2-day Crowdsourcing Workshop for Doctoral Students within the SFB-TRR 161
Event date:  March 30, 2017 9:00 AM  to March 31, 2017 6:00 PM

This In-depth crash-course to crowdsourcing is a seminar aimed at teaching doctoral students to efficiently conduct crowdsourcing studies as part of their doctoral thesis work. In essence, the seminar will cover the whole process of performing an experiment and introduce some useful tools for analyzing the results. Starting with an introduction to the topic, participants will be introduced to the basic experimental procedure. Subsequently students will get to design a small scale crowdsourcing study by themselves. In the process, they will be guided around the pitfalls of experiment design, as well as given a spectrum of handy tools that simplify the process.

Particular attention will be focused on crowdsourcing subjective quality attributes and annotations, such as qualities of NPR graphics and visualizations, or annotating artifacts in renderings. Additionally, participants will experience crowdsourcing from the crowd worker’s position, to better understand the crowd. One invited speaker will share their insight into the dynamics of crowdsourcing and experimental procedures. Finally, the results of an example crowd-study will be analyzed, and any remaining questions will be resolved in an open discussion.



Thursday, March, 30th 2017

9:00 Introduction to Crowdsourcing

10:30 Coffee Break

10:45 Practical Introduction to Designing Crowd Experiments

12:15 Lunch

13:15 Hands-on Session & Toolsets

14:45 Coffee Break

15:00 Discussion of Issues & Pitfalls

16:30 Invited Speaker

19:00 Dinner at Brigantinus


Friday, March 31st 2017

9:00 Analysis of Results

10:30 Coffee Break

10:45 Q&A session

12:15 Lunch

13:00 TRR Collaboration Sessions

Event location:  University of Konstanz