Motivation of Workers on Microtask Crowdsourcing Platforms
von: Babak Naderi
Springer-Verlag, 2018
ISBN: 9783319727004
Sprache: Englisch
125 Seiten, Download: 3573 KB
Format: PDF, auch als Online-Lesen
| Acknowledgements | 6 | ||
| Contents | 8 | ||
| Acronyms | 10 | ||
| Abstract | 12 | ||
| Zusammenfassung | 14 | ||
| 1 Introduction | 16 | ||
| 1.1 Crowdsourcing Microtask | 17 | ||
| 1.1.1 Platforms | 17 | ||
| 1.1.2 Tasks | 19 | ||
| 1.2 Scope and Research Questions | 20 | ||
| 2 Theoretical Background on Motivation | 22 | ||
| 2.1 Taxonomy | 22 | ||
| 2.1.1 Motivation | 22 | ||
| 2.1.2 Influencing Factors | 26 | ||
| 2.1.3 Outcomes | 27 | ||
| 2.2 Other Motivational Theories | 28 | ||
| 2.3 Motivation in Crowdsourcing | 29 | ||
| 2.4 Chapter Summary | 31 | ||
| 3 Who are the Crowdworkers? | 32 | ||
| 3.1 Method | 33 | ||
| 3.2 Data Collection | 34 | ||
| 3.3 Results | 35 | ||
| 3.3.1 Demographics | 36 | ||
| 3.3.2 Socioeconomic Status | 37 | ||
| 3.3.3 Crowdwork Conditions | 40 | ||
| 3.4 Chapter Discussion and Summary | 41 | ||
| 4 How to Measure Motivation? | 43 | ||
| 4.1 Initial Item Set | 43 | ||
| 4.2 Study 4.1: Construction of the CWMS Questionnaire | 44 | ||
| 4.2.1 Method | 44 | ||
| 4.2.2 Factorial Structure of the Questionnaire | 47 | ||
| 4.3 Validation of the Questionnaire | 53 | ||
| 4.4 Chapter Discussion and Summary | 53 | ||
| 5 What Determines Task Selection Strategies? | 59 | ||
| 5.1 Study 5.1: What are the Influencing Factors? | 59 | ||
| 5.1.1 Method | 59 | ||
| 5.1.2 Results | 60 | ||
| 5.1.3 Discussion | 61 | ||
| 5.2 Study 5.2: How to Measure the Task-Related Factors? | 62 | ||
| 5.2.1 Method | 64 | ||
| 5.2.2 Results | 66 | ||
| 5.2.3 Discussion | 69 | ||
| 5.3 Study 5.3: Is the Task-Selection Behavior of Workers Predictable? | 69 | ||
| 5.3.1 Method | 70 | ||
| 5.3.2 Results | 72 | ||
| 5.3.3 Discussion | 77 | ||
| 5.4 Study 5.4: What is the Relative Importance … | 79 | ||
| 5.4.1 Method | 80 | ||
| 5.4.2 Results | 83 | ||
| 5.4.3 Discussion | 86 | ||
| 5.5 Study 5.5: Is the Expected Workload Predictable? | 87 | ||
| 5.5.1 Method | 87 | ||
| 5.5.2 Results | 90 | ||
| 5.5.3 Discussion | 91 | ||
| 5.6 Chapter Discussion and Summary | 92 | ||
| 6 What Influences Workers' Performance? | 95 | ||
| 6.1 Motivation | 95 | ||
| 6.1.1 Survey Task | 95 | ||
| 6.1.2 Study 6.1: Algorithmic and Heuristic Tasks | 97 | ||
| 6.1.3 Discussion | 99 | ||
| 6.2 Task Design | 100 | ||
| 6.2.1 Study 6.2: Effect of Being Observed on the Reliability of Responses | 100 | ||
| 6.2.2 Study 6.3: Effect of Trapping Questions on the Performance of Crowdworkers | 103 | ||
| 6.3 Chapter Discussion and Summary | 109 | ||
| 7 Conclusion and Outlook | 111 | ||
| 7.1 Conclusion | 111 | ||
| 7.2 Future Work | 113 | ||
| 7.2.1 General Motivation | 113 | ||
| 7.2.2 Task-Specific Motivation | 114 | ||
| 7.2.3 Performance | 114 | ||
| Appendix A Features and the Model for Predicting Expected Workload | 116 | ||
| A.1 Features | 116 | ||
| A.1.1 Syntax Based Features | 116 | ||
| A.1.2 Semantic Based Features | 117 | ||
| A.1.3 Visual Features | 117 | ||
| A.2 Prediction Model | 118 | ||
| References | 120 |