FIND DATA: By Author | Journal | Sites   ANALYZE DATA: Help with R | SPSS | Stata | Excel   WHAT'S NEW? US Politics | Int'l Relations | Law & Courts
   FIND DATA: By Author | Journal | Sites   WHAT'S NEW? US Politics | IR | Law & Courts
If this link is broken, please report as broken. You can also submit updates (will be reviewed).
Insights from the Field

Foreign Workers Not the Only Problem on MTurk: An Indian Quality Control Study


Mechanical Turk
Indian workers
data reliability
response accuracy
Methodology
R&P
11 R files
4 Datasets
4 Text
1 Other
Dataverse
Anomalous Responses on Amazon Mechanical Turk: An Indian Perspective was authored by William O'Brochta and Sunita Parikh. It was published by Sage in R&P in 2021.

Surprising Finding: 26% of surveyed Indian Mechanical Turk workers correctly passed U.S.-specific survey questions.

Method & Context:

We surveyed Indian Mechanical Turk respondents. Counter to expectations, a significant number (26%) successfully navigated MTurk's detection mechanisms for foreign workers accessing the platform, while only 3% falsely claimed U.S. residency.

The Solution Revealed:

*

Restricting participation to Master Workers significantly improved location accuracy among Indian respondents.

* Removing explicit U.S.-location requirements further enhanced data reliability.

*

By implementing these simple adjustments, researchers can boost the quality of responses without drastically increasing costs.

Implications:

This research highlights practical steps for improving MTurk's utility in political science studies by addressing location-specific response issues.

data
Find on Google Scholar
Find on JSTOR
Find on Sage Journals
Rsearch & Politics
Podcast host Ryan