Online Survey Quality, PoliSciData.com Special Feature

About This Feature

This special feature of Political Science Data examines the quality and reliability of online surveys, exploring issues like sample representativeness, response bias, and data validity. Understanding these challenges is crucial for researchers and practitioners as online surveys become an increasingly common tool for gathering public opinion and behavioral data. Featured on site 2024/25.

Watch & Learn

►

How Did the Pew Research Center Identify Twitter Bots? i

From the Pew Research Center (4:25).

►

Random Digit Dialing Vs. Registration Based Sampling i

A Marist Poll Academy case study (2:30).

Replication Data from Peer-Reviewed Studies

Turn Open-Ended Answers Into Continuous Attention Checks
Manipulation Checks
Attention Checks
Text-as-data
Survey Experiments
R Package
2022
Pol. An.
3 R files
1 other files
17 PDF files
1 images
9 LaTeX files
1 text files
Dataverse

i
Amazon Mechanical Turk's Data Quality Crisis: New Insights into Detection
Mechanical Turk
VPNs
Data Quality
Fraud Detection
2020
PSR&M
1 R files
4 Stata files
12 images
4 PDF files
40 datasets
1 text files
Dataverse

i
Online Recruitment in India vs. U.S.: Not All Samples Can Make Valid Inferences
Representative Samples
Convenience Samples
Partisanship Effects
US Benchmarks
India Recruitment
2020
PSR&M
16 R files
9 text files
14 datasets
6 PDF files
1 LaTeX files
2 HTML files
Dataverse

i
Sponsorship Shapes Survey Responses — A New Look at Online Polling Biases
Online Survey
Sampling Bias
Response Bias
Political Engagement
2022
Pol. Behav.
6 R files
1 text files
5 datasets
Dataverse

i
Dropping Manipulation-Check Failures Can Produce Serious Bias
Manipulation Check
Experimental Design
Bounds
Causal Inference
Treatment Effects
2019
Pol. An.
1 archives
Dataverse

i
Online Recruitment in China: Are Crowdsourced Samples Representative of Netizens?
Witmart Platform
Chinese Internet Users
Sampling Validity
Post-stratification Weights
2018
R&P
1 R files
6 datasets
4 text files
Dataverse

i
How Crowdsourcing Makes Local Government Data Accurate and Cheap
Local Government
Crowdsourcing
Data Validation
Consensus Measures
United States
2020
Pol. An.
1 archives
Dataverse

i
Online Social Ties Mirror Offline Relationships: Implications for Political Science Research
Social Networks
Experimental Methods
External Validity
Tie Similarity
2017
APSR
8 R files
6 Stata files
16 PDF files
19 datasets
4 LaTeX files
6 text files
Dataverse

i
Attention Not Enough? Why Single Survey Screeners Fall Short in Political Studies
Attention
Representation
Self-administered Surveys
2014
AJPS
3 Stata files
8 datasets
3 text files
Dataverse

i
How Fast Answers Reveal Unseen Inattentiveness in Online Surveys
Attentiveness
Response Time
Clustering
Web Surveys
Survey Quality
2022
Pol. An.
1 archives
Dataverse

i
Factual Checks Reveal Attention: A New Tool for Experimental Clarity
Factual Manipulation Checks
US Politics
Attention Measurement
Experimental Methods
2019
AJPS
2 Stata files
1 PDF files
8 datasets
1 text files
Dataverse

i
Screeners Could Enhance Political Science Data Quality
Screeners For Attention
Item-response Theory
Survey Standardization
2021
PSR&M
3 R files
1 Stata files
1 text files
1 datasets
Dataverse

i
Ignoring Inattentive Respondents Biases Political Surveys — Even List Experiments
Inattentiveness
Instructed-Response
List Experiment
Survey Bias
Online Survey
2019
Pol. An.
2 R files
2 datasets
1 text files
Dataverse

i
How Do Survey Experiments on Mechanical Turk Generalize? New Replication Evidence Provides Insights.
Experimental Generalization
Mechanical Turk Replicates
Demographic Variation
Treatment Effects
2019
PSR&M
7 R files
6 HTML files
4 datasets
1 text files
Dataverse

i

Also see Journal Data Archives

SPECIAL FEATURE: Online Survey Quality