Online Survey Quality, PoliSciData.com Special Edition

About This Feature

This special edition of Political Science Data examines the quality and reliability of online surveys, exploring issues like sample representativeness, response bias, and data validity. Understanding these challenges is crucial for researchers and practitioners as online surveys become an increasingly common tool for gathering public opinion and behavioral data. Featured on site 2024/25.

Replication Data from Peer-Reviewed Studies

Online Social Ties Mirror Offline Relationships: Implications for Political Science Research
Social Networks
Experimental Methods
External Validity
Tie Similarity
APSR
8 R files
6 Stata files
16 PDF files
19 datasets
4 LaTeX files
6 text files
Dataverse

i
Online Recruitment in India vs. U.S.: Not All Samples Can Make Valid Inferences
Representative Samples
Convenience Samples
Partisanship Effects
US Benchmarks
India Recruitment
PSR&M
16 R files
9 text files
14 datasets
6 PDF files
1 LaTeX files
2 HTML files
Dataverse

i
Turn Open-Ended Answers Into Continuous Attention Checks
Manipulation Checks
Attention Checks
Text-as-data
Survey Experiments
R Package
Pol. An.
3 R files
1 other files
17 PDF files
1 images
9 LaTeX files
1 text files
Dataverse

i
Amazon Mechanical Turk's Data Quality Crisis: New Insights into Detection
Mechanical Turk
VPNs
Data Quality
Fraud Detection
PSR&M
1 R files
4 Stata files
12 images
4 PDF files
40 datasets
1 text files
Dataverse

i
Factual Checks Reveal Attention: A New Tool for Experimental Clarity
Factual Manipulation Checks
US Politics
Attention Measurement
Experimental Methods
AJPS
2 Stata files
1 PDF files
8 datasets
1 text files
Dataverse

i
Attention Not Enough? Why Single Survey Screeners Fall Short in Political Studies
Attention
Representation
Self-administered Surveys
AJPS
3 Stata files
8 datasets
3 text files
Dataverse

i
How Do Survey Experiments on Mechanical Turk Generalize? New Replication Evidence Provides Insights.
Experimental Generalization
Mechanical Turk Replicates
Demographic Variation
Treatment Effects
PSR&M
7 R files
6 HTML files
4 datasets
1 text files
Dataverse

i
Dropping Manipulation-Check Failures Can Produce Serious Bias
Manipulation Check
Experimental Design
Bounds
Causal Inference
Treatment Effects
Pol. An.
1 archives
Dataverse

i
Screeners Could Enhance Political Science Data Quality
Screeners For Attention
Item-response Theory
Survey Standardization
PSR&M
3 R files
1 Stata files
1 text files
1 datasets
Dataverse

i
Online Recruitment in China: Are Crowdsourced Samples Representative of Netizens?
Witmart Platform
Chinese Internet Users
Sampling Validity
Post-stratification Weights
R&P
1 R files
6 datasets
4 text files
Dataverse

i
Ignoring Inattentive Respondents Biases Political Surveys — Even List Experiments
Inattentiveness
Instructed-Response
List Experiment
Survey Bias
Online Survey
Pol. An.
2 R files
2 datasets
1 text files
Dataverse

i
How Fast Answers Reveal Unseen Inattentiveness in Online Surveys
Attentiveness
Response Time
Clustering
Web Surveys
Survey Quality
Pol. An.
1 archives
Dataverse

i
How Crowdsourcing Makes Local Government Data Accurate and Cheap
Local Government
Crowdsourcing
Data Validation
Consensus Measures
United States
Pol. An.
1 archives
Dataverse

i
Sponsorship Shapes Survey Responses — A New Look at Online Polling Biases
Online Survey
Sampling Bias
Response Bias
Political Engagement
Pol. Behav.
6 R files
1 text files
5 datasets
Dataverse

i

Also see Journal Data Archives | Author Replication Data

Watch & Learn

►

A Marist Poll Academy case study (2:30).

Random Digit Dialing Vs. Registration Based Sampling

►

A Marist Poll Academy case study (2:29).

Does It Matter Who Sponsors a Poll?

MORE VIDEOS: See Video Channels for more political science videos!

LEARN HOW: Watch Lecture Videos for Essentials of Political Analysis, Video Tutorials for R, Stata, SPSS, and Excel