FIND DATA: By Author | Journal | Sites   ANALYZE DATA: Help with R | SPSS | Stata | Excel   WHAT'S NEW? US Politics | Int'l Relations | Law & Courts
   FIND DATA: By Author | Journal | Sites   WHAT'S NEW? US Politics | IR | Law & Courts
If this link is broken, please report as broken. You can also submit updates (will be reviewed).
Conjoint Surveys Withstand Dozens of Tasks, New Experiments Show
Insights from the Field
conjoint
satisficing
MTurk
SSI
survey experiment
Methodology
Pol. An.
2 R files
2 Datasets
1 Text
Dataverse
The Number of Choice Tasks and Survey Satisficing in Conjoint Experiments was authored by Kirk Bansak, Jens Hainmueller, Daniel J. Hopkins and Teppei Yamamoto. It was published by Cambridge in Pol. An. in 2018.

Conjoint survey designs are now common tools for studying decision-making, but a practical question arises for researchers: how many choice tasks can respondents do before satisficing meaningfully reduces response quality?

📋 How Respondents Were Tested

  • Respondents were asked to complete as many as 30 conjoint choice tasks.
  • Experiments were fielded on two common survey platforms: Amazon's Mechanical Turk (MTurk) and Survey Sampling International (SSI).

📊 What the Experiments Found

  • Detectable increases in survey satisficing occurred as the number of tasks rose, but these increases were quite limited.
  • Conjoint designs showed surprising robustness: even with dozens of tasks, response quality did not decline substantially in the study contexts examined.

🔎 Why This Matters

  • The results provide practical guidance for survey designers weighing the trade-off between statistical power and respondent burden.
  • In similar populations and contexts, researchers can assign multiple—potentially dozens of—conjoint tasks without expecting large losses in data quality, though monitoring satisficing indicators remains advisable.
data
Find on Google Scholar
Find on JSTOR
Find on CUP
Political Analysis
Podcast host Ryan