FIND DATA: By Author | Journal | Sites   ANALYZE DATA: Help with R | SPSS | Stata | Excel   WHAT'S NEW? US Politics | Int'l Relations | Law & Courts
   FIND DATA: By Author | Journal | Sites   WHAT'S NEW? US Politics | IR | Law & Courts
If this link is broken, please report as broken. You can also submit updates (will be reviewed).
Insights from the Field

More Attributes, More Responses? Conjoint Surveys Can Handle Complexity Better Than Expected


Conjoint Experiment
Survey Satisficing
Filler Attributes
US Senate
Response Quality
Methodology
PSR&M
1 text files
1 archives
Dataverse
Beyond the Breaking Point? Survey Satisficing in Conjoint Experiments was authored by Kirk Bansak, Jens Hainmueller, Dan Hopkins and Teppei Yamamoto. It was published by Cambridge in PSR&M in 2021.

Conjoint experiments are popular in political science surveys, but researchers lacked guidance on how many attributes could be included before survey satisficing became problematic. This paper addresses that gap by conducting two pre-registered studies examining choices among hypothetical US Senate candidates or hotel rooms.

### Methodology ###

We employed a two-stage experimental design with Amazon Mechanical Turk and Survey Sampling International respondents:

* First stage identified core attributes uncorrelated with the primary variable of interest (Senate candidate appeal).

* Second stage randomly assigned filler attributes to conjoint profiles, varying their number.

### Key Findings ###

Our results indicate that survey satisficing does occur but remains manageable even when respondents face large numbers of attributes:

* Core quantities of interest remain stable across conditions.

* Response quality improves with higher attribute loads (more options).

### Why It Matters ###

These findings offer practical guidance for designing political science surveys using conjoint experiments. Researchers can now confidently include numerous attributes without crippling their survey's validity.

data
Find on Google Scholar
Find on JSTOR
Find on CUP
Political Science Research & Methods
Podcast host Ryan