FIND DATA: By Author | Journal | Sites   ANALYZE DATA: Help with R | SPSS | Stata | Excel   WHAT'S NEW? US Politics | Int'l Relations | Law & Courts
   FIND DATA: By Author | Journal | Sites   WHAT'S NEW? US Politics | IR | Law & Courts
If this link is broken, please report as broken. You can also submit updates (will be reviewed).
Insights from the Field

Why Standard Interaction Tests Mislead and a Better Lasso-Based Fix


interactions
regularization
lasso
post-double selection
heterogeneity
Methodology
Pol. An.
9 R files
116 datasets
35 PDF files
1 text files
1 other files
Dataverse
Reducing Model Misspecification and Bias in the Estimation of Interactions was authored by Matthew Blackwell and Michael Olson. It was published by Cambridge in Pol. An. in 2022.

๐Ÿ” The Problem and Aim

Estimating treatment-effect variation often relies on including a multiplicative interaction between treatment and a proposed effect modifier in a regression. This simple approach can produce biased inferences when the modifier interacts with other covariates that are not modeled, while adding many interaction terms can cause unstable estimates from overfitting. The paper investigates these trade-offs and asks how adaptive, machine-learning methods can be used to stabilize interaction estimates without introducing new biases.

๐Ÿงช How the Methods Were Evaluated

  • Illustrates how off-the-shelf adaptive methods introduce two distinct forms of regularization bias:
  • direct regularization bias (coefficients are shrunk toward zero by penalization), and
  • indirect regularization bias (variable selection or shrinkage omits or downweights covariates that interact with the modifier, biasing the interaction estimate).
  • Proposes a post-double selection strategy that uses several lasso estimators to choose which interactions to include in the final model, then estimates interaction and marginal effects with uncertainty quantification.
  • Compares performance through simulation experiments and two empirical applications to demonstrate practical consequences.

๐Ÿ“ˆ Key Findings

  • The post-double selection approach yields more reliable interaction and marginal effect estimates than competing methods in simulations, including settings with many covariates.
  • Machine-learning methods used without careful selection can produce misleading results because of both direct and indirect regularization bias.
  • In two empirical examples, the choice of estimation method substantially altered conclusions about effect heterogeneity, showing real-world importance.

๐Ÿ’ก Why It Matters

These results show that routine interaction tests can be fragile in observational and high-dimensional settings. The proposed lasso-based post-double selection framework reduces model misspecification and bias while allowing valid uncertainty assessment for interaction and marginal effects, helping researchers draw more credible inferences about treatment-effect heterogeneity.

data
Find on Google Scholar
Find on JSTOR
Find on CUP
Political Analysis
Podcast host Ryan