Read Political Science Articles with Replication Data

Insights from the Field

When Robust Standard Errors Reveal Bigger Problems — And How to Fix Them

robust SE

misspecification

information matrix

simulation

software

How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It was authored by Gary King and Margaret Roberts. It was published by Cambridge in Pol. An. in 2015.

🔎 What this paper finds

Robust standard errors are widely used to correct standard errors for model misspecification. However, when robust and classical standard errors diverge, that divergence itself signals substantial misspecification. Assuming the misspecification is nevertheless small enough to leave everything else unbiased requires considerable optimism. Even if that optimism is warranted, relying on a misspecified model—whether or not robust standard errors are used—will bias estimators of all but a few quantities of interest.

🧭 What this paper offers

A clearer, more productive way to understand and use robust standard errors as diagnostic clues rather than a blanket fix.
A new, general, and easier-to-use statistic—the generalized information matrix test—that formally assesses misspecification by comparing robust and classical variance estimates.
Practical illustrations via simulations and real examples drawn from published research.

🧪 How the generalized information matrix test works

The test hinges on measurable differences between robust and classical variance estimates.
It provides a formal test statistic that flags when those differences indicate substantive model misspecification rather than benign departures.
The procedure is designed to be broadly applicable and simpler to implement than many existing formal tests.

📈 Key implications for applied researchers

Divergence between robust and classical standard errors should not be dismissed; it often exposes deeper methodological problems.
Settling for a misspecified model will typically bias estimators except for a limited set of targets, so robust SEs alone do not guarantee valid inference.
Rather than abandoning robust standard errors, use them as indicators of misspecification, likely bias, and a guide toward more reliable and defensible inferences.

⚙️ Practical tools and availability

Accompanying software implements the generalized information matrix test and the diagnostic workflow demonstrated in the simulations and real-data examples, enabling applied researchers to evaluate misspecification and improve statistical practice.