Statistical significance, especially in small samples, is a problem in all empirical social science, including economics. Here statistician, blogger, and author Andrew Gelman of Columbia University talks with EconTalk host Russ Roberts about the challenges facing psychologists and economists when using small samples.
On the surface, finding statistically significant results in a small sample would seem to be extremely impressive and would make one even more confident that a larger sample would find even stronger evidence. Yet, larger samples often fail to lead to replication. Gelman discusses how this phenomenon is rooted in the incentives built into human nature and the publication process. The conversation closes with a general discussion of the nature of empirical work in the social sciences.
A direct link to the audio is available here.