When preparing the analysis for our recent preregistered field experiment on the effect of carbon foodprint labels, we decided to implement an (interactive) specification curve analysis to present insights on how large our researcher degrees of freedom were, even after preregistration. This blog post introduces the idea and links you to the GitHub repo, where you can reproduce and explore our analyis relatively quickly using GitHub Codepaces.
Building on a current working papers of David Veenman and myself, and using ‘fancy’ animations, we discuss the issues related to non-random outliers in empirical archival research work and whether robust regression methods can be viewed as a pancea (spoiler: they can’t). Building on these insights we suggest a work-flow for archival work that helps us to take outlier treatment to the next level.
Designing empirical research to be easily reproducible is no easy task. The new ’treat’ repository, developed by the Open Science Data Center of the TRR 266 Accounting for Transparency, accompanied by a series of short videos, leads the way, step by step.