Comments on: Teaching Replication in Quantitative Empirical Economics https://curriculumconference2013.weaconferences.net/papers/teaching-replication-in-quantitative-empirical-economics/ 3rd May – 14th June 2013 Mon, 09 Jun 2025 11:51:52 +0000 hourly 1 By: Jan H. Höffler https://curriculumconference2013.weaconferences.net/papers/teaching-replication-in-quantitative-empirical-economics/#comment-31 Tue, 14 May 2013 19:29:00 +0000 http://curriculumconference2013.worldeconomicsassociation.org/?p=133#comment-31 We chose the American Economic Review because it was the leading force in introducing an online archive for data and code for replication and it is among the top journals that publish applied econometric studies. The Journal of Political Economy followed the same policy and is also among the very top journals. The four American Economic Journals were introduced by the American Economic Association because they saw that so many good papers were submitted to the American Economic Review and underwent some editorial process but not all of them could be published and not all of them had the quality to be published in similarly renowned journals so they offered the authors the option to choose the option to undergo a quicker review process and get published in these field journals that are good but not among the very top. We included these journals because they have the same replication policy, so material is easily available. Many studies published there are a bit more accessible to students. And it is a good opportunity to check if there is a difference in replicability between journals that are among the very top and those that are still very good but not quite as well established.
Certainly to speak of top journals in econometrics we would also need journals that publish theoretical econometric studies but that was not our focus. Another journal that is important in the field of replication as it has an online archive and an own replication section is the Journal of Applied Econometrics. We however do not suggest our students to replicate studies from that journal for two reasons. Since this journal focuses on advances in econometrics many of the studies published there are quite complicated for many students. In addition, their policy is not to ask for the original code because they think for a true replication the code should be written again. I see good reason for this. For seminars however students cannot be expected to write code that often took researchers many months to write for a publication. Also in case of deviations from published results it could require quite some effort to find out about the reasons and it would often require contact to the original authors and you never know how fast they will reply. In our seminars students also often get in touch with original authors but the way we do it they do not depend on them, otherwise it would not be feasible for seminars.

]]> By: Haiyun Zhao https://curriculumconference2013.weaconferences.net/papers/teaching-replication-in-quantitative-empirical-economics/#comment-30 Thu, 09 May 2013 20:12:09 +0000 http://curriculumconference2013.worldeconomicsassociation.org/?p=133#comment-30 Do you think the six journals your paper focuses are the top journals of econometrics in the world? If so, why?

Haiyun Zhao

]]>