How-to
How To Conduct Replication Studies
Bonett, D. G. (2021). Design and analysis of replication studies. Organizational Research Methods, 24(3), 513-529. https://doi.org/10.1177/1094428120911088
Maula, M., & Stam, W. (2019). Enhancing Rigor in Quantitative Entrepreneurship Research. Entrepreneurship Theory and Practice, 44(6), 1059–1090. https://doi.org/10.1177/1042258719891388
Köhler, T., & Cortina, J. M. (2019). Play It Again, Sam! An Analysis of Constructive Replication in the Organizational Sciences. Journal of Management, 47(2), 488–518. https://doi.org/10.1177/0149206319843985
Aguinis, H., & Solarino, A. M. (2019). Transparency and replicability in qualitative research: The case of interviews with elite informants. Strategic Management Journal. https://doi.org/10.1002/smj.3015
Aguinis H., Cascio W.F., Ramani R.S. (2020) Science’s Reproducibility and Replicability Crisis: International Business Is Not Immune. In: Eden L., Nielsen B., Verbeke A. (eds) Research Methods in International Business. JIBS Special Collections. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-22113-3_2
Anderson, S. F., & Maxwell, S. E. (2016). There’s more than one way to conduct a replication study: Beyond statistical significance. Psychological methods, 21(1), 1. https://doi.org/10.1037/met0000051
Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R., Nosek, B. A., Perugini, M., Roberts, B. W., Schmitt, M., Van Aken, M. A. G., Weber, H., & Wicherts, J. M. (2013). Recommendations for Increasing Replicability in Psychology. European Journal of Personality, 27(2), 108–119. https://doi.org/10.1002/per.1919
Benson, L., & Borrego, M. (2015). The Role of Replication in Engineering Education Research. Journal of Engineering Education, 104(4), 388–392. https://doi.org/10.1002/jee.20082
Bettis, R. A., Ethiraj, S., Gambardella, A., Helfat, C., & Mitchell, W. (2016). Creating repeatable cumulative knowledge in strategic management. Strategic Management Journal, 37(2), 257–261. https://doi.org/10.1002/smj.2477
Bettis, R. A., Helfat, C. E., & Shaver, J. M. (2016). The necessity, logic, and forms of replication. Strategic Management Journal, 37(11), 2193-2203. https://doi.org/10.1002/smj.2580
Block, J., Kuckertz, A. Seven principles of effective replication studies: strengthening the evidence base of management research. Manag Rev Q 68, 355–359 (2018). https://doi.org/10.1007/s11301-018-0149-3
Bonett, D. G. (2012). Replication-extension studies. Current Directions in Psychology, 21, 409-412. https://doi.org/10.1177/0963721412459512
Brandt, M. J., IJzerman, H., Dijksterhuis, A., Farach, F. J., Geller, J., Giner-Sorolla, R., ... & Van't Veer, A. (2014). The replication recipe: What makes for a convincing replication?. Journal of Experimental Social Psychology, 50, 217-224. https://doi.org/10.1016/j.jesp.2013.10.005
Brendel, Alfred & Greulich, Reinhard & Niederman, Fred & Trang, Simon. (2020). Towards a Greater Diversity of Replication Studies. https://aisel.aisnet.org/trr/vol6/iss1/20/
Briker, R., & Gerpott, F. H. (2023). Publishing Registered Reports in Management and Applied Psychology: Common Beliefs and Best Practices. Organizational Research Methods, 10944281231210309. https://doi.org/10.1177/10944281231210309
Brodeur, A., Dreber, A., Hoces De La Guardia, F., & Miguel, E. (2023). Replication games: How to make reproducibility research more systematic. Nature, 621(7980), 684–686. https://doi.org/10.1038/d41586-023-02997-5
Brown, A. N., & Wood, B. D. K. (2018). Which tests not witch hunts: a diagnostic approach for conducting replication research. Economics, 12(1). http://dx.doi.org/10.5018/economics-ejournal.ja.2018-53
DeCelles, K. A., Howard-Grenville, J., & Tihanyi, L. (2021). From the Editors—Improving the Transparency of Empirical Research Published in AMJ. Academy of Management Journal, 64(4), 1009–1015. https://doi.org/10.5465/amj.2021.4004
Edlund, J. E., Cuccolo, K., Irgens, M. S., Wagge, J. R., & Zlokovich, M. S. (2021). Saving Science Through Replication Studies. Perspectives on Psychological Science, 174569162098438. https://doi.org/10.1177/1745691620984385
Gómez, O. S., Juristo, N., & Vegas, S. (2014). Understanding replication of experiments in software engineering: A classification. Information and Software Technology, 56(8), 1033–1048. http://dx.doi.org/10.1016/j.infsof.2014.04.004
Hedges, L. V., & Schauer, J. M. (2019). More than one replication study is needed for unambiguous tests of replication. Journal of Educational and Behavioral Statistics, 44(5), 543-570. https://doi.org/10.3102/1076998619852953
Hofman, J. M., Goldstein, D. G., Sen, S., Poursabzi-Sangdeh, F., Allen, J., Dong, L. L., Fried, B., Gaur, H., Hoq, A., Mbazor, E., Moreira, N., Muso, C., Rapp, E., & Terrero, R. (2021). Expanding the scope of reproducibility research through data analysis replications. Organizational Behavior and Human Decision Processes, 164, 192–202. https://doi.org/10.1016/j.obhdp.2020.11.003
Hubbard, R., Vetter, D. E., & Little, E. L. 1998. Replication in strategic management: Scientific testing for validity, generalizability, and usefulness. Strategic Management Journal, 19(3): 243-254. https://doi.org/10.1002/(SICI)1097-0266(199803)19:3%3C243::AID-SMJ951%3E3.0.CO;2-0
Isager, P. M., Van Aert, R. C., Bahník, Š., Brandt, M., DeSoto, K. A., Giner-Sorolla, R., ... & Lakens, D. (2020). Deciding what to replicate: A decision model for replication study selection under resource and knowledge constraints. https://doi.org/10.31222/osf.io/2gurz
Jarke, H., Anand-Vembar, S., Alzahawi, S., Andersen, T. L., Bojanić, L., Carstensen, A., Feldman, G., Garcia-Garzon, E., Kapoor, H., Lewis, S., Todsen, A. L., Većkalov, B., Zickfeld, J. H., & Geiger, S. J. (2022). A Roadmap to Large-Scale Multi-Country Replications in Psychology. Collabra: Psychology, 8(1), 57538. https://doi.org/10.1525/collabra.57538
Kraimer, M. L., Martin, X., Schulze, W., & Seibert, S. E. 2023. What does it mean to test theory? Journal of Management Scientific Reports, 1(1): 8-17. https://doi.org/10.1177/27550311231153484
Maniadis, Z., Tufano, F., & List, J. A. (2017). To Replicate or Not to Replicate? Exploring Reproducibility in Economics through the Lens of a Model and a Pilot Study. The Economic Journal, 127(605), F209–F235. https://doi.org/10.1111/ecoj.12527
Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015). Is psychology suffering from a replication crisis? What does “failure to replicate” really mean?. American Psychologist, 70(6), 487. https://doi.org/10.1037/a0039400
Miller, C. C., & Bamberger, P. (2016). Exploring emergent and poorly understood phenomena in the strangest of places: The footprint of discovery in replications, meta-analyses, and null findings. In Academy of Management Discoveries (Vol. 2, No. 4, p. 313-319). https://doi.org/10.5465/amd.2016.0115
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018). The preregistration revolution. Proceedings of the National Academy of Sciences, 115(11), 2600–2606. https://doi.org/10.1073/pnas.1708274114
Obenauer, W. G. (2024). Designing, executing, and publishing replication research: Best practices for successfully taking replication ideas from conceptualization to publication. Journal of Management Scientific Reports, 27550311241232661. https://doi.org/10.1177/27550311241232661
Pagell, M. (2020). Replication without repeating ourselves: Addressing the replication crisis in operations and supply chain management research. Journal of Operations Management, 67(1), 105–115. https://doi.org/10.1002/joom.1120
Simons, D. J. (2014). The Value of Direct Replication. Perspectives on Psychological Science, 9(1), 76–80. https://doi.org/10.1177/1745691613514755
Singh, K., Ang, S. H., & Leong, S. M. 2003. Increasing replication for knowledge accumulation in strategy research. Journal of Management, 29(4): 533-549. https://doi.org/10.1016/S0149-2063(03)00024-2
Standing, L. G., Grenier, M., Lane, E. A., Roberts, M. S., & Sykes, S. J. (2014). Using replication projects in teaching research methods. Psychology Teaching Review, 20, 96-104. http://www.jstor.org/stable/188390
Stroebe, W., & Strack, F. (2014). The Alleged Crisis and the Illusion of Exact Replication. Perspectives on Psychological Science, 9(1), 59–71. https://doi.org/10.1177/1745691613514450
Tierney, W., Hardy III, J. H., Ebersole, C. R., Leavitt, K., Viganola, D., Clemente, E. G., ... & Hiring Decisions Forecasting Collaboration. (2020). Creative destruction in science. Organizational Behavior and Human Decision Processes, 161, 291-309. https://doi.org/10.1016/j.obhdp.2020.07.002
Toncar, M. F., & Munch, J. M. (2010). Meaningful replication: When is a replication no longer a replication? A rejoinder to Stella and Adam (2008). Journal of Marketing Theory and Practice, 18(1), 71-80. https://doi.org/10.2753/MTP1069-6679180105