Faculty Publications

Reproducible Analyses In Education Research

Document Type

Article

Journal/Book/Conference Title

Review of Research in Education

Volume

45

Issue

1

First Page

195

Last Page

222

Abstract

A reproducible analysis is one in which an independent entity, using the same data and the same statistical code, would obtain the exact same result as the previous analyst. Reproducible analyses utilize script-based analyses and open data to aid in the reproduction of the analysis. A reproducible analysis does not ensure the same results are obtained if another sample of data is obtained, often referred to as replicability. Reproduction and replication of studies are discussed as well as the overwhelming benefits of creating a reproducible analysis workflow. A tool is proposed to aid in the evaluation of studies to describe which element in a study has a strong reproducible workflow and areas that could be improved. This tool is meant to serve as a discussion tool, not to rank studies or devalue studies that are unable to share data or statistical code. Finally, discussion surrounding reproducibility for qualitative studies are discussed along with unique challenges for adopting a reproducible analysis framework.

Department

Department of Educational Psychology, Foundations, and Leadership Studies

Original Publication Date

3-1-2021

DOI of published version

10.3102/0091732X20985076

Repository

UNI ScholarWorks, Rod Library, University of Northern Iowa

Language

en

Link to Full Text

Comments?

Share

COinS