Mini-Many Analysts: Using Registered Reports to Learn About Analytical Flexibility
Amanda Kay Montoya, Gareth Ong Yu, John TawaIntroduction
Analytical flexibility describes the multiple defensible analytic strategies researchers can use. Registered reports reduce analytical flexibility by requiring a two-stage submission process, in which journals provide an in-principle acceptance after Stage 1.
Statement of the Problem
Open science is a key concept for undergraduate psychology students but relies on an understanding of analytical flexibility. Limited examples exist that integrate analytical flexibility and open science in psychology undergraduate education.
Literature Review
The present article provides an example learning activity where students read a Stage 1 registered report, receive the data, and implement the analysis plan as described. In an example implementation, students gave a 10-min oral presentation of their results, then compared them with the final Stage 2 manuscript and those of other students.
Teaching Implications
We provide example materials and identify registered reports with analytical approaches appropriate for undergraduate students. This project could be integrated into advanced undergraduate or graduate courses in research methods, statistics, or laboratory work.
Conclusion
Activities that use registered reports or preregistrations can help students achieve multiple important learning outcomes, including understanding the impact of analytical flexibility, the advantages and limitations of open science practice, and the use of statistical methods with real data.