Evaluating methodological and reporting practices of L2 meta-analyses

Abstract

In the field of second language (L2) research, interest in applying meta-analytic techniques has gained momentum in recent years. Considering the potentially far-reaching impact of meta-analyses, they must adhere to rigorous methodological practices and a high level of transparency regarding decisions made throughout the meta-analytic process. This study empirically assessed the methodological and reporting practices of 224 L2 meta-analyses published across 99 journals. To conduct systematic coding, a comprehensive instrument was developed, comprising 39 items that each address a key aspect of meta-analytic methodology or reporting practice. The overall findings provided an overview of current practices, identifying both strengths and areas for improvement. Based on the findings, recommendations were offered for improving methodological rigor and transparency in L2 meta-analyses. Additionally, the comprehensive coding instrument developed in this study offers a valuable resource for the systematic evaluation of methodological and reporting practices in future L2 meta-analytic research.