Reflecting on scoping review methodology with a language testing example

Abstract

This chapter provides a reflective analysis of conducting a scoping review on L2 learners’ cognitive processes in language testing as a methodological case study (for the published review protocol, see

). Guided by framework, the chapter explores both anticipated and emergent methodological and ethical challenges, the courses of action taken, and alternative pathways not pursued. Central themes include the tension between comprehensiveness and feasibility, and the role of AI in research synthesis. Drawing on the team’s direct experience, the chapter distinguishes between mechanical tasks suitable for AI automation and interpretive tasks requiring human expertise, concluding with key lessons for navigating similar challenges in research synthesis.