Choose the Right Test: Validity Claims for the Computer Adaptive Test—Problem Solving Measure ( CAT ‐ PSM )

ABSTRACT

This study presents validity evidence for the Computer Adaptive Test–Problem Solving Measure (CAT‐PSM), a computer‐adaptive assessment of middle grades mathematical problem‐solving performance. Targeted to grades 6–8, the CAT‐PSM draws on content aligned with the Common Core State Standards for Mathematics (CCSSM). Using validation as a methodological framework, qualitative data were collected and analyzed to examine claims related to test content and response processes. Findings support three claims regarding test content: (a) items reflect CCSSM‐aligned mathematics and have well‐defined solution spaces; (b) items adhere to an open, complex, and realistic problem framework; and (c) items demonstrate evidence of limited bias. For response processes, evidence indicates that student approaches align with hypothesized solution strategies. These results extend prior validation work and provide evidence to support the intended interpretation and use of CAT‐PSM scores, offering educators and researchers increased confidence in the validity of the assessment's uses and interpretations.