Psychometric Modeling to Identify Examinees’ Strategy Differences during Testing

• DOI: 10.3390/jintelligence12040040
• Publication Date: 2024-03-29T10:33:16Z
• Authors: Clifford E. Hauen...; Susan E. Embretson; Eunbee Kim
• Keywords: Leverage (statistics); Classical test theory

Aptitude test scores are typically interpreted similarly for examinees with the same overall score. However, research has found evidence of examinee differences in strategies, as well continued application appropriate procedures during testing. Such can impact correlates scores, making similar interpretations equivalent questionable. This study presents some item response theory (IRT) models that relevant to identifying strategies and understanding test-taking procedures. First, mixture IRT identify latent classes different patterns responses considered; these have long been available but unfortunately not routinely applied. Strategy between then be studied separately by modeling cognitive complexity variables within each class. Secondly, novel psychometric approaches leverage time information (in particular, residuals) order both inter intraindividual variability processes considered. In doing so, a general method evaluating threats validity is proposed. The utility approach, terms providing more interpretable performance estimates improving administration psychological measurement instruments, demonstrated an empirical example.