Beyond standard checklist assessment: Question sequence may impact student performance

• DOI: 10.1007/s40037-016-0265-5
• Publication Date: 2016-04-07T07:43:27Z
• Authors: Jeff LaRochelle; Steven J. Durning; John R. Boulet; Cees Van der Vleuten; Jeroen Van Merrie...; Jeroen Donkers
• Keywords: Sequence (biology); Inter-Rater Reliability

Introduction Clinical encounters are often assessed using a checklist. However, without direct faculty observation, the timing and sequence of questions not captured. We theorized that can be captured measured coherence scores may distinguish between low high performing candidates.
 Methods A logical key features was determined standard case checklist for an observed structured clinical exam (OSCE). An independent clinician educator reviewed each encounter to provide global rating. Coherence were calculated based on question sequence. These compared with ratings scores.
 Results positively correlated ratings, these correlations increased as improved. explained more variance in student performance improved.
 Discussion Logically sequences indicate higher student, this information is lost when only overall Conclusions The test takers ask accurately recorded, ratings. during by traditional scoring, represent important dimension performance.