Quality assurance methods for performance-based assessments |
| |
Authors: | Boulet John R McKinley Danette W Whelan Gerald P Hambleton Ronald K |
| |
Affiliation: | (1) Research and Evaluation, Educational Commission for Foreign Medical Graduates (ECFMG), 3624 Market Street, Philadelphia, PA 19104-2685, USA;(2) University of Massachusetts, MA, USA |
| |
Abstract: | Performance assessments are subject to many potential error sources. For performance-based assessments, including standardized patient (SP) examinations, these error sources, if left unchecked, can compromise the validity and reliability of scores. Quality assurance (QA) measures, both quantitative and qualitative, can be used to ensure that candidate scores are accurate and reasonably free from measurement error. The purpose of this paper is to outline several QA strategies that can be used to identify potential content- and score-related problems with SP assessments. These approaches include case analyses and various comparisons of primary and observer scores. Specific examples from the ECFMG Clinical Skills Assessment(CSA®) are used to educate the reader concerning appropriate statistical methods and legitimate data interpretations. The results presented in this investigation highlight the need for well-defined training regimes, regular feedback to those involved in rating/scoring performances, and detailed statistical analyses of all scores.This revised version was published online in October 2005 with corrections to the Cover Date. |
| |
Keywords: | clinical skills performance assessment psychometrics quality assurance standardized patients |
本文献已被 PubMed SpringerLink 等数据库收录! |
|