

This chapter provides a simplified explanation of these two complex ideas. You should examine these features when evaluating the suitability of the test for your use. These are the two most important features of a test. Test reliability and validity are two technical properties of a test that indicate the quality and usefulness of the test. Time and Attendance/Workforce ManagementĬhapter 3: Understanding Test Quality-Concepts of Reliability and Validity.Using In-Training Evaluation Report (ITER) qualitative comments to assess medical students and residents: a systematic review. Hatala R, Sawatsky AP, Dudek N, Ginsburg S, Cook DA. Technology-enhanced simulation to assess health professionals: a systematic review of validity evidence, research methods, and reporting quality. Much ado about differences: why expert-novice comparisons add little to the validity argument. What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Effects of training in direct observation of medical residents’ clinical competence: a randomized trial. A systematic review of validity evidence for checklists versus global rating scales in simulation-based assessment. Validity: one word with a plurality of meanings. Linking simulation-based educational assessments and patient-related outcomes. 2015 20:1149–75.īrydges R, Hatala R, Zendejas B, Erwin PJ, Cook DA. Constructing a validity argument for the Objective Structured Assessment of Technical Skills (OSATS): a systematic review of validity evidence. Objective structured assessment of technical skill (OSATS) for surgical residents. Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M.
When assessment data are words: validity evidence for qualitative educational assessments. Validating the interpretations and uses of test scores.

New York: American Council on Education and Macmillan 1989. A contemporary approach to validity arguments: a practical guide to Kane’s framework. 2016 1:31.Ĭook DA, Brydges R, Ginsburg S, Hatala R. Validation of educational assessments: a primer for simulation and beyond.
