Examiner effect on the objective structured clinical exam - a study at five medical schools

2017 | journal article. A publication with affiliation to the University of Göttingen.

Jump to: Cite & Linked | Documents & Media | Details | Version history

Cite this publication

​Examiner effect on the objective structured clinical exam - a study at five medical schools​
Schleicher, I.; Leitner, K.; Juenger, J.; Moeltner, A.; Ruesseler, M.; Bender, B. & Sterz, J. et al.​ (2017) 
BMC Medical Education17 art. 71​.​ DOI: https://doi.org/10.1186/s12909-017-0908-1 

Documents & Media

s12909-017-0908-1.pdf700.82 kBAdobe PDFSupplement120.53 kBUnknown

License

Attribution 4.0 CC BY 4.0

Details

Authors
Schleicher, Iris; Leitner, Karsten; Juenger, Jana; Moeltner, Andreas; Ruesseler, Miriam; Bender, Bernd; Sterz, Jasmina; Schuettler, Karl-Friedrich; Koenig, Sarah; Kreuder, Joachim Gerhard
Abstract
Background: The Objective Structured Clinical Examination (OSCE) is increasingly used at medical schools to assess practical competencies. To compare the outcomes of students at different medical schools, we introduced standardized OSCE stations with identical checklists. Methods: We investigated examiner bias at standardized OSCE stations for knee-and shoulder-joint examinations, which were implemented into the surgical OSCE at five different medical schools. The checklists for the assessment consisted of part A for knowledge and performance of the skill and part B for communication and interaction with the patient. At each medical faculty, one reference examiner also scored independently to the local examiner. The scores from both examiners were compared and analysed for inter-rater reliability and correlation with the level of clinical experience. Possible gender bias was also evaluated. Results: In part A of the checklist, local examiners graded students higher compared to the reference examiner; in part B of the checklist, there was no trend to the findings. The inter-rater reliability was weak, and the scoring correlated only weakly with the examiner's level of experience. Female examiners rated generally higher, but male examiners scored significantly higher if the examinee was female. Conclusions: These findings of examiner effects, even in standardized situations, may influence outcome even when students perform equally well. Examiners need to be made aware of these biases prior to examining.
Issue Date
2017
Status
published
Publisher
Biomed Central Ltd
Journal
BMC Medical Education 
ISSN
1472-6920
Sponsor
German Federal Ministry of Education and Research [01PL12038A-C]

Reference

Citations


Social Media