BJA Advance Access originally published online on January 22, 2004
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
British Journal of Anaesthesia, 2004, Vol. 92, No. 3 388-392
© 2004 The Board of Management and Trustees of the British Journal of Anaesthesia
Clinical Investigations |
High-fidelity patient simulation: validation of performance checklists
1 Department of Anesthesia, Sunnybrook and Women’s College Health Sciences Centre, Women’s College Campus, 76 Grenville Street, Toronto, Ontario, Canada M5S 1B2. 2 Centre for Research in Education, University Health Network, University of Toronto, Toronto, Canada
*Corresponding author. E-mail: pam.morgan@utoronto.ca
Background. Standardized scenarios can be used for performance assessments geared to the level of the learner. The purpose of this study was to validate checklists used for the assessments of medical students’ performance using high-fidelity patient simulation.
Methods. Our undergraduate committee designed 10 scenarios based on curriculum objectives. Fifteen faculty members with undergraduate educational experience identified items considered appropriate for medical students’ performance level and identified items that, if omitted, would negatively affect grades. Items endorsed by less than 20% of faculty were omitted. For remaining items, weighting was calculated according to faculty responses. Students managed at least one scenario during which their performance was videotaped. Two raters independently completed the checklists for three consecutive sessions to determine inter-rater reliability. Validity was determined using Cronbach’s 
with an 
0.6 and 
0.9 considered acceptable internal consistency. Item analysis was performed by recalculating Cronbach’s with each item deleted to determine if that item contributed to a low internal consistency.
Results. 135 students participated in the study. Inter-rater reliability of the two raters determined on the third session was 0.97 and therefore one rater completed the remaining performance assessments. Cronbach’s for the 10 scenarios ranged from 0.16 to 0.93 with two scenarios demonstrating acceptable internal consistency with all items. Three scenarios demonstrated acceptable internal consistency with one item deleted.
Conclusions. Five scenarios developed for this study were shown to be valid when using the faculty criteria for expected performance level.
Br J Anaesth 2004; 92: 388–92
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  H. Berkenstadt, Y. Haviv, A. Tuval, Y. Shemesh, A. Megrill, A. Perry, O. Rubin, and A. Ziv Improving Handoff Communications in Critical Care: Utilizing Simulation-Based Training Toward Process Improvement in Managing Patient Risk Chest, July 1, 2008; 134(1): 158 - 162. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 N. A. Crabtree, D. B. Chandra, I. D. Weiss, H. S. Joo, and V. N. Naik Fibreoptic airway training: correlation of simulator performance and clinical skill: [Formation en gestion des voies aeriennes par fibre optique : correlation entre la performance en simulateur et les habiletes cliniques] Can J Anesth, February 1, 2008; 55(2): 100 - 104. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. J. Morgan, J. Lam-McCulloch, J. Herold-McIlroy, and J. Tarshis Simulation performance checklist generation using the Delphi technique: [Generation d'une liste de verification de la performance simulee a l'aide de la methode Delphi] Can J Anesth, December 1, 2007; 54(12): 992 - 997. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. Berkenstadt, G. S. Kantor, Y. Yusim, N. Gafni, A. Perel, T. Ezri, and A. Ziv The Feasibility of Sharing Simulation-Based Evaluation Scenarios in Anesthesiology Anesth. Analg., October 1, 2005; 101(4): 1068 - 1074. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G F Dillon, J R Boulet, R E Hawkins, and D B Swanson Simulations in the United States Medical Licensing ExaminationTM (USMLETM) Qual. Saf. Health Care, October 1, 2004; 13(suppl_1): i41 - i45. [Abstract] [Full Text] [PDF]
|
|