Integrating human factors into the medical curriculum

Background  The study of human factors is a scientific discipline that deals with the interactions between human beings and the elements of a system. This is important because shortcomings in these areas, if unchecked, can result in adverse outcomes. Research into human factors in industries where safety is paramount has provided the basis of countermeasures against human error. Adverse outcomes in medicine resulting from human error exact a high cost in both patient suffering and financial outlay.
CRM training  One of the approaches used to minimise the effect of human error is to train people in a set of knowledge, skills and attitudes that underpin the domain-specific competencies for that profession. These are referred to as non-technical skills (NTS). In aviation, such an approach has been shown to be both translatable from the training environment to the workplace and effective in reducing adverse outcomes.
Discussion  Medicine has incorporated this style of training, usually centred around simulator-based courses, but as yet in a piecemeal, episodic fashion which relies on participants volunteering to attend courses. Unlike other industries there is no systematic approach to linking the content of this teaching with the more conventional range of topics. As a consequence it is difficult to assess the impact of human factors training in medicine. This is partly because very little work has been done to date in identifying the key non-technical skills required in medicine, and the overall experience of workplace based assessment is limited. Lessons from other high reliability organisations may help to address the main challenges of developing the content, integrating it into the curriculum, reinforcing the concepts in the workplace through staff development and establishing its role in summative assessment.     

Cardiopulmonary resuscitation training for undergraduate medical students: a five-year study

BACKGROUND: Cardiopulmonary resuscitation (CPR) training for undergraduate medical students and junior doctors has been noted to be poor in the past. Attempts have been made over the last decade to improve CPR training for all health professionals. AIM: This study aimed to determine if CPR training for undergraduate medical students in a single institution improved after initial concerns in 1992, and to observe trends in CPR training over five years. METHODS: Prospective single centre observational cohort survey by means of a 2-page self completed questionnaire to final year undergraduate medical students at the University of Glasgow (1993-97 inclusive). RESULTS: Mean annual response rate 58% (range 48%-67%). 99% of responders had been trained in basic life support during undergraduate training. The use of simulated arrests for training increased significantly. CPR training was concentrated in the first and final years. Training in all aspects of advanced life support increased, as did the students' confidence in these techniques. Student satisfaction with the amount of basic life support training increased very significantly and there was a small, but significant increase in student satisfaction with advanced life support training. Overall confidence at the prospect of being a member of the resuscitation team on qualification did not increase. CONCLUSIONS: There has been a sustained improvement in CPR training at this institution since 1993. Improvements in the training of specific advanced life support techniques does not lead to improved overall confidence in using these skills on qualification. Advanced life support training requires further expansion.     

Teaching clinical skills to new medical students: the Oman experience

The College of Medicine at the Sultan Qaboos University (SQU) in Oman took up the challenge of moving away from a didactic emphasis in the teaching of family and community health by actively involving students in health care, requiring some clinical skills, as early as possible. This paper describes the experience of the Department of Family and Community Health at SQU of the feasibility of training first-year medical students in the measurement of blood pressure within a few days. Our experience showed that proper training before starting field-work can teach clinical skills to students who have had no prior exposure to medical subjects. There was a strong correlation between the measurements of blood pressure of 638 individuals by the students and the supervisors. This experience at SQU has encouraged us to implement the idea of family- and community-based clinical exposure for every class. Teaching of clinical skills is feasible in the field for new entrants, provided there is adequate orientation beforehand and skilled supervision of the students in small groups.     

Peer-assisted learning: a novel approach to clinical skills learning for medical students

OBJECTIVE: This study aimed to determine whether peer-assisted learning (PAL) can enhance clinical examination skills training. METHODS: Three student trainers studied small-group theory and clinical examination and provided PAL as extra tuition for 86 trainees. Trainees watched an examination video, were videotaped practising the examination and, after constructive feedback, repeated the examination. Responses to PAL were evaluated to attain an overview of trainee and trainer performance using visual analogue and Likert scale analyses. Year-group review was undertaken using questionnaires. RESULTS: Trainees evaluated all aspects of PAL highly, including their post-training confidence in examination skills (mean > 7.7 on a 10-cm scale), indicating that the PAL was effective. Written comments confirmed the students perceived the sessions as well structured and of high quality. Compared with trainees in the first groups, those from later groups gave all parameters similar or higher gradings. Those for interest (P = 0.03) and appropriateness (P = 0.01) were significantly higher, suggesting that trainers may improve their technique with time. Students with previous degrees gave similar or lower gradings than standard entry students, with answers about post-training confidence and recommendation to friends being statistically lower (P < 0.006). Six months later, year-group analysis showed that 90% of trainees rated PAL highly, and 86% wished to become trainers. Of the trainers' year group, 79% perceived that PAL training could improve examination skills. CONCLUSIONS: In the context of clinical skills training, PAL was highly evaluated across many parameters, including confidence after training. Student interest and enthusiasm supports suggestions that PAL could be a useful adjunct to clinical skills training.     

Evaluation of procedural skills training in an undergraduate curriculum

CONTEXT: A substantial proportion of medical students enter their intern year without any basic skills experience. Lack of experience is a significant source of stress for many junior doctors. OBJECTIVES: To evaluate the effect of a basic procedural skills tutorial for Year 3 medical students on their competence in relevant skills at Year 5. SUBJECTS: The control group consisted of 93 medical students who completed Year 3 in 1996. The intervention group consisted of 92 medical students who completed Year 3 in 1997. The intervention group received a practical skills tutorial in Year 3; the control group did not. Both groups were assessed on their practical skills competence during Year 5. METHODS: A 3-hour practical tutorial on injection and suturing techniques was delivered to the intervention group. The effectiveness of the intervention was assessed by self-reported experience of giving injections, inserting sutures and sustaining needlestick injuries, and by teacher-rated competency in four basic procedural skills. RESULTS: Students who received the Year 3 tutorial were significantly more likely to record a satisfactory assessment for their performance in all four basic skills compared with students who did not receive the tutorial. They were less likely than controls to refuse invitations to give injections, but not invitations to insert a suture, during Years 4 and 5. CONCLUSIONS: A single session of formalised teaching in procedural skills in the early stages of a medical degree can have long-term effectiveness in basic skills competence and may increase students' confidence to practise their skills.     

Low- to high-fidelity simulation – a continuum of medical education?

Context  Changes in medical training and culture have reduced the acceptability of the traditional apprenticeship style training in medicine and influenced the growth of clinical skills training. Simulation is an educational technique that allows interactive, and at times immersive, activity by recreating all or part of a clinical experience without exposing patients to the associated risks. The number and range of commercially available technologies used in simulation for education of health care professionals is growing exponentially. These range from simple part-task training models to highly sophisticated computer driven models.
Aim  This paper will review the range of currently available simulators and the educational processes that underpin simulation training. The use of different levels of simulation in a continuum of training will be discussed. Although simulation is relatively new to medicine, simulators have been used extensively for training and assessment in many other domains, most notably the aviation industry. Some parallels and differences will be highlighted.     

A comparison of computer-assisted instruction and small-group teaching of cardiac auscultation to medical students

Cardiac auscultation is suffering from declining interest, caused by competing diagnostic technology and inadequate training of doctors. Computer-assisted instruction (CAI) supporting graphics and digitized sound could be ideally suited for teaching and sharpening this skill. To evaluate this premise we randomized 35 third-year medical students to 3 hours of seminar teaching plus the use of audiotapes (group 1), the self-use of a MacIntosh-based CAI (group 2), or both (group 3). All students took a pre- and post-test consisting of eight pre-recorded cardiac events and were also assessed for computer anxiety. Although there were no significant differences between pre- and post-tests for each group and among groups, group 1 had a 4.5% deterioration in its diagnostic score compared to the 7.2% and 3.2% improvements of groups 2 and 3 respectively. Group 2 used the CAI significantly more than group 3. We conclude that CAI is at least as effective as seminars in teaching cardiac auscultation to third-year medical students.     

Using standardised students in faculty development workshops to improve clinical teaching skills

PURPOSE: We describe the use of standardised students (SSs) in interdisciplinary faculty development programmes to improve clinical teaching skills. Standardised students are actual health professions students who are trained to portray a prototypical teaching challenge consistently across many encounters with different faculty participants. METHODS: The faculty development programmes described focused on the skills of providing feedback and brief clinical teaching. At the beginning of each session, each participant was videotaped in encounters with 2 different SSs. Using microteaching (an instructional method in which learners view short segments of their own videotaped performance and discuss the tapes with a facilitator, consultant or other workshop participants), each group of participants and instructors reviewed the tapes and reflected on the encounters, providing immediate feedback to participants and modelling different approaches to the same teaching problem. The same process was repeated with more complicated scenarios after 2 weeks and again after 6 months offering reinforcement, further practice and more sophisticated development of the strategies learned. Participants completed post-session evaluations and a follow-up telephone survey. RESULTS: A total of 36 faculty members from the colleges of medicine, dentistry, pharmacy and nursing participated in workshops in 2000-01. The workshops were rated as highly relevant to participants' teaching, and most participants reported that they had learned a great deal. Participants most appreciated reviewing the videotaped interactions, the feedback they received, the interactions with their colleagues, the interdisciplinary nature of the groups and the practical focus of the workshops. CONCLUSIONS: Standardised students provide a high fidelity, low risk, simulated environment in which faculty can reflect on and experiment with new teaching behaviours. Such encounters can enhance the effectiveness and impact of faculty development programmes to improve clinical teaching skills.     

Comprehensive undergraduate medical assessments improve prediction of clinical performance

OBJECTIVES: This study aimed to compare an essay-style undergraduate medical assessment with modified essay, multiple-choice question (MCQ) and objective structured clinical examination (OSCE) undergraduate medical assessments in predicting students' clinical performance (predictive validity), and to determine the relative contributions of the written (modified essay and MCQ) assessment and OSCE to predictive validity. DESIGN: Before and after cohort study. SETTING: One medical school running a 6-year undergraduate course. PARTICIPANTS: Study participants included 137 Year 5 medical students followed into their trainee intern year. MAIN OUTCOME MEASURES: Aggregated global ratings by senior doctors, junior doctors and nurses as well as comprehensive structured assessments of performance in the trainee intern year. RESULTS: Students' scores in the new examinations predicted performance significantly better than scores in the old examinations, with correlation coefficients increasing from 0.05-0.44 to 0.41-0.81. The OSCE was a stronger predictor of subsequent performance than the written assessments but combining assessments had the strongest predictive validity. CONCLUSION: Using more comprehensive, more reliable and more authentic undergraduate assessment methods substantially increases predictive validity.     

The rating of pre-clerkship examination questions by postgraduate medical students: an assessment of quality and relevancy to medical practice

OBJECTIVE: To determine whether postgraduate students are able to assess the quality of undergraduate medical examinations and to establish whether faculty can use their results to troubleshoot the curriculum in terms of its content and evaluation. SUBJECTS: First and second year family medicine postgraduate students. MATERIALS: A randomly generated sample of undergraduate medical examination questions. METHODS: Postgraduate students were given two undergraduate examinations which included questions with an item difficulty (ID) > 0.60. The students answered and then rated each question on a scale of 1-7. RESULTS: The percentage of postgraduate students answering each question correctly correlated significantly with the average perceived relevance (Examination 1: r=0.372; P < 0.05; Examination 2: r=0.458; P < 0.05). Questions plotted for average postgraduate/undergraduate performance ratio versus the average perceived relevance were significantly correlated (Examination 1: r=0.462; P < 0.01; Examination 2: r=0.458; P < 0.05). CONCLUSIONS: This study offers a method of validating question appropriateness prior to examination administration. The design has the potential to be used as a model for determining the relevancy of a medical curriculum.     

Fostering diagnostic knowledge through computer-supported, case-based worked examples: effects of erroneous examples and feedback

Objectives  A case-based, worked example approach was realised in a computer-based learning environment with the intention of facilitating medical students' diagnostic knowledge. In order to enhance the effectiveness of the approach, two additional measures were implemented: erroneous examples and elaborated feedback. In the context of an experimental study, the two measures were varied experimentally.
Methods  A total of 153 medical students were randomly assigned to four experimental conditions of a 2 × 2-factor design (errors versus no errors, elaborated feedback versus knowledge of correct result [KCR]). In order to verify the sustainability of the effects, a subgroup of subjects ( n  = 52) was compared with a control group of students who did not participate in the experiment ( n  = 145) on a regular multiple-choice question (MCQ) test.
Results  Results show that the acquisition of diagnostic knowledge is mainly supported by providing erroneous examples in combination with elaborated feedback. These effects were independent from differences in time-on-task and prior knowledge. Furthermore, the effects of the learning environment proved sustainable.
Conclusions  Our results demonstrate that the case-based, worked example approach is effective and efficient.     

In-training assessment: qualitative study of effects on supervision and feedback in an undergraduate clinical rotation

BACKGROUND: Supervision and feedback are essential factors that contribute to the learning environment in the context of workplace learning and their frequency and quality can be improved. Assessment is a powerful tool with which to influence students' learning and supervisors' teaching and thus the learning environment. OBJECTIVE: To investigate an in-training assessment (ITA) programme in action and to explore its effects on supervision and feedback. DESIGN: A qualitative study using individual, semistructured interviews. SUBJECTS AND SETTING: Eight students and 17 assessors (9 members of staff and 8 residents) in the internal medicine undergraduate clerkship at Vrije Universiteit Medical Centre, Amsterdam, the Netherlands. RESULTS: The ITA programme in action differed from the intended programme. Assessors provided hardly any follow-up on supervision and feedback given during assessments. Although students wanted more supervision and feedback, they rarely asked for it. Students and assessors failed to integrate the whole range of competencies included in the ITA programme into their respective learning and supervision and feedback. When giving feedback, assessors rarely gave borderline or fail judgements. DISCUSSION AND CONCLUSION: If an ITA programme in action is to be congruent with the intended programme, the implementation of the programme must be monitored. It is also necessary to provide full information about the programme and to ensure this information is given repeatedly. Introducing an ITA programme that includes the assessment of several competencies does not automatically lead to more attention being paid to these competencies in terms of supervision and feedback. Measures that facilitate change in the learning environment seem to be a prerequisite for enabling the assessment programme to steer the learning environment.     

Teaching plastic surgery to medical students

A plastic surgery syllabus for third-year medical students is described. It is intended for a teaching programme in which plastic surgery is integrated into the surgical teaching on the same basis as the other surgical specialties. The syllabus was designed to concentrate on aspects of plastic surgery relevant to the needs of undergraduates. An audit of the teaching showed that the students were readily interested and considered the teaching to be relevant to their examinations and to their future as doctors. A survey of all plastic surgery centres in the British Isles showed that similar teaching was being undertaken in 11 centres out of 51.     

Not knowing that they do not know: self-assessment accuracy of third-year medical students

PURPOSE: The development of self-regulated learning is a major focus of our problem-based learning (PBL) medical programme. Students who are unsuccessful in assessments often seem to lack insight into the standard of their own performance, yet the ability to self-assess accurately is essential for the effective self-management of learning. The aim of this project was to evaluate the accuracy of self- and peer-assessment according to academic performance. METHOD: In 2004, 175 3rd-year students undertook an integrated, case-based, short-essay, formative assessment. After the assessment they were provided with model answers and marking criteria. Students marked their own assessment paper and the paper of one of their peers. Assessment papers were subsequently marked by faculty members. The following data was available for each student: self-mark, faculty-mark, score awarded by a peer and the score that they awarded to their peer. Self-assessment and peer-assessment ability was compared to overall academic performance. RESULTS: Low-achieving students score themselves and their peers generously. High-achieving students score themselves more harshly than faculty. However, they score their peers accurately. CONCLUSION: In the 3rd year of the programme low-achieving students are unable to assess accurately the quality of their own work or the work of their peers in a formative written assessment. The PBL curriculum does not guarantee the appropriate development of self-assessment skills.     

Teaching of cardiopulmonary resuscitation by medical students

Ten first-year medical students were taught basic cardiopulmonary resuscitation (CPR) according to the guidelines laid down by the American Heart Association. Following a 7.5-hour instruction period they, in turn, taught 40 secondary school pupils. On formal assessment using models, all the school children were able to perform basic CPR.     

Medical ethics contributes to clinical management: teaching medical students to engage patients as moral agents

Objectives  In order to teach medical students to engage more fully with patients, we offer ethics education as a tool to assist in the management of patient health issues.
Methods  We propose that many dilemmas in clinical medicine would benefit by having the doctor embark on an iterative reasoning process with the patient. Such a process acknowledges and engages the patient as a moral agent. We recommend employing Kant's ethic of respect and a more inclusive definition of patient autonomy drawn from philosophy and clinical medicine, rather than simply presenting dichotomous choices to patients, which represents a common, but often suboptimal, means of approaching both medical and moral concerns.
Discussion  We describe how more nuanced teaching about the ethics of the doctor–patient relationship might fit into the medical curriculum and offer practical suggestions for implementing a more respectful, morally engaged relationship with patients that should assist them to achieve meaningful health goals.     

Teaching sociology to medical students

A recent change in many medical curricula has been the introduction of courses in the behavioural sciences. These courses, while introduced with the intention of emphasizing interpersonal and behavioural skills, have not been shown to lead to any of the changes towards which they are directed. Rather, there is evidence that students find these courses 'waffly' and boring. If the sociology component of these courses is to lead to change, then there is the need for a continuing process of evaluation and modification. In this paper we report upon one medical sociology course, its evaluation, subsequent modification and re-evaluation. Our evidence would suggest that sociology courses can lead to changed attitudes and values, but that such changes are contingent upon the overt application of relevant sociological concepts to the health care field.     

Biomedical knowledge in explanations of clinical problems by medical students

This paper was motivated by a controversy concerning the role of basic sciences in medical education. A problem underlying this issue is that it is unknown how basic science is used in clinical reasoning. The experiment was designed to address this issue. Three texts were constructed dealing with basic science knowledge relevant to a clinical problem. Subjects were asked to read and recall the texts. Next, the subjects were required to read and recall the clinical text describing a patient problem. Finally, they were asked to provide a diagnosis and an explanation of the underlying pathophysiology. Subjects were first-, second- and fourth-year medical students. Detailed analysis of subjects' protocols are presented. In general, the results show that when basic science information is given before the clinical problem, the basic science knowledge is used either incorrectly or inconsistently in explaining the clinical problem by all subjects. The authors interpret these results to indicate that the basic sciences and the more practical clinical knowledge form two separate domains with their own individual structures and the clinical information cannot be embedded into the basic science knowledge structure.     

A study of a multi-source feedback system for international medical graduates holding defined licences

OBJECTIVE: To develop and assess the feasibility and psychometric properties of multi-source feedback questionnaires to monitor international medical graduates practising in Canada under 'defined' licences. METHOD: Four questionnaires (patient, co-worker, colleague and self) were developed and administered in 2 phases through paper-based and telephone or Internet formats. Reliability was assessed with Cronbach's alpha and generalisability coefficient analyses. Validity was established through mean ratings, 'unable to respond' rates and factor analyses. RESULTS: A total of 37 doctors participated in the 2 phases. Overall response rates were 70% for patients, 86% for co-workers, 72% for medical colleagues and 92% for self, with response rates higher for the paper-based format than the Internet and phone formats. The instruments had high internal consistency reliability, with Cronbach's alphas of 0.83 for self-assessment and > 0.90 for the other instruments. The generalisability coefficients were Ep(2) = 0.71 for 25 patients on a 13-item survey, Ep(2) = 0.59 for 8 co-workers on a 13-item survey, and Ep(2) = 0.67 for 8 colleagues on a 21-item questionnaire. The range of mean scores was narrow (between 4 and 5) for all items and all surveys. The factor analyses identified that 2 factors accounted for 70% or more of the variance for the patient and colleague surveys and 60% of the variance for the co-worker survey. CONCLUSION: These data suggest that the instruments have reasonable psychometric properties. Traditional survey methods (i.e. paper-based) yielded better results than Internet or phone methods for this group of doctors.