Simulation in undergraduate medical education: bridging the gap between theory and practice

OBJECTIVE: To evaluate the use of simulation-based teaching in the medical undergraduate curriculum in the context of management of medical emergencies, using a medium fidelity simulator. DESIGN: Small groups of medical students attended a simulation workshop on management of medical emergencies. The workshop was evaluated in a post-course questionnaire. SUBJECTS: All Year 4 medical students allocated to the resuscitation rotation during the first half of 2002. MAIN OUTCOME MEASURES: Student perceptions of learning outcomes, the value of the simulation in the undergraduate curriculum and their self-assessed improved mastery of workshop material. RESULTS: A total of 33 students attended the workshop and all completed questionnaires. Students rated the workshop highly and found it a valuable learning experience. In all, 21 (64%) students identified teamwork skills as key learning points; 11 (33%) felt they had learnt how to approach a problem better, particularly in terms of using a systematic approach, and 12 (36%) felt they had learnt how to apply their theoretical knowledge in a clinical setting better. All 33 students were positive about the use of simulation in their training; 14 students wrote that simulation should be used more or should be mandatory in training; 5 students commented positively on the realism of the learning experience and a further 5 said they valued the opportunity to learn new skills in a safe environment. CONCLUSION: This study demonstrates that medical students value simulation-based learning highly. In particular, they value the opportunity to apply their theoretical knowledge in a safe and realistic setting, to develop teamwork skills and to develop a systematic approach to a problem. A medium fidelity simulator is a valuable educational tool in medical undergraduate education.     

Medical graduates evaluate the effectiveness of their education

Summary. In response to the General Medical Council's 1991 Consultative Document proposing changes to medical curricula, the King's College School of Medicine and Dentistry, London, established a steering group to plan a new curriculum. As part of this process a postal survey was undertaken of five cohorts of King's graduates to ascertain how well the medical course they had undertaken had equipped them for practice. The questionnaire explored the level of factual content, the adequacy of their skills training, and the development of personal attributes during the course. A total of 371 graduates replied, a response rate of 78%. Over 70% indicated that their education had satisfactorily equipped them for their medical practice. Significant differences were found, however, between those now practising in primary care and those in hospital medicine regarding the importance attached to different subjects within the curriculum, and also with respect to the personal attributes the graduates felt they had acquired. Both groups identified deficiencies in virtually all aspects of their skills training: clinical, analytical, communication, management and technical.
This feedback from some of the 'consumers' of medical education is now being used to assist the planning of the new King's curriculum.     

Does a new undergraduate curriculum based on Tomorrow's Doctors prepare house officers better for their first post? A qualitative study of the views of pre‐registration house officers using critical incidents

INTRODUCTION: In 1994 Manchester University introduced an integrated undergraduate medical course using problem-based learning (PBL) throughout. The study reported here explored whether there were any differences between the new course graduates (NCGs) and the traditional course graduates (TCGs) in the types of scenarios they recalled as 'critical incidents', or challenging cases, while working as pre-registration house officers (PRHOs). The focus is on differences rather than causal links. METHOD: We used semistructured interviews to generate our data. Twenty-four traditional course graduates and 23 new course graduates were interviewed approximately 3 months after starting their first PRHO placement. RESULTS: We identified 4 types of critical incidents relating to: clinical practice; limitations of competence; emotional involvement; and communication. Traditional course graduates reported difficulties in making patient management decisions, whereas the NCGs were better at dealing with uncertainty, knowing their limits and asserting their rights for support. Communication difficulties and coping with emotional involvement were common across both groups of graduates and hence remain problems in relation to being prepared for the role of a PRHO. CONCLUSIONS: Graduates of the new, integrated curriculum seemed to be much better at dealing with uncertainty, knowing their personal limits and asserting their rights for support when they felt these limits had been reached. Communication difficulties and emotional involvement remain major factors in the transition from student to PRHO.     

Impact of a new curriculum on medical students' interpersonal and interviewing skills

OBJECTIVES: In 1998 we reported on the rise and fall of medical student communication skills during the 4 years of medical school. Since then, the University of Connecticut School of Medicine has completed a major curriculum renewal project with an emphasis on early clinical work, lifelong learning and more ambulatory training. The goals of this study were to compare students' interviewing and interpersonal skills in standardised patient (SP) assessments in the old and new curricula and to assess the success of the new curriculum in preventing a decline in student skills in this domain. METHODS: The clinical skills of 202 students were measured longitudinally during encounters with SPs in each of their 4 years of medical school. Students in this study and the earlier study were evaluated using the Arizona Clinical Interviewing Rating (ACIR) Scale. RESULTS: Compared with students from the previous curriculum, students on the new curriculum in this study showed an improvement in ACIR scores. Year 1 mean ACIR scores (1 = poor to 5 = excellent) were, respectively, 3.6 for the old curriculum cohort and 4.0 for the new curriculum group. In Year 4 the mean score for the old curriculum cohort was 3.7 and that for the new curriculum group was 3.8. Students on the new curriculum still showed a decline in ACIR scores from Years 1 to 4, but it was not as severe a decline as it had been previously. CONCLUSIONS: Pre-clinical medical students perform better on measures of interpersonal communication than their clinical counterparts. The students who participated in the new curriculum demonstrated an earlier acquisition of and a less steep decline in interviewing and interpersonal skills during the course of medical school.     

Teaching and learning in the clinical setting: a qualitative study of the perceptions of students and teachers

Objective  To describe the perceptions of medical students and clinical teachers of teaching and learning in the clinical setting.
Design  Qualitative study of focus groups with undergraduate medical students and semistructured interviews with hospital consultant clinical teachers.
Setting  The School of Medicine, University of Leeds and the Leeds Teaching Hospitals Trust, UK.
Participants  Fourth year medical students and consultant clinical teachers.
Main outcome measures  Analysis of narratives to identify students' perceptions of clinical teaching and consultants' views of their delivery of undergraduate clinical teaching.
Results  Students believed in the importance of consultant teaching and saw consultants as role models. However, they perceived variability in the quality and reliability of teaching between physicians and surgeons. Some traditional teaching venues, especially theatre, are believed to be of little clinical importance. Generally, consultants enjoyed teaching but felt under severe pressure from other commitments. They taught in a range of settings and used various teaching strategies, not all of which were perceived to be 'teaching' by students.
Conclusions  While students and teachers are educational partners, they are not always in agreement about the quality, quantity, style or appropriate setting of clinical teaching. To enable teachers to provide more high quality teaching, there needs to be support, opportunities and incentives to understand curricular developments and acquire teaching skills.     

Effects of basic clinical skills training on objective structured clinical examination performance

OBJECTIVES: The aim of curriculum reform in medical education is to improve students' clinical and communication skills. However, there are contradicting results regarding the effectiveness of such reforms. METHODS: A study of internal medicine students was carried out using a static group design. The experimental group consisted of 77 students participating in 7 sessions of communication training, 7 sessions of skills-laboratory training and 7 sessions of bedside-teaching, each lasting 1.5 hours. The control group of 66 students from the traditional curriculum participated in equally as many sessions but was offered only bedside teaching. Students' cognitive and practical skills performance was assessed using Multiple Choice Question (MCQ) testing and an objective structured clinical examination (OSCE), delivered by examiners blind to group membership. RESULTS: The experimental group performed significantly better on the OSCE than did the control group (P < 0.01), whereas the groups did not differ on the MCQ test (P < 0.15). This indicates that specific training in communication and basic clinical skills enabled students to perform better in an OSCE, whereas its effects on knowledge did not differ from those of the traditional curriculum. CONCLUSION: Curriculum reform promoting communication and basic clinical skills are effective and lead to an improved performance in history taking and physical examination skills.     

Perceptions of how well graduates are prepared for the role of pre-registration house officer: a comparison of outcomes from a traditional and an integrated PBL curriculum

INTRODUCTION: Most medical schools in the UK have been engaged in major curriculum reform based on their premises of what might improve undergraduate medical education. In 1994 the course at the medical school of the University of Manchester changed to an integrated course using problem-based learning throughout and with increased emphasis on community-based medical education. This study explores whether the new curriculum has produced any differences in perceptions of how well graduates are prepared for the role of pre-registration house officer. METHODS: A postal questionnaire was used to survey 1998 Manchester graduates (traditional course) and 1999 Manchester graduates (new course), three months into their first pre-registration house officer placement. A similar questionnaire was sent to the educational supervisors who were supervising the graduates. The questionnaire was designed to measure perceptions of levels of preparedness for the role of pre-registration house officer, using a list of broad areas of competence and specific skills listed in the General Medical Council's 'The New Doctor'. RESULTS: Graduates rated the new course significantly more effective for 12 of the 19 broad competences and eight of the 13 specific skills that were listed. The 'new' graduates rated their understanding of disease processes lower than the 'traditional' graduates, but there was no difference in the ratings given by the educational supervisors for this. Overall the educational supervisors rated the new course as better preparing graduates in five of the competences. CONCLUSIONS: Overall, the evaluation shows that a major change in curriculum approach has changed the profile of the perceived preparedness of graduates for entering professional practice.     

The perceptions of attending doctors of the role of residents as teachers of undergraduate clinical students

INTRODUCTION: Much of undergraduate clinical teaching is provided by residents. An earlier study showed the attitude of residents towards teaching to be generally positive. Little is known, however, about attending doctors' views on their own and residents' roles as teachers of medical students. OBJECTIVES: To examine attending doctors' perceptions of the (dis)advantages of resident teaching, their own teaching abilities and the need for a teacher training programme for residents. METHOD: A questionnaire survey of 76 attending doctors was carried out in the Departments of Obstetrics & Gynaecology and Paediatrics at the teaching hospitals of the Universities of Maastricht and Amsterdam, the Netherlands. RESULTS: Attending doctors perceive teaching by residents to be beneficial for students and residents alike. Although they consider themselves to be better suited than residents to teach medical students, they see teaching as an integral part of residency training and feel it should be recognised as such by departments and medical schools. Attending doctors are in favour of a teacher training programme for residents, which should include communication, clinical and teaching skills as well as skills such as time management and (self-) assessment. DISCUSSION: Despite the uneven distribution of participants between the departments, no significant differences were found between departments. It is interesting that attending doctors perceive teacher training as beneficial to residents' teaching skills, but provide more feedback on residents' attitudes than on their teaching. The results show that, in general, attending doctors share residents' views that teaching is an important component of residency and that a teacher training programme for residents is to be recommended.     

Meeting the challenge of prescribing and administering medicines safely: structured teaching and assessment for final year medical students

OBJECTIVES: To promote safe prescribing and administration of medicines in the pre-registration house officer (PRHO) year through a programme of structured teaching and assessment for final year medical students. DESIGN: Forty final year medical students from two medical schools were randomly allocated either to participate in a pharmacist facilitated teaching session or to receive no additional teaching. Teaching comprised five practical exercises covering seven skills through which students rotated in small groups. One month later, a random sample of 16 taught and 16 non-taught students participated in a nine-station objective structured clinical examination (OSCE) to assess the impact of the teaching. SETTING: Manchester School of Medicine (MSM), and Kings College School of Medicine and Dentistry (KCSMD). PARTICIPANTS: Final year medical student volunteers. MAIN OUTCOME MEASURES: The need for teaching as indicated by student prior experience; questionnaire rating of student acceptability of teaching and assessment; self-rating of student confidence post-assessment, and student performance assessed by OSCE. RESULTS: The study demonstrated that the taught group achieved higher scores in eight OSCE stations. Four of these were statistically significant (P < or= 0.005). Taught students felt more confident performing the skills on five stations. From 0 to 47.5% students had prior experience of the skills taught. The post-teaching questionnaire evaluated exercises positively on several criteria, including provision of new information and relevance to future work. CONCLUSIONS: Structured teaching provided an effective and acceptable method of teaching the medicines management skills needed in the PRHO year. The structured approach complemented variable precourse clinical experience.     

General competencies of problem-based learning (PBL) and non-PBL graduates

INTRODUCTION: Junior doctors have reported shortcomings in their general competencies, such as organisational skills and teamwork. We explored graduates' perceptions of how well their training had prepared them for medical practice and in general competencies in particular. We compared the opinions of graduates from problem-based learning (PBL) and non-PBL schools, because PBL is supposed to enhance general competencies. METHOD: We analysed the responses of 1159 graduates from 1 PBL and 4 non-PBL schools to a questionnaire survey administered 18 months after graduation. RESULTS: Compared with their non-PBL colleagues, the PBL graduates gave higher ratings for the connection between school and work, their medical training and preparation for practice. According to the graduates, the most frequently used competencies with sufficient coverage during medical training were expert knowledge, profession-specific skills and communication skills. The majority of the PBL graduates, but less than half of the non-PBL graduates, indicated that communication skills had been covered sufficiently. All the graduates called for more curriculum attention on working with computers, planning and organisation, and leadership skills. More PBL graduates than non-PBL graduates indicated that they had learned profession-specific methods, communication skills and teamwork in medical school. DISCUSSION: Overall, the graduates appeared to be satisfied with their knowledge and skills. The results suggest that the PBL school provided better preparation with respect to several of the competencies. However, both PBL and non-PBL graduates identified deficits in their general competencies, such as working with computers and planning and organising work. These competencies should feature more prominently in undergraduate medical education.     

Medical teachers' concerns about the clinical teaching context

INTRODUCTION: Despite several unique aspects of the medical teacher's role compared to other teachers in higher education, there has been little research in this area. In particular there have been few studies which have explored teachers' perspectives on their role. This study aimed to elicit teachers' perceptions of the teaching environment in a single medical school at a time of curriculum change. METHODS: As part of an ethnographic study to explore the culture of the school, 22 teachers took part in in-depth, semi-structured interviews to ascertain their views and experiences of teaching. Additional data were collected through participant observation of curriculum meetings, and informal data collection. The data were analysed using a grounded approach, which resulted in over 200 analytic codes being assigned, which were later grouped into six main themes. RESULTS: The strongest themes to emerge were teachers' concerns about the students, the infrastructure for teaching and their relationship with the medical school. These included concerns about the lack of student clerking activity, insufficient monitoring of students, poor support or recognition of teaching and a perceived lack of inclusion in the medical school. DISCUSSION: The structure and culture within the medical school and associated hospital trust appeared to offer little support for doctors in their teaching role. This suggested that teaching was not highly valued. Teachers were preoccupied with the practical issues of teaching, leaving little time to consider more fundamental educational issues. These findings have implications for the quality of teaching and implementation of curricular change.     

A web-based presentation of an undergraduate clinical skills curriculum

AIMS: The aim of this study was to use information and communications technology to present a curriculum of clinical skills in a user-friendly format. SETTING: A UK undergraduate medical school with a problem-based curriculum and a strong emphasis on proficiency in clinical skills. STUDY DESIGN: Case study describing the qualitative analysis of users' requirements and development of a web-based learning portfolio. EVALUATION: The study involved direct observation of users during a 'think-aloud' protocol, a validated software users' measurement inventory and a 17-item questionnaire designed to test whether 'SkillsBase' met its users' requirements. RESULTS: Students wanted a clear and flexible presentation of their skills curriculum that was easy to navigate, offered instructional material and standards for self- and peer assessment, offered useful Internet links, allowed them to compare their progress with school standards and peer norms, and could be used as a learning portfolio. During the think-aloud protocol, students made very few errors in data interpretation or navigation, and found SkillsBase easy to learn and aesthetically pleasing to use. They rated it higher on all measures of usability than standard commercial software. The questionnaire showed that it met most aspects of its design specification, although many students were doubtful that they would use its reflective function. It is available for inspection at http://www.skillsbase.man.ac.uk/. CONCLUSIONS: SkillsBase meets the design specification for a training and reflective aid to learning clinical skills and is very usable.     

The teaching of professional attitudes within UK medical schools: Reported difficulties and good practice

INTRODUCTION: The demonstration of appropriate attitudinal behaviour is crucial in the professional development of doctors. This study explores the experiences of UK medical schools in developing and assessing the behaviour associated with the attitudes of undergraduate medical students. METHODS: A qualitative in-depth interview study was based on a questionnaire survey of all UK medical schools. Six heads of medical schools or their nominated representatives were interviewed. Outcome measures were the perceptions and experiences of developing and assessing appropriate attitudes and behaviour in their undergraduate students. RESULTS: Aspects of the hidden curriculum, especially the negative role modelling encountered during clinical practice, were seen to undermine the attitudinal messages of the formal curriculum. Some participants believed that students could still qualify as doctors despite having inappropriate attitudes or behaviour. Others felt certain that this was now unlikely in their school, and this confidence seemed to be backed up with the knowledge that strategies, systems and structures were in place to detect and act upon poor behaviour. DISCUSSION: The conviction that it is right to assess students on their attitudinal behaviour does not yet appear to be held consistently across all schools and we suggest that this may reflect some fundamental tensions arising from differing views about the essential elements of good medical practice, tensions that are also shaping the hidden curriculum.     

Pre-registration house officers' views on studying under a reformed medical curriculum in the UK

In 1996 the University of Liverpool introduced a new curriculum based on the recommendations published in Tomorrow's Doctors. This work examines how graduates of that course view their undergraduate curriculum and whether they consider it prepared them well for the pre-registration year. Five focus groups were arranged with a selection of graduates from the first cohort to graduate from the reformed curriculum in order to ascertain their views on the course and how it had prepared them to work as pre-registration house officers (PRHOs). The focus groups were tape-recorded, transcribed and analysed. The PRHOs felt they had been well prepared for the PRHO year, citing the clinical experience of the final year, communication skills classes and the Clinical Skills Resource Centre as having been particularly beneficial. There were concerns about their basic science knowledge base although this had not affected their ability to work as PRHOs. They had criticisms of the way part of their course had been structured but overall they were happy with the content of the course. A reformed medical curriculum in the UK can prepare graduates well to work as junior doctors and can take away some of the anxiety associated with graduation; therefore, to that extent curriculum reform has worked. However, anxiety about undertaking the role of junior doctor seems to have been replaced by anxiety about knowledge base, despite having adequate knowledge to work as PRHOs. Students undertaking a reformed curriculum are wary about being the first people to use their training in the workplace. This factor may need to be considered when further reforms are introduced.     

Educational supervisors evaluate the preparedness of graduates from a reformed UK curriculum to work as pre-registration house officers (PRHOs): a qualitative study

INTRODUCTION: In 1996 the University of Liverpool introduced an integrated problem-based learning (PBL) medical curriculum incorporating the recommendations of Tomorrow's Doctors. This paper investigates whether the PRHO (pre-registration house officer) educational supervisors who supervise Liverpool graduates believe that the reformed curriculum is producing house officers who have the competencies outlined by the General Medical Council. METHODS: Forty-one interviews were arranged with a sample of educational supervisors in the Mersey Deanery area to ascertain their views on the competencies of Liverpool PRHOs. The interviews were tape-recorded, transcribed and analysed. RESULTS: The supervisors felt that the PRHOs had been well prepared to work as PRHOs, and compared with traditional graduates they were actually better prepared for the job of PRHO. They saw the PRHOs as competent communicators with improved clinical skills, who had good attitudes, were aware of limitations, were team workers, good at history-taking and examination and had different approaches to finding information. There was a very confusing picture regarding basic knowledge, with some consultants expressing concerns, despite saying they had adequate knowledge to work as PRHOs. It emerged that there was little consensus about the knowledge base of the traditional or PBL graduates or what knowledge level was needed at this stage. DISCUSSION: Educational supervisors believe that the reformed curriculum in Liverpool is producing competent PRHOs who have been better prepared for the role of PRHO than previous graduates. It could be that uncertainty over knowledge base may be the price paid for reducing the factual burden and improving preparedness for professional practice.     

Growth of analytical thinking skills over time as measured with the MATCH test

Context Ber’s Comprehensive Integrative Puzzle aims to assess analytical clinical thinking in medical students. We developed a paediatric version, the MATCH test, in which we added two irrelevant options to each question in order to reduce guessing behaviour. We tested its construct validity and studied the development of integrative skills over time. Methods We administered a test (MATCH 1) to subjects from two universities, both with a 6‐year medical training course. Subjects included 30 students from university 1 who had completed a paediatric clerkship in Year 4, 23 students from university 2 who had completed a paediatric clerkship in Year 5, 13 students from both universities who had completed an advanced paediatric clerkship in Year 6, 28 paediatric residents and 17 paediatricians. We repeated this procedure using a second test with different domains in a new, comparable group of subjects (MATCH 2). Results Mean MATCH 1 scores for the respective groups were: Year 4 students: 61.2% (standard deviation [SD] 1.3); Year 5 students: 71.3% (SD 1.6); Year 6 students: 76.2% (SD 1.5); paediatric residents: 88.5% (SD 0.7), and paediatricians: 92.2% (SD 1.1) (one‐way anova F = 104.00, P < 0.0001). Students of both universities had comparable scores. MATCH 1 and 2 scores were comparable. Cronbach’s α‐values in MATCH 1 and 2 were 0.92 and 0.91, respectively, for all subjects, and 0.82 and 0.87, respectively, for all students. Conclusions Analytical clinical thinking develops over time, independently of the factual content of the course. This implies that shortened medical training programmes could produce less skilled graduates.