Responding to the implications of the genetics revolution for the education and training of doctors: a medical humanities approach

BACKGROUND: Rapid advances in the field of genetics continue to present medical educators with significant challenges. Whilst there is undoubtedly a pressing need to educate doctors about genetic disorders, research and therapies, there is a parallel need to provide a context for all of these. CONTENT: An interdisciplinary, arts and humanities based approach, responding to this need, is described. This teaching has been successfully delivered both as optional and core undergraduate teaching, and as part of continuing professional development. THE HUMAN PERSPECTIVE: STORIES NOT HISTORIES: Understanding of the patient's perspective can be significantly improved by drawing on both written and oral stories of illness. THE HISTORICAL PERSPECTIVE: LEARNING FROM THE PATIENT: Experiential learning provides insights into the social history of developments in genetics, thereby placing the current concern and debate about the new genetics in context. THE ROLE OF THE MEDIA: THE POWER TO PERSUADE: Critical reading skills can be developed and the power of the popular press to influence the reader acknowledged by analysing and employing the skills of the journalist when reporting developments in biotechnology. LEARNER ASSESSMENT AND EVALUATION: Assessment, both formative and summative, demonstrates sophisticated insights and perspectives into the lived experience of genetic illness. Learner evaluation of the teaching is high. CONCLUSION: Medical humanities offers a powerful way to convey an understanding of how genetic disorders impact on the lives of patients and families, and to set this against the background of a history rich in the uses, and abuses, of knowledge of heredity.     

Contribution of medical students to admission interviews

Objective  Medical students were included in 3-person interview panels selecting applicants for a 4-year medical programme for graduates and health professionals. We analysed student contributions to the interview panels.
Methods  A total of 188 semi-structured interviews were carried out over 2 years. The scores of 17 student interviewers were compared with those of the other 2 members of the panels.
Results  Students were positive about the interview process and their involvement. Overall interview scores did not differ between students and other interviewers. However, students gave lower scores overall and in a number of individual areas to those who had the highest consensus scores and were offered places on the programme. Students were more likely than other interviewers to be indecisive between 2 scores (25.2% versus 17.5%; P  <   0.01).
Conclusions  Students can be integrated effectively into the interview process. However, they tend to be more reluctant to give high scores and less decisive about committing to a single score than more experienced interviewers. Students value the experience of participating in the selection process, especially when combined with an exploration of the literature related to selection procedures.     

Making sense of focus groups

CONTEXT: This paper provides an overview of the contribution of medical education research which has employed focus group methodology to evaluate both undergraduate education and continuing professional development. PRACTICALITIES AND PROBLEMS: It also examines current debates about the ethics and practicalities involved in conducting focus group research. It gives guidance as to how to go about designing and planning focus group studies, highlighting common misconceptions and pitfalls, emphasising that most problems stem from researchers ignoring the central assumptions which underpin the qualitative research endeavour. PRESENTING AND DEVELOPING FOCUS GROUP RESEARCH: Particular attention is paid to analysis and presentation of focus group work and the uses to which such information is put. Finally, it speculates about the future of focus group research in general and research in medical education in particular.     

The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: a case study

AIM: Because it deals with qualitative information, portfolio assessment inevitably involves some degree of subjectivity. The use of stricter assessment criteria or more structured and prescribed content would improve interrater reliability, but would obliterate the essence of portfolio assessment in terms of flexibility, personal orientation and authenticity. We resolved this dilemma by using qualitative research criteria as opposed to reliability in the evaluation of portfolio assessment. METHODOLOGY/RESEARCH DESIGN: Five qualitative research strategies were used to achieve credibility and dependability of assessment: triangulation, prolonged engagement, member checking, audit trail and dependability audit. Mentors read portfolios at least twice during the year, providing feedback and guidance (prolonged engagement). Their recommendation for the end-of-year grade was discussed with the student (member checking) and submitted to a member of the portfolio committee. Information from different sources was combined (triangulation). Portfolios causing persistent disagreement were submitted to the full portfolio assessment committee. Quality assurance procedures with external auditors were used (dependability audit) and the assessment process was thoroughly documented (audit trail). RESULTS: A total of 233 portfolios were assessed. Students and mentors disagreed on 7 (3%) portfolios and 9 portfolios were submitted to the full committee. The final decision on 29 (12%) portfolios differed from the mentor's recommendation. CONCLUSION: We think we have devised an assessment procedure that safeguards the characteristics of portfolio assessment, with credibility and dependability of assessment built into the judgement procedure. Further support for credibility and dependability might be sought by means of a study involving different assessment committees.     

Low- to high-fidelity simulation – a continuum of medical education?

Context  Changes in medical training and culture have reduced the acceptability of the traditional apprenticeship style training in medicine and influenced the growth of clinical skills training. Simulation is an educational technique that allows interactive, and at times immersive, activity by recreating all or part of a clinical experience without exposing patients to the associated risks. The number and range of commercially available technologies used in simulation for education of health care professionals is growing exponentially. These range from simple part-task training models to highly sophisticated computer driven models.
Aim  This paper will review the range of currently available simulators and the educational processes that underpin simulation training. The use of different levels of simulation in a continuum of training will be discussed. Although simulation is relatively new to medicine, simulators have been used extensively for training and assessment in many other domains, most notably the aviation industry. Some parallels and differences will be highlighted.     

Cross-year peer tutoring experience in a medical school: conditions and outcomes for student tutors

AIMS: To examine the features of cross-year peer tutoring and to explore their relationships to learners' characteristics and educational outcomes from the student-tutor perspective. METHOD: The records of 447 final year medical students were examined to provide data on the starting terms, frequency and course targets of peer tutoring activity of student tutors. The relationships of these features with their learners' characteristics, academic achievements and selective clerkship pathways were analysed. SETTING: The medical education programme at the University of Brasilia, Brazil. RESULTS: Analysis showed that about 96% of all graduates had acted as student tutors at some time during the programme, with great variation in starting terms, numbers and types of courses tutored. The average number of tutored courses per tutor was four. Frequency and variety of tutored courses were significantly related to achievement, learning style and gender. Higher achievers acted as student tutors for many terms and explored different subjects, and there is evidence that the experience expanded their academic expertise. Specific tutoring in a clinical course also related to strength of early career preference. Furthermore, there was a significant correlation between the number of terms of tutoring undertaken in a clinical course and the proportion of students choosing selective clerkship training in the same area by the end of programme. CONCLUSIONS: The findings suggest that acting as a peer tutor can be an appealing and constructive educational opportunity to further students' academic development. Enhanced expertise seems to relate to the accumulation and breadth of tutoring experience. Moreover, clinical tutoring may help students in making decisions regarding choice of career.     

An acute care skills evaluation for graduating medical students: a pilot study using clinical simulation

PURPOSE: This investigation aimed to explore the measurement properties of scores from a patient simulator exercise. METHODS: Analytic and holistic scores were obtained for groups of medical students and residents. Item analysis techniques were used to explore the nature of specific examinee actions. Interrater reliability was calculated. Scores were contrasted for third year medical students, fourth year medical students and emergency department residents. RESULTS: Interrater reliabilities for analytic and holistic scores were 0.92 and 0.81, respectively. Based on item analysis, proper timing and sequencing of actions discriminated between low- and high-ability examinees. In general, examinees with more advanced training obtained higher scores on the simulation exercise. CONCLUSION: Reliable and valid measures of clinical performance can be obtained from a trauma simulation provided that care is taken in the development and scoring of the scenario.     

A longitudinal study of self-assessment accuracy

AIM: Although studies have examined medical students' ability to self-assess their performance, there are few longitudinal studies that document the stability of self-assessment accuracy over time. This study compares actual and estimated examination performance for three classes during their first 3 years of medical school. METHODS: Students assessed their performance on classroom examinations and objective structured clinical examination (OSCE) stations. Each self-assessment was then contrasted with their actual performance using idiographic (within-subject) methods to define three measures of self-assessment accuracy: bias (arithmetic differences of actual and estimated scores), deviation (absolute differences of actual and estimated scores), and covariation (correlation of actual and estimated scores). These measures were computed for four intervals over the course of 3 years. Multivariate analyses of variance and correlational analyses were used to evaluate the stability of these measures. RESULTS: Self-assessment accuracy measures were relatively stable over the first 2 years of medical school with a decease occurring in the third year. However, the correlational analyses indicated that the stability of self-assessment accuracy was comparable to the stability of actual performance over this same period. CONCLUSION: The apparent decline in accuracy in the third year may reflect the transition from familiar classroom-based examinations to the substantially different clinical examination tasks of the third year OSCE. However, the stability of self-assessment accuracy compares favorably with the stability of actual performance over this period. These results suggest that self-assessment accuracy is a relatively stable individual characteristic that may be influenced by task familiarity.     

Evaluation of undergraduate medical education in Finnish community-oriented and traditional medical faculties: a 10-year follow-up

OBJECTIVES: This study focused on Finnish physicians' views of their undergraduate medical education. Differences between traditional and community-oriented medical faculties were examined and changes which had taken place during a 10-year follow-up period were also assessed. METHODS: The study was based on data retrieved from a postal survey made among Finnish physicians in 1998. The study population consisted of all doctors who graduated between 1987 and 1996 (n=4926); those born on odd-numbered days were selected for this study (n=2492). A postal questionnaire and two reminders were sent to those selected, and 1822 questionnaires were returned, giving a response rate of 73.1%. RESULTS: Physicians who graduated from the community-oriented faculties were more satisfied with their undergraduate medical education when compared with their colleagues graduating from traditional faculties. There were some differences between the universities with respect to education for hospital work. The teaching of primary health care, however, was clearly more effective in community-oriented faculties. The proportion of graduates who were satisfied with their primary care education was over 70% in community-oriented faculties, whereas in the traditional faculties it was only 35-45%. CONCLUSIONS: According to graduates, the community-oriented medical school curriculum better meets the needs of practising physicians than that in traditional faculties. In curriculum reforms, more emphasis should be placed on comprehensive medical education, which includes both primary and secondary health care.     

Accreditation of postgraduate medical education in the United States and Canada: a comparison of two systems

The systems for accrediting residency programmes in the United States and Canada, although they have developed independently in the two countries, have similar objectives and accreditation requirements. Both have become increasingly focused over the past several decades on the importance of educational programmes structured to provide graded professional responsibility with appropriate guidance and supervision to residents according to their level of training, ability and experience. The Canadian model used by the Royal College of Physicians and Surgeons of Canada is a centrist one, with accreditation decisions on all programmes in all specialties being vested in a single, multidisciplinary accreditation committee. The American model developed by the Accreditation Council for Graduate Medical Education is a distributive one, with accreditation decisions being vested in each specialty Residency Review Committee. In both models, accreditation is based on a system of periodic on-site visits during which both faculty and residents are interviewed by a surveyor to provide the accrediting body with a first-hand evaluation of the extent to which each accredited programme meets the standards of accreditation. While they are similar in purpose, there are significant differences in the operation of the two systems.     

Assessing student reflection in medical practice. The development of an observer-rated instrument: reliability, validity and initial experiences

INTRODUCTION: This study describes the development of an instrument to measure the ability of medical students to reflect on their performance in medical practice. METHODS: A total of 195 Year 4 medical students attending a 9-hour clinical ethics course filled in a semi-structured questionnaire consisting of reflection-evoking case vignettes. Two independent raters scored their answers. Respondents were scored on a 10-point scale for overall reflection score and on a scale of 0-2 for the extent to which they mentioned a series of perspectives in their reflections. We analysed the distribution of scores, the internal validity and the effect of being pre-tested with an alternate form of the test on the scores. The relationships between overall reflection score and perspective score, and between overall reflection score and gender, career preference and work experience were also calculated. RESULTS: The interrater reliability was sufficient. The range of scores on overall reflection was large (1-10), with a mean reflection score of 4.5-4.7 for each case vignette. This means that only 1 or 2 perspectives were mentioned, and hardly any weighing of perspectives took place. The values over the 2 measurements were comparable and were strongly related. Women had slightly higher scores than men, as had students with work experience in health care, and students considering general practice as a career. CONCLUSIONS: Reflection in medical practice can be measured using this semistructured questionnaire built on case vignettes. The mean score allows for the measurement of improvement by future educational efforts. The wide range of individual differences allows for comparisons between groups. The differences found between groups of students were as expected and support the validity of the instrument.     

Short-term outcomes and long-term impact of a programme in medical education for medical students

Objectives  There is growing appreciation of the value of early preparation of future medical educators. Staff development programmes, conferences and workshops pertaining to the training of educators may be crucial to the pursuit of a school's larger educational mission to educate students, doctors and scholars and to provide comprehensive knowledge, research, patient care and service. This study examined the efficacy of a 1-week educational intervention aimed at preparing medical students to become effective doctor educators by building skills early in their careers. The study asked whether participation in a 5-day teacher training programme led to increased knowledge of instructional methods, more favourable attitudes towards teaching, and the integration of structured instructional design methods in a student-developed teaching project.
Methods  A mixed methods research design was employed with quantitative data captured through pre- and post-test inventories, qualitative components captured through written comments, and a 2-year post-intervention survey. Quantitative analyses included pre-/post-intervention repeated measures with calculated effect sizes. Qualitative analysis was conducted using constant comparative methods.
Results  Subjects demonstrated improved content knowledge and more positive attitudes towards motivation, teaching confidence, teacher roles, varied pedagogy, and use of assessment, instructional planning, and evaluation. Subjects were able to incorporate the programme's teaching theory and methods into their teaching projects and assessment of peers' and others' teaching in their own institutions 2 years post-training.
Conclusions  This study demonstrates that a well-designed programme for teacher preparation can be pedagogically effective for training medical students to become better educators and that this learning can be incorporated into long-term practice.     

Patient-centred medicine through student-centred teaching: a student perspective on the key impacts of community- based learning in undergraduate medical education

CONTEXT: The UK General Medical Council has proposed that increased use of community settings is essential to enhancement of medical education. However, such curriculum developments have been directed by educationalists and clinical faculty; there is to date little to show whether student perspectives accord with such expectations. AIM: To examine student views on whether community-based learning during a UK undergraduate medical education course results in new learning in the areas expected, and to elucidate any process factors which enhance attainment of learning objectives. METHOD: Nominal group technique, to develop consensus on important learning outcomes and process factors, and questionnaire survey, developed from the views of the nominal groups. RESULTS: 89 students participated (response rate 70% for the nominal groups, and 88% for questionnaire). Students perceived increased learning in many of the areas expected. In particular, students reported significant learning from: witnessing the impact of a longer term and more personal relationship with patients; the visible impact of social environment on health; the importance of dealing with people rather than diseases, and the use of the whole team for care. In addition, they emphasized that tutor, staff and patient enthusiasm for student presence and learning greatly enhanced the student learning experience. CONCLUSIONS: Community settings appear to achieve the expected attitudinal adaptation of students. The role of the committed tutor and team is seen as pivotal to learning. The conclusions support an increased emphasis in contemporary medical education and related research activity on the key impact of relationships in the learning environment.     

Elaborated learning in undergraduate medical education

Southampton Medical School holds its major examination of basic knowledge after rather than before students enter their first clinical attachments. An interview survey investigated its educational effects, and found that students adopt one of four revision approaches. The most successful, not just in terms of examination grade but more particularly in students' subsequent ability to retrieve and use the knowledge gained, occurred when students related their preclinical revision to their clinical experiences. One of these approaches, an elaboration of knowledge, is considered to be essential for effective clinical thinking yet is probably rare elsewhere in medical education since it appears to be a consequence of a particular curricular arrangement. An explanation is given in terms of current thinking in cognitive psychology, and this challenges the theoretical assumptions on which other research in medical education has been uncritically based. Some implications for medical education and further research are discussed.     

CELT: a computerised evaluative learning tool for continuing professional development

OBJECTIVES: To evaluate a computerised, evaluative learning tool (CELT) designed to encourage self-directed learning and help users make changes in practice following learning. The study aimed to evaluate how CELT was used and to ascertain user perceptions of the program. DESIGN: Qualitative analysis of interviews and quantitative analysis of entries made using the software. SETTING AND SUBJECTS: West of Scotland region, comprising six Health Board areas with a total of 2176 general practitioners (GPs), 39 of whom took part in the study. RESULTS: Of the 39 GPs who started on the project, 34 used CELT. Of these 34, 28 GPs sent in files and six did not. Of the 28 GPs who sent in files, 25 entered data and 76% (22/29) considered the program easy to use. The program was used 7 days a week during the day and night. It raised participants' awareness of the educational value of everyday experiences and led to increased thought about learning. In 41% (45/111) of entries there was evidence that some action had been initiated by users as a result of learning. CONCLUSIONS: CELT was designed to encourage self-directed learning and help users make changes in practice following learning. The study has shown that it can be used to deliver individual continuing professional development. It encourages a disciplined approach to learning, promotes thought about learning needs and increases the ability of GPs to learn from everyday experiences. In some instances, users were able to apply what had been learned.     

Medical students proposing questions for their own written final examination: evaluation of an educational project

BACKGROUND: In order to emphasise learning more than control, from autumn 2000 we have invited medical students to propose questions for their own written examination in family medicine. One out of three student's proposals was guaranteed to be a part of their coming written examination, possibly somewhat modified. AIM: To evaluate how sixth year medical students experienced the project, and to what extent their performance in the examination was influenced. PARTICIPANTS: Sixth year medical students. MAIN OUTCOME MEASURES: The project was evaluated using (i) marks in examination; (ii) scores on self-administered questionnaires; and (iii) students' free text evaluation. RESULTS: Fifty-seven of 64 (89%) students taking their examination in autumn 2000, and 56 of 59 (95%) students taking the exam in spring 2001, responded. In autumn 2000, 34 (60%) students reported that the project had changed their learning strategies. During spring 2001, 46 of 56 students participated in producing questions, using a mean of 2.6 hours on the work. Students got 5-7% higher marks on their own questions on a scale ranging from 1 to 12. The students' free text evaluation showed that they had prepared especially thoroughly for the topics proposed by the students. They found it comforting to know at least one of the questions in the examination, and the students' questions were found relevant for general practice. CONCLUSION: Encouraging students to write questions for their own examination makes them feel more confident during the examination period, and may increase their reflective learning, without seriously limiting topics studied or violating the control function of the examination.     

The relation between understanding and practice in problem-based medical education

The importance of conceptions of the soundness of medical education are considered briefly. This leads to the question of misconceptions. A pervasive misconception characterized by the separation of understanding from action and practice, illustrated by two examples from the literature on medical education, is discussed. Questions as to the soundness of medical education are usually approached in terms of empirical inquiry; this paper takes a different, complementary, approach. Five medical faculties in Australia, Sweden and the UK. Problem-based medical course staff and students. The practical effect of the separation between action and practice is illustrated in the question of problem-solving as conceived in transitional semiproblem-based curricula in common with traditional curricula, limiting the development of sound professional education. The centrality of the misconception generates a widespread approach to the curriculum, described as the 'Convenient peg' model. In contrast, the 'Growing web' model enables the design of rigorous problem-based curricula which acknowledge that action and practice are necessarily related to understanding in a way unrecognized in the 'Convenient peg' model. Consequently, rigorous problem-based curricula embody a thoroughly integrated curriculum enabling improved medical education.     

Developing professional clinical skills for practice – the results of a feasibility study using a reflective approach to intimate examination

Objectives  To develop a student-selected component (SSC) for junior medical students, to evaluate the feasibility of incorporating the development of skills in carrying out an intimate examination, whilst developing professional thinking skills using a reflective approach.
Subjects  The student selected component was designed for a maximum of 6 students over a 4-week period in Phase 2 (year 2 and 3) of the undergraduate medical curriculum.
Setting  The Clinical Skills Centre, the Faculty of Medicine Nursing and Dentistry, University of Dundee, Scotland, UK.
Methods  The SSC consisted of a weekly patient clerking from the ward, an analysis of the clinical and communication skills for any intimate examinations the patient would require, and practice using simulators and simulated patients. Students were supported by timed periods of structured reflection, which enabled them to discuss ethical issues and their own professional conduct related to carrying out an intimate examination. The SSC was evaluated on 3 levels; student satisfaction, learning professional thinking using a reflective approach, and observing behaviour change in relation to skill development, using a ward simulation exercise.
Results  The evaluation at the levels of student satisfaction, learning professional thinking and changes in behaviour associated with intimate examination demonstrated that the SSC had been well received by the students, who felt they had improved their skills in intimate examinations in the context of a ward simulation exercise, in parallel with their professional thinking skills.
Conclusion  It is possible to develop the professional thinking of junior medical students at the same time as developing their technical competence in relation to intimate examinations. It may be advantageous to introduce students early to this reflective approach, using simulation to promote the integration of theory with practice.