Evaluation of procedural skills training in an undergraduate curriculum

CONTEXT: A substantial proportion of medical students enter their intern year without any basic skills experience. Lack of experience is a significant source of stress for many junior doctors. OBJECTIVES: To evaluate the effect of a basic procedural skills tutorial for Year 3 medical students on their competence in relevant skills at Year 5. SUBJECTS: The control group consisted of 93 medical students who completed Year 3 in 1996. The intervention group consisted of 92 medical students who completed Year 3 in 1997. The intervention group received a practical skills tutorial in Year 3; the control group did not. Both groups were assessed on their practical skills competence during Year 5. METHODS: A 3-hour practical tutorial on injection and suturing techniques was delivered to the intervention group. The effectiveness of the intervention was assessed by self-reported experience of giving injections, inserting sutures and sustaining needlestick injuries, and by teacher-rated competency in four basic procedural skills. RESULTS: Students who received the Year 3 tutorial were significantly more likely to record a satisfactory assessment for their performance in all four basic skills compared with students who did not receive the tutorial. They were less likely than controls to refuse invitations to give injections, but not invitations to insert a suture, during Years 4 and 5. CONCLUSIONS: A single session of formalised teaching in procedural skills in the early stages of a medical degree can have long-term effectiveness in basic skills competence and may increase students' confidence to practise their skills.     

Peer assessment of professional competence

BACKGROUND: Current assessment formats for medical students reliably test core knowledge and basic skills. Methods for assessing other important domains of competence, such as interpersonal skills, humanism and teamwork skills, are less well developed. This study describes the development, implementation and results of peer assessment as a measure of professional competence of medical students to be used for formative purposes. METHODS: Year 2 medical students assessed the professional competence of their peers using an online assessment instrument. Fifteen randomly selected classmates were assigned to assess each student. The responses were analysed to determine the reliability and validity of the scores and to explore relationships between peer assessments and other assessment measures. RESULTS: Factor analyses suggest a 2-dimensional conceptualisation of professional competence: 1 factor represents Work Habits, such as preparedness and initiative, and the other factor represents Interpersonal Habits, including respect and trustworthiness. The Work Habits factor had moderate, yet statistically significant correlations ranging from 0.21 to 0.53 with all other performance measures that were part of a comprehensive assessment of professional competence. Approximately 6 peer raters were needed to achieve a generalisability coefficient of 0.70. CONCLUSIONS: Our findings suggest that it is possible to introduce peer assessment for formative purposes in an undergraduate medical school programme that provides multiple opportunities to interact with and observe peers.     

Perceived stress during undergraduate medical training: a qualitative study

INTRODUCTION: Medical education is long and emotionally taxing. It can involve levels of stress that lead to disruptions in both physical and mental health. This qualitative study explores the views of Year 5 medical students on the causes of stress throughout their undergraduate medical training. METHOD: Semi-structured interviews were conducted with 21 final year medical students at the University of Birmingham between January and May 2001. RESULTS: Pressure of work, especially in terms of preparing for examinations and acquiring professional knowledge, skills and attitudes were reported as the most stressful aspects of medical training. Transition periods, particularly between school and medical school, preclinical and clinical training, and clinical training to approaching qualification were highlighted as particularly stressful. A perceived lack of support from the medical school authorities also appeared to add to student stress levels. DISCUSSION: Student stress may be alleviated by greater guidance and support from the medical school during crucial transition periods. Aspects of professional socialisation may also need to be addressed to reduce the levels of stress associated with undergraduate training for future generations of medical students.     

Early introduction of clinical skills teaching in a medical curriculum--factors affecting students' learning

OBJECTIVE: To evaluate the effects of the early introduction of clinical skills teaching on students' learning following an overhaul of the curriculum of a traditional Asian medical school. METHODS: Randomly selected medical students in Year I and II were invited to participate in 30 focus group interviews while all students were asked to assist with the questionnaire survey. Most students were contacted personally to help them understand the objectives of the study. Confidentiality was emphasised and a non-faculty interviewer was recruited for the interviews. RESULTS: Two hundred and eight of Year I/Year II students attended the lunchtime focus group interviews (response rate=86.7%) while 252 (73.5%) students returned the questionnaire. The majority of them (87%) agreed or strongly agreed that it was good to introduce clinical skills in the early years of the curriculum. They reflected that the course enhanced their learning interest and made them feel like doctors. They also made many constructive suggestions on how the course could be improved during the interactive focus group interviews so that the negative effects could be minimised. CONCLUSION: It is useful to introduce clinical skills in the early years of a medical curriculum. A comprehensive course evaluation, using both quantitative and qualitative methods, helps to collect useful information on how the course can be improved.     

Student perceptions of effective small group teaching

PURPOSE: The goal of this study was to assess student perceptions of effective small group teaching during preclinical training in a medical school that promotes an integrated, systems-based undergraduate curriculum. In particular, students were asked to comment on small group goals, effective tutor behaviours, pedagogical materials and methods of evaluation. METHODS: Six focus groups were held with 46 Year 1 and 2 medical students to assess their perceptions of effective small group teaching in the 'Basis of Medicine' component of the undergraduate curriculum. Ethnographic content analysis guided the interpretation of the focus group data. RESULTS: Students identified tutor characteristics, a non-threatening group atmosphere, clinical relevance and integration, and pedagogical materials that encourage independent thinking and problem solving as the most important characteristics of effective small groups. Tutor characteristics included personal attributes and the ability to promote group interaction and problem solving. Small group teaching goals providing included opportunities to ask questions, to work as a team, and to learn to problem solve. CONCLUSION: This study highlighted the benefits of soliciting student impressions of effective small group teaching. The students' emphasis on group atmosphere and facilitation skills underscored the value of the tutor as a 'guide' to student learning. Similarly, their comments on effective cases emphasised the importance of clinical relevance, critical thinking and the integration of basic and clinical sciences. This study also suggested future avenues for research, such as a comparison of student and teacher perceptions of small group teaching as well as an analysis of perceptions of effective small group learning across the educational continuum, including undergraduate, postgraduate and continuing professional education.     

Medical students' perceptions of identity in communication skills training: a qualitative study

Objectives  Communication skills training in undergraduate medical education is considered to play an important role in medical students' formation of their professional identity. This qualitative study explores Year 1 students' perceptions of their identities when practising communication skills with real patients.
Methods  A total of 23 individual semi-structured interviews and two focus group discussions were conducted with 10 students during their first year of communication skills training. All interviews and discussions were audio-recorded, transcribed and analysed for emergent themes relating to identity.
Results  Students struggled to communicate professionally with patients because of a lack of clinical knowledge and skills. Consequently, students enacted other identities, yet patients perceived them differently, causing conversational ambiguities.
Discussion  Students' perceptions challenge educational goals, suggesting that there is limited potential for the formation of professional identity through early training. Teacher-doctors must acknowledge how students' low levels of clinical competence and patients' behaviour complicate students' identity formation.     

Comprehensive undergraduate medical assessments improve prediction of clinical performance

OBJECTIVES: This study aimed to compare an essay-style undergraduate medical assessment with modified essay, multiple-choice question (MCQ) and objective structured clinical examination (OSCE) undergraduate medical assessments in predicting students' clinical performance (predictive validity), and to determine the relative contributions of the written (modified essay and MCQ) assessment and OSCE to predictive validity. DESIGN: Before and after cohort study. SETTING: One medical school running a 6-year undergraduate course. PARTICIPANTS: Study participants included 137 Year 5 medical students followed into their trainee intern year. MAIN OUTCOME MEASURES: Aggregated global ratings by senior doctors, junior doctors and nurses as well as comprehensive structured assessments of performance in the trainee intern year. RESULTS: Students' scores in the new examinations predicted performance significantly better than scores in the old examinations, with correlation coefficients increasing from 0.05-0.44 to 0.41-0.81. The OSCE was a stronger predictor of subsequent performance than the written assessments but combining assessments had the strongest predictive validity. CONCLUSION: Using more comprehensive, more reliable and more authentic undergraduate assessment methods substantially increases predictive validity.     

Consultant attitudes to undertaking undergraduate teaching duties: perspectives from hospitals serving a large medical school

OBJECTIVE: To explore attitudes among National Health Service consultants responsible for delivering basic clinical teaching to medical students. DESIGN: Postal questionnaire. SUBJECTS AND SETTING: A total of 308 acute hospital trust consultants working in 4 'new' and 4 'established' teaching hospitals in the West Midlands metropolitan area, and involved in the delivery of clinical teaching to Year 3 medical students at the University of Birmingham Medical School during 2002-03. MAIN OUTCOME MEASURE(S): The questionnaire explored contractual requirements, actual teaching commitments and perceptions of medical students' knowledge and attitudes. Responses from doctors and surgeons and from respondents working in established and new teaching hospitals were compared. RESULTS: A total of 249 responses were received (response rate 80.8%). Although many consultants enjoy teaching students, their enjoyment and their ability to deliver high standards of teaching are compromised by time and resource constraints. For many the situation is aggravated by the perceived inappropriate organisation of the clinical teaching curriculum and the inadequate preparation of students for clinical practice. Linking these themes is the overarching perception among teachers that neither service nor educational establishments afford teaching the levels of recognition and reward associated with clinical work or research. CONCLUSION: To overcome barriers to teaching requires more reciprocal links between hospital staff and medical schools, opportunities for consultants to understand and to comment on curricular and timetable developments, and, perhaps most importantly, recognition (in contractual, financial, managerial and personal terms) of the importance of undergraduate teaching in the competing triad of service, research and education.     

Anxiety in medical students: is preparation for full‐time clinical attachments more dependent upon differences in maturity or on educational programmes for undergraduate and graduate entry students?

INTRODUCTION: The transition to full-time clinical studies holds anxieties for most medical students. While graduate entry medical education has only recently begun in the UK, the parallel undergraduate and graduate entry MBBS courses taught at our school allowed us to study how 2 differently prepared groups perceived this vital time at a comparable stage in their training. METHOD: An anonymous questionnaire collected demographic data and graded anxiety in 13 statements relating to starting full-time clinical attachments. Two open questions allowed free text comment on the most positive and negative influences perceived during this time. Both a statistical analysis and a qualitative assessment were performed to compare the 2 groups of students. RESULTS: The 2 groups were similar with respect to gender but the graduate entry students were significantly older. The graduate entry students were significantly less anxious about most aspects of the transition period compared to the undergraduates. These course differences remained after adjusting for age and sex. When adjusted for course and age, male students expressed less anxiety. The main positive qualitative statements related to continual clinical and communication skills training in the graduate entry group. The main qualitative concerns in both groups related to 'fitting in' and perceived lack of factual knowledge. DISCUSSION: These data support the early introduction of clinical skills teaching, backed up by a fully integrated clinically relevant curriculum with continued assessment, in preparing students and reducing levels of anxiety before they start full-time clinical attachments. These course design differences appear to be more important than any differences in maturity between the 2 groups.     

Medical students' perceptions of racial diversity and gender equality

OBJECTIVES: To assess attitudes of medical students toward issues of racial diversity and gender equality and to ascertain changes in these attitudes during the pre-clinical curriculum. METHODS: Attitudes toward multiculturalism and gender equality were assessed using a 43-item questionnaire. The survey was completed by incoming Year 1 students in 2000 and 2001, and was completed again in 2002 by the students who had entered in 2000. Mean scores were analysed at baseline by gender, ethnic group and political affiliation using analysis of variance. The paired scores of the first and follow-up surveys of the 2000 entering class were compared using paired t-tests. RESULTS: Upon entry into medical school, women, minority group students and Democrats scored significantly higher on the cultural sensitivity scale than their comparison groups. No significant changes were seen overall in the matched data. However, minority groups showed a significant increase in scores, while Republicans and white men experienced a non-significant decline. In addition, incoming students judged cultural competency education to be important. The perceived need to increase the numbers of minority group doctors varied by gender, ethnic group and political affiliation. CONCLUSIONS: Among incoming medical students, perceptions of racial diversity and gender equality vary along ethnic, gender and political lines. Additionally, pre-clinical education was associated with increased cultural sensitivity by minority group students, but not by others. These findings demonstrate the continuing need for diversity in medical school and for medical students to recognise and address their personal and group biases.     

Perceptions of dissection by students in one medical school: beyond learning about anatomy. A qualitative study

INTRODUCTION: The practice of dissection, as part of undergraduate medical education, has recently resurfaced in the public eye. This paper focuses on a number of important learning outcomes that were reported by Year 1-5 medical students in a British medical school, during the dissection sessions in the first 2 years of their training, as part of a wider qualitative research project into undergraduate medical education. METHODS: A group of 29 students was selected by quota sampling, using the whole student population of the medical school as the sampling frame. Qualitative data were collected by 1 : 1 interviews with students and from formal non-participatory observations of dissection sessions. RESULTS: Apart from learning to cope with the overt 'emotional confrontation' with the cadavers which assists anatomical learning, 7 additional covert learning outcomes were identified by the students: teamwork, respect for the body, familiarisation of the body, application of practical skills, integration of theory and practice, preparation for clinical work, and appreciation of the status of dissection within the history of medicine. DISCUSSION: A number of medical schools have either removed the practical, hands-on aspect of dissection in the medical undergraduate curriculum or are seriously considering such a measure, on financial and/or human resource grounds. This study highlights the fact that dissection can impart anatomical knowledge as well as offer other relevant, positive learning opportunities to enhance the skills and attitudes of future doctors.     

Measuring the effect of interprofessional problem-based learning on the attitudes of undergraduate health care students

OBJECTIVES: This study aimed to measure the improvement in attitudes towards interprofessional collaboration of undergraduate health care students who have a single module of interprofessional problem-based learning (PBL) using real patients as triggers integrated into their curricula. DESIGN: A dedicated module, consisting of 5 PBL seminars, was integrated into the undergraduate medical, nursing and physiotherapy curricula at the participating institutions. Seminar groups consisted of students from a single profession in the control group, and of evenly distributed students from the participating professions in the intervention group. The Interdisciplinary Education Perception Scale was used to measure improvements in attitudes towards interprofessional co-operation. Patients, faculty members and students were included in the evaluation of the interprofessional module and their comments examined for indications of adverse effects of the use of patients in this setting. RESULTS: A total of 177 students were recruited into the study and assigned to 1 of 16 seminar groups, all of which attended the complete module, 8 in control mode and 8 in intervention mode. Statistically significant improvements could be identified in the overall attitudes of male students in the intervention group, and in attitudes pertaining to the competence and autonomy of individuals in one's own profession in the intervention group as a whole. No significant improvements were detected in the control group. No adverse effects of the use of real patients came to light. CONCLUSIONS: The integration of an interprofessional educational module that requires limited student and faculty time in undergraduate health care curricula may be proven to have an effect. The Interdisciplinary Education Perception Scale may be suitable for measuring such effect. Real patients may continue to contribute to education in this setting.     

An empirical study of the predictive validity of number grades in medical school using 3 decades of longitudinal data: implications for a grading system

Context It is important to establish the predictive validity of medical school grades. The strength of predictive validity and the ability to identify at-risk students in medical schools depends upon assessment systems such as number grades, pass/fail (P/F) or honours/pass/fail (H/P/F) systems. Objective This study was designed to examine the predictive validity of number grades in medical school, and to determine whether any important information is lost in a shift from number to P/F and H/P/F grading systems. Subjects The participants in this prospective, longitudinal study were 6656 medical students who studied at Jefferson Medical College over 3 decades. They were grouped into 10 deciles based on their number grades in Year 1 of medical school. Methods Participants were compared on academic accomplishments in Years 2 and 3 of medical school, medical school class rank, delayed graduation and attrition, performance on medical licensing examinations and clinical competence ratings in the first postgraduate year. Results Results supported the short- and longterm predictive validity of the number grades. Ratings of clinical competence beyond medical school were predicted by number grades in medical school. We demonstrated that small differences in number grades are statistically meaningful, and that important information for identifying students in need of remedial education is lost when students who narrowly meet faculty's expectations are included with the rest of the class in a broad 'pass' category. Conclusions The findings refute the argument that knowledge of sciences basic to medicine is not critical to subsequent performance in medical school and beyond if an appropriate evaluation system is used. Furthermore, the results of this study raise questions about abandoning number grades in favour of a pass/fail system. Consideration of these findings in policy decisions regarding assessment systems of medical students is recommended.     

Personality traits and types predict medical school stress: a six-year longitudinal and nationwide study

OBJECTIVES: Personality types (combinations of traits) that take into account the interplay between traits give a more detailed picture of an individual's character than do single traits. This study examines whether both personality types and traits predict stress during medical school training. METHODS: We surveyed Norwegian medical students (n = 421) 1 month after they began medical school (T1), at the mid-point of undergraduate Year 3 (T2), and at the end of undergraduate Year 6 (T3). A total of 236 medical students (56%) responded at all time-points. They were categorised according to Torgersen's personality typology by their combination of high and low scores on the 'Big Three' personality traits of extroversion, neuroticism and conscientiousness. We studied the effects of both personality types (spectator, insecure, sceptic, brooder, hedonist, impulsive, entrepreneur and complicated) and traits on stress during medical school. RESULTS: There was a higher level of stress among female students. The traits of neuroticism (P = 0.002) and conscientiousness (P = 0.03) were independent predictors of stress, whereas female gender was absorbed by neuroticism in the multivariate model. When controlled for age and gender, 'brooders' (low extroversion, high neuroticism, high conscientiousness) were at risk of experiencing more stress (P = 0.02), whereas 'hedonists' (high extroversion, low neuroticism, low conscientiousness) were more protected against stress (P = 0.001). CONCLUSIONS: This is the first study to show that a specific combination of personality traits can predict medical school stress. The combination of high neuroticism and high conscientiousness is considered to be particularly high risk.     

Change in knowledge and skills of Year 3 undergraduates in evidence-based medicine seminars

PURPOSE: To evaluate the effect of a compulsory evidence-based medicine (EBM) seminar in critical appraisal skills and the overall acceptance of compulsory EBM seminars for Year 3 medical undergraduate students. METHODS: Small group seminars by peer teaching were conducted for up to 23 undergraduates. Knowledge and skills in EBM before and after the compulsory seminars were evaluated by 2 different sets of 20 questions. To apply knowledge, each undergraduate had to analyse an individual paper case using the principles of EBM. Undergraduates gave anonymous feedback using separate evaluation sheets at the end of the seminar. Main outcome variables were changes in knowledge and skills. RESULTS: A total of 132 Year 3 undergraduates at the University of Frankfurt participated in a compulsory EBM seminar during the academic half-year 2003/04 as part of their regular curriculum. Complete datasets were available for evaluation from 124 undergraduates (94%). The seminars led to an overall increase in knowledge (question paper score increase from 2.37 to 7.48, 99% CI 6.61-8.36, or 216%). Transfer of knowledge into a paper case scenario was generally good, with a mean score of 49.5 (SD 5.24) out of 55 points. Feedback indicated good overall acceptance of the seminars, with a median of 2 (score range from 1 = excellent to 6 = failed). CONCLUSION: Trained medical students are effective and well accepted EBM trainers in compulsory undergraduate seminars.     

Medical students' personality characteristics and academic performance: a five-factor model perspective

OBJECTIVES: This study investigates: (1) which personality traits are typical of medical students as compared to other students, and (2) which personality traits predict medical student performance in pre-clinical years. DESIGN: This paper reports a cross-sectional inventory study of students in nine academic majors and a prospective longitudinal study of one cohort of medical students assessed by inventory during their first preclinical year and by university examination at the end of each pre-clinical year. SUBJECTS AND METHODS: In 1997, a combined total of 785 students entered medical studies courses in five Flemish universities. Of these, 631 (80.4%) completed the NEO-PI-R (i.e. a measure of the Five-Factor Model of Personality). This was also completed by 914 Year 1 students of seven other academic majors at Ghent University. Year end scores for medical students were obtained for 607 students in Year 1, for 413 in Year 2, and for 341 in Year 3. RESULTS: Medical studies falls into the group of majors where students score highest on extraversion and agreeableness. Conscientiousness (i.e. self-achievement and self-discipline) significantly predicts final scores in each pre-clinical year. Medical students who score low on conscientiousness and high on gregariousness and excitement-seeking are significantly less likely to sit examinations successfully. CONCLUSIONS: The higher scores for extraversion and agreeableness, two dimensions defining the interpersonal dynamic, may be beneficial for doctors' collaboration and communication skills in future professional practice. Because conscientiousness affects examination results and can be reliably assessed at the start of a medical study career, personality assessment may be a useful tool in student counselling and guidance.     

Academic misconduct among medical students in a post-communist country

AIM: To assess the prevalence of, attitudes towards and willingness to report different forms of academic dishonesty among medical students in a post-communist transitional country. METHODS: An anonymous, self-administered questionnaire was distributed to medical students in Years 2-6 at the Zagreb University School of Medicine; 827 (70%) valid questionnaires were returned and analysed. RESULTS: Most of the students (94%) admitted cheating at least once during their studies. The most frequent type of misconduct was 'signing in an absent student on a class attendance list' (89.1%), and the least frequent 'paying for passing an examination' (0.7%). The number of committed types of misconduct out of 11 listed types increased from Year 2 (median 2) to Year 6 (median 4). Cheating behaviours could be clustered into 4 groups based on self-reported cheating, perceived prevalence of cheating, attitude towards cheating, and willingness to report cheating. The clustered behaviours that most students admitted to were perceived as the most frequent, more approved of and less likely to be reported. The strongest predictors of dishonest behaviour were attitude, perception of peer group behaviour and study year. Almost half (44%) the students said they would never report any form of cheating. CONCLUSION: Academic misconduct is widespread among medical students at the largest medical school in Croatia and its prevalence is greater than that reported for developed countries. This may be related to social and cultural factors specific to a country in the midst of a post-communist transition to a market economy, and calls for measures to be instigated at an institutional level to educate against and prevent such behaviour.     

Students' opinions about their preparation for clinical practice

INTRODUCTION: There are data that suggest that medical students do not feel sufficiently prepared for clinical practice in the clerkships. The transition from pre-clinical to clinical training causes problems. OBJECTIVES: To seek quantitative verification of qualitative findings from an earlier focus group study on problems medical students encounter when entering the clinical phase of undergraduate training. METHODS: At the start of the clinical phase, all Year 4 students at Maastricht Medical School were surveyed on the transition from pre-clinical to clinical training and its effects on workload, knowledge, skills and learning. RESULTS: The response rate was 67%. Students were uncertain as to how to behave and act, mainly because they did not know what was expected of them. They experienced a drastic increase in workload and a lack of time for studying. They considered themselves to be moderately prepared with regard to knowledge and they regarded their physical examination skills as satisfactory. Students reported having difficulty applying theoretical knowledge in clinical practice and perceived shortcomings in basic science knowledge. In addition, they felt compelled to change their learning strategies. DISCUSSION: The results of this study confirm the findings of the focus group study. The students experienced problems related to professional socialisation and workload and deficiencies in knowledge and the organisation of knowledge. A good starting point for improvement may involve exploring students' suggestions of an extensive introduction into the clerkships, a more gradual transition with regard to workload and closer integration of pre-clinical and clinical education.