Predicting stress in first year medical students: a longitudinal study

While there is ample documentation that medical training is stressful, less is known about predictive variables that might identify students who have the most difficulty in managing stress during medical training. Depression and anxiety in first year medical students were investigated in a longitudinal design. One-hundred and twenty-one medical students (81% of the class) were surveyed. The first survey took place immediately prior to the beginning of medical training (wave 1); the second survey was approximately 8 months after the beginning of classes (wave 2). Medical students who began their first year with relatively low ‘A'level grades, high ratings of state anxiety and depression, high trait anxiety and low dispositional optimism, and reliance on avoidant coping strategies were found to be at higher risk for developing depression and anxiety symptoms at wave 2. Students reported increased concern about curriculum and environment, personal competence and endurance, and time to have a life outside medical school at wave 2, compared to their reports at wave 1. Increase in concerns correlated with an increase in depression and anxiety. At both surveys, use of avoidant coping strategies resulted in increased depression and anxiety; at wave 2, active coping and positive reinterpretation resulted in decreased depression and anxiety. These findings suggest characteristics of vulnerable students who might be identified early in their first year and provided with additional support. Educating students to expect an increase in concerns about environment and personal ability to manage the academic load might make these concerns less overwhelming. In addition, information about effective coping strategies (i.e. active coping efforts) and ineffective means of dealing with stress (avoidant coping efforts) might be helpful in preventing distress.     

A longitudinal study of self-assessment accuracy

AIM: Although studies have examined medical students' ability to self-assess their performance, there are few longitudinal studies that document the stability of self-assessment accuracy over time. This study compares actual and estimated examination performance for three classes during their first 3 years of medical school. METHODS: Students assessed their performance on classroom examinations and objective structured clinical examination (OSCE) stations. Each self-assessment was then contrasted with their actual performance using idiographic (within-subject) methods to define three measures of self-assessment accuracy: bias (arithmetic differences of actual and estimated scores), deviation (absolute differences of actual and estimated scores), and covariation (correlation of actual and estimated scores). These measures were computed for four intervals over the course of 3 years. Multivariate analyses of variance and correlational analyses were used to evaluate the stability of these measures. RESULTS: Self-assessment accuracy measures were relatively stable over the first 2 years of medical school with a decease occurring in the third year. However, the correlational analyses indicated that the stability of self-assessment accuracy was comparable to the stability of actual performance over this same period. CONCLUSION: The apparent decline in accuracy in the third year may reflect the transition from familiar classroom-based examinations to the substantially different clinical examination tasks of the third year OSCE. However, the stability of self-assessment accuracy compares favorably with the stability of actual performance over this period. These results suggest that self-assessment accuracy is a relatively stable individual characteristic that may be influenced by task familiarity.     

How do supervising doctors construe the medical student in clinical training?

Basing the prediction of student performance in medical school on intellective-cognitive abilities alone has proved to be more pertinent to academic achievement than to clinical practice. A major obstacle to the development of adequate measures has been the elusive nature of requirements for successful clinical performance. The present study aimed at defining the relevant variables through an analysis of the concept of the medical student held by supervising doctors. With the aid of a methodology derived from cognitive-social psychology, the components of how training doctors of a large medical school evaluate their students were first explicated in structured interviews. In a second phase of the research, 18 supervisors in five major clinical departments rated their student-supervisees on 15 obtained traits. Findings of trait correlations with an overall evaluation, as well as Guttman's 'Smallest Space Analysis' (1968), indicated a clear priority of cognitive-motivational traits in supervisors' judgements and reduced relevance of personal and interpersonal variables. Certain inconsistencies between avowed ideology of medical training and actual supervising practice could be detected.     

Early identification of future medical students using initial undergraduate grades

This study assessed whether overall academic performance in undergraduate medical coursework can be predicted with reasonable accuracy by using grades from initial college-level courses rather than total premedical grade point averages (GPAs). Initial college grades from four areas, MCAT scores, and NBME I and II scores were recorded for students admitted to the University of Washington Medical School, for students admitted to other medical schools, and for students not admitted to any medical school. The results documented a high relationship between cumulative GPAs and initial grades, with differences found between those students admitted to medical school and those not admitted. The importance of this study is the documentation that little predictive utility is gained by waiting for overall college GPAs from medical school applicants. Initial GPAs are available 2 years earlier than overall GPAs and provide virtually the same information. Exploratory suggestions for medical school admission policies are made.     

Characteristics of graduating medical students who were matched and unmatched to hospital training posts

The purpose of this paper is to examine similarities and differences between graduating medical students who do and do not match through the National Internship and Resident Matching Programme (NIRMP). Data from graduates of 3- and 4-year undergraduate curricula were examined separately. A two way analysis of variance was used; the two independent variables were (1) whether the student was a 3- or 4-year medical graduate, and (2) the students' matched vs unmatched status. The dependent variables used in this study were in the following five categories: (1) demographic and academic performance upon entrance to medical school, (2) academic performance during medical school, (3) future practice preferences projected during medical school, (4) internship/residency choices, and (5) clinical performance during internship/residency. On the basis of the data presented, it is clear that there are few differences between matched and unmatched students that could be detected in over seventy-five measures examined. Within the unmatched group, however, the 3-year graduates differ in some respects from their 4-year colleagues. It is likely, therefore, that a different constellation of factors appears to be operating in these two unmatched groups but not within the matched groups.     

American medical students in Israel: stress and coping

Medical students studying abroad have to adapt to a new cultural environment in addition to the usual stresses of medical school. This study explored the perceived stress and coping ability of students of the New York State/American Programme, Sackler School of Medicine, Tel Aviv University, who study medicine in Israel but are expected to return to America to practice. Students were surveyed using the Ways of Coping Checklist (WCCL), Appraisal Dimension Scale (ADS) and two instruments specifically designed for the study. The results supported the view that students having difficulty adapting to their new cultural environment also have difficulty at medical school. This pattern is a negative spiral in which anxiety and depression impair cognitive performance, which leads to academic difficulties and emotional distress. Improvements in student social support and primary prevention were implemented as a result of the study. Limitations of the study are discussed.     

Should medical students be selected only from recent school-leavers who have studied science?

This study was undertaken to investigate the apparently widespread belief that in order to be successful at medical school, aspiring candidates must have a sound academic background based predominantly on the study of the natural sciences, be school-leavers aged about 18 (in the non-college educational environments such as Australia or the United Kingdom) and preferably be men. The demographic background and prior academic achievement of individual students entering the University of Newcastle Medical School between 1978 and 1989 has been reviewed and compared with their progress in medical studies. The data show that in the Newcastle medical school environment there is no significant correlation between outcome and previous study of any of the natural sciences. However, significant correlations between outcome and performance in the humanities in general, and English in particular, were found. In this regard a weak background in these subjects correlated with an increased tendency not to complete the medical course. There were no significant correlations found between outcome and age at entry, sex or levels of prior academic achievement (within the top 10% achievement band studied). In summary, the study offers no support for the current selection criteria dominating medical school admissions processes.     

Adaptive and maladaptive perfectionism in medical students: a longitudinal investigation

OBJECTIVES: The personality of medical students may have an important impact on both their academic performance and emotional adjustment during medical school. There has been little systematic study of the impact of perfectionism on medical students. The present study sought to compare the perfectionism profile of medical students with that of a general arts student group and to examine the relationship among perfectionism, distress symptoms and academic expectations and satisfaction. DESIGN: Medical students (n=96) and arts students (n=289) completed a baseline assessment including two multidimensional perfectionism scales. The medical students also completed measures of distress symptoms, personality (neuroticism, conscientiousness) and questions about their perceptions of their academic performance. Of the medical students, 58 completed a second set of questionnaires 6 months later (time 2). SUBJECTS: First-, second- and third year medical students and first-year arts students. RESULTS: In comparison with arts students, the perfectionism profile of medical students showed higher personal standards, lower doubts about actions and lower maladaptive perfectionism scores. In the medical students adaptive perfectionism (achievement striving) was significantly correlated with baseline academic performance expectations and conscientiousness and was predictive of dissatisfaction with academic performance at time 2. Maladaptive perfectionism (excessive evaluative concerns) was significantly correlated with baseline distress symptoms and neuroticism and was predictive of symptoms of depression and hopelessness at time 2. CONCLUSIONS: Perfectionism in medical students differs systematically from perfectionism in general arts students. Distinguishing adaptive and maladaptive aspects of perfectionism is important in understanding the cross-sectional and longitudinal implications of perfectionism for medical students.     

An assessment of academic performance and personality

This study examines whether personality profiles, using personality factors, or clusters of personality factors, are associated with academic success. One hundred and forty medical students of the University of Wales College of Medicine were invited to complete a personality questionnaire (Cattell 16 PF) as they sat their final examinations in June 1988. A total of 129 usable forms were obtained. The students were divided into four groups dependent on their academic performance, which had been monitored throughout the course. The majority (62%) had no academic problems, but 16 (12%) students had serious difficulties, which entailed delaying qualification by at least 6 months. There was no relationship between the scores obtained for the students' first attempt at A-level and their subsequent medical school academic performance. However, students who obtained a degree either before or during their medical course were significantly less likely to have academic problems. Academic success was not associated with any of Cattell's personality factors. This was true of previously reported groups of factors associated with the poor student performance, and regardless of first or second order factors. We conclude that this personality profile is unlikely to be helpful in selecting future intakes of medical students, although a prospective study would be required for a definite answer to this question.     

Volunteer bias in medical education research: an empirical study of over three decades of longitudinal data

CONTEXT: The issue of whether medical education research outcomes can be biased by students' refusal to allow their data to be used in outcomes research should be empirically addressed to assure the validity of research findings. Given that institutions are expected to document the outcomes of their educational programmes, evaluations of clinical performance subsequent to medical school are crucial, but are often incomplete when graduates decline to permit data collection. OBJECTIVES: This study aimed to examine the demographic and performance differences between research volunteers and others. METHODS: A total of 7415 doctors graduated from Jefferson Medical College between 1970 and 2004; 75% (n = 5575) agreed to participate in medical education research by granting written permission for the collection of data from their postgraduate training directors on their behalf (research volunteers); 20% (n = 1489) refused to grant such permission (non-volunteers), and 5% (n = 351) did not return the permission form (non-respondents). This prospective longitudinal study compared research volunteers, non-volunteers and non-respondents on gender, ethnicity, performance measures prior to, during and after medical school, scores on medical licensing examinations, and board certification status. RESULTS: Doctors who granted permission (volunteers) generally performed better during and after medical school. In addition, they scored higher on medical licensing examinations and had a higher certification rate. Women and members of ethnic minority groups were less likely to grant permission. CONCLUSIONS: The study raises questions about the validity of research findings as a result of volunteerism in medical education research. The implications for guidelines regarding the protection of human subjects in medical education research, and for educational outcomes, are discussed.     

Active learning in a Year 2 pathology curriculum

PURPOSE: Team-based learning (TBL) has been successfully used in non-medical curricula, but its effectiveness in medical education has not been studied extensively. We evaluated the impact of TBL on the academic performance of Year 2 medical students at Wright State University by comparing this active learning strategy against a traditional method of case-based group discussion (CBGD). METHODS: A prospective crossover design assigned 83 Year 2 medical students to either CBGD or TBL for 8 pathology modules in the systems-based curriculum. The effectiveness of both learning methods was assessed by performance on pathology-based examination questions contained in end-of-course examinations. The highest and lowest academic quartiles of students were evaluated separately. Students' opinions of both methods were surveyed. RESULTS: No significant differences in whole group performance on pathology-based examination questions were observed as a consequence of experiencing TBL versus CBGD. However, students in the lowest academic quartile showed better examination performance after experiencing TBL than CBGD in 4 of 8 modules (P = 0.035). Students perceived that the contributions of peers to learning were more helpful during TBL than CBGD (P = 0.003). CONCLUSION: This study demonstrates that TBL and CBGD are equally effective active learning strategies when employed in a systems-based pre-clinical pathology curriculum, but students with lower academic performance may benefit more from TBL than CBGD.     

Non-cognitive characteristics of medical students: entry to problem-based and lecture-based curricula

The effectiveness of problem-based learning (PBL) versus lecture-based learning (LBL) continues to be debated all over the world. These arguments have often been based on students' cognitive measures of performance. Little emphasis has been placed on non-cognitive factors that may directly or indirectly affect the medical school performance of students in either curriculum. The purpose of this study was to (1) document possible differences in student cognitive and non-cognitive characteristics at entry between the two curricula and (2) to explore the relationships that exist between cognitive and noncognitive factors. Data were obtained from three medical school classes (   n = 281  ). The results indicate that students who entered the PBL curriculum at this medical school had higher total Medical College Admission Test and undergraduate grade point average than students who entered the LBL curriculum. Students who entered the PBL curriculum were also more self-sufficient and were more likely to do well in individualistic and less structured settings. There were no strong correlations between cognitive and non-cognitive variables. Before conclusions can be drawn about the effectiveness of either PBL or LBL curricula, we need to document patterns in entry characteristics to control for a priori differences that affect student performance.     

Personality traits and types predict medical school stress: a six-year longitudinal and nationwide study

OBJECTIVES: Personality types (combinations of traits) that take into account the interplay between traits give a more detailed picture of an individual's character than do single traits. This study examines whether both personality types and traits predict stress during medical school training. METHODS: We surveyed Norwegian medical students (n = 421) 1 month after they began medical school (T1), at the mid-point of undergraduate Year 3 (T2), and at the end of undergraduate Year 6 (T3). A total of 236 medical students (56%) responded at all time-points. They were categorised according to Torgersen's personality typology by their combination of high and low scores on the 'Big Three' personality traits of extroversion, neuroticism and conscientiousness. We studied the effects of both personality types (spectator, insecure, sceptic, brooder, hedonist, impulsive, entrepreneur and complicated) and traits on stress during medical school. RESULTS: There was a higher level of stress among female students. The traits of neuroticism (P = 0.002) and conscientiousness (P = 0.03) were independent predictors of stress, whereas female gender was absorbed by neuroticism in the multivariate model. When controlled for age and gender, 'brooders' (low extroversion, high neuroticism, high conscientiousness) were at risk of experiencing more stress (P = 0.02), whereas 'hedonists' (high extroversion, low neuroticism, low conscientiousness) were more protected against stress (P = 0.001). CONCLUSIONS: This is the first study to show that a specific combination of personality traits can predict medical school stress. The combination of high neuroticism and high conscientiousness is considered to be particularly high risk.     

Assessment of non-cognitive traits through the admissions multiple mini-interview

CONTEXT: Contemporary studies have shown that traditional medical school admissions interviews have strong face validity but provide evidence for only low reliability and validity. As a result, they do not provide a standardised, defensible and fair process for all applicants. METHODS: In 2006, applicants to the University of Calgary Medical School were interviewed using the multiple mini-interview (MMI). This interview process consisted of 9, 8-minute stations where applicants were presented with scenarios they were then asked to discuss. This was followed by a single 8-minute station that allowed the applicant to discuss why he or she should be admitted to our medical school. Sociodemographic and station assessment data provided for each applicant were analysed to determine whether the MMI was a valid and reliable assessment of the non-cognitive attributes, distinguished between the non-cognitive attributes, and discriminated between those accepted and those placed on the waitlist (waiting list). We also assessed whether applicant sociodemographic characteristics were associated with acceptance or waitlist status. RESULTS: Cronbach's alpha for each station ranged from 0.97-0.98. Low correlations between stations and the factor analysis suggest each station assessed different attributes. There were significant differences in scores between those accepted and those on the waitlist. Sociodemographic differences were not associated with status on acceptance or waiting lists. DISCUSSION: The MMI is able to assess different non-cognitive attributes and our study provides additional evidence for its reliability and validity. The MMI offers a fairer and more defensible assessment of applicants to medical school than the traditional interview.     

Incremental validity of noncognitive tests for medical school academic achievement

This paper reports an investigation of the incremental validity of noncognitive tests. Incremental validity is the predictive ability of a measure when entered into a regression equation after the routine predictors have first been included. Three noncognitive tests--Rotter Locus of Control, Adjective Check List, and Student Orientations Survey--were administered to a first-year medical school class. When entered after the usual academic predictors of success in medical school--Undergraduate Grade Point Average and Medical College Admission Test--the three noncognitive tests added little to the prediction of first-year medical school Grade Point Average. It is concluded that while noncognitive measures are useful in characterizing a medical school class and in discovering nonacademic correlates of academic success in medical school, limited incremental validity related to first-year academic performance was demonstrated.     

Does studying for an objective structured clinical examination make a difference?

PURPOSE: This study examines the extent to which second-year medical students studied for an objective structured clinical examination (OSCE), how they studied, and the impact of self-reported studying on OSCE performance. METHOD: One class of 113 medical students completed an end-of-second-year OSCE, held on two consecutive evenings. The OSCE was comprised of eight stations, each of which was of 20 minutes' duration. The OSCE was formative: students received performance feedback but were not graded. Prior to the OSCE, students completed a brief survey regarding their preparation for the OSCE and their perceptions of confidence, anxiety and preparedness. Only 78 students returned surveys with names, comprising the data for these analyses. RESULTS: Mean studying time was 3.3 h, ranging from 0 to 19 h. Studying time was positively associated with age and negatively associated with basic science examination scores. The most study time was dedicated to reviewing the physical examination textbook, class notes and supplemental course readings. The breadth of study strategies increased as more time was spent in OSCE preparation. OSCE performance was related to study time and to achievement on pre-clinical basic science examinations. DISCUSSION: The students whose performance was above average seemed to be the talented students whose records indicated a history of academic success. The amount of time they reported for OSCE preparation was comparable to that reported by students with below average performance. It appears that prior academic performance rather than preparatory studying time is a better predictor of OSCE outcomes.     

Selection of medical students: a controlled experiment

Objectives  We aimed to discover, through a controlled experiment, whether cognitive and non-cognitive assessment would select higher-achieving applicants to medical school than selection by lottery.
Methods  We carried out a prospective cohort study to compare 389 medical students who had been admitted by selection and 938 students who had been admitted by weighted lottery, between 2001 and 2004. Main outcome measures were dropout rates, study rate (credits per year) and mean grade per first examination attempt per year. Study rates in the 4 pre-clinical years of medical school were used to categorise students' performance as average or optimal.
Results  Pre-admission variables did not differ between the two groups. The main outcome of the selection experiment was that relative risk for dropping out of medical school was 2.6 times lower for selected students than for lottery-admitted controls (95% confidence interval 1.59–4.17). Significant differences between the groups in the percentage of optimally performing students and grade point average for first examination attempts were found only in the 2001 cohort, when results favoured the selected group. The results of the selection process took into account both the assessment procedure involved and the number of students who withdrew voluntarily.
Conclusions  This is the first controlled study to show that assessing applicants' non-cognitive and cognitive abilities makes it possible to select students whose dropout rate will be lower than that of students admitted by lottery. The dropout rate in our overall cohort was 2.6 times lower in the selected group.     

Prediction of student clinical performance

The predictive validity of 'traditional' tools utilized in the selection of medical students was evaluated in a 'non-traditional' selection paradigm, where a wide range of previous-academic ability was represented. The validity of the use of pre-academic grades and examination scores in the prediction of success in clinical performance was examined in a medical school which de-emphasizes these indicators and emphasizes personal characteristics assessed via interview ratings in student selection. Grades and examination scores were found to have no relation to clinical ratings which have an added interpersonal and community emphasis during the fourth-sixth years of medical school. A positive trend was found for interview ratings with clinical performance, but the skewed nature of interview scores was seen as limiting investigation of this variable. The meaning of these results vis-à-vis the continued use of academic and examination related selection criteria was discussed.     

The impact of job stress and working conditions on mental health problems among junior house officers. A nationwide Norwegian prospective cohort study

CONTEXT: Previous studies have shown that physicians have an increased risk of mental health problems such as depression, suicide and substance abuse. OBJECTIVES: To study the prevalence of mental health problems during the first postgraduate year, and to investigate whether work-related factors in hospital are linked to these, when we control for gender, previous mental health problems, personality traits, stress in medical school and other possible predictors. DESIGN: Nationwide and prospective postal questionnaire survey. SETTING: University of Oslo. SUBJECTS: Medical students who answered questionnaires in their graduating semester, and 1 year later when they were junior house officers (n=371). RESULTS: Mental health problems (needing treatment) during internship were reported by 11%, with no gender difference. Adjusted predictors of mental health problems were: previous mental health problems, (odds ratio (OR)=5.1, 95% confidence interval (CI) 1.7 to 15.8); being married/cohabitant (OR=0.2, CI 0.1 to 0.7); the personality trait 'vulnerability' (OR=1.5, CI 1.1 to 2.0); negative life events during internship (OR=2.1, CI 1.2 to 3.5), and job stress as house officer (OR=1.05, CI 1.01 to 1.10). The job stress factor of emotional pressure/demands from patients was most important. Perceived study stress and lack of skills at the end of medical school were univariately related to mental health problems in internship, but not when other variables were adjusted. Gender, weekly working hours and lack of sleep were not linked to having problems. CONCLUSION: Job stress is related to mental health problems among young doctors, even when the variables of previous mental health problems and personality traits are controlled for. More support during internship is needed.     

Assessing the development of communication skills in undergraduate medical students

CONTEXT: The teaching of clinical communication skills' teaching has become an important part of medical school curricula. Many undergraduate medical courses include communication skills training at various points in their curriculum. Very few reports have been published on the development of communication skills over the duration of a medical undergraduate training. AIMS: To determine the change in communication skills between early and mid-stages of the students' 5-year curriculum, and to investigate the predictive and theoretical significance of knowledge and understanding of communication skills in relation to observed performance. PARTICIPANTS: Students entering as the first cohort to the new medical curriculum at Liverpool Medical School (n=207). Nine students withdrew leaving 198 students who completed two summative assessments in June 1997 (level 1) and November 1998 (level 2). STATISTICAL ANALYSIS: Repeated measures multivariate ANOVAS were applied to the main study data to detect any change in performance between levels 1 and 2. RESULTS AND CONCLUSIONS: An improvement in communication skills was found in medical students over 17 months of their undergraduate teaching: that is from the level 1 to the level 2 assessment. Knowledge and understanding of communication skills at initial assessment did not show the predicted association with performance at level 2.