When surgeons decide to become surgeons: new opportunities for surgical education

Background

When surgeons decide to become surgeons has important implications. If the decision is made prior to or early in medical school, surgical education can be more focused on surgical diseases and resident skills.

Methods

To determine when surgeons – compared with their nonsurgical colleagues – decide on their medical path, residents in surgery, internal medicine, obstetrics and gynecology, pediatrics, psychiatry, and emergency medicine were surveyed. Timing of residency choice, demographic data, personal goals, and reason for residency choice were queried.

Results

A total of 234 residents responded (53 surgical residents). Sixty-two percent of surgeons reported that they were “fairly certain” of surgery before medical school, 13% decided during their preclinical years, and 25% decided during their clerkship years. This compares with an aggregate 40%, 7%, and 54%, respectively, for the other 5 residency specialties. These differences were statistically significant (P = .001). When the 234 residents were asked about their primary motivation for choosing their field, 51% pointed to expected job satisfaction and 44% to intellectual curiosity, and only 3% mentioned lifestyle, prestige, or income.

Conclusions

General surgery residents decide on surgery earlier than residents in other programs. This may be advantageous, resulting in fast-tracking of these medical students in acquiring surgical knowledge, undertaking surgical research, and early identification for surgical residency programs. Surgical training in the era of the 80-hour work week could be enhanced if medical students bring much deeper knowledge of surgery to their first day of residency.     

Is there a place for medical students as teachers in the education of junior residents?

Background

The aim of this study was to investigate a novel resident education model that turns the traditional surgical hierarchy upside down, termed a “reverse” peer-assisted learning curriculum.

Methods

Thirty surgical topics were randomized between medical students and chief residents on each clinical team, with 1 topic being presented briefly during morning rounds. An exam evaluating junior residents' knowledge of these topics was administered before and after 1 month of presentations. A questionnaire was distributed to evaluate the junior residents' perceptions of this teaching model.

Results

Thirty-four residents participated. There was a significant improvement in the mean examination score (54 vs 74, P < .05). No significant difference was noted in the mean score differentials of topics presented by either the medical students or the chief resident (21 vs 18, P = .22). More than 80% of the residents responded positively about the effectiveness of this exercise and agreed that they would like to see this model used on other services.

Conclusions

This study confirms the hypothesis that medical students can teach surgical topics to junior residents at least as effectively as their chief residents.     

Higher clinical performance during a surgical clerkship is independently associated with matriculation of medical students into general surgery

Background

The purpose of our study was to determine the predictive impact of individual academic measures for the matriculation of senior medical students into a general surgery residency.

Methods

Academic records were evaluated for third-year medical students (n = 781) at a single institution between 2004 and 2011. Cohorts were defined by student matriculation into either a general surgery residency program (n = 58) or a non–general surgery residency program (n = 723). Multivariate logistic regression was performed to evaluate independently significant academic measures.

Results

Clinical evaluation raw scores were predictive of general surgery matriculation (P = .014). In addition, multivariate modeling showed lower United States Medical Licensing Examination Step 1 scores to be independently associated with matriculation into general surgery (P = .007).

Conclusions

Superior clinical aptitude is independently associated with general surgical matriculation. This is in contrast to the negative correlation United States Medical Licensing Examination Step 1 scores have on general surgery matriculation. Recognizing this, surgical clerkship directors can offer opportunities for continued surgical education to students showing high clinical aptitude, increasing their likelihood of surgical matriculation.     

Correlating surgical clerkship evaluations with performance on the National Board of Medical Examiners examination

Background

Evaluation of medical students during the surgical clerkship is controversial. Performance is often based on subjective scoring, whereas objective knowledge is based on written examinations. Whether these measures correspond or are relevant to assess student performance is unknown. We hypothesized that student evaluations correlate with performance on the National Board Of Medical Examiners (NBME) examination.

Methods

Data were collected from the 2011–2012 academic year. Medical students underwent a ward evaluation using a seven-point Likert scale assessing six educational competencies. Students also undertook the NBME examination, where performance was recorded as a percentile score adjusted to national standards.

Results

A total of 129 medical students were studied. Scores on the NBME ranged from the 52nd to the 96th percentile with an average in the 75th percentile (±9). Clerkship scores ranged from 3.2–7.0 with a mean of 5.7 (±0.8). There was a strong positive association between higher NBME scores and higher clerkship evaluations shown by a Pearson correlation coefficient of 0.47 (P < 0.001). Students clustered with below average ward evaluations (3.0–4.0) were in the 69.5th percentile of NBME scores, whereas students clustered with above average ward evaluations (6.0–7.0) were in the 79.2th percentile (P < 0.001).

Conclusions

A strong positive relationship exists between subjective ward evaluations and NBME performance. These data may afford some confidence to surgical faculty and surgical resident ability to accurately evaluate medical students during clinical clerkships. Understanding factors in student performance may help in improving the surgical clerkship experience.     

American College of Surgeons/Association for Surgical Education medical student simulation-based surgical skills curriculum needs assessment

Background

Simulation can enhance learning effectiveness, efficiency, and patient safety and is engaging for learners.

Methods

A survey was conducted of surgical clerkship directors nationally and medical students at 5 medical schools to rank and stratify simulation-based educational topics. Students applying to surgery were compared with others using Wilcoxon's rank-sum tests.

Results

Seventy-three of 163 clerkship directors (45%) and 231 of 872 students (26.5%) completed the survey. Of students, 28.6% were applying for surgical residency training. Clerkship directors and students generally agreed on the importance and timing of specific educational topics. Clerkship directors tended to rank basic skills, such as examination skills, higher than medical students. Students ranked procedural skills, such as lumbar puncture, more highly than clerkship directors.

Conclusions

Surgery clerkship directors and 4th-year medical students agree substantially about the content of a simulation-based curriculum, although 4th-year medical students recommended that some topics be taught earlier than the clerkship directors recommended. Students planning to apply to surgical residencies did not differ significantly in their scoring from students pursuing nonsurgical specialties.     

Faculty and resident evaluations of medical students on a surgery clerkship correlate poorly with standardized exam scores

Background

The clinical knowledge of medical students on a surgery clerkship is routinely assessed via subjective evaluations from faculty members and residents. Interpretation of these ratings should ideally be valid and reliable. However, prior literature has questioned the correlation between subjective and objective components when assessing students' clinical knowledge.

Methods

Retrospective cross-sectional data were collected from medical student records at The Johns Hopkins University School of Medicine from July 2009 through June 2011. Surgical faculty members and residents rated students' clinical knowledge on a 5-point, Likert-type scale. Interrater reliability was assessed using intraclass correlation coefficients for students with ≥4 attending surgeon evaluations (n = 216) and ≥4 resident evaluations (n = 207). Convergent validity was assessed by correlating average evaluation ratings with scores on the National Board of Medical Examiners (NBME) clinical subject examination for surgery. Average resident and attending surgeon ratings were also compared by NBME quartile using analysis of variance.

Results

There were high degrees of reliability for resident ratings (intraclass correlation coefficient, .81) and attending surgeon ratings (intraclass correlation coefficient, .76). Resident and attending surgeon ratings shared a moderate degree of variance (19%). However, average resident ratings and average attending surgeon ratings shared a small degree of variance with NBME surgery examination scores (ρ² ≤ .09). When ratings were compared among NBME quartile groups, the only significant difference was for residents' ratings of students with the lower 25th percentile of scores compared with the top 25th percentile of scores (P = .007).

Conclusions

Although high interrater reliability suggests that attending surgeons and residents rate students with consistency, the lack of convergent validity suggests that these ratings may not be reflective of actual clinical knowledge. Both faculty members and residents may benefit from training in knowledge assessment, which will likely increase opportunities to recognize deficiencies and make student evaluation a more valuable tool.     

A framework for professionalism in surgery: what is important to medical students?

Background

The purposes of this study were to develop a comprehensive framework for professionalism in surgery and to determine which attributes are most valued by medical students.

Methods

A framework for professionalism in surgery, consisting of 11 attribute categories, was developed. All 3rd-year medical students (n = 168) participated in a focus group and completed a questionnaire regarding their perceptions about professionalism. Students' responses were transcribed verbatim, coded, and assigned attribute categories.

Results

Students rated respect as the most important attribute of professionalism (56%), followed by altruism (21%) and interpersonal skills (8%). Fifty-three percent of students witnessed unprofessional behavior among faculty members while on the surgical clerkship. Of these incidents, 74% were related to respect, 28% to practice improvement, and 1% to altruism.

Conclusions

Respect was rated as the single most important characteristic of professionalism and was the attribute with the most witnessed violations.     

International surgical clerkship rotation: perceptions and academic performance

Background

Concerns about international training experiences in medical school curricula include the effect on student learning. We studied the educational effect of an international elective integrated into a traditional third-year (M3) surgical clerkship.

Methods

A 1-week surgical elective in Haiti was available to M3 students during the conventional 8-week surgical clerkship each year for the 4 academic years 2008 to 2011. The authors collected student and surgeon perceptions of the elective using a mixed-methods web-based survey. Statistical analysis compared the academic performance of participating M3s relative to nonparticipating peers.

Results

Twenty-eight (100%) students (41 trip weeks) and 3 (75%) surgeons responded. Twenty-five (89%) students believed the elective provided appropriate clinical training. Surgeon responses were consistent with students' reported perceptions.Strengths included unique clinical experiences and close interactions with faculty. Criticisms included recurring overwhelming clinical responsibilities and lack of local provider involvement.Academic performance of participants versus nonparticipants in the same clerkship term were statistically insignificant.

Conclusions

This study demonstrates the feasibility of integrating global health experiences into traditional medical student clinical curricula. The effects on less tangible attributes such as leadership skills, fostering teamwork, and cultural competency require future investigation.     

Is USMLE Step 1 score a valid predictor of success in surgical residency?

Background

Many programs rely extensively on United States Medical Licensing Examination (USMLE) scores for interviews/selection of surgical residents. However, their predictive ability remains controversial. We examined the association between USMLE scores and success in surgical residency.

Methods

We compared USMLE scores for 123 general surgical residents who trained in the past 20 years and their performance evaluation. Scores were normalized to the mean for the testing year and expressed as a ratio (1 = mean). Performances were evaluated by (1) rotation evaluations; (2) “dropouts;” (3) overall American Board of Surgery pass rate; (4) first-time American Board of Surgery pass rate; and (5) a retrospective comprehensive faculty evaluation. For the latter, 16 surgeons (average faculty tenure 22 years) rated residents on a 1 to 4 score (1 = fair; 4 = excellent).

Results

Rotation evaluations by faculty and “drop out” rates were not associated with USMLE score differences (dropouts had average above the mean). One hundred percent of general surgery practitioners achieved board certification regardless of USMLE score but trainees with an average above the mean had a higher first-time pass rate (P = .04). Data from the comprehensive faculty evaluations were conflicting: there was a moderate degree of correlation between board scores and faculty evaluations (r = .287, P = .001). However, a score above the mean was associated with a faculty ranking of 3 to 4 in only 51.7% of trainees.

Conclusion

Higher USMLE scores were associated with higher faculty evaluations and first-time board pass rates. However, their positive predictive value was only 50% for higher faculty evaluations and a high overall board pass rate can be achieved regardless of USMLE scores. USMLE Step 1 score is a valid tool for selecting residents but caution might be indicated in using it as a single selection factor.     

Palliative and end-of-life care training during the surgical clerkship

Background

In 2000, the Liaison Committee on Medical Education required that all medical schools provide experiential training in end-of-life care. To adhere to this mandate and advance the professional development of medical students, experiential training in communication skills at the end-of-life was introduced into the third-year surgical clerkship curriculum at Wright State University Boonshoft School of Medicine.

Materials and methods

In the 2007–08 academic year, 97 third-year medical students completed six standardized end-of-life care patient scenarios commonly encountered during the third-year surgical clerkship. Goals and objectives were outlined for each scenario, and attending surgeons graded student performances and provided formative feedback.

Results

All 97 students, 57.7% female and average age 25.6 ± 2.04 y, had passing scores on the scenarios: (1) Adult Hospice, (2) Pediatric Hospice, (3) Do Not Resuscitate, (4) Dyspnea Management/Informed Consent, (5) Treatment Goals and Prognosis, and (6) Family Conference. Scenario scores did not differ by gender or age, but students completing the clerkship in the first half of the year scored higher on total score for the six scenarios (92.8% ± 4.8% versus 90.5% ± 5.0%, P = 0.024).

Conclusions

Early training in end-of-life communication is feasible during the surgical clerkship in the third-year of medical school. Of all the scenarios, “Conducting a Family Conference” proved to be the most challenging.     

Cutting too deep? Assessing the impact of a shorter surgery clerkship on students' clinical skills and knowledge

Background

The aim of this study was to compare the performance of students completing an 8-week versus a 6-week surgery clerkship on an objective structured clinical examination (OSCE) and the National Board of Medical Examiners (NBME) clinical science surgery examination.

Methods

One hundred fifteen students from the 8-week clerkship and 99 from the 6-week clerkship were included. Performance on a summative OSCE was assessed using behaviorally anchored checklists. NBME exams were graded using the NBME's standard scaled scores. Results were compared using 2-tailed, independent-samples, unequal-variance t tests.

Results

Mean OSCE scores for the 8-week and 6-week curricula were not statistically different. Mean NBME scores also did not statistically differ. Six-week students performed significantly better in the specific OSCE subdomains of blood pressure, orthostatic blood pressure, rectal exam, and fecal occult blood test.

Conclusions

Overall OSCE and NBME exam performance did not differ between 8-week and 6-week surgery clerkship students.     

Barriers to advancement in academic surgery: views of senior residents and early career faculty

Background

A significant faculty attrition rate exists in academic surgery. The authors hypothesized that senior residents and early-career faculty members have different perceptions of advancement barriers in academic surgery.

Methods

A modified version of the Career Barriers Inventory–Revised was administered electronically to surgical residents and early-career surgical faculty members at 8 academic medical centers.

Results

Residents identified a lack of mentorship as a career barrier about half as often as faculty members. Residents were twice as likely as faculty members to view childbearing as a career barrier.

Conclusions

Many early-career faculty members cite a lack of mentors as a limitation to their career development in academic surgery. Childbearing remains a complex perceived influence for female faculty members in particular. Female faculty members commonly perceive differential treatment and barriers on the basis of their sex. Faculty development programs should address both systemic and sex-specific obstacles if academic surgery is to remain a vibrant field.     

Surgical resident learning styles: faculty and resident accuracy at identification of preferences and impact on ABSITE scores

Introduction

As a consequence of surgical resident duty hour restrictions, there is a need for faculty to utilize novel teaching methods to convey information in a more efficient manner. The current paradigm of surgical training, which has not changed significantly since the time of Halsted, assumes that all residents assimilate information in a similar fashion. However, recent data has shown that learners have preferences for the ways in which they receive and process information. The VARK model categorizes learners as visual (V), aural (A), read/write (R), and kinesthetic (K). The VARK learning style preferences of surgical residents have not been previously evaluated. In this study, the preferred learning styles of general surgery residents were determined, along with faculty and resident perception of resident learning styles. In addition, we hypothesized that American Board of Surgery In-Training Exam (ABSITE) scores are associated with preference for a read/write (R) learning style.

Methods

The Fleming VARK learning styles inventory was administered to all general surgery residents at a university hospital–based program. Responses on the inventory were scored to determine the preferred learning style for each resident. Faculty members were surveyed to determine their accuracy in identifying the preferred learning style of each resident. All residents were also surveyed to determine their accuracy in identifying their peers' VARK preferences. Resident ABSITE scores were examined for association with preferred learning styles.

Results

Twenty-nine residents completed the inventory. Most (18 of 29, 62%) had a multimodal preference, although more than a third (11 of 29, 38%) demonstrated a single-modality preference. Seventy-six percent of all residents (22 of 29) had some degree of kinesthetic (K) learning, while under 50% (14 of 29) were aural (A) learners. Although not significant, dominant (R) learners had the highest mean ABSITE scores. Faculty identified residents' learning styles accurately 41% of the time; more experienced faculty were better than less experienced ones (R² = 0.703, P = 0.018). Residents had similar accuracy to faculty in identifying their peers' learning styles. Chief residents were more accurate than junior residents (44% versus 28%, P = 0.009).

Conclusions

Most general surgery residents have a multimodal learning preference. Faculty members are relatively inaccurate at identifying residents' preferred learning styles; however, there is a strong correlation between years of faculty experience and accuracy. Chief residents are more accurate than junior residents at learning style identification. Higher mean ABSITE scores may be a reflection of a dominant read/write learning style.     

Porcine wet lab improves surgical skills in third year medical students

Background

Medical students desire to become proficient in surgical techniques and believe their acquisition is important. However, the operating room is a challenging learning environment. Small group procedural workshops can improve confidence, participation, and performance. The use of fresh animal tissues has been rated highly among students and improves their surgical technique. Greater exposure to surgical procedures and staff could positively influence students' interest in surgical careers. We hypothesized that a porcine “wet lab” course for third year medical students would improve their surgical skills.

Methods

Two skills labs were conducted for third year medical students during surgery clerkships in the fall of 2011. The students' surgical skills were first evaluated in the operating room across nine dimensions. Next, the students performed the following procedures during the skills lab: (1) laparotomy; (2) small bowel resection; (3) splenectomy; (4) partial hepatectomy; (5) cholecystectomy; (6) interrupted abdominal wall closure; (7) running abdominal wall closure; and (8) skin closure. After the skills lab, the students were re-evaluated in the operating room across the same nine dimensions. Student feedback was also recorded. Fifty-one participants provided pre- and post-lab data for use in the final analysis.

Results

The mean scores for all nine surgical skills improved significantly after participation in the skills lab (P ≤ 0.002). Cumulative post-test scores also showed significant improvement (P = 0.002). Finally, the student feedback was largely positive.

Conclusions

The surgical skills of third year medical students improved significantly after participation in a porcine wet lab, and the students rated the experience as highly educational. Integration into the surgery clerkship curriculum would promote surgical skill proficiency and could elicit interest in surgical careers.     

Educational value of the operating room experience during a core surgical clerkship

Background

The amount and content of medical student teaching in the operating room and its alignment with clerkship goals was unknown.

Methods

A qualitative research design using field observations, followed by qualitative and quantitative data coding and analysis.

Results

A mean of 9.8% of the total case time (range 1.6%-20.2%) was spent teaching clerkship goals. Teaching strategies based on basic principles of learning were used during a mean of 66% of the total case time (range 30%-99%). The most common teaching strategy was active student participation (28%) followed by command (14%) and lecture (13%). Educational experience in the OR was rated 4.0 (out of 5) by faculty and 3.3 by students. No correlation existed between student satisfaction and time actively participating in the operation or time spent teaching to clerkship goals (P = .66, P = .95, respectively).

Conclusion

Teaching in the OR is more focused on technical aspects of the operation than the goals of a core surgery clerkship.     

Teaching across the continuum: variations in rankings and valued teaching components between surgery residents and medical students

Background

Surgical faculty teach medical students and residents within the same environment; however, each group may require different teaching methods. The aim of this study was to identify teaching components valued by these sets of learners.

Methods

Teaching evaluations for 43 surgical faculty members who received yearly evaluations from students and residents were analyzed. Highest and lowest ranked educators in medical student evaluations were traced to corresponding rankings in resident evaluations. Thematic analysis was conducted on written comments.

Results

Educators rated the highest in the medical student group were spread out among the residents' rankings, with several educators being rated the lowest. Similar patterns were observed in reverse for faculty rated highly by residents.

Conclusions

Residents and medical students value faculty teaching using different criteria, with residents more focused on operative autonomy and medical students focused on approachability. Using one group to define best teaching methods is insufficient as learners value different optimal attributes.     

Innovation in internship preparation: an operative anatomy course increases senior medical students' knowledge and confidence

Background

An operative anatomy course was developed within the construct of a surgical internship preparatory curriculum. This course provided fourth-year medical students matching into a surgical residency the opportunity to perform intern-level procedures on cadavers under the guidance of surgical faculty members.

Methods

Senior medical students performed intern-level procedures on cadavers with the assistance of faculty surgeons. Students' confidence, anxiety, and procedural knowledge were evaluated both preoperatively and postoperatively. Preoperative and postoperative data were compared both collectively and based on individual procedures.

Results

Student confidence and procedural knowledge significantly increased and anxiety significantly decreased when preoperative and postoperative data were compared (P < .05). Students reported moderate to significant improvement in their ability to perform a variety of surgical tasks.

Conclusions

The consistent improvement in confidence, knowledge, and anxiety justifies further development of an operative anatomy course, with future assessment of the impact on performance in surgical residency.     

Accuracy and content of medical student midclerkship self-evaluations

Background

Midclerkship self-evaluations (MCSEs) require students to reflect on their knowledge, skills, and behaviors. We hypothesized that MCSEs would be consistent with supervisor midpoint evaluations during a surgical clerkship.

Methods

MCSEs of 153 students who completed our surgery clerkship in 2 academic years were compared with supervisor midclerkship evaluations. The quantitative domains of the MCSE and supervisor evaluation were compared for accuracy. Identified areas of strengths and weakness were evaluated for thematic consistency.

Results

Student MCSE scoring was accurate across evaluated domains most of the time; when students were inaccurate, they tended to underrate themselves. Students and supervisors most often identified cognitive skills as areas for improvement and noncognitive skills predominated as student strengths.

Conclusions

Medical students can accurately identify their strengths and weaknesses in the context of an MCSE. Based on these findings, knowledge acquisition and application by medical students in the clinical setting should be emphasized in undergraduate medical education.     

Development of a fresh cadaver model for instruction of ultrasound-guided breast biopsy during the surgery clerkship: pre-test and post-test results among third-year medical students

Background

The aim of our study was to determine if a fresh cadaver model is a viable method for teaching ultrasound (US)-guided breast biopsy of palpable breast lesions.

Methods

Third-year medical students were assessed both preinstruction and postinstruction on their ability to perform US-guided needle aspiration or biopsy of artificially created masses using a 10-item checklist.

Results

Forty-one third-year medical students completed the cadaver laboratory as part of the surgery clerkship. Eight items on the checklist were found to be significantly different between pre-testing and post-testing. The mean preinstruction score was 2.4, whereas the mean postinstruction score was 7.10 (P < .001).

Conclusions

Fresh cadaver models have been widely used in medical education. However, there are few fresh cadaver models that provide instruction on procedures done in the outpatient setting. Our model was found to be an effective method for the instruction of US-guided breast biopsy among medical students.     

The relationship between grit and resident well-being

Background

The well-being of residents in general surgery is an important factor in their success within training programs. Consequently, it is important to identify individuals at risk for burnout and low levels of well-being as early as possible. The aim of this study was to test the hypothesis that resident well-being may be related to grit, a psychological factor defined as perseverance and passion for long-term goals.

Methods

One hundred forty-one residents across 9 surgical specialties at 1 academic medical center were surveyed; the response rate was 84%. Perseverance was measured using the Short Grit Scale. Resident well-being was measured with (1) burnout using the Maslach Burnout Inventory and (2) psychological well-being using the Dupuy Psychological General Well-Being Scale.

Results

Grit was predictive of later psychological well-being both as measured by the Maslach Burnout Inventory (B = −.20, P = .05) and as measured by the Psychological General Well-Being Scale (B = .27, P < .01).

Conclusions

Measuring grit may identify those who are at greatest risk for poor psychological well-being in the future. These residents may benefit from counseling to provide support and improve coping skills.