American College of Surgeons/Association for Surgical Education medical student simulation-based surgical skills curriculum needs assessment

Background

Simulation can enhance learning effectiveness, efficiency, and patient safety and is engaging for learners.

Methods

A survey was conducted of surgical clerkship directors nationally and medical students at 5 medical schools to rank and stratify simulation-based educational topics. Students applying to surgery were compared with others using Wilcoxon's rank-sum tests.

Results

Seventy-three of 163 clerkship directors (45%) and 231 of 872 students (26.5%) completed the survey. Of students, 28.6% were applying for surgical residency training. Clerkship directors and students generally agreed on the importance and timing of specific educational topics. Clerkship directors tended to rank basic skills, such as examination skills, higher than medical students. Students ranked procedural skills, such as lumbar puncture, more highly than clerkship directors.

Conclusions

Surgery clerkship directors and 4th-year medical students agree substantially about the content of a simulation-based curriculum, although 4th-year medical students recommended that some topics be taught earlier than the clerkship directors recommended. Students planning to apply to surgical residencies did not differ significantly in their scoring from students pursuing nonsurgical specialties.     

Correlating surgical clerkship evaluations with performance on the National Board of Medical Examiners examination

Background

Evaluation of medical students during the surgical clerkship is controversial. Performance is often based on subjective scoring, whereas objective knowledge is based on written examinations. Whether these measures correspond or are relevant to assess student performance is unknown. We hypothesized that student evaluations correlate with performance on the National Board Of Medical Examiners (NBME) examination.

Methods

Data were collected from the 2011–2012 academic year. Medical students underwent a ward evaluation using a seven-point Likert scale assessing six educational competencies. Students also undertook the NBME examination, where performance was recorded as a percentile score adjusted to national standards.

Results

A total of 129 medical students were studied. Scores on the NBME ranged from the 52nd to the 96th percentile with an average in the 75th percentile (±9). Clerkship scores ranged from 3.2–7.0 with a mean of 5.7 (±0.8). There was a strong positive association between higher NBME scores and higher clerkship evaluations shown by a Pearson correlation coefficient of 0.47 (P < 0.001). Students clustered with below average ward evaluations (3.0–4.0) were in the 69.5th percentile of NBME scores, whereas students clustered with above average ward evaluations (6.0–7.0) were in the 79.2th percentile (P < 0.001).

Conclusions

A strong positive relationship exists between subjective ward evaluations and NBME performance. These data may afford some confidence to surgical faculty and surgical resident ability to accurately evaluate medical students during clinical clerkships. Understanding factors in student performance may help in improving the surgical clerkship experience.     

International surgical clerkship rotation: perceptions and academic performance

Background

Concerns about international training experiences in medical school curricula include the effect on student learning. We studied the educational effect of an international elective integrated into a traditional third-year (M3) surgical clerkship.

Methods

A 1-week surgical elective in Haiti was available to M3 students during the conventional 8-week surgical clerkship each year for the 4 academic years 2008 to 2011. The authors collected student and surgeon perceptions of the elective using a mixed-methods web-based survey. Statistical analysis compared the academic performance of participating M3s relative to nonparticipating peers.

Results

Twenty-eight (100%) students (41 trip weeks) and 3 (75%) surgeons responded. Twenty-five (89%) students believed the elective provided appropriate clinical training. Surgeon responses were consistent with students' reported perceptions.Strengths included unique clinical experiences and close interactions with faculty. Criticisms included recurring overwhelming clinical responsibilities and lack of local provider involvement.Academic performance of participants versus nonparticipants in the same clerkship term were statistically insignificant.

Conclusions

This study demonstrates the feasibility of integrating global health experiences into traditional medical student clinical curricula. The effects on less tangible attributes such as leadership skills, fostering teamwork, and cultural competency require future investigation.     

Students’ expectations on the surgery clerkship exceed those of residents and faculty

Purpose

The perceptions and expectations of students on the surgery clerkship were evaluated and compared with those of surgical residents and faculty.

Methods

A voluntary and anonymous survey was distributed to third year medical students, general surgery residents, and surgery faculty. Statistical analysis was performed using the χ² and Cochran-Mantel-Haenszel tests (P value <0.05 was significant).

Results

Medical students, surgery residents and faculty largely agreed on student responsibilities during morning rounds. However, more students (96.9%) than residents (86.2%) and faculty (77.3%) believed they should be writing progress notes, and fewer students (85%) than residents (100%) and faculty (95.5%) thought they should be taught during morning rounds (P < 0.01 and P = 0.04, respectively). The expected and actual educational experience on the surgical clerkship was similar. The amount of instruction provided each week by residents and faculty was similar to the amount expected by students; each group believed that surgical residents were good educators. Students, residents, and faculty agreed on many essential skills for a student to learn by the clerkship’s end; however, more students (85.8%) than residents (58.6%) and faculty (68.2%) viewed identifying surgical complications as an essential skill (P < 0.01).

Conclusions

Overall, the expectations of the medical students, surgical residents, and surgical faculty on the surgery clerkship were well matched. However, there were some instances where the students thought they should be more involved in patient care than did the residents and the faculty. It is important for surgical educators to be aware of these discrepancies to fully maximize the educational experience of medical students.     

Palliative and end-of-life care training during the surgical clerkship

Background

In 2000, the Liaison Committee on Medical Education required that all medical schools provide experiential training in end-of-life care. To adhere to this mandate and advance the professional development of medical students, experiential training in communication skills at the end-of-life was introduced into the third-year surgical clerkship curriculum at Wright State University Boonshoft School of Medicine.

Materials and methods

In the 2007–08 academic year, 97 third-year medical students completed six standardized end-of-life care patient scenarios commonly encountered during the third-year surgical clerkship. Goals and objectives were outlined for each scenario, and attending surgeons graded student performances and provided formative feedback.

Results

All 97 students, 57.7% female and average age 25.6 ± 2.04 y, had passing scores on the scenarios: (1) Adult Hospice, (2) Pediatric Hospice, (3) Do Not Resuscitate, (4) Dyspnea Management/Informed Consent, (5) Treatment Goals and Prognosis, and (6) Family Conference. Scenario scores did not differ by gender or age, but students completing the clerkship in the first half of the year scored higher on total score for the six scenarios (92.8% ± 4.8% versus 90.5% ± 5.0%, P = 0.024).

Conclusions

Early training in end-of-life communication is feasible during the surgical clerkship in the third-year of medical school. Of all the scenarios, “Conducting a Family Conference” proved to be the most challenging.     

A framework for professionalism in surgery: what is important to medical students?

Background

The purposes of this study were to develop a comprehensive framework for professionalism in surgery and to determine which attributes are most valued by medical students.

Methods

A framework for professionalism in surgery, consisting of 11 attribute categories, was developed. All 3rd-year medical students (n = 168) participated in a focus group and completed a questionnaire regarding their perceptions about professionalism. Students' responses were transcribed verbatim, coded, and assigned attribute categories.

Results

Students rated respect as the most important attribute of professionalism (56%), followed by altruism (21%) and interpersonal skills (8%). Fifty-three percent of students witnessed unprofessional behavior among faculty members while on the surgical clerkship. Of these incidents, 74% were related to respect, 28% to practice improvement, and 1% to altruism.

Conclusions

Respect was rated as the single most important characteristic of professionalism and was the attribute with the most witnessed violations.     

Faculty and resident evaluations of medical students on a surgery clerkship correlate poorly with standardized exam scores

Background

The clinical knowledge of medical students on a surgery clerkship is routinely assessed via subjective evaluations from faculty members and residents. Interpretation of these ratings should ideally be valid and reliable. However, prior literature has questioned the correlation between subjective and objective components when assessing students' clinical knowledge.

Methods

Retrospective cross-sectional data were collected from medical student records at The Johns Hopkins University School of Medicine from July 2009 through June 2011. Surgical faculty members and residents rated students' clinical knowledge on a 5-point, Likert-type scale. Interrater reliability was assessed using intraclass correlation coefficients for students with ≥4 attending surgeon evaluations (n = 216) and ≥4 resident evaluations (n = 207). Convergent validity was assessed by correlating average evaluation ratings with scores on the National Board of Medical Examiners (NBME) clinical subject examination for surgery. Average resident and attending surgeon ratings were also compared by NBME quartile using analysis of variance.

Results

There were high degrees of reliability for resident ratings (intraclass correlation coefficient, .81) and attending surgeon ratings (intraclass correlation coefficient, .76). Resident and attending surgeon ratings shared a moderate degree of variance (19%). However, average resident ratings and average attending surgeon ratings shared a small degree of variance with NBME surgery examination scores (ρ² ≤ .09). When ratings were compared among NBME quartile groups, the only significant difference was for residents' ratings of students with the lower 25th percentile of scores compared with the top 25th percentile of scores (P = .007).

Conclusions

Although high interrater reliability suggests that attending surgeons and residents rate students with consistency, the lack of convergent validity suggests that these ratings may not be reflective of actual clinical knowledge. Both faculty members and residents may benefit from training in knowledge assessment, which will likely increase opportunities to recognize deficiencies and make student evaluation a more valuable tool.     

When surgeons decide to become surgeons: new opportunities for surgical education

Background

When surgeons decide to become surgeons has important implications. If the decision is made prior to or early in medical school, surgical education can be more focused on surgical diseases and resident skills.

Methods

To determine when surgeons – compared with their nonsurgical colleagues – decide on their medical path, residents in surgery, internal medicine, obstetrics and gynecology, pediatrics, psychiatry, and emergency medicine were surveyed. Timing of residency choice, demographic data, personal goals, and reason for residency choice were queried.

Results

A total of 234 residents responded (53 surgical residents). Sixty-two percent of surgeons reported that they were “fairly certain” of surgery before medical school, 13% decided during their preclinical years, and 25% decided during their clerkship years. This compares with an aggregate 40%, 7%, and 54%, respectively, for the other 5 residency specialties. These differences were statistically significant (P = .001). When the 234 residents were asked about their primary motivation for choosing their field, 51% pointed to expected job satisfaction and 44% to intellectual curiosity, and only 3% mentioned lifestyle, prestige, or income.

Conclusions

General surgery residents decide on surgery earlier than residents in other programs. This may be advantageous, resulting in fast-tracking of these medical students in acquiring surgical knowledge, undertaking surgical research, and early identification for surgical residency programs. Surgical training in the era of the 80-hour work week could be enhanced if medical students bring much deeper knowledge of surgery to their first day of residency.     

Teaching across the continuum: variations in rankings and valued teaching components between surgery residents and medical students

Background

Surgical faculty teach medical students and residents within the same environment; however, each group may require different teaching methods. The aim of this study was to identify teaching components valued by these sets of learners.

Methods

Teaching evaluations for 43 surgical faculty members who received yearly evaluations from students and residents were analyzed. Highest and lowest ranked educators in medical student evaluations were traced to corresponding rankings in resident evaluations. Thematic analysis was conducted on written comments.

Results

Educators rated the highest in the medical student group were spread out among the residents' rankings, with several educators being rated the lowest. Similar patterns were observed in reverse for faculty rated highly by residents.

Conclusions

Residents and medical students value faculty teaching using different criteria, with residents more focused on operative autonomy and medical students focused on approachability. Using one group to define best teaching methods is insufficient as learners value different optimal attributes.     

Porcine wet lab improves surgical skills in third year medical students

Background

Medical students desire to become proficient in surgical techniques and believe their acquisition is important. However, the operating room is a challenging learning environment. Small group procedural workshops can improve confidence, participation, and performance. The use of fresh animal tissues has been rated highly among students and improves their surgical technique. Greater exposure to surgical procedures and staff could positively influence students' interest in surgical careers. We hypothesized that a porcine “wet lab” course for third year medical students would improve their surgical skills.

Methods

Two skills labs were conducted for third year medical students during surgery clerkships in the fall of 2011. The students' surgical skills were first evaluated in the operating room across nine dimensions. Next, the students performed the following procedures during the skills lab: (1) laparotomy; (2) small bowel resection; (3) splenectomy; (4) partial hepatectomy; (5) cholecystectomy; (6) interrupted abdominal wall closure; (7) running abdominal wall closure; and (8) skin closure. After the skills lab, the students were re-evaluated in the operating room across the same nine dimensions. Student feedback was also recorded. Fifty-one participants provided pre- and post-lab data for use in the final analysis.

Results

The mean scores for all nine surgical skills improved significantly after participation in the skills lab (P ≤ 0.002). Cumulative post-test scores also showed significant improvement (P = 0.002). Finally, the student feedback was largely positive.

Conclusions

The surgical skills of third year medical students improved significantly after participation in a porcine wet lab, and the students rated the experience as highly educational. Integration into the surgery clerkship curriculum would promote surgical skill proficiency and could elicit interest in surgical careers.     

Cutting too deep? Assessing the impact of a shorter surgery clerkship on students' clinical skills and knowledge

Background

The aim of this study was to compare the performance of students completing an 8-week versus a 6-week surgery clerkship on an objective structured clinical examination (OSCE) and the National Board of Medical Examiners (NBME) clinical science surgery examination.

Methods

One hundred fifteen students from the 8-week clerkship and 99 from the 6-week clerkship were included. Performance on a summative OSCE was assessed using behaviorally anchored checklists. NBME exams were graded using the NBME's standard scaled scores. Results were compared using 2-tailed, independent-samples, unequal-variance t tests.

Results

Mean OSCE scores for the 8-week and 6-week curricula were not statistically different. Mean NBME scores also did not statistically differ. Six-week students performed significantly better in the specific OSCE subdomains of blood pressure, orthostatic blood pressure, rectal exam, and fecal occult blood test.

Conclusions

Overall OSCE and NBME exam performance did not differ between 8-week and 6-week surgery clerkship students.     

Novel oral anticoagulants vs warfarin for the management of postoperative atrial fibrillation: clinical outcomes and cost analysis

Background

The American Board of Surgery In-Training Examination (ABSITE) offers annual assessment of resident medical knowledge. We sought to determine if ongoing end-of-rotation evaluations by faculty of residents' medical knowledge correlate with ABSITE performance.

Methods

Retrospective cross-sectional study was conducted over 3 years at 2 institutions. Faculty rated residents' clinical knowledge as part of a global summative evaluation. The intraclass correlation coefficient and convergent validity between faculty evaluations and ABSITE performance were assessed.

Results

A total of 1,562 faculty evaluations were completed for about 147 residents. There was poor agreement among faculty for each resident, with intraclass correlation coefficients of less than 0.2. Spearman's correlation coefficient was calculated for evaluations and ABSITE scores and were found to be weakly correlative at one institution and not correlated at all at the other. Finally, evaluations across quartiles of resident ABSITE scores were examined and show no correlation.

Conclusion

Faculty evaluations of resident medical knowledge correlate poorly with resident ABSITE performance, and should not be used as an ongoing predictive tool.     

Development of a fresh cadaver model for instruction of ultrasound-guided breast biopsy during the surgery clerkship: pre-test and post-test results among third-year medical students

Background

The aim of our study was to determine if a fresh cadaver model is a viable method for teaching ultrasound (US)-guided breast biopsy of palpable breast lesions.

Methods

Third-year medical students were assessed both preinstruction and postinstruction on their ability to perform US-guided needle aspiration or biopsy of artificially created masses using a 10-item checklist.

Results

Forty-one third-year medical students completed the cadaver laboratory as part of the surgery clerkship. Eight items on the checklist were found to be significantly different between pre-testing and post-testing. The mean preinstruction score was 2.4, whereas the mean postinstruction score was 7.10 (P < .001).

Conclusions

Fresh cadaver models have been widely used in medical education. However, there are few fresh cadaver models that provide instruction on procedures done in the outpatient setting. Our model was found to be an effective method for the instruction of US-guided breast biopsy among medical students.     

A formative midterm test increases accuracy of identifying students at risk of failing a third year surgery clerkship

Background

Providing midclerkship feedback to identify students at risk for failing is a Liaison Committee on Medical Education standard. Objective criteria for that feedback are critical. The investigators studied the value of a formative midterm (MT) test in identifying students at risk for failing a surgery clerkship.

Methods

A written midclerkship test, which did not contribute to the final grade, was administered (n = 155). The Bayesian specificity, sensitivity, and predictive values for clerkship failure of low MT score, low global clinical performance rating GCPR, and the combination of low MT and low GCPR were computed.

Results

Low MT as a predictor of clerkship failure was sensitive (1.0) but not specific (.35). Likewise, low GCPR was sensitive (1.0) but not specific (.31). The combination of low MT and GCPR, however, was both specific (1.0) and sensitive (.87).

Conclusions

The addition of an MT test to clinical performance ratings can stratify students' risk for clerkship failure.     

Medical Students' Knowledge and Attitudes Toward Organ Donation: Results of a Dutch Survey

Background

In the Netherlands, as in many other countries, a paucity of research exists on the attitudes and intentions of medical students toward organ donation. These students are of interest for the effect that increasing medical knowledge might have on the willingness to register as a donor.

Objective

To examine which factors determine medical students' willingness to register as donors.

Methods

We conducted a cross-sectional survey among medical students at the University of Amsterdam. Our questionnaire included questions on actual donor registration, motives, knowledge, and attitudes toward donation. To assess which factors were related to self-reported donor registration status, we conducted multivariate logistic regression analyses.

Results

We received 506 questionnaires (response rate at least 84%). The majority of respondents (80%) intended to donate organs, while 59% were registered. Self-reported medical knowledge and positive attitudes on donation were independently associated with registering as a donor. A rising study year was associated with registering as a donor; this could be explained by increasing medical knowledge and changing attitudes.

Conclusion

The results of our study suggest that willingness to register as a donor increases with a rising level of knowledge on organ donation up to some minimal level.     

Innovation in internship preparation: an operative anatomy course increases senior medical students' knowledge and confidence

Background

An operative anatomy course was developed within the construct of a surgical internship preparatory curriculum. This course provided fourth-year medical students matching into a surgical residency the opportunity to perform intern-level procedures on cadavers under the guidance of surgical faculty members.

Methods

Senior medical students performed intern-level procedures on cadavers with the assistance of faculty surgeons. Students' confidence, anxiety, and procedural knowledge were evaluated both preoperatively and postoperatively. Preoperative and postoperative data were compared both collectively and based on individual procedures.

Results

Student confidence and procedural knowledge significantly increased and anxiety significantly decreased when preoperative and postoperative data were compared (P < .05). Students reported moderate to significant improvement in their ability to perform a variety of surgical tasks.

Conclusions

The consistent improvement in confidence, knowledge, and anxiety justifies further development of an operative anatomy course, with future assessment of the impact on performance in surgical residency.     

Évaluation d’un labyrinthe pédagogique pour l’enseignement de la traumatologie grave

Background

Assess efficacy, satisfaction and usefulness of an educational maze based on posters and audioguide for major trauma care teaching to medical students. The educational maze consists of posters with audio comments recorded in an audioguide. This tool was part of a larger educational program including medical simulation.

Study design

Prospective, interventional, observational, monocentric study.

Student

Medical student of Grenoble University Hospital, in the four last years of medical school, following a training course in anesthesia, emergency medical services and intensive care units.

Method

Forty essentials key messages for major trauma management were included in 10 posters and audioguides. A first assessment with short opened answers was handed to the students at the end of the educational maze to assess their memorization. A second assessment with simple choice answers regarding satisfaction and usefulness of this new educational tool was realized at the end of the entire program.

Result

One hundred and eighty-four medical students attending the major trauma program were included in this study. On the first test, 75% of essential knowledge on major trauma management was memorized by more than 50% of the medical students. On the second test, 94% of medical students had a high satisfaction level of this educational maze.

Conclusion

An educational maze based on posters and audioguides seems to be an efficient, useful tool for teaching essential knowledge on major trauma management to medical students.     

Higher clinical performance during a surgical clerkship is independently associated with matriculation of medical students into general surgery

Background

The purpose of our study was to determine the predictive impact of individual academic measures for the matriculation of senior medical students into a general surgery residency.

Methods

Academic records were evaluated for third-year medical students (n = 781) at a single institution between 2004 and 2011. Cohorts were defined by student matriculation into either a general surgery residency program (n = 58) or a non–general surgery residency program (n = 723). Multivariate logistic regression was performed to evaluate independently significant academic measures.

Results

Clinical evaluation raw scores were predictive of general surgery matriculation (P = .014). In addition, multivariate modeling showed lower United States Medical Licensing Examination Step 1 scores to be independently associated with matriculation into general surgery (P = .007).

Conclusions

Superior clinical aptitude is independently associated with general surgical matriculation. This is in contrast to the negative correlation United States Medical Licensing Examination Step 1 scores have on general surgery matriculation. Recognizing this, surgical clerkship directors can offer opportunities for continued surgical education to students showing high clinical aptitude, increasing their likelihood of surgical matriculation.     

Expanding surgical clerkships to remote community sites: the success of the Washington, Wyoming, Alaska, Montana, and Idaho experience

Background

The purpose of this analysis was to determine if the surgical clerkship model and site affect educational outcomes and student postclerkship perceptions.

Methods

Data from University of Washington students participating in surgical clerkships at traditional/academic or community/apprentice sites across Washington, Wyoming, Alaska, Montana, and Idaho (WWAMI) between 2005 and 2007 were gathered retrospectively. Comparisons of final examination scores as well as postclerkship student evaluations of the educational experience were made between traditional and community training sites.

Results

The mean final examination scores at WWAMI sites were significantly higher than those at traditional academic sites. Furthermore, WWAMI sites were rated higher with respect to time spent by faculty in direct observation, quality of the clerkship as a whole, and overall contribution to medical education.

Conclusions

Community surgical clerkship sites remote from an academic institution can provide an excellent learning experience for students.     

Influence of medical students' past experiences and innate dexterity on suturing performance

Background

Medical students often site their ability to excel at technical tasks as justification for choosing surgery as a career path. We sought to investigate how medical students' dexterity skills and past experiences correlated with suturing performance.

Methods

Sixty-four 3rd-year medical students were surveyed about previous experiences that involved manual dexterity. Technical skills were then measured using a validated test of manual dexterity and subcuticular closure of a pig's foot incision. Spearman's rank correlation coefficients determined correlation between variables.

Results

Previous experiences, self-assessment of dexterity, prior suturing, and current interest in surgery did not significantly correlate with manual dexterity or suturing skill scores. Innate manual dexterity score was the only significant correlating factor to suture skill score (Spearman's rank correlation coefficient = .336; P = .007).

Conclusions

Innate manual dexterity skills are predictive of initial surgical suturing performance regardless of past student experiences. Interventions aimed at improving early surgical technique should be optimally focused on dexterity training.