Positive Outcomes of Optimizing Student–Preceptor Continuity in a Traditional Block Clerkship

Problem: Student–preceptor discontinuity during 3rd-year clerkships limits the quality and quantity of supervision, teaching, and feedback. Although longitudinal integrative clerkships increase continuity and are associated with improved student and preceptor experience, they require schoolwide curricular reform. Alternative innovations enhancing student–preceptor relationships within the constraints of a traditional block clerkship may demonstrate similar benefits. Intervention: We piloted a continuity-enhanced general pediatric ambulatory schedule during 2 consecutive clerkship blocks in 2013. Students in the continuity-enhanced model (n = 29) were assigned 1–3 primary clinic preceptors, whereas those in the traditional model (n = 30) worked with 5–8. Data were gathered from student assessments and anonymous student and preceptor surveys. We used t and Fisher's exact tests to compare the two groups and performed thematic analysis of free-text survey comments. Context: Our school utilizes a block clerkship model with approximately 30 students rotating through the pediatric clerkship every 8 weeks. During the 3-week ambulatory portion, students spend 8 half days in the general pediatric ambulatory clinic. At the conclusion of each clinic, attendings completed brief student evaluation cards. Traditionally, student and attending schedules were created independently, resulting in transient supervisory relationships and dissatisfaction with clinical engagement, feedback, and evaluation. Outcome: Seventy-three percent (43/59) of the students completed the survey. Ten general ambulatory attendings collectively completed 87.5% (35/40) of the monthly surveys. Continuity students received significantly more narrative evaluation comments (10.6 vs. 5.8, p <. 001) from general ambulatory clinic attendings and were more likely to have at least one general ambulatory clinic attending endorse being able to provide meaningful feedback and evaluation (n = 29, 100% vs. n = 20, 66.7%, p <. 001). Continuity students were also more likely to endorse being able to ask at least one of these attendings for a letter of recommendation (71.4% vs. 9.1%, p <. 001) and to have at least one general ambulatory clinic attending endorse being able to provide a meaningful letter of recommendation if asked (62.1% vs. 3.3%, p <. 001). Students (88.4%) and attendings (85.7%) preferred the continuity-enhanced schedule. The most frequent theme of both student and attending free-text survey remarks were relationships and assessment. Lessons Learned: Intentional scheduling of clerkship students to enhance preceptor continuity resulted in significant positive outcomes echoing the relationship-based educational benefits of longitudinal clerkships, particularly in regards to student assessment and feedback. Clerkship directors and other medical educators should consider implementing small changes within block clerkships to maximize student–preceptor continuity.     

Grade Inflation and the Internal Medicine Subinternship: A National Survey of Clerkship Directors

Background: Grade inflation has been demonstrated in certain medical school clerkships but never studied in the internal medicine subinternship.

Purposes: The purpose is to determine the existence, extent, and possible causes of subinternship grade inflation.

Methods: We surveyed clerkship directors as part of the 2004 Clerkship Directors in Internal Medicine national member survey.

Results: The majority of clerkship directors agree that subinternship grade inflation exists. Half of SI students receive Honors and one third receive High Pass. Eighteen percent admitted passing a student that they felt should have failed. Difficulty delivering negative feedback is the top explanation for grade inflation.

Conclusion: Clerkship directors agree that grade inflation exists in the internal medicine subinternship. Faculty development and further analysis of our current subinternship evaluation and grading system may help to minimize this problem.     

Internal Medicine Clerkship Directors' Use of and Opinions About Clerkship Examinations

Background: For years, quantifiable examinations have been a core component of assessing medical student competence during the internal medicine clerkship.

Purpose: To determine how internal medicine clerkship directors use and view examinations and how uses of examinations have changed.

Methods: In 1999, the Clerkship Directors in Internal Medicine conducted a confidential survey of its 123 institutional members.

Results: Survey response rate was 89% (109/123). The National Board of Medical Examiners subject examination was used by 83%, alone (49%) or in combination with a faculty developed examination or a standardized patient examination (34%). Minimum passing scores were required for the subject exam by 80%, for faculty-developed examinations by 65%, and for the standardized patient exam by 63%. Examinations contribute approximately 25% toward a student's final grade. Students with acceptable clerkship performances but who fail an exam typically retest after self-study. Students who fail a retest receive unsatisfactory grades and require additional medicine experience.

Of the clerkship directors who reported using the National Board of Medical Examiners subject examination, 45 (50%) provided comments on ways to improve the examination. Comments focused on examination content, reporting results, basing the exam on a published core curriculum, and general administrative issues. Over the past decade, use of the National Board of Medical Examiners subject examination has increased (66% to 83%), use of faculty-developed examinations has declined (46% to 27%), and the use of a clerkship standardized patient examination increased sharply (2% to 27%).

Conclusions: Internal medicine clerkship directors commonly require students to pass standardized or locally developed exams and use test results to make academic decisions. The use of standardized patient examinations has increased significantly and likely reflects a broadening of competency assessment. Our results can serve as a basis for individual programmatic evaluation, for internal medicine and other clerkship directors.     

Internal Medicine Core Clerkships Experience With Core Problem Lists: Results From a National Survey of Clerkship Directors in Internal Medicine

Background: The Liaison Committee on Medical Education (LCME) requires clinical clerkships in North American Medical Schools to define and monitor core problems and clinical conditions for medical students and adjust the clerkships to ensure that all students meet those objectives at all instructional sites. Clinical clerkships usually use medical student generated logbooks to meet these requirements. It is not clear what clinical clerkship directors are doing to meet these standards. Purpose: To determine how internal medicine clerkship directors develop problem lists, whether and how they verify student problem list entry, and how missed core problems are covered. Methods: The Clerkship Directors in Internal Medicine (CDIM) organization conducts an annual survey of its institutional members (one member per medical school). In 2007, 75% of North American medical schools (82 of 110) responded to the survey, which included questions on core problem lists and medical student logbooks. Results: Ninety-four percent of responding medical schools had a core problem list for the core internal medicine clerkship. Most schools used an electronic logbook and verified student exposure to core problems (76%). The clerkship director usually did the verification (63%). Clerkships offered a variety of options to remedy lack of exposure to core problems and usually offered more than one option. Conclusions: Clerkship directors in internal medicine develop, verify, and ensure exposure to core problems in internal medicine. Most clerkship directors used the CDIM recommended core problem list as a basis for their local core problem list. Emerging computer-assisted learning options may simplify clerkship adjustments for lack of exposure to core problems. It appears that clerkship directors are using logbooks appropriately to meet the LCME charge to monitor core problems and clinical conditions.     

Understanding Clerkship Student Roles in the Context of 21st-Century Healthcare Systems and Curricular Reform

ABSTRACT

Phenomenon: Preclerkship medical education has undergone extensive reform, and the clerkship years are growing targets for curricular innovation. As institutions implement new preclerkship curricula to better prepare medical students to practice medicine in the context of modern healthcare systems, the perspective of clerkship leaders regarding clerkship student roles and potential for change will facilitate redefining these roles so that preclerkship educational innovations can continue into clerkships. Approach: In this qualitative exploratory study, authors conducted semistructured interviews with clerkship and site directors for eight core clerkships from April to May 2016. Questions addressed how clerkship leaders perceive current student roles and the potential for change. Through iterative consensus building, authors identified themes describing current ideal clerkship student roles applicable to future roles. Findings: Twenty-three of 24 (96%) directors participated. Findings fell into four themes: factors influencing the clerkship role, clerkship student role archetypes, workplace authenticity and value, and potential for change. Student, supervisor, and context factors determine the clerkship student role. Three role archetypes emerged: the apprentice (an assistant completing concrete patient care tasks), the academic (a researcher bringing literature back to the team), and the communicator (an interdisciplinary and patient liaison). Each archetype was considered authentic and valuable. Positive attitudes toward preclerkship curricular changes were associated with openness to evolution of the clerkship students' role. These emerging roles mapped to the archetypes. Insights: Clerkship leaders perceive that student, supervisor, and context factors result in varying emphasis on role archetypes, which in turn lead to different types of learning. Medical educators can use the archetypes to articulate how expanded student roles align learning with clinical needs, particularly as they relate to health systems science and inquiry.     

University and Community Hospital Medical Student Emergency Medicine Clerkship Experiences

Objective : To determine whether there is a significant difference between educational opportunities for fourth-year medical students rotating at a university hospital (UH) compared with several community hospitals (CHs) during a mandatory emergency medicine (EM) clerkship.
Methods : A self-reported clinical tool was completed in real time by each student rotating for 2 weeks at the UH and 2 weeks at 1 of 4 CHs (3 affiliated and 1 unaffiliated). Students are required to document the number of patients seen and the number of procedures performed on each of 20 six-hour shifts. They rated the EM attending clinical teaching by site using a 5-point scale at the end of the clerkship.
Results : Most (95%) of the 87 students in the 7 clerkship blocks of the 1996–97 academic year rotated at the UH and a CH. Most (71%) students rated both the UH and the CH for the quality of teaching by attendings. There was a significant difference in the mean number of patients evaluated/shift (2.2 ± 0.10 vs 2.8 ± 0.10, UH vs CH; p < 0.001) and the mean number of procedures performed/shift (0.36 ± 0.04 vs 0.56 ± 0.05, UH vs CH; p < 0.001). Attending clinical teaching scores were significantly higher (p = 0.03) at the CHs.
Conclusions : The educational opportunities for students in an EM clerkship to evaluate patients and perform procedures were significantly greater at the community hospitals. Inclusion of community hospital settings in a medical student EM clerkship may optimize the clinical experience.     

A National Survey of Pediatric Clerkship Directors' Approaches to Meeting the LCME ED-2 Requirement for Quantified Patient Criteria for Medical Students

Background: The Liaison Committee on Medical Education (LCME) recently reinterpreted ED-2, their quantified patient criteria requirement.

Purpose: The purpose is to describe pediatric clerkship directors' response to ED-2.

Method: We used a survey of U.S. and Canadian pediatric clerkship directors.

Results: Survey response rate was 76% (108/142). The most frequent categories that clerkship directors used to describe quantified patient criteria were age group (77%), organ systems (65%), or symptoms (61%). Computer simulations were the alternative patient experience in 83% of clerkships. Patient logs (90%) and checklists (31%) tracked student completion of ED-2. Thirty-two respondents had an LCME visit since ED-2 was reinterpreted, and 69% reported that LCME had concerns about their clerkships' fulfillment of ED-2. There was no difference in method of ED-2 implementation between schools who were cited by LCME and those who were not.

Conclusions: Clerkship directors have used a variety of approaches to specify and monitor quantified patient criteria.     

Using Patient Encounter Logs for Mandated Clinical Encounters in an Internal Medicine Clerkship

Background: Patient encounter logs help assess a student's educational experience. The use of a grading incentive linked to the mandatory documentation of prespecified clinical encounters has been insufficiently studied. Purposes: Given this, our objectives were to determine (a) if mandating student exposure to patients with 18 key training problems leads to the successful documentation of these encounters, (b) the degree of difficulty students and clerkship directors experienced in meeting these mandates, (c) the accuracy of mandated log entries, and (d) how often the log entries were questioned or rejected by preceptors. Methods: Ninety-two 3rd-year internal medicine students and 6 internal medicine clerkship directors at 9 geographically dispersed hospitals and 30 ambulatory sites participated in the study. Over a single academic year, we directly measured the completion rate of mandated logs, the degree of their accuracy as judged against faculty-generated logs of two required videotaped standardized patient encounters, and the percentage of logs that were not validated. We surveyed students and directors on the perceived degree of difficulty in meeting mandated requirements. Results: Ninety-eight percent of students met our mandated requirements and 93.8% of students found it “easy” or “very easy” to meet this requirement. The amount of estimated time spent by clerkship directors helping students meet mandated requirements for the entire year was 4.5 hr. The accuracy of submitted logs was 77%; however, almost all inaccurate log entries were “validated” by preceptors. Conclusions: Mandating encounters is effective in assuring that students document encounters with patients who present with specific clinical problems. The accuracy of our students' mandated logs is similar to previously published data. However, even inaccurate logs were rarely questioned or rejected by preceptors.     

Abstracts From the Proceedings of the 2005 Annual Meeting of the Association of Directors of Medical Student Education in Psychiatry (ADMSEP)

Background: Educational theories predict conflicting results for the effect of increasing the authenticity of the teaching format of complex information on educational outcomes. We sought to determine the effect of increasingly authentic small-group, preclerkship teaching format on clerkship outcomes to further enlighten this debate. Summary: Students enrolled in a prospective randomized crossover trial that involved three content areas. For each content area, three teaching formats were tested. Participants were randomized to teaching format by content area. Clerkship outcomes were performance on an objective structured clinical exam, a DVD exam, internal medicine clerkship grades, and performance on the subject examination. The data were analyzed using a multivariate analysis of covariance. One hundred and thirty-three (78%) students participated. Teaching format did not have a statistically significant effect on any of the specified clerkship outcomes. However, number of patients seen was significantly associated with higher scores in respective outcomes by topic. Conclusions: Second-year teaching format did not directly influence subsequent clerkship performance. Our study adds to the literature by demonstrating that the authenticity of preclinical teaching format does not appear to matter for clerkship performance; however, the number of actual patients seen does appear to influence related clerkship outcomes.     

Enhancing Motivational Interviewing Training in a Family Medicine Clerkship

Problem: Despite the prevalence of unhealthy behaviors among patients in the healthcare system, traditional medical training involves little or no exposure to effective behavior change techniques such as Motivational Interviewing. Intervention: An online learning community for enhanced training in Motivational Interviewing was developed for 3rd-year medical students. The website included educational materials about Motivational Interviewing as well as problematic health behaviors, a repository of exemplar videos and student videos with feedback, and a discussion board. Student participants were given the opportunity to record an encounter with a patient and to receive feedback on their use of Motivational Interviewing from a faculty member. Context: Student volunteers in the Family Medicine Clerkship at Georgetown University School of Medicine were randomized to enhanced training, which included the online learning community, or training as usual. All student volunteers completed a questionnaire assessing self-efficacy initially and at the end of the clerkship. Students also participated in an Observed Structured Clinical Exam, which was subsequently coded by a blinded rater for behavioral counts of Motivational Interviewing techniques, key steps in Motivational Interviewing, and overall Motivational Interviewing style. Outcome: Students in the enhanced training arm were rated as having significantly higher scores in Motivational Interviewing style in the Observed Structured Clinical Exam than training as usual students. A significant increase in self-efficacy from pre- to posttest in the overall sample was observed but between-group differences were not significant. Student feedback was particularly positive regarding video recorded practice sessions with patients and individualized feedback. Lessons Learned: The results of this study as well as student feedback suggest that future work should include patient practice sessions and individualized feedback in developing Motivational Interviewing curricula.     

Expectations for Medical Student Work Hours in Inpatient Clinical Clerkships

Background: No standards regarding what should be learned during medical school exist. Purpose: We investigated what medical students and clerkship directors (CDs) believe students are, and should be, doing during clerkships. Methods: From January to June 2011, Mount Sinai School of Medicine CDs (n = 4) and 3rd-year students (n = 132) estimated how students spend time and should spend time during clerkships. Mann-Whitney U-tests compared students’ and CDs’ replies. Results: All CDs and 105 of 132 students (79.5%) participated. Medicine CDs believed that students did more rounding and studying, and surgery CDs perceived that students did more note writing and studying and less waiting than students reported. Medicine CDs felt students should round more, whereas surgery CDs felt students should spend more total time in the hospital as well as in educational activities and studying than students did ( p < .05). Conclusions: Students and CDs disagree about how students allocate (and should allocate) time during clerkships.     

Navigating Tensions of Efficiency and Caring in Clerkship: A Qualitative Study

Abstract

Phenomenon: Clerkship is a challenging transition during which medical students must learn to navigate the responsibilities of medical school and clinical medicine. We explored how clerks understand their roles as both medical learners and developing professionals and some of the tensionss that arise therein. Understanding how the clinical learning environment shapes the clerkship role can help educators foster compassionate care. Approach: We conducted 5 focus groups and 1 interview with 3rd-year medical students (n?=?14) at University of Toronto between January and June 2016 regarding the perceived role of the clerk, compassionate care, assessment and feedback. Data were analyzed thematically. Findings: In addition to transitioning to a new learning environment, clerkship students assume different roles in response to complex and often competing expectations from preceptors. We identified three main themes: learning to impress preceptors with varying expectations, providing compassionate care—sometimes supported by preceptors, other times being secondary to efficiency—and passing assessments that required a different skill set than simply being a “good clerk.” Insights: Clerks perceive their role as providing compassionate care to patients and balance this with fulfilling the (sometimes) competing roles of being a student and developing medical professional. In a system where efficiency is often prioritized, medical students are afforded an opportunity to help satisfy the demand for greater compassion in patient-centered care.     

Grading Practices and Distributions Across Internal Medicine Clerkships

Theory: Clerkship evaluation and grading practices vary widely between U.S. medical schools. Grade inflation continues to exist, and grade distribution is likely to be different among U.S. medical schools. Hypotheses: Increasing the number of available grades curtails “grade inflation.” Method: A national survey of all Clerkship Directors in Internal Medicine members was administered in 2011. The authors assessed key aspects of grading. Results: Response rate was 76%. Among clerkship directors (CDs), 61% of respondents agreed that grade inflation existed in the internal medicine clerkship at their school, and 43% believed that it helped students obtain better residency positions. With respect to grading practices, 79% of CDs define specific behaviors needed to achieve each grade, and 36% specify an ideal grade distribution. In addition, 44% have a trained core faculty responsible for evaluating students, 35% describe formal grading meetings, and 39% use the Reporter-Interpreter-Manager-Educator (RIME) scheme. Grading scales were described as follows: 4% utilize a pass/fail system, 13% a 3-tier (e.g., Honors/Pass/Fail), 45% 4-tier, 35% 5-tier, and 4% 6+-tier system. There was a trend to higher grades with more tiers available. Conclusions: Grade inflation continues in the internal medicine clerkship. Almost half of CDs feel that this practice assists students to obtain better residency positions. A minority of programs have a trained core faculty who are responsible for evaluation. About one third have formal grading meetings and use the RIME system; both have been associated with more robust and balanced grading practices. In particular, there is a wide variation between schools in the percentage of students who are awarded the highest grade, which has implications for residency applications. Downstream users of clinical clerkship grades must be fully aware of these variations in grading in order to appropriately judge medical student performance.     

Beyond the Ivory Tower: A Comparison of Grades Across Academic and Community OB/GYN Clerkship Sites

Construct: Decentralized clinical education is the use of community facilities and community physicians to educate medical students. The theory behind decentralized clinical education is that academic and community sites will provide educational equivalency as determined by objective and subjective performance measures, while training more medical students and exposing students to rural or underserved communities. One of the major challenges of decentralized clinical education is ensuring site comparability in both learning opportunities and evaluation of students. Background: Previous research has examined objective measures of student performance, but less is known about subjective performance measures, particularly in the field of obstetrics and gynecology (OB/GYN). This study explores the implications of clinical site on the adequacy of subjective and objective performance measures. Approach: This was a retrospective cohort study of 801 students in the University of Washington School of Medicine OB/GYN clerkship from 2008 to 2012. Academic sites included those with OB/GYN residency programs (n = 2) and community sites included those without residency programs (n = 29). The association between clerkship site and National Board of Medical Examiners (NBME) grade was assessed using linear regression and clinical and final grade using multinomial regression, estimating β coefficient and relative risks (RR), respectively, and 95% confidence intervals (CIs), adjusting for gender, academic quarter of clerkship, and year of clerkship. Results: There were no differences in NBME exam grades of students at academic sites (76.4 (7.3) versus 74.6 (8.0), β = –0.11, 95% CI [1.35, 1.12] compared to community sites. For clinical grade, students at community sites were 2.4 times more likely to receive honors relative to high pass (RR 2.45), 95% CI [1.72, 3.50], and for final grade, students at community sites were 1.9 times more likely to receive honors relative to pass (RR 1.98), 95% CI [1.27, 3.09], and 1.6 times more likely to receive honors relative to high pass (RR 1.62), 95% CI [1.05, 2.50], compared to those at academic sites. Conclusions: Students at community sites receive higher clinical and final grades in the OB/GYN clerkship. This highlights a significant challenge in decentralized clinical education—ensuring site comparability in clinical grading, Further work should examine the differences in sites, as well as improve standardization of clinical grading. This also underscores an important consideration, as the final grade can influence medical school rank, nomination into honor societies, and ranking of residency applicants.     

The Impact of Two Clinical Shift Allocation Models on Student Experiences in an Emergency Medicine Clerkship

Background: Medical students on Emergency Medicine (EM) clerkships are traditionally assigned work shifts in a manner that provides a mix of daytime, evening, overnight, and weekend shifts. Whether or not this shift allocation model provides the optimal educational experience remains unclear. Purpose: The purpose of this study was to compare the impact of two different shift allocation models on the student's clerkship experience. Specifically, we set out to compare the traditional shift allocation model to a novel model designed to maximize teacher–learner continuity. Methods: This was a prospective, crossover, cohort study of medical students participating in an EM clerkship at one institution from January 1 through April 31, 2010. All students completed 2 weeks of shifts under the “traditional shift model” and 2 weeks of shifts under the “continuity-based shift model.” In the latter, the guiding principle of student shift allocation was continuity between teacher and learner. Students completed coded surveys after each 2-week block that were later matched and analyzed using 2-way ANOVAs with 1 repeated measure. In addition, all students participated in a semistructured group interview at the completion of both blocks. The interviews were recorded, transcribed, and analyzed using qualitative methods. Themes and subthemes that emerged were assessed for frequency of occurrence. Results: Eighteen medical students consented to participate. Students rated the continuity-based shift model higher on all 10 survey items. However, only the items that asked specifically about “faculty”—faculty teaching, faculty interaction, frequency and quality of faculty feedback—were rated significantly higher when students worked under the continuity-based shift model. Qualitative analysis of group interviews revealed 6 major themes and 16 subthemes. Students described feedback (N = 16/117) and the teacher–learner relationship (N = 21/117) as superior under the continuity-based shift model. Conclusions: Changes in shift allocation affects student experience in an EM clerkship. A shift allocation model that maximizes the continuity between teacher and learner is perceived by students to improve feedback and the teacher–learner relationship.     

Faculty Evaluations Correlate Poorly with Medical Student Examination Performance in a Fourth-Year Emergency Medicine Clerkship

Background

Clerkship directors routinely evaluate medical students using multiple modalities, including faculty assessment of clinical performance and written examinations. Both forms of evaluation often play a prominent role in final clerkship grade. The degree to which these modalities correlate in an emergency medicine (EM) clerkship is unclear.