Grading Practices and Distributions Across Internal Medicine Clerkships

Theory: Clerkship evaluation and grading practices vary widely between U.S. medical schools. Grade inflation continues to exist, and grade distribution is likely to be different among U.S. medical schools. Hypotheses: Increasing the number of available grades curtails “grade inflation.” Method: A national survey of all Clerkship Directors in Internal Medicine members was administered in 2011. The authors assessed key aspects of grading. Results: Response rate was 76%. Among clerkship directors (CDs), 61% of respondents agreed that grade inflation existed in the internal medicine clerkship at their school, and 43% believed that it helped students obtain better residency positions. With respect to grading practices, 79% of CDs define specific behaviors needed to achieve each grade, and 36% specify an ideal grade distribution. In addition, 44% have a trained core faculty responsible for evaluating students, 35% describe formal grading meetings, and 39% use the Reporter-Interpreter-Manager-Educator (RIME) scheme. Grading scales were described as follows: 4% utilize a pass/fail system, 13% a 3-tier (e.g., Honors/Pass/Fail), 45% 4-tier, 35% 5-tier, and 4% 6+-tier system. There was a trend to higher grades with more tiers available. Conclusions: Grade inflation continues in the internal medicine clerkship. Almost half of CDs feel that this practice assists students to obtain better residency positions. A minority of programs have a trained core faculty who are responsible for evaluation. About one third have formal grading meetings and use the RIME system; both have been associated with more robust and balanced grading practices. In particular, there is a wide variation between schools in the percentage of students who are awarded the highest grade, which has implications for residency applications. Downstream users of clinical clerkship grades must be fully aware of these variations in grading in order to appropriately judge medical student performance.     

Grade Inflation and the Internal Medicine Subinternship: A National Survey of Clerkship Directors

Background: Grade inflation has been demonstrated in certain medical school clerkships but never studied in the internal medicine subinternship.

Purposes: The purpose is to determine the existence, extent, and possible causes of subinternship grade inflation.

Methods: We surveyed clerkship directors as part of the 2004 Clerkship Directors in Internal Medicine national member survey.

Results: The majority of clerkship directors agree that subinternship grade inflation exists. Half of SI students receive Honors and one third receive High Pass. Eighteen percent admitted passing a student that they felt should have failed. Difficulty delivering negative feedback is the top explanation for grade inflation.

Conclusion: Clerkship directors agree that grade inflation exists in the internal medicine subinternship. Faculty development and further analysis of our current subinternship evaluation and grading system may help to minimize this problem.     

Effectiveness of a Clinical Intervention for MD/PhD Students Re-entering Medical School

Background and Purpose: For MD/PhD students, the transition to medical school following graduate research can be difficult. We developed a clinical intervention, the Clinical Preceptorship Program (CPP), for MD/PhD students at Vanderbilt to ease the transition to the core clinical clerkship year (the 3rd medical year) following graduate training. In this study, we determined whether the CPP prepared MD/PhD students adequately for medical school reentry. Methods: Clerkship grades were obtained for 680 medical students and 50 MD/PhD students for academic years 2004–2010. A student's unpaired t test was used to analyze differences between group grades. Results: We did not detect significant differences in the grades of the MD versus MD/PhD students. No differences in individual clerkships were detected with the exception of the Surgery clerkship. Conclusions: These data suggest that the CPP intervention was successful in preparing MD/PhD students for the core clerkship year. Such a clinical intervention can be an effective preparation for MD/PhD students returning to medical school.     

Beyond the Ivory Tower: A Comparison of Grades Across Academic and Community OB/GYN Clerkship Sites

Construct: Decentralized clinical education is the use of community facilities and community physicians to educate medical students. The theory behind decentralized clinical education is that academic and community sites will provide educational equivalency as determined by objective and subjective performance measures, while training more medical students and exposing students to rural or underserved communities. One of the major challenges of decentralized clinical education is ensuring site comparability in both learning opportunities and evaluation of students. Background: Previous research has examined objective measures of student performance, but less is known about subjective performance measures, particularly in the field of obstetrics and gynecology (OB/GYN). This study explores the implications of clinical site on the adequacy of subjective and objective performance measures. Approach: This was a retrospective cohort study of 801 students in the University of Washington School of Medicine OB/GYN clerkship from 2008 to 2012. Academic sites included those with OB/GYN residency programs (n = 2) and community sites included those without residency programs (n = 29). The association between clerkship site and National Board of Medical Examiners (NBME) grade was assessed using linear regression and clinical and final grade using multinomial regression, estimating β coefficient and relative risks (RR), respectively, and 95% confidence intervals (CIs), adjusting for gender, academic quarter of clerkship, and year of clerkship. Results: There were no differences in NBME exam grades of students at academic sites (76.4 (7.3) versus 74.6 (8.0), β = –0.11, 95% CI [1.35, 1.12] compared to community sites. For clinical grade, students at community sites were 2.4 times more likely to receive honors relative to high pass (RR 2.45), 95% CI [1.72, 3.50], and for final grade, students at community sites were 1.9 times more likely to receive honors relative to pass (RR 1.98), 95% CI [1.27, 3.09], and 1.6 times more likely to receive honors relative to high pass (RR 1.62), 95% CI [1.05, 2.50], compared to those at academic sites. Conclusions: Students at community sites receive higher clinical and final grades in the OB/GYN clerkship. This highlights a significant challenge in decentralized clinical education—ensuring site comparability in clinical grading, Further work should examine the differences in sites, as well as improve standardization of clinical grading. This also underscores an important consideration, as the final grade can influence medical school rank, nomination into honor societies, and ranking of residency applicants.     

Internal Medicine Core Clerkships Experience With Core Problem Lists: Results From a National Survey of Clerkship Directors in Internal Medicine

Background: The Liaison Committee on Medical Education (LCME) requires clinical clerkships in North American Medical Schools to define and monitor core problems and clinical conditions for medical students and adjust the clerkships to ensure that all students meet those objectives at all instructional sites. Clinical clerkships usually use medical student generated logbooks to meet these requirements. It is not clear what clinical clerkship directors are doing to meet these standards. Purpose: To determine how internal medicine clerkship directors develop problem lists, whether and how they verify student problem list entry, and how missed core problems are covered. Methods: The Clerkship Directors in Internal Medicine (CDIM) organization conducts an annual survey of its institutional members (one member per medical school). In 2007, 75% of North American medical schools (82 of 110) responded to the survey, which included questions on core problem lists and medical student logbooks. Results: Ninety-four percent of responding medical schools had a core problem list for the core internal medicine clerkship. Most schools used an electronic logbook and verified student exposure to core problems (76%). The clerkship director usually did the verification (63%). Clerkships offered a variety of options to remedy lack of exposure to core problems and usually offered more than one option. Conclusions: Clerkship directors in internal medicine develop, verify, and ensure exposure to core problems in internal medicine. Most clerkship directors used the CDIM recommended core problem list as a basis for their local core problem list. Emerging computer-assisted learning options may simplify clerkship adjustments for lack of exposure to core problems. It appears that clerkship directors are using logbooks appropriately to meet the LCME charge to monitor core problems and clinical conditions.     

Alignment of Ethics Curricula in Medical Education: A Student Perspective

Abstract

Issue: Although there is consensus on the importance of including ethics in the medical school curriculum, there is wide variation in how this topic is taught. Recent literature also questions the effectiveness of current ethical teaching methods in changing student attitudes and future behavior. Furthermore, from the student perspective, there is a marked disconnect between the stated importance of and lack of effort in ethics courses. Evidence: Applying a student perspective of the hidden curriculum, as well as reviewing and applying insight from the available literature, we advocate for alignment of instructional design, content, and assessments. This article provides specific recommendations to increase student engagement in ethics courses and concludes by discussing whether a lack of engagement is attributable to intrinsic qualities of medical students in addition to pedagogical technique and educational setting and culture. Implications: This article has practical suggestions for medical educators to improve their ethics courses, leading to more well-rounded and thoughtful physicians.     

Positive Outcomes of Optimizing Student–Preceptor Continuity in a Traditional Block Clerkship

Problem: Student–preceptor discontinuity during 3rd-year clerkships limits the quality and quantity of supervision, teaching, and feedback. Although longitudinal integrative clerkships increase continuity and are associated with improved student and preceptor experience, they require schoolwide curricular reform. Alternative innovations enhancing student–preceptor relationships within the constraints of a traditional block clerkship may demonstrate similar benefits. Intervention: We piloted a continuity-enhanced general pediatric ambulatory schedule during 2 consecutive clerkship blocks in 2013. Students in the continuity-enhanced model (n = 29) were assigned 1–3 primary clinic preceptors, whereas those in the traditional model (n = 30) worked with 5–8. Data were gathered from student assessments and anonymous student and preceptor surveys. We used t and Fisher's exact tests to compare the two groups and performed thematic analysis of free-text survey comments. Context: Our school utilizes a block clerkship model with approximately 30 students rotating through the pediatric clerkship every 8 weeks. During the 3-week ambulatory portion, students spend 8 half days in the general pediatric ambulatory clinic. At the conclusion of each clinic, attendings completed brief student evaluation cards. Traditionally, student and attending schedules were created independently, resulting in transient supervisory relationships and dissatisfaction with clinical engagement, feedback, and evaluation. Outcome: Seventy-three percent (43/59) of the students completed the survey. Ten general ambulatory attendings collectively completed 87.5% (35/40) of the monthly surveys. Continuity students received significantly more narrative evaluation comments (10.6 vs. 5.8, p <. 001) from general ambulatory clinic attendings and were more likely to have at least one general ambulatory clinic attending endorse being able to provide meaningful feedback and evaluation (n = 29, 100% vs. n = 20, 66.7%, p <. 001). Continuity students were also more likely to endorse being able to ask at least one of these attendings for a letter of recommendation (71.4% vs. 9.1%, p <. 001) and to have at least one general ambulatory clinic attending endorse being able to provide a meaningful letter of recommendation if asked (62.1% vs. 3.3%, p <. 001). Students (88.4%) and attendings (85.7%) preferred the continuity-enhanced schedule. The most frequent theme of both student and attending free-text survey remarks were relationships and assessment. Lessons Learned: Intentional scheduling of clerkship students to enhance preceptor continuity resulted in significant positive outcomes echoing the relationship-based educational benefits of longitudinal clerkships, particularly in regards to student assessment and feedback. Clerkship directors and other medical educators should consider implementing small changes within block clerkships to maximize student–preceptor continuity.     

Understanding Clerkship Student Roles in the Context of 21st-Century Healthcare Systems and Curricular Reform

ABSTRACT

Phenomenon: Preclerkship medical education has undergone extensive reform, and the clerkship years are growing targets for curricular innovation. As institutions implement new preclerkship curricula to better prepare medical students to practice medicine in the context of modern healthcare systems, the perspective of clerkship leaders regarding clerkship student roles and potential for change will facilitate redefining these roles so that preclerkship educational innovations can continue into clerkships. Approach: In this qualitative exploratory study, authors conducted semistructured interviews with clerkship and site directors for eight core clerkships from April to May 2016. Questions addressed how clerkship leaders perceive current student roles and the potential for change. Through iterative consensus building, authors identified themes describing current ideal clerkship student roles applicable to future roles. Findings: Twenty-three of 24 (96%) directors participated. Findings fell into four themes: factors influencing the clerkship role, clerkship student role archetypes, workplace authenticity and value, and potential for change. Student, supervisor, and context factors determine the clerkship student role. Three role archetypes emerged: the apprentice (an assistant completing concrete patient care tasks), the academic (a researcher bringing literature back to the team), and the communicator (an interdisciplinary and patient liaison). Each archetype was considered authentic and valuable. Positive attitudes toward preclerkship curricular changes were associated with openness to evolution of the clerkship students' role. These emerging roles mapped to the archetypes. Insights: Clerkship leaders perceive that student, supervisor, and context factors result in varying emphasis on role archetypes, which in turn lead to different types of learning. Medical educators can use the archetypes to articulate how expanded student roles align learning with clinical needs, particularly as they relate to health systems science and inquiry.     

Relationships Matter: Enhancing Trainee Development with a (Simple) Clerkship Curriculum Reform

Problem: The traditional clerkship model of brief encounters between faculty and students results in reduced meaningful learning opportunities due to the lack of a relationship that enables repeated observation, supervisor feedback, trust formation, and growth. Intervention: Clinical clerkships at our institution were restructured to decrease fragmentation of supervision and foster an educational alliance between faculty and student. A mixed-methods approach was used to study the impact of this curriculum reform on the student experience in the obstetrics and gynecology clerkship. Student participation in patient care was assessed by comparing the number of common obstetric procedures performed before and after clerkship reform. Separate qualitative analyses of comments from student surveys and a faculty focus group revealed themes impacting student involvement. The supervisor–trainee relationship was further investigated by analysis of “rich picture” discussions with students and faculty. Context: Clerkships in the 3rd year of our 4-year undergraduate medical curriculum were converted from an experience fragmented by both didactic activities and multiple faculty supervisors to one with a single supervisor and the elimination of competing activities. Outcomes: Students in the revised clerkship performed twice the number of obstetric procedures. Objective measures (United States Medical Licensing Examination Step 1 scores, receiving clerkship honors, self-reported interest in obstetrics, and gender) did not correlate with the number of procedures performed by students. Qualitative analysis of student survey comments revealed that procedure numbers were influenced by being proactive, having a supervisor with a propensity to teach (trust), and contextual factors (busy service or competition with other learners). Themes identified by faculty that influenced student participation included relationship continuity; growth of patient care skills; and observed student engagement, interest, and confidence. The quality of the relationship was cited by both students and faculty as a factor influencing meaningful clinical participation. Discussions of “rich pictures” drawn by students and faculty revealed that relationships are influenced by continuity, early alignment of goals, and the engagement and attitude of both student and faculty. Lessons Learned: Clinical curricular reforms that strengthen the continuity of the supervisor–trainee relationship promote mutual trust and can result in a more meaningful training experience in less time. Reciprocal engagement and early alignment of goals between supervisor and trainee are critical for creating a positive relationship.     

A Better Norm-Referenced Grading Using the Standard Deviation Criterion

Background: The commonly used norm-referenced grading assigns grades to rank-ordered students in fixed percentiles. It has the disadvantage of ignoring the actual distance of scores among students. Purposes: A simple norm-referenced grading via standard deviation is suggested for routine educational grading. Methods: The number of standard deviation of a student's score from the class mean was used as the common yardstick to measure achievement level. Cumulative probability of a normal distribution was referenced to help decide the amount of students included within a grade. Results of the foremost 12 students from a medical examination were used for illustrating this grading method. Results: Grading by standard deviation seemed to produce better cutoffs in allocating an appropriate grade to students more according to their differential achievements and had less chance in creating arbitrary cutoffs in between two similarly scored students than grading by fixed percentile. Conclusions: Grading by standard deviation has more advantages and is more flexible than grading by fixed percentile for norm-referenced grading.     

Mobile Technology for the Facilitation of Direct Observation and Assessment of Student Performance

Background: We developed, implemented, and assessed a web-based clinical evaluation application (i.e., CEX app) for Internet-enabled mobile devices, including mobile phones. The app displays problem-specific checklists that correspond to training problems created by the Clerkship Directors in Internal Medicine. Purpose: We hypothesized that use of the CEX app for directly observing students’ clinical skills would be feasible and acceptable, and would demonstrate adequate reliability and validity. Methods: Between July 2010 and February 2012, 266 third-year medical students completed 5 to 10 formative CEXs during their internal medicine clerkship. The observers (attendings and residents), who performed the CEX, used the app to guide and document their observations, record their time observing and giving feedback to the students, and their overall satisfaction with the CEX app. Interrater reliability and validity were assessed with 17 observers who viewed 6 videotaped student–patient encounters, and by measuring the correlation between student CEX scores and their scores on subsequent standardized-patient Objective Structured Clinical Examination (OSCE) exams. Results: A total of 2,523 CEXs were completed by 411 observers. The average number of evaluations per student was 9.8 (± 1.8 SD), and the average number of CEXs completed per observer was 6 (± 11.8 SD). Observers spent less than 10 min on 45.3% of the CEXs and 68.6% of the feedback sessions. An overwhelming majority of observers (90.6%) reported satisfaction with the CEX. Interrater reliability was measured at 0.69 among the observers viewing the videotapes, and their ratings discriminated between competent and noncompetent performances. Student CEX grades, however, did not correlate with their end of 3rd-year OSCE scores. Conclusions: The use of this CEX app is feasible and it captures students’ clinical performance data with a high rate of user satisfaction. Our embedded checklists had adequate interrater reliability and concurrent validity. The grades measured on this app, however, were not predictive of subsequent student performance.     

Adaptation of Medical Students During Clinical Training: Effects of Holistic Preclinical Education on Clerkship Performance

Theory: Taiwan’s medical undergraduate program at a university or medical center is a continuation of 12?years of compulsory citizenship education rooted in holistic philosophies. Students acquire both technical knowledge and nontechnical attributes, which are necessary for success in further work and life. The early clinical learning experiences of medical students are primarily acquired through clerkships. These clerkships require medical students to apply and extend what they learned during their preclinical education; however, previous studies have explored this issue through examining fragmentary factors such as preclinical course grades and traits but not undertaking comprehensive, whole-person investigations. Hypotheses: To account for the potential benefits of a holistic approach in medical students’ learning, we propose three hypotheses: Medical students’ preclinical performance on Taiwan’s technical and nontechnical higher education assessments are positively associated with their clinical competence (Hypothesis 1) and psychological well-being (Hypothesis 2) during clerkships, and medical students’ psychological well-being during clerkships is positively associated with their clinical competence (Hypothesis 3). Method: We studied a cohort of 65 medical students engaged in clerkships from September 2013 to April 2015. Their preclinical technical knowledge scores—formal curricular grades received from course instructors—were obtained from their medical school’s archival dataset. Their nontechnical attributes—moral and social performance scores received from student mentors and physical performance scores received from course instructors—were also obtained from the school’s archival data set. The medical students’ competence in their 2-year clinical clerkships was measured using the objective structured clinical examination scores from the end of both clerkship years. The medical students’ psychological well-being during their 2-year clerkships was measured according to burnout level, which was determined using routine online surveys that employed validated, structured, and self-administered questionnaires at each specialty rotation. Multiple regressions and linear mixed-effects model were employed for statistical analysis. Results: Our study revealed that higher preclinical technical knowledge predicted superior clinical competence and a higher level of burnout during clerkships. By contrast, higher preclinical nontechnical attributes (i.e., higher preclinical moral, social, and physical performance) predicted lower level of burnout. However, no relationship was discovered between clerkship burnout and the clinical competence of the medical students. Conclusions: Our study verified the value of a holistic education that encompasses both technical knowledge and nontechnical attributes during the preclinical learning stage for medical students. Our findings can serve as a reference for medical educators designing preclinical educational programs for medical students.     

Medical Student Perspectives of Active Learning: A Focus Group Study

Phenomenon: Medical student perspectives were sought about active learning, including concerns, challenges, perceived advantages and disadvantages, and appropriate role in the educational process. Approach: Focus groups were conducted with students from all years and campuses of a large U.S. state medical school. Findings: Students had considerable experience with active learning prior to medical school and conveyed accurate understanding of the concept and its major strategies. They appreciated the potential of active learning to deepen and broaden learning and its value for long-term professional development but had significant concerns about the efficiency of the process, the clarity of expectations provided, and the importance of receiving preparatory materials. Most significantly, active learning experiences were perceived as disconnected from grading and even as impeding preparation for school and national examinations. Insights: Medical students understand the concepts of active learning and have considerable experience in several formats prior to medical school. They are generally supportive of active learning concepts but frustrated by perceived inefficiencies and lack of contribution to the urgencies of achieving optimal grades and passing United States Medical Licensing Examinations, especially Step 1.     

Accuracy of Medical Student Electronic Logbook Problem List Entry

Background: The accuracy of medical student logbooks has not been extensively studied.

Purpose: The purpose of this study was to determine accuracy of student entry of core problems and completeness of patient entry in an electronic logbook.

Methods: Third-year internal medicine clerkship students entered patient encounters as required by the clerkship. Experts entered information from the same encounters.

Results: A total of 1,440 patient entries generated by 37 consecutive students were compared to expert entries. Sensitivity (core problem underreporting) was low (60%, SD = 22%). Percent agreement (87%, SD = 7%), kappa (0.46, SD = 0.19), and specificity (core problem overreporting; 95%, SD = 5%) were good to excellent. Students both omitted (underreported 14%, SD = 12%) and overreported (23%, sd 17%) patients.

Conclusions: Under ideal study circumstances, there was significant underreporting of core problems by students. Although the high specificity, meaning that students are not reporting problems they have not encountered, is reassuring, logbook sensitivity in this study was not good enough for high-stakes evaluations of students or for medical school licensing.     

Informed consent for blood transfusion as a transfusion medicine educational intervention

SUMMARY. The aim here was to determine the effectiveness of a transfusion medicine educational intervention in a medicine core clerkship program.
Third-year medical students enrolled in their medicine core clerkship rotations at tertiary care hospitals affiliated with our institution underwent a two-part educational intervention that incorporated a transfusion medicine curriculum within the context of the medicolegal, ethical and educational elements of informed consent. Part one was a 1-h didactic session on standards of practice for red blood cell transfusion. Part two was a 90-min multidisciplinary workshop on informed consent. The effectiveness of the educational intervention was analysed by an objective structured clinical evaluation.
The student group receiving the educational intervention scored significantly higher than in the comparison group (65.8 ± 9.2 vs. 54.1 ± 10.56, P <0.001). When student scores were used to determine changes in student response patterns over time, the largest change occurred in identifying possible other options to allogeneic blood transfusion.
These results suggest that a transfusion medicine curriculum using an informed consent model can be used effectively as an educational intervention in a medicine core clerkship programme.     

Grade Inflation in Internal Medicine Clerkships: Results of a National Survey

Background: There has been a discussion among medical educators concerning grade inflation; however, little has been written about it in the medical education literature. Purpose: A survey was developed to determine if grade inflation exists by gathering data about grading practices and by gathering the opinions of course directors from Internal Medicine clerkships. Methods: The survey was administered during the 1996-1997 academic year to all 125 LCME accredited medical school Internal Medicine Clerkship Directors. Grading practices for 3 separate academic years were obtained plus responses to questions about causes of and solutions for grade inflation. Results: Eighty-three surveys were returned for a 66% response rate. There was a trend towards higher grades across the 3 study years, with the 1995-1996 year being statistically significant. Forty-eight percent of the clerkship directors felt that grade inflation existed in their courses, and 43% felt that some students passed who should have failed. Conclusion: Statistically significant grade inflation exists in Internal Medicine clerkships. Most disturbingly, 43% feel we are unable appropriately to identify incompetent students.     

An Educator''s Guide to Teaching Emergency Medicine to Medical Students

There is a need for every medical school graduate to handle emergencies as they arise in the daily practice of medicine. Emergency medicine (EM) educators are in a unique position to provide students with basic life support skills, guidance in assessing the undifferentiated patient, and exposure to the specialty of EM during all years of medical school. Emergency physicians can become involved in a variety of education experiences that can supplement the preclinical curriculum and provide access to our specialty at an early stage. A well-designed course in the senior year allows students to develop critical thinking and patient management skills that are necessary for any medical career path. It can ensure that all medical students are exposed to the skills essential for evaluating and stabilizing the acutely ill patient. To implement this type of course, learning objectives and evaluation methods must be set when the curriculum is developed. An effective course combines didactic and clinical components that draw on the strengths of the teaching institution and faculty of the department. A structured clerkship orientation session and system for feedback to students are essential in nurturing the development of student learners. This article provides an approach to assist the medical student clerkship director in planning and implementing EM education experiences for students at all levels of training, with an emphasis on the senior-year rotation.