What do medicine clerkship preceptors do best?

PURPOSE: Students' ratings of preceptors are widely used in medical education for feedback and evaluation purposes. The present study investigated students' ratings of the clinical teaching skills of inpatient attending physicians, inpatient residents, and outpatient attending physicians to assess differences among types of preceptors and relative strengths and weaknesses. METHOD: A total of 268 students from three academic years (1997-2000) at one medical school rated preceptors on an end-of-clerkship evaluation, for a total of 1,680 ratings. When the ratings were aggregated by preceptors' names and types, there were 691 mean ratings of preceptors. Relative strengths and weaknesses were identified. Differences in mean ratings by preceptor type (inpatient attending physician, inpatient resident, and outpatient attending physician) were evaluated, and strengths and weaknesses were identified by rank ordering the items' means. RESULTS: Students tended to rate outpatient attending physicians higher than inpatient attending physicians or residents. Areas where ratings suggested relative strengths included showing an interest in teaching, respecting students' opinions, and being available to students. Areas of relative weakness included increasing physical examination and interviewing skills. CONCLUSIONS: Students' ratings are useful for identifying strengths and weakness for groups of preceptors and, as such, are important sources of information for setting priorities for faculty development efforts.     

Enhancing clinical skills education: University of Virginia School of Medicine's Clerkship Clinical Skills Workshop Program.

In 1993, the University of Virginia School of Medicine began a clinical skills workshop program in an effort to improve the preparation of all clerkship students to participate in clinical care. This program involved the teaching of selected basic clinical skills by interested faculty to small groups of third-year medical students. Over the past 14 years, the number of workshops has increased from 11 to 31, and they now involve clerkship faculty from family medicine, internal medicine, and pediatrics. Workshops include a variety of common skills from the communication, physical examination, and clinical test and procedure domains such as pediatric phone triage, shoulder examination, ECG interpretation, and suturing. Workshop sessions allow students to practice skills on each other, with standardized patients, or with models, with the goal of improving competence and confidence in the performance of basic clinical skills. Students receive direct feedback from faculty on their skill performance. The style and content of these workshops are guided by an explicit set of educational criteria.A formal evaluation process ensures that faculty receive regular feedback from student evaluation comments so that adherence to workshop criteria is continuously reinforced. Student evaluations confirm that these workshops meet their skill-learning needs. Preliminary outcome measures suggest that workshop teaching can be linked to student assessment data and may improve students' skill performance. This program represents a work-in-progress toward the goal of providing a more comprehensive and developmental clinical skills curriculum in the school of medicine.     

Early clinical experience enhances third-year pediatrics clerkship performance.

PURPOSE: To determine whether clinical experiences in the preclinical years improve medical students' performances in a third-year clerkship. METHOD: A cohort study reviewed the pediatrics clerkship performances of 400 Eastern Virginia Medical School students in the graduating classes of 1996 through 1999. The first two classes completed a traditional preclinical curriculum with limited clinical experience. The final two classes participated in a mentorship program that provided 18 months of early clinical experience, consisting of one-on-one half-day sessions every other week with a generalist community faculty. The authors compared the clinical clerkship performances of the groups using clinical skills (CS) scores, history and physical examination (H&P) scores, and scores on the NBME pediatrics shelf examination. They also looked at the mean MCAT and USMLE scores for each group. The authors also looked at the scores within each class, comparing students who completed one of the first two pediatrics clerkship rotations with their classmates who completed clerkships later in the academic year. RESULTS: The students' NBME scores rose significantly (p < .05, r2 = 0.95) over the four-year study, paralleling a significant rise in MCAT scores (p < .03, r2 = 0.73). The CS and H&P scores did not rise. Students who had the traditional preclinical curriculum and who completed their clerkships early in the year had significantly lower CS and H&P scores than did their classmates. In contrast, the scores of students who had the early clinical experiences did not differ significantly according to the timing of their rotation. CONCLUSION: Students who had participated in a mentorship program that provided early clinical experience demonstrated significantly improved clinical skills in the pediatrics clerkship early in the academic year.     

Medical students' perceptions of their housestaffs' ability to teach physical examination skills.

PURPOSE: To evaluate the amount of time housestaff spent at the bedside on physical examination skills with third-year medical students and whether housestaff enhanced physical examination skills. METHOD: All Albert Einstein College of Medicine students who completed the third-year medicine inpatient clerkship at one of five participating sites evaluated housestaff (interns and residents) with whom they spent at least ten days. The students quantified the amount of time housestaff spent with them at the bedside and used a modified five-point Likert scale to evaluate housestaff's enhancement of students' physical examination skills. Data were analyzed separately for interns, but pooled for residents (years two and three). Differences between groups were tested using Wilcoxon rank-sum and by Mantel-Haenszel chi-square tests. RESULTS: Totals of 191 responses for interns and 166 responses for residents were collected from October 1999 to October 2000. Fifteen (8%) of the intern group and 59 (36%) of the resident group spent no time at the bedside (p <.0001). Students were most satisfied with enhancement of pulmonary, cardiovascular, and gastrointestinal skills and least satisfied with enhancement of ENT, eye, and genitourinary skills (p <.0001). CONCLUSIONS: Interns spent more time with students than did residents. Almost one third of the residents spent no time on physical examination skills with students. Training programs should re-emphasize the importance of housestaff's teaching at the bedside and address areas of deficiency.     

Medical student evaluation of the quality of hospitalist and nonhospitalist teaching faculty on inpatient medicine rotations.

PURPOSE: To evaluate the impact of academic hospitalists on third-year medical students during inpatient medicine rotations. METHOD: The authors conducted a retrospective quantitative assessment of medical student evaluations of hospitalist and nonhospitalist Department of Medicine faculty at Oregon Health & Science University, for the 1998-00 academic years. Using a nine-point Likert-type scale, students evaluated the faculty on the following characteristics: communication of rotation goals, establishing a favorable learning climate, use of educational time, teaching style, evaluation and feedback, contributions to the student's growth and development, and overall effectiveness as a clinical teacher. RESULTS: A total of 138 students rotated on the university wards during the study period; 100 with hospitalists, and 38 with nonhospitalists. Of these students, 99 (71.7%) returned evaluations. The hospitalists received higher numeric evaluations for all individual attending characteristics. Significance was achieved comparing communication of goals (p =.011), effectiveness as a clinical teacher (p =.016), and for the combined analysis of all parameters (p <.001). Despite lack of achieving statistical significance, there was a trend toward hospitalists being more likely to contribute to the medical student's perception of growth and development during the period evaluated (p =.065). CONCLUSIONS: In addition to performing the responsibilities required of full-time hospital-based physicians, hospitalists were able to provide at least as positive an educational experience as did highly rated nonhospitalist teaching faculty and in some areas performed better. A hospitalist model can be an effective method of delivering inpatient education to medical students.     

A student-centered, problem-based surgery clerkship

In the academic year 1989-90, the department of surgery at one college of medicine revised its third-year clerkship to focus on students' learning decision-making skills and critical thinking (cognitive skills) and acquiring knowledge about surgery. Learning to perform procedures and tasks (psychomotor skills) would be accomplished in the required fourth-year acting internships. Problem-based learning (PBL) was chosen as the clerkship's primary instructional method. Comprehensive student and program evaluation systems were established. The response by faculty and students has been very positive. Students believe that the new clerkship has helped them increase their abilities in resource use, time management, and retention of knowledge. Faculty have noted students' increased eagerness and enthusiasm for learning.     

A communication assessment and skill-building exercise (CASE) for first-year residents.

OBJECTIVE: Good communication skills are essential for residents entering postgraduate education programs. However, these skills vary widely among medical school graduates. This pilot program was designed to create opportunities for (1) teaching essential interviewing and communication skills to trainees at the beginning of residency, (2) assessing resident skills and confidence with specific types of interview situations, (3) developing faculty teaching and assessment skills, (4) encouraging collegial interaction between faculty and new trainees, and (5) guiding residency curricular development. DESCRIPTION: During residency orientation, all first-year internal medicine residents (n = 26) at the University of Minnesota participated in the communication assessment and skill-building exercise (CASE). CASE consisted of four ten-minute stations in which residents demonstrated their communication skills in encounters with standardized patients (SPs) while faculty members observed for specific skills. Faculty and SPs were oriented to the educational purposes and goals of their stations, and received instructions on methods of providing feedback to residents. With each station, residents were provided one and a half minutes of direct feedback by the faculty observer and the SP. The residents were asked to deal with an angry family member, to counsel for smoking cessation, to set a patient-encounter agenda, and to deliver bad news. A resident's performance was analyzed for each station, and individual profiles were created. All residents and faculty completed evaluations of the exercise, assessing the benefits and areas for improvement. DISCUSSION: Evaluations and feedback from residents and faculty showed that most of our objectives were accomplished. Residents reported learning important skills, receiving valuable feedback, and increasing their confidence in dealing with certain types of stressful communication situations in residency. The activity was also perceived as an excellent way to meet and interact with faculty. Evaluators found the experience rewarding, an effective method for assessing and teaching clinical skills, a faculty development experience for themselves in learning about structured practical skills exercises, and a good way to meet new interns. The residency program director found individual resident performance profiles valuable for identifying learning issues and for guiding curricular development. Time constraints were the most frequently cited area for improvement. The exercise became feasible by collaborating with the medical school Office of Education-Educational Development and Research, whose mission is to collaborate with faculty across the continuum of medical education to improve the quality of instruction and evaluation. The residency program saved considerable time, effort, and expense by using portions of the medical school's existing student skills-assessment programs and by using chief residents and faculty as evaluators. We plan to use CASE next year with a wider variety of physician-patient scenarios for interns, and to expand the program to include beginning second- and third-year residents. Also, since this type of exercise creates powerful feedback and assessment opportunities for instructors and course directors, and because feedback was so favorable from evaluators, we will encourage participation in CASE as part of our faculty educational development program.     

Part-time residency training in internal medicine: analysis of a ten-year experience.

PURPOSE: To evaluate a ten-year experience (1983-1993) with a part-time residency curriculum. METHOD: In 1994, the authors analyzed the curriculum through interviews with graduates of a part-time residency track, surveys of faculty and graduates of a full-time residency program, and a quantitative comparison of faculty evaluations of those part-time and full-time residents. RESULTS: Both participants and full-time residents supported the part-time track and reported no adverse effect on the residency program as a whole. Analysis of faculty evaluations found that part-time residents scored significantly higher with respect to clinical skills (p = .0005) and humanistic skills (p = .0001), while there was no difference between the groups in leadership or teaching skills. CONCLUSIONS: This part-time residency curriculum provided a highly useful program track for a group of internal medicine residents with concomitant obligations, allowing them to complete their training in an uninterrupted fashion. The part-time structure did not adversely affect clinical competence and may have fostered humanistic attributes. The authors believe that this form of curriculum deserves wider consideration in residency training.     

The psychiatric rotation: Traditional inpatient or consultation clerkship?

Thirty-nine medical students on a junior clinical clerkship in consultation psychiatry were compared with 21 students on a more traditional inpatient clerkship for changes in formal psychiatric knowledge, interest in psychiatry, self-rated psychiatry skills, and attitudes about psychiatry. Both groups showed comparable increases in objective knowledge and increased comfort with psychiatric patients. Minor but no fundamental differences between the two groups were ascertained by objective testing. The findings support the observation that students on a consultation clerkship can learn clinical psychiatry as well as those on traditional inpatient clerkships.     

Development and implementation of an innovative ward-based program to help medical students acquire end-of-life care experience.

The authors developed and implemented a new ward-based end-of-life care experience for third-year medical students at Yale University School of Medicine, which began on a pilot basis in 2005. The primary objectives of the program, which still continues, are to improve students' comfort and skills in communicating with and assessing patients facing the end of life and to reflect on their experiences. Students interview a hospitalized patient, family, and caregivers; assess specified end-of-life domains and management plans; reflect on the experience; and then prepare a report for presentation at a case conference facilitated by dedicated multidisciplinary faculty. Many students interview patients while rotating on psychiatry consults, and the case conference occurs during the psychiatry clerkship. A total of 45 students in the pilot year (2005), 76 students in the following year, and 48 thus far in the current year have completed the program. An assessment of the personal impact of the exercise on the students who completed the program in 2005 and 2006 revealed six themes, including students' recognition of the complexity of patients' reactions to dying, students' appreciation of the value of the clinicians' presence, and students' personal reflections. This experience suggests that a hands-on end-of-life exercise is feasible and will be well received in the acute inpatient setting. Key features for success include separate, dedicated faculty for the case conference (which is integrated into a single clerkship), emphasis on student self-reflection, and a requirement that the written component become part of the student's portfolio.     

Direct observation of students during clerkship rotations: a multiyear descriptive study.

PURPOSE: To determine how often students report that they are observed while performing physical examinations and taking histories during clerkship rotations. METHOD: From 1999-2001, 397 students at the University of Virginia School of Medicine were asked at the end of their third year to report the number of times they had been observed by a resident or faculty member while taking histories and performing physical examinations on six rotations. RESULTS: Three hundred and forty-five students (87%) returned the survey instrument; of these, 322 (81%) returned instruments with complete information. On average, the majority reported that they had never been observed by a faculty member while taking a history (51%), performing a focused physical examination (54%), or a complete physical examination (81%). The majority (60%) reported that they had never been observed by a resident while performing a complete physical examination. Faculty observations occurred most frequently during the four-week family medicine rotation and least frequently during the 12-week surgery rotation. The length of the clerkship rotation was inversely related to the number of reported observations, chi(2) (5, n = 295) = 127.85, p <.000. CONCLUSIONS: Although alternative assessments of clinical skills are becoming more common in medical education, faculty ratings based on direct observation are still prominent. The data in this study reflect that these observations may actually be occurring quite infrequently, if at all. Decreasing the evaluative weight of faculty and resident ratings during the clerkship rotation may be necessary. Otherwise, efforts should be made to increase the validity of these ratings.     

Third-year medical students' perceptions of effective teaching behaviors in a multidisciplinary ambulatory clerkship.

PURPOSE: The authors sought third-year medical students' perceptions of ambulatory preceptors' teaching effectiveness across primary care disciplines. METHODS: Third-year students at the University of Pittsburgh School of Medicine spent three-week rotations each in ambulatory internal medicine, pediatrics, family medicine, and an elective. After the 12-week clerkship, students anonymously evaluated the full-time and volunteer preceptors using a five-point Likert-type evaluation (1 = hardly at all; 5 = to a great degree) that had eight items addressing preceptor teaching behaviors, six items on attaining clerkship goals and an assessment of overall teaching effectiveness, the outcome variable of interest. RESULTS: The authors analyzed 276 evaluation forms (58% response rate) collected from July 2001 to June 2002. They found a mean effectiveness rating of 4.4 (SD.9) and no differences between genders, specialties, and faculty appointment types (p >.2 for each). The 14 items were associated with teaching effectiveness in univariate analysis (p <.01 for each). In multivariate analyses, effectiveness was associated with four preceptor behaviors: inspired confidence in medical skills, explained decisions, treated students with respect, and provided a role model (R(2) =.33). Effectiveness was associated with three items about attaining clerkship goals: allowed opportunity for improving clinical skills, practiced ethical medicine, and encouraged evidence-based medicine (R(2) =.20). CONCLUSIONS: Several teaching behaviors and measures of attaining clerkship goals influenced students' perceptions of teaching effectiveness. Involving students in a humanistic but rigorous approach to medicine and being a physician students wanted to emulate seem particularly important. These aspects appear potentially amenable to faculty development efforts.     

Positive effects of a clinical performance assessment program

Since 1986, there has been a clinical performance assessment program for fourth-year students at the University of Massachusetts Medical School. Students interact with several standardized patients (SPs) and complete other tasks such as interpretation of electrocardiograms and interpretation of X-rays. Scores are generated both by checklists and rating forms completed by the SPs and by paperwork completed by the students at the end of each encounter. Since 1986, students have been asked how frequently they have been observed by faculty and residents as they interacted with actual patients; the students report that such observations have markedly increased. Since 1989, there has been increased feedback to students by the attending faculty during and following clinical rotations. Although it is difficult to claim cause and effect, it is clear that since the inception of this exercise, the faculty have made a conscious effort to improve students' clinical skills by providing increased observation and feedback.     

Training medical students in community health: a novel required fourth-year clerkship at the University of Rochester.

In 2004, community health became the fourth mission of the University of Rochester Medical Center, along with education, clinical care, and research. In that same year, a novel clerkship was added to the fourth-year curriculum that focuses on the "practice" of community health and preventive medicine. The goal is to offer intensive experiential training to develop skills in community health improvement by partnering with community agencies involved in health promotion and disease prevention. The learning objectives addressed include community health assessment, risk behavior change, assurance of personal health services, advocacy and policy change, environmental interventions, community organization and partnership building, and program evaluation. The clerkship involves three full days of didactic instruction at the beginning of a four-week period of program development and implementation. Each student chooses a project that focuses on a specific target population, then designs it and incorporates public health knowledge, skills, and attitudes learned during the didactic component. Course directors then mentor students during project implementation. Students can begin "longitudinal" experiences in their first or second years to fold into the required clerkship. Innovations include a novel Advocacy and Policy Change module, a highly rated Cultural Determinants of Health lecture, and a resource-based course Web site. The clerkship was initially offered as an elective, and it has since become a required course. In the clerkship to date, 340 students have launched hundreds of community-level interventions within various settings locally, nationally, and internationally. Evaluation efforts to date indicate that the clerkship has been received favorably by both faculty and students.     

Palliative care module within a required geriatrics clerkship: taking advantage of existing partnerships.

OBJECTIVE: LCME has recently required that all graduating medical students learn about end-of-life care. This program describes the design and integration into an existing geriatrics clerkship of a palliative care module that teaches the foundations of end-of-life and palliative care to medical students. DESCRIPTION: Faculty experts in geriatrics met during a series of weekly meetings in 1999 to design a mandatory four-week-long clinical clerkship in geriatrics. Since the palliative care program is based within the geriatrics department, faculty members with interest and expertise in both geriatrics and palliative care were invited to design a palliative care module that can be integrated into the clerkship. Since LCME does not specify details of what students must learn about end-of-life care, and our goal is to educate and prepare students for any chosen specialty, we wanted to design a basic core curriculum in palliative care that would be useful to any graduating student. After reviewing potential palliative care topics, and given limited curriculum time, we condensed the medical student core curriculum to the following sessions: (1) Systematic Pain Assessment Management, (2) Management of Distressing Symptoms, (3) Communicating Bad News, and (4) Advance Directives. We developed PowerPoint presentations, teaching case vignettes, and a set of reference articles, which can be distributed to students as well as to help faculty teachers prepare for the sessions. Teaching sessions occur in small groups, using case discussions and interactive lectures. Sessions 3 and 4 are co-facilitated by palliative care physicians and ethicists, who use role-plays, reflections, and discussions to teach the topics. At the end of the clerkship, students practice these communication skills with videotaped standardized patient encounters, and debrief with faculty members about their performances and ways to improve their communication skills. DISCUSSION: Palliative care sessions are welcomed by the students, who traditionally have not received much teaching in this area. Even though students have learned about mechanisms regulating pain and other symptoms in the past, they have not learned to assess or treat symptoms in a systematic way. Students often have good questions about the decision-making, legal, and ethical issues that emerge for patients near the end of life. Thus, co-facilitation of physicians with ethicists presents both the practical clinical and the theoretical perspectives, and provides a good model for team teaching. In terms of teaching style, students are more involved and participatory when teachers use case vignettes as compared with slide presentations, even if they are case-based. When using role-plays to teach students how to communicate bad news, we found that students need to feel safe in that environment, need to know they can call for time out when necessary, and want to have seen one done before they are asked to do one.     

A tutorial for students demonstrating adequate skills but inadequate knowledge after completing a medicine clerkship at the Oregon Health Sciences University.

Upon completing a clinical clerkship, some students demonstrate adequate clinical skills appropriate for that clerkship but do not demonstrate an adequate fund of knowledge or ability to apply their knowledge clinically. For such students, repeating all or a portion of the clerkship may not be appropriate. This study describes a tutorial provided such students after they had completed the medicine clerkship at the Oregon Health Sciences University. During a two-year period (academic years 1988-89 and 1989-90), six students were identified as needing remediation, and were enrolled in a tutorial coordinated by one faculty member with support from others. The experience was highly successful for all but one student, and the tutorial was uniformly viewed by the students who took it as one of their best experiences in medical school.     

Improving knowledge in palliative medicine with a required hospice rotation for third-year medical students.

PURPOSE: The Liaison Committee for Medical Education requires accredited U.S. and Canadian medical schools to teach end-of-life care. The purpose of this study was to evaluate a new required curriculum in palliative medicine for third-year medical students. METHOD: Beginning in July 2001, a required four-day (32 hour) curriculum was piloted as part of an ambulatory month in the 12-week medicine clerkship. Students spent Day 1 in the classroom learning core concepts regarding hospice, palliative care, and symptom management. A two-hour session with a standardized patient to break bad news was included. Students spent Days 2 and 3 making home visits or participating in inpatient care. Day 4 was spent in the classroom reviewing cases they had seen with interdisciplinary faculty, making presentations on assigned topics, and discussing professional self-care. Students completed a self-awareness project. Educational outcomes were measured with the students' completion of five pre- and postcourse assessment instruments: (1) self-assessment of competency, (2) attitudes, (3) concerns, (4) a 50-item, multiple-choice knowledge test, and (5) an assessment of elements of the course. RESULTS: Analysis of 127 paired evaluations showed significant improvements in three instruments: 56% improvement in competence (p <.0001), 29% reduction in concern (p <.0001), and 23% improvement in knowledge (p <.0001). There were no significant changes attitudes (p =.35). CONCLUSION: This 32-hour required curriculum in palliative medicine for third-year medical students improved knowledge. They came to the course with appropriate attitudes that did not change.