Shared Decision Making in Common Chronic Conditions: Impact of a Resident Training Workshop

Problem: Physicians must be competent in several different kinds of communication skills in order to implement shared decision making; however, these skills are not part of routine medical student education, nor are they formally taught during residency training. Intervention: We developed a 1- and 2-hour workshop curriculum for internal medicine residents to promote shared decision making in treatment decisions for four common chronic conditions: diabetes, depression, hypertension, and hyperlipidemia. The workshops included a written case exercise, a short didactic presentation on shared decision-making concepts and strategies for risk communication, and two role-playing exercises focused on decision making for depression and hyperlipidemia treatment. Context: We delivered the workshop as a required component of the resident curriculum in ambulatory medicine. To evaluate the impact of the workshop, we used written course evaluations, tracked the use of the newly introduced Decision Worksheets, and asked preceptors to perform direct observation of treatment decision conversations. Outcome: Residents were involved in the development of the workshop and helped identify key content, suggested framing for difficult topics, and confirmed the need for the skills workshop. One hundred thirty internal medicine and medicine-pediatrics residents attended 8 workshops over a 4-month period. In written cases completed before the workshop, the majority of residents indicated that they would discuss medications, but few mentioned other treatment options or documented patients’ goals and preferences in a sample encounter note with a patient with new depression symptoms. Overall, most participants (89.7%) rated the workshop as excellent or very good, and 93.5% said that they would change their practice based on what they learned. Decision Worksheets addressing diabetes, depression, hyperlipidemia, and hypertension were available on a primary care-focused intranet site and were downloaded almost 1,200 times in the first 8 months following the workshops. Preceptors were able to observe only one consult during which one of the four topics was discussed. Lessons Learned: Internal medicine residents had considerable gaps in shared decision-making skills as measured in a baseline written exercise. Residents provided valuable contributions to the development of a Decision Worksheet to be used at the point of care. Participants rated the skills workshop highly, though interns rated the exercise more useful than PGY-2 and PGY-3 residents did. The Decision Worksheets were accessed often following the sessions; however, observing the Decision Worksheets in use in real time was a challenge in the resident-faculty clinic. Additional studies are warranted to examine whether the workshop was successful in increasing residents’ ability to implement skills in practice.     

The Current and Ideal State of Mental Health Training: Pediatric Resident Perspectives

Phenomenon: Mental health (MH) problems are prevalent in the pediatric population, and in a setting of limited resources, pediatricians need to provide MH care in the primary medical home yet are uncomfortable doing so citing a lack of training during residency as one barrier. Approach: The purpose of this study is to describe pediatric residents’ experiences and perspectives on the current and ideal states of MH training and ideas for curriculum development to bridge this gap. A qualitative study using focus groups of pediatric residents from an urban academic medical center was performed. Audio recordings were transcribed and analyzed using a grounded theory approach. Findings: Twenty-six residents participated in three focus groups, which is when thematic saturation was achieved. The team generated five major themes: capabilities, comfort, organizational capacity, coping, and education. Residents expressed uncertainty at every step of an MH visit. Internal barriers identified included low levels of comfort and negative emotional responses. External barriers included a lack of MH resources and mentorship in MH care, or an inadequate organizational capacity. These internal and external barriers resulted in a lack of perceived capability in handling MH issues. In response, residents reported inadequate coping strategies, such as ignoring MH concerns. To build knowledge and skills, residents prefer educational modalities including didactics, experiential learning through collaborations with MH specialists, and tools built into patient care flow. Insights: Pediatric residency programs need to evolve in order to improve resident training in MH care. The skills and knowledge requested by residents parallel the American Academy of Pediatrics statement on MH competencies. Models of collaborative care provide similar modalities of learning requested by residents. These national efforts have not been operationalized in training programs yet may be useful for curriculum development and dissemination to enhance trainees’ MH knowledge and skills to provide optimal MH care for children.     

Residents-as-Teachers: Implementing a Toolkit in Morning Report to Redefine Resident Roles

Background: Morning report was initially created to meet service needs. Purpose: The objective was to improve morning report through a toolkit combining principles of learning theory with resident teaching. Methods: The toolkit consists of three parts: a guideline describing expectations, a worksheet outlining teaching plans, and a feedback form facilitating post-presentation feedback. In 2009–2010, internal medicine residents met with a chief resident before their presentations to refine teaching plans. The chief resident then supported the presenter in achieving their objectives and provided post-presentation feedback. Residents were surveyed before and 6 months after the intervention. Mean scores were compared using an unpaired t test. Results: Residents’ ratings improved in the following domains: understanding expectations (3.10 vs. 4.02, p = .0003), presentation organization (3.50 vs. 4.25, p = .005), and creating and accomplishing learning objectives (3.31 vs. 4.00, p = .002). Residents commented positively on the improved presentations. Conclusions: This toolkit, based on educational principles, improved morning report presentations.     

Implementation of a Mini-CEX Requirement Across All Third-Year Clerkships

Problem: Direct observation of medical students performing clinical tasks, such as eliciting a patient history or examining a patient, and the provision of feedback, are foundational to student improvement but have been reported to occur infrequently. The mini clinical evaluation exercise (mini-CEX) is a tool that can facilitate direct observation and feedback. This study assessed the impact of a mini-CEX requirement across all 3rd-year clerkships on student report of direct observation by faculty and objectively measured clinical skills. Intervention: A mini-CEX requirement across all 3rd-year clerkships was implemented in the 2012–2013 academic year. The impact of the mini-CEX requirement on student report of direct observation was assessed by end-of-clerkship surveys and Association of American Medical Colleges (AAMC) Graduation Questionnaire (GQ) items on direct observation. The impact on students' clinical skills was assessed by a summative Objective Structured Clinical Examination (OSCE). Pre/post comparisons were assessed with chi-square and Fisher's exact tests. Context: A mini-CEX requirement had been in place for the internal medicine clerkship, and student reports of direct observation were historically higher for the internal medicine clerkship than for other clerkships. Faculty, residents, and students at each of the clinical sites across all 6 clerkships were oriented to the use of the mini-CEX; the feasibility of its use during usual patient interaction settings and the importance of direct observation and feedback for student improvement were emphasized during these sessions. Outcome: Adherence to the mini-CEX requirement was high: 92% of required forms were completed, and 78% of completed forms indicated that specific feedback was given. The proportion of students reporting direct observation of physical examination significantly increased in all clerkships, with the largest relative increase occurring in surgery (from 49% to 87%), χ²(1, N = 225) = 37.70, p < .0001. Significant increases were seen in faculty observation of history taking in pediatrics, surgery, and psychiatry. Direct observation rates also increased on the AAMC GQ items for history taking and physical exam for all clerkships. Failures on the summative OSCE decreased from 12% preintervention to 2% postintervention (p = .0046). Lessons Learned: Institution of a mini-CEX requirement was feasible across all 3rd-year clerkships and was associated with a significant increase in student report of direct observation by faculty and a decrease in summative OSCE failure rates.     

Attending Physicians' Perspectives of Resident Academic Half Day

Phenomenon: Academic health centers face significant challenges trying to improve medical education while meeting patient care needs. In response to problems with traditional forms of didactic education, many residency programs have transitioned to Academic Half Day (AHD), a curricular model in which learning is condensed into half-day blocks. In this model, trainees have protected educational time free from clinical responsibilities. However, an understanding of the impact on attending physicians and patient care when residents depart clinical sites for learning activities has not been well described. We sought to explore attending physicians’ perspectives when residents depart clinical sites to attend AHD. Approach: We performed a qualitative study with a grounded theory approach using individual semistructured interviews (December 2016–April 2017) of attending physicians who worked at inpatient and emergency department clinical sites from which residents departed to attend AHD. We used the constant comparative method, generating codes using an iterative approach and continuing sampling until saturation was reached. Major themes were identified and disagreements were resolved by consensus. Findings: Fifteen attending physicians from 6 clinical services were interviewed. Data analysis yielded 5 themes: emotional strain of workload, technology and systems challenges, patient safety and care concerns, disrupted resident learning, and the challenge to optimize resident education. Attending physicians, already working on busy services, felt frustrated and perceived having an increased workload when residents departed for AHD. They were concerned about safely entering orders in the electronic health record, impeded patient workflow, and further disruption of resident schedules already disrupted by duty hour restrictions and continuity clinic. Attending physicians described the importance of experiential learning from caring for patients and from structured didactic learning; however, the optimal balance was uncertain. Insights: We found that attending physicians experienced significant emotional strain, faced technological challenges, and were concerned about impeded workflow and patient safety when residents departed clinical sites for AHD. This is likely to be true whenever residents are pulled out of the clinical setting for any reason. Educators need to partner with hospital administrators to provide appropriate support for attending physicians when residents leave clinical sites, evaluate the effectiveness of different educational models, and determine how structured learning activities fit into the overall curriculum.     

Evaluation of Resident Performance and Intensive Bedside Teaching during Direct Observation

Objective: To describe the experience of a residency program in emergency medicine with an intensive observational evaluation of resident performance in the ED.
Methods: Each resident was directly observed and evaluated during a clinical shift four times each academic year: once by each residency codirector and twice by the resident's faculty advisor. The faculty members performed this evaluation outside of "clinical staffing time," shadowing the resident for several hours in the ED during the resident's assigned shift. The resident and assigned faculty member discussed the patients' histories and physical examination findings and developed treatment plans together. Prior to initiation of the observation, the faculty were provided with guidelines for the evaluation of specific skills. Immediate feedback of strengths and deficiencies was provided to the resident.
Results: Subjective evaluations by faculty suggest that new insights into resident clinical strengths and weaknesses were determined using this approach. Objective scoring of resident performance demonstrated heterogeneity of skills between residents as well as inconsistency of skills for specific residents.
Conclusions: The program provided the faculty with protected teaching time, an opportunity to share clinical pearls, and unique insights into resident performance that are not obvious during standard clinical interactions.     

Teaching Resident Self-Assessment Through Triangulation of Faculty and Patient Feedback

Problem: To accurately determine one's ability in any clinical competency, an individual must be able to self-assess performance and identify personal limitations. Existing research demonstrates that physicians of all levels are unreliable self-assessors. This poses a concern in medical practice, which requires continuous updates to clinical competencies and awareness of personal limitations. Few published studies examine graduate medical education curricula designed to develop self-assessment skills. Intervention: Conceptual models, such as self-determination theory, suggest that self-assessment is most effectively learned through reflective processes. The Family Medicine Residency Program at Lehigh Valley Health Network developed a learner-centered competency assessment process that integrates advising and performance review. The multisource, observable behavior-based process encourages conversation between resident and advisor. Utilizing feedback from clinical preceptors and patient surveys, advisors guide residents in determining individual learning needs in core competency areas, including relationship-centered care. Development of medical learners' capacity to form relationships is one means to improving the patient experience. Context: This retrospective case study evaluates the accuracy of senior residents' self-assessment in relationship-centered care compared with that of junior residents. The study population includes the 34 residents enrolled from AY 2009–2012. Data sets represent specific 6-month periods and have 3 component scores—Self, Faculty, and Patient—which were triangulated to determine concordance rates by postgraduate year level. Outcome: The concordance rate among first-years was 26.7%, whereas third-years saw 60.0% concordance. A discordance analysis found the Patient score most often deviated from the other 2 scores, whereas the Faculty score was never the sole dissenter. When all 3 scores differed, the Self score frequently fell between the other 2 scores. Lessons Learned: The principles of self-determination theory provide a valuable framework for understanding the development of residents' intrinsic motivation to become lifelong learners. The trend in improved concordance rates among senior residents suggests that prompting learners to triangulate feedback from multiple sources can lead to a shift in perspective about competency. Further study is needed to determine whether our results are generalizable to other competencies and educational settings.     

Useful but Different: Resident Physician Perceptions of Interprofessional Feedback

Phenomenon: Based on recently formulated interprofessional core competencies, physicians are expected to incorporate feedback from other healthcare professionals. Based on social identity theory, physicians likely differentiate between feedback from members of their own profession and others. The current study examined residents' experiences with, and perceptions of, interprofessional feedback. Approach: In 2013, Anesthesia, Obstetrics-Gynecology, Pediatrics, and Psychiatry residents completed a survey including questions about frequency of feedback from different professionals and its perceived value (5-point scale). The authors performed an analysis of variance to examine interactions between residency program and profession of feedback provider. They conducted follow-up interviews with a subset of residents to explore reasons for residents' survey ratings. Findings: Fifty-two percent (131/254) of residents completed the survey, and 15 participated in interviews. Eighty percent of residents reported receiving written feedback from physicians, 26% from nurses, and less than 10% from other professions. There was a significant interaction between residency program and feedback provider profession, F(21, 847) = 3.82, p < .001, and a significant main effect of feedback provider profession, F(7, 847) = 73.7, p < .001. On post hoc analyses, residents from all programs valued feedback from attending physicians higher than feedback from others, and anesthesia residents rated feedback from other professionals significantly lower than other residents. Ten major themes arose from qualitative data analysis, which revealed an overall positive attitude toward interprofessional feedback and clarified reasons behind residents' perceptions and identified barriers. Insights: Residents in our study reported limited exposure to interprofessional feedback and valued such feedback less than intraprofessional feedback. However, our data suggest opportunities exist for effective utilization of interprofessional feedback.     

Disruptions and Satisfaction in Internal Medicine Resident Continuity Clinic Differ Between Inpatient and Outpatient Rotations

Abstract

Background: Little is known about whether assignment to simultaneous inpatient and outpatient clinical duties causes disruptions during internal medicine resident continuity clinic and impacts trainee satisfaction.

Purpose: Our purpose was to determine whether dual inpatient and continuity clinic responsibilities impact resident stress and document the number, type, and immediacy of interruptions in continuity clinics.

Methods: Methods included a prospective 2-residency survey of 70 internal medicine residents performing 240 half-day continuity clinic sessions.

Results: More than half (52%) of trainees on inpatient rotations felt pressured to return to their ward duties. Half (50%) of residents thought clinic increased work hours, and the majority (70%) did not think continuity clinic detracted from their education on inpatient or elective rotations. Disturbances were more likely to occur on inpatient rotations (odds ratio 4.52, 95% confidence interval = 2.29-8.92) than on outpatient rotations. The time required to address an interruption was 3.9 ± 4.51 min. Residents thought many (46%) problems addressed during clinic could have waited until clinic completion.

Conclusions: Residents on inpatient rotations who were commonly interrupted in clinic felt pressured to return to ward duties and unable to focus on their clinic patients. Internal medicine faculty should modify curriculum to minimize the interference of other duties in resident clinics.     

Feedback in the OSCE: What Do Residents Remember?

Theory: The move to competency-based education has heightened the importance of direct observation of clinical skills and effective feedback. The Objective Structured Clinical Examination (OSCE) is widely used for assessment and affords an opportunity for both direct observation and feedback to occur simultaneously. For feedback to be effective, it should include direct observation, assessment of performance, provision of feedback, reflection, decision making, and use of feedback for learning and change. Hypotheses: If one of the goals of feedback is to engage students to think about their performance (i.e., reflection), it would seem imperative that they can recall this feedback both immediately and into the future. This study explores recall of feedback in the context of an OSCE. Specifically, the purpose of this study was to (a) determine the amount and the accuracy of feedback that trainees remember immediately after an OSCE, as well as 1 month later, and (b) assess whether prompting immediate recall improved delayed recall. Methods: Internal medicine residents received 2 minutes of verbal feedback from physician examiners in the context of an OSCE. The feedback was audio-recorded and later transcribed. Residents were randomly allocated to the immediate recall group (immediate-RG; n = 10) or the delayed recall group (delayed-RG; n = 8). The immediate-RG completed a questionnaire prompting recall of feedback received immediately after the OSCE, and then again 1 month later. The delayed-RG completed a questionnaire only 1 month after the OSCE. The total number and accuracy of feedback points provided by examiners were compared to the points recalled by residents. Results comparing recall at 1 month between the immediate-RG and the delayed-RG were also studied. Results: Physician examiners provided considerably more feedback points (M = 16.3) than the residents recalled immediately after the OSCE (M = 2.61, p < .001). There was no significant difference between the number of feedback points recalled upon completion of the OSCE (2.61) compared to 1 month later (M = 1.96, p = .06, Cohen's d = .70). Prompting immediate recall did not improve later recall. The mean accuracy score for feedback recall immediately after the OSCE was 4.3/9 or “somewhat representative,” and at 1 month the score dropped to 3.5/9 or “not representative” (ns). Conclusion: Residents recall very few feedback points immediately after the OSCE and 1 month later. The feedback points that are recalled are neither very accurate nor representative of the feedback actually provided.     

Emergency Medicine Resident Self-assessment of Clinical Teaching Compared to Student Evaluation Using a Previously Validated Rubric

Purpose

The quality of clinical teaching in the emergency department from the students' perspective has not been previously described in the literature. Our goals were to assess senior residents' teaching ability from the resident/teacher and student/learner viewpoints for any correlation, and to explore any gender association. The secondary goal was to evaluate the possible impact of gender on the resident/student dyad, an interaction that has previously been studied only in the faculty/student pairing.

Resident Efficiency in a Pediatric Emergency Department

Objectives: To measure the hourly rate of patients evaluated and treated by resident physicians in an academic pediatric emergency department (PED) and examine differences in the rate by subspecialty and year of training. Methods: For all residents rotating in an academic, urban children's hospital PED, the rate of patients seen per hour over the course of their rotation was calculated using an electronic tracking system, EmSTAT, for calendar year 2000. Rates are reported as the mean number of patients seen per resident hour worked. Mean differences are reported for resident subspecialties (emergency medicine, pediatrics, and family practice) and postgraduate year (PGY1–PGY3), and subclass comparisons were made with an analysis of variance test with Tukey's post hoc analysis. Results: A total of 153 residents (63.4% pediatric, 18.9% family practice, and 17.7% emergency medicine) saw 24,414 patients during the study period. The makeup of the group by training year was as follows: PGY1, 20.9%; PGY2, 41.2%; and PGY3, 37.9%. For all residents, the mean rate was 1.02 patients seen per hour (pph). Significant differences in the mean number of patients seen per hour by subspecialty existed, with emergency medicine residents seeing a mean of 1.12 pph, pediatrics residents seeing 1.02 pph, and family practice residents seeing 0.93 pph (mean difference, p < 0.05 for all comparisons). Rates increased by year of training, with PGY1 seeing a mean of 0.95 pph, PGY2 seeing 0.99 pph, and PGY3 seeing 1.09 pph (mean difference, p < 0.05 for all comparisons except PGY1 vs. PGY2). Conclusions: Significant differences in the rate of patients evaluated and treated in the PED exist by resident subspecialty and year of training. Knowing these rates is helpful in evaluation of resident performance, because it allows comparison with peers. Additionally, such information may be useful for residency program evaluators to gauge the amount of patient exposure for residents.     

Lessons Learned to Aid in Developing Fatigue Risk Management Plans for Resident Physicians

Phenomenon: Fatigue is a significant risk factor for deterioration in performance, which may lead to medical errors and reduced well-being in resident physicians (residents). Sleep deprivation, which has been studied extensively, is only one contributor to fatigue. Given the complexity of fatigue and its relationship with resident performance, the National Steering Committee on Resident Duty Hours in Canada recommends that all residency education programs develop a fatigue risk management plan (FRMP) for their residents. The purpose of this study was to explore the impact of residents’ experiences of fatigue and the strategies they use to manage it. Approach: This single-site study investigated the perceptions of resident physicians. Residents were recruited through purposive sampling to ensure representation from a variety of programs, postgraduate year level, and gender. Recruitment was managed with support from the residency programs; however, data collection and analysis were conducted by the Office of Postgraduate Medical Education to ensure participant anonymity. Program directors and administrators assisted in relaying the information about the study to the residents; however, they were not made aware if their residents participated in the study. Interview and focus group data were collected all at once, then transcribed, and then subsequent thematic analysis of these data was conducted using a quasi-constant comparison approach until thematic saturation was reached. Two researchers coded the data using thematic content analysis. Findings: Fifty-seven residents participated in a focus group or interview. There was representation from more than half of the 58 residency programs and from 15 of 16 departments. Overall, there was consensus that fatigue impacts residents’ physical, cognitive, and emotional states. These impacts were reported as influencing resident performance including those related to patient care. Residents reported that fatigue led them to be less productive in their personal and professional lives. Three major themes were identified for which strategies could be developed for fatigue risk management: self, program, and system. Together with self-, program-, and system-level strategies that complement and enhance each other, specific targeted FRMPs could be developed. Insights: Fatigue is a multifaceted phenomenon experienced by residents that requires management beyond extended duty hours and adequate amounts of sleep. FRMPs that encompass strategies used by the resident, the residency-training program, and the healthcare system in which they work could assist with managing fatigue in residents and support enhanced resident well-being and patient care.     

Resident Perceptions of the Educational Value of Night Float Rotations

Background: Night float rotations are being increasingly used in the era of resident physician work-hour regulations, but their impact on resident education is not clear. Purpose: Our objective was to clarify resident perceptions of the educational aspects of night float rotations. Methods: An anonymous survey of internal medicine residents at a university-based residency program was completed. Results: Responses were received from 116 of 163 surveyed residents (71%). Residents attended less residents’ report (0.10 ± .43 vs. 2.70 + 0.93 sessions/week, p< .001) and fewer grand rounds sessions (0.14 ± 0.25 vs. 0.43 ± 0.28 sessions/week, p< .001) and spent less time reading, (2.63 ± 2.0 vs. 3.33 ± 1.6 hr/week, p< .001) interacting with attending physicians (0.57 ± 1.1 vs. 2.97 ± 1.5 hr/week, p< .001) and sleeping at home (6.3 ± 1.2 vs. 7.10 ± 0.9 hr/day, p< .001) on night float rotations than on non–night float rotations. Residents had strongly negative opinions about the educational value of night float, sleep cycle adjustment issues, and impact on their personal lives, which correlated with resident evaluations from the regular program evaluation process. In free responses, residents commented that they liked the autonomy and opportunity to improve triage skills on these rotations and confirmed their negative opinions about the sleep–wake cycle and interference with personal lives. Conclusions: Internal medicine residents at a university-based program have negative opinions regarding the educational value of night float rotations. Further work is necessary to determine whether problems exist across programs and specialties.     

First-postgraduate-year Resident Clinical Time Use on Three Specialty Rotations

OBJECTIVE: To compare in-hospital time uses by first-postgraduate-year (PGY1) residents during rotations in emergency medicine (EM), internal medicine (IM), and surgery (S). This article reports the clinical components of residency time use. METHODS: A cross-sectional, observational study of the clinical activities of EM PGY1 residents was performed while the residents were on duty during the three specialty rotations. The activities were recorded by an observer using a log with predetermined categories for clinical activities. A time-blocked, convenience sample of resident shifts was observed for each service rotation. The sample was proportional to the total number of hours for which a PGY1 resident was expected to be in the hospital during a rotation on that service. No attempt was made to sample the same resident at all time periods or on all rotations. Proportions were compared by chi2; alpha = 0.0001. RESULTS: Twelve PGY1 residents were observed for a total of 166 hours on S, 156 hours on IM, and 120 hours on EM. These hourly amounts were representative of a typical two-week span of service on each rotation for the residents. On average, the residents spent 57% of their time on clinical or service-oriented activities. During EM and IM rotations, the residents spent most of their time performing clinical information gathering and engaging in case management and data synthesis (52% of total clinical effort). Within this category, residents on EM were more involved with case discussion and review of ancillary test results than on IM (34% vs 20% of time in this category). Conversely, proportionately less time in this category was devoted to documentation on the EM vs IM rotation (56% vs 80%; p < 0.0001). The greatest opportunity to perform procedures was on the S rotation (31% of total clinical time vs 6% for other specialties; p < 0.0001). CONCLUSION: Awareness of the clinical activities performed on PGY1 rotations can help residency directors anticipate educational needs to balance their residents' experience. Since 29% and 42% of total clinical time on PGY1 EM and IM rotations, respectively, is focused on documentation, efforts to enhance charting skills and efficiency are warranted. Also, efforts to enhance PGY1 procedural experience outside of the S rotation appear warranted.     

An Evaluation of Emergency Medicine Resident Interaction Time with Faculty in Different Teaching Venues

OBJECTIVES: To measure actual emergency medicine (EM) resident interaction time with faculty and to investigate the potential to use direct observation as an assessment tool for the core competencies. By 2006 all EM residencies must implement resident assessment techniques of the six Accreditation Council for Graduate Medical Education core competencies. Emergency medicine educators recommend direct observation as the optimal evaluation tool for patient care, systems-based practice, interpersonal and communication skills, and professionalism. Continuous faculty presence in the emergency department (ED) is widely believed to facilitate direct observation as an assessment technique. METHODS: Observational study of EM resident-faculty interaction time during two-hour periods. Study venues included two EDs, two trauma services, inpatient medicine, adult and pediatric intensive care units (ICUs), and a pediatric outpatient clinic. Using a priori definitions, the authors categorized faculty-EM resident interaction time as direct observation of patient care, indirect patient care, or non-patient care activities, and calculated total faculty interaction time. Subjects were blinded to the nature of the study, and data gathering was encrypted. RESULTS: Two hundred seventy observation periods of two hours each were conducted, sampling 32 EMR1, 33 EMR2-3, 41 EM, and 38 non-EM faculty. The mean total faculty interaction time ranged from a high of 30% (95% CI = 20% to 41%) in the pediatric ICU to a low of 10% (95% CI = 3% to 16%) on internal medicine wards. Overall, EM faculty interaction time was 20% (95% CI = 18% to 22%). Direct observation by faculty ranged from a high of 6% for EMR2-3s in the critical care areas of the ED (95% CI = 3% to 9%) to a low of 1% (95% CI = 0% to 2%) on internal medicine wards. Overall ED direct observation time was 3.6% (95% CI = 2.6% to 4.7%). Emergency department direct observation did not vary within EM resident training level or by ED site. Direct observation varied by treatment area within the EDs, with the critical care areas being substantially higher (6%) than the noncritical care areas (1%). CONCLUSIONS: Faculty direct observation time of EM residents was low in all training venues studied. Direct observation was the highest in ED critical care areas and lowest on medicine ward rotations. Emergency medicine faculty involved simultaneously in routine ED teaching, supervision, and patient care rarely performed direct observation, despite their continuous physical presence. This finding suggests that alternative strategies may be required to assess core competencies through direct observation in the ED.