Evaluation of residency training in the delivery of culturally effective care

OBJECTIVE: To augment resident training in the delivery of culturally effective care in order to improve clinician capacity to effectively care for patients from diverse backgrounds. METHODS: Residents from the Naval Medical Center San Diego and the University of California San Diego participated in experiential learning and service activities. Programme evaluation assessed aspects of the delivery of culturally effective care in community settings. A community-based participatory approach to engaging residents in the delivery of culturally effective care and evaluation of the effectiveness of this approach are described. RESULTS: A significant pre-post rotation increase was noted in residents' self-perceived ability to identify culture-related issues that may impact on the patient's view of illness (P<0.001) and ability to address a culture-related issue (P<0.001). Community evaluations rated residents positively on behaviours that reflected communication skills and professionalism, but less positively on knowledge about communities. CONCLUSIONS: The authors conclude that resident exposure to the block rotation curriculum contributes to improved knowledge of the skills necessary to provide culturally effective care in diverse community settings.     

Learning management systems: technology to measure the medical knowledge competency of the ACGME

AIMS: We report how the learning management system (LMS) Web Course Tools (WebCT) was used to design, implement and evaluate the web-based course "Principles of Ambulatory Paediatrics", taken by paediatric residents during an ambulatory block rotation. This report also illustrates how WebCT can be used to measure the medical knowledge competency required by the Accreditation Council for Graduate Medical Education (ACGME). METHODS: Eighty paediatric residents completed a 1-month outpatient rotation between July 1, 2001 and June 30, 2002. During this rotation residents were required to complete 4 modules in asthma, otitis media, gastroenteritis and fever, respectively. Each module was evaluated using a standard questionnaire. RESULTS: Completion rates for the required modules ranged from 64-72%. Residents in all 3 years of training showed improvement between the pre- and post-test scores for each module, except for postgraduate Year 2 residents in the asthma module. Most residents somewhat agreed, agreed or strongly agreed that the module components were useful and that the experience of completing the modules would improve their ability to take care of patients. CONCLUSIONS: The LMS WebCT is an innovative and adaptable approach for designing a web-based course for primary care education in paediatrics. The LMS addresses the educational needs of both a clinical division and a residency programme. The LMS also provides an information technology infrastructure to measure the medical knowledge competency required by the ACGME.     

Relationship of resident characteristics, attitudes, prior training and clinical knowledge to communication skills performance

PURPOSE: A substantial body of literature demonstrates that communication skills in medicine can be taught and retained through teaching and practice. Considerable evidence also reveals that characteristics such as gender, age, language and attitudes affect communication skills performance. Our study examined the characteristics, attitudes and prior communication skills training of residents to determine the relationship of each to patient-doctor communication. The relationship between communication skills proficiency and clinical knowledge application (biomedical and ethical) was also examined through the use of doctor-developed clinical content checklists, as very little research has been conducted in this area. METHODS: A total of 78 first- and second-year residents across all departments at Dalhousie Medical School participated in a videotaped 4-station objective structured clinical examination presenting a range of communication and clinical knowledge challenges. A variety of instruments were used to gather information and assess performance. Two expert raters evaluated the videotapes. RESULTS: Significant relationships were observed between resident characteristics, prior communication skills training, clinical knowledge and communication skills performance. Females, younger residents and residents with English as first language scored significantly higher, as did residents with prior communication skills training. A significant positive relationship was found between the clinical content checklist and communication performance. Gender was the only characteristic related significantly to attitudes. CONCLUSIONS: Gender, age, language and prior communication skills training are related to communication skills performance and have implications for resident education. The positive relationship between communication skills proficiency and clinical knowledge application is important and should be explored further.     

Evaluation of One Program's Use of the Society for Adolescent Health and Medicine Resident Curriculum

PurposeThe publicly available Society for Adolescent Health and Medicine (SAHM) Resident Curriculum provides resources for blended learning. This report presents a formal evaluation of this blended learning curriculum.MethodsWe adapted the SAHM curriculum for a required four-week rotation for pediatricians in training. We selected webinars, videos, articles, and Web sites from the SAHM curriculum to complement the local clinical context. We evaluated the effectiveness of our curriculum using resident pre- and post-self-assessments, weekly knowledge quizzes, and a standardized patient encounter.ResultsResident self-assessment improved in all domains except managing urologic conditions. Residents scored 85% or higher on knowledge quizzes. Standardized patients rated residents a mean of 90.2 out of 100 on adolescent communication and 89.0 out of 100 on parent communication.ConclusionsA blended learning curriculum consisting of SAHM online materials and local clinical experiences improved resident self-assessment, knowledge, and communication skills.     

Using a pilot curriculum in geriatric palliative care to improve communication skills among medical students

The purpose of this study was to assess the impact of an elective geriatric palliative care course on medical students' attitudes, knowledge, and behaviors regarding communication with terminally ill patients. Surveys were administered at the beginning and end of the elective. Despite a significant increase in knowledge about geriatric and palliative medicine (F=24.80; P<.001), there were no significant changes in students' self-reported behaviors when applying curriculum-based communication strategies. However, the qualitative analysis of open-ended questions showed that the curriculum intervention did result in an improvement in empowering message strategies for breaking bad news. The evaluation of the end-of-life curriculum needs to exceed the measurement of attitudes and knowledge and include behavioral assessment of end-of-life communication skills.     

Benefits of a learner-centred abortion curriculum for family medicine residents.

BACKGROUND AND METHODOLOGY: Despite the high prevalence of unplanned pregnancy and abortion in the USA, abortion education in medical schools and residencies is extremely limited. Regardless of their personal views, family physicians will care for many women who have abortions. This article describes the implementation and evaluation of a learner-centred abortion curriculum in a family medicine residency. Residents were surveyed at baseline to assess openness to abortion education. An abortion curriculum was developed and implemented as a routine component of training. Three to four half-day training sessions were tailored to individual residents, with varying levels of participation in providing abortion depending on learners' personal beliefs. Residents completed written surveys before and after participation in the curriculum. RESULTS: The pre-implementation survey had a 90% response rate and showed that routine participation in an abortion curriculum was acceptable to 69% of respondents. The curriculum was implemented and evaluated from 2003 to 2006. All 39 residents participated and 28 (72%) completed both pre- and post-rotation surveys. Comparisons between pre- and post-rotation surveys demonstrated statistically significant improvements in abortion-related knowledge and self-reported comfort with abortion-related skills and significantly more favourable attitudes about abortion training. DISCUSSION AND CONCLUSIONS: Residents were better prepared to care for women with unwanted pregnancies after routine participation in an abortion curriculum. For controversial topics such as abortion, a learner-centred curriculum ensures adequate education for all residents. Future research should assess how routine abortion education affects patient care and whether it results in an increased number of family physicians who provide abortion.     

Primary care resident,faculty, and patient views of barriers to cultural competence,and the skills needed to overcome them

INTRODUCTION: Primary care residencies are expected to provide training in cultural competence. However, we have insufficient information about the perceptions of stakeholders actually involved in healthcare (i.e. residents, faculty and patients) regarding commonly encountered cross-cultural barriers and the skills required to overcome them. METHOD: This study used a total of 10 focus groups to explore resident, faculty and patient attitudes and beliefs about what culturally competent doctor-patient communication means, what obstacles impede or prevent culturally competent communication, and what kinds of skills are helpful in achieving cultural competence. A content analysis was performed to identify major themes. RESULTS: Residents and faculty defined culturally competent communication in terms of both generic and culture-specific elements, however, patients tended to emphasize only generic attitudes and skills. Residents and patients were liable to blame each other in explaining barriers; faculty were more likely to consider systemic influences contributing to resident-patient difficulties. All groups emphasized appropriate skill and attitude development in learners as the key to successful communication. However, residents were sceptical of sensitivity and communication skills training, and worried that didactic presentations would result in cultural stereotyping. DISCUSSION: All stakeholders recognized the importance of effective doctor-patient communication. Of concern was the tendency of various stakeholders to engage in person-blame models.     

360度评估在住院医师规范化培训中的应用

目的分析360度评估在住院医师规范化培训工作中的应用。方法将医院从2019年2—6月共开展5期在线问卷调查评估数据导入SPSS 19.0软件进行统计分析。结果护理人员对住院医师的评价总体高于住院医师与指导医师的互评;住院医师认为带教老师在教学讲座准备、对住院医师培训中的表现作出的及时反馈等方面能力有待于提高;指导老师认为住院医师在独立做出正确诊断、临床判断及临床影像或实验室操作掌握程度等方面能力较差;护理人员认为住院医师在及时告知护理人员患者情况、治疗和出院计划等方面需要提高。结论360度评估可以有效促进住培过程质量控制,结果需要及时跟踪反馈。     

Demonstration of Portfolios to Assess Competency of Residents

Residency educators are identifying approaches to measure resident competence. Portfolios are well suited since they require work already completed as part of patient care where competency must be demonstrated. This paper describes assessment of the reliability and validity of portfolios in a psychiatry residency program. This was a cross-sectional study across 4years of residency education. Using guidelines, 18 residents assembled portfolios containing five entries chosen from 13 skills. Trained raters scored the portfolios. Residents and faculty were interviewed about their perceptions. Generalizability results indicated five entries and two raters were sufficient for relative decisions. Six entries or a third rater would be sufficient for absolute decisions. Portfolio scores tended to improve with years of training and correlated with psychiatric knowledge but not clinical performance. Residents and faculty identified benefits to assembling a portfolio. Portfolios incorporate tasks embedded in the residency to provide evidence of resident competency. The results support that the score is reliable and valid.     

Demonstration of Portfolios to Assess Competency of Residents

Residency educators are identifying approaches to measure resident competence. Portfolios are well suited since they require work already completed as part of patient care where competency must be demonstrated. This paper describes assessment of the reliability and validity of portfolios in a psychiatry residency program. This was a cross-sectional study across 4years of residency education. Using guidelines, 18 residents assembled portfolios containing five entries chosen from 13 skills. Trained raters scored the portfolios. Residents and faculty were interviewed about their perceptions. Generalizability results indicated five entries and two raters were sufficient for relative decisions. Six entries or a third rater would be sufficient for absolute decisions. Portfolio scores tended to improve with years of training and correlated with psychiatric knowledge but not clinical performance. Residents and faculty identified benefits to assembling a portfolio. Portfolios incorporate tasks embedded in the residency to provide evidence of resident competency. The results support that the score is reliable and valid.     

A collaborative end-of-life care curriculum.

Death and dying in America has received limited attention in medical education. The Southern Arizona VA Health Care System and the University of Arizona have collaborated with three nonprofit community hospice programs to develop an end-of-life care curriculum. This formal and comprehensive program is offered as a one-month elective to senior medical students, residents and fellows. The goal of the program is to improve clinical skills in caring for the dying patient and foster research in palliative and supportive care.     

A study on the goals and achievements of postgraduate medical education

In order to evaluate postgraduate medical education (PGME) in Japan, residents and supervisors of all the postgraduate teaching hospitals (128 university hospitals and 216 non-university hospitals designated by the Ministry of Health and Welfare) were surveyed. The purposes of this study were, 1) to compare the goals of PGME set by residents and the achievements of PGME by residents in university hospitals and non-university hospitals, 2) to compare the goals of PGME between residents and supervisors, 3) to identify how clinical skills and knowledge related to the behavioral sciences and social medicine are stressed on PGME. Residents and supervisors received a newly developed questionnaire consisting of 41 items concerning clinical skills and knowledge. The items were divided into four categories: 17 basic areas, 9 allied areas, 12 areas related to the behavioral sciences and social medicine, and 3 areas related to clinical research. The response rate was 52.3% for university hospitals and 75.5% for non-university hospitals. The results are 1) residents in non-university hospitals scored at higher levels than residents in university hospitals for 14 items concerning goals and 11 items of achievements, mainly basic clinical skills and knowledge, 2) there was an incongruence between residents and supervisors for 23 items concerning goals, 3) clinical skills and knowledge related to the behavioral sciences and social medicine were not as highly stressed as other areas of clinical skills and knowledge. This study suggests that more effort is needed to create or improve the system of PGME, especially in university hospitals.     

Impact of partial participation in integrated family planning training on medical knowledge,patient communication and professionalism

Introduction

Obstetrics and gynecology residency programs are required to provide access to abortion training, but residents can opt out of participating for religious or moral reasons. Quantitative data suggest that most residents who opt out of doing abortions participate and gain skills in other aspects of the family planning training. However, little is known about their experience and perspective.

Methods

Between June 2010 and June 2011, we conducted semistructured interviews with current and former residents who opted out of some or all of the family planning training at ob-gyn residency programs affiliated with the Kenneth J. Ryan Residency Training Program in Abortion and Family Planning. Residents were either self-identified or were identified by their Ryan Program directors as having opted out of some training. The interviews were transcribed and coded using modified grounded theory.

Results

Twenty-six physicians were interviewed by telephone. Interviewees were from geographically diverse programs (35% Midwest, 31% West, 19% South/Southeast and 15% North/Northeast). We identified four dominant themes about their experience: (a) skills valued in the family planning training, (b) improved patient-centered care, (c) changes in attitudes about abortion and (d) miscommunication as a source of negative feelings.

Discussion

Respondents valued the ability to partially participate in the family planning training and identified specific aspects of their training which will impact future patient care. Many of the effects described in the interviews address core competencies in medical knowledge, patient care, communication and professionalism. We recommend that programs offer a spectrum of partial participation in family planning training to all residents, including residents who choose to opt out of doing some or all abortions.

Implications

Learners who morally object to abortion but participate in training in family planning and abortion, up to their level of comfort, gain clinical and professional skills. We recommend that trainers should offer a range of participation levels to maximize the educational opportunities for these learners.     

Residents' training goals in respiratory knowledge and skills: perspective of three parties

Medical residents, full-time respiratory teaching staff, and community-based doctors rated the importance of fifty-five respiratory training goals involving knowledge and skills necessary for the future practices of all medical residents. Residents also rated their perceived preparedness in these training areas. Intra-and inter-group analyses indicated that residents agreed more often, and consistently assigned more importance (94% of goals) to the training goals than did the teachers and doctors. Although the residents considered themselves prepared for 69% of the training goals, they also had moderate intra-group disagreement. These results may reflect variable training experiences and/or institutional practices, but areas of less than adequate preparation were identified and can be corrected. The other two groups were in general agreement except regarding some clinical skills. This study offers possible explanations for the group responses and indicates the potential benefit for groups to discuss, identify, and survey training goals.     

Improving capacity to care for patients with intellectual and developmental disabilities: The value of an experiential learning model for family medicine residents

BackgroundPatients with intellectual and developmental disabilities (IDD) are more likely to experience poor health outcomes and family physicians receive inadequate training to provide appropriate care to this patient group. Little prior research has studied how to effectively train family physicians to care for patients with IDD.ObjectiveThe aim of this pilot study was to assess the value of adding an experiential component to didactic education strategies to improve family medicine resident perceived comfort, skills and knowledge related to caring for patients with IDD.MethodsStructured education programs for residents were implemented at three primary care practices in Ontario, Canada. Two practices received didactic information only (didactic-only group); one received didactic information and an experiential training model including clinical interactions and a written reflection on that experience (didactic plus experiential group). In this separate-sample pre-post design, residents were invited to complete a brief anonymous survey prior to and following the training assessing their perceived comfort, skills and knowledge related to patients with IDD.ResultsAt baseline, there were no significant differences between the two groups of residents. At follow up, the experiential group reported significantly higher levels of comfort, skills, and knowledge compared to baseline for most items assessed, while in the didactic-only group most items showed little or no improvement.ConclusionThis pilot study suggests that providing residents the opportunity to participate in clinical encounters with patients with IDD, as well as a structured process to reflect on such encounters, results in greater benefit than didactic training alone.     

Evaluation of a Chaplain Residency Program and Its Partnership with an In-Patient Palliative Care Team

In 2009 a Consensus Conference of experts in the field of spiritual care and palliative care recommended the inclusion of Board-certified professional chaplains with at least 1,600 hours of clinical pastoral education as members of palliative care teams. This study evaluates a clinical pastoral education residency program’s effectiveness in preparing persons to provide spiritual care for those with serious illness and in increasing the palliative care team members’ understanding of the chaplain as part of the palliative care team. Results showed chaplain residents felt the program prepared them to provide care for those with serious illness. It also showed that chaplain residents and palliative care team members view spirituality as an integral part of palliative care and see the chaplain as the team member to lead that effort. Suggested program improvements include longer palliative care orientation period, more shadowing with palliative care team members, and improved communication between palliative care and the chaplain residents.     

Use of a sports medicine clinic in a family practice residency

The experience of a pilot sports medicine clinic in affiliation with a family practice residency program is reviewed. The use of volunteer orthopedic staffing along with residents working in an acute sports medicine clinic in a community hospital proved to be a valuable addition to the orthopedic exposure during residency training. Seventy-eight patient contacts involving 93 injuries were encountered over a seven-week period. Three injuries required hospitalization for further definitive care. The benefits derived suggest that a similar clinic setup in other residency training programs could enhance the required orthopedic rotation as well as give acute, responsible care to the injured athlete. Educationally the resident's role as the athlete's physician provided a clinical experience valuable to a primary care practice.     

Primary care residents and the management of hypercholesterolemia

A survey of primary care residents' attitudes, beliefs, and knowledge and a medical record audit were used to assess barriers to appropriate detection, identification, and management of hypercholesterolemia. Previous studies have focused on either self-reports or audits alone. This study compares survey results to recorded clinical performance. Family practice and internal medicine residents were compared to determine if previous findings were specialty-specific. The results of the survey indicate that, even prior to the publication of the National Cholesterol Education Program, residents demonstrated positive attitudes and appropriate knowledge of risk levels, in contrast with previous reports on practicing physicians. The medical record audit, however, showed that residents were not providing care that approximated their own recommendations for hypercholesterolemia management. Results of the survey and audit demonstrated little or no difference between specialty groups. The results indicated that training in management skills and reducing practice barriers are important to improve resident physicians' management of patients with hypercholesterolemia. The use of a survey and audit provide a useful needs assessment for designing educational programs.     

Availability and characteristics of abortion training in US ob-gyn residency programs: a national survey

Objective

To assess the availability and characteristics of abortion training in US ob-gyn residency programs.

Methods

We surveyed fourth-year residents at US residency programs by email regarding availability and type of abortion training, procedural experience and self-assessed competence in abortion skills. We conducted multivariable, ordinal logistic regression with general estimating equations to determine individual-level and resident-reported, program-level correlates of quantity of uterine evacuation procedures done during residency.

Results

Three hundred sixty-two residents provided data, representing 161 of the 240 residency programs contacted. Access to training in elective abortion was available to most respondents: 54% reported routine training—where abortion training was routinely scheduled; 30% reported opt-in training—where training was available but not routinely integrated; and 16% reported that elective abortion training was not available. Residents in programs with routine elective abortion training and those who intended to do abortions before residency did a greater number of first-trimester manual uterine aspiration and second-trimester dilation and evacuation procedures than those without routine training. Similarly, routine, integrated training, even for indications other than elective abortion, correlated with more clinical experience (all p<.01, odds ratio and confidence interval shown below).

Conclusion

There is a strong independent relationship between routine training and greater clinical experience with uterine aspiration procedures.     

A Cross-Sectional Survey of Internal Medicine Residents’ Knowledge,Attitudes, and Current Practices Regarding Patient Transitions to Post-Acute Care

ObjectivesPrior studies have found suboptimal knowledge about post-acute care (PAC) among inpatient providers and poor communication at discharge that can lead to unsafe discharge transitions, but little is known about residents and the PAC transition. The aim of this study is to assess internal medicine residents’ knowledge, attitudes, and current practice regarding patient transitions to PAC.DesignA multisite, cross-sectional 36-question survey.Setting and ParticipantsInternal Medicine and Medicine-Pediatrics residents at 3 university-based Internal Medicine training programs in the United States. Methods: Survey delivered electronically to residents in 2018 and 2019. Survey responses were described by collapsing 4-point Likert responses into dichotomous variables, and thematic content analysis was used to evaluate free text responses. Results: Of 482 residents surveyed, 236 responded (49%). Despite high reported confidence in their ability to transition patients to PAC, only 31% of residents knew how often patients received skilled therapies at skilled nursing facilities (SNFs) and 23% knew how frequently nursing services are provided. The majority of residents (79%) identified the discharge summary as the main way they communicated care instructions to the SNF, but only 55% reported always completing it prior to discharge. Upper-level residents were more likely to know how much therapy patients received at a SNF, but resident knowledge about PAC did not vary by residency year in other domains. Residents who experienced a clinical rotation at a SNF had higher levels of knowledge compared to residents who did not.ConclusionsThis national survey of internal medicine residents identified common knowledge gaps regarding PAC. These knowledge gaps did not improve throughout residency without deliberate exposure to PAC environments. This suggests a need for dedicated curriculum development as discharges to PAC continue to rise exponentially.