Teaching clinically experienced physicians communication skills. A review of evaluation studies

CONTEXT: Interest in the teaching of communication skills in medical schools has increased since the early seventies but, despite this growing interest, relatively limited curricular time is spent on the teaching of communication skills. The limited attention to the teaching of these skills applies even more to the physicians' clinical years, when attention becomes highly focused on biomedical and technical competence. Continuing training after medical school is necessary to refresh knowledge and skills, to prohibit decline of performance and to establish further improvements. OBJECTIVE: This review provides an overview of evaluation studies of communication skills training programmes for clinically experienced physicians who have finished their undergraduate medical education. The review focuses on the training objectives, the applied educational methods, the evaluation methodology and instruments, and training results. METHODS: CD-ROM searches were performed on MedLine and Psychlit, with a focus on effect-studies dating from 1985. RESULTS: Fifteen papers on 14 evaluation studies were located. There appears to be some consistency in the aims and methods of the training programmes. Course effect measurements include physician self-ratings, independent behavioural observations and patient outcomes. Most of the studies used inadequate research designs. Overall, positive training effects on the physicians' communication behaviour are found on half or less of the observed behaviours. Studies with the most adequate designs report the fewest positive training effects. CONCLUSION: Several reasons are discussed to explain the limited findings. Future research may benefit from research methods which focus on factors that inhibit and facilitate the physicians' implementation of skills into actual behaviours in daily practice.     

The stability of maternal ratings of medical student interviews

INTRODUCTION: Little information is available on the intrarater reliability of parent ratings of medical student interview skills. The aim of this study was to compare maternal ratings of a videotaped medical student interview, with ratings by the same mother of the same interview seen a month later. METHOD: Thirty mothers rated 1 of 2 'medical student' interview videotapes (random allocation). An actor played the role of the student and demonstrated different student skill levels in each interview. Mothers rated the same interview again a month later (mean +/- SD 34 +/- 13 days). Maternal satisfaction was measured using the Medical Interview Satisfaction Scale (MISS, maximum score 203) and the Interpersonal Skills Rating Scale (IPS, maximum score 91) with higher scores indicating higher satisfaction. RESULTS: No significant differences in mean maternal ratings were observed following the first and second viewings of each interview. The average percentage difference in first and second viewing scores was MISS 4%, IPS 8% with correlation coefficients MISS 0.96, IPS 0.87 (P < 0.05). CONCLUSIONS: The high levels of stability in maternal evaluations of simulated medical student interviews supports the use of maternal evaluations for longitudinal monitoring of medical student performance.     

Communication Skills Training and Patients' Satisfaction

Effective physician-patient encounters require the doctor to have consulting skills that facilitate communication flow. When adequate communication does not occur, patients express dissatisfaction with their medical interactions. Many medical students show interview behaviors that may not contribute to patients' satisfaction. Poor communication skills reduce the reliability of elicited medical information and lead to reduced satisfaction for both patients and students. In the present study, a communication skills training course was evaluated using ratings of students' videotaped history-taking interviews with patients and patients' satisfaction ratings. Trained students showed significantly improved consultation skills and techniques compared with a group of control students who displayed few changes in behavior over the course of the study. Satisfaction ratings given by patients of students improved significantly after training, whereas ratings given by patients of control group students decreased over the same period.     

General competencies of problem-based learning (PBL) and non-PBL graduates

INTRODUCTION: Junior doctors have reported shortcomings in their general competencies, such as organisational skills and teamwork. We explored graduates' perceptions of how well their training had prepared them for medical practice and in general competencies in particular. We compared the opinions of graduates from problem-based learning (PBL) and non-PBL schools, because PBL is supposed to enhance general competencies. METHOD: We analysed the responses of 1159 graduates from 1 PBL and 4 non-PBL schools to a questionnaire survey administered 18 months after graduation. RESULTS: Compared with their non-PBL colleagues, the PBL graduates gave higher ratings for the connection between school and work, their medical training and preparation for practice. According to the graduates, the most frequently used competencies with sufficient coverage during medical training were expert knowledge, profession-specific skills and communication skills. The majority of the PBL graduates, but less than half of the non-PBL graduates, indicated that communication skills had been covered sufficiently. All the graduates called for more curriculum attention on working with computers, planning and organisation, and leadership skills. More PBL graduates than non-PBL graduates indicated that they had learned profession-specific methods, communication skills and teamwork in medical school. DISCUSSION: Overall, the graduates appeared to be satisfied with their knowledge and skills. The results suggest that the PBL school provided better preparation with respect to several of the competencies. However, both PBL and non-PBL graduates identified deficits in their general competencies, such as working with computers and planning and organising work. These competencies should feature more prominently in undergraduate medical education.     

A controlled study of the short- and long-term effects of a Train the Trainers course

Objectives  This study aimed to establish the longterm effects of a 3-day 'Training for Trainers' course (TTC) on doctors' knowledge, teaching behaviour and clinical learning climate.
Methods  The study was designed as an intervention study with pre-, post- and long-term measurements. The intervention group (I-group) included 118 doctors from the departments of internal medicine and orthopaedic surgery at one university hospital. The control group (C-group) consisted of 125 doctors from the corresponding departments at another university hospital. Gains in knowledge about teaching skills were assessed by a written test. Teaching behaviour and learning climate were evaluated by questionnaires.
Results  In the I-group, 98.4% of doctors, both specialists and trainees, participated in a TTC. Response rates on the written test varied from 90% at baseline to 70% at 6 months after the intervention. Knowledge about teaching skills increased in the I-group by 25% after the TTC and was sustained at 6 months. Questionnaire response rates varied from 98.4% at baseline to 84.8% at 6 months. Post-course, the teaching behaviour of the I-group significantly changed and its learning climate improved compared with the C-group. Scores for use of feedback and supervision in the I-group increased from 4–5 to 6–7 (maximum score = 9). This was significantly higher than in the C-group.
Conclusions  A 3-day residential TTC has a significant impact in terms of gains of knowledge concerning teaching skills, teaching behaviour and learning climate after 6 months. The positive effects demonstrated in this study were rooted in both the specialists and trainees who attended the course.     

Target-focused medical emergency team training using a human patient simulator: effects on behaviour and attitude

CONTEXT: Full-scale simulation training is an accepted learning method for gaining behavioural skills in team-centred domains such as aviation, the nuclear power industry and, recently, medicine. In this study we evaluated the effects of a simulator team training method based on targets and known principles in cognitive psychology. METHODS: This method was developed and adapted for a medical emergency team. In particular, we created a trauma team course for novices, and allowed 15 students to practise team skills in 5 full-scale scenarios. Students' team behaviour was video-recorded and students' attitude towards safe teamwork was assessed using a questionnaire before and after team practice. RESULTS: Nine of 10 observed team skills improved significantly in response to practice, in parallel with a global rating of team skills. In contrast, no change in attitude toward safe teamwork was registered. CONCLUSION: The use of team skills in 5 scenarios in a full-scale patient simulator environment implementing a training method based on targets and known principles in cognitive psychology improved individual team skills but had no immediate effect on attitude toward safe patient care.     

A survey of clinical teaching fellowships in UK medical schools

CONTEXT: Undergraduate medical education in the UK has changed considerably over the last decade. One development has involved the creation of teaching-specific posts for junior doctors by medical schools. These posts are generally termed 'clinical teaching fellowships', but it is not known how many of them exist, or whether they are similar in terms of educational activities, professional development, and research and clinical experience opportunities. METHODS: Teaching deans in all UK medical schools were sent a questionnaire relating to clinical teaching fellowships, and were asked to distribute a second set of different questionnaires to their clinical teaching fellows, which were to be returned to the authors separately. RESULTS: A total of 28 deans and 46 fellows responded. Fifteen medical schools had clinical teaching fellows and there appeared to be a total of 77 such posts in the UK. There was little uniformity in the activities undertaken within the posts. Deans who employed clinical teaching fellows were unanimously positive regarding the posts. Fellows were generally positive but expressed reservations relating to approval for postgraduate training, career development, deterioration in clinical skills, financial disincentives, credibility within one's own specialty, and provision of training and support. CONCLUSIONS: Clinical teaching fellow posts are generally enjoyed by fellows and valued by deans. Fellows carry out differing duties and their training in medical education is variable. The posts can be unstructured and may lack credibility to doctors outside medical education. Providing specific structured training in medical education, recognised at a national level, would help deal with these concerns.     

Can undergraduate education have an effect on the ways in which pre‐registration house officers conceptualise communication?

AIMS: In 1994 Manchester Medical School introduced a learner-centred course using problem-based learning (PBL), which emphasises effective communication skills. This study explored how 2 cohorts of graduates conceptualised communication within their role as pre-registration house officer (PRHOs). METHODS: Graduates from the last year of the traditional and first year of the new course were interviewed 3 months after starting work. They were asked how well their courses had prepared them for working as PRHOs and were given a specific question about communication skills. Interviews were tape-recorded, transcribed, coded and analysed. RESULTS: In all, 24 traditional course graduates (TCGs) and 23 new course graduates (NCGs) were interviewed. Traditional course graduates tended to conceptualise communication as informing people rather than as involving negotiation or having therapeutic effects. Most TCGs considered good communicators 'were born that way' and did not think communication skills could be learned. Many NCGs had a richer concept of communication that recognised communication has therapeutic benefits for patients and involved negotiation. They understood it was possible to teach communication skills. However, a minority of NCGs conceptualised communication in a similar way to TCGs. CONCLUSION: Our study suggests that the new course has helped NCGs acquire a more complex concept of communication in their role as PRHOs.     

Medical students' perceptions of identity in communication skills training: a qualitative study

Objectives  Communication skills training in undergraduate medical education is considered to play an important role in medical students' formation of their professional identity. This qualitative study explores Year 1 students' perceptions of their identities when practising communication skills with real patients.
Methods  A total of 23 individual semi-structured interviews and two focus group discussions were conducted with 10 students during their first year of communication skills training. All interviews and discussions were audio-recorded, transcribed and analysed for emergent themes relating to identity.
Results  Students struggled to communicate professionally with patients because of a lack of clinical knowledge and skills. Consequently, students enacted other identities, yet patients perceived them differently, causing conversational ambiguities.
Discussion  Students' perceptions challenge educational goals, suggesting that there is limited potential for the formation of professional identity through early training. Teacher-doctors must acknowledge how students' low levels of clinical competence and patients' behaviour complicate students' identity formation.     

Senior medical students' appraisal of CanMEDS competencies

CONTEXT: In 2003 the Dutch Central College of Medical Specialties presented guidelines for the modernisation of all medical specialty training programmes in the Netherlands. These guidelines are based to a large extent on the CanMEDS (Canadian Medical Education Directives for Specialists) 2000 model, which defines 7 roles for medical specialists. This model was adjusted to the Dutch situation. The roles were converted to 7 fields of competency: Medical Performance; Communication; Collaboration; Knowledge and Science; Community Performance; Management, and Professionalism. OBJECTIVE: As changes in postgraduate training will probably be most effective if future trainees recognise their value, we set out to determine how senior medical students rated these fields of competency in terms of their importance. METHODS: We carried out a study at University Medical Centre (UMC) Utrecht, the Netherlands, in which 80 Year 6 medical students answered a questionnaire in which they rated the importance of each of 28 key competencies within the 7 competency fields. RESULTS: Although all key competencies were regarded as important (averages > or = 3.8), Professionalism and Communication scored highest on the student ratings. Management was assessed as least important. CONCLUSIONS: It is interesting that medical students acknowledged the importance of competencies other than those involving medical expertise and performance. It confirms the opinion that educating doctors is currently viewed as much more than providing theoretical and clinical knowledge and skills. The CanMEDS framework is appreciated by Dutch medical students. The fact that all competencies are seen as important adds to their face validity and therefore to their usefulness as a basis for postgraduate training.     

Evaluation of a family-oriented continuing medical education course for general practitioners

OBJECTIVE: To explore the long-term effects of a 2-year Family Systems Medicine course. Fifteen experienced GPs participated in the training programme. SETTING: Continuing Education Centre, University of Tampere, Department of Public Health Science and General Practice, University of Oulu, Finland. METHODS: The participants assessed the development of their professional skills on the Doherty-Baird scale and filled in 2 questionnaires. The material obtained from the application form and 2 questionnaires was analysed using the grounded theory method. RESULTS: The reasons for taking part in the course seemed to be the constant increase in the workload, problems caused by the demands for change and adaptation, stress and exhaustion. Furthermore, 10 health centres out of 15 had adopted the population-based practice, which requires different working methods compared to the old routines. Some trainees reported that their family-centred working methods improved during the course. A year after the end of the training, all of the GPs who had participated were using such methods in their daily practice. Half of the participants felt that they had also improved the functioning of their working group by making it more family-oriented. The significance of multi-professional collaboration was one of the most important insights during the course. CONCLUSION: The 2-year family-oriented training programme provided GPs with systemic thinking and with new skills, including the ability to work with families. The programme raised awareness of the need for multi-professional collaboration in the primary care settings.     

Effects of communication skills training on students'' diagnostic efficiency

This study evaluates the impact of a training programme in communications skills on subsequent diagnostic efficiency. Videotaped history-taking interviews conducted by groups of specially trained and control groups of students were rated for their diagnostic efficiency by two medical practitioners. Students in the trained group had shown greatly increased skills in interviewing and interpersonal effectiveness as a result of their training. A comparison of ratings given by the two experimentally naive, independent observers revealed that trained students were significantly better at eliciting full, relevant data from patients--they were diagnostically more efficient, but took no longer than their control group counterparts to elicit the information. Further research with the medical interview rating scale will clarify the skills required of medical students in interviewing and diagnosis and facilitate remedial training for students who show poor interview skills.     

How interdisciplinary teams can create multi-disciplinary education: the interplay between team processes and educational quality

CONTEXT: Many undergraduate medical education programmes offer integrated multi-disciplinary courses, which are generally developed by a team of teachers from different disciplines. Research has shown that multi-disciplinary teams may encounter problems, which can be detrimental to productive co-operation, which in turn may diminish educational quality. Because we expected that charting these problems might yield suggestions for addressing them, we examined the relationships between team diversity, team processes and course quality. METHODS: We administered a questionnaire to participants from 21 interdisciplinary teams from 1 Dutch and 1 German medical school, both of which were reforming their curriculum. An adapted questionnaire on team learning behaviours, which had been validated in business contexts, was used to collect data on team processes, team learning behaviours and diversity within teams. We examined the relationship between the team factors and educational quality measures of the courses designed by the teams. RESULTS: A total of 84 teachers (60%) completed the questionnaire. Bivariate correlation analysis showed that several aspects of diversity, conflict, working climate and learning behaviour were correlated with course quality. CONCLUSIONS: The negative effects of the diversity measures, notably, value diversity, on other team processes and course quality and the positive association between psychological safety and team learning suggest that educational quality might be improved by enhancing the functioning of multi-disciplinary teams responsible for course development. The relationship between team processes and educational quality should be studied among larger study populations. Student ratings should also be considered in measuring educational quality.     

One year's experience with a clinical skills resource centre

OBJECTIVES: To describe our experience of teaching clinical skills to first-year medical students in a new problem-based curriculum. DESIGN: Prospective evaluation of clinical skills acquisition using objective measures. SETTING: Students were taught in a purpose-designed clinical skills resource centre in weekly structured sessions. SUBJECTS: All 210 first year medical undergraduates in the first year of a new problem-based and clinically oriented course. RESULTS: Student performance in structured objective examinations improved over 1 year. In all but one of nine matched stations, involving history, examination and procedural skills, improvements were significant. Ninety-three per cent thought that the appropriateness of the skills training course to other course elements was 'good' or 'very good'. CONCLUSIONS: First-year medical students can learn a wide range of clinical skills. Integrated teaching of clinical skills improves satisfaction with undergraduate studies.     

The effects of a continuing medical education programme in interpersonal communication skills on doctor practice and patient satisfaction in Trinidad and Tobago

This study investigates the effects of a brief training programme on the communication skills of doctors in ambulatory care settings in Trinidad and Tobago. Evaluation of doctor performance is based on analysis of audiotapes of doctors with their patients during routine clinic visits and on patient satisfaction ratings. A pre-test/post-test quasi-experimental study design was used to evaluate the effects of exposure to the training programme. Doctors were assigned to groups based on voluntary participation in the programme. Audiotapes of the 15 participating doctors (nine trained and six control) with 75 patients at baseline and 71 patients at the post-training assessment were used in this analysis. The audiotapes were content-coded using the Roter Interaction Analysis System (RIAS). Doctors trained in communication skills used significantly more target skills post-training than their untrained colleagues. Trained doctors used more facilitations in their visits and more open-ended questions than other doctors. There was also a trend towards more emotional talk, and more close-ended questions. Patients of trained doctors talked more overall, gave more information to their doctors and tended to use more positive talk compared to other patients. Trained doctors were judged as sounding more interested and friendly, while patients of trained doctors were judged as sounding more dominant, responsive and friendly than patients of untrained doctors. Consistent with these communication differences, patient satisfaction tended to be higher in visits of trained doctors.