Consulting skills training and medical students' interviewing efficiency

In more traditional medical education, medical students took a patient's medical history by asking a series of sequenced, routine questions, covering presenting medical problem(s); medical history; social and personal history; systems review; and physical examination. Following this process, the student then attempted to derive the patient's medical problems. This inductive problem-solving paradigm may not assist students to prepare for their future interviewing needs, given doctors use a hypothetico-deductive, problem-solving approach when interviewing patients and numerous researchers have developed specialized communication skills training programmes designed to enhance students' interviewing skills. Students given specific consulting skills training have tended to show significantly greater interpersonal effectiveness and improved interview behaviours compared with students who experience traditional patient clerking training. These improvements in interviewing tend to persist over the period of students' medical training. The aim of the present study was to determine whether specialized communication skills training helped students elicit greater quantity and quality of information from patients and if so, whether such information assisted students in improving their diagnostic skills. Videotaped history-taking interviews conducted by students trained in communication skills and untrained (control) students were rated for their interview efficiency. A comparison of ratings given by experimentally naive, independent observers revealed that trained students were more efficient, but took no longer than their control group counterparts to elicit fuller, more relevant information. However, the student groups did not differ in the accuracy or scope of their medical diagnoses. It is argued that students' lack of medical knowledge in this early phase of their clinical training militated against their being able to use their interviewing competence to derive more potentially accurate medical diagnoses.     

Sources of variation in performance on a shared OSCE station across four UK medical schools

Context  High-stakes undergraduate clinical assessments should be based on transparent standards comparable between different medical schools. However, simply sharing questions and pass marks may not ensure comparable standards and judgements. We hypothesised that in multicentre examinations, teaching institutions contribute to systematic variations in students' marks between different medical schools through the behaviour of their markers, standard-setters and simulated patients.
Methods  We embedded a common objective structured clinical examination (OSCE) station in four UK medical schools. All students were examined by a locally trained examiner as well as by a centrally provided examiner. Central and local examiners did not confer. Pass scores were calculated using the borderline groups method. Mean scores awarded by each examiner group were also compared. Systematic variations in scoring between schools and between local and central examiners were analysed.
Results  Pass scores varied slightly but significantly between each school, and between local and central examiners. The patterns of variation were usually systematic between local and central examiners (either consistently lower or higher). In some cases scores given by one examiner pair were significantly different from those awarded by other pairs in the same school, implying that other factors (possibly simulated patient behaviour) make a significant difference to student scoring.
Conclusions  Shared undergraduate clinical assessments should not rely on scoring systems and standard setting which fail to take into account other differences between schools. Examiner behaviour and training and other local factors are important contributors to variations in scores between schools. The OSCE scores of students from different medical schools should not be directly compared without taking such systematic variations into consideration.     

Effects of communication skills training on students'' diagnostic efficiency

This study evaluates the impact of a training programme in communications skills on subsequent diagnostic efficiency. Videotaped history-taking interviews conducted by groups of specially trained and control groups of students were rated for their diagnostic efficiency by two medical practitioners. Students in the trained group had shown greatly increased skills in interviewing and interpersonal effectiveness as a result of their training. A comparison of ratings given by the two experimentally naive, independent observers revealed that trained students were significantly better at eliciting full, relevant data from patients--they were diagnostically more efficient, but took no longer than their control group counterparts to elicit the information. Further research with the medical interview rating scale will clarify the skills required of medical students in interviewing and diagnosis and facilitate remedial training for students who show poor interview skills.     

Can student tutors act as examiners in an objective structured clinical examination?

Context  The dissemination of objective structured clinical examinations (OSCEs) is hampered by requirements for high levels of staffing and a significantly higher workload compared with multiple-choice examinations. Senior medical students may be able to support faculty staff to assess their peers. The aim of this study is to assess the reliability of student tutors as OSCE examiners and their acceptance by their peers.
Methods  Using a checklist and a global rating, teaching doctors (TDs) and student tutors (STs) simultaneously assessed students in basic clinical skills at 4 OSCE stations. The inter-rater agreement between TDs and STs was calculated by kappa values and paired t -tests. Students then completed a questionnaire to assess their acceptance of student peer examiners.
Results  All 214 Year 3 students at the University of Göttingen Medical School were evaluated in spring 2005. Student tutors gave slightly better average grades than TDs (differences of 0.02–0.20 on a 5-point Likert scale). Inter-rater agreement at the stations ranged from 0.41 to 0·64 for checklist assessment and global ratings; overall inter-rater agreement on the final grade was 0.66. Most students felt that assessment by STs would result in the same grades as assessment by TDs (64%) and that it would be similarly objective (69%). Nearly all students (95%) felt confident that they could evaluate their peers themselves in an OSCE.
Conclusions  On the basis of our results, STs can act as examiners in summative OSCEs to assess basic medical skills. The slightly better grades observed are of no practical concern. Students accepted assessment performed by STs.     

The effectiveness of immediate feedback during the Objective Structured Clinical Examination

Using eight different physical examination or technical stations, 400 examinations were conducted to evaluate the effectiveness of immediate feedback during the Objective Structured Clinical Examination (OSCE). The test group comprised 50 medical students who underwent a standard 4-minute examination followed by 2 minutes of feedback. Immediately following feedback the students repeated an identical 4-minute examination scored by the same examiners. The control group consisted of 50 students from the same class who underwent an identical testing sequence, but instead of receiving feedback, they were instructed to continue their examinations for an additional 2 minutes before repeating the stations. Simple repetition of the task did not significantly improve score (mean increase 2.0%, NS). Extending the testing period from 4 to 6 minutes resulted in a small but significant increase in score (mean 6.7%, P less than 0.001). However, there was a much larger increase in the scores obtained following 2 minutes of immediate feedback compared to pre-feedback performance (mean 26.3%, P less than 0.0001). The majority of students and examiners felt that feedback, as administered in this study, was valuable both as a learning and teaching experience. Short periods of immediate feedback during an OSCE are practical and can improve competency in the performance of criterion-based tasks, at least over the short term. In addition, such feedback provides students with valuable self-assessment that may stimulate further learning.     

Teaching and assessing clinical skills: a competency-based programme in China

The objective of this study was to develop a compentency-based clinical skills teaching and assessment programme in China utilizing modern teaching techniques. Medical teachers from three schools agreed on items for inclusion in the complete physical examination of an asymptomatic adult, an outline for an adult and paediatric history, and important interviewing skills. Lesson plans, performance checklists, and written and videotape training materials were developed. Standardized patients were trained at one school to assist with the teaching at that school and with the assessment at all three schools. A national, a provincial, and a local medical school in China were used. Before beginning the new curriculum for students in their first year of clinical training, baseline data were collected on skills of students at various levels of training in the previous curriculum at all three schools. Although in the previous curriculum there was some improvement in clinical skills among advanced compared to more junior students, performance was lower than expected by staff. One year after implementation of the new curriculum, students were evaluated. These students significantly outperformed their counterparts as well as the more senior level students tested the previous year. This project has established a competency-based teaching and assessment programme in China that allows for rapid improvement in the clinical skills of students. Within a short time, a sophisticated group of medical educators has been formed, who now function as consultants to other educators in their own country. Many aspects of this programme are being adapted throughout China and are applicable to medical schools throughout the world.     

Measuring clinical competence of medical students

Evidence of clinical competence for medical students entering the clinical clerkships at the University of Kansas College of Health Sciences is established by passing two different examinations: a 100 item multiple choice examination and a videotaped history and physical examination by each student of a simulated patient, being rated by that patient and two examiners. In 1976 the class of 196 medical students took an average 1.85 written examinations per student. With 70% or better constituting a passing score, 30.6% passed on the first attempt, 55.6% the second, 11.2% the third and 2.5% the fourth. Each student passed the televised practical examination and had the opportunity to review his or her videotape with a critiqued data base and the examiners' and simulated patient's evaluations in hand. Correlation coefficients for all 196 students between scores of written examinations, medicine tutors, examiners and professional patients revealed weak but significant correlations between the assessments of examiners and medical tutors and assessments of examiners and written examination scores, but not between other evaluations. This scheme of proof of competence appears to be objective and direct, and serves the convenience of both students and teaching staff.     

The surgical clerkship: characteristics of the effective teacher

A good relationship between medical students and clinicians is crucial to a positive learning experience. To increase contact between surgical teaching staff and students, a teacher programme was instituted in the problem-based surgical clerkship at the University of Kentucky. This study examined the teacher traits and skills that medical students perceive as distinguishing effective from ineffective teachers. The 312 evaluations collected from students in successive surgical clerkship rotations (87% response rate) were used to determine the characteristics of the effective teacher. Results suggest that students rate increased contact with surgical teaching staff highly and that they value increased mentoring by the staff. The traits of teachers rated highly by students in the surgical clerkship include: being a positive role model, encouraging communication, and being well organized. Comparing data from the 2 years of the clerkship also revealed that providing feedback to staff on their performance as teachers enabled them to improve their instructional skills.     

Medical education and experience affecting intra-observer variability

Intra-observer variability for history and simple test evaluation was assessed in a group of 10 final-year medical students and in five senior hospital staff members. Substantial agreement between the results of two evaluations made 7-10 days apart was found in 20 out of 30 instances for staff and in 17 out of 60 instances for students. However, there were instances when variability seemed to be unrelated to the academic standard of students or to the training and experience of staff. It is concluded that the nature of diagnostic procedure and present training in medical school or long-term experience may not be the only factors that affect intra-observer variability in everyday simple diagnostic applications.     

Short-term outcomes and long-term impact of a programme in medical education for medical students

Objectives  There is growing appreciation of the value of early preparation of future medical educators. Staff development programmes, conferences and workshops pertaining to the training of educators may be crucial to the pursuit of a school's larger educational mission to educate students, doctors and scholars and to provide comprehensive knowledge, research, patient care and service. This study examined the efficacy of a 1-week educational intervention aimed at preparing medical students to become effective doctor educators by building skills early in their careers. The study asked whether participation in a 5-day teacher training programme led to increased knowledge of instructional methods, more favourable attitudes towards teaching, and the integration of structured instructional design methods in a student-developed teaching project.
Methods  A mixed methods research design was employed with quantitative data captured through pre- and post-test inventories, qualitative components captured through written comments, and a 2-year post-intervention survey. Quantitative analyses included pre-/post-intervention repeated measures with calculated effect sizes. Qualitative analysis was conducted using constant comparative methods.
Results  Subjects demonstrated improved content knowledge and more positive attitudes towards motivation, teaching confidence, teacher roles, varied pedagogy, and use of assessment, instructional planning, and evaluation. Subjects were able to incorporate the programme's teaching theory and methods into their teaching projects and assessment of peers' and others' teaching in their own institutions 2 years post-training.
Conclusions  This study demonstrates that a well-designed programme for teacher preparation can be pedagogically effective for training medical students to become better educators and that this learning can be incorporated into long-term practice.     

Peer-assisted versus faculty staff-led skills laboratory training: a randomised controlled trial

Objectives Although peer‐assisted learning (PAL) is widely employed throughout medical education, its effectiveness for training in technical procedures in skills laboratories has been subject to little systematic investigation. We conducted a prospective, randomised trial to evaluate the hypotheses that PAL is effective in technical skills training in a skills laboratory setting, and PAL is as effective as faculty staff‐led training. Methods Volunteer Year 3 medical students were randomly assigned to one of three groups. Two of these received regular skills training from either cross‐year peer tutors or experienced faculty staff. Following training, both groups were assessed using an objective structured clinical examination (OSCE) (three stations assessing various injection techniques) which was video‐recorded. Two independent video assessors scored the OSCEs using binary checklists and global ranking forms. A third student group was assessed prior to training and served as a control group. Results A total of 89 students (mean age 23.0 ± 0.2 years; 41 male, 48 female) agreed to participate in the trial. Confounding variables including prior training as a paramedic or previous experience in performing the technical procedures did not significantly differ between the three study groups. In the OSCE, PAL (58.1 ± 1 binary points, 4.9 ± 0.1 global ranking points) and faculty‐led groups (58.3 ± 1 binary points, 4.7 ± 0.1 global ranking points) scored significantly higher than the control group (33.3 ± 1 binary points, 2.7 ± 0.1 global ranking points; all P < 0.0001). There was no significant difference between the PAL and faculty‐led groups (P = 0.92 for binary checklists, P = 0.11 for global rankings). Conclusions Peer‐assisted learning is a successful method for learning technical procedures in a skills laboratory setting and can be just as effective as the training provided by experienced faculty staff.     

Pelvic manikins as learning aids

The use of pelvic trainers in undergraduate teaching was evaluated, using a questionnaire based on examination findings of a series of four pelvic trainers by 20 medical students and 34 gynaecologists. The main outcome measures were the ability to correctly identify pelvic findings in the trainers, and the numbers of false positive findings. There were two adnexal masses in two of the trainers. One was correctly identified by 33 (14 (70%) medical students and 19 (56%) doctors) in one trainer, whereas the other was missed by 52 of 54 examiners. Prolapse was missed by 41 of 54. The normal pelvis was correctly identified by 30 (16 (80%) medical students and 20 (59%) doctors. There were 15 false positive identifications of adnexal masses (6 by medical students and 9 by doctors) and 22 false positive identification of uterine enlargements (5 by medical students and 17 by doctors). The pelvic trainers were of value in demonstrating the process of pelvic and speculum examination. Some of the clinical conditions emulated were missed by most of the gynaecologists, suggesting that they were not suitable for training students in abnormal findings. Although the figures were not statistically significant, there was a trend for qualified doctors rather than medical students to make false positive findings.     

Does learning emergency medicine equip medical students for ward emergencies?

The aim of this study was to assess the competence of senior medical students in recognizing and managing life-threatening ward emergencies and to compare the competence of a group that had received emergency medicine teaching with one that had not.
This was achieved by asking 60 final year medical students to complete a structured written clinical examination designed to test these skills. Comparisons were made between the group that had received emergency medicine teaching (the 'taught' group) and that which had not (the 'untaught' group) with respect to numerical scores on the examination and the number of fatal management errors committed.
The 'taught' group had an average total score of 285/400 compared with an average score of 223/400 for the 'untaught' group ( P < 0.001). The 'untaught' group committed 0.25 fatal errors per student per case compared with the 'taught' group that committed 0.06 fatal errors per student per case ( P < 0.001).
There is considerable scope to improve the competence of senior medical students for dealing with life-threatening ward emergencies. Students who had received emergency medicine teaching scored significantly better than those who had not suggesting that emergency medicine teaching is a suitable tool to help equip medical students to deal with life threatening ward emergencies.     

Medical teaching—help or hindrance?

The paper describes an ongoing research study into the learning practices of medical students. Responses from structured interviews of forty-four (20%) first-year students at the University of New South Wales indicate that they work long hours, use few resources, consult little with teaching staff, co-operate a lot with each other and see themselves as responsible for their own learning. It is suggested that teacher training activities should take more notice of the actual learning practices of students if teachers and students are not to become confused and disillusioned.     

The essential role of the student in curriculum planning

Medical school curricula are planned, written and organized by academic and clinical staff within medical schools. While these medical educators may well be experts in their given field, they lack first-hand experience of what it is to be a medical student in 1995. For a medical curriculum to be an effective means of learning for today's students, it must be written with a knowledge of their priorities, needs and abilities. The way in which this can be best achieved is by the inclusion of current students in all stages of designing a new curriculum.
In my second year of medicine at Flinders University, I became involved in planning for the new Graduate Entry curriculum. In the role of student advocate, I have found I am able to offer teaching staff a unique perspective, the student perspective , on various issues.
Students, through experience from their own education, are able to give advice on student resources and facilities and are in a favourable position to judge other aspects of curricula, such as the balance and relevance of course content and assessment. Students need to realize the valuable insight they have to offer their faculties and the way in which this can benefit future students. It is by actively seeking student involvement and using their input, that faculties will be able to create a consumer-friendly curriculum.     

The influence of gender and specialty on reporting of abusive and discriminatory behaviour by medical students, residents and physician teachers

INTRODUCTION: The perception of whether a given behaviour is abusive differs between students and teachers. We speculated that attitudes towards reporting abusive and discriminatory behaviour may vary by specialty as well as by gender. METHODS: We report a cross-sectional survey of incoming medical students, medical students, residents, and teaching faculty at one Canadian medical school. The discrimination and abuse questions were in the following domains: (i) psychological abuse, (ii) sexual abuse, (iii) physical abuse, (iv) gender discrimination, (v) racial discrimination, (vi) disability discrimination, (vii) derogatory remarks regarding homosexuality. The frequency of self-reported witnessed or experienced abusive and discriminatory behaviour was compared by gender, specialty choice and stage of training. RESULTS: The response rates varied by respondent group: 44/56 (79%) of incoming medical students, 177/218 (81%) of medical students, 134/206 (65%) of residents and 215/554 (38%) of physician teachers. The frequency of these behaviours was perceived to be low by both male and female respondents. Abusive and discriminatory behaviour by physician teachers was noted more frequently by residents (P < 0.001) and physician teachers themselves (P < 0.001) compared with incoming medical students. As well, in general, women noted more abusive and discriminatory behaviour by all teachers, compared with men (P < 0. 003). Each response to the abuse/discrimination questions was also modelled as the independent variable using stepwise multiple regression. The area of specialization (surgical versus non-surgical) altered the reporting of abusive and discriminatory behaviour by women. CONCLUSION: We conclude that female surgical residents and medical students undergo a process of acclimatization to the patriarchal surgical culture. As female surgeons become physician teachers they revert to a culture more similar to that of their female non-surgical colleagues. Although a process of deidealization occurs in medical training, these attitudes are not necessarily retained throughout the practising lifetime of physicians as they regain autonomy and more personal control.     

Working patterns and the quality of training of medical house officers: evaluating the effect of the `new deal'

The `new deal' on junior doctors' hours of work has led to the widespread introduction of working patterns such as full shifts and partial shifts in the United Kingdom. The impact of these changes on the training of medical staff is unclear. The subjects of the current study were 36 pre-registration medical house officers working shift rotas and on-call rotas at a teaching hospital in the north of England. They were studied over a 12-month period using a self-report questionnaire seeking their views on the quality of their training experience and their satisfaction with the in-service training they received. Nursing staff, consultant and medical student opinion was also sought. Partial-shift and full-shift systems led to reduced hours of work when compared to on-call rotas (mean hours: partial shift 65·0; full shift 59·8; on-call 72·7), but they were associated with significantly lower training experience and training satisfaction scores for the house officers than were on-call systems (P < 0·01). Shift systems were unpopular among consultants and medical students but not nursing staff. Despite reducing excessive hours of work, shifts may be detrimental to the training of medical house officers. The further imposition of shift working should be suspended until such time as the impact of new working patterns on the training of medical staff has been determined.     

Attending rounds on in-patient units: differences between medical and non-medical services

Summary. The objective of this cross-sectional observational study was to quantify communication patterns between teachers and trainees on in-patient attending ward rounds and assess trainees' perceptions of the effectiveness of teaching interactions. Sixty-nine in-patient ward rounds on medical and non-medical teaching services at a university hospital and its affiliated VA Medical Center were studied. Teaching rounds were observed and audiotaped, and trained raters coded verbal interchange for its location, speaker identity and topic of the exchange. One to three days following the teaching rounds, residents and students were interviewed and completed a questionnaire concerning recollections of the content of the session. Medical rounds lasted a mean of 90 minutes, while non-medical rounds averaged 38 minutes. Medical teams spent more time than non-medical teams on case presentations and discussions of diseases not directly related to patient care. Both groups averaged approximately 10 minutes directly interacting with patients, and equal times were spent speaking by the teacher and trainees. The role of postgraduate year 1 residents and medical students primarily was to recite details of patients' clinical condition. Twenty-nine per cent of trainees were unable to recall a specific teaching point from rounds when interviewed 1–3 days later. Duration and content of in-patient rounds differed on medical and non-medical services. For both, discourse tended to be hierarchical, with those at different training levels adhering to specific roles. Bedside patient interactions were limited. The content recalled by students and house staff suggests that new, more effective educational paradigms are needed.     

Effects of basic clinical skills training on objective structured clinical examination performance

OBJECTIVES: The aim of curriculum reform in medical education is to improve students' clinical and communication skills. However, there are contradicting results regarding the effectiveness of such reforms. METHODS: A study of internal medicine students was carried out using a static group design. The experimental group consisted of 77 students participating in 7 sessions of communication training, 7 sessions of skills-laboratory training and 7 sessions of bedside-teaching, each lasting 1.5 hours. The control group of 66 students from the traditional curriculum participated in equally as many sessions but was offered only bedside teaching. Students' cognitive and practical skills performance was assessed using Multiple Choice Question (MCQ) testing and an objective structured clinical examination (OSCE), delivered by examiners blind to group membership. RESULTS: The experimental group performed significantly better on the OSCE than did the control group (P < 0.01), whereas the groups did not differ on the MCQ test (P < 0.15). This indicates that specific training in communication and basic clinical skills enabled students to perform better in an OSCE, whereas its effects on knowledge did not differ from those of the traditional curriculum. CONCLUSION: Curriculum reform promoting communication and basic clinical skills are effective and lead to an improved performance in history taking and physical examination skills.     

Surgical skills training: simulation and multimedia combined

CONTEXT: Basic surgical skills are needed throughout the medical profession, but current training is haphazard and unpredictable. There is increasing pressure to provide transparency about training and performance standards. There is a clear need for inexperienced learners to build a framework of basic skills before carrying out surgical procedures on patients. Effective learning of a skill requires sustained deliberate practice within a cognitive framework, and simulation offers an opportunity for safe preparation. OBJECTIVES: This paper presents a new approach to basic surgical skills training, where tuition using a specially designed computer program is combined with structured practice using simulated tissue models. This approach to teaching has evolved from practical experience with surgical skills training in workshops. METHODS: Pilot studies with 72 first-year medical students highlighted the need for separate programs for teaching and for self-directed learning. The authors developed a training approach in the light of this experience. Subsequent in-depth observational and interview studies examined (a) individual teaching sessions between surgical teachers and learners (five consultant surgeons and five senior house officers) and (b) group teaching sessions with general practitioners (14 participants in three group interviews). Further work has resulted in a self-directed learning program. CONCLUSIONS: Qualitative analysis of observational and interview data provides strong preliminary support for the effectiveness of this approach. The response of teachers and learners was extremely positive. The combination of information (presented by computer) and practice of psychomotor skill (using simulated tissue models) could be extended to other surgical and practical skills.