The importance of race in medical student performance of an AIDS risk assessment interview with simulated patients

INTRODUCTION: This study was done to ascertain the effect of race on medical student-patient communication. The primary hypothesis was that interviewing performance scores would be higher when race of student and race of simulated patient instructor (SPI) were concordant than when they were discordant. METHODS: Data obtained from student interactions with four Caucasian and four African American female SPIs participating in a case involving an AIDS risk assessment interview were analysed. Performance was assessed using two instruments: an 8-item behaviourally anchored interviewing skills scale and a 14-item checklist reflecting content relevant to sexual behaviour and AIDS risk. SPI groups were comparable and SPIs were trained to a high level of inter-rater reliability. Students (24 African American and 180 non-African American) were assigned to SPIs based on the spelling of the student's name. Performance was scored independently at the conclusion of each interview by both the SPI and the student her/himself. RESULTS: African American students had lower scale scores than non-African American students in interactions with Caucasian (but not African American) SPIs; and all student scores, both on the skills scale and the content checklist, were higher with African American than with Caucasian SPIs (as assessed by both SPI and student). Women students had higher scores than men. CONCLUSIONS: Race of SPI has an influence on student performance of an AIDS risk assessment interview. Further studies focusing on racial interactions in the medical interview are required. It appears that race of SPI may need to be accounted for in the development and interpretation of SPI-based clinical competence exams.     

Medical student interviewing skills and mother-reported satisfaction and recall

BACKGROUND: Providing feedback to medical students about their interviewing skills is an important component of teaching programmes. There is very little information about mothers' views of medical student consultations in paediatrics, and in particular about what mothers consider to be the key elements of a successful consultation. Patient-centred interviewing is a model which emphasizes the active seeking of patient views. In association with appropriate clinical skills, it is reported to promote improved health outcomes. OBJECTIVES: To examine whether greater medical student clinical competence and more frequent use of patient-centred techniques is associated with higher maternal satisfaction, higher maternal rating of the medical student's interpersonal skills, and greater maternal recall of relevant diagnosis and treatment recommendations. METHOD: Two standardized 'medical student' videotaped interviews were created based on actual senior medical student consultations. Interview A demonstrated both higher student clinical competence and higher patient-centredness compared with interview B. Both videotaped interviews were viewed and then rated, using a questionnaire, by 11 mothers attending a teaching general practice. RESULTS: Significantly higher mean scores, indicating greater maternal satisfaction, were associated with interview A (P < 0.01 for all measures). Accurate recall for diagnosis and management was also significantly greater after interview A (mean diagnosis recall, interview A 35%, interview B 14%, P < 0.01; mean management recall, interview A 95%, interview B 57%, P < 0.01). CONCLUSIONS: Maternal satisfaction and recall were higher following a more clinically competent and patient-centred medical student interview. Maternal ratings of student interviews could be used as an additional method of assessment as well as providing feedback to medical students on their interview skills development.     

The rise and fall of students' skill in obtaining a medical history

A gradual shift towards a more humanistic conception of medicine has occurred in recent years. Along with this shift have come attempts by medical educators to include interviewing and communication skills as part of the medical curriculum. The current study evaluates the effectiveness of a clinical medicine curriculum which emphasizes interviewing skills. Between 1992 and 1994 the 292 graduates of the University of Connecticut School of Medicine participated in five clinical skills teaching and assessment programmes during the four years of medical school. During each of these five programmes, the students' interviewing skills were rated using the Arizona Clinical Interview Rating Scale (ACIR). The raters were standardized patients with whom they had just completed a medical encounter. Results show that students' development of skills differed, with closure items showing the greatest increase and social history items showing the greatest decline, with an overall initial increase and then a decline in interviewing skills over the four years. Explanations for these findings include the de-emphasis of communication skills during the clinical years and the culture of medicine to which students are exposed during these years.     

Teaching patient communication skills to medical students: a review of randomized controlled trials

Tools to examine the effects of teaching interventions across a variety of studies are needed. The authors perform a meta-analysis of 24 randomized controlled trials evaluating the effects of teaching on medical students' patient communication skills. Study quality is rated using a modified Jadad score, and standardized mean difference effect size (d) measures are calculated. Fifteen of 24 studies have sufficient data for analysis. Students' ability to establish rapport improves after teaching. The effects are large when the teaching intervention was small group discussion (n = 5) or giving structured feedback on a student-patient interview (n = 6). A similar effect of teaching is seen on student data gathering skills (n = 5). Teaching medical students patient communication skills using small group discussion or providing feedback on a student-patient interview results in improvement in student performance.     

Reproducibility of clinical performance assessment in practice using incognito standardized patients

BACKGROUND: The reproducibility of authentic assessment methods has been investigated for objective structured clinical examinations (OSCEs) and video assessment in general practice, but not for assessment with incognito standardized patients. PURPOSE: To investigate the reproducibility of assessment with incognito standardized patients. METHODS: A total of 27 Dutch rheumatologists in 16 hospitals were each visited by 8 incognito standardized patients presenting with different rheumatological disorders. After each visit, the standardized patient completed a case-specific checklist containing items on medical history, physical examination and management. Over a 20-month period, 254 incognito visits took place, of which 201 were first visits. The standardized patient was detected by the rheumatologist in 2 cases only. These encounters were not included in the analysis. Generalizability theory was used to investigate the reproducibility of the assessment. RESULTS: One fifth of the variance can be attributed to variation between rheumatologists. The largest variance is due to the variation in difficulty among cases. A reproducible assessment requires 3 hours of testing time (6 cases) if it is obtained through a norm-referenced interpretation of scores and 7 hours of testing time (14 cases) if it is obtained through an absolute interpretation of scores. CONCLUSION: The reproducibility of performance assessment in clinical practice by incognito standardized patients is similar to that of other authentic measurements for the assessment of clinical competence and performance.     

Consulting skills training and medical students' interviewing efficiency

In more traditional medical education, medical students took a patient's medical history by asking a series of sequenced, routine questions, covering presenting medical problem(s); medical history; social and personal history; systems review; and physical examination. Following this process, the student then attempted to derive the patient's medical problems. This inductive problem-solving paradigm may not assist students to prepare for their future interviewing needs, given doctors use a hypothetico-deductive, problem-solving approach when interviewing patients and numerous researchers have developed specialized communication skills training programmes designed to enhance students' interviewing skills. Students given specific consulting skills training have tended to show significantly greater interpersonal effectiveness and improved interview behaviours compared with students who experience traditional patient clerking training. These improvements in interviewing tend to persist over the period of students' medical training. The aim of the present study was to determine whether specialized communication skills training helped students elicit greater quantity and quality of information from patients and if so, whether such information assisted students in improving their diagnostic skills. Videotaped history-taking interviews conducted by students trained in communication skills and untrained (control) students were rated for their interview efficiency. A comparison of ratings given by experimentally naive, independent observers revealed that trained students were more efficient, but took no longer than their control group counterparts to elicit fuller, more relevant information. However, the student groups did not differ in the accuracy or scope of their medical diagnoses. It is argued that students' lack of medical knowledge in this early phase of their clinical training militated against their being able to use their interviewing competence to derive more potentially accurate medical diagnoses.     

Promoting diagnostic problem representation

PURPOSE: Problem representation, as mediated by semantic qualifiers (SQs), has been associated with better diagnostic outcomes. The purpose of this study was to assess the effect of training medical students to use semantic abstractions as a means of building problem representations. METHODS: Sixty second-year medical students were assigned to either an intervention group (n = 20) or a control group (n = 40) during 8 months of an Essentials in Clinical Medicine course which used standardized patient-based workshops. Students were trained to transform findings into SQs and to use abstractions to compare and contrast diagnostic hypotheses. Students were assessed using a standardized patient data collection checklist, a post-encounter patient finding questionnaire (PFQ), and case summaries and write-ups. RESULTS: Experimental subjects used over twice as many SQs in their summaries as control group members (1.40 versus 0.63, P = 0.006). The correlation between checklist and PFQ scores was higher for the experimental group than for the control group (r = 0.70 versus r = 0.58, P 0.56). CONCLUSION: A short instructional intervention was successful in promoting the use of SQs and enabled students to recall elicited findings better. This intervention did not enhance data interpretation and diagnostic accuracy. Use of SQs may therefore be a necessary tool for efficient problem representation but one that is insufficient when used in isolation. The naturalistic setting used in this study imposed a number of limitations, implying that further research should test whether instructional efforts should also emphasize recognition of key patient findings and knowledge representation.     

Does observation add to the validity of the long case?

BACKGROUND: A London medical school final MBBS examination for 155 candidates. OBJECTIVE: To investigate whether observing the student-patient interaction in a history taking (HT) long case adds incremental information to the traditional presentation component. DESIGN: A prospective study of a HT long case which included both examiner observation of the student-patient interview (Part 1) and traditional presentation to different examiners (Part 2). Checklist and global ratings of both parts were compared. Examiners were paired to estimate inter-rater reliability. The students also took a 20 station Objective Structured Clinical Examination (OSCE). OUTCOME MEASURES: Correlation of (I) examiner ratings for observation and presentation of the HT long case (II) examiner pair ratings and (III) stepwise regression analysis of scores for the HT long case with OSCE scores. RESULTS: Seventy-five (48.4%) candidates had two examiner pairs marking their case history. Observation and presentation scores correlated poorly (checklist 0.38 and global 0.33). Checklist and global scores for each part correlated at higher levels (observation 0.64 and presentation 0.61). Inter-rater reliability correlations were higher for observation (checklist 0.72 and global 0.71) than for presentation (checklist 0.38 and global 0.60). When HT long case scores were correlated with OSCE scores, using stepwise regression, global presentation scores showed the highest correlation with the OSCE score (0.36) and the global observation score contributed a further 12% to the correlation (0.50). CONCLUSION: Observation of history taking in a long case appears to measure a useful and distinct component of clinical competence over and above the contribution made by the presentation.     

Interprofessional clinical education of medical and pharmacy students

Pharmacists have become increasingly involved in influencing prescribing. Pharmaceutical education has changed accordingly, with increased teaching in therapeutics, partly on hospitals wards, giving students an insight into diseases and helping communication with clinicians. To extend this idea we have designed joint therapeutics teaching sessions with pharmacy and medical students. The scheme involves final year pharmacy students who have completed a course in clinical pharmacy and medical students who have completed their second MB. Interdisciplinary pairs of students are assigned a patient with common medical and therapeutic problems, such as arthritis, diabetes and cardiac failure; patients on multiple drug treatments are preferred. They jointly obtain a history: the medical student performs basic clerking, while the pharmacy student obtains the medication history. The medical student subsequently presents a brief medical history, with a summary of the patient's current problems. For each problem, the pharmacy student presents the current therapy, its rationale and how it is to be monitored. Experience with 73 students over 3 years has shown that almost all found sessions with students from another discipline useful. Few felt that members of the pairs contributed unequally. The main problem appeared to be insufficient time (although 2 1/2 h were allowed). Most students favoured more such sessions. Little difference in ability appeared between the two disciplines; there was considerable co-operation and little nascent 'professional rivalry'. The medical students were more comfortable interviewing patients, and the pharmacy students more confident analysing drug therapy. It is concluded that such interdisciplinary sessions are a successful method of clinical teaching and should be encouraged.     

Medical students' essay-writing skills: criteria-based self- and tutor-evaluation and the role of language background

OBJECTIVES: An exercise is described which aimed to make clear to first-year undergraduate medical students the expected writing skills required for an essay examination in one discipline. SUBJECTS: Many students were from a non-English speaking background and over one-third of students, regardless of language background, had limited experience in this type of essay writing. PROCEDURE: For this exercise, a practice essay was written by each student for formative assessment. The essay was rated by a tutor and by the student according to well-defined criteria. This allowed for comparisons to be made in a structured and objective way between the judgements of the student and the assessor. RESULTS: Students found the exercise to be very useful, although whether essay writing skills actually improved could not be established. Students from non-English speaking backgrounds tended to be most harsh in their self-evaluations, yet tutor-evaluations generally showed these students to have better writing skills than other students. Indeed, correlations between self- and tutor-evaluations were quite low. CONCLUSIONS: It is evident that students and their educators may be unclear about each others' expectations. By making explicit the requirements of an exercise, misunderstandings may be minimized and it is possible that student performance could improve, though further research is required to verify these hypotheses. It is suggested that students should be encouraged to evaluate their own work and should be instructed in writing skills throughout their medical degree education.     

Teaching and assessing clinical skills: a competency-based programme in China

The objective of this study was to develop a compentency-based clinical skills teaching and assessment programme in China utilizing modern teaching techniques. Medical teachers from three schools agreed on items for inclusion in the complete physical examination of an asymptomatic adult, an outline for an adult and paediatric history, and important interviewing skills. Lesson plans, performance checklists, and written and videotape training materials were developed. Standardized patients were trained at one school to assist with the teaching at that school and with the assessment at all three schools. A national, a provincial, and a local medical school in China were used. Before beginning the new curriculum for students in their first year of clinical training, baseline data were collected on skills of students at various levels of training in the previous curriculum at all three schools. Although in the previous curriculum there was some improvement in clinical skills among advanced compared to more junior students, performance was lower than expected by staff. One year after implementation of the new curriculum, students were evaluated. These students significantly outperformed their counterparts as well as the more senior level students tested the previous year. This project has established a competency-based teaching and assessment programme in China that allows for rapid improvement in the clinical skills of students. Within a short time, a sophisticated group of medical educators has been formed, who now function as consultants to other educators in their own country. Many aspects of this programme are being adapted throughout China and are applicable to medical schools throughout the world.     

The effect of a Structured Question Grid on the validity and perceived fairness of a medical long case assessment

PROBLEM: A perception that the reliability of our oral assessments of clinical competence was vitiated by lack of consistency in questioning. DESIGN: Parallel group controlled trial of a Structured Question Grid for use in clinical assessments. The Structured Question Grid required assessors to see the patient personally in advance of the student and to write down for each case the points they wished to examine. The Structured Question Grid limited assessors to two questions on each point, one designated a pass question and one at a higher level. Three basic science and three clinical reasoning issues were required, so that a total of 12 questions was allowed. SETTING: Small (70 students/year) undergraduate medical school with an integrated, problem-based curriculum. SUBJECTS: Sixty-seven students in the fourth year of a 5-year course were assessed, each seeing one patient and being examined by a pair of assessors. Assessor pairs were allocated to use the Structured Question Grid or to assess according to their usual practice. RESULTS: After the assessment but before being informed of the result the students completed a questionnaire on their experience and gave their performance a score between 0 and 100. The questions asked were based on focus group discussions with a previous student cohort, and concerned principally the perceived fairness and subjective validity of the assessment. The assessors independently completed a similar questionnaire, gave the student's performance a score between 0 and 100, and assigned an overall pass/fail grade. CONCLUSIONS: No difference was detected between students' or assessors' views of the fairness of the assessment for assessors who had used the Structured Question Grid compared to those who had not. Students whose assessors used the Structured Question Grid considered the assessment less representative of their ability. No difference was detected in the chance of students being assessed as failing or on the likelihood of a discrepancy between students' and assessors' ratings of students as passing or failing.     

Can student tutors act as examiners in an objective structured clinical examination?

Context  The dissemination of objective structured clinical examinations (OSCEs) is hampered by requirements for high levels of staffing and a significantly higher workload compared with multiple-choice examinations. Senior medical students may be able to support faculty staff to assess their peers. The aim of this study is to assess the reliability of student tutors as OSCE examiners and their acceptance by their peers.
Methods  Using a checklist and a global rating, teaching doctors (TDs) and student tutors (STs) simultaneously assessed students in basic clinical skills at 4 OSCE stations. The inter-rater agreement between TDs and STs was calculated by kappa values and paired t -tests. Students then completed a questionnaire to assess their acceptance of student peer examiners.
Results  All 214 Year 3 students at the University of Göttingen Medical School were evaluated in spring 2005. Student tutors gave slightly better average grades than TDs (differences of 0.02–0.20 on a 5-point Likert scale). Inter-rater agreement at the stations ranged from 0.41 to 0·64 for checklist assessment and global ratings; overall inter-rater agreement on the final grade was 0.66. Most students felt that assessment by STs would result in the same grades as assessment by TDs (64%) and that it would be similarly objective (69%). Nearly all students (95%) felt confident that they could evaluate their peers themselves in an OSCE.
Conclusions  On the basis of our results, STs can act as examiners in summative OSCEs to assess basic medical skills. The slightly better grades observed are of no practical concern. Students accepted assessment performed by STs.     

Clinical skills training: developing objective assessment instruments

The purpose of this study was to develop objective assessment instruments for use in psychomotor skill training and to test the instruments for interobserver reliability. Two checklist style instruments, one for suturing and one for endotracheal intubation, were developed through a process of review of standard texts, consultation with local experts and field testing. Following development they were used by paired examiners in an Objective Structured Clinical Examination (OSCE) setting to test the instruments for interobserver reliability. A total of 88 final year medical students were recruited from the five Ontario medical schools to participate as examinees. The checklists worked well within the practical constraints of a 10 minute OSCE station and demonstrated a high level of interobserver reliability with Kappa scores of 0·65 for the suturing checklist and 0·71 for the intubation checklist. Furthermore, the Kappa scores for individual checklist items served to identify items which demonstrated poor interobserver reliability and thus highlighted them for review.     

Measuring clinical competence of medical students

Evidence of clinical competence for medical students entering the clinical clerkships at the University of Kansas College of Health Sciences is established by passing two different examinations: a 100 item multiple choice examination and a videotaped history and physical examination by each student of a simulated patient, being rated by that patient and two examiners. In 1976 the class of 196 medical students took an average 1.85 written examinations per student. With 70% or better constituting a passing score, 30.6% passed on the first attempt, 55.6% the second, 11.2% the third and 2.5% the fourth. Each student passed the televised practical examination and had the opportunity to review his or her videotape with a critiqued data base and the examiners' and simulated patient's evaluations in hand. Correlation coefficients for all 196 students between scores of written examinations, medicine tutors, examiners and professional patients revealed weak but significant correlations between the assessments of examiners and medical tutors and assessments of examiners and written examination scores, but not between other evaluations. This scheme of proof of competence appears to be objective and direct, and serves the convenience of both students and teaching staff.     

Assessing medical student effectiveness from the psychiatric patient's perspective: the Medical Student Interviewing Performance Questionnaire

This study sought to develop and pilot-test a patient-completed rating scale of medical student effectiveness while training in psychiatry. Specifically, the study focused on: (1) examining the statistical reliability and validity of a new scale; (2) using the measure to assess patient satisfaction with medical student care during the psychiatry clerkship; and (3) providing some experience-based recommendations about utilizing patient feedback when training medical students in psychiatry. Data were collected over an entire academic year and involved 35 third-year medical students and ratings of their performance provided by 102 psychiatric inpatients. Participants were recruited from three inpatient units and the rate of participation was 62.5%. Principle components analyses of the Medical Student Interviewing Performance Scale (MSIPQ) showed that the overall scale consisted of two, theoretically relevant subscales called 'Rapport' and 'Treatment Feedback.' Each subscale had adequate reliability. In addition, the two subscales were shown to each account for unique variance in two separate questions assessing the patient's overall ratings of rapport and treatment helpfulness. Finally, patients' mean ratings of medical student effectiveness were examined and showed very high levels of satisfaction with the student-patient relationship and the quality of care received. This study is among the first to examine patient satisfaction with medical student providers among a general population of psychiatric inpatients. Recommendations are made about the ways in which the MSIPQ can be used to strengthen the training of medical students in psychiatry.     

The students' view of an innovative undergraduate medical course: the first year at the University of Newcastle,N.S.W.†

An innovative medical course commenced in 1978 in a new medical school at the University of Newcastle. An evaluation of the student response to the first year of this course was carried out. This evaluation aimed to assess how far the students had progressed towards the attainment of the long-term Faculty objectives on which the Newcastle curriculum is based. Students' perceptions of educational innovations were obtained and compared with the Faculty's stated aims. Students felt that they could approach a problem scientifically, in a manner consistent with the Faculty's specified methods. In the area of team work, students had accepted the need for training in team skills as preparation for work after graduation. Students have adapted to the use of objectives, to assessment for competence, and to the marking of one another's papers. These methods had been introduced to facilitate the development of skills necessary for independent and continuing self-education. Patient contact was designated as the greatest strength of the first year. Students expressed concern for patient well-being and the influence of student activities on patients. This indicated that students had progressed some way towards the attainment of the Faculty objective that they should develop an humanitarian approach to patients.     

Communication Skills in Standardized-Patient Assessment of Final-Year Medical Students: A Psychometric Study

The purpose of this study is to investigate the content-specificity of communication skills. It investigates the reliability and dimensionality of standardized patient (SP) ratings of communication skills in an Objective Structured Clinical Examination (OSCE) for final year medical students. An OSCE consisting of seven standardized patient (SP) encounters was administered to final-year medical students at four medical schools that are members of the California Consortium for the Assessment of Clinical Competence (N = 567). For each case, SPs rated students' communication skills on the same seven items. Internal consistency coefficients were calculated and a two-facet generalizability study was performed to investigate the reliability of the scores. An exploratory factor analysis was conducted to examine the dimensionality of the exam. Findings indicate that communication skills across the seven-case examination demonstrate a reliable generic component that supports relative decision making, but that a significant case-by-student interaction exists. The underlying structure further supports the case-specific nature of students' ability to communicate with patients. From these findings, it is evident that individual's communication skills vary systematically with specific cases. Implications include the need to consider the range of communication skill demands made across the OSCE to support generalization of findings, the need for instruction to provide feedback on communication skills in multiple contexts, and the need for research to further examine the student, patient, and presenting problem as sources of variation in communication skills.     

Evaluating medical students' non-verbal communication during the objective structured clinical examination

OBJECTIVES: Non-verbal communication (NVC) in medical encounters is an important method of exchanging information on emotional status and contextualising the meaning of verbal communication. This study aimed to assess the impact of medical students' NVC on interview evaluations by standardised patients (SPs). METHODS: A total of 89 medical interviews in an objective structured clinical examination (OSCE) for post-clerkship medical students were analysed. All interviews were videotaped and evaluated on 10 non-verbal behaviour items. In addition, the quality of the interview content was rated by medical faculty on 5 items and the interview was rated by SPs on 5 items. The relationships between student NVC and SP evaluation were examined by multivariate regression analyses controlling for the quality of the interview content. RESULTS: Standardised patients were likely to give higher ratings when students faced them directly, used facilitative nodding when listening to their talk, looked at them equally when talking and listening, and spoke at a similar speed and voice volume to them. These effects of NVC remained significant after controlling for the quality of the interview content. CONCLUSIONS: This study provided evidence of specific non-verbal behaviours of doctors that may have additional impacts on the patient's perception of his or her visit, independently of the interview content. Education in basic NVC should be incorporated into medical education alongside verbal communication.