Can medical schools rely on clerkships to train students in basic clinical skills?

OBJECTIVE: Many medical schools have drawn up lists of basic clinical skills that students are required to have mastered at the end of medical training. To determine whether undergraduate students actually perform these basic clinical skills during clerkships and whether different approaches to skills training led to different results, we surveyed 365 final-year medical students in 1996 and 1997. METHOD: A questionnaire containing items on 265 skills in eight body systems was administered to students from two conventional medical schools (Ghent and Antwerp, Belgium), and one Dutch medical school, Maastricht, which offers a problem-based curriculum and systematic skills training. RESULTS: Although quite a few skills were not performed by Maastricht students, the results of this school compared favourably to those of the Ghent and Antwerp medical schools. Significant differences between Ghent and Antwerp were found for surgery, paediatrics and gynaecology/obstetrics. In the non-obligatory clerkships in dermatology, otorhinolaryngology and ophthalmology a great percentage of skills were not performed. CONCLUSIONS: The main conclusion is that all three medical schools cannot rely on clerkship experiences alone to provide adequate basic skills training. A problem-based learning environment and training in a skills laboratory appear to result in students performing more skills during clerkships. Assessment of clinical skills, obligatory clerkships in specialties and general practice, and continuous monitoring of the quality of clerkships may also be strong determinants of the present findings.     

Factors in faculty evaluation of medical students' performance

CONTEXT: Faculty members often use global rating scales as a method of assessing various characteristics of medical students' clinical performance. The purpose of this study was to determine if some performance characteristics are more highly associated with the overall faculty grade than others. METHODS: The clinical performance of 211 surgery clerkship students was evaluated by 2 or 3 faculty preceptors. Faculty rated students on 10 specific performance characteristics, using a 5-point scale. Faculty then assigned a numerical grade summarising the faculty's view of the student's performance. Reliability of the ratings was estimated by the intraclass correlation, and 1-way (analysis of variance) anova was used to test for differences among the students' mean ratings. Logistic regression was employed to determine the accuracy of each performance measure in predicting students' grades (A or B). Stepwise logistic regression was used to determine if there was a combination of performance characteristics that best predicted students' grades. RESULTS: The inter-rater reliabilities were low (相似文献   

Clinical clerkships: students can structure their own learning

In clinical clerkships, student learning is often unstructured and diverse. Even when curriculum objectives are explicit, they are seldom used by students to guide their learning. Student-determined learning objectives may help students to structure their learning. This study aimed to assess whether students can use this method to meet widely differing learning needs within the general practice clerkship and considered the relationship of student objectives to overall curriculum objectives. Students allocated a 5-week clerkship in general practice from April 2000 to April 2001 were required to set and meet personal learning objectives within a supportive learning environment. They recorded the strategies they used, how well objectives were met and which curriculum objectives they met. Objectives were categorised using a hierarchical system. A total of 143 (85%) students recorded 1549 objectives. Four categories accounted for 1092 (70%) of objectives: Consultation Skills; Study of Diseases; Practical Procedures, and Therapeutics. Otherwise the range of objectives set was wide, encompassing all curriculum objectives. A total of 1043 objectives were rated as satisfactorily or highly satisfactorily met and 185 (12%) were not met at all. Strategies that students used to meet objectives included clinical experience with doctors but also with practice-based nurses. Students were able to use student-determined learning objectives to meet a diverse range of learning needs within the general practice clerkship. The objectives set reflected the breadth of curriculum objectives. This method allows students to address gaps in their knowledge in a clerkship where teaching is largely based on opportunistic contact.     

In-training assessment - its potential in enhancing clinical teaching

CONTEXT: In-training assessment (ITA) has established its place alongside formative and summative assessment at both the undergraduate and postgraduate level. In this paper the authors aimed to identify those characteristics of ITA that could enhance clinical teaching. METHODS: A literature review and discussions by an expert working group at the Ninth Cambridge Conference identified the aspects of ITA that could enhance clinical teaching. RESULTS: The features of ITA identified included defining the specific benefits to the learner, teacher and institution, and highlighting the patient as the context for ITA and clinical teaching. The 'mapping' of a learner's progress towards the clinical teaching objectives by using multiple assessments over time, by multiple observers in both a systematic and opportunistic way correlates with the incremental nature of reaching clinical competence. CONCLUSIONS: The importance of ITA based on both direct and indirect evidence of what the learner actually does in the real clinical setting is emphasized. Particular attention is given to addressing concerns in the more controversial areas of assessor training, ratings and documentation for ITA. Areas for future research are also identified.     

Types of problem students encountered by clinical teachers on clerkships

The teachers who play the all-important role of enabling students to learn on clinical clerkships must balance the two essential skills of being a good role model and maintaining objectivity in order to identify students with a variety of problems. This study describes the findings of a survey that identifies both the type of the problems that most bother teachers and the relative frequency of those problems. Non-cognitive problems (poor interpersonal skills and non-assertive, shy students) were identified by teachers as being seen at the same relative frequency but posing greater difficulty than cognitive problems (poor integration skills, disorganization, poor fund of knowledge, etc.). A variety of the types of interventions to these problems are discussed.     

Reliability of global rating scales in the assessment of clinical competence of medical students

Undergraduate medical students of the Ben Gurion University were evaluated upon completion of their fourth- and sixth-year medical clerkships by a 17-item rating scale, a multiple choice question (MCQ) test and a patient-oriented oral examination by two academic staff members. Pearson's correlation coefficient between the fourth-and sixth-year global ratings was r = 0.44 (P less than or equal to 0.001), while that between the fourth- and sixth-year MCQ scores was r = 0.54 P less than or equal to 0.001). Pearson's coefficient between the global ratings and the MCQ scores in the sixth year was r = 0.25 (P less than or equal to 0.05). Stepwise regression analysis revealed that the ratings on the parameters 'reliability', 'knowledge', 'organization', 'diligence' and 'case presentation' were the most predictive of the overall global rating. It is concluded that the reproducibility of 'subjective' expert assessment of performance through global rating scales is comparable to that of 'objective' evaluation through written MCQ, even though these measures assess different domains of competence at different levels of simulations. It is recommended that the clinical performance of undergraduate medical students should be assessed by a combination of subjective and objective measures.     

Students' evaluation of surgical seminars in a teaching hospital

AIM: To evaluate the surgical seminars given for medical students at Auckland University and factors affecting them, so as to define areas for improvement. METHODS: A confidential questionnaire was completed by fourth-year medical students for each surgical seminar they attended during an academic year. The seminars were repeated four times during the year. The questionnaire consisted of five statements relating to whether the seminar was stimulating, problem- oriented, patient-centred, evidence-based and interactive. The students rated each statement on a 7-point scale. RESULTS: 556 questionnaires evaluating 28 clinical teachers were collected. A generalized linear model showed that the clinical teachers (F=4.16, P = 0.0001), the attachment (F=4.39, P=0.005) and the interaction between the seniority and institute (F=6.38, P=0.019) had a significant effect on the rating of the seminars. University consultants and hospital registrars had the highest overall least-squares mean, followed by hospital consultants, while university lecturers had the lowest overall least-squares mean (5.56, 5.4, 5.18, and 4.36, respectively). Ratings for problem-oriented approach improved over the studied period, while ratings of evidence-based and patient-centred approaches remained lower. University consultants and hospital registrars had the best patient-centred approach compared with hospital consultants and university lecturers (least-squares means 5.52, 5.4, 5.01, 4.18, respectively). Hospital registrars showed the best interactive ability ratings (least-squares mean 5.51) while university lecturers had the least stimulating seminars (least-squares mean 4.46). CONCLUSIONS: Surgical seminars which were introduced to cover surgical topics had acceptable ratings in each of the teaching domains, although there is a need for improvement in the patient-centred and evidence-based approaches.     

Direct, standardized assessment of clinical competence

Doctor ratings of clerkship performance are often discounted as not accurately reflecting clinical competence. Such ratings are influenced by the following uncontrolled variables: case difficulty; differing rater focus and standards; lack of agreement on what constitutes acceptable performance; and collective patient care responsibility masks individual contributions. Standardized direct measures of clinical competence were developed to control these factors and allow direct comparisons of student performance. Students saw 18 patients representing frequently occurring and important patient problems. Student actions and decisions were recorded and subsequent responses to questions revealed knowledge of pathophysiology, basis for actions, use and interpretation of laboratory investigations, and management. Actions and responses were graded using a pre-set key. The examination covered 73% of designated clinical competencies. Examinations scores corresponded with independent measures of clinical competence. Reliability studies indicated that new cases can be substituted in subsequent years with confidence that scores will maintain similar meaning. Costs are +6.95 per student per case, which is modest considering the quality and quantity of information acquired. Methods described are practical for evaluation of clerks and residents and for licensing and specialty certification examinations.     

Clinical teaching: maintaining an educational role for doctors in the new health care environment

CONTEXT AND OBJECTIVES: Good clinical teaching is central to medical education but there is concern about maintaining this in contemporary, pressured health care environments. This paper aims to demonstrate that good clinical practice is at the heart of good clinical teaching. METHODS: Seven roles are used as a framework for analysing good clinical teaching. The roles are medical expert, communicator, collaborator, manager, advocate, scholar and professional. RESULTS: The analysis of clinical teaching and clinical practice demonstrates that they are closely linked. As experts, clinical teachers are involved in research, information retrieval and sharing of knowledge or teaching. Good communication with trainees, patients and colleagues defines teaching excellence. Clinicians can 'teach' collaboration by acting as role models and by encouraging learners to understand the responsibilities of other health professionals. As managers, clinicians can apply their skills to the effective management of learning resources. Similarly skills as advocates at the individual, community and population level can be passed on in educational encounters. The clinicians' responsibilities as scholars are most readily applied to teaching activities. Clinicians have clear roles in taking scholarly approaches to their practice and demonstrating them to others. CONCLUSION: Good clinical teaching is concerned with providing role models for good practice, making good practice visible and explaining it to trainees. This is the very basis of clinicians as professionals, the seventh role, and should be the foundation for the further development of clinicians as excellent clinical teachers.     

Computer-assisted general medicine clerkship evaluation

This report describes the development and analysis of a computer-assisted evaluation system designed to standardize and simplify student evaluations on a general medicine clerkship. Three standard clinical evaluation components were employed: written examination; oral examination; and clinical performance evaluation. Computer spread sheet technology was used to weight each component separately and calculate a final numerical grade for the clerkship. The system provides a consistent, well-documented and well-defined method for justifying individual grades of honours, pass or fail. It has been very helpful in identifying evaluation problems occurring in particular hospital sites or with particular evaluators.     

Task-based learning: the answer to integration and problem-based learning in the clinical years

INTRODUCTION: Integrated teaching and problem-based learning (PBL) are powerful educational strategies. Difficulties arise, however, in their application in the later years of the undergraduate medical curriculum, particularly in clinical attachments. Two solutions have been proposed - the use of integrated clinical teaching teams and time allocated during the week for PBL separate from the clinical work. Both approaches have significant disadvantages. Task-based learning (TBL) is a preferred strategy. In TBL, a range of tasks undertaken by a doctor are identified, e.g. management of a patient with abdominal pain, and these are used as the focus for learning. Students have responsibility for integrating their learning round the tasks as they move through a range of clinical attachments in different disciplines. They are assisted in this process by study guides. METHOD: The implementation of TBL is described in one medical school. One hundred and thirteen tasks, arranged in 16 groups, serve to integrate the student learning as they rotate through 10 clinical attachments. RESULTS: This trans-disciplinary approach to integration, which incorporates the principles of PBL offers advantages to both teachers and students. It recognizes that clinical attachments in individual disciplines can offer rich learning opportunities and that such attachments can play a role in an integrated, as well as in a traditional, curriculum. In TBL, the contributions of the clinical attachments to the curriculum learning outcomes must be clearly defined and tasks selected which will serve as a focus for the integration of the students' learning over the range of attachments.     

The accountability of clinical education: its definition and assessment

BACKGROUND: Medical education is not exempt from increasing societal expectations of accountability. Competition for financial resources requires medical educators to demonstrate cost-effective educational practice; health care practitioners, the products of medical education programmes, must meet increasing standards of professionalism; the culture of evidence-based medicine demands an evaluation of the effect educational programmes have on health care and service delivery. Educators cannot demonstrate that graduates possess the required attributes, or that their programmes have the desired impact on health care without appropriate assessment tools and measures of outcome. OBJECTIVE: To determine to what extent currently available assessment approaches can measure potentially relevant medical education outcomes addressing practitioner performance, health care delivery and population health, in order to highlight areas in need of research and development. METHODS: Illustrative publications about desirable professional behaviour were synthesized to obtain examples of required competencies and health outcomes. A MEDLINE search for available assessment tools and measures of health outcome was performed. RESULTS: There are extensive tools for assessing clinical skills and knowledge. Some work has been done on the use of professional judgement for assessing professional behaviours; scholarship; and multiprofessional team working; but much more is needed. Very little literature exists on assessing group attributes of professionals, such as clinical governance, evidence-based practice and workforce allocation, and even less on examining individual patient or population health indices. CONCLUSIONS: The challenge facing medical educators is to develop new tools, many of which will rely on professional judgement, for assessing these broader competencies and outcomes.     

The impact of formal instruction in clinical examination skills on medical student performance -- the example of peripheral nervous system examination

BACKGROUND: Peripheral nervous system examination is an essential part of the full medical clerking of a patient. We have investigated the effectiveness of formal instruction in peripheral nervous system examination compared to the traditional bedside ward teaching that our students usually receive. METHOD: We instructed an unselected group of 22 medical students in peripheral nervous system examination in a clinical skills centre and evaluated them with a 12 item marking schedule before and after instruction. The performance of this group was then compared to the rest of their year (220 students) in an end of year OSCE, which included a neurology station assessing sensory examination of the lower limbs. RESULTS: Students formally instructed in neurology significantly improved their scores after instruction and scored 15% higher marks (90% vs. 75%) than the rest of their year in the end of year neurology OSCE station 2 months later (P < 0.01, Mann Whitney U-test). They did not perform significantly better in the OSCE overall. CONCLUSIONS: Formal instruction in neurological examination resulted in a significant increase in the end of year neurology OSCE station score compared to traditional heterogeneous teaching methods.     

Psychological tests to measure the effects of medical education on students'' interpersonal skills

The consulting skills required of medical students and practitioners have been categorized into a number of specific skills, two of which are: students' ability to empathize with the patient; and ability to decode non-verbal cues given by the patient in the interview. Training programmes to improve students' consulting skills are usually evaluated using analysis of students' actual interview behaviours with patients. Broad psychological and personality tests have also been used to measure changes in students' interviewing skills, but have generally not been successful. The hypothesis is advanced that more specific tests of the skills of interviewing, such as non-verbal sensitivity and empathy, would detect changes in students' ability to display these skills. As part evaluation of a consulting skills training programme, clinical students completed psychological tests of empathy and non-verbal sensitivity. Subsequent comparisons between trained and control student groups revealed no clear pattern in test results. These data suggest that specific psychological tests of empathy and non-verbal sensitivity may be no more effective in detecting changes in students' interpersonal skills than global personality measures.     

A longitudinal study of self-assessment accuracy

AIM: Although studies have examined medical students' ability to self-assess their performance, there are few longitudinal studies that document the stability of self-assessment accuracy over time. This study compares actual and estimated examination performance for three classes during their first 3 years of medical school. METHODS: Students assessed their performance on classroom examinations and objective structured clinical examination (OSCE) stations. Each self-assessment was then contrasted with their actual performance using idiographic (within-subject) methods to define three measures of self-assessment accuracy: bias (arithmetic differences of actual and estimated scores), deviation (absolute differences of actual and estimated scores), and covariation (correlation of actual and estimated scores). These measures were computed for four intervals over the course of 3 years. Multivariate analyses of variance and correlational analyses were used to evaluate the stability of these measures. RESULTS: Self-assessment accuracy measures were relatively stable over the first 2 years of medical school with a decease occurring in the third year. However, the correlational analyses indicated that the stability of self-assessment accuracy was comparable to the stability of actual performance over this same period. CONCLUSION: The apparent decline in accuracy in the third year may reflect the transition from familiar classroom-based examinations to the substantially different clinical examination tasks of the third year OSCE. However, the stability of self-assessment accuracy compares favorably with the stability of actual performance over this period. These results suggest that self-assessment accuracy is a relatively stable individual characteristic that may be influenced by task familiarity.     

A study of pre-registration house officers' clinical skills

BACKGROUND: Little is known about the ability of pre-registration house officers (PRHOs) to perform basic clinical skills just prior to entering the medical register. OBJECTIVES: To find out whether PRHOs have deficiencies in basic clinical skills and to determine if the PRHOs themselves or their consultants are aware of them. METHOD: All 40 PRHOs at the Chelsea and Westminster and Whittington Hospitals were invited to undertake a 17 station OSCE of basic clinical skills. Each station was marked by one examiner completing an overall global score after completing an itemised checklist. An adequate station performance was the acquisition of a pass/borderline pass grade. Prior to the OSCE, a questionnaire was given to each PRHO asking them to rate their own abilities (on a 5-point scale) in the skills tested. A similar questionnaire was sent to the educational supervisors of each PRHO asking them to rate their house officer's ability in each of the same skills. RESULTS: Twenty-two PRHOs participated. Each PRHO failed to perform adequately a mean of 2.4 OSCE stations (SD 1.8, range 1-8). There were no significant correlations between OSCE performance and either self- or educational supervisor ratings. The supervisor felt unable to give an opinion on PRHO abilities in 18% of the skills assessed. DISCUSSION: This study suggests that PRHOs may have deficiencies in basic clinical skills at the time they enter the medical register. Neither the PRHOs themselves nor their consultants identified these deficiencies. A large regional study with sufficient power is required to explore the generalizability of these concerns in more detail.     

Acquisition of basic clinical skills in the general practice setting

Undergraduate medical education in the UK is changing due to both educational pressure (from the General Medical Council) and changes in the hospital service. As a result the role of general practice in providing core clinical experience is under debate. The purpose of this study was to determine the clinical contact available for junior clinical medical clerks (third year) attached to five general practices. We report here on the clinical experience recorded by students during 106 sessions (74% of possible sessions). One hundred and one patients were seen, 54% females; ages ranging from 14 to 92. Four hundred and twenty-six symptoms were recorded; the largest category (36%) was CVS/respiratory followed by neurological (20%). Shortness of breath was the commonest single symptom (46% in the CVS/respiratory category). Three hundred and seventy-one signs were recorded; 48% were in the CVS/respiratory category, 33% in the neurological category. Cardiac murmurs were the commonest single sign (34% of the CVS/respiratory category). Sixty-nine separate comments were made by students about the range of clinical experience available; all were favourable. Forty-eight per cent of comments highlighted the availability of patients with appropriate symptoms and signs. This study has demonstrated that general practices can provide appropriate clinical exposure which complements hospital teaching for junior students.     

Inquiry: the pedagogical importance of a skill central to clinical practice

The skill of inquiry is central to the task of the doctor confronted with a patient problem. Despite its importance this skill is not given appropriate emphasis in the education of medical students or in research concerning the clinical reasoning skills of doctors.     

A review of the evaluation of clinical teaching: new perspectives and challenges

PURPOSE: This article discusses the importance of the process of evaluation of clinical teaching for the individual teacher and for the programme. Measurement principles, including validity, reliability, efficiency and feasibility, and methods to evaluate clinical teaching are reviewed. CONTEXT: Evaluation is usually carried out from the perspective of the learner. This article broadens the evaluation to include the perspectives of the teacher, the patient and the institutional administrators and payers in the health care system and recommends evaluation strategies. RESULTS: Each perspective provides specific feedback on factors or attributes of the clinical teacher's performance in the domains of medical expert, professional, scholar, communicator, collaborator, patient advocate and manager. Teachers should be evaluated in all domains relevant to their teaching objectives; these include knowledge, clinical competence, teaching effectiveness and professional attributes. CONCLUSIONS AND IMPLICATIONS: Using this model of evaluation, a connection can be made between teaching and learning about all the expected roles of a physician. This can form the basis for systematic investigation into the relationship between the quality of teaching and the desired outcomes, the improvement of student learning and the achievement of better health care practice. It is suggested that the extent of effort and resources devoted to evaluation should be commensurate with the value assigned to the evaluation process and its outcomes.     

Using standardised students in faculty development workshops to improve clinical teaching skills

PURPOSE: We describe the use of standardised students (SSs) in interdisciplinary faculty development programmes to improve clinical teaching skills. Standardised students are actual health professions students who are trained to portray a prototypical teaching challenge consistently across many encounters with different faculty participants. METHODS: The faculty development programmes described focused on the skills of providing feedback and brief clinical teaching. At the beginning of each session, each participant was videotaped in encounters with 2 different SSs. Using microteaching (an instructional method in which learners view short segments of their own videotaped performance and discuss the tapes with a facilitator, consultant or other workshop participants), each group of participants and instructors reviewed the tapes and reflected on the encounters, providing immediate feedback to participants and modelling different approaches to the same teaching problem. The same process was repeated with more complicated scenarios after 2 weeks and again after 6 months offering reinforcement, further practice and more sophisticated development of the strategies learned. Participants completed post-session evaluations and a follow-up telephone survey. RESULTS: A total of 36 faculty members from the colleges of medicine, dentistry, pharmacy and nursing participated in workshops in 2000-01. The workshops were rated as highly relevant to participants' teaching, and most participants reported that they had learned a great deal. Participants most appreciated reviewing the videotaped interactions, the feedback they received, the interactions with their colleagues, the interdisciplinary nature of the groups and the practical focus of the workshops. CONCLUSIONS: Standardised students provide a high fidelity, low risk, simulated environment in which faculty can reflect on and experiment with new teaching behaviours. Such encounters can enhance the effectiveness and impact of faculty development programmes to improve clinical teaching skills.