OSCE! Variations on a theme by Harden

BACKGROUND: In 1979, Harden described the first objective structured clinical examination (OSCE). Harden's OSCE dramatically changed the assessment of professional competence because it used actors and choreographed scenarios to evaluate the performance of professional behaviours. ANALYSIS: Because of the intense focus on performance, OSCEs have had a powerful influence on doctor training and practice. However, the immediate psychometric characteristics of OSCEs rather than their performance effects have been the subject of most research. CONCLUSION: The time has come to undertake a sophisticated sociological investigation of how OSCEs affect medical practice, including the ways in which they shape doctor interaction with patients, families and other health professionals.     

Student attitudes to surgical teaching in provincial hospitals

Objective: The ever‐increasing pressure on metropolitan teaching hospitals to rationalise budgets and increase productivity has resulted in a dwindling amount of teaching opportunity for the medical student population. One solution to the problem was to utilise a largely untapped resource in South Australia, namely the provincial hospitals, however, student opinion regarding such a radical change had yet to be determined. Design: A questionnaire was circulated among an entire year group of medical students who would be undertaking the revised surgical curriculum with rural attachments. Setting: In October 1997, a decision was made by the Department of Surgery at the University of Adelaide to proceed with optional rural surgical attachments in 1998. Subjects: The survey was distributed to the 125 members of the 1997 fifth year medical student group. Results: A total of 92 questionnaires were returned giving a response rate of 75%. Thirty‐nine students ranked a rural term in their top half of preferences, while a further 18 indicated that they would go to a rural centre if they had to. Conclusion: Despite having little warning of the impending changes to their surgical curriculum, the majority of students who responded to the questionnaire stated that they would be willing to venture to the country locations. Before planning significant changes to an established curriculum, the student group should be consulted to gauge their opinion. What is already known: Within the medical literature, studies have been performed with regard to student opinions regarding postgraduate internships in rural locations, but to our knowledge, this survey represents the first study into student opinion with particular reference to rural surgical attachments prior to their commencement within a medical school curriculum. What this study adds: As a result of this study, it can now be concluded that a considerable amount of interest exists within the student population to undertake rural surgical rotations.     

A Strategy to Standardize the Learning of Core Clerkship Objectives

Background: Consistent and effective implementation of clinical clerkship objectives remains elusive. Using the behavioral principles of self assessment, active learning and learner differences, we designed an objectives checklist to ensure that all students mastered a core body of internal medicine (IM) knowledge and to facilitate self-directed learning. Methods: We developed a 54-item learning objectives checklist card in the IM clerkship. In a randomized controlled trial by clerkship site and block, students in the intervention group received the checklist card and were instructed to obtain sign off on objectives by faculty and housestaff and to seek teaching, literature, and clinical experiences to satisfy objectives unmet through routine activities. Intervention group faculty and housestaff were oriented to the use of the checklist. Both intervention and control groups received the course syllabus. We assessed learning with faculty and housestaff evaluations, student knowledge self-assessment, and a written examination. Satisfaction with the cards was assessed with written evaluations. Results: There were no significant differences in ward evaluations, examination scores or self-assessed knowledge between students using the learning objectives cards and control groups. Faculty were more likely than students to agree that objectives cards improved education. Conclusions: An intervention designed to guide students in the use of a learning objectives card did not enhance learning as assessed by ward evaluations, a written examination, and satisfaction surveys. It is possible that more sensitive outcome measures could detect differences in knowledge for students using learning objectives checklist cards. This revised version was published online in September 2006 with corrections to the Cover Date.     

Assessing procedural skills in context: Exploring the feasibility of an Integrated Procedural Performance Instrument (IPPI)

BACKGROUND: The assessment of clinical procedural skills has traditionally focused on technical elements alone. However, in real practice, clinicians are expected to be able to integrate technical with communication and other professional skills. We describe an integrated procedural performance instrument (IPPI), where clinicians are assessed on 12 clinical procedures in a simulated clinical setting which combines simulated patients (SPs) with inanimate models or items of medical equipment. Candidates are observed remotely by assessors whose data are fed back to the clinician within 24 hours of the assessment. This paper describes the feasibility of IPPI. RESULTS: A full-scale IPPI and 2 pilot studies with trainee and qualified health care professionals has yielded an extensive data set including 585 scenario evaluations from candidates, 60 from clinical assessors and 31 from simulated patients (SPs). Interview and questionnaire data showed that for the majority of candidates IPPI provided a powerful and valuable learning experience. Realism was rated highly. Remote and real-time assessment worked effectively, although for some procedures limited camera resolution affected observation of fine details. DISCUSSION: IPPI offers an innovative approach to assessing clinical procedural skills. Although resource-intensive, it has the potential to provide insight into individual's performance over a spectrum of clinical scenarios and at no risk to the safety of patients. Additional benefits of IPPI include assessment in real time from experts (allowing remote rating by external examiners) as well as provision of feedback from simulated patients.     

Undergraduate public health education in UK medical schools - struggling to deliver

INTRODUCTION: Recent policy initiatives in the United Kingdom (UK) have underlined the importance of public health education for health care professionals. We aimed to describe teaching inputs to medical undergraduate curricula, to identify perceived challenges in the delivery of public health teaching and strategies that may overcome them. METHODS: We undertook a cross-sectional survey; questionnaires were sent electronically to 28 teaching leads in academic departments of public health in UK medical schools. These were followed-up by telephone interviews. RESULTS: We obtained a 75% response rate. We found a great deal of variability between schools in teaching methods, curricular content and resources used. In 76% of medical schools, public health and clinical teaching were integrated to some extent. The proportion of teaching delivered as lectures is decreasing and that of self-directed learning is increasing. A range of methods is used to assess students and in 33% of schools these assessments contributed to final Medical School marks. More than half the medical schools had difficulty finding teachers and staffing levels had deteriorated in 55% of schools. Many interviewees felt that their contributions were undervalued. Few were aware of the level of funding received to support teaching. DISCUSSION: There is a need to increase the supply of well-trained and motivated teachers and combine the best traditional teaching methods with more innovative, problem-based approaches. Faculties need to share 'learning about what works' and teaching resources across medical schools as well as addressing a culture of neglect of teaching in some departments. Suggestions are made as to how undergraduate public health teaching can be strengthened.     

Medical student attitudes to risk taking and self-perceived influence on medical practice

CONTEXT: Little has been published on medical student risk-taking attitudes and behaviours and whether students think these attributes will affect how they treat patients. OBJECTIVES: Our aims were to assess for an association between risk-taking attitudes and behaviours, such as problematic substance use, self-reported risky behaviours, and self-reported accidents, and to test for an association between risk-taking attitudes and student perceptions of the influence of these attitudes on future clinical practice. METHODS: Three consecutive classes of Year 2 medical students (n=315) completed a self-administered, 29-item questionnaire. Risk-taking attitudes were evaluated using a 6-question, risk-taking scale adapted from the Jackson Personality Inventory (JPI). RESULTS: A significant positive correlation was demonstrated between risk-taking attitudes (JPI) and problematic substance use (r=0.34; P<0.01), self-reported risky behaviours (r=0.47; P<0.01), and self-reported accidents (r=0.33; P<0.01). Students who did not think their attitudes toward risk would affect their clinical decision making scored significantly higher on our measure of risk-taking attitudes (t306=-4.60; P<0.01). Students who did not think that their drinking, drug taking or sexual behaviour would affect how they counselled patients on these matters scored significantly higher on our measure of problematic substance use (t307=-2.51; P=0.01). CONCLUSIONS: Although risk-taking attitudes have been associated with significant differences in clinical decision making among doctors, in our sample students with high risk-taking attitudes and behaviours were significantly less likely than their colleagues to think their attitudes would affect their clinical practice. Implications for medical education are discussed.     

The influence of tutoring competencies on problems, group functioning and student achievement in problem-based learning

CONTEXT: Prominent factors in problem-based learning (PBL) are the problems to be solved, tutorial group functioning and tutors' competencies. These factors mutually affect one another and largely determine whether a powerful learning environment will be created. It is a tutor's task to stimulate active, self-directed, contextual and collaborative learning and display interpersonal behaviour that is conducive to students' learning. We investigated the effects of tutors' competencies on students' learning and on other variables, such as group functioning and student achievement. OBJECTIVES: We investigated whether tutors who stimulate active, self-directed, contextual and collaborative learning make better use of problems and meaningful contexts in PBL and also enhance group functioning. We also investigated whether the quality of problems has a positive impact on group functioning and whether group functioning advanced student achievements. METHODS: Questionnaires were used to collect data from students at the end of 11 modules in Years 1 and 2 of a PBL undergraduate medical curriculum. We used structural equation modelling to test the fit of a theoretical model representing the factors of interest and their relationships. RESULTS: Stimulation of active and constructive learning, self-directed learning and collaborative learning by tutors enhanced the quality of the problems and group functioning. The quality of the problems promoted group functioning, which was found to have a positive effect on student achievement. CONCLUSIONS: Tutors' competencies had a positive effect on the learning of students. This suggests that it would be worthwhile including these competencies in staff development.     

Can we assess students' awareness of cultural diversity? A qualitative study of stakeholders' views

CONTEXT: Personal attitudes of doctors towards cultural diversity may influence the delivery of clinical care. Yet whether medical schools should assess a student's cultural awareness and if so, how, has not been specifically debated. OBJECTIVE: To establish the views of key stakeholders in medical education on the assessment of awareness of cultural diversity within the undergraduate curriculum. METHODS: Semi-structured interviews were undertaken, using sampling and snowballing, with 61 stakeholders, including policymakers, teachers of diversity, students, service users and carers. The data were analysed qualitatively using quasi-statistical and template approaches and themes identified. RESULTS: Three main themes emerged. The first was ambivalence over the need to assess students. Most felt students should be assessed to ensure the subject was taken seriously. Some were concerned that assessment might encourage false attitudes. The second theme was uncertainty over the best methodology. Objective structured clinical examinations (OSCEs) were the most favoured method. Significant concern was expressed that this alone was sufficient. The third theme was concern that current assessment methods do not identify students with inappropriate attitudes that are potentially detrimental to patient care. CONCLUSIONS: Assessment of cultural awareness should be attempted but it needs to be multifaceted. The OSCE alone is inadequate. Other tools, such as reflective portfolios, need evaluation.     

Stress, debt and undergraduate medical student performance

INTRODUCTION: Against the background of current debate over university funding and widening access, we aimed to examine the relationships between student debt, mental health and academic performance. METHODS: We carried out an electronic survey of all medical undergraduate students at the University of Aberdeen during May-June 2004. The questionnaire contained items about demographics, debt, income and stress. Students were also asked for consent to access their examination results, which were correlated with their answers. Statistical analyses of the relationships between debt, performance and stress were performed. RESULTS: The median total outstanding debt was pound 7300 (interquartile range 2000-14 762.50). Students from lower socioeconomic backgrounds and postgraduate students had higher debts. There was no direct correlation between debt, class ranking or General Health Questionnaire (GHQ) score; however, a subgroup of 125 students (37.7%), who said that worrying about money affected their studies, did have higher debt and were ranked lower in their classes. Some of these students were also cases on the GHQ-12. Overall, however, cases on the GHQ had lower levels of debt and lower class ranking, suggesting that financial worries are only 1 cause of mental health difficulties. DISCUSSION: Students' perceptions of their own levels of debt rather than level of debt per se relates to performance. Students who worry about money have higher debts and perform less well than their peers in degree examinations. Some students in this subgroup were also identified by the GHQ and may have mental health problems. The relationships between debt, mental health and performance in undergraduate medical students are complex but need to be appreciated by medical education policy makers.