Using borderline methods to compare passing standards for OSCEs at graduation across three medical schools

CONTEXT: Medical schools in the UK set their own graduating examinations and pass marks. In a previous study we examined the equivalence of passing standards using the Angoff standard-setting method. To address the limitation this imposed on that work, we undertook further research using a standard-setting method specifically designed for objective structured clinical examinations (OSCEs). METHODS: Six OSCE stations were incorporated into the graduating examinations of 3 of the medical schools that took part in the previous study. The borderline group method (BGM) or borderline regression method (BRM) was used to derive the pass marks for all stations in the OSCE. We compared passing standards at the 3 schools. We also compared the results within the schools with their previously generated Angoff pass marks. RESULTS: The pass marks derived using the BGM or BRM were consistent across 2 of the 3 schools, whereas the third school generated pass marks which were (with a single exception) much lower. Within-school comparisons of pass marks revealed that in 2 schools the pass marks generally did not significantly differ using either method, but for 1 school the Angoff mark was consistently and significantly lower than the BRM. DISCUSSION: The pass marks set using the BGM or BRM were more consistent across 2 of the 3 medical schools than pass marks set using the Angoff method. However, 1 medical school set significantly different pass marks from the other 2 schools. Although this study is small, we conclude that passing standards at different medical schools cannot be guaranteed to be equivalent.     

Overview of accreditation of undergraduate medical education programmes worldwide

Context  There is significant variation in the structure and quality of undergraduate medical education around the world. Accreditation processes can encourage institutional improvement and help promote high-quality education experiences.
Methods  To investigate the overseeing of medical education from an international perspective, the Foundation for Advancement of International Medical Education and Research (FAIMER^®) has developed, and continues to update, the Directory of Organizations that Recognize/Accredit Medical Schools (DORA). The directory includes information on the presence of national accrediting bodies and related data. Medical education accreditation information was pooled by World Health Organization (WHO) regions.
Results  Although over half of all countries with medical schools indicate that they have a national process for accrediting medical education programmes, the nature of the various authorities and levels of enforcement vary considerably.
Discussion  Despite global trends indicating an increasing focus on the quality of education programmes, data linking accreditation processes to the production of more highly skilled doctors and, ultimately, better patient care are lacking. Investigating current accreditation practices is a necessary step for further research. To this end, we will continue to gather data on medical education around the world and will explore opportunities for relating these processes to outcomes.     

Development of a tool to support holistic generic assessment of clinical procedure skills

Context  The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic.
Objectives  This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills.
Methods  We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff.
Results  In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station.
Conclusions  This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).     

Mentioning race at the beginning of clinical case presentations: a survey of US medical schools

Objectives  Medical students and doctors in the USA frequently mention the patient's race at the beginning of oral or written clinical case presentations. However, this practice is controversial. We aimed to determine whether US medical schools explicitly teach students to mention race at the beginning of case presentations, and to collect additional information on the schools' perspectives on this practice.
Methods  An Internet-based questionnaire was submitted to directors of courses on history taking and physical examination at all US medical schools.
Results  The response rate was 85%. Students are taught to mention race routinely at 11% of schools and selectively at 63% of schools; this practice is discouraged at 9% of schools and not addressed at 18% of schools. Most respondents noted that resident doctors at their institutions routinely mention race at the beginning of case presentations. Even at schools in which mentioning race is discouraged or not addressed, students tend to include race during their clinical rotations. Respondents were divided on whether a standardised approach to inclusion of race should exist at US schools.
Conclusions  Teaching about inclusion or exclusion of race in the opening statement of clinical case presentations varies across US medical schools. This variation presents an opportunity for medical educators to discuss tensions between stereotyping and cultural competence in medical education.     

Checklists for assessment and certification of clinical procedural skills omit essential competencies: a systematic review

Objective  To develop generic criteria for the global assessment of clinical procedural competence and to quantify the extent to which existing checklists allow for holistic assessment of procedural competencies.
Methods  We carried out a systematic review and qualitative analysis of published clinical procedural skills assessment checklists and enumerated the contents of each. Source materials included all English-language papers published from 1990 to June 2005, identified from 18 databases, which described or referred to an assessment document for any clinical procedural skill. A pair of reviewers identified key generic themes and sub-themes through in-depth analysis of a subset of 20 checklists with iterative agreement and independent retesting of a coding framework. The resulting framework was independently applied to all checklists by pairs of reviewers checking for the emergence of new themes and sub-themes. Main outcome measures were identification of generic clinical procedural skills and the frequency of occurrence of each in the identified checklists.
Results  We identified 7 themes ('Procedural competence', represented in 85 [97%] checklists; 'Preparation', 65 [74%]; 'Safety', 45 [51%]; 'Communication and working with the patient', 32 [36%]; 'Infection control', 28 [32%]; 'Post-procedural care', 24 [27%]; 'Team working', 13 [15%]) and 37 sub-themes, which encapsulated all identified checklists. Of the sub-themes, 2 were identified after the initial coding framework had been finalised.
Conclusions  It is possible to develop generic criteria for the global assessment of clinical procedural skills. A third and a half of checklists, respectively, do not enable explicit assessment of the key competencies 'Infection control' and 'Safety'. Their assessment may be inconsistent in assessments which use such checklists.     

Origin bias of test items compromises the validity and fairness of curriculum comparisons

OBJECTIVE: To determine whether items of progress tests used for inter-curriculum comparison favour students from the medical school where the items were produced (i.e. whether the origin bias of test items is a potential confounder in comparisons between curricula). METHODS: We investigated scores of students from different schools on subtests consisting of progress test items constructed by authors from the different schools. In a cross-institutional collaboration between 3 medical schools, progress tests are jointly constructed and simultaneously administered to all students at the 3 schools. Test score data for 6 consecutive progress tests were investigated. Participants consisted of approximately 5000 undergraduate medical students from 3 medical schools. The main outcome measure was the difference between the scores on subtests of items constructed by authors from 2 of the collaborating schools (subtest difference score). RESULTS: The subtest difference scores showed that students obtained better results on items produced at their own schools. This effect was more pronounced in Years 2-5 of the curriculum than in Year 1, and diminished in Year 6. CONCLUSIONS: Progress test items were subject to origin bias. As a consequence, all participating schools should contribute equal numbers of test items if tests are to be used for valid and fair inter-curriculum comparisons.     

Assessing cardiac physical examination skills using simulation technology and real patients: a comparison study

Objective High‐stakes assessments of doctors’ physical examination skills often employ standardised patients (SPs) who lack physical abnormalities. Simulation technology provides additional opportunities to assess these skills by mimicking physical abnormalities. The current study examined the relationship between internists’ cardiac physical examination competence as assessed with simulation technology compared with that assessed with real patients (RPs). Methods The cardiac physical examination skills and bedside diagnostic accuracy of 28 internists were assessed during an objective structured clinical examination (OSCE). The OSCE included 3 modalities of cardiac patients: RPs with cardiac abnormalities; SPs combined with computer‐based, audio‐video simulations of auscultatory abnormalities, and a cardiac patient simulator (CPS) manikin. Four cardiac diagnoses and their associated cardiac findings were matched across modalities. At each station, 2 examiners independently rated a participant’s physical examination technique and global clinical competence. Two investigators separately scored diagnostic accuracy. Results Inter‐rater reliability between examiners for global ratings (GRs) ranged from 0.75–0.78 for the different modalities. Although there was no significant difference between participants’ mean GRs for each modality, the correlations between participants’ performances on each modality were low to modest: RP versus SP, r = 0.19; RP versus CPS, r = 0.22; SP versus CPS, r = 0.57 (P < 0.01). Conclusions Methodological limitations included variability between modalities in the components contributing to examiners’ GRs, a paucity of objective outcome measures and restricted case sampling. No modality provided a clear ‘gold standard’ for the assessment of cardiac physical examination competence. These limitations need to be addressed before determining the optimal patient modality for high‐stakes assessment purposes.     

Development of a framework of medical undergraduate teaching activities

Context  The need for a comprehensive framework of teaching activities in undergraduate medical education was identified by colleagues involved in teacher training at the University of Edinburgh, UK and Karolinska Institutet, Sweden. Such a framework could be used to develop training programmes for medical teachers, to help experienced teachers to reflect upon and communicate with others about their practice, and as a focus for further research on medical teaching.
Methods  A provisional framework of medical teaching activities and a model illustrating how these activities are situated within the wider context of learning and teaching were developed iteratively using the literature and pilot studies. The provisional framework and model were then methodically tested using journal analysis, brainstorming sessions and focus group sessions with medical teachers and teacher trainers in both institutions. Data gathered from this research were analysed and used to further develop the framework and model.
Results  Many of the provisional teaching activities in the framework were further developed in response to the research data and some new activities were added. Teaching activities seemed to cluster into three domains: 'Facilitating', 'Managing', and 'Learning and Community Building'. Specific tasks were identified relating to planning, administering, resourcing, implementing and evaluating each teaching activity. Participants found the model of learning and teaching helpful and felt it adequately represented the place of teaching activities within the wider context of undergraduate medical education. The framework and model are now being used by the authors in faculty development, undergraduate teaching and further research.     

Growth of analytical thinking skills over time as measured with the MATCH test

Context Ber’s Comprehensive Integrative Puzzle aims to assess analytical clinical thinking in medical students. We developed a paediatric version, the MATCH test, in which we added two irrelevant options to each question in order to reduce guessing behaviour. We tested its construct validity and studied the development of integrative skills over time. Methods We administered a test (MATCH 1) to subjects from two universities, both with a 6‐year medical training course. Subjects included 30 students from university 1 who had completed a paediatric clerkship in Year 4, 23 students from university 2 who had completed a paediatric clerkship in Year 5, 13 students from both universities who had completed an advanced paediatric clerkship in Year 6, 28 paediatric residents and 17 paediatricians. We repeated this procedure using a second test with different domains in a new, comparable group of subjects (MATCH 2). Results Mean MATCH 1 scores for the respective groups were: Year 4 students: 61.2% (standard deviation [SD] 1.3); Year 5 students: 71.3% (SD 1.6); Year 6 students: 76.2% (SD 1.5); paediatric residents: 88.5% (SD 0.7), and paediatricians: 92.2% (SD 1.1) (one‐way anova F = 104.00, P < 0.0001). Students of both universities had comparable scores. MATCH 1 and 2 scores were comparable. Cronbach’s α‐values in MATCH 1 and 2 were 0.92 and 0.91, respectively, for all subjects, and 0.82 and 0.87, respectively, for all students. Conclusions Analytical clinical thinking develops over time, independently of the factual content of the course. This implies that shortened medical training programmes could produce less skilled graduates.     

Effects of basic clinical skills training on objective structured clinical examination performance

OBJECTIVES: The aim of curriculum reform in medical education is to improve students' clinical and communication skills. However, there are contradicting results regarding the effectiveness of such reforms. METHODS: A study of internal medicine students was carried out using a static group design. The experimental group consisted of 77 students participating in 7 sessions of communication training, 7 sessions of skills-laboratory training and 7 sessions of bedside-teaching, each lasting 1.5 hours. The control group of 66 students from the traditional curriculum participated in equally as many sessions but was offered only bedside teaching. Students' cognitive and practical skills performance was assessed using Multiple Choice Question (MCQ) testing and an objective structured clinical examination (OSCE), delivered by examiners blind to group membership. RESULTS: The experimental group performed significantly better on the OSCE than did the control group (P < 0.01), whereas the groups did not differ on the MCQ test (P < 0.15). This indicates that specific training in communication and basic clinical skills enabled students to perform better in an OSCE, whereas its effects on knowledge did not differ from those of the traditional curriculum. CONCLUSION: Curriculum reform promoting communication and basic clinical skills are effective and lead to an improved performance in history taking and physical examination skills.     

Clinical skills education: outcomes of relationships between junior medical students, senior peers and simulated patients

Objectives  Peer-assisted learning (PAL) has been reported to have educational benefits in cross-year, small-group teaching in other contexts. Accordingly, we explored whether senior medical students are effective tutors for their junior peers in clinical skills education, and how the participants in the learning triad (tutors, learners and simulated patients [SPs]) perceive the learning environment created in PAL.
Methods  Year 2 students were randomly allocated to one of two groups for skills training. Group 1 ( n  = 64) were tutored by volunteer Year 6 students, and Group 2 ( n  = 67) by paid doctors. The results of both groups in a clinical skills examination were compared using an independent samples t -test. Qualitative data, obtained from Year 2 students ( n  = 125) by written questionnaire and Year 6 students ( n  = 11) and SPs ( n  = 3) by focus group interviews, were analysed for themes.
Results  Students receiving PAL did at least as well in the clinical skills examination as students with qualified tutors (difference in mean total score: 0.7 marks out of 112; 95% confidence interval − 3.8 to 2.4). The PAL environment was perceived as 'comfortable' and fostered the development of confidence in all participants. Peer tutors created a more active learning environment than doctor tutors for both learners and SPs and reported personal benefits from teaching.
Conclusions  With appropriate support, volunteer Year 6 student tutors are as effective as graduate doctors for small-group structured tutorials in clinical skills. Educational relationships were forged between all participants in the learning triad.     

Current status of teaching on spirituality in UK medical schools

OBJECTIVE: To investigate the current status of teaching on spirituality in medicine in UK medical schools and to establish if and how medical schools are preparing future doctors to identify patients' spiritual needs. METHODS: We carried out a national questionnaire survey using a 2-part questionnaire. Section A contained questions relating to the quantity of teaching on spirituality and the topics covered. Section B contained questions relating to teaching on alternative health practices. Medical educators from each of the 32 medical schools in the UK were invited to participate. RESULTS: A response rate of 53% (n = 17) was achieved. A total of 59% (n = 10) of respondents stated that there is teaching on spirituality in medicine in their curricula. On extrapolation, at least 31% and a maximum of 78% of UK medical schools currently provide some form of teaching on spirituality. Of the respondents that teach spirituality, 50% (n = 5) stated that their schools include compulsory teaching on spirituality in medicine, 80% (n = 8) include optional components, and 88% stated that teaching on complementary and alternative medicine is included in the curriculum. CONCLUSIONS: Although 59% (n = 10) of respondent medical schools (the actual UK figure lies between 31% and 78%) currently provide some form of teaching on spirituality, there is significant room for improvement. There is little uniformity between medical schools with regard to content, form, amount or type of staff member delivering the teaching. It would be beneficial to introduce a standardised curriculum on spirituality across all UK medical schools.     

Anatomical dissection as a teaching method in medical school: a review of the evidence

CONTEXT: Discussions about dissection as a teaching method in gross anatomy are characterised by a lack of objective evidence. METHODS: A search for such evidence in the literature produced 14 relevant papers. These were reviewed for objective data on the effect of cadaver dissection on cognitive learning outcomes. RESULTS: All reviewed studies compared groups of students exposed to different teaching approaches, including active dissection, learning on prosected material, or a combination with computerised teaching aids. Study and course designs varied substantially and student groups compared were not always homogeneous. In all studies, compared learning experiences differed in more than 1 variable, and assessment of anatomical knowledge was not standardised. DISCUSSION: It is difficult to interpret and generalise from the results of the reviewed studies. Considering the bias that must be assumed for teachers who develop new course designs and compare these with traditional ones, the review shows a slight advantage for traditional dissection over prosection. CONCLUSIONS: More sophisticated research designs may be necessary to solve the general problem of the small measurable impact of educational interventions and to come to scientifically sound conclusions about the best way to teach gross anatomy. Such research will have to include sufficient sample sizes, the use of validated assessment instruments, and a discussion of the educational significance of measured differences. More educational research in anatomy is necessary to counterbalance emotional arguments about dissection with scientific evidence. Anatomical knowledge is too important to future doctors to leave its teaching to the educational fashion of the day.     

Understanding student concerns about peer physical examination using an activity theory framework

Context Peer physical examination (PPE) has been employed for several decades as part of the formal curriculum for learning clinical skills. Most of the existing studies exploring students’ attitudes towards PPE are single‐site and use quantitative methods. Currently, there is a lack of theoretical underpinning to PPE as a learning method. Methods Using an adaptation of the Examining Fellow Students questionnaire, we captured qualitative data from Year 1 medical students about their views and concerns around learning using PPE. The study was set in six schools across five countries (the UK, Australia, New Zealand, Japan and Hong Kong). Students provided free text comments that were later transcribed and analysed using framework analysis. Results A total of 617 students provided comments for analysis. This paper focuses on several related themes about the complexities of students’ relationships within the context of PPE and their reflections on peer examination in comparison with genuine patient examination. Students drew parallels and differences between the peer examiner–examinee relationship and the doctor–patient relationship. They explained how these two types of relationship differed in nature and in terms of their levels of interaction. Discussion Our findings illuminate the interactional and complex nature of PPE, drawing out concerns and ambiguities around relationships, community and rules. We discuss our results in light of Engeström’s model of activity theory (AT) and provide recommendations for educational practice and further research based on the principles of AT.     

Implementing workplace-based assessment across the medical specialties in the United Kingdom

Objectives  To evaluate the reliability and feasibility of assessing the performance of medical specialist registrars (SpRs) using three methods: the mini-clinical evaluation exercise (mini-CEX), directly observed procedural skills (DOPS) and multi-source feedback (MSF) to help inform annual decisions about the outcome of SpR training.
Methods  We conducted a feasibility study and generalisability analysis based on the application of these assessment methods and the resulting data. A total of 230 SpRs (from 17 specialties) in 58 UK hospitals took part from 2003 to 2004. Main outcome measures included: time taken for each assessment, and variance component analysis of mean scores and derivation of 95% confidence intervals for individual doctors' scores based on the standard error of measurement. Responses to direct questions on questionnaires were analysed, as were the themes emerging from open-comment responses.
Results  The methods can provide reliable scores with appropriate sampling. In our sample, all trainees who completed the number of assessments recommended by the Royal Colleges of Physicians had scores that were 95% certain to be better than unsatisfactory. The mean time taken to complete the mini-CEX (including feedback) was 25 minutes. The DOPS required the duration of the procedure being assessed plus an additional third of this time for feedback. The mean time required for each rater to complete his or her MSF form was 6 minutes.
Conclusions  This is the first attempt to evaluate the use of comprehensive workplace assessment across the medical specialties in the UK. The methods are feasible to conduct and can make reliable distinctions between doctors' performances. With adaptation, they may be appropriate for assessing the workplace performance of other grades and specialties of doctor. This may be helpful in informing foundation assessment.     

The impact of case specificity and generalisable skills on clinical performance: a correlated traits-correlated methods approach

Context  The finding of case or content specificity in medical problem solving moved the focus of research away from generalisable skills towards the importance of content knowledge. However, controversy about the content dependency of clinical performance and the generalisability of skills remains.
Objectives  This study aimed to explore the relative impact of both perspectives (case specificity and generalisable skills) on different components (history taking, physical examination, communication) of clinical performance within and across cases.
Methods  Data from a clinical performance examination (CPX) taken by 350 Year 3 students were used in a correlated traits−correlated methods (CTCM) approach using confirmatory factor analysis, whereby 'traits' refers to generalisable skills and 'methods' to individual cases. The baseline CTCM model was analysed and compared with four nested models using structural equation modelling techniques. The CPX consisted of three skills components and five cases.
Results  Comparison of the four different models with the least-restricted baseline CTCM model revealed that a model with uncorrelated generalisable skills factors and correlated case-specific knowledge factors represented the data best. The generalisable processes found in history taking, physical examination and communication were responsible for half the explained variance, in comparison with the variance related to case specificity.
Conclusions  Pure knowledge-based and pure skill-based perspectives on clinical performance both seem too one-dimensional and new evidence supports the idea that a substantial amount of variance contributes to both aspects of performance. It could be concluded that generalisable skills and specialised knowledge go hand in hand: both are essential aspects of clinical performance.     

The impact of formal instruction in clinical examination skills on medical student performance -- the example of peripheral nervous system examination

BACKGROUND: Peripheral nervous system examination is an essential part of the full medical clerking of a patient. We have investigated the effectiveness of formal instruction in peripheral nervous system examination compared to the traditional bedside ward teaching that our students usually receive. METHOD: We instructed an unselected group of 22 medical students in peripheral nervous system examination in a clinical skills centre and evaluated them with a 12 item marking schedule before and after instruction. The performance of this group was then compared to the rest of their year (220 students) in an end of year OSCE, which included a neurology station assessing sensory examination of the lower limbs. RESULTS: Students formally instructed in neurology significantly improved their scores after instruction and scored 15% higher marks (90% vs. 75%) than the rest of their year in the end of year neurology OSCE station 2 months later (P < 0.01, Mann Whitney U-test). They did not perform significantly better in the OSCE overall. CONCLUSIONS: Formal instruction in neurological examination resulted in a significant increase in the end of year neurology OSCE station score compared to traditional heterogeneous teaching methods.     

Validation of MSAT: an instrument to measure medical students' self-assessed confidence in musculoskeletal examination skills

CONTEXT: Self-assessment promotes reflective practice, helps students identify gaps in their learning and is used in curricular evaluations. Currently, there is a dearth of validated self-assessment tools in rheumatology. We present a new musculoskeletal self-assessment tool (MSAT) that allows students to assess their confidence in their skills in and knowledge of knee and shoulder examination. OBJECTIVES: We aimed to validate the 15-item MSAT, addressing its construct validity, internal consistency, responsiveness, repeatability and relationship with competence. METHODS: Participants were 241 Year 3 students in Newcastle upon Tyne and 113 Year 3 students at University College London, who were starting their musculoskeletal skills placement. Factor analysis explored the construct validity of the MSAT; Cronbach's alpha assessed its internal consistency; standardised response mean (SRM) evaluated its responsiveness, and test-retest, before and after a pathology lecture, assessed its repeatability. Its relationship with competence was explored by evaluating its correlation with shoulder and knee objective structured clinical examinations (OSCEs). Results The MSAT was valid in distinguishing the 5 domains it intended to measure: clinical examination of the knee; clinical examination of the shoulder; clinical anatomy of the knee and shoulder; history taking, and generic musculoskeletal anatomical and clinical terms. It was internally consistent (alpha = 0.93), responsive (SRM 0.6 in Newcastle and 2.2 in London) and repeatable (intraclass correlation coefficient 0.97). Correlations between MSAT scores and OSCE scores were weak (r < 0.2). CONCLUSIONS: The MSAT has strong psychometric properties, thereby offering a valid approach to evaluating the self-assessment of confidence in examination skills by students. Confidence does not necessarily reflect competence; future research should clarify what underpins confidence.     

Trialling a new way to learn clinical skills: systematic clinical appraisal and learning

AIM: To describe and evaluate the effectiveness of a new method of teaching clinical skills designed to increase students' active and self-directed learning as well as tutor feedback. METHODS: A total of 22 consenting Year 4 medical students undertaking general practice and general surgery clinical experience were involved in a pre- and post-test research design. In the initial period of the study, students were taught clinical skills in a traditional manner. In the second phase a clinical teaching strategy called systematic clinical appraisal and learning (SCAL) was utilised. This learning strategy involved active and self-directed learning, holistic care and immediate feedback. Students independently saw a patient and were asked to make judgements about the patient's potential diagnosis, tests required, management, psychosocial needs, preventive health requirements, and any ethical problems. These judgements were then compared with those of the clinical supervisor, who saw the same patient independently. Students recorded details for each consultation. Comparisons were made of the two study periods to examine whether the use of SCAL increased the number of students' independent judgements, perceived student learning, tutor feedback and self-directed learning. RESULTS: During the SCAL learning period, students reported making a greater number of statistically significant independent judgements, and receiving significantly increased tutor feedback in both general practice and general surgery. The number of learning goals set by students was not found to differ between the two periods in surgery but significantly increased in general practice in the SCAL period. Students' perceptions of their learning significantly increased in the SCAL period in surgery but not in general practice. During the traditional learning period in both settings, there was limited student decision-making about most aspects of care, but particularly those relating to prevention, psychosocial issues and ethics. CONCLUSIONS: The SCAL approach appears to offer some advantages over traditional clinical skills teaching. It appears to encourage active and independent decision-making, and to increase tutor feedback. Further exploration of the approach appears warranted.