Measuring the hospital experiences of junior doctors

The development of an appraisal questionnaire which measures junior doctors' opinions about their hospital experiences is described. The first section of the questionnaire consists of seven reliable subscales which measure opinions about teaching and learning, registrar teaching, consultant teaching, staff support, workload, administration and overall experiences during a period of attachment or term. The second part of the survey contains 11 reliable questions about the hours spent on service and education during the term. The responses to this measure of 257 randomly selected Australian junior doctors are described. The questionnaire may be used to contrast the experiences of junior doctors in different types of terms, different hospitals or varying levels of training. The data generated from the instrument can provide useful information about hospitals, such as the work practices of junior staff and the effectiveness of educational programs.     

Monitoring standards of training

In postgraduate medical education there will always be a tension between delivering the service and ensuring time for reflection and learning. The balance requires monitoring to ensure national implementation of standards and to provide an external review for hospitals. However, the current system in the United Kingdom of visiting by many different agencies is disruptive to hospitals and wasteful of resources. The North Western Deanery has worked with medical royal colleges to develop a co-ordinated system of visiting and reporting which is designed to share information and expertise while reducing the pressure on hospitals. SETTING AND MAINTAINING STANDARDS: Clear standards are published and hospitals are encouraged to measure their own performance against these so that they are able to address identified problems. The effectiveness of the visits depends on collection and collation of data, especially face-to-face interviews with trainees and consultants. At the end of the visit a structured verbal feedback is given to senior managers and clinicians in the hospital and is followed by a written report. IMPROVING THE QUALITY OF TRAINING: Systematic review of training placements by the postgraduate dean's team has resulted in a steady increase in the quality of training placements and a structured approach has given trusts a framework to review the quality of training between visits. The future must lie in greater investment of responsibility in postgraduate deans for routine monitoring of training placements to consistent standards, which would allow the newly emerging Medical Education Standards Board (MESB) to review deaneries rather than individual placements.     

'Science', 'critical thinking' and 'competence' for tomorrow's doctors. A review of terms and concepts

CONTEXT: The recommendations of the General Medical Council in Tomorrow's Doctors renewed efforts to define core knowledge in undergraduate medical education. They also encouraged better use of the medical knowledge base in nurturing clinical judgement, critical thinking, and reflective practice. What then does the medical world understand by 'science', 'critical thinking' and 'competence', given the need to address both growth and uncertainty in the knowledge base and to practise evidence-based healthcare? AIM AND OBJECTIVES: This review aims to outline the role of these key concepts in preparing undergraduate medical students for professional practice. Specifically, it explores: the fallibility of the 'scientific' foundations of medical practice; the role of understanding and thinking in undergraduate medical education; the need for a broad interpretation of competence and its relationship to transferability, and the nature of clinical judgement. COMMENT: Tensions are seen to lie in the varying interpretations of clinical decision making as art or science; the varying characterizations of the nature of skilled performance in the novice, the competent and the expert practitioner, and the varying reactions to the acceptability and usefulness of 'meta-' concepts in capturing the essence of professional practice. Habitual self-conscious monitoring of mental processes may be the key to the flexible transfer and application of knowledge and skills across the contexts, characterized by uncertainty and incomplete evidence, for which doctors must be prepared.     

Do junior doctors feel they are prepared for hospital practice? A study of graduates from traditional and non-traditional medical schools

A valid and reliable questionnaire was developed which assesses eight subscales relating to key areas of medical hospital-based work. This was used to evaluate junior doctors' perceptions of the adequacy of their undergraduate medical training to prepare them for hospital practice. Data from 139 (60%) first-year doctors (interns) showed that graduates from the problem-based medical school rated their undergraduate preparation more highly than traditional medical school graduates in preparing them for practice in the areas of interpersonal skills, confidence, collaboration with other health care workers, preventive care, holistic care and self-directed learning. These findings persisted when ratings were adjusted for the effects of age and gender. There were no differences between the intern groups for patient management and understanding science. This research suggests that educational experiences in different undergraduate medical courses are important in preparing doctors for their early working life.     

Measurement of how well a paediatric training programme prepares graduates for their chosen career paths

To provide a sound basis for modification of our paediatric residency education programme, we surveyed graduates from the past 16 years. The questionnaire was designed to determine the adequacy of training rotations in preparing graduates for their career paths. Questionnaires were mailed to 81 graduates; 73 (90%) replied. A modified version was completed by 27 of 29 current residents (93%). For most rotations, responses were normally distributed. However, 10 or more respondents identified exposure in one area as `excessive' and in 6 as `inadequate'. Current residents scored many rotations as `inadequate', likely indicative of their limited exposure to actual practice. Recommendations were consistent for subjects needing more instruction. All major issues raised by graduates had been identified by faculty, but the substantiation enabled changes to be made with widespread support. We recommend periodic survey of graduates to evaluate how well education is preparing residents for their ultimate career paths.     

Hospital doctors,general practitioners and dentists learning together

The design, implementation and evaluation of an innovative course on education for a group of hospital doctors, general practitioners and dentists is described. It took place over five 2-day modules spread over 21 months. There were 33 participants and several tutors and external resources. The course was designed around group work and used a learner-centred agenda. Evaluation was by use of the nominal group technique during the course and by open questionnaires after 18 months. The course was successful in stimulating a number of activities and in developing the skills and confidence of the participants. Problem areas centred around the tension between the learner-centred agenda and the participants' need for structure. Courses such as this require good administration, a cohesive and supportive tutors' group, a clear statement of aims, even within a learner-centred framework, and the establishment of clear ground rules to allow the participants to feel safe. Without safety it is arguable that less challenging learning will occur.     

Setting standards on educational tests

OBJECTIVE: This instalment in the series on professional assessment provides an introduction to methods of setting standards. METHOD: A standard is a special score that serves as a boundary between those who perform well enough and those who do not. The practical steps in selecting it include: deciding on the type of standard; deciding the method for setting it; selecting the judges; holding the meeting; calculating the cutpoint, and deciding what to do afterwards. Four of the more popular methods are illustrated for both written and clinical examinations. RESULTS: The most important criteria for selecting a method for setting standards are whether it is consistent with the purpose of the test, based on expert judgement, informed by data, supported by research, transparent, and requires due diligence. The credibility of the standard will rely largely on the nature of the standard setters and the selection of a broadly representative and knowledgeable group is essential. After the standard has been set, it is important to ensure that stakeholders view the results as credible and that the pass rates have sensible relationships with other markers of competence. CONCLUSIONS: A standard is an expression of professional values in the context of a test's purpose and content, the ability of the examinees, and the wider social or educational setting. Because standards are an expression of values, methods for setting them are systematic ways of gathering value judgements, reaching consensus and expressing that consensus as a single score on a test.     

Clinical teaching: maintaining an educational role for doctors in the new health care environment

CONTEXT AND OBJECTIVES: Good clinical teaching is central to medical education but there is concern about maintaining this in contemporary, pressured health care environments. This paper aims to demonstrate that good clinical practice is at the heart of good clinical teaching. METHODS: Seven roles are used as a framework for analysing good clinical teaching. The roles are medical expert, communicator, collaborator, manager, advocate, scholar and professional. RESULTS: The analysis of clinical teaching and clinical practice demonstrates that they are closely linked. As experts, clinical teachers are involved in research, information retrieval and sharing of knowledge or teaching. Good communication with trainees, patients and colleagues defines teaching excellence. Clinicians can 'teach' collaboration by acting as role models and by encouraging learners to understand the responsibilities of other health professionals. As managers, clinicians can apply their skills to the effective management of learning resources. Similarly skills as advocates at the individual, community and population level can be passed on in educational encounters. The clinicians' responsibilities as scholars are most readily applied to teaching activities. Clinicians have clear roles in taking scholarly approaches to their practice and demonstrating them to others. CONCLUSION: Good clinical teaching is concerned with providing role models for good practice, making good practice visible and explaining it to trainees. This is the very basis of clinicians as professionals, the seventh role, and should be the foundation for the further development of clinicians as excellent clinical teachers.     

Progression of junior doctors into higher specialist training

OBJECTIVES: To report on the transition of junior doctors into higher specialist training in the UK, following the Calman reforms and recent initiatives to promote training in general practice. Design and setting Postal questionnaire survey carried out in the UK. PARTICIPANTS: All graduates of 1996 from UK medical schools were surveyed in 2002. MAIN OUTCOME MEASURES: Outcome measures were considered to be details of applications, outcomes of applications, intentions to apply for specialist training, and career plans with regard to such issues as flexible training and work. RESULTS: Of 2312 responders, 39% had applied for specialist registrar (SpR) training and 35% for general practice (GP) training. Of applicants for SpR training, 68% were successful; 24% failed, almost all of whom intended to reapply, many after gaining research experience; 4% awaited a decision, and 4% had had another outcome (e.g. they withdrew their application). A sixth of responders intended to apply but had not yet done so. Of applicants for GP training, 95% had been successful. A further 2% intended to apply but had not yet done so. Responders viewed flexible and part-time training and work opportunities, and information about available posts, as being more widely available in general practice than in hospital practice. Half of the responders did not agree that their postgraduate training had been of a high standard. CONCLUSIONS: Progression into GP training seemed to have been a smoother and less protracted process than that into SpR training. Delayed applications for SpR training were common, and many of those who had applied had not been accepted. The use of research experience to strengthen a re-application was common.     

Home, training and work: mobility of British doctors

This study examines the locations of family homes, medical schools and places of specialist training, and work of doctors qualifying from UK medical schools in 5 calendar years between 1974 and 1993. The contribution of each UK region to the medical workforce relative to its population is assessed and trends over time are examined. The relationship between place of family home and medical school attended is examined for 14,108 doctors. Career appointment location and its relationship to medical school and family home loc‐ation are examined for over 4000 doctors. For the qualifiers of 1983, an additional analysis incorporating place of training is included. Large differences were found in the percentage of medical students from local family homes attending each regional medical school. In some cases differences reflected local populations but other cases had no obvious cause. Over all cohorts studied, 38% of respondents attended a medical school in the region of their family home (32% of 1993 qualifiers), 42% held a career post in the same region as their medical school, and 38% held a career post in the same region as their family home. Among the qualifiers of 1983, 65% had a career post in the same region as their postgraduate training, 34% also attended medical school in the same region, and 19% also came from family homes in the same region. More women than men took up a career post in the same region as their postgraduate training. The relationships to family home and medical school did not differ by gender. Consultants appeared slightly less likely than GPs to have stayed within a region, but this difference was not statistically significant.     

Reforming higher specialist training in the United Kingdom--a step along the continuum of medical education

OBJECTIVES: The requirement to align the arrangements for postgraduate training in the United Kingdom with those elsewhere in the European Community provided the opportunity to review and reform our arrangements for higher specialist training. This paper describes the case for change--the strengths and deficiencies of the traditional pattern of postgraduate medical training, demographic influences in the medical workforce and the need for a more structural or planned approach to training. CONCLUSIONS: Over the past 5 years substantial progress has been made: the introduction of new regulatory arrangements and a new higher specialist training grade; the development of a managed and flexible system for delivering training to standards set by the Royal Colleges and which can accommodate the needs of those pursuing academic and research medicine; and the opportunity for trainees' progress to be measured against published curricula. The significant programme of change has been underpinned by careful workforce planning and the publication of comprehensive guidance. Significant reform of higher specialist training has been achieved. This paper also makes the case for a more strategic approach to planning and developing medical education across the continuum, from entry to medical school until retirement, which can guide medical education and improve patient care into the next millennium.     

Shared goals, shared learning: evaluation of a multiprofessional course for undergraduate students

Twenty-eight undergraduate degree students from seven health care professions attended a two-day pilot course. Using small multiprofessional groups, final-year students from occupational therapy, orthoptics, therapy radiography, nursing, physiotherapy, medicine and dentistry explored professional roles and clinical problem-solving using a theme-based approach. A balance of didactic and interactive small-group learning enabled them to identify issues surrounding multiprofessional teamworking and collaboration in the National Health Service. Evaluation results showed that the course increased knowledge and understanding of other health care professions, developed more positive attitudes and demonstrated the importance of multiprofessional teamwork and communication. Participating students believed that both early and regular opportunities for shared learning should be essential aspects of undergraduate courses.     

Education and training in the senior house officer grade: results from a cohort study of United Kingdom medical graduates

INTRODUCTION: This paper shows the findings from a survey of 439 senior house officers undertaken as part of the British Medical Association cohort study of 1995 medical graduates. The aim of the study was to assess the quality of senior house officer training in the United Kingdom. METHOD: In July 1997 a postal questionnaire was sent to a sample of 545 doctors who graduated from medical school in 1995. Responses were received from 515 (95%). Only those doctors who had worked as a senior house officer in the previous 12 months were included in the analysis (n = 439). RESULTS: Encouraging results are that 69% of the senior house officers surveyed had discussed their progress directly with their consultant, and 24% rated their supervision by their consultant as 'excellent'. Of concern are the findings that 47% of respondents did not receive protected teaching time and 16% were unable to take study leave. DISCUSSION: The study revealed wide variability in the quality of training received by senior house officers in the United Kingdom. Whilst some respondents - notably those in general practice, accident and emergency, paediatrics and psychiatry - had enjoyed a high standard of education and training, it was clear that a minority of posts continue to offer little if any educational value to the post holder. The results point to a need for a more systematic approach to maintaining standards in senior house officer training with greater incentives for under-performing trusts.     

Promoting effective teaching and learning: hospital consultants identify their needs

OBJECTIVES: The aim of this study was to help hospital consultants identify their needs in relation to teaching skills, leading to the development of a teacher training programme. DESIGN: The study was directed at all 869 consultants in the region and initially involved a postal questionnaire which had a 60.5% response rate. SETTING: Hospitals throughout Northern Ireland. SUBJECTS: Hospital consultants. RESULTS: Results from this questionnaire indicated that while the majority of respondents were interested teachers, only 34% had received any teacher training. The questionnaire was followed by a focus group study involving three groups of consultants drawn randomly from those who had responded to the questionnaire. Participants in these groups identified the following key areas of hospital education: qualities of hospital teachers; selection procedures; problems of teaching in hospitals; the need for teacher training and how it should be provided. CONCLUSION: The study highlighted that hospital teachers need to acquire and update their teaching skills through attending courses that should include basic teaching and assessment/appraisal skills. These courses should last 1 or 2 days and be provided at a regional or subregional level. As a result of this study, teacher training courses have been developed in this region.     

Meeting the needs of future physicians: a core curriculum initiative for postgraduate medical education at a Canadian university

In addition to possessing medical expertise, contemporary physicians are expected to be skilled communicators, critical consumers and users of medical research, teachers, collaborators, health care advocates, and managers. A core curriculum is a common set of learning experiences designed to help prepare physicians for these complex roles. PURPOSE: This article describes the design and implementation of one core curriculum, summarizes the feedback received from residents, and shares some of the lessons we are learning as we use feedback to develop our programme. METHOD: The core curriculum described was implemented at a Canadian university which offers 56 residency programmes with a total enrollment of approximately 360 students. The curriculum consisted of 30 sessions organized around four themes: biostatistics and epidemiology; communications and teaching skills; healthcare management, and ethical, medicolegal and lifestyle issues. Each session in the Core Curriculum was evaluated by residents with respect to the timing, quality, and value of the learning experience. In addition, residents participated in focus group discussions of their Core Curriculum experiences. RESULTS: Key findings related to the characteristics of effective core curriculum learning experiences and to the barriers to implementing a core curriculum across programmes. Of particular salience were findings related to explicit issues of attendance and the diverse needs of learners and programmes, and to more implicit issues of communication and managing change. The specific content and format of the Core Curriculum and the results of the evaluation process will be of interest to others considering a core curriculum for postgraduate medical programmes.     

Clarifying the concepts of confidence and competence to produce appropriate self-evaluation measurement scales

INTRODUCTION: This paper reviews the literature on self-evaluation and discusses the findings of a small-scale qualitative study which explored the terms 'confidence' and 'competence' as useful measures in a self-evaluation scale. Four pre-registration house officers took part in interviews and completed a provisional instrument to assess their perceived competence. FINDINGS: Competence and confidence are useful terms for house officers expressing beliefs about their ability to perform their job but the terms should not be used synonymously. In our study, 'competent' represented what individuals knew about their ability and was based on the individual's previous experience of the task. 'Confident' described a judgement which influenced whether an individual was willing or not to undertake an activity. Confidence was not necessarily based on known levels of competence and therefore performance of tasks which were unfamiliar to the house officer also involved the assessment of risk. The authors give examples of task and skill scales which may be useful in the process of self-evaluation by pre-registration house officers. CONCLUSIONS: The authors suggest that the process of assessing oneself is complicated, and by its very nature can never be objective or free from the beliefs and values individuals hold about themselves. Therefore self-evaluation instruments are best used to help individuals analyse their work practices and to promote reflection on performance. They should not be used to judge the 'accuracy' of the individual's evaluation.     

Medical education and the corresponding professional needs of young doctors: the Finnish Junior Physician 88 Study

Summary. The Universities of Kuopio and Tampere in collaboration with the Ministry of Social Affairs and Health and Finnish Medical Association carried out the 'Junior Physician 88' study in 1988, the purpose of which was to shed further light on the life situation and future plans of young doctors and their views concerning undergraduate and postgraduate medical education. The study concerned all the doctors registered during the years 1977–1986 in Finland (   n = 5208  ). After randomization, a postal questionnaire was sent to one half (   n = 2631  ) of these doctors. After the first reminder letter, 1745 questionnaires (66.3%) were returned. According to the views of the respondents undergraduate hospital teaching was adequate but the teaching of practice in health centres, school health care, team-work, health care of the elderly, home health care, rehabilitation, environmental health care and administration did not meet the professional needs of doctors. All doctors were satisfied with the hospital teaching in their undergraduate curriculum. However, only the doctors who graduated from the two modern universities in Kuopio and Tampere were satisfied with their undergraduate health centre teaching.     

Are junior doctors taught to use problem lists?

One hundred junior doctors were asked to complete a questionnaire about the training they had received in the use of problem lists. A questionnaire was sent about the training in the use of problems lists at their medical school to the Deans at all 27 British medical schools. Of the 100 junior doctors, 57 reported that problem lists 'had hardly been mentioned' at their medical school. In contrast only one of the 24 Deans who responded thought that problems lists were 'likely to be hardly mentioned' at his medical school. After graduation only 35 junior doctors had worked for a consultant who had demanded the use of problem lists and only 17 of these had worked for more than one such consultant. Most junior doctors have received little training in the use of problem lists as undergraduates and even fewer as postgraduates. Few consultants demand the use of problem lists.     

The development and evaluation of a personal learning log for Senior House Officers

OBJECT: To develop and evaluate the effect of having a personal learning log on Senior House Officers knowledge and confidence. METHODS: A multiple choice paper and a confidence checklist for two hospital specialties were developed to assess knowledge and confidence. These were administered to a control group and to an intervention group who had the learning log. Both groups completed an evaluation at the end of the post. SETTING: The study took place in Accident & Emergency and Obstetric & Gynaecology posts in Greater Glasgow and Lanarkshire. SUBJECTS: 79 Senior House Officers in Accident & Emergency and 78 Senior House Officers in Obstetrics & Gynaecology. RESULTS: The mean scores in the MCQ and the mode in the confidence checklist increased significantly in both specialties during the post, but there was no significant difference between the control and intervention groups. Forty two learning logs were returned at the end of the study and analysis of these revealed that there was great scope for learning but few documented the specific learning achieved. Evaluation of the posts revealed that some improvements had taken place in teaching and assessment frequency, however, there was scope for further improvement. CONCLUSION: While the problems of hospital training are well documented, an attempt to improve the situation using a learning log did not have a statistically significant impact on SHO knowledge or confidence. A six-month hospital post appears to present many opportunities for learning but these are not exploited. It is suggested that three things are needed. Firstly, active participation by and personalized feedback from a senior member of staff, with training where needed. Secondly, protected time for tutorials with a planned system of formative assessment, and thirdly, a more positive approach to learning by both SHOs and consultants. Once this occurs, a learning log may have a more significant impact on training.     

Helping tomorrow's doctors to gain a population health perspective - good news for community stakeholders

INTRODUCTION: The modernising agenda of the NHS and recommendations of professional bodies demand that all doctors achieve a basic understanding of a population health perspective. The principle of integrated learning and the logistics of provision make it inappropriate for such learning to be delivered solely by public health specialists, and community-based learning has been promoted as the best setting in which to assist this objective. However, there is little evidence from practice as to whether non-specialist staff are willing or able to play a role in orienting tomorrow's doctors to the needs of communities. METHODS: Semi-structured interviews, questionnaires and focus groups iterated the opinion of key stakeholders on their preferred contributions to community-oriented undergraduate medical education. Framework analysis was used to elicit key outcomes and process factors. RESULTS: There was consensus that community-based learning should be a core element of the medical curriculum as it can demonstrate the socioenvironmental context of care and the doctor's role in interagency working and preventive care. Effective academic/NHS partnerships were called for, with higher education leading the agenda on aims and objectives, creating collaborative structures, and reallocating resources to support new learning. Community-based stakeholders would offer the translation of theory into practice by demonstrating clinical and social diversity, models of teamworking, and a context for the application of prior learning. They also promoted recurrent contact with communities, and suggested an enhanced role in mentoring students through longer term relationships. CONCLUSION: Community-based personnel and NHS users are an under-used resource for medical education. Their proposed contributions strongly accord with the agenda for a population health perspective in basic training. Curriculum planners need to make long-term partnerships with community-based agencies, rather than using them as an intermittent provider of limited learning sessions with narrowly defined objectives.