A regionalized perinatal continuing education programme: successful adaptation to a foreign health care system and language

Much of the decline in perinatal mortality over the past two decades in the United States has been attributed to regionalization of perinatal care. Outreach education from regional medical centres to community hospitals is an essential component of regionalization. The Perinatal Continuing Education Program (PCEP) has been successfully used for outreach education in more than 30 states since 1979. This project tested the efficacy of implementing the PCEP strategy in Poland. PCEP was adapted to Polish conditions, translated, and implemented in four phases. The scheme allowed gradual transfer of ownership to Polish leaders and use of the existing regional structure to disseminate information from regional centres to community hospitals. Evaluation included measures of programme use (participation and completion rates) and acceptance (participant evaluation forms), cognitive knowledge (pre- vs. post-tests), and patient care (chart reviews). Of 2093 doctors, nurses and midwives who began, 1615 (77%) completed the programme, with higher completion by regional centre than community hospital staff. All participant groups responded favourably to the materials and expressed moderate confidence in their mastery of the information and skills. Test scores improved significantly for all phases and for all disciplines, with baseline and final scores consistent with degrees of previous professional education. Large baseline and inter-hospital variations in chart review data restricted analysis of care practices. A comprehensive perinatal education programme can be successfully transferred to a foreign health care system. We believe the following to be particularly important: multidisciplinary instructors and students; a self-instructional format; content aimed at practice rather than theory; and an organized implementation strategy co-ordinated by local personnel.     

The impact of evidence-based education on a perinatal capacity-building initiative in Macedonia

CONTEXT: The perinatal mortality rate (PMR) in Macedonia is among the highest in Europe. The World Bank supported a consultant (HEJ) to collaborate with a Macedonian team to develop a national perinatal strategy with the goal of reducing the PMR. Education was given priority in the form of a hospital-based initiative to develop the capacity of health professionals to introduce evidence-based perinatal practice into 16 participating hospitals. A "train the teachers" approach was used, with trainees introduced to modern education and clinical practice in Sydney and subsequently supported to train their colleagues in Skopje. OBJECTIVES: To describe the development, implementation and evaluation of the educational intervention. METHODS: A curriculum, based on specific Macedonian needs, was developed in order to integrate teaching in the knowledge, skills and attitudinal domains of learning, using small group, interactive techniques. Twenty-five Macedonian doctors and nurses participated in 4-month (phase 1a) and 6-month (phase 1b) teaching programmes at a tertiary perinatal unit in Sydney. Australian staff conducted 4 2-week modules for 36 trainees in Macedonia (phase 2). The phase 1 trainees conducted 8 modules for 57 colleagues in Skopje (phase 3). The intervention was evaluated by trainee questionnaires, assessments of competence, changes in hospital practice and pre- (1997-99) and post-intervention (2000-01) comparisons of PMR. RESULTS: A total of 115 doctors and nurses graduated from the programme. Positive responses to the education programme exceeded 80%. Evidence-based practice in 16 participating hospitals (covering 91% of all Macedonian births) was verified in 6 key areas of neonatology. The PMR fell significantly from 27.4 to 21.5 per 1000 births (RR 0.79, 95% CI 0.73, 0.85). The early neonatal death rate in babies weighing over 1000 g fell by 36%. CONCLUSIONS: The intervention has increased the capacity of Macedonians to practise best-evidence perinatal medicine and improve outcomes. Sustainability is predicted by the "train the teachers" approach, with concurrent strengthening of the infrastructure and organisational framework.     

Improvement of neonatal care in Zhejiang Province, China through a self-instructional continuing education programme

Summary. Major upheavals have taken place in medical education in the last three decades in China. This has meant that at every level there are personnel with a wide range of training backgrounds. Continuing education programmes to ameliorate the situation have been seen as a priority of the Ministry of Public Health (MOPH). However, many of the training courses offered are too academic in approach and do little to raise standards of clinical care. The shortcomings in neonatal education are particularly acute and this is reflected in the relatively high neonatal mortality rate.
At the request of Zhejiang Provincial Bureau of Public Health (BOPH), Project HOPE, an American non-governmental organization (NGO), collaborated with Zhejiang Medical University (ZMU) on the development of a neonatal outreach programme. The programme was self-instructional in approach with individual hospitals having autonomy in the mode of implementation of the programme. There were 225 participants in four county level hospitals. Cognitive knowledge test scores improved by an average of 56%. Observation of clinical practices showed that 54% improved following the programme, with 34% meeting the criteria set by the modules. An inventory of facilities showed that of a list of essential items an average of 38% were present before the programme compared with 76% after completion of the programme.
As a result of the success of the programme it is being expanded into a comprehensive teaching and evaluation package for use throughout Zhejiang Province and Eastern China.     

Certifying examination performance and patient outcomes following acute myocardial infarction

OBJECTIVE: To establish whether successful certifying examination performances of doctors are associated with their patients' mortality and length of stay following acute myocardial infarction. DESIGN: Risk adjusted mortality and survivors' length of stay were compared for doctors who had satisfactorily completed training in internal medicine or cardiology and attempted the relevant examination. Specifically, the study investigated the joint effects of hospital location, availability of advanced cardiac care, doctors' specializations, certifying examination performances, year certification was first attempted and patient volume. SETTING AND PARTICIPANTS: Data on all acute myocardial infarctions in Pennsylvania for the calendar year 1993 were collected by the Pennsylvania Health Care Cost Containment Council. These data were combined with physician information from the database of the American Board of Internal Medicine. RESULTS: Holding all variables constant, successful examination performance (i.e. certification in internal medicine or cardiology) was associated with a 19% reduction in mortality. Decreased mortality was also correlated with treatment in hospitals located outwith either rural or urban settings and with management by a cardiologist. Shorter stays were not related to examination performance but were associated with treatment by high volume cardiologists who had recently finished training and who cared for their patients in hospitals located outwith rural or urban settings. CONCLUSIONS: The results of the study add to the evidence supporting the validity of the certifying examination and lend support to the concept that fund of knowledge is related to quality of practice.     

Components of postgraduate competence: analyses of thirty years of longitudinal data

CONTEXT: The conceptualisation and measurement of competence in patient care are critical to the design of medical education programmes and outcome assessment. OBJECTIVE: We aimed to examine the major components and correlates of postgraduate competence in patient care. METHODS: A 24-item rating form with additional questions about resident doctors' performance and future residency offers was used. Study participants comprised 4560 subjects who graduated from Jefferson Medical College between 1975 and 2004. They pursued their graduate medical education in 508 hospitals. We used a longitudinal study design in which the rating form was completed by programme directors to evaluate residents at the end of the first postgraduate year. Factor analysis was used to identify the underlying components of postgraduate ratings. Multiple regression, t-test and correlational analyses were used to study the validity of the components that emerged. RESULTS: Two major components emerged, which we labelled 'Knowledge and Clinical Capabilities' and 'Professionalism', and which addressed the science and art of medicine, respectively. Performance measures during medical school, scores on medical licensing examinations, and global assessment of Medical Knowledge, Clinical Judgement and Data-gathering Skills showed higher correlations with scores on the Knowledge and Clinical Capabilities component. Global assessments of Professional Attitudes and ratings of Empathic Behaviour showed higher correlations with scores on the Professionalism component. Offers of continued residency and evaluations of desirable qualities were associated with both components. CONCLUSIONS: Psychometric support for measuring the components of Knowledge and Clinical Capabilities, and Professionalism provides an instrument to empirically evaluate educational outcomes to medical educators who are in search of such a tool.     

Learning management systems: technology to measure the medical knowledge competency of the ACGME

AIMS: We report how the learning management system (LMS) Web Course Tools (WebCT) was used to design, implement and evaluate the web-based course "Principles of Ambulatory Paediatrics", taken by paediatric residents during an ambulatory block rotation. This report also illustrates how WebCT can be used to measure the medical knowledge competency required by the Accreditation Council for Graduate Medical Education (ACGME). METHODS: Eighty paediatric residents completed a 1-month outpatient rotation between July 1, 2001 and June 30, 2002. During this rotation residents were required to complete 4 modules in asthma, otitis media, gastroenteritis and fever, respectively. Each module was evaluated using a standard questionnaire. RESULTS: Completion rates for the required modules ranged from 64-72%. Residents in all 3 years of training showed improvement between the pre- and post-test scores for each module, except for postgraduate Year 2 residents in the asthma module. Most residents somewhat agreed, agreed or strongly agreed that the module components were useful and that the experience of completing the modules would improve their ability to take care of patients. CONCLUSIONS: The LMS WebCT is an innovative and adaptable approach for designing a web-based course for primary care education in paediatrics. The LMS addresses the educational needs of both a clinical division and a residency programme. The LMS also provides an information technology infrastructure to measure the medical knowledge competency required by the ACGME.     

Validating the Readiness for Interprofessional Learning Scale (RIPLS) in the postgraduate context: are health care professionals ready for IPL?

AIMS: This paper describes the process of validating the Readiness for Interprofessional Learning Scale (RIPLS) for use with postgraduate health care professionals. CONTEXT: The RIPLS questionnaire has proved useful in the undergraduate context, enabling tutors to assess the readiness of students to engage in interprofessional learning (IPL). With the drive in the National Health Service (NHS) to deliver health care in interprofessional teams, it seems logical to ask whether postgraduate education should, or could, be delivered successfully in interprofessional contexts. As a preliminary to undertaking an extended IPL project, the researchers tested the validity of the RIPLS tool in the postgraduate health care context. METHOD: A modified version of the RIPLS questionnaire was administered to all general practitioners, nurses, pharmacists and allied health professionals in the Dundee Local Health Care Cooperative (LHCC) (n = 799). A total of 546 staff responded (68%). RESULTS: Three factors, comprising 23 statements, emerged from the statistical analysis of the survey data, namely, teamwork and collaboration, sense of professional identity and patient-centredness. The internal consistency measure was 0.76. Analysis of variance suggested some key differences between the different professions in respect of the factors. CONCLUSIONS: The RIPLS questionnaire was validated for use in the postgraduate context, thus providing researchers with a tool for assessing health professionals' attitudes towards interprofessional learning at practice level, community health partnership level or at a national level of education and training. Significant differences between professional groups should be taken into account in designing any interprofessional learning programme.     

Community-based learning in obstetrics for undergraduate medical students

Summary: Medical students on their obstetrics and gynaecology attachment were randomly assigned to attend hospital ( n = 24) or general practice ( n = 18) obstetric clinics once weekly for 4 weeks. The students completed self-assessment questionnaires at the beginning and end of the attachment. There was a significant improvement in the level of knowledge and skills required for antenatal care, care in labour and postnatal care by the end of the attachment, with no difference between hospital or general practice groups. There was a significant increase in the level of interest in the future practice of obstetrics only in the general practice group. However, this difference could be explained by the greater number of students in the general practice group who were by chance in the 'no or don't know' category at the start of their attachment. We conclude that general practice based clinical teaching of obstetrics can be a suitable alternative to hospital-based clinical teaching for undergraduate medical students.     

Use of critical incidents to develop a rating form for resident evaluation of faculty teaching

CONTEXT: Monitoring the teaching effectiveness of attending physicians is important to enhancing the quality of graduate medical education. METHODS: We used a critical incident technique with 35 residents representing a cross-section of programmes in a teaching hospital to develop a 23-item rating form. We obtained ratings of 11 attending physicians in internal medicine and general surgery from 54 residents. We performed linear and logistic regression analysis to relate the items on the form to the residents' overall ratings of the attending physicians and the programme directors' ratings of the attending physicians. RESULTS: The residents rated the attending physicians highly in most areas, but lower in provision of feedback, clarity of written communication and cost-effectiveness in making clinical decisions. When we used the residents' overall ratings as the criterion, the most important aspects of attending physicians' teaching were clarity of written communication, cost-effectiveness, commitment of time and energy and whether the resident would refer a family member or friend to the physician. When we used the programme directors' ratings as the criterion, the additional important aspects of performance were concern for the residents' professional well-being, knowledge of the literature and the delivery of clear verbal and written communication. CONCLUSIONS: The critical incident technique can be used to develop an instrument that demonstrates content and construct validity. We found that residents consider commitment of time to teaching and clinical effectiveness to be the most important dimensions of faculty teaching. Other important dimensions include written and verbal communication, cost-effectiveness and concern for residents' professional development.     

Assessment of patient management skills and clinical skills of practising doctors using computer-based case simulations and standardised patients

CONTEXT: Standardised assessments of practising doctors are receiving growing support, but theoretical and logistical issues pose serious obstacles. OBJECTIVES: To obtain reference performance levels from experienced doctors on computer-based case simulation (CCS) and standardised patient-based (SP) methods, and to evaluate the utility of these methods in diagnostic assessment. SETTING AND PARTICIPANTS: The study was carried out at a military tertiary care facility and involved 54 residents and credentialed staff from the emergency medicine, general surgery and internal medicine departments. MAIN OUTCOME MEASURES: Doctors completed 8 CCS and 8 SP cases targeted at doctors entering the profession. Standardised patient performances were compared to archived Year 4 medical student data. RESULTS: While staff doctors and residents performed well on both CCS and SP cases, a wide range of scores was exhibited on all cases. There were no significant differences between the scores of participants from differing specialties or of varying experience. Among participants who completed both CCS and SP testing (n = 44), a moderate positive correlation between CCS and SP checklist scores was observed. There was a negative correlation between doctor experience and SP checklist scores. Whereas the time students spent with SPs varied little with clinical task, doctors appeared to spend more time on communication/counselling cases than on cases involving acute/chronic medical problems. CONCLUSION: Computer-based case simulations and standardised patient-based assessments may be useful as part of a multimodal programme to evaluate practising doctors. Additional study is needed on SP standard setting and scoring methods. Establishing empirical likelihoods for a range of performances on assessments of this character should receive priority.     

Promoting effective teaching and learning: hospital consultants identify their needs

OBJECTIVES: The aim of this study was to help hospital consultants identify their needs in relation to teaching skills, leading to the development of a teacher training programme. DESIGN: The study was directed at all 869 consultants in the region and initially involved a postal questionnaire which had a 60.5% response rate. SETTING: Hospitals throughout Northern Ireland. SUBJECTS: Hospital consultants. RESULTS: Results from this questionnaire indicated that while the majority of respondents were interested teachers, only 34% had received any teacher training. The questionnaire was followed by a focus group study involving three groups of consultants drawn randomly from those who had responded to the questionnaire. Participants in these groups identified the following key areas of hospital education: qualities of hospital teachers; selection procedures; problems of teaching in hospitals; the need for teacher training and how it should be provided. CONCLUSION: The study highlighted that hospital teachers need to acquire and update their teaching skills through attending courses that should include basic teaching and assessment/appraisal skills. These courses should last 1 or 2 days and be provided at a regional or subregional level. As a result of this study, teacher training courses have been developed in this region.     

The current state of medical education in Japan: a system under reform

CONTEXT: Not since just after World War II has there been as dramatic a change in the system of medical education in Japan as in the last several years. Medical school curricula are including more education that mimics clinical practice through problem-based learning, organ-based curricula and implementation of the objective structured clinical examination (OSCE). In response to criticism and concerns, the Japanese government has also implemented 2 major changes in the system of postgraduate medical education. First, a 2-year structured internship has been required of all medical school graduates; the first cohort to undertake this completed it in April 2006. Second, an internship matching system was adopted and first implemented in 2003. DISCUSSION: These reforms are leading to significant shifts in clinical education in Japan. Increasing numbers of medical graduates are entering residency programmes outside specialised university hospitals and core rotations place an increased emphasis on primary care. CONCLUSIONS: These changes in the training of young doctors suggest that the general clinical competency of doctors in Japan will improve in the coming years.     

Predicting doctor performance outcomes of curriculum interventions: problem-based learning and continuing competence

Context  Problem-based learning (PBL) is an educational strategy designed to enhance self-assessment, self-directed learning and lifelong learning. The present study examines a peer review programme to determine whether the impact of PBL on continuing competence can be detected in practice.
Objectives  This study aimed to establish whether McMaster graduates who graduated between 1972 and 1991 were any less likely to be identified as having issues of competence by a systematic peer review programme than graduates of other Ontario medical schools.
Methods  We identified a total of 1166 doctors who had graduated after 1972 and had completed a mandated peer review programme. Of these, 108 had graduated from McMaster and 857 from other Canadian schools. School of graduation was cross-tabulated against peer rating. A secondary analysis examined predictors of ratings using multiple regression.
Results  We found that 4% of McMaster graduates and 5% of other graduates were deemed to demonstrate cause for concern or serious concern, and that 24% of McMaster doctors and 28% of other doctors were rated as excellent. These differences were not significant. Multiple regression indicated that certification by family medicine or a specialty, female gender and younger age were all predictors of practice outcomes, but school of graduation was not.
Conclusions  There is no evidence from this study that PBL graduates are better able to maintain competence than graduates of conventional schools. The study highlights potential problems in attempting to link undergraduate educational interventions to doctor performance outcomes.     

Healthcare personnel and hand decontamination in intensive care units: knowledge,attitudes, and behaviour in Italy

The purpose of this study was to evaluate knowledge, attitudes, and behaviour regarding hand decontamination in personnel of intensive care units (ICUs) in Italy. All ICU physicians and nurses in 19 and five randomly selected hospitals in Campania and Calabria (Italy) were mailed a questionnaire focusing on demographics and practice characteristics; knowledge about prevention of hospital acquired infection; attitudes and behaviour with respect to hand decontamination; and use of gloves. A total of 413 questionnaires were returned giving a response rate of 66.6%. Overall, 53.2% agreed with the correct responses on knowledge related to infection control, and this knowledge was significantly higher in neonatal and medicine-surgery wards and in larger ICUs. A positive attitude was reported by the large majority who agreed that hand decontamination reduces the risk of infection in patients (96.8%) and personnel (86.2%), and the positive attitude was significantly higher among older and female personnel and in those with a higher level of knowledge. Only 60% always decontaminate hands at the start of a shift, and 72.5% before and after a patient contact. Higher compliance is reported for invasive manoeuvres, such as urinary catheters (96.5%) and intravenous lines (77.1%). Routine hand decontamination between each patient was significantly higher in females, and in neonatal and medicine-surgery ICUs. Our results suggest that interventions should not only be focused on predisposing factors (knowledge), but also on enabling (facilitating) and reinforcing (gratifying) factors.     

Chronic patients in undergraduate education: didactic value as perceived by students

OBJECTIVES: Medical education should prepare students for future clinical practice. However, this preparation is inadequate for the most prevalent problem in health care: chronic disease. This applies to the continuous aspect of chronic disease. Within the context of a newly developed programme, we investigated what makes a chronic patient interesting in the eyes of medical students, what they learned from a specific programme in which each student had contact with a chronic patient 4 times in 8 months, and what they learned from their patients. METHODS: A total of 240 Year 3 students were enrolled in the programme, 89 of whom filled in questionnaires at both the start and end of the programme. Topics included the characteristics of the ideal and the actual patient, the Ideal Physician Questionnaire, and several questions on the expected and actual amount of knowledge gained from the patient. RESULTS: Students preferred patients who demonstrated clear symptoms and had frequent contacts with health care professionals during the programme to 'well adapted' patients. The perceived knowledge obtained from the patient was less than they had expected at the start of the programme. A didactic gain perceived as low was mainly due to low expectations of gaining knowledge at the start of the programme, a doctor-centred attitude and a high level of discrepancy between the student's ideal patient and the actual patient. CONCLUSIONS: Programmes that aim to present chronic patients to medical students focus on patient selection so that patients who differ only very slightly from healthy persons are eliminated. In addition, realistic information on the types of patients with whom students can expect to have contact may help students appreciate the knowledge to be gained from these patients.     

Predictive validity of a written knowledge test of skills for an OSCE in postgraduate training for general practice

PURPOSE: To examine the validity of a written knowledge test of skills for performance on an OSCE in postgraduate training for general practice. METHODS: A randomly-selected sample of 47 trainees in general practice took a knowledge test of skills, a general knowledge test and an OSCE. The OSCE included technical stations and stations including complete patient encounters. Each station was checklist rated and global rated. RESULTS: The knowledge test of skills was better correlated to the OSCE than the general knowledge test. Technical stations were better correlated to the knowledge test of skills than stations including complete patient encounters. For the technical stations the rating system had no influence on the correlation. For the stations including complete patient encounters the checklist rating correlated better to the knowledge test of skills than the global rating. CONCLUSION: The results of this study support the predictive validity of the knowledge test of skills. In postgraduate training for general practice a written knowledge test of skills can be used as an instrument to estimate the level of clinical skills, especially for group evaluation, such as in studies examining the efficacy of a training programme or as a screening instrument for deciding about courses to be offered. This estimation is more accurate when the content of the test matches the skills under study. However, written testing of skills cannot replace direct observation of performance of skills.     

Faculty development for teaching and evaluating professionalism: from programme design to curriculum change

INTRODUCTION: The recent emphasis on the teaching and evaluation of professionalism for medical students and residents has placed significant demands on medicine's educational institutions. The traditional method of transmitting professional values by role modelling is no longer adequate, and professionalism must be taught explicitly and evaluated effectively. However, many faculty members do not possess the requisite knowledge and skills to teach this content area and faculty development is therefore required. PROGRAMME DESCRIPTION: A systematic, integrated faculty development programme was designed to support the teaching and evaluation of professionalism at our institution. The programme consisted of think tanks to promote consensus and "buy-in", and workshops to convey core content, examine teaching strategies and evaluation methods, and promote reflection and self-awareness. PROGRAMME EVALUATION: The programme was evaluated using a CIPP (context, input, process, product) analysis. The institution supported this initiative and local expertise was available. A total of 152 faculty members, with key educational responsibilities, attended 1 or more faculty development activities. Faculty participation resulted in agreement on the cognitive base and attributes of professionalism, consensus on the importance of teaching and evaluating professionalism, and self-reported changes in teaching practices. This initiative also led to the development of new methods of evaluation, site-specific activities and curriculum change. DISCUSSION: A faculty development programme designed to support the teaching and evaluation of professionalism can lead to self-reported changes in teaching and practice as well as new educational initiatives. It can also help to develop more knowledgeable faculty members, who will, it is hoped, become more effective role models.