A meta-analysis of continuing medical education effectiveness

INTRODUCTION: We undertook a meta-analysis of the Continuing Medical Education (CME) outcome literature to examine the effect of moderator variables on physician knowledge, performance, and patient outcomes. METHODS: A literature search of MEDLINE and ERIC was conducted for randomized controlled trials and experimental design studies of CME outcomes in which physicians were a major group. CME moderator variables included the types of intervention, the types and number of participants, time, and the number of intervention sessions held over time. RESULTS: Thirty-one studies met the eligibility criteria, generating 61 interventions. The overall sample-size weighted effect size for all 61 interventions was r = 0.28 (0.18). The analysis of CME moderator variables showed that active and mixed methods had medium effect sizes (r = 0.33 [0.33], r = 0.33 [0.26], respectively), and passive methods had a small effect size (r = 0.20 [0.16], confidence interval 0.15, 0.26). There was a positive correlation between the effect size and the length of the interventions (r = 0.33) and between multiple interventions over time (r = 0.36). There was a negative correlation between the effect size and programs that involved multiple disciplines (r = -0.18) and the number of participants (r = -0.13). The correlation between the effect size and the length of time for outcome assessment was negative (r = -0.31). DISCUSSION: The meta-analysis suggests that the effect size of CME on physician knowledge is a medium one; however, the effect size is small for physician performance and patient outcome. The examination of moderator variables shows there is a larger effect size when the interventions are interactive, use multiple methods, and are designed for a small group of physicians from a single discipline.     

Journal-based continuing medical education

Continuing Medical Education (CME) has become a practical necessity for most physicians, because CME credit is required by many licensing and other medical authorities and because physicians are expected to follow the most recently published practice guidelines. A useful and relatively inexpensive source of CME credit is provided by journals such as JAMA and Archives of Family Medicine. In this article, the costs of CME to the physician's practice are estimated, and the educational objectives, format, and evaluation procedure of the JAMA Reader's Choice CME activity are described.     

A new metric for continuing medical education credit

The two major continuing medical education (CME) credit systems for allopathic physicians in the United States are administered by the American Medical Association (AMA) and the American Academy of Family Physicians (AAFP). This article explores the history of AMA and AAFP CME credit and its value to physicians and the patients they serve. Historically, CME credit has been awarded as hours for participation, but this approach is inadequate as a measure of CME and its impact on improving physician practice. New credit systems are needed to measure a CME activity by its value in bettering the physician's knowledge base, competence, and performance in practice.     

Designing a continuing medical education programme in Malaysia based on practitioners'' needs

A cross-sectional national survey was conducted amongst a random sample of medical practitioners registered in 1988 with the Malaysian Medical Council with the purpose of determining their educational needs with regards to continuing medical education (CME). A 91.0% response rate was obtained. It was found that more than 70% wanted a programme that would provide them with new practical skills and new knowledge or advances in specific fields. About 2/3 also wanted their intellectual skills in problem-solving to be further developed. Reinforcement of communication skills appears to be of secondary importance. They would also like a programme of CME to help them monitor and improve their diagnostic accuracy, investigative habits, prescribing pattern, skills in interpreting diagnostic tests and management of common illnesses. As for content areas it was found that the problems they have least confidence in managing come mainly from the disciplines of psychiatry, obstetrics and gynaecology, and emergency and critical care. More than 90% preferred self-learning methods with some group-type activities. Based on these needs it was recommended that a programme of CME be developed with orientation towards a practice-based setting, self-directed learning, utilizing problem-solving approaches and focusing on the major content areas identified. In addition, activities such as small-group discussions, clinical rounds and journal clubs should be encouraged to develop into local network group activities to supplement the self-learning and present lectures and talks.     

Continuing medical education and continuing medical education accreditation in Spain

Nearly all Spanish physicians are employed by public or private institutions, and employers are enabling the continuing medical education (CME) of physicians. In view of coexisting CME accreditation systems in Spain, we conclude that a common approach is needed. We recommend establishing formal relationships with American and European systems to ensure consistent accreditation and mutual recognition of CME credits and improvement in accreditation.     

Web-based continuing medical education. (II): Evaluation study of computer-mediated continuing medical education

BACKGROUND: Over the years, various distance learning technologies and methods have been applied to the continuing medical education needs of rural and remote physicians. They have included audio teleconferencing, slow scan imaging, correspondence study, and compressed videoconferencing. The recent emergence and growth of Internet, World Wide Web (Web), and compact disk read-only-memory (CD-ROM) technologies have introduced new opportunities for providing continuing education to the rural medical practitioner. This evaluation study assessed the instructional effectiveness of a hybrid computer-mediated courseware delivery system on dermatologic office procedures. METHODS: A hybrid delivery system merges Web documents, multimedia, computer-mediated communications, and CD-ROMs to enable self-paced instruction and collaborative learning. Using a modified pretest to post-test control group study design, several evaluative criteria (participant reaction, learning achievement, self-reported performance change, and instructional transactions) were assessed by various qualitative and quantitative data collection methods. RESULTS: This evaluation revealed that a hybrid computer-mediated courseware system was an effective means for increasing knowledge (p < .05) and improving self-reported competency (p < .05) in dermatologic office procedures, and that participants were very satisfied with the self-paced instruction and use of asynchronous computer conferencing for collaborative information sharing among colleagues.     

Educational audit of postgraduate medical education

Summary. This project examined the academic audit of postgraduate medical education, and went on to research, design and implement an educational audit system for use in Mersey Region, UK. Issues found to be significant included ownership of both standards and results, norming, and the levels of aggregation of data. The project has demonstrated that designing and implementing a system of feedback which is effective and sustainable is feasible, but requires the agreement and support of tutors as to its objectives and use. The resulting system has now been tested across a range of courses and programmes of meetings in Mersey Region, and has been accepted by the Postgraduate Office as the basis for future development.     

Hidden curriculum in continuing medical education

In developing curricula for undergraduate and graduate medical education, educators have become increasingly aware of an interweaving of the formal, informal, and hidden curricula and their influences on the outcomes of teaching and learning. But, to date, there is little in the literature about the hidden curriculum of medical practice, which takes place after graduation and certification. This article initiates that discussion with influences of the hidden curriculum on the actions physicians take or do not take in caring for patients. Hafferty's framework of institutional policies, evaluation activities, resource-allocation decisions, and institutional slang, along with our knowledge of health services research and the continuing medical education (CME) research literature, suggests that there is a hidden and powerful curriculum that affects physician performance. Determining whether the hidden curriculum conflicts with the messages that we are delivering through formal CME (courses, clinical practice guidelines, peer review journals) may contribute to improving our impact on physician performance.     

A review of evaluation outcomes of web-based continuing medical education

INTRODUCTION: The Internet and worldwide web have expanded opportunities for the provision of a flexible, convenient and interactive form of continuing medical education (CME). Larger numbers of doctors are accessing and using the Internet to locate and seek medical information. It has been suggested that a significant proportion of this usage is directly related to questions that arise from patient care. A variety of Internet technologies are being used to provide both asynchronous and synchronous forms of web-based CME. Various models for designing and facilitating web-based CME learning have also been reported. The purpose of this study was to examine the nature and characteristics of the web-based CME evaluative outcomes reported in the peer-reviewed literature. METHODS: A search of Medline was undertaken and the level of evaluative outcomes reported was categorised using Kirkpatrick's model for levels of summative evaluation. RESULTS: The results of this analysis revealed that the majority of evaluative research on web-based CME is based on participant satisfaction data. There was limited research demonstrating performance change in clinical practices and there were no studies reported in the literature that demonstrated that web-based CME was effective in influencing patient or health outcomes. DISCUSSION: The findings suggest an important need to examine in greater detail the nature and characteristics of those web-based learning technologies, environments and systems which are most effective in enhancing practice change and ultimately impacting patient and health outcomes. This is particularly important as the Internet grows in popularity as a medium for knowledge transfer.     

Role of state medical boards in continuing medical education

The evaluation of physician competency prior to issuing an initial medical license has been a fundamental responsibility of medical boards. Growing public expectation holds that medical boards will ensure competency throughout a physician's career. The Federation of State Medical Boards (FSMB) strongly supports the right of state medical boards to require physicians to demonstrate continuing qualification for medical licensure. The FSMB views continuing medical education (CME) as an important component of any maintenance-of-competence initiative. Most medical boards require CME as part of their license renewal process. Learner-focused CME with measurable outcomes enables the medical profession's emphasis on core competencies, training, and assessment, and the general public's expectation for maintenance of physician competence. To effectively move their licensee populations toward the most effective CME tools and structure, medical boards must recognize physicians' educational needs and preferences. Medical boards can be proactive by fostering educational consortia involving medical boards, medical societies, and academic medical centers and featuring educational sessions that represent the best in current CME practices.     

A systematic review of evaluation in formal continuing medical education

INTRODUCTION: Physicians spend a considerable amount of time in Continuing Medical Education (CME) to maintain their medical licenses. CME evaluation studies vary greatly in evaluation methods, levels of evaluation, and length of follow-up. Standards for CME evaluation are needed to enable comparison among different studies and to detect factors influencing CME evaluation. METHODS: A review of the CME evaluation literature was conducted on primary research studies published from January 2000 to January 2006. Studies assessing only satisfaction with CME were excluded, as were studies where fewer than 50% of the participants were practicing physicians. Thirty-two studies were included in the analyses. Determinations were made about evaluation methods, outcome measures, and follow-up assessment. RESULTS: Only 2 of 32 reviewed studies addressed all evaluation levels: physician changes in knowledge and attitudes (level 2), practices (level 3), and improved patient health status (level 4). None of the studies using self-developed instruments (n = 10) provided reliability and validity information. Only 6 studies used validated scales. Twenty studies had a follow-up period of 6 months or less, and 11 had a follow-up period between 1 and 2 years. DISCUSSION: A gold standard for evaluating the effectiveness of CME would include assessment of all 4 levels of evaluation. A valid, reliable, and adaptable CME evaluation questionnaire addressing variables in the second level is needed to allow comparison of effectiveness across CME interventions. A minimum 1-year postintervention follow-up period may also be indicated to investigate the sustainability of intervention outcomes.     

美国继续医学教育的认证制度

对美国继续医学教育的认证组织、继续医学教育认证的主要政策依据、对继续医学教育举办单位和州医学会的认证程序以及认证管理做了简要介绍,为我国继续医学教育的认证工作提供了借鉴.