Medication-related Clinical Decision Support in Computerized Provider Order Entry Systems: A Review

While medications can improve patients’ health, the process of prescribing them is complex and error prone, and medication errors cause many preventable injuries. Computer provider order entry (CPOE) with clinical decision support (CDS), can improve patient safety and lower medication-related costs.To realize the medication-related benefits of CDS within CPOE, one must overcome significant challenges. Healthcare organizations implementing CPOE must understand what classes of CDS their CPOE systems can support, assure that clinical knowledge underlying their CDS systems is reasonable, and appropriately represent electronic patient data. These issues often influence to what extent an institution will succeed with its CPOE implementation and achieve its desired goals.Medication-related decision support is probably best introduced into healthcare organizations in two stages, basic and advanced. Basic decision support includes drug-allergy checking, basic dosing guidance, formulary decision support, duplicate therapy checking, and drug–drug interaction checking. Advanced decision support includes dosing support for renal insufficiency and geriatric patients, guidance for medication-related laboratory testing, drug-pregnancy checking, and drug–disease contraindication checking. In this paper, the authors outline some of the challenges associated with both basic and advanced decision support and discuss how those challenges might be addressed. The authors conclude with summary recommendations for delivering effective medication-related clinical decision support addressed to healthcare organizations, application and knowledge base vendors, policy makers, and researchers.     

Viewpoint: Controversies Surrounding Use of Order Sets for Clinical Decision Support in Computerized Provider Order Entry

Order sets provide straightforward clinical decision support within computerized provider order entry systems. They make “the right thing” easier to do because they are much faster than writing single orders; they deliver real-time, evidence-based prompts; they are easy to update; and they support coverage of multiple patient problems through linkages among order sets. This viewpoint paper discusses controversies surrounding use of order sets—advantages and pitfalls, decision-making criteria, and organizational considerations, including suggestions for vendors. Order sets have the potential to improve clinician efficiency, provide real-time guidance, facilitate compliance with Joint Commission on Accreditation of Healthcare Organizations and Centers for Medicare & Medicaid Services performance measure sets, and encourage overall acceptance of computerized provider order entry, but may not do so unless these controversies are addressed.     

Using Computerized Provider Order Entry and Clinical Decision Support to Improve Referring Physicians' Implementation of Consultants' Medical Recommendations

Objectives

Only half of consultants' medical recommendations are implemented. We created a tool that lets referring providers review and implement electronic recommendations made by consultants, with the hypothesis that facilitation with our tool could improve implementation.

Measurements

The tool was piloted among geriatrics consultants and hospitalists. Pre-post evaluation was done with control (before pilot; N = 20) and intervention (after pilot; N = 20) patients. Consultants wrote notes containing recommendations for all study patients, and entered electronic recommendations only for intervention patients. We analyzed all recommendations and surveyed hospitalists.

Results

A total of 249 recommendations were made for intervention patients versus 192 for controls (p < 0.05). Of all recommendations about intervention patients, 78% were implemented, compared to 59% for controls (p = 0.01). Of the intervention recommendations, 77% were entered electronically using our tool; of these, 86% were implemented. All 24 survey respondents indicated that the system improved quality, saved time, and should be expanded.

Conclusion

Consultant recommendations were implemented 30% more often when there was electronic facilitation of recommendations.     

Evaluation and Certification of Computerized Provider Order Entry Systems

Computerized physician order entry (CPOE) is an application that is used to electronically write physician orders either in the hospital or in the outpatient setting. It is used in about 15% of U.S. Hospitals and a smaller percentage of ambulatory clinics. It is linked with clinical decision support, which provides much of the value of implementing it. A number of studies have assessed the impact of CPOE with respect to a variety of parameters, including costs of care, medication safety, use of guidelines or protocols, and other measures of the effectiveness or quality of care. Most of these studies have been undertaken at CPOE exemplar sites with homegrown clinical information systems. With the increasing implementation of commercial CPOE systems in various settings of care has come evidence that some implementation approaches may not achieve previously published results or may actually cause new errors or even harm. This has lead to new initiatives to evaluate CPOE systems, which have been undertaken by both vendors and other groups who evaluate vendors, focused on CPOE vendor capabilities and effective approaches to implementation that can achieve benefits seen in published studies. In addition, an electronic health record (EHR) vendor certification process is ongoing under the province of the Certification Commission for Health Information Technology (CCHIT) (which includes CPOE) that will affect the purchase and use of these applications by hospitals and clinics and their participation in public and private health insurance programs. Large employers have also joined this focus by developing flight simulation tools to evaluate the capabilities of these CPOE systems once implemented, potentially linking the results of such programs to reimbursement through pay for performance programs. The increasing role of CPOE systems in health care has invited much more scrutiny about the effectiveness of these systems in actual practice which has the potential to improve their ultimate performance.     

The Impact of Computerized Provider Order Entry Systems on Inpatient Clinical Workflow: A Literature Review

Previous studies have shown the importance of workflow issues in the implementation of CPOE systems and patient safety practices. To understand the impact of CPOE on clinical workflow, we developed a conceptual framework and conducted a literature search for CPOE evaluations between 1990 and June 2007. Fifty-one publications were identified that disclosed mixed effects of CPOE systems. Among the frequently reported workflow advantages were the legible orders, remote accessibility of the systems, and the shorter order turnaround times. Among the frequently reported disadvantages were the time-consuming and problematic user-system interactions, and the enforcement of a predefined relationship between clinical tasks and between providers. Regarding the diversity of findings in the literature, we conclude that more multi-method research is needed to explore CPOE's multidimensional and collective impact on especially collaborative workflow.     

推进医生电子医嘱 优化临床工作流程

电子医嘱应用对提升医疗质量、防止医疗差错有重要作用。电子医嘱系统的开发与实施使医院临床医疗的操作以及医护沟通出现了新的问题,因此,正确的实施策略和流程分析重组是推进临床电子医嘱的基础。在我院临床病区电子医嘱应用推进的基础上,总结了医院临床流程重组优化的原则和方法,分析了医院临床流程优化对提升医疗质量管理的推进作用,指出临床流程优化对临床电子医嘱应用效果有关键性影响。     

Types of Unintended Consequences Related to Computerized Provider Order Entry

ObjectiveTo identify types of clinical unintended adverse consequences resulting from computerized provider order entry (CPOE) implementation.DesignAn expert panel provided initial examples of adverse unintended consequences of CPOE. The authors, using qualitative methods, gathered and analyzed additional examples from five successful CPOE sites.MethodsUsing a card sort method, the authors developed a categorization scheme for the 79 unintended consequences initially identified and then iteratively modified the scheme to categorize 245 additional adverse consequences resulting from fieldwork. Because the focus centered on consequences requiring prevention or remedial action, the authors did not further analyze reported unintended beneficial (positive) consequences.ResultsUnintended adverse consequences (UACs) fell into nine major categories (in order of decreasing frequency): 1) more/new work for clinicians; 2) unfavorable workflow issues; 3) never ending system demands; 4) problems related to paper persistence; 5) untoward changes in communication patterns and practices; 6) negative emotions; 7) generation of new kinds of errors; 8) unexpected changes in the power structure; and 9) overdependence on the technology. Clinical decision support features introduced many of these unintended consequences.ConclusionIdentifying and understanding the types and in some instances the causes of unintended adverse consequences associated with CPOE will enable system developers and implementers to better manage implementation and maintenance of future CPOE projects.     

The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry

Background

Computerized provider order entry (CPOE) systems can help hospitals improve health care quality, but they can also introduce new problems. The extent to which hospitals experience unintended consequences of CPOE, which include more than errors, has not been quantified in prior research.

Objective

To discover the extent and importance of unintended adverse consequences related to CPOE implementation in U.S. hospitals.

Design, Setting, and Participants

Building on a prior qualitative study involving fieldwork at five hospitals, we developed and then administered a telephone survey concerning the extent and importance of CPOE-related unintended adverse consequences to representatives from 176 hospitals in the U.S. that have CPOE.

Measurements

Self report by key informants of the extent and level of importance to the overall function of the hospital of eight types of unintended adverse consequences experienced by sites with inpatient CPOE.

Results

We found that hospitals experienced all eight types of unintended adverse consequences, although respondents identified several they considered more important than others. Those related to new work/more work, workflow, system demands, communication, emotions, and dependence on the technology were ranked as most severe, with at least 72% of respondents ranking them as moderately to very important. Hospital representatives are less sure about shifts in the power structure and CPOE as a new source of errors. There is no relation between kinds of unintended consequences and number of years CPOE has been used. Despite the relatively short length of time most hospitals have had CPOE (median five years), it is highly infused, or embedded, within work practice at most of these sites.

Conclusions

The unintended consequences of CPOE are widespread and important to those knowledgeable about CPOE in hospitals. They can be positive, negative, or both, depending on one’s perspective, and they continue to exist over the duration of use. Aggressive detection and management of adverse unintended consequences is vital for CPOE success.     

Does Computerized Provider Order Entry Reduce Prescribing Errors for Hospital Inpatients? A Systematic Review

Previous reviews have examined evidence of the impact of CPOE on medication errors, but have used highly variable definitions of “error”. We attempted to answer a very focused question, namely, what evidence exists that CPOE systems reduce prescribing errors among hospital inpatients? We identified 13 papers (reporting 12 studies) published between 1998 and 2007. Nine demonstrated a significant reduction in prescribing error rates for all or some drug types. Few studies examined changes in error severity, but minor errors were most often reported as decreasing. Several studies reported increases in the rate of duplicate orders and failures to discontinue drugs, often attributed to inappropriate selection from a dropdown menu or to an inability to view all active medication orders concurrently. The evidence-base reporting the effectiveness of CPOE to reduce prescribing errors is not compelling and is limited by modest study sample sizes and designs. Future studies should include larger samples including multiple sites, controlled study designs, and standardized error and severity reporting. The role of decision support in minimizing severe prescribing error rates also requires investigation.     

A Cognitive Task Analysis of Information Management Strategies in a Computerized Provider Order Entry Environment

Objective

Computerized Provider Order Entry (CPOE) with electronic documentation, and computerized decision support dramatically changes the information environment of the practicing clinician. Prior work patterns based on paper, verbal exchange, and manual methods are replaced with automated, computerized, and potentially less flexible systems. The objective of this study is to explore the information management strategies that clinicians use in the process of adapting to a CPOE system using cognitive task analysis techniques.

Design

Observation and semi-structured interviews were conducted with 88 primary-care clinicians at 10 Veterans Administration Medical Centers.

Measurements

Interviews were taped, transcribed, and extensively analyzed to identify key information management goals, strategies, and tasks. Tasks were aggregated into groups, common components across tasks were clarified, and underlying goals and strategies identified.

Results

Nearly half of the identified tasks were not fully supported by the available technology. Six core components of tasks were identified. Four meta-cognitive information management goals emerged: 1) Relevance Screening; 2) Ensuring Accuracy; 3) Minimizing memory load; and 4) Negotiating Responsibility. Strategies used to support these goals are presented.

Conclusion

Users develop a wide array of information management strategies that allow them to successfully adapt to new technology. Supporting the ability of users to develop adaptive strategies to support meta-cognitive goals is a key component of a successful system.     

The Utility of Adding Retrospective Medication Profiling to Computerized Provider Order Entry in an Ambulatory Care Population

Background

We assessed whether medication safety improved when a medication profiling program was added to a computerized provider order entry system.

Design

Between June 2001 and January 2002 we profiled outpatients with potential prescribing errors using computerized retrospective drug utilization software. We focused primarily on drug interactions. Patients were randomly assigned either to Provider Feedback or to Usual Care. Subsequent adverse drug event (ADE) incidence and other outcomes, including ADE preventability and severity, occurring up to 1 year following the last profiling date were evaluated retrospectively by a pharmacist blinded to patient assignment.

Measurements

Data were abstracted using a study-designed instrument. An ADE was defined by an Adverse Drug Reaction Probability scale score of 1 or more. Statistical analyses included negative binomial regression for comparing ADE incidence.

Results

Of 913 patients in the analytic sample, 371 patients (41%) had one or more ADEs. Incidence, by individual, was not significantly different between Usual Care and Provider Feedback groups (37% vs. 45%; p = 0.06; Coefficient, 0.19; 95% CI: −0.008, 0.390). ADE severity was also similar. For example, 51% of ADEs in the Usual Care and 58% in the Provider Feedback groups involved symptoms that were not serious (95% CI for the difference, −15%, 2%). Finally, ADE preventability did not differ. For example, 16% in the Usual Care group and 17% in the Provider Feedback group had an associated warning (95% CI for the difference, −7 to 5%; p = 0.79).

Conclusion

Medications safety did not improve with the addition of a medication profiling program to an electronic prescribing system.     

计算机医嘱输入系统对用药错误的助长作用

背景：医院的计算机医嘱输入（computerized physician order entry，CPOE）系统被广泛认为能从技术上解决用药错误，后者是最常见的可以预防的医院诊疗错误的来源。已发表的研究表明，CPOE可减少高达81％的用药错误。然而，很少研究关注CPOE助长用药错误作用的范围或类型。     

Evaluation of Outpatient Computerized Physician Medication Order Entry Systems: A Systematic Review

This paper provides a systematic literature review of CPOE evaluation studies in the outpatient setting on: safety; cost and efficiency; adherence to guideline; alerts; time; and satisfaction, usage, and usability. Thirty articles with original data (randomized clinical trial, non-randomized clinical trial, or observational study designs) met the inclusion criteria. Only four studies assessed the effect of CPOE on safety. The effect was not significant on the number of adverse drug events. Only one study showed a significant reduction of the number of medication errors. Three studies showed significant reductions in medication costs; five other studies could not support this. Most studies on adherence to guidelines showed a significant positive effect. The relatively small number of evaluation studies published to date do not provide adequate evidence that CPOE systems enhance safety and reduce cost in the outpatient settings. There is however evidence for (a) increasing adherence to guidelines, (b) increasing total prescribing time, and (c) high frequency of ignored alerts.     

Evaluating Clinical Decision Support Systems: Monitoring CPOE Order Check Override Rates in the Department of Veterans Affairs' Computerized Patient Record System

Objective

To measure critical order check override rates in VA Puget Sound Health Care System''s computerized practitioner order entry (CPOE) system and to compare 2006 results to a similar 2001 study.

Design

Analysis of ordering and order check data gathered by a post-hoc logging program. Use of Pearson''s chi-square contingency table test comparing results from this study and the earlier study.

Measurements

Factors measured were total number of orders, frequency of order check types, frequency of order check overrides by order check type and comparisons of these results with previous results.

Results

A total of 37,040 orders generated 908 (2.5%) critical order checks. Drug-drug critical alert override rate was 74/85 (87%) in 2006 compared to 95/108 (88%) in 2001 (X ²=0.04, df=1, p=0.85). The drug-allergy override rate was 341/420 (81%) compared to 72/105 (69%) in 2001 (X ²=7.97, df=1, p=0.005). In 2001, 0.25% (105/42,621) orders generated a drug-allergy order check compared to 1.13% (420/37,040) in 2006 (X ²=238.45, df=1, p<0.0001).

Conclusion

Override rates of critical drug-drug and drug-allergy order checks remain high at VA Puget Sound Health Care System including significant increases in drug-allergy order checks. We recommend that monitoring override rates be regular practice in clinical computing systems and conclude that qualitative research should be carried out to better understand how physicians interact with decision support at the point of ordering.     

Adoption of Order Entry with Decision Support for Chronic Care by Physician Organizations

Objective

This study sought to explore physician organizations’ adoption of chronic care guidelines in order entry systems and to investigate the organizational and market-related factors associated with this adoption.

Design

A quantitative nationwide survey of all primary care medical groups in the United States with 20 or more physicians; data were collected on 1,104 physician organizations, representing a 70% response rate.

Measurements

Measurements were the presence of an asthma, diabetes, or congestive heart failure guideline in a physician organization’s order entry system; size; age of the organization; number of clinic locations; type of ownership; health maintenance organization market penetration; urban/rural location; and presence of external incentives to improve quality of care.

Results

Only 27% of organizations reported access to order entry with decision support for chronic disease care. External incentives for quality is the only factor significantly associated with adoption of these tools. Organizations experiencing greater external incentives for quality are more likely to adopt order entry with decision support.

Conclusion

Because external incentives are strong drivers of adoption, policies requiring reporting of chronic care measurements and rewarding improvement as well as financial incentives for use of specific information technology tools are likely to accelerate adoption of order entry with decision support.     

本体在糖尿病临床决策支持系统中的应用

基于电子健康系统的临床决策支持系统（clinical decision support system, CDSS）可以辅助基层医生进行临床决策,提高诊疗效率。其中利用本体构建CDSS的医学知识库和患者数据使CDSS的推理过程和决策结果具有可解释性。本文就糖尿病治疗领域的相关本体及基于本体的CDSS的进展与挑战进行综述。首先,阐明我国糖尿病诊疗的现状与挑战为亟需提高医疗服务效率与质量;在介绍本体的相关知识后,概述使用本体构建CDSS的框架、方法及特点;然后综述国内外糖尿病治疗领域的本体及基于本体的CDSS的案例,总结其构建方法及特点;最后提出该领域的展望:将循证医学与本体相融合,构建可信的临床推荐体系是目前CDSS的发展重点。     

A Knowledge-Modeling Approach to Integrate Multiple Clinical Practice Guidelines to Provide Evidence-Based Clinical Decision Support for Managing Comorbid Conditions

Clinical management of comorbidities is a challenge, especially in a clinical decision support setting, as it requires the safe and efficient reconciliation of multiple disease-specific clinical procedures to formulate a comorbid therapeutic plan that is both effective and safe for the patient. In this paper we pursue the integration of multiple disease-specific Clinical Practice Guidelines (CPG) in order to manage co-morbidities within a computerized Clinical Decision Support System (CDSS). We present a CPG integration framework—termed as COMET (Comorbidity Ontological Modeling & ExecuTion) that manifests a knowledge management approach to model, computerize and integrate multiple CPG to yield a comorbid CPG knowledge model that upon execution can provide evidence-based recommendations for handling comorbid patients. COMET exploits semantic web technologies to achieve (a) CPG knowledge synthesis to translate a paper-based CPG to disease-specific clinical pathways (CP) that include specialized co-morbidity management procedures based on input from domain experts; (b) CPG knowledge modeling to computerize the disease-specific CP using a Comorbidity CPG ontology; (c) CPG knowledge integration by aligning multiple ontologically-modeled CP to develop a unified comorbid CPG knowledge model; and (e) CPG knowledge execution using reasoning engines to derive CPG-mediated recommendations for managing patients with comorbidities. We present a web-accessible COMET CDSS that provides family physicians with CPG-mediated comorbidity decision support to manage Atrial Fibrillation and Chronic Heart Failure. We present our qualitative and quantitative analysis of the knowledge content and usability of COMET CDSS.