Turning Off Frequently Overridden Drug Alerts: Limited Opportunities for Doing It Safely

Objectives

This study sought to identify opportunities to safely turn off frequently overridden drug–drug interaction alerts (DDIs) in computerized physician order entry (CPOE).

Design

Quantitative retrospective analysis of drug safety alerts overridden during 1 month and qualitative interviews with 24 respondents (18 physicians and 6 pharmacists) about turning off frequently overridden DDI alerts, based on the Dutch drug database, in a hospital setting. Screen shots and complete texts of frequently overridden DDIs were presented to physicians of internal medicine, cardiology, and surgery and to hospital pharmacists who were asked whether these could be turned off hospital-wide without impairing patient safety, and the reasons for their recommendations.

Results

Data on the frequency of alerts overridden in 1 month identified 3,089 overrides, of which 1,963 were DDIs. The category DDIs showed 86 different alerts, of which 24 frequently overridden alerts, accounting for 72% of all DDI overrides, were selected for further evaluation. The 24 respondents together made 576 assessments. Upon investigation, differences in the reasons for turning off alerts were found across medical specialties and among respondents within a specialty. Frequently mentioned reasons for turning off were “alert well known,” “alert not serious,” or “alert not needing (additional) action,” or that the effects of the combination were monitored or intended. For none of the alerts did all respondents agree that it could be safely turned off hospital-wide. The highest agreement was 13 of 24 respondents (54%). A positive correlation was found between the number of alerts overridden and the number of clinicians recommending to turn them off.

Conclusion

Although the Dutch drug database is already a selected reduction from all DDIs mentioned in literature, the majority of respondents wanted to turn off DDI alerts to reduce alert overload. Turning off DDI alerts hospital-wide appeared to be problematic because of differences among physicians regarding drug-related knowledge and of differences across the hospital in routine drug monitoring practices. Furthermore, several reasons for suppression of alerts could be questioned from a safety perspective. Further research should investigate when each of the following might help: changes in alert texts; new differential alert triggers based on clinician knowledge or specialty; and nonintrusive alert presentation so long as serum levels and patient parameters are measured and stay within limits.     

Characteristics and consequences of drug allergy alert overrides in a computerized physician order entry system

ObjectiveThe aim of this study was to determine characteristics of drug allergy alert overrides, assess how often they lead to preventable adverse drug events (ADEs), and suggest methods for improving the allergy-alerting system.DesignChart review was performed on a stratified random subset of all allergy alerts occurring during a 3-month period (August through October 2002) at a large academic hospital.MeasurementsFactors that were measured were drug/allergy combinations that triggered alerts, frequency of specific override reasons, characteristics of ADEs, and completeness of allergy documentation.ResultsA total of 6,182 (80%) of 7,761 alerts were overridden in 1,150 patients. In this sample, only 10% of alerts were triggered by an exact match between the drug ordered and allergy listed. Physicians' most common reasons for overriding alerts were “Aware/Will monitor” (55%), “Patient does not have this allergy/tolerates” (33%), and “Patient taking already” (10%). In a stratified random subset of 320 patients (28% of 1,150) on chart review, 19 (6%) experienced ADEs attributed to the overridden drug; of these, 9 (47%) were serious. None of the ADEs was considered preventable, because the overrides were deemed clinically justifiable. The degree of completeness of patients' allergy lists was highly variable and generally low in both paper charts and the CPOE system.ConclusionOverrides of drug-allergy alerts were common and about 1 in 20 resulted in ADEs, but all of the overrides resulting in ADEs appeared clinically justifiable. The high rate of alert overrides was attributable to frequent nonexact match alerts and infrequent updating of allergy lists. Based on these findings, we have made specific recommendations for increasing the specificity of alerting and thereby improving the clinical utility of the drug allergy alerting system.     

Provider management strategies of abnormal test result alerts: a cognitive task analysis

Objective

Electronic medical records (EMRs) facilitate abnormal test result communication through “alert” notifications. The aim was to evaluate how primary care providers (PCPs) manage alerts related to critical diagnostic test results on their EMR screens, and compare alert-management strategies of providers with high versus low rates of timely follow-up of results.

Design

28 PCPs from a large, tertiary care Veterans Affairs Medical Center (VAMC) were purposively sampled according to their rates of timely follow-up of alerts, determined in a previous study. Using techniques from cognitive task analysis, participants were interviewed about how and when they manage alerts, focusing on four alert-management features to filter, sort and reduce unnecessary alerts on their EMR screens.

Results

Provider knowledge of alert-management features ranged between 4% and 75%. Almost half (46%) of providers did not use any of these features, and none used more than two. Providers with higher versus lower rates of timely follow-up used the four features similarly, except one (customizing alert notifications). Providers with low rates of timely follow-up tended to manually scan the alert list and process alerts heuristically using their clinical judgment. Additionally, 46% of providers used at least one workaround strategy to manage alerts.

Conclusion

Considerable heterogeneity exists in provider use of alert-management strategies; specific strategies may be associated with lower rates of timely follow-up. Standardization of alert-management strategies including improving provider knowledge of appropriate tools in the EMR to manage alerts could reduce the lack of timely follow-up of abnormal diagnostic test results.     

Improving Acceptance of Computerized Prescribing Alerts in Ambulatory Care

Computerized drug prescribing alerts can improve patient safety, but are often overridden because of poor specificity and alert overload. Our objective was to improve clinician acceptance of drug alerts by designing a selective set of drug alerts for the ambulatory care setting and minimizing workflow disruptions by designating only critical to high-severity alerts to be interruptive to clinician workflow. The alerts were presented to clinicians using computerized prescribing within an electronic medical record in 31 Boston-area practices. There were 18,115 drug alerts generated during our six-month study period. Of these, 12,933 (71%) were noninterruptive and 5,182 (29%) interruptive. Of the 5,182 interruptive alerts, 67% were accepted. Reasons for overrides varied for each drug alert category and provided potentially useful information for future alert improvement. These data suggest that it is possible to design computerized prescribing decision support with high rates of alert recommendation acceptance by clinicians.     

Inviting patients to identify diagnostic concerns through structured evaluation of their online visit notes

BackgroundThe 21st Century Cures Act mandates patients’ access to their electronic health record (EHR) notes. To our knowledge, no previous work has systematically invited patients to proactively report diagnostic concerns while documenting and tracking their diagnostic experiences through EHR-based clinician note review.ObjectiveTo test if patients can identify concerns about their diagnosis through structured evaluation of their online visit notes.MethodsIn a large integrated health system, patients aged 18–85 years actively using the patient portal and seen between October 2019 and February 2020 were invited to respond to an online questionnaire if an EHR algorithm detected any recent unexpected return visit following an initial primary care consultation (“at-risk” visit). We developed and tested an instrument (Safer Dx Patient Instrument) to help patients identify concerns related to several dimensions of the diagnostic process based on notes review and recall of recent “at-risk” visits. Additional questions assessed patients’ trust in their providers and their general feelings about the visit. The primary outcome was a self-reported diagnostic concern. Multivariate logistic regression tested whether the primary outcome was predicted by instrument variables.ResultsOf 293 566 visits, the algorithm identified 1282 eligible patients, of whom 486 responded. After applying exclusion criteria, 418 patients were included in the analysis. Fifty-one patients (12.2%) identified a diagnostic concern. Patients were more likely to report a concern if they disagreed with statements “the care plan the provider developed for me addressed all my medical concerns” [odds ratio (OR), 2.65; 95% confidence interval [CI], 1.45–4.87) and “I trust the provider that I saw during my visit” (OR, 2.10; 95% CI, 1.19–3.71) and agreed with the statement “I did not have a good feeling about my visit” (OR, 1.48; 95% CI, 1.09–2.01).ConclusionPatients can identify diagnostic concerns based on a proactive online structured evaluation of visit notes. This surveillance strategy could potentially improve transparency in the diagnostic process.     

Identifying and prioritizing benefits and risks of using privacy-enhancing software through participatory design: a nominal group technique study with patients living with chronic conditions

ObjectiveWhile patients often contribute data for research, they want researchers to protect their data. As part of a participatory design of privacy-enhancing software, this study explored patients’ perceptions of privacy protection in research using their healthcare data. Materials and MethodsWe conducted 4 focus groups with 27 patients on privacy-enhancing software using the nominal group technique. We provided participants with an open source software prototype to demonstrate privacy-enhancing features and elicit privacy concerns. Participants generated ideas on benefits, risks, and needed additional information. Following a thematic analysis of the results, we deployed an online questionnaire to identify consensus across all 4 groups. Participants were asked to rank-order benefits and risks. Themes around “needed additional information” were rated by perceived importance on a 5-point Likert scale.ResultsParticipants considered “allowance for minimum disclosure” and “comprehensive privacy protection that is not currently available” as the most important benefits when using the privacy-enhancing prototype software. The most concerning perceived risks were “additional checks needed beyond the software to ensure privacy protection” and the “potential of misuse by authorized users.” Participants indicated a desire for additional information with 6 of the 11 themes receiving a median participant rating of “very necessary” and rated “information on the data custodian” as “essential.”ConclusionsPatients recognize not only the benefits of privacy-enhancing software, but also inherent risks. Patients desire information about how their data are used and protected. Effective patient engagement, communication, and transparency in research may improve patients’ comfort levels, alleviate patients’ concerns, and thus promote ethical research.     

The mental health status of children who have been evacuated or migrated from rural areas in Fukushima prefecture after the Fukushima daiichi nuclear power station accident: results from the Fukushima health management survey

Introduction: We evaluated the mental health status of children residing in Kawauchi village (Kawauchi), Fukushima Prefecture, after the 2011 accident at the Fukushima Daiichi Nuclear Power Station, based on the children’s experience of the nuclear disaster. Methods: We conducted this cross-sectional study within the framework of the Fukushima Health Management Survey (FHMS); FHMS data on age, sex, exercise habits, sleeping times, experience of the nuclear disaster, and the “Strengths and Difficulties Questionnaire (SDQ)” scores for 156 children from Kawauchi in 2012 were collected. Groups with and without experience of the nuclear disaster — “nuclear disaster (+)” and “nuclear disaster (−)” — were also compared. Results: Our effective response was 93 (59.6%); the mean SDQ score was 11.4±6.8 among elementary school-aged participants and 12.4±6.8 among junior high school-aged ones. We statistically compared the Total Difficulties Scores (TDS) and sub-item scores of the SDQ between “elementary school” and “junior high school” or “nuclear disaster” (+) and (−). There was no significant difference between these items. Conclusions: We found indications of poor mental health among elementary and junior high school-aged children in the disaster area immediately following the accident, but no differences based on their experience of the nuclear disaster. These results indicate the possibility of triggering stress, separate to that from experiences related to the nuclear disaster, in children who lived in affected rural areas and were evacuated just after the nuclear disaster.     

Making electronic prescribing alerts more effective: scenario-based experimental study in junior doctors

Objective

Expert authorities recommend clinical decision support systems to reduce prescribing error rates, yet large numbers of insignificant on-screen alerts presented in modal dialog boxes persistently interrupt clinicians, limiting the effectiveness of these systems. This study compared the impact of modal and non-modal electronic (e-) prescribing alerts on prescribing error rates, to help inform the design of clinical decision support systems.

Design

A randomized study of 24 junior doctors each performing 30 simulated prescribing tasks in random order with a prototype e-prescribing system. Using a within-participant design, doctors were randomized to be shown one of three types of e-prescribing alert (modal, non-modal, no alert) during each prescribing task.

Measurements

The main outcome measure was prescribing error rate. Structured interviews were performed to elicit participants'' preferences for the prescribing alerts and their views on clinical decision support systems.

Results

Participants exposed to modal alerts were 11.6 times less likely to make a prescribing error than those not shown an alert (OR 11.56, 95% CI 6.00 to 22.26). Those shown a non-modal alert were 3.2 times less likely to make a prescribing error (OR 3.18, 95% CI 1.91 to 5.30) than those not shown an alert. The error rate with non-modal alerts was 3.6 times higher than with modal alerts (95% CI 1.88 to 7.04).

Conclusions

Both kinds of e-prescribing alerts significantly reduced prescribing error rates, but modal alerts were over three times more effective than non-modal alerts. This study provides new evidence about the relative effects of modal and non-modal alerts on prescribing outcomes.     

Speaking up about patient-perceived serious visit note errors: Patient and family experiences and recommendations

BackgroundOpen notes invite patients and families to read ambulatory visit notes through the patient portal. Little is known about the extent to which they identify and speak up about perceived errors. Understanding the barriers to speaking up can inform quality improvements.ObjectiveTo describe patient and family attitudes, experiences, and barriers related to speaking up about perceived serious note errors.MethodsMixed method analysis of a 2016 electronic survey of patients and families at 2 northeast US academic medical centers. Participants had active patient portal accounts and at least 1 note available in the preceding 12 months.Results6913 adult patients (response rate 28%) and 3672 pediatric families (response rate 17%) completed the survey. In total, 8724/9392 (93%) agreed that reporting mistakes improves patient safety. Among 8648 participants who read a note, 1434 (17%) perceived ≥1 mistake. 627/1434 (44%) reported the mistake was serious and 342/627 (56%) contacted their provider. Participants who self-identified as Black or African American, Asian, “other,” or “multiple” race(s) (OR 0.50; 95% CI (0.26,0.97)) or those who reported poorer health (OR 0.58; 95% CI (0.37,0.90)) were each less likely to speak up than white or healthier respondents, respectively. The most common barriers to speaking up were not knowing how to report a mistake (61%) and avoiding perception as a “troublemaker” (34%). Qualitative analysis of 476 free-text suggestions revealed practical recommendations and proposed innovations for partnering with patients and families.ConclusionsAbout half of patients and families who perceived a serious mistake in their notes reported it. Identified barriers demonstrate modifiable issues such as establishing clear mechanisms for reporting and more challenging issues such as creating a supportive culture. Respondents offered new ideas for engaging patients and families in improving note accuracy.     

Knowledge and attitudes of physicians toward forensic psychiatry in Saudi Arabia

Objectives:To assess the knowledge and attitudes of physicians of different specialties, including psychiatrists, regarding forensic psychiatry to determine whether further modification or training is needed in the psychiatry residency program.Methods:This cross-sectional study was carried out using a 3-page, 3-section questionnaire containing 21 questions disseminated randomly online via Google forms using social media platforms. The 482 participants were residents, specialists, and consultants of various specialties. The study was conducted between September 2020 and August 2021 in various tertiary hospitals across Saudi Arabia.Results:A total of 482 physicians were recruited. The most common age group was 25-35 years, comprising mostly Saudis (62.4%). Based on the results, “poor” and “good” knowledge of forensic psychiatry was identified in 89% and 11% of the physicians, while “negative” and “positive” attitudes were identified in 16.4% and 83.6% of the physicians.Conclusion:Although the perspective of physicians regarding forensic psychiatry was found to be positive, their knowledge of the topic seems to be lacking.     

TOLERANCE TIME OF EXPERIMENTAL THERMAL PAIN (COLD INDUCED) IN VOLUNTEERS

Perception of thermal pain (cold induced) was studied in 106 volunteers from troops and civilians deployed in J & K. Thermal stimulus devised was “holding ice”. Tolerance time of holding ice was taken to be a measure of thermal sensitivity, volunteers were classified based on their native areas, addiction habits and socio-economic status, out of 106 volunteers, 81 could & 25 could not hold ice over 10 min. Sixteen out of 40 from coastline States and 9 out of 66 from non-coast line States failed to hold ice over 10 min. In “below average” “average” and “high average” socio-economic groups, three out of 27, 19 out of 73 and 03 out of 6 failed to hold ice over 10 min respectively. Fifteen out of 64 from “addiction habit group” and 10 out of 42 from “no addiction habit group” failed to hold ice over 10 min. Statistically no classification used in the study revealed significant difference in “tolerance times” of volunteers except the one based on coastline and non-coastline States.KEY WORDS: Pain, Nociception, Thermal sensations     

Skin diseases in the Da Qing Diabetes Study: a cross-sectional study

Background:The prevalence of skin diseases and diabetes mellitus (DM) are prominent around the world. The current scope of knowledge regarding the prevalence of skin diseases and comorbidities with type 2 DM (T2DM) is limited, leading to limited recognition of the correlations between skin diseases and T2DM.Methods:We collected 383 subjects from the Da Qing Diabetes Study during the period from July 9th to September 1st, 2016. The subjects were categorized into three groups: Normal glucose tolerance (NGT), impaired glucose tolerance (IGT), and T2DM. The prevalence and clinical characteristics of skin diseases were recorded and investigated.Results:In this cross-sectional study, 383 individuals with ages ranging from 53 to 89-year-old were recruited. The overall prevalence of skin diseases was 93.5%, and 75.7% of individuals had two or more kinds of skin diseases. Additionally, there were 47 kinds of comorbid skin diseases in patients with T2DM, of which eight kinds of skin diseases had a prevalence >10%. The prevalence of skin diseases in NGT, IGT, and T2DM groups were 93.3%, 91.5%, and 96.6%, respectively; stratified analysis by categories showed a statistically significant difference in “disturbances of pigmentation” and “neurological and psychogenic dermatoses”. The duration of T2DM also significantly associated with the prevalence of “disturbances of pigmentation” and “neurological and psychogenic dermatoses”. Subsequently, the prevalence of “disturbances of pigmentation” was higher in males than females in NGT (P < 0.01) and T2DM (P < 0.01) groups. In addition, the difference in the prevalence of “disturbances of pigmentation” was also significant in NGT and T2DM groups (P < 0.01).Conclusions:There was a high prevalence of skin diseases in the Da Qing Diabetes Study. To address the skin diseases in the Da Qing Diabetes Study, increased awareness and intervention measures should be implemented.     

Impact of event notification services on timely follow-up and rehospitalization among primary care patients at two Veterans Affairs Medical Centers

ObjectiveTo examine the effectiveness of event notification service (ENS) alerts on health care delivery processes and outcomes for older adults.Materials and methodsWe deployed ENS alerts in 2 Veterans Affairs (VA) medical centers using regional health information exchange (HIE) networks from March 2016 to December 2019. Alerts targeted VA-based primary care teams when older patients (aged 65+ years) were hospitalized or attended emergency departments (ED) outside the VA system. We employed a concurrent cohort study to compare postdischarge outcomes between patients whose providers received ENS alerts and those that did not (usual care). Outcome measures included: timely follow-up postdischarge (actual phone call within 7 days or an in-person primary care visit within 30 days) and all-cause inpatient or ED readmission within 30 days. Generalized linear mixed models, accounting for clustering by primary care team, were used to compare outcomes between groups.ResultsCompared to usual care, veterans whose primary care team received notification of non-VA acute care encounters were 4 times more likely to have phone contact within 7 days (AOR = 4.10, P < .001) and 2 times more likely to have an in-person visit within 30 days (AOR = 1.98, P = .007). There were no significant differences between groups in hospital or ED utilization within 30 days of index discharge (P = .057).DiscussionENS was associated with increased timely follow-up following non-VA acute care events, but there was no associated change in 30-day readmission rates. Optimization of ENS processes may be required to scale use and impact across health systems.ConclusionGiven the importance of ENS to the VA and other health systems, this study provides guidance for future research on ENS for improving care coordination and population outcomes.Trial RegistrationClinicalTrials.gov {"type":"clinical-trial","attrs":{"text":"NCT02689076","term_id":"NCT02689076"}}NCT02689076. “Regional Data Exchange to Improve Care for Veterans After Non-VA Hospitalization.” Registered February 23, 2016.     

Medication-related Clinical Decision Support in Computerized Provider Order Entry Systems: A Review

While medications can improve patients’ health, the process of prescribing them is complex and error prone, and medication errors cause many preventable injuries. Computer provider order entry (CPOE) with clinical decision support (CDS), can improve patient safety and lower medication-related costs.To realize the medication-related benefits of CDS within CPOE, one must overcome significant challenges. Healthcare organizations implementing CPOE must understand what classes of CDS their CPOE systems can support, assure that clinical knowledge underlying their CDS systems is reasonable, and appropriately represent electronic patient data. These issues often influence to what extent an institution will succeed with its CPOE implementation and achieve its desired goals.Medication-related decision support is probably best introduced into healthcare organizations in two stages, basic and advanced. Basic decision support includes drug-allergy checking, basic dosing guidance, formulary decision support, duplicate therapy checking, and drug–drug interaction checking. Advanced decision support includes dosing support for renal insufficiency and geriatric patients, guidance for medication-related laboratory testing, drug-pregnancy checking, and drug–disease contraindication checking. In this paper, the authors outline some of the challenges associated with both basic and advanced decision support and discuss how those challenges might be addressed. The authors conclude with summary recommendations for delivering effective medication-related clinical decision support addressed to healthcare organizations, application and knowledge base vendors, policy makers, and researchers.     

3. Protein diets for obesity: metabolic and clinical aspects

The alleged benefits of protein diets remain unproven, since research data on the safety and long-term utility of protein products as the principal or only source of nutrients for weight reduction programs are as yet insufficient. First, it is uncertain whether the decreases in body protein turnover occurring with these diets are consistent with normal function over long periods, though net balance of protein is obtained. Second, the main advantage to the patient is the suppression of appetite by the ketoacidosis, but it is the ketoacidosis that causes many of the untoward effects. Third, the addition of carbohydrate to a protein diet does not mitigate the benefit of the protein and prevents most of the untoward effects. Fourth, there is clearly no advantage of “predigested” proteins (which are generally poorer in quality than normal high-protein foods) except for the psychologic factor of being given “medication” for the “disease” of obesity. Fifth, there is a distinct danger of deficiencies of micronutrients developing with prolonged consumption of unsupplemented diets. Sixth, the cardiac disorders associated with death in persons taking these diets have not been shown to be coincidental rather than a direct consequence of the diets.

In the present state of understanding of protein diets, they should be supervised only by specially trained physicians in rigorous multidisciplinary programs, preferably those with ongoing research. Only individuals free from contraindications should be so treated. Until compelling data proving the safety and efficacy of these diets are forthcoming, the general public should be counselled against their use.