Impact of a problem-oriented view on clinical data retrieval

ObjectiveThe electronic health record (EHR) data deluge makes data retrieval more difficult, escalating cognitive load and exacerbating clinician burnout. New auto-summarization techniques are needed. The study goal was to determine if problem-oriented view (POV) auto-summaries improve data retrieval workflows. We hypothesized that POV users would perform tasks faster, make fewer errors, be more satisfied with EHR use, and experience less cognitive load as compared with users of the standard view (SV).MethodsSimple data retrieval tasks were performed in an EHR simulation environment. A randomized block design was used. In the control group (SV), subjects retrieved lab results and medications by navigating to corresponding sections of the electronic record. In the intervention group (POV), subjects clicked on the name of the problem and immediately saw lab results and medications relevant to that problem.ResultsWith POV, mean completion time was faster (173 seconds for POV vs 205 seconds for SV; P < .0001), the error rate was lower (3.4% for POV vs 7.7% for SV; P = .0010), user satisfaction was greater (System Usability Scale score 58.5 for POV vs 41.3 for SV; P < .0001), and cognitive task load was less (NASA Task Load Index score 0.72 for POV vs 0.99 for SV; P < .0001).DiscussionThe study demonstrates that using a problem-based auto-summary has a positive impact on 4 aspects of EHR data retrieval, including cognitive load.ConclusionEHRs have brought on a data deluge, with increased cognitive load and physician burnout. To mitigate these increases, further development and implementation of auto-summarization functionality and the requisite knowledge base are needed.     

Using event logs to observe interactions with electronic health records: an updated scoping review shows increasing use of vendor-derived measures

ObjectiveThe aim of this article is to compare the aims, measures, methods, limitations, and scope of studies that employ vendor-derived and investigator-derived measures of electronic health record (EHR) use, and to assess measure consistency across studies.Materials and MethodsWe searched PubMed for articles published between July 2019 and December 2021 that employed measures of EHR use derived from EHR event logs. We coded the aims, measures, methods, limitations, and scope of each article and compared articles employing vendor-derived and investigator-derived measures.ResultsOne hundred and two articles met inclusion criteria; 40 employed vendor-derived measures, 61 employed investigator-derived measures, and 1 employed both. Studies employing vendor-derived measures were more likely than those employing investigator-derived measures to observe EHR use only in ambulatory settings (83% vs 48%, P = .002) and only by physicians or advanced practice providers (100% vs 54% of studies, P < .001). Studies employing vendor-derived measures were also more likely to measure durations of EHR use (P < .001 for 6 different activities), but definitions of measures such as time outside scheduled hours varied widely. Eight articles reported measure validation. The reported limitations of vendor-derived measures included measure transparency and availability for certain clinical settings and roles.DiscussionVendor-derived measures are increasingly used to study EHR use, but only by certain clinical roles. Although poorly validated and variously defined, both vendor- and investigator-derived measures of EHR time are widely reported.ConclusionThe number of studies using event logs to observe EHR use continues to grow, but with inconsistent measure definitions and significant differences between studies that employ vendor-derived and investigator-derived measures.     

Optimizing the electronic health record: An inpatient sprint addresses provider burnout and improves electronic health record satisfaction

ObjectiveWe sought reduce electronic health record (EHR) burden on inpatient clinicians with a 2-week EHR optimization sprint.Materials and MethodsA team led by physician informaticists worked with 19 advanced practice providers (APPs) in 1 specialty unit. Over 2 weeks, the team delivered 21 EHR changes, and provided 39 one-on-one training sessions to APPs, with an average of 2.8 hours per provider. We measured Net Promoter Score, thriving metrics, and time spent in the EHR based on user log data.ResultsOf the 19 APPs, 18 completed 2 or more sessions. The EHR Net Promoter Score increased from 6 to 60 postsprint (1.0; 95% confidence interval, 0.3-1.8; P = .01). The NPS for the Sprint itself was 93, a very high rating. The 3-axis emotional thriving, emotional recovery, and emotional exhaustion metrics did not show a significant change. By user log data, time spent in the EHR did not show a significant decrease; however, 40% of the APPs responded that they spent less time in the EHR.ConclusionsThis inpatient sprint improved satisfaction with the EHR.     

Human-centered development of an electronic health record-embedded,interactive information visualization in the emergency department using fast healthcare interoperability resources

ObjectiveDevelop and evaluate an interactive information visualization embedded within the electronic health record (EHR) by following human-centered design (HCD) processes and leveraging modern health information exchange standards.Materials and MethodsWe applied an HCD process to develop a Fast Healthcare Interoperability Resources (FHIR) application that displays a patient’s asthma history to clinicians in a pediatric emergency department. We performed a preimplementation comparative system evaluation to measure time on task, number of screens, information retrieval accuracy, cognitive load, user satisfaction, and perceived utility and usefulness. Application usage and system functionality were assessed using application logs and a postimplementation survey of end users.ResultsUsability testing of the Asthma Timeline Application demonstrated a statistically significant reduction in time on task (P < .001), number of screens (P < .001), and cognitive load (P < .001) for clinicians when compared to base EHR functionality. Postimplementation evaluation demonstrated reliable functionality and high user satisfaction.DiscussionFollowing HCD processes to develop an application in the context of clinical operations/quality improvement is feasible. Our work also highlights the potential benefits and challenges associated with using internationally recognized data exchange standards as currently implemented.ConclusionCompared to standard EHR functionality, our visualization increased clinician efficiency when reviewing the charts of pediatric asthma patients. Application development efforts in an operational context should leverage existing health information exchange standards, such as FHIR, and evidence-based mixed methods approaches.     

The impact of time spent on the electronic health record after work and of clerical work on burnout among clinical faculty

ObjectiveTo identify specific thresholds of daily electronic health record (EHR) time after work and daily clerical time burden associated with burnout in clinical faculty.Materials and MethodsWe administered an institution-wide survey to faculty in all departments at Mount Sinai Health System from November 2018 to February 2019. The Maslach Burnout Inventory and Mayo Well-Being Index assessed burnout. Demographics, possible confounding variables, and time spent on EHR work/clerical burden were assessed.ResultsOf 4156 eligible faculty members, 1781(42.9%) participated in the survey. After adjustment for background factors, EHR frustration (odds ratio [OR]=1.64–1.66), spending >90 minutes on EHR-outside the workday by self-report (OR = 1.41–1.90) and >1 hour of self-reported clerical work/day (OR = 1.39) were associated with burnout. Reporting that one’s practice unloads clerical burden (OR = 0.50–0.66) and higher resilience scores (OR = 0.77–0.84) were negatively associated with burnout.Spending >90 minutes/day on EHR-outside work (OR = 0.66–0.67) and >60 minutes/day on clerical work (OR = 0.54–0.58) was associated with decreased likelihood of satisfactory work–life integration (WLI) and professional satisfaction (PS). Greater meaning in work was associated with an increasedlikelihoodof achieving WLI (OR = 2.51) and PS (OR = 21.67).ConclusionResults suggest there are thresholds of excessive time on the EHR-outside the workday (>90 minutes) and overall clerical tasks (>60 minutes), above which clinical faculty may be at increased risk for burnout, as well as reduced WLI and PS, independent of demographic characteristics and clinical work hours. These thresholds of EHR and clerical burden may inform interventions aimed at mitigating this burden to reduce physician burnout.     

The association between perceived electronic health record usability and professional burnout among US nurses

ObjectivesTo measure nurse-perceived electronic health records (EHR) usability with a standardized metric of technology usability and evaluate its association with professional burnout.MethodsA cross-sectional survey of a random sample of US nurses was conducted in November 2017. EHR usability was measured with the System Usability Scale (SUS; range 0–100) and burnout with the Maslach Burnout Inventory.ResultsAmong the 86 858 nurses who were invited, 8638 (9.9%) completed the survey. The mean nurse-rated EHR SUS score was 57.6 (SD 16.3). A score of 57.6 is in the bottom 24% of scores across previous studies and categorized with a grade of “F.” On multivariable analysis adjusting for age, gender, race, ethnicity, relationship status, children, highest nursing-related degree, mean hours worked per week, years of nursing experience, advanced certification, and practice setting, nurse-rated EHR usability was associated with burnout with each 1 point more favorable SUS score and associated with a 2% lower odds of burnout (OR 0.98; 95% CI, 0.97–0.99; P < .001).ConclusionsNurses rated the usability of their current EHR in the low marginal range of acceptability using a standardized metric of technology usability. EHR usability and the odds of burnout were strongly associated with a dose-response relationship.     

Characterizing physician EHR use with vendor derived data: a feasibility study and cross-sectional analysis

ObjectiveTo derive 7 proposed core electronic health record (EHR) use metrics across 2 healthcare systems with different EHR vendor product installations and examine factors associated with EHR time.Materials and MethodsA cross-sectional analysis of ambulatory physicians EHR use across the Yale-New Haven and MedStar Health systems was performed for August 2019 using 7 proposed core EHR use metrics normalized to 8 hours of patient scheduled time.ResultsFive out of 7 proposed metrics could be measured in a population of nonteaching, exclusively ambulatory physicians. Among 573 physicians (Yale-New Haven N = 290, MedStar N = 283) in the analysis, median EHR-Time₈ was 5.23 hours. Gender, additional clinical hours scheduled, and certain medical specialties were associated with EHR-Time₈ after adjusting for age and health system on multivariable analysis. For every 8 hours of scheduled patient time, the model predicted these differences in EHR time (P < .001, unless otherwise indicated): female physicians +0.58 hours; each additional clinical hour scheduled per month −0.01 hours; practicing cardiology −1.30 hours; medical subspecialties −0.89 hours (except gastroenterology, P = .002); neurology/psychiatry −2.60 hours; obstetrics/gynecology −1.88 hours; pediatrics −1.05 hours (P = .001); sports/physical medicine and rehabilitation −3.25 hours; and surgical specialties −3.65 hours.ConclusionsFor every 8 hours of scheduled patient time, ambulatory physicians spend more than 5 hours on the EHR. Physician gender, specialty, and number of clinical hours practicing are associated with differences in EHR time. While audit logs remain a powerful tool for understanding physician EHR use, additional transparency, granularity, and standardization of vendor-derived EHR use data definitions are still necessary to standardize EHR use measurement.     

Measuring time clinicians spend using EHRs in the inpatient setting: a national,mixed-methods study

ObjectiveTo understand hospitals’ use of EHR audit-log-based measures to address burden associated with inpatient EHR use.Materials and MethodsUsing mixed methods, we analyzed 2018 American Hospital Association Information Technology Supplement Survey data (n = 2864 hospitals; 64% response rate) to characterize measures used and provided by EHR vendors to track clinician time spent documenting. We interviewed staff from the top 3 EHR vendors that provided these measures. Multivariable analyses identified variation in use of the measures among hospitals with these 3 vendors.Results53% of hospitals reported using EHR data to track clinician time documenting, compared to 68% of the hospitals using the EHR from the top 3 vendors. Among hospitals with EHRs from these vendors, usage was significantly lower among rural hospitals and independent hospitals (P < .05). Two of these vendors provided measures of time spent doing specific tasks while the third measured an aggregate of auditable activities. Vendors varied in the underlying data used to create measures, measure specification, and data displays.DiscussionTools to track clinicians’ documentation time are becoming more available. The measures provided differ across vendors and disparities in use exist across hospitals. Increasing the specificity of standards underlying the data would support a common set of core measures making these measures more widely available.ConclusionAlthough half of US hospitals use measures of time spent in the EHR derived from EHR generated data, work remains to make such measures and analyses more broadly available to all hospitals and to increase its utility for national burden measurement.     

Can decision support combat incompleteness and bias in routine primary care data?

ObjectiveRoutine primary care data may be used for the derivation of clinical prediction rules and risk scores. We sought to measure the impact of a decision support system (DSS) on data completeness and freedom from bias.Materials and MethodsWe used the clinical documentation of 34 UK general practitioners who took part in a previous study evaluating the DSS. They consulted with 12 standardized patients. In addition to suggesting diagnoses, the DSS facilitates data coding. We compared the documentation from consultations with the electronic health record (EHR) (baseline consultations) vs consultations with the EHR-integrated DSS (supported consultations). We measured the proportion of EHR data items related to the physician’s final diagnosis. We expected that in baseline consultations, physicians would document only or predominantly observations related to their diagnosis, while in supported consultations, they would also document other observations as a result of exploring more diagnoses and/or ease of coding.ResultsSupported documentation contained significantly more codes (incidence rate ratio [IRR] = 5.76 [4.31, 7.70] P < .001) and less free text (IRR = 0.32 [0.27, 0.40] P < .001) than baseline documentation. As expected, the proportion of diagnosis-related data was significantly lower (b = −0.08 [−0.11, −0.05] P < .001) in the supported consultations, and this was the case for both codes and free text.ConclusionsWe provide evidence that data entry in the EHR is incomplete and reflects physicians’ cognitive biases. This has serious implications for epidemiological research that uses routine data. A DSS that facilitates and motivates data entry during the consultation can improve routine documentation.     

A visual representation of microbiological culture data improves comprehension: a randomized controlled trial

ObjectiveWhile the judicious use of antibiotics takes past microbiological culture results into consideration, this data’s typical format in the electronic health record (EHR) may be unwieldy when incorporated into clinical decision-making. We hypothesize that a visual representation of sensitivities may aid in their comprehension.Materials and MethodsA prospective parallel unblinded randomized controlled trial was undertaken at an academic urban tertiary care center. Providers managing emergency department (ED) patients receiving antibiotics and having previous culture sensitivity testing were included. Providers were randomly selected to use standard EHR functionality or a visual representation of patients’ past culture data as they answered questions about previous sensitivities. Concordance between provider responses and past cultures was assessed using the kappa statistic. Providers were surveyed about their decision-making and the usability of the tool using Likert scales.Results518 ED encounters were screened from 3/5/2018 to 9/30/18, with providers from 144 visits enrolled and analyzed in the intervention arm and 129 in the control arm. Providers using the visualization tool had a kappa of 0.69 (95% CI: 0.65–0.73) when asked about past culture results while the control group had a kappa of 0.16 (95% CI: 0.12–0.20). Providers using the tool expressed improved understanding of previous cultures and found the tool easy to use (P < .001). Secondary outcomes showed no differences in prescribing practices.ConclusionA visual representation of culture sensitivities improves comprehension when compared to standard text-based representations.     

Inaccuracies in electronic health records smoking data and a potential approach to address resulting underestimation in determining lung cancer screening eligibility

ObjectiveThe US Preventive Services Task Force (USPSTF) requires the estimation of lifetime pack-years to determine lung cancer screening eligibility. Leading electronic health record (EHR) vendors calculate pack-years using only the most recently recorded smoking data. The objective was to characterize EHR smoking data issues and to propose an approach to addressing these issues using longitudinal smoking data.Materials and MethodsIn this cross-sectional study, we evaluated 16 874 current or former smokers who met USPSTF age criteria for screening (50–80 years old), had no prior lung cancer diagnosis, and were seen in 2020 at an academic health system using the Epic^® EHR. We described and quantified issues in the smoking data. We then estimated how many additional potentially eligible patients could be identified using longitudinal data. The approach was verified through manual review of records from 100 subjects.ResultsOver 80% of evaluated records had inaccuracies, including missing packs-per-day or years-smoked (42.7%), outdated data (25.1%), missing years-quit (17.4%), and a recent change in packs-per-day resulting in inaccurate lifetime pack-years estimation (16.9%). Addressing these issues by using longitudinal data enabled the identification of 49.4% more patients potentially eligible for lung cancer screening (P < .001).DiscussionMissing, outdated, and inaccurate smoking data in the EHR are important barriers to effective lung cancer screening. Data collection and analysis strategies that reflect changes in smoking habits over time could improve the identification of patients eligible for screening.ConclusionThe use of longitudinal EHR smoking data could improve lung cancer screening.     

Sharing patient-generated data with healthcare providers: findings from a 2019 national survey

ObjectiveOur study estimates the prevalence and predictors of wearable device adoption and data sharing with healthcare providers in a nationally representative sample.Materials and MethodsData were obtained from the 2019 Health Information National Trend Survey. We conducted multivariable logistic regression to examine predictors of device adoption and data sharing.ResultsThe sample contained 4159 individuals, 29.9% of whom had adopted a wearable device in 2019. Among adopters, 46.3% had shared data with their provider. Individuals with diabetes (odds ratio [OR], 2.39; 95% CI, 1.66–3.45; P < .0001), hypertension (OR, 2.80; 95% CI, 2.12–3.70; P < .0001), and multiple chronic conditions (OR, 1.55; 95% CI, 1.03–2.32; P < .0001) had significantly higher odds of wearable device adoption. Individuals with a usual source of care (OR, 2.44; 95% CI, 1.95–3.04; P < .0001), diabetes (OR, 1.66; 95% CI, 1.32–2.08; P < .0001), and hypertension (OR, 1.78; 95% CI, 1.44–2.20; P < .0001) had significantly higher odds of sharing data with providers.DiscussionA third of individuals adopted a wearable medical device and nearly 50% of individuals who owned a device shared data with a provider in 2019. Patients with certain conditions, such as diabetes and hypertension, were more likely to adopt devices and share data with providers. Social determinants of health, such as income and usual source of care, negatively affected wearable device adoption and data sharing, similarly to other consumer health technologies.ConclusionsWearable device adoption and data sharing with providers may be more common than prior studies have reported; however, digital disparities were noted. Studies are needed that test implementation strategies to expand wearable device use and data sharing into care delivery.     

Examining association between cohesion and diversity in collaboration networks of pharmaceutical clinical trials with drug approvals

ObjectiveClinical trials ensure that pharmaceutical treatments are safe, efficacious, and effective for public consumption, but are extremely complex, taking up to 10 years and $2.6 billion to complete. One main source of complexity arises from the collaboration between actors, and network science methodologies can be leveraged to explore that complexity. We aim to characterize collaborations between actors in the clinical trials context and investigate trends of successful actors.Materials and MethodsWe constructed a temporal network of clinical trial collaborations between large and small-size pharmaceutical companies, academic institutions, nonprofit organizations, hospital systems, and government agencies from public and proprietary data and introduced metrics to quantify actors’ collaboration network structure, organizational behavior, and partnership characteristics. A multivariable regression analysis was conducted to determine the metrics’ relationship with success.ResultsWe found a positive correlation between the number of successful approved trials and interdisciplinary collaborations measured by a collaboration diversity metric (P < .01). Our results also showed a negative effect of the local clustering coefficient (P < .01) on the success of clinical trials. Large pharmaceutical companies have the lowest local clustering coefficient and more diversity in partnerships across biomedical specializations.ConclusionsLarge pharmaceutical companies are more likely to collaborate with a wider range of actors from other specialties, especially smaller industry actors who are newcomers in clinical research, resulting in exclusive access to smaller actors. Future investigations are needed to show how concentrations of influence and resources might result in diminished gains in treatment development.     

Evaluation of electronic health record-integrated digital health tools to engage hospitalized patients in discharge preparation

ObjectiveTo evaluate the effect of electronic health record (EHR)-integrated digital health tools comprised of a checklist and video on transitions-of-care outcomes for patients preparing for discharge.Materials and MethodsEnglish-speaking, general medicine patients (>18 years) hospitalized at least 24 hours at an academic medical center in Boston, MA were enrolled before and after implementation. A structured checklist and video were administered on a mobile device via a patient portal or web-based survey at least 24 hours prior to anticipated discharge. Checklist responses were available for clinicians to review in real time via an EHR-integrated safety dashboard. The primary outcome was patient activation at discharge assessed by patient activation (PAM)-13. Secondary outcomes included postdischarge patient activation, hospital operational metrics, healthcare resource utilization assessed by 30-day follow-up calls and administrative data and change in patient activation from discharge to 30 days postdischarge.ResultsOf 673 patients approached, 484 (71.9%) enrolled. The proportion of activated patients (PAM level 3 or 4) at discharge was nonsignificantly higher for the 234 postimplementation compared with the 245 preimplementation participants (59.8% vs 56.7%, adjusted OR 1.23 [0.38, 3.96], P = .73). Postimplementation participants reported 3.75 (3.02) concerns via the checklist. Mean length of stay was significantly higher for postimplementation compared with preimplementation participants (10.13 vs 6.21, P < .01). While there was no effect on postdischarge outcomes, there was a nonsignificant decrease in change in patient activation within participants from pre- to postimplementation (adjusted difference-in-difference of −16.1% (9.6), P = .09).ConclusionsEHR-integrated digital health tools to prepare patients for discharge did not significantly increase patient activation and was associated with a longer length of stay. While issues uncovered by the checklist may have encouraged patients to inquire about their discharge preparedness, other factors associated with patient activation and length of stay may explain our observations. We offer insights for using PAM-13 in context of real-world health-IT implementations.Trial RegistrationNIH US National Library of Medicine, {"type":"clinical-trial","attrs":{"text":"NCT03116074","term_id":"NCT03116074"}}NCT03116074, clinicaltrials.gov     

Clinical data sharing improves quality measurement and patient safety

ObjectiveAccurate and robust quality measurement is critical to the future of value-based care. Having incomplete information when calculating quality measures can cause inaccuracies in reported patient outcomes. This research examines how quality calculations vary when using data from an individual electronic health record (EHR) and longitudinal data from a health information exchange (HIE) operating as a multisource registry for quality measurement. Materials and MethodsData were sampled from 53 healthcare organizations in 2018. Organizations represented both ambulatory care practices and health systems participating in the state of Kansas HIE. Fourteen ambulatory quality measures for 5300 patients were calculated using the data from an individual EHR source and contrasted to calculations when HIE data were added to locally recorded data.ResultsA total of 79% of patients received care at more than 1 facility during the 2018 calendar year. A total of 12 994 applicable quality measure calculations were compared using data from the originating organization vs longitudinal data from the HIE. A total of 15% of all quality measure calculations changed (P < .001) when including HIE data sources, affecting 19% of patients. Changes in quality measure calculations were observed across measures and organizations.DiscussionThese results demonstrate that quality measures calculated using single-site EHR data may be limited by incomplete information. Effective data sharing significantly changes quality calculations, which affect healthcare payments, patient safety, and care quality.ConclusionsFederal, state, and commercial programs that use quality measurement as part of reimbursement could promote more accurate and representative quality measurement through methods that increase clinical data sharing.     

The correlation between fear of falling and upper extremity muscle strength

Objectives:To determine the relationship between fear of falling (FOF) and upper extremity muscle strength.Methods:This cross-sectional study included 112 hospitalized, mobile patients. Forty-seven (42%) were males and 65 (58%) were females, and the mean age was 72.3. The study was carried out between September 2018 and September 2019 at Balikli Rum Hospital Nursing Homes, Istanbul, Turkey. Patients were tested using geriatric tools (such as Mini-Mental State Examination) and physical tests such as handgrip, key pinch and 6-meter up and go tests.Results:The average annual falling number of elderly people with FOF was statistically significantly higher than that in those without FOF (p=0.001). Right handgrip, left handgrip, right key pinch, and left key-pinch mean values in elderly individuals with FOF were statistically significantly lower than those without FOF (p< 0.001, p< 0.001, p< 0.001, p< 0.001, respectively).Conclusion:The measurement of upper extremity strength could be a predicting parameter of FOF.     

Burnout and imposter syndrome among Saudi young adults: The strings in the puppet show of psychological morbidity

Objectives:To determine the prevalence of imposter syndrome (IS) among Saudi adults and its association with burnout.Methods:Using non-probability convenience sampling, we carried out a cross-sectional analytical study among adults in Northern Saudi Arabia. Data collection toll was a self-administered questionnaire containing young imposter scale (YIS), Maslach burnout inventory (MBI) and depression, anxiety, and stress scale 21 (DASS 21). These 3 scales are valid and reliable measurement tools for measuring IS, burnout, and psychological morbidity.Results:In the study sample (n=384), imposterism was present among 222 adults (57.8%). Moderate and severe symptoms of depression were present in 217 (56.5%), symptoms of stress in 210 (54.7%), and symptoms of anxiety in 126 (32.8%). Burnout was measured in 3 domains of depersonalization, emotion exhaustion, and personal accomplishments. High degree of depersonalization was found in 221 (57.6%), higher emotional exhaustion in 246 (64.1%) while lower personal accomplishment was present in 126 (32.8%). We found statistical association between IS and gender (p<0.01), depression (p<0.001) stress (p<0.001) and all 3 domains of burnout (p<0.01). Imposter syndrome was not found associated with anxiety (p=0.97). Young imposter scale score was associated with all the 3 domains of burnout even after controlling for depression, anxiety, and stress.Conclusion:Imposter syndrome is frequent among Saudi adults and associated with all 3 burnout domains. Mental health domains like burnout, depression, stress, and anxiety were found associated with IS.