Utilizing timestamps of longitudinal electronic health record data to classify clinical deterioration events

ObjectiveTo propose an algorithm that utilizes only timestamps of longitudinal electronic health record data to classify clinical deterioration events.Materials and methodsThis retrospective study explores the efficacy of machine learning algorithms in classifying clinical deterioration events among patients in intensive care units using sequences of timestamps of vital sign measurements, flowsheets comments, order entries, and nursing notes. We design a data pipeline to partition events into discrete, regular time bins that we refer to as timesteps. Logistic regressions, random forest classifiers, and recurrent neural networks are trained on datasets of different length of timesteps, respectively, against a composite outcome of death, cardiac arrest, and Rapid Response Team calls. Then these models are validated on a holdout dataset.ResultsA total of 6720 intensive care unit encounters meet the criteria and the final dataset includes 830 578 timestamps. The gated recurrent unit model utilizes timestamps of vital signs, order entries, flowsheet comments, and nursing notes to achieve the best performance on the time-to-outcome dataset, with an area under the precision-recall curve of 0.101 (0.06, 0.137), a sensitivity of 0.443, and a positive predictive value of 0. 092 at the threshold of 0.6.Discussion and ConclusionThis study demonstrates that our recurrent neural network models using only timestamps of longitudinal electronic health record data that reflect healthcare processes achieve well-performing discriminative power.     

Risk prediction for chronic kidney disease progression using heterogeneous electronic health record data and time series analysis

Background As adoption of electronic health records continues to increase, there is an opportunity to incorporate clinical documentation as well as laboratory values and demographics into risk prediction modeling.Objective The authors develop a risk prediction model for chronic kidney disease (CKD) progression from stage III to stage IV that includes longitudinal data and features drawn from clinical documentation.Methods The study cohort consisted of 2908 primary-care clinic patients who had at least three visits prior to January 1, 2013 and developed CKD stage III during their documented history. Development and validation cohorts were randomly selected from this cohort and the study datasets included longitudinal inpatient and outpatient data from these populations. Time series analysis (Kalman filter) and survival analysis (Cox proportional hazards) were combined to produce a range of risk models. These models were evaluated using concordance, a discriminatory statistic.Results A risk model incorporating longitudinal data on clinical documentation and laboratory test results (concordance 0.849) predicts progression from state III CKD to stage IV CKD more accurately when compared to a similar model without laboratory test results (concordance 0.733, P<.001), a model that only considers the most recent laboratory test results (concordance 0.819, P < .031) and a model based on estimated glomerular filtration rate (concordance 0.779, P < .001).Conclusions A risk prediction model that takes longitudinal laboratory test results and clinical documentation into consideration can predict CKD progression from stage III to stage IV more accurately than three models that do not take all of these variables into consideration.     

Synergies between centralized and federated approaches to data quality: a report from the national COVID cohort collaborative

ObjectiveIn response to COVID-19, the informatics community united to aggregate as much clinical data as possible to characterize this new disease and reduce its impact through collaborative analytics. The National COVID Cohort Collaborative (N3C) is now the largest publicly available HIPAA limited dataset in US history with over 6.4 million patients and is a testament to a partnership of over 100 organizations.Materials and MethodsWe developed a pipeline for ingesting, harmonizing, and centralizing data from 56 contributing data partners using 4 federated Common Data Models. N3C data quality (DQ) review involves both automated and manual procedures. In the process, several DQ heuristics were discovered in our centralized context, both within the pipeline and during downstream project-based analysis. Feedback to the sites led to many local and centralized DQ improvements.ResultsBeyond well-recognized DQ findings, we discovered 15 heuristics relating to source Common Data Model conformance, demographics, COVID tests, conditions, encounters, measurements, observations, coding completeness, and fitness for use. Of 56 sites, 37 sites (66%) demonstrated issues through these heuristics. These 37 sites demonstrated improvement after receiving feedback.DiscussionWe encountered site-to-site differences in DQ which would have been challenging to discover using federated checks alone. We have demonstrated that centralized DQ benchmarking reveals unique opportunities for DQ improvement that will support improved research analytics locally and in aggregate.ConclusionBy combining rapid, continual assessment of DQ with a large volume of multisite data, it is possible to support more nuanced scientific questions with the scale and rigor that they require.     

Measures of electronic health record use in outpatient settings across vendors

Electronic health record (EHR) log data capture clinical workflows and are a rich source of information to understand variation in practice patterns. Variation in how EHRs are used to document and support care delivery is associated with clinical and operational outcomes, including measures of provider well-being and burnout. Standardized measures that describe EHR use would facilitate generalizability and cross-institution, cross-vendor research. Here, we describe the current state of outpatient EHR use measures offered by various EHR vendors, guided by our prior conceptual work that proposed seven core measures to describe EHR use. We evaluate these measures and other reporting options provided by vendors for maturity and similarity to previously proposed standardized measures. Working toward improved standardization of EHR use measures can enable and accelerate high-impact research on physician burnout and job satisfaction as well as organizational efficiency and patient health.     

Patient characteristics associated with venous thromboembolic events: a cohort study using pooled electronic health record data

Objective

To demonstrate the potential of de-identified clinical data from multiple healthcare systems using different electronic health records (EHR) to be efficiently used for very large retrospective cohort studies.

Materials and methods

Data of 959 030 patients, pooled from multiple different healthcare systems with distinct EHR, were obtained. Data were standardized and normalized using common ontologies, searchable through a HIPAA-compliant, patient de-identified web application (Explore; Explorys Inc). Patients were 26 years or older seen in multiple healthcare systems from 1999 to 2011 with data from EHR.

Results

Comparing obese, tall subjects with normal body mass index, short subjects, the venous thromboembolic events (VTE) OR was 1.83 (95% CI 1.76 to 1.91) for women and 1.21 (1.10 to 1.32) for men. Weight had more effect then height on VTE. Compared with Caucasian, Hispanic/Latino subjects had a much lower risk of VTE (female OR 0.47, 0.41 to 0.55; male OR 0.24, 0.20 to 0.28) and African-Americans a substantially higher risk (female OR 1.83, 1.76 to 1.91; male OR 1.58, 1.50 to 1.66). This 13-year retrospective study of almost one million patients was performed over approximately 125 h in 11 weeks, part time by the five authors.

Discussion

As research informatics tools develop and more clinical data become available in EHR, it is important to study and understand unique opportunities for clinical research informatics to transform the scale and resources needed to perform certain types of clinical research.

Conclusions

With the right clinical research informatics tools and EHR data, some types of very large cohort studies can be completed with minimal resources.     

Harmonized patient-reported data elements in the electronic health record: supporting meaningful use by primary care action on health behaviors and key psychosocial factors

Background

Electronic health records (EHR) have the potential to improve patient care through efficient access to complete patient health information. This potential may not be reached because many of the most important determinants of health outcome are rarely included. Successful health promotion and disease prevention requires patient-reported data reflecting health behaviors and psychosocial issues. Furthermore, there is a need to harmonize this information across different EHR systems.

Methods

To fill this gap a three-phased process was used to conceptualize, identify and recommend patient-reported data elements on health behaviors and psychosocial factors for the EHR. Expert panels (n=13) identified candidate measures (phase 1) that were reviewed and rated by a wide range of health professionals (n=93) using the grid-enabled measures wiki social media platform (phase 2). Recommendations were finalized through a town hall meeting with key stakeholders including patients, providers, researchers, policy makers, and representatives from healthcare settings (phase 3).

Results

Nine key elements from three areas emerged as the initial critical patient-reported elements to incorporate systematically into EHR—health behaviors (eg, exercise), psychosocial issues (eg, distress), and patient-centered factors (eg, demographics). Recommendations were also made regarding the frequency of collection ranging from a single assessment (eg, demographic characteristics), to annual assessment (eg, health behaviors), or more frequent (eg, patient goals).

Conclusions

There was strong stakeholder support for this initiative reflecting the perceived value of incorporating patient-reported elements into EHR. The next steps will include testing the feasibility of incorporating these elements into the EHR across diverse primary care settings.     

RS纠删码在电子健康档案云存储中的应用

电子健康档案云存储成为研究热点,但云端存储节点的不可控特性使得其存储数据的安全性得不到保障,从而制约了电子健康档案云存储的进一步发展。利用RS纠删码编码将文件信息割裂并分片存储来防止局部存储节点数据块泄露导致的整个文件信息被窃取,利用其纠删能力实现损坏数据的恢复,为电子健康档案云存储数据安全性保障提供了一种新的解决方案。     

CSER and eMERGE: current and potential state of the display of genetic information in the electronic health record

Objective Clinicians’ ability to use and interpret genetic information depends upon how those data are displayed in electronic health records (EHRs). There is a critical need to develop systems to effectively display genetic information in EHRs and augment clinical decision support (CDS).Materials and Methods The National Institutes of Health (NIH)-sponsored Clinical Sequencing Exploratory Research and Electronic Medical Records & Genomics EHR Working Groups conducted a multiphase, iterative process involving working group discussions and 2 surveys in order to determine how genetic and genomic information are currently displayed in EHRs, envision optimal uses for different types of genetic or genomic information, and prioritize areas for EHR improvement.Results There is substantial heterogeneity in how genetic information enters and is documented in EHR systems. Most institutions indicated that genetic information was displayed in multiple locations in their EHRs. Among surveyed institutions, genetic information enters the EHR through multiple laboratory sources and through clinician notes. For laboratory-based data, the source laboratory was the main determinant of the location of genetic information in the EHR. The highest priority recommendation was to address the need to implement CDS mechanisms and content for decision support for medically actionable genetic information.Conclusion Heterogeneity of genetic information flow and importance of source laboratory, rather than clinical content, as a determinant of information representation are major barriers to using genetic information optimally in patient care. Greater effort to develop interoperable systems to receive and consistently display genetic and/or genomic information and alert clinicians to genomic-dependent improvements to clinical care is recommended.     

A novel application of SMART on FHIR architecture for interoperable and scalable integration of patient-reported outcome data with electronic health records

ObjectiveDespite a proliferation of applications (apps) to conveniently collect patient-reported outcomes (PROs) from patients, PRO data are yet to be seamlessly integrated with electronic health records (EHRs) in a way that improves interoperability and scalability. We applied the newly created PRO standards from the Office of the National Coordinator for Health Information Technology to facilitate the collection and integration of standardized PRO data. A novel multitiered architecture was created to enable seamless integration of PRO data via Substitutable Medical Apps and Reusable Technologies on Fast Healthcare Interoperability Resources apps and scaled to different EHR platforms in multiple ambulatory settings.Materials and MethodsWe used a standards-based approach to deploy 2 apps that source and surface PRO data in real-time for provider use within the EHR and which rely on PRO assessments from an external center to streamline app and EHR integration.ResultsThe apps were developed to enable patients to answer validated assessments (eg, a Patient-Reported Outcomes Measurement Information System including using a Computer Adaptive Test format). Both apps were developed to populate the EHR in real time using the Health Level Seven FHIR standard allowing providers to view patients’ data during the clinical encounter. The process of implementing this architecture with 2 different apps across 18 ambulatory care sites and 3 different EHR platforms is described.ConclusionOur approach and solution proved feasible, secure, and time- and resource-efficient. We offer actionable guidance for this technology to be scaled and adapted to promote adoption in diverse ambulatory care settings and across different EHRs.     

Area-level factors associated with electronic health record adoption and meaningful use in the Regional Extension Center Program

Objective

To identify area-level correlates of electronic health record (EHR) adoption and meaningful use (MU) among primary care providers (PCPs) enrolled in the Regional Extension Center (REC) Program.

Materials and methods

County-level data on 2013 EHR adoption and MU among REC-enrolled PCPs were obtained from the Office of the National Coordinator for Health Information Technology and linked with other county-level data sources including the Area Resource File, American Community Survey, and Federal Communications Commission''s broadband availability database. Hierarchical models with random intercepts for RECs were employed to assess associations between a broad set of area-level factors and county-level rates of EHR adoption and MU.

Results

Among the 2715 counties examined, the average county-level EHR adoption and MU rates for REC-enrolled PCPs were 87.5% and 54.2%, respectively. Community health center presence and Medicaid enrollment concentration were positively associated with EHR adoption, while metropolitan status and Medicare Advantage enrollment concentration were positively associated with MU. Health professional shortage area status and minority concentration were negatively associated with EHR adoption and MU.

Discussion

Increased financial incentives in areas with greater concentrations of Medicaid and Medicare enrollees may be encouraging EHR adoption and MU among REC-enrolled PCPs. Disparities in EHR adoption and MU in some low-resource and underserved areas remain a concern.

Conclusions

Federal efforts to spur EHR adoption and MU have demonstrated some early success; however, some geographic variations in EHR diffusion indicate that greater attention needs to be paid to ensuring equitable uptake and use of EHRs throughout the US.     

Optimizing gender-affirming medical care through anatomical inventories,clinical decision support,and population health management in electronic health record systems

Recent advances in electronic health records and health information technology are providing new opportunities to improve the quality of care for transgender and gender diverse people, a population that experiences significant health disparities. This article recommends changes to electronic health record systems that have the potential to optimize gender-affirming care. Specifically, we discuss the importance of creating an anatomical inventory form that captures organ diversity, and of developing clinical decision support tools and population health management systems that consider each patient’s gender identity, sex assigned at birth, and anatomy.     

Effects of electronic health record use on the exam room communication skills of resident physicians: a randomized within-subjects study

Background The effects of electronic health records (EHRs) on doctor–patient communication are unclear.Objective To evaluate the effects of EHR use compared with paper chart use, on novice physicians’ communication skills.Design Within-subjects randomized controlled trial using observed structured clinical examination methods to assess the impact of use of an EHR on communication.Setting A large academic internal medicine training program.Population First-year internal medicine residents.Intervention Residents interviewed, diagnosed, and initiated treatment of simulated patients using a paper chart or an EHR on a laptop computer. Video recordings of interviews were rated by three trained observers using the Four Habits scale.Results Thirty-two residents completed the study and had data available for review (61.5% of those enrolled in the residency program). In most skill areas in the Four Habits model, residents performed at least as well using the EHR and were statistically better in six of 23 skills areas (p<0.05). The overall average communication score was better when using an EHR: mean difference 0.254 (95% CI 0.05 to 0.45), p = 0.012, Cohen''s d of 0.47 (a moderate effect). Residents scoring poorly (>3 average score) with paper methods (n = 8) had clinically important improvement when using the EHR.Limitations This study was conducted in first-year residents in a training environment using simulated patients at a single institution.Conclusions Use of an EHR on a laptop computer appears to improve the ability of first-year residents to communicate with patients relative to using a paper chart.     

Use of the internet and an online personal health record system by US veterans: comparison of Veterans Affairs mental health service users and other veterans nationally

Objective

The Department of Veterans Affairs (VA) operates one of the largest nationwide healthcare systems and is increasing use of internet technology, including development of an online personal health record system called My HealtheVet. This study examined internet use among veterans in general and particularly use of online health information among VA patients and specifically mental health service users.

Methods

A nationally representative sample of 7215 veterans from the 2010 National Survey of Veterans was used. Logistic regression was employed to examine background characteristics associated with internet use and My HealtheVet.

Results

71% of veterans reported using the internet and about a fifth reported using My HealtheVet. Veterans who were younger, more educated, white, married, and had higher incomes were more likely to use the internet. There was no association between background characteristics and use of My HealtheVet. Mental health service users were no less likely to use the internet or My HealtheVet than other veterans.

Discussion

Most veterans are willing to access VA information online, although many VA service users do not use My HealtheVet, suggesting more education and research is needed to reduce barriers to its use.

Conclusion

Although adoption of My HealtheVet has been slow, the majority of veterans, including mental health service users, use the internet and indicate a willingness to receive and interact with health information online.     

MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care

The rise of digital data and computing power have contributed to significant advancements in artificial intelligence (AI), leading to the use of classification and prediction models in health care to enhance clinical decision-making for diagnosis, treatment and prognosis. However, such advances are limited by the lack of reporting standards for the data used to develop those models, the model architecture, and the model evaluation and validation processes. Here, we present MINIMAR (MINimum Information for Medical AI Reporting), a proposal describing the minimum information necessary to understand intended predictions, target populations, and hidden biases, and the ability to generalize these emerging technologies. We call for a standard to accurately and responsibly report on AI in health care. This will facilitate the design and implementation of these models and promote the development and use of associated clinical decision support tools, as well as manage concerns regarding accuracy and bias.     

The quality of social determinants data in the electronic health record: a systematic review

ObjectiveThe aim of this study was to collect and synthesize evidence regarding data quality problems encountered when working with variables related to social determinants of health (SDoH).Materials and MethodsWe conducted a systematic review of the literature on social determinants research and data quality and then iteratively identified themes in the literature using a content analysis process.ResultsThe most commonly represented quality issue associated with SDoH data is plausibility (n = 31, 41%). Factors related to race and ethnicity have the largest body of literature (n = 40, 53%). The first theme, noted in 62% (n = 47) of articles, is that bias or validity issues often result from data quality problems. The most frequently identified validity issue is misclassification bias (n = 23, 30%). The second theme is that many of the articles suggest methods for mitigating the issues resulting from poor social determinants data quality. We grouped these into 5 suggestions: avoid complete case analysis, impute data, rely on multiple sources, use validated software tools, and select addresses thoughtfully.DiscussionThe type of data quality problem varies depending on the variable, and each problem is associated with particular forms of analytical error. Problems encountered with the quality of SDoH data are rarely distributed randomly. Data from Hispanic patients are more prone to issues with plausibility and misclassification than data from other racial/ethnic groups.ConclusionConsideration of data quality and evidence-based quality improvement methods may help prevent bias and improve the validity of research conducted with SDoH data.     

Graphical display of diagnostic test results in electronic health Records: a comparison of 8 systems

Accurate display and interpretation of clinical laboratory test results is essential for safe and effective diagnosis and treatment. In an attempt to ascertain how well current electronic health records (EHRs) facilitated these processes, we evaluated the graphical displays of laboratory test results in eight EHRs using objective criteria for optimal graphs based on literature and expert opinion. None of the EHRs met all 11 criteria; the magnitude of deficiency ranged from one EHR meeting 10 of 11 criteria to three EHRs meeting only 5 of 11 criteria. One criterion (i.e., the EHR has a graph with y-axis labels that display both the name of the measured variable and the units of measure) was absent from all EHRs. One EHR system graphed results in reverse chronological order. One EHR system plotted data collected at unequally-spaced points in time using equally-spaced data points, which had the effect of erroneously depicting the visual slope perception between data points. This deficiency could have a significant, negative impact on patient safety. Only two EHR systems allowed users to see, hover-over, or click on a data point to see the precise values of the x–y coordinates. Our study suggests that many current EHR-generated graphs do not meet evidence-based criteria aimed at improving laboratory data comprehension.     

Inaccuracies in electronic health records smoking data and a potential approach to address resulting underestimation in determining lung cancer screening eligibility

ObjectiveThe US Preventive Services Task Force (USPSTF) requires the estimation of lifetime pack-years to determine lung cancer screening eligibility. Leading electronic health record (EHR) vendors calculate pack-years using only the most recently recorded smoking data. The objective was to characterize EHR smoking data issues and to propose an approach to addressing these issues using longitudinal smoking data.Materials and MethodsIn this cross-sectional study, we evaluated 16 874 current or former smokers who met USPSTF age criteria for screening (50–80 years old), had no prior lung cancer diagnosis, and were seen in 2020 at an academic health system using the Epic^® EHR. We described and quantified issues in the smoking data. We then estimated how many additional potentially eligible patients could be identified using longitudinal data. The approach was verified through manual review of records from 100 subjects.ResultsOver 80% of evaluated records had inaccuracies, including missing packs-per-day or years-smoked (42.7%), outdated data (25.1%), missing years-quit (17.4%), and a recent change in packs-per-day resulting in inaccurate lifetime pack-years estimation (16.9%). Addressing these issues by using longitudinal data enabled the identification of 49.4% more patients potentially eligible for lung cancer screening (P < .001).DiscussionMissing, outdated, and inaccurate smoking data in the EHR are important barriers to effective lung cancer screening. Data collection and analysis strategies that reflect changes in smoking habits over time could improve the identification of patients eligible for screening.ConclusionThe use of longitudinal EHR smoking data could improve lung cancer screening.     

Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review

Background ObjectiveElectronic health records (EHRs) are linked with documentation burden resulting in clinician burnout. While clear classifications and validated measures of burnout exist, documentation burden remains ill-defined and inconsistently measured. We aim to conduct a scoping review focused on identifying approaches to documentation burden measurement and their characteristics.Materials and MethodsBased on Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Extension for Scoping Reviews (ScR) guidelines, we conducted a scoping review assessing MEDLINE, Embase, Web of Science, and CINAHL from inception to April 2020 for studies investigating documentation burden among physicians and nurses in ambulatory or inpatient settings. Two reviewers evaluated each potentially relevant study for inclusion/exclusion criteria.ResultsOf the 3482 articles retrieved, 35 studies met inclusion criteria. We identified 15 measurement characteristics, including 7 effort constructs: EHR usage and workload, clinical documentation/review, EHR work after hours and remotely, administrative tasks, cognitively cumbersome work, fragmentation of workflow, and patient interaction. We uncovered 4 time constructs: average time, proportion of time, timeliness of completion, activity rate, and 11 units of analysis. Only 45.0% of studies assessed the impact of EHRs on clinicians and/or patients and 40.0% mentioned clinician burnout.DiscussionStandard and validated measures of documentation burden are lacking. While time and effort were the core concepts measured, there appears to be no consensus on the best approach nor degree of rigor to study documentation burden.ConclusionFurther research is needed to reliably operationalize the concept of documentation burden, explore best practices for measurement, and standardize its use.