Implementation science approaches for integrating eHealth research into practice and policy

PurposeTo summarize key issues in the eHealth field from an implementation science perspective and to highlight illustrative processes, examples and key directions to help more rapidly integrate research, policy and practice.MethodsWe present background on implementation science models and emerging principles; discuss implications for eHealth research; provide examples of practical designs, measures and exemplar studies that address key implementation science issues; and make recommendations for ways to more rapidly develop and test eHealth interventions as well as future research, policy and practice.ResultsThe pace of eHealth research has generally not kept up with technological advances, and many of our designs, methods and funding mechanisms are incapable of providing the types of rapid and relevant information needed. Although there has been substantial eHealth research conducted with positive short-term results, several key implementation and dissemination issues such as representativeness, cost, unintended consequences, impact on health inequities, and sustainability have not been addressed or reported. Examples of studies in several of these areas are summarized to demonstrate this is possible.ConclusionseHealth research that is intended to translate into policy and practice should be more contextual, report more on setting factors, employ more responsive and pragmatic designs and report results more transparently on issues important to potential adopting patients, clinicians and organizational decision makers. We outline an alternative development and assessment model, summarize implementation science findings that can help focus attention, and call for different types of more rapid and relevant research and funding mechanisms.     

Decision technologies as normative instruments: exposing the values within

OBJECTIVE: Describe some of the implicit normative and value judgments made in decision technologies development and use. METHODS: Using conceptual analysis of published models, we first outline some of the background assumptions of the knowledge translation/evidence-based medicine view of decision technologies. We then describe how normative judgments are embedded in decision technology development and use, drawing from empirical normative analysis of qualitative interviews with clinical practice guidelines developers (n=18) and users (n=17) in Canada and the UK. RESULTS: Normative judgments are made in at least three stages of decision technologies' "life cycle": (1) in the identification of contexts where decisions are seen as requiring support; (2) in determining what type of information and options should be part of the content of decision technologies; (3) in the negotiation between different actors regarding how effectiveness of decision technologies should be judged. These findings contrast with the knowledge translation/evidence-based medicine picture of decision technologies as neutral carriers of facts, or 'pure' synthesis of research evidence. CONCLUSION: Normative judgments are at play throughout the life cycle of decision technology development and use. References to scientific notions of truth and validity in the knowledge translation/evidence-based medicine model tend to overlook the socio-political dimension of decision technology development and implementation, as well as the contested nature of what "good decision" these technologies aim to support. PRACTICE IMPLICATIONS: Empirical normative analysis is an important research tool to better understand the values, interests and power relationships embedded in decision technologies. Such lines of inquiry could foster a more open debate among stakeholders - including patients and members of the public - regarding the norms promoted by practice guidelines and patient decision aids. It also offers new insights in understanding the problem of implementing decision technologies in clinical practice.     

Implementation of eHealth Interventions Across the HIV Care Cascade: a Review of Recent Research

Purpose of Review

We review recent implementation science focusing on eHealth interventions to improve outcomes along the HIV care cascade. We highlight several gaps in the eHealth implementation literature and propose areas for future study.

Recent Findings

We identified 17 studies conducted in North America, Europe, and sub-Saharan Africa assessing the acceptability, appropriateness, adoption, cost, feasibility, fidelity, penetration, or sustainability of eHealth interventions targeting the HIV care cascade. Most interventions used SMS messages to improve cascade outcomes. Feasibility research has demonstrated the importance of adaptability for intervention scale-up and delivery. Key gaps in the literature remain related to predictors of the adoption of eHealth interventions by health facilities and staff. In addition, no studies explored sustainability and few used theoretical frameworks for implementation research or validated measures of implementation outcomes. We propose next steps for the future of eHealth implementation research to inform the delivery, scale-up, and maintenance of eHealth interventions in the real world.

     

Lessons learned implementing a regional health information exchange in Geneva as a pilot for the Swiss national eHealth strategy

It took more than ten years from the initial mandate to the first implementation of e-toile, the Geneva health information exchange. Although most actors quickly agreed on the goals and potential benefits of such a system, obstacles were many, and mostly non-technical. The transparency resulting from a streamlined exchange of information may improve the continuity, quality and efficiency of care, while, at the same time, reveal and challenge habits and practices of care professionals and of citizens. This tension must be understood, and trust must be fostered amongst stakeholders. In our experience, key enablers were the collaborative elaboration and negotiation of an eHealth law, the definition of an eHealth strategy, as well as the involuntary increased financial pressure on all healthcare stakeholders. Nevertheless, and even though it is often cited as a successful model, the Swiss health system, being highly fragmented and based on a complex interplay of private and public stakeholders, is not as conducive to the deployment of eHealth systems as most other developed countries.     

Decision technologies as normative instruments: Exposing the values within

ObjectiveDescribe some of the implicit normative and value judgments made in decision technologies development and use.MethodsUsing conceptual analysis of published models, we first outline some of the background assumptions of the knowledge translation/evidence-based medicine view of decision technologies. We then describe how normative judgments are embedded in decision technology development and use, drawing from empirical normative analysis of qualitative interviews with clinical practice guidelines developers (n = 18) and users (n = 17) in Canada and the UK.ResultsNormative judgments are made in at least three stages of decision technologies’ “life cycle”: (1) in the identification of contexts where decisions are seen as requiring support; (2) in determining what type of information and options should be part of the content of decision technologies; (3) in the negotiation between different actors regarding how effectiveness of decision technologies should be judged. These findings contrast with the knowledge translation/evidence-based medicine picture of decision technologies as neutral carriers of facts, or ‘pure’ synthesis of research evidence.ConclusionNormative judgments are at play throughout the life cycle of decision technology development and use. References to scientific notions of truth and validity in the knowledge translation/evidence-based medicine model tend to overlook the socio–political dimension of decision technology development and implementation, as well as the contested nature of what “good decision” these technologies aim to support.Practice implicationsEmpirical normative analysis is an important research tool to better understand the values, interests and power relationships embedded in decision technologies. Such lines of inquiry could foster a more open debate among stakeholders – including patients and members of the public – regarding the norms promoted by practice guidelines and patient decision aids. It also offers new insights in understanding the problem of implementing decision technologies in clinical practice.     

Organizational issues in the implementation and adoption of health information technology innovations: An interpretative review

PurposeImplementations of health information technologies are notoriously difficult, which is due to a range of inter-related technical, social and organizational factors that need to be considered. In the light of an apparent lack of empirically based integrated accounts surrounding these issues, this interpretative review aims to provide an overview and extract potentially generalizable findings across settings.MethodsWe conducted a systematic search and critique of the empirical literature published between 1997 and 2010. In doing so, we searched a range of medical databases to identify review papers that related to the implementation and adoption of eHealth applications in organizational settings. We qualitatively synthesized this literature extracting data relating to technologies, contexts, stakeholders, and their inter-relationships.ResultsFrom a total body of 121 systematic reviews, we identified 13 systematic reviews encompassing organizational issues surrounding health information technology implementations. By and large, the evidence indicates that there are a range of technical, social and organizational considerations that need to be deliberated when attempting to ensure that technological innovations are useful for both individuals and organizational processes. However, these dimensions are inter-related, requiring a careful balancing act of strategic implementation decisions in order to ensure that unintended consequences resulting from technology introduction do not pose a threat to patients.ConclusionsOrganizational issues surrounding technology implementations in healthcare settings are crucially important, but have as yet not received adequate research attention. This may in part be due to the subjective nature of factors, but also due to a lack of coordinated efforts toward more theoretically-informed work. Our findings may be used as the basis for the development of best practice guidelines in this area.     

New directions in eHealth communication: Opportunities and challenges

Objective

This article reviews key communication issues involved in the design of effective and humane eHealth applications to help guide strategic development and implementation of health information technologies.

Background

There is a communication revolution brewing in the delivery of health care and the promotion of health fueled by the growth of powerful new health information technologies.

Conclusion

The development, adoption, and implementation of a broad range of new eHealth applications (such as online health information websites, interactive electronic health records, health decision support programs, tailored health education programs, health care system portals, mobile health communication programs, and advanced telehealth applications) holds tremendous promise to increase consumer and provider access to relevant health information, enhance the quality of care, reduce health care errors, increase collaboration, and encourage the adoption of healthy behaviors.

Practice implications

With the growth of new and exciting health information technology opportunities, however, comes the daunting responsibility to design interoperable, easy to use, engaging, and accessible eHealth applications that communicate the right information needed to guide health care and health promotion for diverse audiences.     

eHealth for Stigma Reduction Efforts Designed to Improve Engagement in Care for People Living with HIV

Purpose of Review

HIV-related stigma remains a significant barrier to engagement in care for persons living with HIV (PLWH) worldwide. This review examines the use of eHealth technologies for reducing stigma as a pathway toward improved engagement in care for PLWH. We provide a brief overview of effective stigma reduction interventions for PLWH, both eHealth and others; identify gaps in the research on use of eHealth technologies for stigma reduction; and suggest potential research avenues moving forward.

Recent Findings

The majority of HIV-related eHealth studies use technology to improve ART adherence. To date, few HIV-related eHealth studies have included any measurement of stigma.

Summary

Given the current narrow evidence base, further research is needed to determine whether eHealth technologies can help to reduce stigma and improve engagement in care for PLWH.

     

eHealth literacy 2.0: problems and opportunities with an evolving concept

As the use of eHealth grows and diversifies globally, the concept of eHealth literacy - a foundational skill set that underpins the use of information and communication technologies (ICT) for health - becomes more important than ever to understand and advance. EHealth literacy draws our collective attention to the knowledge and complex skill set that is often taken for granted when people interact with technology to address information, focusing our attention on learning and usability issues from the clinical through to population health level. Just as the field of eHealth is dynamic and evolving, so too is the context where eHealth literacy is applied and understood. The original Lily Model of eHealth literacy and scale used to assess it were developed at a time when the first generation of web tools gained prominence before the rise of social media. The rapid shifts in the informational landscape created by Web 2.0 tools and environments suggests it might be time to revisit the concept of eHealth Literacy and consider what a second release might look like.     

Knowledge,use and attitude toward eHealth among patients with chronic lung diseases

BackgroundDespite high expectations and numerous initiatives in the area of eHealth, implementation and use of eHealth applications on a national level is no common practice yet. There is no full understanding of patients’ attitude on eHealth yet. Aim of this study is to gain insight into the level of knowledge and experiences with eHealth of people with chronic lung diseases.MethodA telephone survey among 400 people with a medical diagnosis of asthma or COPD was conducted. All patients participated in the larger research program National Panel of people with Chronic diseases or Disabilities (NPCD) conducted by NIVEL.ResultsEight percent of the asthma and COPD patients knew of the term eHealth. Knowledge of specific eHealth applications (e.g. electronic medical record, electronic consultations, monitoring from a distance) was higher and ranged from 21 to 88%. Most available applications were used by less than 20% of the patients, although figures differ by age and educational level. People who have used applications were in general rather positive about their use. Non-users did not see clear advantages of using eHealth applications. A majority thought that eHealth decreases human contact in health care and will not contribute to a higher quality of care. On the contrary, almost half of the patients considered eHealth as a possibility to take more responsibility in their own care. Asthma and COPD patients were unanimous that the use of eHealth should always be a free choice.ConclusionAlthough most asthma and COPD patient know of one or more eHealth applications, actual use remains low. Patients who do have experience with the use of eHealth are on the whole positive. However, patients without experience have no clear ideas about the advantages. They should be convinced first, and stressing the possibilities for more personal control might be an important argument to persuade them.     

Design and evaluation in eHealth: challenges and implications for an interdisciplinary field

Much has been written about insufficient user involvement in the design of eHealth applications, the lack of evidence demonstrating impact, and the difficulties these bring for adoption. Part of the problem lies in the differing languages, cultures, motives, and operational constraints of producers and evaluators of eHealth systems and services. This paper reflects on the benefits of and barriers to interdisciplinary collaboration in eHealth, focusing particularly on the relationship between software developers and health services researchers. It argues that the common pattern of silo or parallel working may be ameliorated by developing mutual awareness and respect for each others' methods, epistemologies, and contextual drivers and by recognizing and harnessing potential synergies. Similarities and differences between models and techniques used in both communities are highlighted in order to illustrate the potential for integrated approaches and the strengths of unique paradigms. By sharing information about our research approaches and seeking to actively collaborate in the process of design and evaluation, the aim of achieving technologies that are truly user-informed, fit for context, high quality, and of demonstrated value is more likely to be realized. This may involve embracing new ways of working jointly that are unfamiliar to the stakeholders involved and that challenge disciplinary conventions. It also has policy implications for agencies commissioning research and development in this area.     

Security considerations for e-mental health interventions

Security considerations are an often overlooked and underfunded aspect of the development, delivery, and evaluation of e-mental health interventions although they are crucial to the overall success of any eHealth project. The credibility and reliability of eHealth scientific research and the service delivery of eHealth interventions rely on a high standard of data security. This paper describes some of the key methodological, technical, and procedural issues that need to be considered to ensure that eHealth research and intervention delivery meet adequate security standards. The paper concludes by summarizing broad strategies for addressing the major security risks associated with eHealth interventions. These include involving information technology (IT) developers in all stages of the intervention process including its development, evaluation, and ongoing delivery; establishing a wide-ranging discourse about relevant security issues; and familiarizing researchers and providers with the security measures that must be instituted in order to protect the integrity of eHealth interventions.     

The Behavioral Intervention Technology Model: An Integrated Conceptual and Technological Framework for eHealth and mHealth Interventions

A growing number of investigators have commented on the lack of models to inform the design of behavioral intervention technologies (BITs). BITs, which include a subset of mHealth and eHealth interventions, employ a broad range of technologies, such as mobile phones, the Web, and sensors, to support users in changing behaviors and cognitions related to health, mental health, and wellness. We propose a model that conceptually defines BITs, from the clinical aim to the technological delivery framework. The BIT model defines both the conceptual and technological architecture of a BIT. Conceptually, a BIT model should answer the questions why, what, how (conceptual and technical), and when. While BITs generally have a larger treatment goal, such goals generally consist of smaller intervention aims (the "why") such as promotion or reduction of specific behaviors, and behavior change strategies (the conceptual "how"), such as education, goal setting, and monitoring. Behavior change strategies are instantiated with specific intervention components or “elements” (the "what"). The characteristics of intervention elements may be further defined or modified (the technical "how") to meet the needs, capabilities, and preferences of a user. Finally, many BITs require specification of a workflow that defines when an intervention component will be delivered. The BIT model includes a technological framework (BIT-Tech) that can integrate and implement the intervention elements, characteristics, and workflow to deliver the entire BIT to users over time. This implementation may be either predefined or include adaptive systems that can tailor the intervention based on data from the user and the user’s environment. The BIT model provides a step towards formalizing the translation of developer aims into intervention components, larger treatments, and methods of delivery in a manner that supports research and communication between investigators on how to design, develop, and deploy BITs.     

Peer-review and publication of research protocols and proposals: a role for open access journals

Peer-review and publication of research protocols offer several advantages to all parties involved. Among these are the following opportunities for authors: external expert opinion on the methods, demonstration to funding agencies of prior expert review of the protocol, proof of priority of ideas and methods, and solicitation of potential collaborators. We think that review and publication of protocols is an important role for Open Access journals. Because of their electronic form, openness for readers, and author-pays business model, they are better suited than traditional journals to ensure the sustainability and quality of protocol reviews and publications. In this editorial, we describe the workflow for investigators in eHealth research, from protocol submission to a funding agency, to protocol review and (optionally) publication at JMIR, to registration of trials at the International eHealth Study Registry (IESR), and to publication of the report. One innovation at JMIR is that protocol peer reviewers will be paid a honorarium, which will be drawn partly from a new submission fee for protocol reviews. Separating the article processing fee into a submission and a publishing fee will allow authors to opt for "peer-review only" (without subsequent publication) at reduced costs, if they wish to await a funding decision or for other reasons decide not to make the protocol public.     

A Business Analytics Software Tool for Monitoring and Predicting Radiology Throughput Performance

Business analytics (BA) is increasingly being utilised by radiology departments to analyse and present data. It encompasses statistical analysis, forecasting and predictive modelling and is used as an umbrella term for decision support and business intelligence systems. The primary aim of this study was to determine whether utilising BA technologies could contribute towards improved decision support and resource management within radiology departments. A set of information technology requirements were identified with key stakeholders, and a prototype BA software tool was designed, developed and implemented. A qualitative evaluation of the tool was carried out through a series of semi-structured interviews with key stakeholders. Feedback was collated, and emergent themes were identified. The results indicated that BA software applications can provide visibility of radiology performance data across all time horizons. The study demonstrated that the tool could potentially assist with improving operational efficiencies and management of radiology resources.     

The law of attrition

In an ongoing effort of this Journal to develop and further the theories, models, and best practices around eHealth research, this paper argues for the need for a "science of attrition", that is, a need to develop models for discontinuation of eHealth applications and the related phenomenon of participants dropping out of eHealth trials. What I call "law of attrition" here is the observation that in any eHealth trial a substantial proportion of users drop out before completion or stop using the application. This feature of eHealth trials is a distinct characteristic compared to, for example, drug trials. The traditional clinical trial and evidence-based medicine paradigm stipulates that high dropout rates make trials less believable. Consequently eHealth researchers tend to gloss over high dropout rates, or not to publish their study results at all, as they see their studies as failures. However, for many eHealth trials, in particular those conducted on the Internet and in particular with self-help applications, high dropout rates may be a natural and typical feature. Usage metrics and determinants of attrition should be highlighted, measured, analyzed, and discussed. This also includes analyzing and reporting the characteristics of the subpopulation for which the application eventually "works", ie, those who stay in the trial and use it. For the question of what works and what does not, such attrition measures are as important to report as pure efficacy measures from intention-to-treat (ITT) analyses. In cases of high dropout rates efficacy measures underestimate the impact of an application on a population which continues to use it. Methods of analyzing attrition curves can be drawn from survival analysis methods, eg, the Kaplan-Meier analysis and proportional hazards regression analysis (Cox model). Measures to be reported include the relative risk of dropping out or of stopping the use of an application, as well as a "usage half-life", and prediction models reporting demographic usage discontinuation in a population. Differential dropout or usage rates between two interventions could be a standard metric for the "usability efficacy" of a system. A "run-in and withdrawal" trial design is suggested as a methodological innovation for Internet-based trials with a high number of initial dropouts/nonusers and a stable group of hardcore users.     

Modeling the cost-effectiveness of health care systems for alcohol use disorders: how implementation of eHealth interventions improves cost-effectiveness

Background

Informing policy decisions about the cost-effectiveness of health care systems (ie, packages of clinical interventions) is probably best done using a modeling approach. To this end, an alcohol model (ALCMOD) was developed.

Objective

The aim of ALCMOD is to estimate the cost-effectiveness of competing health care systems in curbing alcohol use at the national level. This is illustrated for scenarios where new eHealth technologies for alcohol use disorders are introduced in the Dutch health care system.

Method

ALCMOD assesses short-term (12-month) incremental cost-effectiveness in terms of reductions in disease burden, that is, disability adjusted life years (DALYs) and health care budget impacts.

Results

Introduction of new eHealth technologies would substantially increase the cost-effectiveness of the Dutch health care system for alcohol use disorders: every euro spent under the current system returns a value of about the same size (€ 1.08, ie, a “surplus” of 8 euro cents) while the new health care system offers much better returns on investment, that is, every euro spent generates € 1.62 in health-related value.

Conclusion

Based on the best available evidence, ALCMOD''s computations suggest that implementation of new eHealth technologies would make the Dutch health care system more cost-effective. This type of information may help (1) to identify opportunities for system innovation, (2) to set agendas for further research, and (3) to inform policy decisions about resource allocation.     

eHealth in Latin America and the Caribbean: development and policy issues

This paper reviews trends and issues in health and in the information and communication technologies (ICT) market as they relate to the deployment of eHealth solutions in Latin America and the Caribbean. Heretofore designed for industrialized countries and large organizations, eHealth solutions are being proposed as an answer to a variety of health-system management problems and health care demands faced by all health organizations including those in developing societies. Particularly, eHealth is seen as especially useful in the operational support of the new health care models being implemented in many countries. The authors examine those developments vis-à-vis the characteristics of the Latin American and the Caribbean health-sector organizational preparedness and technological infrastructure, and propose policy and organizational actions to foster the development of eHealth solutions in the region.     

Effectiveness of eHealth Interventions and Information Needs in Palliative Care: A Systematic Literature Review

Background

One of the key components in palliative care is communication. eHealth technologies can be an effective way to support communications among participants in the process of palliative care. However, it is unclear to what extent information technology has been established in this field.

Objective

Our goal was to systematically identify studies and analyze the effectiveness of eHealth interventions in palliative care and the information needs of people involved in the palliative care process.

Methods

We conducted a systematic literature search using PubMed, Embase, and LILACS according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We collected and analyzed quantitative and qualitative data regarding effectiveness of eHealth interventions and users’ information needs in palliative care.

Results

Our search returned a total of 240 articles, 17 of which met our inclusion criteria. We found no randomized controlled trial studying the effects of eHealth interventions in palliative care. Studies tended to be observational, noncontrolled studies, and a few quasi-experimental studies. Overall there was great heterogeneity in the types of interventions and outcome assessments; some studies reported some improvement on quality of care, documentation effort, cost, and communications. The most frequently reported information need concerned pain management.

Conclusions

There is limited evidence around the effectiveness of eHealth interventions for palliative care patients, caregivers, and health care professionals. Focused research on information needs and high-quality clinical trials to assess their effectiveness are needed.