Low Health Literacy and Evaluation of Online Health Information: A Systematic Review of the Literature

Background

Recent years have witnessed a dramatic increase in consumer online health information seeking. The quality of online health information, however, remains questionable. The issue of information evaluation has become a hot topic, leading to the development of guidelines and checklists to design high-quality online health information. However, little attention has been devoted to how consumers, in particular people with low health literacy, evaluate online health information.

Objective

The main aim of this study was to review existing evidence on the association between low health literacy and (1) people’s ability to evaluate online health information, (2) perceived quality of online health information, (3) trust in online health information, and (4) use of evaluation criteria for online health information.

Methods

Five academic databases (MEDLINE, PsycINFO, Web of Science, CINAHL, and Communication and Mass-media Complete) were systematically searched. We included peer-reviewed publications investigating differences in the evaluation of online information between people with different health literacy levels.

Results

After abstract and full-text screening, 38 articles were included in the review. Only four studies investigated the specific role of low health literacy in the evaluation of online health information. The other studies examined the association between educational level or other skills-based proxies for health literacy, such as general literacy, and outcomes. Results indicate that low health literacy (and related skills) are negatively related to the ability to evaluate online health information and trust in online health information. Evidence on the association with perceived quality of online health information and use of evaluation criteria is inconclusive.

Conclusions

The findings indicate that low health literacy (and related skills) play a role in the evaluation of online health information. This topic is therefore worth more scholarly attention. Based on the results of this review, future research in this field should (1) specifically focus on health literacy, (2) devote more attention to the identification of the different criteria people use to evaluate online health information, (3) develop shared definitions and measures for the most commonly used outcomes in the field of evaluation of online health information, and (4) assess the relationship between the different evaluative dimensions and the role played by health literacy in shaping their interplay.     

Public access and use of health research: an exploratory study of the National Institutes of Health (NIH) Public Access Policy using interviews and surveys of health personnel

Background

In 2008, the National Institutes of Health (NIH) Public Access Policy mandated open access for publications resulting from NIH funding (following a 12-month embargo). The large increase in access to research that will take place in the years to come has potential implications for evidence-based practice (EBP) and lifelong learning for health personnel.

Objective

This study assesses health personnel’s current use of research to establish whether grounds exist for expecting, preparing for, and further measuring the impact of the NIH Public Access Policy on health care quality and outcomes in light of time constraints and existing information resources.

Methods

In all, 14 interviews and 90 surveys of health personnel were conducted at a community-based clinic and an independent teaching hospital in 2010. Health personnel were asked about the research sources they consulted and the frequency with which they consulted these sources, as well as motivation and search strategies used to locate articles, perceived level of access to research, and knowledge of the NIH Public Access Policy.

Results

In terms of current access to health information, 65% (57/88) of the health personnel reported being satisfied, while 32% (28/88) reported feeling underserved. Among the sources health personnel reported that they relied upon and consulted weekly, 83% (73/88) reported turning to colleagues, 77% (67/87) reported using synthesized information resources (eg, UpToDate and Cochrane Systematic Reviews), while 32% (28/88) reported that they consulted primary research literature. The dominant resources health personnel consulted when actively searching for health information were Google and Wikipedia, while 27% (24/89) reported using PubMed weekly. The most prevalent reason given for accessing research on a weekly basis, reported by 35% (31/88) of survey respondents, was to help a specific patient, while 31% (26/84) were motivated by general interest in research.

Conclusions

The results provide grounds for expecting the NIH Public Access Policy to have a positive impact on EBP and health care more generally given that between a quarter and a third of participants in this study (1) frequently accessed research literature, (2) expressed an interest in having greater access, and (3) were aware of the policy and expect it to have an impact on their accessing research literature in the future. Results also indicate the value of promoting a greater awareness of the NIH policy, providing training and education in the location and use of the literature, and continuing improvements in the organization of biomedical research for health personnel use.     

Cognitive Factors of Using Health Apps: Systematic Analysis of Relationships Among Health Consciousness,Health Information Orientation,eHealth Literacy,and Health App Use Efficacy

Background

Interest in smartphone health apps has been increasing recently. However, we have little understanding of the cognitive and motivational factors that influence the extent of health-app use.

Objective

This study aimed to examine the effects of four cognitive factors—health consciousness, health information orientation, eHealth literacy, and health-app use efficacy—on the extent of health-app use. It also explored the influence of two different use patterns—information and information-behavior use of health apps—with regard to the relationships among the main study variables.

Methods

We collected and analyzed 765 surveys in South Korea. According to the results, there was a negligible gender difference: males (50.6%, 387/765) and females (49.4%, 378/765). All participants were adults whose ages ranged from 19 to 59. In order to test the proposed hypotheses, we used a path analysis as a specific form of structural equation modeling.

Results

Through a path analysis, we discovered that individuals’ health consciousness had a direct effect on their use of health apps. However, unlike the initial expectations, the effects of health information orientation and eHealth literacy on health-app use were mediated by health-app use efficacy.

Conclusions

The results from the path analysis addressed a significant direct effect of health consciousness as well as strong mediating effects of health-app use efficacy. These findings contribute to widening our comprehension of the new, digital dimensions of health management, particularly those revolving around mobile technology.     

Health literacy in the eHealth era: A systematic review of the literature

ObjectivesThis study aimed to identify studies on online health service use by people with limited health literacy, as the findings could provide insights into how health literacy has been, and should be, addressed in the eHealth era.MethodsTo identify the relevant literature published since 2010, we performed four rounds of selection—database selection, keyword search, screening of the titles and abstracts, and screening of full texts. This process produced a final of 74 publications.ResultsThe themes addressed in the 74 publications fell into five categories: evaluation of health-related content, development and evaluation of eHealth services, development and evaluation of health literacy measurement tools, interventions to improve health literacy, and online health information seeking behavior.ConclusionBarriers to access to and use of online health information can result from the readability of content and poor usability of eHealth services. We need new health literacy screening tools to identify skills for adequate use of eHealth services. Mobile apps hold great potential for eHealth and mHealth services tailored to people with low health literacy.Practice implicationsEfforts should be made to make eHealth services easily accessible to low-literacy individuals and to enhance individual health literacy through educational programs.     

Toward Greater Public Health Relevance for Psychotherapeutic Intervention Research: An NIMH Workshop Report

A multidisciplinary group of experts was convened by the National Institute of Mental Health (NIMH) to discuss new opportunities in psychotherapy research. Participants agreed that more research is needed to assess stakeholders' needs, to better understand techniques commonly used in clinical practice, and to test efficacious treatments in community settings. These steps will require increased collaboration across different disciplines, development of new research methods, and a willingness for investigators to ask novel research questions. Participants outlined obstacles to conducting public health-oriented research such as the current dearth of supportive infrastructure (e.g., lack of training opportunities for new investigators), concerns about how applications for conducting new or hybrid methodologies will fare when evaluated by NIMH initial review groups, and the obvious differences in terminology used by relevant stakeholders.     

Dr Google and the Consumer: A Qualitative Study Exploring the Navigational Needs and Online Health Information-Seeking Behaviors of Consumers With Chronic Health Conditions

BackgroundThe abundance of health information available online provides consumers with greater access to information pertinent to the management of health conditions. This is particularly important given an increasing drive for consumer-focused health care models globally, especially in the management of chronic health conditions, and in recognition of challenges faced by lay consumers with finding, understanding, and acting on health information sourced online. There is a paucity of literature exploring the navigational needs of consumers with regards to accessing online health information. Further, existing interventions appear to be didactic in nature, and it is unclear whether such interventions appeal to consumers’ needs.ObjectiveOur goal was to explore the navigational needs of consumers with chronic health conditions in finding online health information within the broader context of consumers’ online health information-seeking behaviors. Potential barriers to online navigation were also identified.MethodsSemistructured interviews were conducted with adult consumers who reported using the Internet for health information and had at least one chronic health condition. Participants were recruited from nine metropolitan community pharmacies within Western Australia, as well as through various media channels. Interviews were audio-recorded, transcribed verbatim, and then imported into QSR NVivo 10. Two established approaches to thematic analysis were adopted. First, a data-driven approach was used to minimize potential bias in analysis and improve construct and criterion validity. A theory-driven approach was subsequently used to confirm themes identified by the former approach and to ensure identified themes were relevant to the objectives. Two levels of analysis were conducted for both data-driven and theory-driven approaches: manifest-level analysis, whereby face-value themes were identified, and latent-level analysis, whereby underlying concepts were identified.ResultsWe conducted 17 interviews, with data saturation achieved by the 14th interview. While we identified a broad range of online health information-seeking behaviors, most related to information discussed during consumer-health professional consultations such as looking for information about medication side effects. The barriers we identified included intrinsic barriers, such as limited eHealth literacy, and extrinsic barriers, such as the inconsistency of information between different online sources. The navigational needs of our participants were extrinsic in nature and included health professionals directing consumers to appropriate online resources and better filtering of online health information. Our participants’ online health information-seeking behaviors, reported barriers, and navigational needs were underpinned by the themes of trust, patient activation, and relevance.ConclusionsThis study suggests that existing interventions aimed to assist consumers with navigating online health information may not be what consumers want or perceive they need. eHealth literacy and patient activation appear to be prevalent concepts in the context of consumers’ online health information-seeking behaviors. Furthermore, the role for health professionals in guiding consumers to quality online health information is highlighted.     

浙江省公共卫生信息网络系统建设现状与对策

本文主要通过了解浙江省公共卫生信息网络系统建设的现状和存在的主要问题，并参考了国内外成功的经验，提出完善当前公共卫生信息网络系统的内容和策略。为科学化决策和管理提供支持。     

eHealth literacy: extending the digital divide to the realm of health information

Background

eHealth literacy is defined as the ability of people to use emerging information and communications technologies to improve or enable health and health care.

Objective

The goal of this study was to explore whether literacy disparities are diminished or enhanced in the search for health information on the Internet. The study focused on (1) traditional digital divide variables, such as sociodemographic characteristics, digital access, and digital literacy, (2) information search processes, and (3) the outcomes of Internet use for health information purposes.

Methods

We used a countrywide representative random-digital-dial telephone household survey of the Israeli adult population (18 years and older, N = 4286). We measured eHealth literacy; Internet access; digital literacy; sociodemographic factors; perceived health; presence of chronic diseases; as well as health information sources, content, search strategies, and evaluation criteria used by consumers.

Results

Respondents who were highly eHealth literate tended to be younger and more educated than their less eHealth-literate counterparts. They were also more active consumers of all types of information on the Internet, used more search strategies, and scrutinized information more carefully than did the less eHealth-literate respondents. Finally, respondents who were highly eHealth literate gained more positive outcomes from the information search in terms of cognitive, instrumental (self-management of health care needs, health behaviors, and better use of health insurance), and interpersonal (interacting with their physician) gains.

Conclusions

The present study documented differences between respondents high and low in eHealth literacy in terms of background attributes, information consumption, and outcomes of the information search. The association of eHealth literacy with background attributes indicates that the Internet reinforces existing social differences. The more comprehensive and sophisticated use of the Internet and the subsequent increased gains among the high eHealth literate create new inequalities in the domain of digital health information. There is a need to educate at-risk and needy groups (eg, chronically ill) and to design technology in a mode befitting more consumers.     

Understanding Online Health Groups for Depression: Social Network and Linguistic Perspectives

BackgroundMental health problems have become increasingly prevalent in the past decade. With the advance of Web 2.0 technologies, social media present a novel platform for Web users to form online health groups. Members of online health groups discuss health-related issues and mutually help one another by anonymously revealing their mental conditions, sharing personal experiences, exchanging health information, and providing suggestions and support. The conversations in online health groups contain valuable information to facilitate the understanding of their mutual help behaviors and their mental health problems.ObjectiveWe aimed to characterize the conversations in a major online health group for major depressive disorder (MDD) patients in a popular Chinese social media platform. In particular, we intended to explain how Web users discuss depression-related issues from the perspective of the social networks and linguistic patterns revealed by the members’ conversations.MethodsSocial network analysis and linguistic analysis were employed to characterize the social structure and linguistic patterns, respectively. Furthermore, we integrated both perspectives to exploit the hidden relations between them.ResultsWe found an intensive use of self-focus words and negative affect words. In general, group members used a higher proportion of negative affect words than positive affect words. The social network of the MDD group for depression possessed small-world and scale-free properties, with a much higher reciprocity ratio and clustering coefficient value as compared to the networks of other social media platforms and classic network models. We observed a number of interesting relationships, either strong correlations or convergent trends, between the topological properties and linguistic properties of the MDD group members.Conclusions(1) The MDD group members have the characteristics of self-preoccupation and negative thought content, according to Beck’s cognitive theory of depression; (2) the social structure of the MDD group is much stickier than those of other social media groups, indicating the tendency of mutual communications and efficient spread of information in the MDD group; and (3) the linguistic patterns of MDD members are associated with their topological positions in the social network.     

Health literacy and task environment influence parents' burden for data entry on child-specific health information: randomized controlled trial

Background

Health care systems increasingly rely on patients’ data entry efforts to organize and assist in care delivery through health information exchange.

Objectives

We sought to determine (1) the variation in burden imposed on parents by data entry efforts across paper-based and computer-based environments, and (2) the impact, if any, of parents’ health literacy on the task burden.

Methods

We completed a randomized controlled trial of parent-completed data entry tasks. Parents of children with attention deficit hyperactivity disorder (ADHD) were randomized based on the Test of Functional Health Literacy in Adults (TOFHLA) to either a paper-based or computer-based environment for entry of health information on their children. The primary outcome was the National Aeronautics and Space Administration Task Load Index (TLX) total weighted score.

Results

We screened 271 parents: 194 (71.6%) were eligible, and 180 of these (92.8%) constituted the study cohort. We analyzed 90 participants from each arm. Parents who completed information tasks on paper reported a higher task burden than those who worked in the computer environment: mean (SD) TLX scores were 22.8 (20.6) for paper and 16.3 (16.1) for computer. Assignment to the paper environment conferred a significant risk of higher task burden (F_1,178 = 4.05, P = .046). Adequate literacy was associated with lower task burden (decrease in burden score of 1.15 SD, P = .003). After adjusting for relevant child and parent factors, parents’ TOFHLA score (beta = -.02, P = .02) and task environment (beta = .31, P = .03) remained significantly associated with task burden.

Conclusions

A tailored computer-based environment provided an improved task experience for data entry compared to the same tasks completed on paper. Health literacy was inversely related to task burden.

Trial registration

Clinicaltrials.gov NCT00543257; http://www.clinicaltrials.gov/ct2/show/NCT00543257 (Archived by WebCite at http://www.webcitation.org/5vUVH2DYR)     

Children's Attitudes About Health Care: Initial Development of a Questionnaire

This study is a preliminary report of the development and initialpsychometric evaluation of a new instrument designed to measurechildren's attitudes toward health care. The Children's HealthCare Attitudes Questionnaire (CHCAQ) taps attitudes toward healthcare providers, settings, and procedures across the followingdimensions: like-dislike, attributed effectiveness-ineffectiveness,and approach-avoidance. The questionnaire incorporates nonverbalas well as verbal respon alternatives, in order to improve itssuitability for younger children. Acceptable levels of internalconsistency, test-retest reliability, and construct vaiidity(relationships with children's pain ratings) were also demonstrated.Factor-analytic findings suggest that children's attitudes clusteralong the three attitudinal dimensions, providing further evidencefor the measure's construct validity. Preliminary normativedata are presented for which significant age patterns emerged.The potential research utility of the instrument is discussed.     

Predictors of eHealth Usage: Insights on The Digital Divide From the Health Information National Trends Survey 2012

Background

Recent eHealth developments have elevated the importance of assessing the extent to which technology has empowered patients and improved health, particularly among the most vulnerable populations. With noted disparities across racial and social groups in chronic health outcomes, such as cancer, obesity, and diabetes, it is essential that researchers examine any differences in the implementation, uptake, and impact of eHealth strategies across groups that bear a disproportionate burden of disease.

Objective

The goal was to examine eHealth use by sociodemographic factors, such as race/ethnicity, socioeconomic status (SES), age, and sex.

Methods

We drew data from National Cancer Institute’s 2012 Health Information National Trends Survey (HINTS) (N=3959) which is publicly available online. We estimated multivariable logistic regression models to assess sociodemographic predictors of eHealth use among adult Internet users (N=2358) across 3 health communication domains (health care, health information–seeking, and user-generated content/sharing).

Results

Among online adults, we saw no evidence of a digital use divide by race/ethnicity. However, there were significant differences in use by SES, particularly for health care and health information–seeking items. Patients with lower levels of education had significantly lower odds of going online to look for a health care provider (high school or less: OR 0.50, 95% CI 0.33-0.76) using email or the Internet to communicate with a doctor (high school or less: OR 0.46, 95% CI 0.29-0.72), tracking their personal health information online (high school or less: OR 0.53, 95% CI 0.32-0.84), using a website to help track diet, weight, and physical activity (high school or less: OR 0.64, 95% CI 0.42-0.98; some college: OR 0.67, 95% CI 0.49-0.93), or downloading health information to a mobile device (some college: OR 0.54, 95% CI 0.33-0.89). Being female was a consistent predictor of eHealth use across health care and user-generated content/sharing domains, whereas age was primarily influential for health information–seeking.

Conclusions

This study illustrates that lower SES, older, and male online US adults were less likely to engage in a number of eHealth activities compared to their counterparts. Future studies should assess issues of health literacy and eHealth literacy and their influence on eHealth engagement across social groups. Clinical care and public health communication efforts attempting to leverage Web 2.0 and 3.0 platforms should acknowledge differential eHealth usage to better address communication inequalities and persistent disparities in health.     

Does the eHealth Literacy Scale (eHEALS) Measure What it Intends to Measure? Validation of a Dutch Version of the eHEALS in Two Adult Populations

Background

The Internet increases the availability of health information, which consequently expands the amount of skills that health care consumers must have to obtain and evaluate health information. Norman and Skinner in 2006 developed an 8-item self-report eHealth literacy scale to measure these skills: the eHealth Literacy Scale (eHEALS). This instrument has been available only in English and there are no data on its validity.

Objectives

The objective of our study was to assess the internal consistency and the construct and predictive validity of a Dutch translation of the eHEALS in two populations.

Methods

We examined the translated scale in a sample of patients with rheumatic diseases (n = 189; study 1) and in a stratified sample of the Dutch population (n = 88; study 2). We determined Cronbach alpha coefficients and analyzed the principal components. Convergent validity was determined by studying correlations with age, education, and current (health-related) Internet use. Furthermore, in study 2 we assessed the predictive validity of the instrument by comparing scores on the eHEALS with an actual performance test.

Results

The internal consistency of the scale was sufficient: alpha = .93 in study 1 and alpha = .92 in study 2. In both studies the 8 items loaded on 1 single component (respectively 67% and 63% of variance). Correlations between eHEALS and age and education were not found. Significant, though weak, correlations were found between the eHEALS and quantity of Internet use (r = .24, P = .001 and r = .24, P = .02, respectively). Contrary to expectations, correlations between the eHEALS and successfully completed tasks on a performance test were weak and nonsignificant: r = .18 (P = .09). The t tests showed no significant differences in scores on the eHEALS between participants who scored below and above median scores of the performance test.

Conclusions

The eHEALS was assessed as unidimensional in a principal component analysis and the internal consistency of the scale was high, which makes the reliability adequate. However, findings suggest that the validity of the eHEALS instrument requires further study, since the relationship with Internet use was weak and expected relationships with age, education, and actual performance were not significant. Further research to develop a self-report instrument with high correlations with people’s actual eHealth literacy skills is warranted.     

Access to Care and Use of the Internet to Search for Health Information: Results From the US National Health Interview Survey

Background

The insurance mandate of the Affordable Care Act has increased the number of people with health coverage in the United States. There is speculation that this increase in the number of insured could make accessing health care services more difficult. Those who are unable to access care in a timely manner may use the Internet to search for information needed to answer their health questions.

Objective

The aim was to determine whether difficulty accessing health care services for reasons unrelated to insurance coverage is associated with increased use of the Internet to obtain health information.

Methods

Survey data from 32,139 adults in the 2011 National Health Interview Study (NHIS) were used in this study. The exposure for this analysis was reporting difficulty accessing health care services or delaying getting care for a reason unrelated to insurance status. To define this exposure, we examined 8 questions that asked whether different access problems occurred during the previous 12 months. The outcome for this analysis, health information technology (HIT) use, was captured by examining 2 questions that asked survey respondents if they used an online health chat room or searched the Internet to obtain health information in the previous 12 months. Several multinomial logistic regressions estimating the odds of using HIT for each reported access difficulty were conducted to accomplish the study objective.

Results

Of a survey population of 32,139 adults, more than 15.90% (n=5109) reported experiencing at least one access to care barrier, whereas 3.63% (1168/32,139) reported using online health chat rooms and 43.55% (13,997/32,139) reported searching the Internet for health information. Adults who reported difficulty accessing health care services for reasons unrelated to their health insurance coverage had greater odds of using the Internet to obtain health information. Those who reported delaying getting care because they could not get an appointment soon enough (OR 2.2, 95% CI 1.9-2.5), were told the doctor would not accept them as a new patient or accept their insurance (OR 2.1, 95% CI 1.7-2.5 and OR 2.1, 95% CI 1.7-2.5, respectively), or because the doctor’s office was not open when they could go (OR 2.2, 95% CI 1.9-2.7) had more than twice the odds of using the Internet to obtain health information compared to those who did not report such access difficulties.

Conclusions

People experiencing trouble accessing health care services for reasons unrelated to their insurance status are more likely to report using the Internet to obtain health information. Improving the accuracy and reliability of health information resources that are publicly available online could help those who are searching for information due to trouble accessing health care services.     

An International Comparison of Web-based Reporting About Health Care Quality: Content Analysis

Background

On more and more websites, consumers are provided with public reports about health care. This move toward provision of more comparative information has resulted in different information types being published that often contain contradictory information.

Objective

The objective was to assess the current state of the art in the presentation of online comparative health care information and to compare how the integration of different information types is dealt with on websites. The content analysis was performed in order to provide website managers and Internet researchers with a resource of knowledge about presentation formats being applied internationally.

Methods

A Web search was used to identify websites that contained comparative health care information. The websites were systematically examined to assess how three different types of information (provider characteristics and services, performance indicators, and health care user experience) were presented to consumers. Furthermore, a short survey was disseminated to the reviewed websites to assess how the presentation formats were selected.

Results

We reviewed 42 websites from the following countries: Australia, Canada, Denmark, Germany, Ireland, the Netherlands, Norway, the United Kingdom, the United States, and Sweden. We found the most common ways to integrate different information types were the two extreme options: no integration at all (on 36% of the websites) and high levels of integration in single tables on 41% of the websites). Nearly 70% of the websites offered drill down paths to more detailed information. Diverse presentation approaches were used to display comparative health care information on the Internet. Numbers were used on the majority of websites (88%) to display comparative information.

Conclusions

Currently, approaches to the presentation of comparative health care information do not seem to be systematically selected. It seems important, however, that website managers become aware of the complexities inherent in comparative information when they release information on the Web. Important complexities to pay attention to are the use of numbers, the display of contradictory information, and the extent of variation among attributes and attribute levels. As for the integration of different information types, it remains unclear which presentation approaches are preferable. Our study provides a good starting point for Internet research to further address the question of how different types of information can be more effectively presented to consumers.     

Online alcohol interventions: a systematic review

Background

There has been a significant increase in the availability of online programs for alcohol problems. A systematic review of the research evidence underpinning these programs is timely.

Objectives

Our objective was to review the efficacy of online interventions for alcohol misuse. Systematic searches of Medline, PsycINFO, Web of Science, and Scopus were conducted for English abstracts (excluding dissertations) published from 1998 onward. Search terms were: (1) Internet, Web*; (2) online, computer*; (3) alcohol*; and (4) E\effect*, trial*, random* (where * denotes a wildcard). Forward and backward searches from identified papers were also conducted. Articles were included if (1) the primary intervention was delivered and accessed via the Internet, (2) the intervention focused on moderating or stopping alcohol consumption, and (3) the study was a randomized controlled trial of an alcohol-related screen, assessment, or intervention.

Results

The literature search initially yielded 31 randomized controlled trials (RCTs), 17 of which met inclusion criteria. Of these 17 studies, 12 (70.6%) were conducted with university students, and 11 (64.7%) specifically focused on at-risk, heavy, or binge drinkers. Sample sizes ranged from 40 to 3216 (median 261), with 12 (70.6%) studies predominantly involving brief personalized feedback interventions. Using published data, effect sizes could be extracted from 8 of the 17 studies. In relation to alcohol units per week or month and based on 5 RCTs where a measure of alcohol units per week or month could be extracted, differential effect sizes to posttreatment ranged from 0.02 to 0.81 (mean 0.42, median 0.54). Pre-post effect sizes for brief personalized feedback interventions ranged from 0.02 to 0.81, and in 2 multi-session modularized interventions, a pre-post effect size of 0.56 was obtained in both. Pre-post differential effect sizes for peak blood alcohol concentrations (BAC) ranged from 0.22 to 0.88, with a mean effect size of 0.66.

Conclusions

The available evidence suggests that users can benefit from online alcohol interventions and that this approach could be particularly useful for groups less likely to access traditional alcohol-related services, such as women, young people, and at-risk users. However, caution should be exercised given the limited number of studies allowing extraction of effect sizes, the heterogeneity of outcome measures and follow-up periods, and the large proportion of student-based studies. More extensive RCTs in community samples are required to better understand the efficacy of specific online alcohol approaches, program dosage, the additive effect of telephone or face-to-face interventions, and effective strategies for their dissemination and marketing.     

Making a Case for Treatment Integrity as a Psychosocial Treatment Quality Indicator for Youth Mental Health Care

Measures of treatment integrity are needed to advance clinical research in general and are viewed as particularly relevant for dissemination and implementation research. Although some efforts to develop such measures are underway, a conceptual and methodological framework will help guide these efforts. The purpose of this article is to demonstrate how frameworks adapted from the psychosocial treatment, therapy process, healthcare, and business literatures can be used to address this gap. We propose that components of treatment integrity (i.e., adherence, differentiation, competence, alliance, client involvement) pulled from the treatment technology and process literatures can be used as quality indicators of treatment implementation and thereby guide quality improvement efforts in practice settings. Further, we discuss how treatment integrity indices can be used in feedback systems that utilize benchmarking to expedite the process of translating evidence‐based practices to service settings.