Integrating Interventions and Services Research: Progress and Prospects

Although interventions and services research paradigms have distinct historical roots and methodologic traditions, both aim to improve mental health services for adults and youth. This article introduces a series of articles that represent examples of innovative and integrative (i.e., integration of services and interventions research) research efforts. This work involves an integration of the interventions and services research paradigms to address the difficult questions related to improving mental health services in diverse settings. Each of the four articles takes a distinctly different path in bringing together the interventions and services research traditions, with foci ranging from (a) using psychotherapy measurement tools to assess the content of usual care practice in collaboration with providers, (b) adapting randomized clinical trial design to fit nonmental healthcare settings while addressing relevant outcomes, (c) understanding and incorporating patient preferences into treatment research, and (d) identifying organization-level variables relevant to interventions development and implementation. In the introductory article, we provide a brief précis concerning the interventions and services research traditions, highlight how each of the four articles illustrates an innovative integration of interventions and services research, and discuss additional future directions beyond the work introduced in this series.     

Commentary: Studying Usual Care in Child and Adolescent Therapy: It's Anything but Routine

Efforts to enhance the quality of mental health care provided to children and youth require an understanding of the nature and impact of existing clinical services. The Practice and Research: Advancing Collaboration (PRAC) study described by Garland, Hurlburt, and Hawley (2006) is currently documenting the diverse treatment practices used in community settings. The study reflects the use of a hybrid design that integrates methods commonly used in treatment outcome and services research paradigms. This article discusses some of the key issues, directions, and challenges associated with efforts designed to enhance the quality of usual care illustrated in their article. Suggestions are made to encourage integrative investigations in the context of practice-based research networks devoted to promoting effective child and adolescent treatment.     

Youth versus parent working alliance in usual clinical care: distinctive associations with retention, satisfaction, and treatment outcome.

We investigated associations between both youth-therapist and parent-therapist alliances and retention, satisfaction, and symptom improvement among 65 youth and their parents receiving usual community-based outpatient mental health services. Parent (but not youth) alliance was significantly related to more frequent family participation, less frequent cancellations and no-shows, and greater therapist concurrence with termination decision. In contrast, youth (but not parent) alliance was significantly related to both youth and parent reports of symptom improvement. Youth and parent alliance were each significantly related to their satisfaction with services. Findings suggest that youth and parent alliance may play important but distinctive roles in the processes and outcomes of usual clinical care.     

Mental health services for rural children and adolescents

Rural children and adolescents have rates of mental disorders comparable to metropolitan youth, but face additional barriers to effective delivery of mental health care that are unique to rural areas. These barriers include transportation, communication, laws, and attitudinal issues that affect the process and structure of mental health services for rural youth. In addition, the recruitment and retention of trained professionals continues to plague mental health organizations that serve children and adolescents in rural areas. Rural communities and providers have responded by changing the structure and organization of mental health services for youth, relying more often on federal and state dollars, and focusing on noncategorical and preventive services. Rural communities have also relied more heavily on alternative types of providers for mental health services for children and adolescents while increasing efforts to retain current providers. The effectiveness of the adaptations used by rural mental health organizations is largely unknown, although most children and adolescents with mental disorders in rural areas do not receive adequate mental health services.     

Early intervention services in youth mental health

Mental and substance use disorders are leading contributors to the burden of disease among young people in Australia, but young people experience a range of barriers to accessing appropriate treatment for their mental health concerns. The development of early intervention services that provide accessible and effective mental health care has the potential to reduce the individual and community burden associated with mental health problems. Collaborative care arrangements between general practitioners, psychologists and other service providers are a key component of comprehensive and integrated early intervention services, with evidence-based psychological treatments an important part of these collaborative mental health care models. Recently, the Australian Government funded headspace (the National Youth Mental Health Foundation) to promote and support early intervention in youth mental health by establishing accessible and collaborative models of enhanced primary mental health care for young people with emergent mental and substance use disorders. Clinical psychologists in the headspace Community of Youth Service and other settings will play a key role in providing early and effective interventions within multidisciplinary collaborative care arrangements.     

What Are Young Adults Saying About Mental Health? An Analysis of Internet Blogs

Background

Despite the high prevalence of mental health concerns, few young adults access treatment. While much research has focused on understanding the barriers to service access, few studies have explored unbiased accounts of the experiences of young adults with mental health concerns. It is through hearing these experiences and gaining an in-depth understanding of what is being said by young adults that improvements can be made to interventions focused on increasing access to care.

Objective

To move beyond past research by using an innovative qualitative research method of analyzing the blogs of young adults (18–25 years of age) with mental health concerns to understand their experiences.

Methods

We used an enhanced Internet search vehicle, DEVONagent, to extract Internet blogs using primary keywords related to mental health. Blogs (N = 8) were selected based on age of authors (18–25 years), gender, relevance to mental health, and recency of the entries. Blogs excerpts were analyzed using a combination of grounded theory and consensual qualitative research methods.

Results

Two core categories emerged from the qualitative analysis of the bloggers accounts: I am powerless (intrapersonal) and I am utterly alone (interpersonal). Overall, the young adult bloggers expressed significant feelings of powerlessness as a result of their mental health concerns and simultaneously felt a profound sense of loneliness, alienation, and lack of connection with others.

Conclusions

The present study suggests that one reason young adults do not seek care might be that they view the mental health system negatively and feel disconnected from these services. To decrease young adults’ sense of powerlessness and isolation, efforts should focus on creating and developing resources and services that allow young adults to feel connected and empowered. Through an understanding of the experiences of young adults with mental health problems, and their experiences of and attitudes toward receiving care, we provide some recommendations for improving receptivity and knowledge of mental health care services.     

Integrating Decision Making and Mental Health Interventions Research: Research Directions

The importance of incorporating patient and provider decision-making processes is in the forefront of the National Institute of Mental Health (NIMH) agenda for improving mental health interventions and services. Key concepts in patient decision making are highlighted within a simplified model of patient decision making that links patient-level/"micro" variables to services-level/"macro" variables via the decision-making process that is a target for interventions. The prospective agenda for incorporating decision-making concepts in mental health research includes (a) improved measures for characterizing decision-making processes that are matched to study populations, complexity, and types of decision making; (b) testing decision aids in effectiveness research for diverse populations and clinical settings; and (c) improving the understanding and incorporation of preference concepts in enhanced intervention designs.     

Hybrid Research Models: Natural Opportunities for Examining Mental Health in Context

The articles in this series promote hybrid research models to bridge the gap between efficacy and effectiveness. We suggest that efforts such as those described in these articles are long overdue. Given the enormous public health consequences of the lack of available and effective mental health services, we no longer can afford research that neglects the natural state of affairs or that leaves others to translate research into practice. It is time to acknowledge that the process of testing interventions in the university for transfer to the community is neither efficient nor empirically justified. Guided by the articles in this series, we focus on the ways in which hybrid models can provide natural opportunities to advance the field and lead to a new generation of research that is both contextually relevant and methodologically rigorous. An iterative process of research and practice is proposed that can lead to stronger theories and methods and enhanced understanding of mental health in context.     

e-CBT (myCompass), Antidepressant Medication,and Face-to-Face Psychological Treatment for Depression in Australia: A Cost-Effectiveness Comparison

Background

The economic cost of depression is becoming an ever more important determinant for health policy and decision makers. Internet-based interventions with and without therapist support have been found to be effective options for the treatment of mild to moderate depression. With increasing demands on health resources and shortages of mental health care professionals, the integration of cost-effective treatment options such as Internet-based programs into primary health care could increase efficiency in terms of resource use and costs.

Objective

Our aim was to evaluate the cost-effectiveness of an Internet-based intervention (myCompass) for the treatment of mild-to-moderate depression compared to treatment as usual and cognitive behavior therapy in a stepped care model.

Methods

A decision model was constructed using a cost utility framework to show both costs and health outcomes. In accordance with current treatment guidelines, a stepped care model included myCompass as the first low-intervention step in care for a proportion of the model cohort, with participants beginning from a low-intensity intervention to increasing levels of treatment. Model parameters were based on data from the recent randomized controlled trial of myCompass, which showed that the intervention reduced symptoms of depression, anxiety, and stress and improved work and social functioning for people with symptoms in the mild-to-moderate range.

Results

The average net monetary benefit (NMB) was calculated, identifying myCompass as the strategy with the highest net benefit. The mean incremental NMB per individual for the myCompass group was AUD 1165.88 compared to treatment as usual and AUD 522.58 for the cognitive behavioral therapy model.

Conclusions

Internet-based interventions can provide cost-effective access to treatment when provided as part of a stepped care model. Widespread dissemination of Internet-based programs can potentially reduce demands on primary and tertiary services and reduce unmet need.     

ADHD service use patterns in youth

OBJECTIVE: To review what is currently known about service use by youth with attention-deficit/hyperactivity disorder (ADHD) and discuss research and policy implications. METHODS: Literature review. RESULTS: The primary care, mental health, and educational service system sectors all play an essential role in caring for youth with ADHD. Recent studies also suggest increasing use of stimulants and other psychoactive medication for youth with ADHD, decreasing mental health visits for ADHD unassociated with medication use, increased use of other psychotropic medications, and a number of barriers to care coordination across primary care, mental health, and schools. CONCLUSIONS: Four important services, research, and policy areas that need to be addressed over the next decade include: 1) delving deeper into current service use, 2) paying attention to the context in which service use occurs, 3) operationalizing evidence-based care for real-world settings, and 4) learning what changes clinician and educator behavior.     

A Multisite,Multidisciplinary Delphi Consensus Study Describing “Usual Care” Intervention Strategies for School-Age to Transition-Age Youth With Autism

Understanding usual care is important to reduce health disparities and improve the dissemination of evidence-based practices for youth (ages 7–22 years) with autism spectrum disorder (ASD). A barrier to describing “usual ASD care” is the lack of a common vocabulary and inventory of the practices used by a diverse provider field. To address this barrier, we gathered input from expert providers to develop an inventory of usual care practices and assess expert familiarity and perceptions of these practices as interventions for anxiety, externalizing, and social difficulties in ASD. Purposeful sampling recruited 66 expert ASD providers representing multiple disciplines from 5 sites. Via a 2-round Delphi poll, experts reviewed, suggested revisions to and rated 49 literature-derived practices on several dimensions (familiarity, usefulness, common use, research support). A revised list of 55 practices and anonymous summary of group characteristics and ratings was then returned for further review. Results yielded 55 intervention practices, 48 of which were identified as “familiar” approaches by consensus (≥ 75% endorsement). Greater variation was observed in practices identified by consensus as most often used, useful, and research supported, depending upon the target problem. Findings provide an inventory of practices, reflective of the multidisciplinary language and approaches of expert ASD providers. This inventory may be used to better assess what constitutes usual care for youth with ASD in the United States. Moreover, findings offer insights from clinical experts regarding the range and acceptability of practices that may inform and ground treatment research, dissemination, and implementation efforts.     

Evidence-based treatments for depression and anxiety versus treatment-as-usual: a meta-analysis of direct comparisons

Objective

The aim of this study was to examine the relative efficacy of evidence-based treatments (EBTs) versus treatment-as-usual (TAU) in routine care for anxiety and depression in adults.

Method

A computerized search of studies that directly compared an EBT with a TAU was conducted. Meta-analytic methods were used to estimate effectiveness of EBTs relative to TAU and to model how various confounding variables impacted the results of this comparative research.

Results

A total of 14 studies were included in the final meta-analysis. There was significant heterogeneity in the TAU conditions, which ranged from unknown and/or minimal mental health treatment to psychotherapeutic interventions provided by trained professionals. Although the effect for EBT vs. TAU was significantly greater than zero, the effect for EBT vs. TAUs that were psychotherapeutic interventions was not statistically different from zero.

Conclusions

Heterogeneity of TAU conditions in this meta-analysis highlight the importance of clarifying the research questions being asked when investigating and drawing conclusions from EBT-TAU comparisons. Researchers need to clarify if they are comparing an EBT to psychotherapeutic services in routine care or to minimal mental health services. Extant research on EBT versus TAU reveals that there is insufficient evidence to recommend the transportation of EBTs for anxiety and depression to routine care, particularly when the routine care involves psychotherapeutic services.     

Predicting patient deterioration in youth mental health services: community mental health vs. managed care settings

Objective: To examine differences across a community mental health system and a private managed care system in the accuracy of a warning system designed to identify youth at risk for deterioration in mental health services. Design: Longitudinal outcome data from the Youth Outcome Questionnaire (Y‐OQ) were examined using multilevel modeling for 2,310 youth ages 4–17 who received outpatient treatment. Results: The warning system correctly identified 69% of cases that ultimately ended in deterioration in the community mental health setting, compared to 61% in the managed care setting. The overall hit rate (overall accuracy in classifying cases as deteriorators/non‐deteriorators) was the same in the two settings (75%). Conclusions: Results are consistent with previous research demonstrating that patient‐focused warning systems can be reasonably accurate in identifying youth cases at risk for treatment failure. © 2011 Wiley Periodicals, Inc. J Clin Psychol 67:1–17, 2011.     

Postpartum psychiatric emergency visits: a nested case-control study

Mental health conditions are one of the most common reasons for postpartum emergency department (ED) visits. Characteristics of women using the ED and their mental health service use before presentation are unknown. We characterized all women in Ontario, Canada (2006–2012), who delivered a live born infant and had a psychiatric ED visit within 1 year postpartum (n?=?8728). We compared those whose ED visit was the first physician mental health contact since delivery to those who had accessed mental health services on specific indicators of marginalization hypothesized to be associated with lower likelihood of mental health contact prior to the ED visit. For 60.4 % of women, this was the first physician mental health contact since delivery. The majority were presenting with a mood or anxiety disorder, and only 13.6 % required hospital admission. These women were more likely to have material deprivation and residential instability than women with contact (Q5 vs. Q1 aORs 1.30, 95 % CI 1.12–1.50; 1.17, 95 % CI 1.01–1.36), to live in rural vs. urban areas (aOR 1.58, 95 % CI 1.38–1.80), and to be low vs. high income quintile (aOR 1.18, 95 % CI 1.01–1.38). The frequent use of ED services as the first point of contact for mental health concerns suggests that interventions to improve timely and equitable access to effective outpatient postpartum mental health care are needed. Marginalized women are at particularly high risk of not having accessed outpatient services prior to an ED visit, and therefore, future research and interventions will specifically need to consider the needs of this group.     

Trends Influencing Future Delivery of Mental Health Services in Large Healthcare Systems

The delivery of mental health services, particularly psychotherapy and other psychosocial care, is being increasingly limited by financial constraints. We briefly review three trends that will play an increasingly important role in the delivery of mental health services in large organizations such as health maintenance organizations. These are (a) an increasing role for self-help and bibliotherapy interventions, both in traditional and electronic formats; (b) mental health services being offered in settings other than mental health specialty clinics; and (c) an increased emphasis on mechanisms for improving the quality and type of services offered, including quality improvement methods and pay-for-performance.     

Mental Health Needs of Older Adults and Primary Care: Opportunity for Interdisciplinary Geriatric Team Practice

The convergence of a number of disparate factors has led to opportunities to help address the mental health needs of older adults in primary care (PC) or "integrated care" settings. Older adults are disproportionately high users of health care resources, and cost projections for coming decades have catastrophic implications. Elders shun mental health services, instead turning to their personal physicians when troubled. The PC system is clogged with patients without medical problems or whose medical conditions are exacerbated by psychosocial factors (estimated at 60% to 70%), resulting in overutilization of services and high costs. However, PC physicians detect and adequately treat or refer only 40% to 50% of patients with mental health problems. Early experience with brief and/or structured interventions in PC settings is promising and suggests opportunities for multidisciplinary team geriatric practice.     

Family preservation using multisystemic therapy: an effective alternative to incarcerating serious juvenile offenders.

Multisystemic therapy (MST) delivered through a community mental health center was compared with usual services delivered by a Department of Youth Services in the treatment of 84 serious juvenile offenders and their multiproblem families. Offenders were assigned randomly to treatment conditions. Pretreatment and posttreatment assessment batteries evaluating family relations, peer relations, symptomatology, social competence, and self-reported delinquency were completed by the youth and a parent, and archival records were searched at 59 weeks postreferral to obtain data on rearrest and incarceration. In comparison with youths who received usual services, youths who received MST had fewer arrests and self-reported offenses and spent an average of 10 fewer weeks incarcerated. In addition, families in the MST condition reported increased family cohesion and decreased youth aggression in peer relations. The relative effectiveness of MST was neither moderated by demographic characteristics nor mediated by psychosocial variables.     

Clinical trials versus mental health services research: contributions and connections

The growing emphasis on using empirical data to guide mental health policy decision making has contributed, in part, to a developing dichotomy along the continuum of research on mental health interventions. At one end of the continuum is research on the efficacy of mental health interventions, traditionally referred to as clinical trials research. The goal of clinical trials research is to determine whether or not a specific intervention can be shown to be efficacious for a specific problem. At the other end of the continuum is research on the implementation and evaluation of mental health interventions, traditionally referred to as mental health services research. The goals of mental health services research are to understand the access to, organization and financing of, and outcomes of mental health interventions. The conceptual, methodological, and measurement features of both types of research are presented and suggestions are offered to bridge the gap between the two paradigms. The purpose of this article is to highlight each discipline's unique contributions to mental health research and, in so doing, facilitate a discussion that fosters scientific integration and collaboration between clinical trials and mental health services investigators.     

Providing Interdisciplinary Geriatric Team Care: What Does It Really Take?

We concur with Speer and Schneider's arguments (2003 ; this issue) that more psychologists should offer mental health services to older adults and that the primary care system is a good focus of such efforts. Three issues deserve more prominence in their review. First, their argument that older adults are averse to mental health services seems incorrect, given research indicating that older adults prefer psychotherapy to medication for treatment of depression. Second, psychologists working in primary care need to be aware of new Current Procedural Terminology (CPT) codes that allow documentation of psychological work in medical settings. Third, Speer and Schneider allude to interdisciplinary team functioning, but provide little information about models of team care or issues in developing a well-functioning interdisciplinary team; this commentary expands on those topics.     

Evidence-based services in a statewide public mental health system: do the services fit the problems?

This study examined the degree to which a literature review of evidence-based services identified services appropriate for the actual problems of youth involved in intensive public mental health services. The diagnostic profiles and specific intervention targets reported by treatment providers were coded to determine whether a relevant empirically supported treatment was identified in the literature by the Hawaii Evidence-Based Services Committee for each problem. Of the 2,197 youth with diagnostic information available, 721 youth (33%) had a pure diagnosis for which an evidence-based service was identified in the literature, and 1,953 youth (89%) had a primary diagnosis with a relevant evidence-based service. Of the 1,220 youth with treatment target information, 1,094 (90%) had 1 or more problem areas targeted for intervention with an identified evidence-based service; thus, the vast majority of youth receiving intensive public mental services experienced a mental health difficulty for which an evidence-based service was identified through a review of the empirical literature. Nevertheless, many youth had additional problems for which evidence-based services have not yet been identified through research.