Can Evidence-Based Prevention Programs be Sustained in Community Practice Settings? The Early Risers’ Advanced-Stage Effectiveness Trial

This study evaluated institutional sustainability of the Early Risers "Skills for Success" conduct problems prevention program. In a previous early-stage effectiveness trial Early Risers had been successfully implemented by a nonprofit community agency with guidance, supervision, technical assistance and fiscal support/oversight provided by program developers. The current advanced-stage effectiveness trial applied a randomized, control group design to determine whether this community agency could replicate earlier positive findings with a new cohort of participants, but with less direct involvement of program developers. An intent-to-intervene strategy was used to compare children randomly assigned to Early Risers or a no-intervention comparison group. Compared to results obtained in an early-stage effectiveness trial, program attendance rates were much lower and only one positive outcome was replicated. Failure to replicate program effects was not attributed to poor program implementation, because data collected pertaining to exposure, adherence and quality of delivery were acceptable, and a participation analysis showed that families who attended at higher levels did benefit. It was difficulties that the community agency experienced in engaging families in program components at recommended levels that primarily accounted for the results. Possible organizational barriers that impeded sustainability included unreliable transportation, poor collaboration between the agency and the local public school system, high staff turnover, agency downsizing, and fiduciary responsibility and accountability. It was concluded that both program developers and program providers need to be proactive in planning for sustainability.     

Implementing an Evidence-Based Preventive Intervention in Neighborhood Family Centers: Examination of Perceived Barriers to Program Participation

: This study examined parents' perceived barriers to participation in a multicomponent prevention program implemented by a community agency serving culturally diverse urban neighborhoods. The Early Risers Participation Interview (ER-PI), modeled after Kadzin et al.'s (1997) Barriers to Treatment Participation Scale, was administered to parents (N = 138) of children who were screened for disruptive behavior and were randomized into a two-year intervention condition. Results showed that the perceived barriers score provided significant information in differentiating low and high participators after controlling for child, parent, and family characteristics. Early identification and resolution of parents' perceived barriers to participation may be key to implementing multifaceted preventive programs successfully in inner-city neighborhoods. EDITOR'S STRATEGIC IMPLICATIONS: The authors present promising practices for client engagement and retention. The experimental, longitudinal design is notable, especially in the evaluation of a community-run prevention program.     

A Qualitative Exploration of Co-location as an Intervention to Strengthen Home Visiting Implementation in Addressing Maternal Child Health

Objectives The aim of this paper is to explore the process and impact of co-locating evidence-based maternal and child service models to inform future implementation efforts. Methods As part of a state-wide evaluation of maternal and child home visiting programs, we conducted semi-structured interviews with administrators and home visitors from home visiting agencies across Pennsylvania. We collected 33 interviews from 4 co-located agencies. We used the Consolidated Framework for Implementation Research (CFIR) to describe the key elements mitigating implementation of multiple home visiting models. Results A primary advantage of co-location described by participants was the ability to increase the agency’s base of eligible clients through the implementation of a model with different program eligibility (e.g. income, child age) than the existing agency offering. Model differences related to curriculum (e.g. content or intensity/meeting frequency) enabled programs to more selectively match clients to models. To recruit eligible clients, new models were able to build upon the existing service networks of the initial program. Co-location provided organizational opportunities for shared trainings, enabling administrative efficiencies and collaborative staff learning. Programs implemented strategies to build synergies with complementary model features, for instance using the additional program option to serve waitlisted clients and to transition services after one model is completed. Conclusions for Practice Considerable benefits are experienced when home visiting models co-locate. This research builds on literature encouraging collaboration among community agencies and provides insight on a specific facilitative approach. This implementation strategy informs policy across the social services spectrum and competitive funding contexts.     

Dissemination of an Evidence-Based Prevention Innovation for Aggressive Children Living in Culturally Diverse, Urban Neighborhoods: The Early Risers Effectiveness Study

This study evaluated the effectiveness of the Early Risers Skills for Success Program when implemented by neighborhood family resource centers available to urban children and their families. Kindergarten and first-grade children (n=327) enrolled in 10 schools were screened for aggressive behavior, and randomized to two model variations of the Early Risers Program or a no-intervention control condition. The full-strength model (CORE + FLEX) included child and parent/family components whereas the partial model (CORE-only) offered only the child component. The intervention was delivered over two continuous years. CORE + FLEX children showed higher levels of program attendance than their CORE-only counterparts but no differences on outcomes measures were observed between models. When both program models were collapsed and compared to controls, program children showed significant gains on measures of school adjustment and social competence, the most aggressive program children showed reductions in disruptive behavior, and program parents reported reduced levels of stress.     

Is it ACT yet? real-world examples of evaluating the degree of implementation for assertive community treatment

Despite growing interest in assessment of program implementation, little is known about the best way to evaluate whether a particular program has implemented the intended service to a level that is minimally acceptable to a funding source, such as a state mental health authority. Such is the case for assertive community treatment (ACT), an evidence-based practice being widely disseminated. Using an exploratory, actuarial approach to defining program standards, this study applies different statistical criteria for determining whether or not a program meets ACT standards using the 28-item Dartmouth Assertive Community Treatment Scale. The sample consists of 51 ACT programs, 25 intensive case management programs, and 11 brokered case management programs which were compared to identify levels of fidelity that discriminated between programs, but were still attainable by the majority of ACT programs. A grading system based on mean total score for a reduced set of 21 items appeared to be most attainable, but still discriminated ACT programs from other forms of case management. Implications for setting and evaluating ACT program standards are discussed.She has now retired.     

Evidence-Based Practices in Community Mental Health: Outcome Evaluation

In 2003, questions were being raised relating to the lack of evidence-based treatments available in public mental health and whether the use of treatments found effective in research settings would be equally effective in real world situations. In response, one state passed a bill mandating a disease management model of service delivery and the use of evidence-based practices designed to obtain better clinical and functional outcomes, and to maximize the possibility for recovery for adults experiencing a serious mental illness. The purpose of this article is to provide an overview of the re-engineered public mental health system and report on findings of a longitudinal time-series study of the redesigned community mental health system. Findings of the study suggest using evidence-based practices and following a disease management model of mental health service delivery can be effective in real world settings for adults experiencing serious mental health symptoms and functional impairment.     

Non-Technical Correctives for High-Tech Systems in Social Service Agencies

Currently, expert systems are being introduced into almost every facet of social service delivery. Because this technology is sustained by computerization, many practitioners believe that objective knowledge will be available to guide program planning. 0ften overlooked, however, is the micro-world that enables computers to operate. The presuppositions associated with this micro- world provide social life with an abstract identity. Therefore, expert systems tend to be insensitive to situational exigencies and generate precise but irrelevant information. To remedy this situation, these systems must be implemented within a reflexive environment, so that they are sensitive to the logic persons use to organize their lives. Several suggestions are made pertaining to creating a reflexive social service agency.     

Financing geriatric programs in community health centers

There are approximately 600 Community and Migrant Health Centers (C/MHCs) providing preventive and primary health care services principally to medically underserved rural and urban areas across the United States. The need to develop geriatric programs within C/MHCs is clear. Less clear is how and under what circumstances a comprehensive geriatric program can be adequately financed. The Health Resources and Services Administration of the Public Health Service contracted with La Jolla Management Corporation and Duke University Center on Aging to identify successful techniques for obtaining funding by examining 10 "good practice" C/MHC geriatric programs. The results from this study indicated that effective techniques included using a variety of funding sources, maintaining accurate cost-per-user information, developing a marketing strategy and user incentives, collaborating with the area agency on aging and other community organizations, and developing special services for the elderly. Developing cost-per-user information allowed for identifying appropriate "drawing card" services, negotiating sound reimbursement rates and contracts with other providers, and assessing the financial impact of changing service mixes. A marketing strategy was used to enhance the ability of the centers to provide a comprehensive package of services. Collaboration with the area agency on aging and other community organizations and volunteers in the aging network was found to help establish referral networks and subsequently increase the number of elderly patients served. Finally, development of special services for the elderly, such as adult day care, case management, and health education, was found to increase program visibility, opportunities to work with the network of services for the aging, and clinical utilization.     

Scaling-Up Evidence-Based Programs Using a Public Funding Stream: a Randomized Trial of Functional Family Therapy for Court-Involved Youth

The Affordable Care Act expanded access to Medicaid programs and required them to provide essential health benefits, which can include prevention services. This study assesses the costs and benefits to using Medicaid funding to implement a well-known evidence-based program, Functional Family Therapy (FFT), with a sample of juvenile justice-involved youth. The study also provides a rigorous test of FFT accommodated for a contemporary urban population that is gang at risk or gang-involved. One hundred twenty-nine predominantly minority and low income families were randomly assigned to receive an enhanced version of FFT or an alternative family therapy. Data from pre- and post-intervention interviews with youth and parents, court records of contacts with the justice system and residential placements, official records of community services, and the costs of placements and services are summarized. The intervention was implemented with fidelity to the FFT model using Medicaid funding. Treatment and control subjects received a wide range of community and residential services in addition to FFT. A higher percentage of treatment subjects than controls received services following random assignment, but the cost per youth served was lower for treatment than control youth, primarily because control youth were more often placed in residential facilities. Recidivism during the 18-month follow-up period was lower for FFT than for control youth. The combination of cost savings realized from avoiding more costly services and the expected future savings due to recidivism reduction suggest the expanded use of evidence-based practices using public funding streams such as Medicaid is warranted.     

Decentralisation trends in the management of New Zealand's health services.

New Zealand is in the process of implementing major changes in the organisation and funding of its health services. Central to these changes is a largely elected area health board responsible for the funding and coordination of all services for a defined population, both public as well as non-government. Four different models of decentralisation, deconcentration (administrative), devolution (political), corporatisation (functional) and privatisation (non-government), have been used to describe and analyse these changes. There is expected to be a major devolution of powers to area health boards from central government, reversing the centralising tendencies which have occurred over the past century. Within boards a pluralistic system of service management, incorporating the above models of decentralisation, is being implemented to replace the present system of institutional administration and to give greater decision-making responsibility to health professionals, non-government agencies and community groups. These initiatives are associated with population-based funding of hospital boards complemented by service planning guidelines. Of particular importance has been the recent government decision to place the funding and management of primary health care under area health boards. However, there are serious concerns as to whether such radical changes, which could put New Zealand ahead of the rest of the world in achieving an integrated health system, can be implemented given the management expertise needed.     

Environmental strategies for primary drug abuse prevention programs

Recent funding and philosophical trends in the drug abuse field suggest the advisability of establishing locally-funded primary prevention programs as an adjunct to law enforcement and treatment efforts. Since no service agency exists in a vacuum, it becomes imperative for the administrators of such organizations to understand the environment with which they must coexist. This paper explores some of the significant interactions and problems between drug prevention agencies and those local community and political forces on whom it depends for resources like funding, clients and legitimacy. Strategies to overcome some anticipated obstacles are presented.     

A model for the integration of community-based health and social services.

This article describes a program designed by a case management organization and home health agency to improve the delivery of home care to the elderly. The results of a modified experimental-control study indicate that the cost of the services to the experimental group, who received comprehensive assessments, consolidated case management and joint monitoring, was less than the control group with an accompanying improvement in the quality of care. It is suggested that the program may be a practical model for local, community social service and health agencies seeking a way to increase continuity of care, improved quality, and reduce costs without difficult organizational and system changes.     

A Model for the Integration of Community-Based Health and Social Services

This article describes a program designed by a case management organization and home health agency to improve the delivery of home care to the elderly. The results of a modified experimental-control study indicate that the cost of the services to the experimental group, who received comprehensive assessments, consolidated case management and joint monitoring, was less than the control group with an accompanying improvement in the quality of care. It is suggested that the program may be a practical model for local, community social service and health agencies seeking a way to increase continuity of care, improved quality, and reduce costs without difficult organizational and system changes.     

社区卫生服务健康管理信息系统综述

通过社区卫生服务健康管理信息系统,建立规范化的个人、家庭及社区健康档案,形成科学、系统、完整的健康信息系统,可全面提高社区卫生服务水平,并为相关部门卫生方针政策的制定和实施提供参考。     

Adaptation and Fidelity: a Recipe Analogy for Achieving Both in Population Scale Implementation

Balancing adherence to fidelity of evidence-based programs and adaptation to local context is one of the key debates in the adoption and implementation of effective programs. Concern about maintaining fidelity to achieve outcomes can result in replication of research-based models that can be a poor fit with the real world. Equally, unplanned adaptation can result in program drift away from the core elements needed to achieve outcomes. To support implementation of the Maternal Early Childhood Sustained Home-visiting (MECSH) program in multiple sites in three countries, an analogy was developed to identify how both fidelity and adaptation can be managed and successfully achieved. This article presents the Commonsense Cookery Book Basic Plain Cake with Variations recipe analogy to articulate the dual requirements of both fidelity and adaptation to achieve quality implementation of the MECSH program. Components classified by the analogy include identification of core ingredients, methods, and equipment that contribute to fundamental outcomes and fidelity to the evidence-based program, and a planned, collaborative approach to identification of needed variations to suit locally sourced capacity, needs, and tastes. Quality is achieved by identifying and measuring the core ingredients and the variations. Sourcing local ingredients and honoring of context support sustainability of quality practice. Using this analogy has assisted adopters of the MECSH program to understand that effective implementation requires uncompromised commitment to expectations of fidelity to the core components and methods; planned, proactive adaptation; systematic monitoring of both core program and agreed variations; and local ownership and sustainability.     

Developing services for substance-abusing HIV-positive youth with mental health disorders

Models of program development have primarily focused on the internal organizational processes needed to plan, implement, and evaluate new service programs. However, creating an external demand for new programs by policy makers, administrative bureaucracies, public health officials, and funders is critical to establishing new programs. A series of deaths of seropositive youth and an absence of local service settings with staff trained to address the needs of youth living with HIV provided the impetus for Larkin Street Youth Center. In particular, the agency had to overcome stigma associated with having both substance use and mental health disorders to establish service programs to recruit and mobilize staff within the agency and the local community and to establish a comprehensive housing program for symptomatic HIV-infected adolescents. This article examines how a residential assisted care facility for HIV-seropositive adolescents was established using organizational strategic planning processes, problem solving, and social marketing frameworks.     

Consultation and education in community mental health: a historical analysis

A historical analysis of consultation and education services within community mental health centers is presented with a focus on the two major tasks that these services were intended to address:prevention andcommunity service system enhancement. This analysis begins with events that shaped the development of the initial community mental health center (CMHC) legislation, then examines key factors that influenced the nature and scope of consultation and education services as the federal CMHC program was implemented, and ends with a look at the changes that have occurred in these services since block grant funding was instituted. Throughout the analysis, central problems are discussed that have seriously hindered the development of viable consultation and education programs, and key policy, definitional and organizational issues are identified that must be addressed if these services are to become a meaningful component of the mental health service system.     

Start-up of the colorectal cancer screening demonstration program

Introduction

In 2005, the Centers for Disease Control and Prevention funded five sites to implement the Colorectal Cancer Screening Demonstration Program (CRCSDP). An evaluation is being conducted that includes a multiple case study. Case study results for the start-up period, the time between initial funding and screening initiation, provide details about the program models and start-up process and reveal important lessons learned.

Methods

The multiple case study includes all five CRCSDP sites, each representing a unique case. Data were collected from August 2005 through September 2006 from documents, observations, and more than 70 interviews with program staff and stakeholders.

Results

Sites differed by geographic service area, screening modality selected, and service delivery structure. Program models were influenced by two factors: preexisting infrastructure and the need to adapt programs to fit local service delivery structures. Several sites modeled program components after their National Breast and Cervical Cancer Early Detection Program. Medical advisory boards convened by all sites provided clinical support for developing program policies and quality assurance plans. Partnerships with comprehensive cancer control programs facilitated access to financial and in-kind resources.

Conclusion

The program models developed by the CRCSDP sites offer a range of prototypes. Case study results suggest benefits in employing a multidisciplinary staff team, assembling a medical advisory board, collaborating with local partners, using preexisting resources, designing programs that are easily incorporated into existing service delivery systems, and planning for adequate start-up time.     

An Afrocentric Program as Primary Prevention for African American Youth: Qualitative and Quantitative Exploratory Data

The need for effective preventive interventions for youth behavior problems in African American communities has been, for the most part, unmet or underserved. Rigorous evaluation of programs guided by the principles of afrocentricity may bridge the gap between primary prevention and community service programs. The purpose of the current article is to examine qualitatitve and quantitative exploratory data from an afrocentric program using the cognitive-cultural model of identity. Taken together, the results of the these exploratory studies suggested that the enhancement of cultural identity and the promotion of academic competence reduce the risk of problem behaviors in African American youth. The present article illustrates a partnership between a university researcher and a community-based agency to bring primary prevention strategies to an afrocentric program, thereby increasing its chances to attract research funding to improve and expand the services.