A review of five major community-based cardiovascular disease prevention programs. Part I: Rationale, design, and theoretical framework

Major community-based cardiovascular disease prevention programs have been conducted in North Karelia, Finland; the state of Minnesota; Pawtucket, Rhode Island; and in three communities and more recently in five cities near Stanford, California. These primary prevention programs aim to reduce cardiovascular disease incidence by reducing risk factors in whole communities. These risk factors are smoking, high blood cholesterol, diet high in cholesterol and saturated fat, hypertension, sedentary lifestyle, and obesity. This strategy may be contrasted with secondary prevention programs directed at patients who already have symptomatic cardiovascular disease and "high risk" primary prevention programs directed at individuals found through screening to have one or more risk factors. The design of the five major programs is similar in that intervention communities are matched for purposes of evaluation with nearby comparison communities. Underlying these programs are theories of community health education, social learning, communication, social marketing, and community activation, as well as more traditional biomedical and public health disciplines. This is Part I of a two-part article.     

A framework for evaluating community-based heart disease prevention programs

This paper reviews issues that arise in the evaluation of community-based heart disease prevention programs and offers suggestions for improving future evaluations of these programs. A framework encompassing the evaluation of process, impact and social relevance guides this discussion. The goal of the framework is to divide the question, "do community-based health programs work?", into more easily answered evaluation questions. In doing so, interventions that promote the health of community residents are likely to be designed and implemented successfully.     

Impact of community health workers on access, use of services, and patient knowledge and behavior

Community health workers have been used in health centers for several decades. Known by various names (e.g., community health advisors, outreach workers, promotoras), they are trusted community members providing informal community-based health-related services and establishing vital links between health providers and the community. They perform many functions, including outreach and case finding, health education, translation, patient transportation, and case management (under the supervision of a nurse or social worker). This article, based on a study of community health worker programs at seven sites, is intended to share the lessons learned that could be helpful to other program managers and to examine the outcomes of such programs.     

Program evaluation strategies for community-based health promotion programs: perspectives from the cardiovascular disease community research and demonstration studies

Community-based programs are being widely adopted in the struggle to prevent chronic disease. Program evaluation of community-based programs involves a particular set of problems stemming from the variety of activities being undertaken simultaneously, the multiple intermediate goals of the programs and the rapidity with which the programs evolve. An analysis of the experience of four large community-based cardiovascular disease research and demonstration studies (Stanford Five-City Project, Minnesota Heart Health Program, Pawtucket Heart Health Program and the German Cardiovascular Prevention Project) provides valuable models, methodologies and strategies for planning and conducting evaluations of public health programs or community studies. By comparing and combining their experiences, the four programs have identified eight categories of evaluation for community studies, including formative evaluation, quality assurance, assessment of delivered dose, assessment of received dose, component program impact, intermediate outcomes, community impact and cost analysis. This paper presents information on the strategies by which each of the four programs addressed these evaluation categories.     

EVALUATING COMMUNITY DEVELOPMENT PROGRAMS FOR HEALTH PROMOTION: PROBLEMS ILLUSTRATED BY A NEW ZEALAND EXAMPLE

This paper illustrates problems in the evaluation of community development programs for health promotion. It is based on the authors' retrospective process evaluation of the Wanganui Community Alcohol Action Program (WCAAP), a recent example of a health promotion program directed at reducing alcohol-related problems in a small New Zealand town. Described by its designers as a community-based program, it included coordination of community organizations, education, publicity and increased enforcement of drinking laws. Discussion of the problems in the evaluation of such programs puts them within the context of the substantial body of previous social science research in both evaluation and community development. This, it is argued, is a body of knowledge with which health promotion researchers need to be conversant. Community development programs usually stem from a process of negotiation between interest groups with differing objectives. This results in a changing definition of both the problem to be solved and the nature of the solution, making evaluation difficult. Community development is also likely to be seen as a new solution providing a panacea for old problems. This can lead to such programs being too ambitious. From the point of view of experimental design these programs are likely to have a number of technical problems. This paper argues that these problems are so significant that it is often unwise to attempt large scale evaluations of community development programs. Rather, attention should be concentrated on critically assessing the policy-making process and disseminating previous knowledge about such programs.     

Year one of HIV prevention community planning: a national perspective on accomplishments, challenges, and future directions.

Two of the most important principles for the implementation of successful human immunodeficiency virus (HIV) prevention programs are the following: (a) planning for the programs must be done in conjunction with members of affected communities; and (b) the foundation of the programs should consist of solid behavioral, social, and epidemiological science. In 1994, the Centers for Disease Control and Prevention and its prevention partners formally implemented HIV prevention community planning in order to address these two key factors. The occasion of the one year anniversary of HIV prevention community planning is marked by taking stock of progress-to-date from a national perspective. This article reviews year one accomplishments and difficulties, and describes the trajectory of HIV prevention community planning for year two and beyond.     

Social Networks and Community Prevention Coalitions

This study investigates the links between community readiness and the social networks among participants in Communities That Care (CTC), community-based prevention coalitions. The coalitions targeted adolescent behavior problems through community risk factor assessments, prioritization of risk factors, and selection/implementation of corresponding evidence-based family, school, and community programs. Key leaders (n = 219) in 23 new CTC sites completed questionnaires focusing on community readiness to implement CTC and the respondents’ personal, work, and social organization links to other key leaders in the community. Outside technical assistants also completed ratings of each community’s readiness and early CTC functioning. Measures of network cohesion/integration were positively associated with readiness, while centralization was negatively associated. These results suggest that non-centralized networks in which ties between members are close and direct may be an indicator of community readiness. In addition, we found different associations between readiness and different domains of social relations. Editors’ Strategic Implications: The authors present the promising practice of using social network analysis to characterize the functioning of local prevention coalitions and their readiness to implement a community-based prevention initiative. Researchers and community planners will benefit from the lessons in this article, which capitalizes on a large sample and multiple informants. This work raises interesting questions about how to combine the promotion of coalition functioning while simultaneously encouraging diversity of coalition membership.     

Girl World: a primary prevention program for Mexican American girls

Theories about women's health have not traditionally been extended to include the healthy development of young women. This article applies a women's health perspective to the implementation and evaluation processes of a gender-specific primary prevention program that worked with 9- to 14-year-old Hispanic girls in a low-income community. Although community-based after-school programs can be an important venue for education and girls' development, long-term effects are elusive to evaluate. The authors used ethnographic techniques to learn more about girls and their interactions with the program and to assess short-term program impact. Three themes were found: Program environment can contribute to girls' expression and behavior, issues of struggling families can slide girls into early adulthood, and mentoring can benefit both girls and adult women. Community-based primary prevention programs, although an essential part of a social safety net available to low-income girls, provide researchers with a unique set of evaluation challenges.     

An Afrocentric Program as Primary Prevention for African American Youth: Qualitative and Quantitative Exploratory Data

The need for effective preventive interventions for youth behavior problems in African American communities has been, for the most part, unmet or underserved. Rigorous evaluation of programs guided by the principles of afrocentricity may bridge the gap between primary prevention and community service programs. The purpose of the current article is to examine qualitatitve and quantitative exploratory data from an afrocentric program using the cognitive-cultural model of identity. Taken together, the results of the these exploratory studies suggested that the enhancement of cultural identity and the promotion of academic competence reduce the risk of problem behaviors in African American youth. The present article illustrates a partnership between a university researcher and a community-based agency to bring primary prevention strategies to an afrocentric program, thereby increasing its chances to attract research funding to improve and expand the services.     

Improving service delivery: provider perspectives on building community-based systems of care

This article examines the views of service providers toward different public policy efforts to improve service delivery to elders requiring multiple services from an array of organizations. The authors examine the relationship between provider assessments of the adequacy of their community-based systems of care and community resource levels, coordination strategies, and client characteristics. Findings, based on responses from managers of programs serving older adults (n = 250) to a mailed survey, were that two-thirds (69.4%) evaluated their service delivery systems as adequate or better. A regression model used to explain system adequacy indicated that 22% of the variance was accounted for by community resource level, information and service availability, attention to specific need clients, and percentage of minority clients served by the respondents' programs. Findings suggest that community resource level appears to be an important factor in respondents' evaluation of system adequacy. While respondents indicated that improved coordination could enhance their efforts to deliver services, this strategy was not one they favored in improving their community-based system of care. Instead, they preferred strategies which expanded or improved the services that were available.     

Environmental indicators: a tool for evaluating community-based health-promotion programs.

We propose using a class of community-level measures--environmental indicators--as part of the evaluation of community-based health-promotion programs. Community-level measures of health-related behavior can be divided into three conceptual categories. The first two categories comprise statistical aggregates (e.g., means, sums, percentages) of measurements made on individuals, distinguished by whether individual-level covariates are also available. Individual-disaggregated measures include covariates, such as a comprehensive survey of health-risk behavior, including demographic information; individual-aggregated measures, such as sales data, do not. Our main focus is on the third category, environmental indicators, derived from observations of the community environment. Environmental indicators measures aspects of the physical, legal, social, and economic environment in a community that reflect, and likely influence, the attitudes and behavior of individual community members. They also measure an important intermediate step in community-based health-promotion interventions, namely environmental factors that programs target to modify individual attitudes and behavior. We present examples of environmental indicators for tobacco use and diet.     

Promising community-level indicators for evaluating cardiovascular health-promotion programs

Rigorous evaluation of community-based programs can be costly, particularly when a representative sample of all members of the community are surveyed in order to assess the impact of a program on individual health behavior. Community-level indicators (CLIs), which are based on observations of aspects of the community other than those associated with individuals, may serve to supplement individual-level measures in the evaluation of community-based programs or in some cases provide a lower-cost alternative to individual-level measures. Because they are often based on observations of the community environment, CLIs also provide a way of measuring environmental changes--often an intermediate goal of community-based programs. The Centers for Disease Control and Prevention convened a panel of experts knowledgeable about community-based program evaluation and cardiovascular disease (CVD) prevention to develop a list of CLIs, and rate their feasibility, reliability and validity. The indicators developed by the panel covered tobacco use, physical activity, diet and a fourth group that were considered 'cross-cutting' because they related to all three behaviors. The indicators were subdivided into policy and regulation, information, environmental change, and behavioral outcome. For example, policy and regulation indicators included laws and ordinances on tobacco use, policies on physical education, and guidelines for menu and food preparation. These indicators provide a good starting point for communities interested in tracking CVD-related outcomes at the community level.     

The Kaiser Family Foundation Community Health Promotion Grants Program: findings from an outcome evaluation

OBJECTIVES: To present results from an outcome evaluation of the Henry J. Kaiser Family Foundation's Community Health Promotion Grants Program (CHPGP) in the West, which represented a major community-based initiative designed to promote improved health by changing community norms, environmental conditions, and individual behavior in 11 western communities. METHODS: The evaluation design: 14 randomly assigned intervention and control communities, 4 intervention communities selected on special merit, and 4 matched controls. Data for the outcome evaluation were obtained from surveys, administered every two years at three points in time, of community leaders and representative adults and adolescents, and from specially designed surveys of grocery stores. Outcomes for each of the 11 intervention communities were compared with outcomes in control communities. RESULTS: With the exception of two intervention communities-a largely Hispanic community and a Native American reservation-we found little evidence of positive changes in the outcomes targeted by the 11 intervention communities. The programs that demonstrated positive outcomes targeted dietary behavior and adolescent substance abuse. CONCLUSIONS: Improvement of health through community-based interventions remains a critical public health challenge. The CHPGP, like other prominent community-based initiatives, generally failed to produce measurable changes in the targeted health outcomes. Efforts should focus on developing theories and methods that can improve the design and evaluation of community-based interventions.     

Perinatal Periods of Risk: A Community Approach for Using Data to Improve Women and Infants’ Health

This paper provides an overview of the origins, purpose, and methods of the Perinatal Periods of Risk (PPOR) approach to community-based planning for action to improve maternal and infant health outcomes. PPOR includes a new analytic framework that enables urban communities to better understand and address fetal and infant mortality. This article serves as the core reference for accompanying specific PPOR methods and practice articles. PPOR is based on core principles of full community engagement and equity and follows a six stage community-based planning process. In Stage 1, communities are mobilized and engaged, related planning efforts aligned, and community and analytic readiness assessed. In Stage 2, feto-infant mortality is mapped, excess mortality is estimated, likely causes of feto-infant mortality are determined, and appropriate actions are suggested. Stage 3 produces action plans for targeted prevention strategies. Stages 4 and 5 include implementation, monitoring, and evaluation. Stage 6 fosters political will to sustain efforts. PPOR can be used in local maternal child health (MCH) practice for improving perinatal outcomes. MCH programs can use PPOR to integrate health assessments, initiate planning, identify significant gaps, target more in-depth inquiry, and suggest clear interventions for lowering feto-infant mortality. PPOR enables greater cooperation in improving MCH through more effective data use, strengthened data capacity, and greater shared understanding of complex infant mortality issues. PPOR offers local health departments and their community partners a comprehensive approach to address the health of women and infants in their jurisdictions.     

Applying logics of change to the evaluation of community development in health promotion

Evaluation of community-oriented health promotion programs requirethat professional evaluators clearly distinguish between exogenouslyand endogenously defined goals and definitions of ‘success’.Acknowledging the different dynamics which underpin community-ledchange and externally initiated health programs and interventionsis essential to this task. It will be argued that the intersectionof, and boundaries around, exogenous and endogenous change canbest be understood and clarified through the application of‘logics of rationality’, adapted from social theory.Community activity is characterised by what we have called ‘lifeworldrationality’ community-based health promotion interventionsare characterised by ‘formal ratonality’. In addition,we suggest that the value dimensions (‘substantive rationality’)underpinning programs and interventions may be overlooked bypolicy makers, program planners and professional evaluatorsunder pressure to demonstrate cost-effectiveness and efficiency.Key requirements for successful and appropriate evaluation ofcommunity-based programs which are sensitive to the needs andsuccess criteria of communities include a shared understandingby the researchers, program sponsors and community actors ofthe nature of the changes sought. The co-production of healthpromotion standards and of indicators to judge the performanceof the program or intervention by all stakeholders should bepreferred over the trend for establishing community-controlledprocess evaluations to coexist alongside expert-controlled impactevaluations. It is argued that current approaches to standardsetting and indicator development to judge the processes andimpacts of interventions are inadequate and several principlesfor improving their content are given. A locally controlledethnographic approach to evaluate endogenous community-led changeis described in the hope that program planners and evaluatorsmay become more sensitive and receptive to local knowledge.We suggest that engagement with what we have termed the ‘communitystory’ should be a fundamental requirement for the planningand evaluation of community health programs.     

Community-based prevention marketing: organizing a community for health behavior intervention

This article describes the application and refinement of community-based prevention marketing (CBPM), an example of community-based participatory research that blends social marketing theories and techniques and community organization principles to guide voluntary health behavior change. The Florida Prevention Research Center has worked with a community coalition in Sarasota County, Florida to define locally important health problems and issues and to develop responsive health-promotion interventions. The CBPM framework has evolved as academic and community-based researchers have gained experience applying it. Community boards can use marketing principles to design evidence-based strategies for addressing local public health concerns. Based on 6 years of experience with the "Believe in All Your Possibilities" program, lessons learned that have led to revision and improvement of the CBPM framework are described.     

Evaluation issues and strategies for community-based organizations developing women's HIV prevention programs

This article discusses issues and strategies for program evaluation particularly useful for community-based organizations (CBOs) involved in the development and implementation of HIV preventing programs for women. The approach the authors present is an extension of a traditional public health paradigm suggested for use in the development and evaluation of violence prevention programs. This study incorporates Becker's Health Belief Model, which provides a framework for viewing the influence of various psychosocial variables on health-related behavior, into this development and evaluation paradigm. Factors influencing the successful development and evaluation of HIV prevention programs for women are reviewed and discussed. The purpose of this article is to provide some guidance to CBOs to strengthen their evaluation strategies and to encourage their use of evaluation during all phases of program development and implementation.     

Writing community-centered evaluation reports

Documenting the process, results, impact, and effectiveness of community-based health promotion programs is an important part of any evaluation. This article provides information on how to write community-centered evaluation reports for program stake-holders. Specific prerequisites and principles are provided. In addition, several tips for increasing the use of the results are highlighted.     

Strategies for Community/School Collaborations to Prevent Youth Substance Abuse

Within communities across the United States, collaborations have developed between community-based organizations (CBOs) and schools to plan and implement unified approaches to prevent youth substance abuse. This article describes challenges and workable strategies reported by a diverse group of 11 community-based organizations (CBOs) for developing and maintaining collaborative relationships with schools. Strategies recommended by CBOs for effective CBO/school collaborations are described within four categories: (1) establishing the collaboration; (2) maintaining cooperation with schools during program implementation; (3) addressing cultural issues; and (4) institutionalizing the collaborative programs. The need to tailor community prevention efforts to the specific context of each community is emphasized.     

Principles for Developing Interdisciplinary School-based Primary Care Centers

ABSTRACT: A 50% increase has occurred in the number of school-based primary care centers (SBPCCs) in the United States since 1993-94. Public schools offer a well-established and respected community-based infrastructure within which health centers may feasibly be developed. SBPCCs have documented improved access to care for underserved children and some initial success in addressing the complex morbidities and associated behavioral risk factors of children and adolescents. This paper presents five working principles to help communities establish SBPCCs that link community health and social services with their educational system. The principles encompass community participation, early assessment of community needs, integration of health and human services with educational services through an interdisciplinary and interagency team approach, development of a business plan, and program evaluation. These principles reflect the experiences of 22 Texas communities which operate 76 SBPCCs. They should prove helpful to many other communities and states that propose to develop, finance, and evaluate school-based, interdisciplinary health care and prevention services.