Measuring the success of community science: the northern California Household Exposure Study

Background: Environmental health research involving community participation has increased substantially since the National Institute of Environmental Health Sciences (NIEHS) environmental justice and community-based participatory research (CBPR) partnerships began in the mid-1990s. The goals of these partnerships are to inform and empower better decisions about exposures, foster trust, and generate scientific knowledge to reduce environmental health disparities in low-income, minority communities. Peer-reviewed publication and clinical health outcomes alone are inadequate criteria to judge the success of projects in meeting these goals; therefore, new strategies for evaluating success are needed.Objectives: We reviewed the methods used to evaluate our project, “Linking Breast Cancer Advocacy and Environmental Justice,” to help identify successful CBPR methods and to assist other teams in documenting effectiveness. Although our project precedes the development of the NIEHS Evaluation Metrics Manual, a schema to evaluate the success of projects funded through the Partnerships in Environmental Public Health (PEPH), our work reported here illustrates the record keeping and self-reflection anticipated in NIEHS’s PEPH.Discussion: Evaluation strategies should assess how CBPR partnerships meet the goals of all partners. Our partnership, which included two strong community-based organizations, produced a team that helped all partners gain organizational capacity. Environmental sampling in homes and reporting the results of that effort had community education and constituency-building benefits. Scientific results contributed to a court decision that required cumulative impact assessment for an oil refinery and to new policies for chemicals used in consumer products. All partners leveraged additional funding to extend their work.Conclusions: An appropriate evaluation strategy can demonstrate how CBPR projects can advance science, support community empowerment, increase environmental health literacy, and generate individual and policy action to protect health.     

Conceptual model of comprehensive research metrics for improved human health and environment

OBJECTIVE: Federal, state, and private research agencies and organizations have faced increasing administrative and public demand for performance measurement. Historically, performance measurement predominantly consisted of near-term outputs measured through bibliometrics. The recent focus is on accountability for investment based on long-term outcomes. Developing measurable outcome-based metrics for research programs has been particularly challenging, because of difficulty linking research results to spatially and temporally distant outcomes. Our objective in this review is to build a logic model and associated metrics through which to measure the contribution of environmental health research programs to improvements in human health, the environment, and the economy. DATA SOURCES: We used expert input and literature research on research impact assessment. DATA EXTRACTION: With these sources, we developed a logic model that defines the components and linkages between extramural environmental health research grant programs and the outputs and outcomes related to health and social welfare, environmental quality and sustainability, economics, and quality of life. DATA SYNTHESIS: The logic model focuses on the environmental health research portfolio of the National Institute of Environmental Health Sciences (NIEHS) Division of Extramural Research and Training. The model delineates pathways for contributions by five types of institutional partners in the research process: NIEHS, other government (federal, state, and local) agencies, grantee institutions, business and industry, and community partners. CONCLUSIONS: The model is being applied to specific NIEHS research applications and the broader research community. We briefly discuss two examples and discuss the strengths and limits of outcome-based evaluation of research programs.     

The NIEHS Environmental Health Sciences Data Resource Portal: placing advanced technologies in service to vulnerable communities

BACKGROUND: Two devastating hurricanes ripped across the Gulf Coast of the United States during 2005. The effects of Hurricane Katrina were especially severe: the human and environmental health impacts on New Orleans, Louisiana, and other Gulf Coast communities will be felt for decades to come. The Federal Emergency Management Agency (FEMA) estimates that Katrina's destruction disrupted the lives of roughly 650,000 Americans. Over 1,300 people died. The projected economic costs for recovery and reconstruction are likely to exceed $125 billion. OBJECTIVES: The NIEHS (National Institute of Environmental Health Sciences) Portal aims to provide decision makers with the data, information, and the tools they need to a) monitor human and environmental health impacts of disasters; b) assess and reduce human exposures to contaminants; and c) develop science-based remediation, rebuilding, and repopulation strategies. METHODS: The NIEHS Portal combines advances in geographic information systems (GIS), data mining/integration, and visualization technologies through new forms of grid-based (distributed, web-accessible) cyberinfrastructure. RESULTS: The scale and complexity of the problems presented by Hurricane Katrina made it evident that no stakeholder alone could tackle them and that there is a need for greater collaboration. The NIEHS Portal provides a collaboration-enabling, information-laden base necessary to respond to environmental health concerns in the Gulf Coast region while advancing integrative multidisciplinary research. CONCLUSIONS: The NIEHS Portal is poised to serve as a national resource to track environmental hazards following natural and man-made disasters, focus medical and environmental response and recovery resources in areas of greatest need, and function as a test bed for technologies that will help advance environmental health sciences research into the modern scientific and computing era.     

Toward the Assessment of Scientific and Public Health Impacts of the National Institute of Environmental Health Sciences Extramural Asthma Research Program Using Available Data

Background

In the past 15 years, asthma prevalence has increased and is disproportionately distributed among children, minorities, and low-income persons. The National Institute of Environmental Health Sciences (NIEHS) Division of Extramural Research and Training developed a framework to measure the scientific and health impacts of its extramural asthma research to improve the scientific basis for reducing the health effects of asthma.

Objectives

Here we apply the framework to characterize the NIEHS asthma portfolio’s impact in terms of publications, clinical applications of findings, community interventions, and technology developments.

Methods

A logic model was tailored to inputs, outputs, and outcomes of the NIEHS asthma portfolio. Data from existing National Institutes of Health (NIH) databases are used, along with publicly available bibliometric data and structured elicitation of expert judgment.

Results

NIEHS is the third largest source of asthma-related research grant funding within the NIH between 1975 and 2005, after the National Heart, Lung, and Blood Institute and the National Institute of Allergy and Infectious Diseases. Much of NIEHS-funded asthma research focuses on basic research, but results are often published in journals focused on clinical investigation, increasing the likelihood that the work is moved into practice along the “bench to bedside” continuum. NIEHS support has led to key breakthroughs in scientific research concerning susceptibility to asthma, environmental conditions that heighten asthma symptoms, and cellular mechanisms that may be involved in treating asthma.

Conclusions

If gaps and limitations in publicly available data receive adequate attention, further linkages can be demonstrated between research activities and public health improvements. This logic model approach to research impact assessment demonstrates that it is possible to conceptualize program components, mine existing databases, and begin to show longer-term impacts of program results. The next challenges will be to modify current data structures, improve the linkages among relevant databases, incorporate as much electronically available data as possible, and determine how to improve the quality and health impact of the science that we support.     

Community-based participatory research as a tool to advance environmental health sciences

The past two decades have witnessed a rapid proliferation of community-based participatory research (CBPR) projects. CBPR methodology presents an alternative to traditional population-based biomedical research practices by encouraging active and equal partnerships between community members and academic investigators. The National Institute of Environmental Health Sciences (NIEHS), the premier biomedical research facility for environmental health, is a leader in promoting the use of CBPR in instances where community-university partnerships serve to advance our understanding of environmentally related disease. In this article, the authors highlight six key principles of CBPR and describe how these principles are met within specific NIEHS-supported research investigations. These projects demonstrate that community-based participatory research can be an effective tool to enhance our knowledge of the causes and mechanisms of disorders having an environmental etiology, reduce adverse health outcomes through innovative intervention strategies and policy change, and address the environmental health concerns of community residents.     

Strategies for setting a national research agenda that is responsive to community needs

Setting a national environmental health research agenda requires broad public input, including that from leading scientists, health care professionals, and communities. Contributions from these diverse constituencies are essential to formulating a research and education strategy that both advances our understanding of the causes and mechanisms of environmentally related diseases and translates such findings into effective prevention and clinical applications to protect those most affected by adverse environmental exposures. Given the increasing number of individual researchers working with communities to address environmental health needs during the past decade, it is also essential for research institutions to foster relationships with communities to understand and respond to their unique public health needs, as well as to communicate research advances in a manner that is both understandable and culturally appropriate. To achieve broad public input and to foster community-university partnerships, the National Institute of Environmental Health Sciences (NIEHS) supports various workshops, roundtables, and advisory groups. In particular, the NIEHS finds Town Meetings to be a successful model for bringing academic researchers together with community residents, state and local departments of health, and community-based organizations to foster greater awareness of community needs, public health needs, and environmental health science research. Since 1998, the NIEHS has supported 16 Town Meetings across the country. In this article we highlight the major outcomes of these meetings to demonstrate the effectiveness of this mechanism for enhancing cooperation among researchers, community residents, and public health officials with the goal of improving public health and setting a national research agenda.     

Social Science Collaboration with Environmental Health

Background

Social science research has been central in documenting and analyzing community discovery of environmental exposure and consequential processes. Collaboration with environmental health science through team projects has advanced and improved our understanding of environmental health and justice.

Objective

We sought to identify diverse methods and topics in which social scientists have expanded environmental health understandings at multiple levels, to examine how transdisciplinary environmental health research fosters better science, and to learn how these partnerships have been able to flourish because of the support from National Institute of Environmental Health Sciences (NIEHS).

Methods

We analyzed various types of social science research to investigate how social science contributes to environmental health. We also examined NIEHS programs that foster social science. In addition, we developed a case study of a community-based participation research project in Akwesasne in order to demonstrate how social science has enhanced environmental health science.

Results

Social science has informed environmental health science through ethnographic studies of contaminated communities, analysis of spatial distribution of environmental injustice, psychological experience of contamination, social construction of risk and risk perception, and social impacts of disasters. Social science–environmental health team science has altered the way scientists traditionally explore exposure by pressing for cumulative exposure approaches and providing research data for policy applications.

Conclusions

A transdisciplinary approach for environmental health practice has emerged that engages the social sciences to paint a full picture of the consequences of contamination so that policy makers, regulators, public health officials, and other stakeholders can better ameliorate impacts and prevent future exposure.

Citation

Hoover E, Renauld M, Edelstein MR, Brown P. 2015. Social science collaboration with environmental health. Environ Health Perspect 123:1100–1106; http://dx.doi.org/10.1289/ehp.1409283     

Size characteristics of larger academic human environmental health programs in the United States.

We have performed a benchmark exercise evaluating larger academic programs in human environmental health sciences. These programs are located at schools of public health and at other institutions that have NIEHS Centers of Excellence. The largest programs were those in which there was both an NIEHS center and a public health graduate education program. This suggests that there is synergy between environmental health sciences research and involvement in public and community health.     

Evaluating Floyd's effect on health in eastern North Carolina

Since the now-famous storm of September 1999, the name "Floyd" has taken on new associations for many people in eastern North Carolina: devastation and environmental catastrophe. On 12 November 1999, representatives from state and federal agencies and local universities met on the NIEHS campus in Research Triangle Park, North Carolina, to discuss the environmental health implications of the floods following Hurricane Floyd. In addition to determining the potential long-term human health and ecological problems, participants hoped to develop strategies, collaborations, and partnerships to be used in the restoration of eastern North Carolina.     

Indigenous Peoples of North America: Environmental Exposures and Reproductive Justice

Background: Indigenous American communities face disproportionate health burdens and environmental health risks compared with the average North American population. These health impacts are issues of both environmental and reproductive justice.Objectives: In this commentary, we review five indigenous communities in various stages of environmental health research and discuss the intersection of environmental health and reproductive justice issues in these communities as well as the limitations of legal recourse.Discussion: The health disparities impacting life expectancy and reproductive capabilities in indigenous communities are due to a combination of social, economic, and environmental factors. The system of federal environmental and Indian law is insufficient to protect indigenous communities from environmental contamination. Many communities are interested in developing appropriate research partnerships in order to discern the full impact of environmental contamination and prevent further damage.Conclusions: Continued research involving collaborative partnerships among scientific researchers, community members, and health care providers is needed to determine the impacts of this contamination and to develop approaches for remediation and policy interventions.