Evidence-based public health: an evolving concept

Evidence-based public health (EBPH) has been proposed as a practice model that builds upon the success of evidence-based medicine (EBM). EBM has been described as a more scientific and systematic approach to the practice of medicine. It has enhanced medical training and practice in many settings. Both EBM and EBPH systematically use data, information, and scientific principles to enhance clinical care and population health, respectively. In this paper, we review the evolution of EBPH, propose a new definition for EBPH, and discuss developments that may support its further advancement.     

An Evidence-Based Public Health Approach to Climate Change Adaptation

Background: Public health is committed to evidence-based practice, yet there has been minimal discussion of how to apply an evidence-based practice framework to climate change adaptation.Objectives: Our goal was to review the literature on evidence-based public health (EBPH), to determine whether it can be applied to climate change adaptation, and to consider how emphasizing evidence-based practice may influence research and practice decisions related to public health adaptation to climate change.Methods: We conducted a substantive review of EBPH, identified a consensus EBPH framework, and modified it to support an EBPH approach to climate change adaptation. We applied the framework to an example and considered implications for stakeholders.Discussion: A modified EBPH framework can accommodate the wide range of exposures, outcomes, and modes of inquiry associated with climate change adaptation and the variety of settings in which adaptation activities will be pursued. Several factors currently limit application of the framework, including a lack of higher-level evidence of intervention efficacy and a lack of guidelines for reporting climate change health impact projections. To enhance the evidence base, there must be increased attention to designing, evaluating, and reporting adaptation interventions; standardized health impact projection reporting; and increased attention to knowledge translation. This approach has implications for funders, researchers, journal editors, practitioners, and policy makers.Conclusions: The current approach to EBPH can, with modifications, support climate change adaptation activities, but there is little evidence regarding interventions and knowledge translation, and guidelines for projecting health impacts are lacking. Realizing the goal of an evidence-based approach will require systematic, coordinated efforts among various stakeholders.Citation: Hess JJ, Eidson M, Tlumak JE, Raab KK, Luber G. 2014. An evidence-based public health approach to climate change adaptation. Environ Health Perspect 122:1177–1186; http://dx.doi.org/10.1289/ehp.1307396     

Teaching evidence-based public health to public health practitioners

PURPOSE: The purpose of the Evidence Based Public Health (EBPH) course is to train public health practitioners to utilize a comprehensive approach for program development and evaluation from a scientific perspective, including principles of scientific reasoning and systematic uses of data and information systems. The increasing technical sophistication of public health problems and approaches emphasizes the importance for an evidence-based approach to developing policy and interventions. METHODS: The training methods used highlight the linkages between data systems and program/policy initiatives. Participants learn to access and interpret existing data systems and methods of using data to impact specific policies or decision-makers. From 1992 through mid-2004 the EBPH course was offered a total of 20 times, in Missouri, nationally and internationally. In March 2002, the workshop was taped and pressed into a 16-CD set that public health workers can use as a self-teaching program in their own homes and offices. The group exercises from the classroom workshop have been adapted into individual self-guided applications, and background readings are included in the set. RESULTS: Compiled results of course evaluations indicate average ratings for course satisfaction ranging from 8.50 to 10.00 on a scale from 1 to 10. Satisfaction with course instructors ranged between 8.00 and 10.00 on the same scale. Ninety-four to ninety-six per cent of participants reported that they would use the course in their day-to-day work. Qualitative comments from participants at the time of and after the course show that the material is applied in a variety of ways. CONCLUSIONS: The EBPH course is making a valuable contribution in strengthening the application of scientific methods to public health practice. To expand the offerings of this training, a train-the-trainer component for the EBPH course is being developed, to be made available in 2005.     

Training practitioners in evidence-based chronic disease prevention for global health

Too often, public health decisions are based on short-term demands rather than long-term research and objectives. Policies and programmes are sometimes developed around anecdotal evidence. The Evidence-Based Public Health (EBPH) programme trains public health practitioners to use a comprehensive, scientific approach when developing and evaluating chronic disease programmes. Begun in 2002, the EBPH programme is an international collaboration. The course is organized in seven parts to teach skills in: 1) assessing a community's needs; 2) quantifying the issue; 3) developing a concise statement of the issue; 4) determining what is known about the issue by reviewing the scientific literature; 5) developing and prioritizing programme and policy options; 6) developing an action plan and implementing interventions; and 7) evaluating the programme or policy. The course takes an applied approach and emphasizes information that is readily available to busy practitioners, relying on experiential learning and includes lectures, practice exercises, and case studies. It focuses n using evidence-based tools and encourages participants to add to the evidence base in areas where intervention knowledge is sparse. Through this training programme, we educated practitioners from 38 countries in 4 continents. This article describes the evolution of the parent course and describes experiences implementing the course in the Russian Federation, Lithuania, and Chile. Lessons learned from replication of the course include the need to build a "critical mass" of public health officials trained in EBPH within each country and the importance of international, collaborative networks. Scientific and technologic advances provide unprecedented opportunities for public health professionals to enhance the practice of EBPH. To take full advantage of new technology and tools and to combat new health challenges, public health practitioners must continually improve their skills.     

NC CATCH: Advancing Public Health Analytics

The North Carolina Comprehensive Assessment for Tracking Community Health (NC CATCH) is a Web-based analytical system deployed to local public health units and their community partners. The system has the following characteristics: flexible, powerful online analytic processing (OLAP) interface; multiple sources of multidimensional, event-level data fully conformed to common definitions in a data warehouse structure; enabled utilization of available decision support software tools; analytic capabilities distributed and optimized locally with centralized technical infrastructure; two levels of access differentiated by the user (anonymous versus registered) and by the analytical flexibility (Community Profile versus Design Phase); and, an emphasis on user training and feedback.The ability of local public health units to engage in outcomes-based performance measurement will be influenced by continuing access to event-level data, developments in evidence-based practice for improving population health, and the application of information technology-based analytic tools and methods.     

Evidence-based management reconsidered

Reports of medical mistakes have splashed across newspapers and magazines in the United States. At the same time, instances of overuse, underuse, and misuse of management tactics and strategies receive far less attention. The sense of urgency associated with improving the quality of medical care does not exist with respect to improving the quality of management decision making. A more evidence-based approach would improve the competence of the decision-makers and their motivation to use more scientific methods when making a decision. The authors of this article consider a study of 68 U.S. health services managers that found a low level of evidence-based management behaviors. From the findings, four strategies are suggested to increase health systems managers' use of research evidence to improve decision making: focusing evidence-based decision making on strategically important issues, developing committees and other structures to diffuse management research throughout the organization, building a management culture that values research, and training managers in the competencies required to apply research evidence to health services management decisions. To aid the manager in understanding and applying an evidenced-based approach to decision making, the article provides practical tools, techniques, and resources for immediate use.     

Evidence and ethics in public health: the experience of SARS in Canada

Making decisions on the basis of evidence is a central tenet of all health-care disciplines, including public health. However, it is not entirely clear what it means to base decisions on evidence; debates on evidence-based approaches often lack a clear understanding of the nature of evidence and obscure the normative underpinnings of evidence. Public health decision making requires an acceptance of limitations such as the availability of funding for research to provide complete evidence for any given decision, the ethical constraints on the creation of certain types of evidence and the ongoing dilemma between the need to take action and the need to gather more information. Using the example of the SARS outbreak in Canada, the inter-relationships between evidence and ethics are explored. I outline a set of critical questions for the global public health community to discuss regarding the nature of the relationship between evidence-based public health practice and ethics.     

From scientific evidence to operative practice: towards a model of occupational medicine based on on efficacy evidence

There is increasing interest in improving health care practice and in providing evidence-based health care, that is, care in which different stakeholders consistently consider research evidence when making decisions. Quality of health care is presently viewed as a goal towards which different health care settings are geared. In comparison with this approach and in spite of the large development potentialities, occupational health practice is only at the beginning of the process. ILO convention No. 161 already pointed out the need to provide customers with quality-oriented services and evidence-based services. Occupational health practice can be analysed by means of a general system model already established for health care systems including input (structure, management, personnel, equipment), process (activities, performance), output (advice, recommendation), outcome (good life quality, sickness absence, work ability). All these elements can be critically measured with appropriate indicators to evaluate their efficacy. Despite general agreement about the importance of such analysis, there is a lack of data on the efficacy of prevention programmes. According to the evidence-based medicine model, which is commonly used by many other medical specialties, occupational health physicians could adopt a similar approach in order to implement more efficacious interventions. The evidence-based paradigm consists in the conscientious, explicit and judicious use of available best evidence in making decisions about health care problems. The practice of evidence-based medicine means integrating individual expertise with the best current evidence from systematic research. Evidence-based occupational health should implement this innovative approach to evaluate and to improve the efficiency of prevention services by means of the ability to (i) formulate the questions on the problem; (ii) search for scientific evidence; (iii) critically evaluate scientific evidence; (iv) use evidence as a key element for the decision process.     

EBM,HTA, and CER: Clearing the Confusion

Context: The terms evidence-based medicine (EBM), health technology assessment (HTA), comparative effectiveness research (CER), and other related terms lack clarity and so could lead to miscommunication, confusion, and poor decision making. The objective of this article is to clarify their definitions and the relationships among key terms and concepts.Methods: This article used the relevant methods and policy literature as well as the websites of organizations engaged in evidence-based activities to develop a framework to explain the relationships among the terms EBM, HTA, and CER.Findings: This article proposes an organizing framework and presents a graphic demonstrating the differences and relationships among these terms and concepts.Conclusions: More specific terminology and concepts are necessary for an informed and clear public policy debate. They are even more important to inform decision making at all levels and to engender more accountability by the organizations and individuals responsible for these decisions.     

Multi-criteria decision making--an approach to setting priorities in health care

The objective of this paper is to present a multi-criteria decision making (MCDM) approach to support public health decision making that takes into consideration the fuzziness of the decision goals and the behavioural aspect of the decision maker. The approach is used to analyse the process of health technology procurement in a University Hospital in Rio de Janeiro, Brazil. The method, known as TODIM, relies on evaluating alternatives with a set of decision criteria assessed using an ordinal scale. Fuzziness in generating criteria scores and weights or conflicts caused by dealing with different viewpoints of a group of decision makers (DMs) are solved using fuzzy set aggregation rules. The results suggested that MCDM models, incorporating fuzzy set approaches, should form a set of tools for public health decision making analysis, particularly when there are polarized opinions and conflicting objectives from the DM group.     

Evidence-based coverage decisions? Primum non nocere

Drug class reviews are blunt tools for medical decision making. The practice of evidence-based medicine is far more than simply systematic reviews: The patient and doctor are integral. Here we highlight areas of evidence-based coverage decision making where greater balance and transparency could serve to improve the current process, and we recommend elements of a more positive approach that could optimize patient outcomes under resource constraints.     

Systematic reviews of economic evaluations: utility or futility?

Systematic reviews of studies of effectiveness are the centrepiece of evidence‐based medicine and policy making. Increasingly, systematic reviews of economic evaluations are also an expected input into much evidence‐based policy making, with some health economists even calling for ‘an economics approach to systematic review’. This paper questions the value of conducting systematic reviews of economic evaluations to inform decision making in health care. It argues that the value of systematic reviews of economic evaluations is usually undermined by three things. Firstly, compared with effectiveness studies, there is a much wider range of factors that limit the generalisability of cost–effectiveness results, over time and between health systems and service settings, including the context‐dependency of resource use and opportunity costs, and different decision contexts and budget constraints. Secondly, because economic evaluations are more explicitly intended to be decision‐informing, the requirements for generalisability take primacy, and considerations of internal validity become more secondary. Thirdly, since one of the two main forms of economic evaluation – decision analytic modelling – is itself a well‐developed method of evidence synthesis, in most cases the need for a comprehensive systematic review of previous economic evaluations of a particular health technology or policy choice is unwarranted. I conclude that apparent ‘meta‐analytic expectations’ for clear and widely applicable cost–effectiveness conclusions from systematic reviews of economic evaluations are optimistic and generally futile. For more useful insights and knowledge from previous economic studies in evidence‐based policy making, a more limited range of reasons for conducting systematic reviews of health economic studies is proposed. Copyright © 2009 John Wiley & Sons, Ltd.     

The process of evidence-based practice in occupational therapy: Informing clinical decisions

As we move into the 21st century, there are increasing demands placed on occupational therapists to ensure their practice is based on sound evidence. Evidence-based practice is an approach to clinical decision making that has gained considerable interest and influence during the last decade. This article describes and explains the process of evidence-based practice and its application to clinical occupational therapy practice. Directions for resources that may assist therapists' self-directed learning are also provided. As health care becomes more evidence-based, awareness of the principles, skills, and resources for evidence-based practice is of relevance to all occupational therapists.     

Decision-Oriented Health Technology Assessment: One Step Forward in Supporting the Decision-Making Process in Hospitals

ObjectivesThis article outlines the Decision-Oriented Health Technology Assessment: a new implementation of the European network for Health Technology Assessment Core Model, integrating the multicriteria decision-making analysis by using the analytic hierarchy process to introduce a standardized methodological approach as a valued and shared tool to support health care decision making within a hospital.MethodsFollowing the Core Model as guidance (European network for Health Technology Assessment. HTA core model for medical and surgical interventions. Available from: http://www.eunethta.eu/outputs/hta-core-model-medical-and-surgical-interventions-10r. [Accessed May 27, 2014]), it is possible to apply the analytic hierarchy process to break down a problem into its constituent parts and identify priorities (i.e., assigning a weight to each part) in a hierarchical structure. Thus, it quantitatively compares the importance of multiple criteria in assessing health technologies and how the alternative technologies perform in satisfying these criteria. The verbal ratings are translated into a quantitative form by using the Saaty scale (Saaty TL. Decision making with the analytic hierarchy process. Int J Serv Sci 2008;1:83–98). An eigenvectors analysis is used for deriving the weights’ systems (i.e., local and global weights’ system) that reflect the importance assigned to the criteria and the priorities related to the performance of the alternative technologies.ResultsCompared with the Core Model, this methodological approach supplies a more timely as well as contextualized evidence for a specific technology, making it possible to obtain data that are more relevant and easier to interpret, and therefore more useful for decision makers to make investment choices with greater awareness.ConclusionsWe reached the conclusion that although there may be scope for improvement, this implementation is a step forward toward the goal of building a “solid bridge” between the scientific evidence and the final decision maker’s choice.     

The Precautionary Principle, science and human health protection

As technology advances rapidly, so do applications with potential adverse implications on human health. The possible threats include risks that can be substantial, far-reaching and irreversible, and currently available methods of investigation, designed to deal with direct exposure-disease associations, are not always suitable. Growing interest is being paid to health effects that may be the consequence of distal, "upstream" determinants. Considering the complex chain of events that links such determinants with health can be extremely difficult, and exposes severe limitations in science. Thus, there is often a mismatch between what is known and what would be required to inform rational, evidence-based decision making, which is increasingly called for. It has become apparent how production and use of scientific evidence in decision making must be accompanied by precaution, especially in those circumstances, more and more common in recent times, where there is an uncertain possibility that serious health consequences might take place. Several cautionary approaches have been proposed, but the Precautionary Principle (PP) has been the object of especially intense debate in recent years. Developed in the field of environmental health, the PP has been clarified, and has been applied or called for in several instances in public health. Although a unique definition is not available, the principle has been characterised, and criteria for its application have been proposed. However, many questions remain open on general as well as specific issues. In this paper, we address some of the questions that are relevant for the PP to support rational decision making in environment and health and more in general to strengthen its contribution towards human health protection.     

Auf dem Weg zur informierten Entscheidungsfindung

There has been a gradual paradigm shift in the area of screening and early detection of diseases. For many years, the sole focus of public health policies was increasing the uptake rates in screening programs. However, today there is an increasing awareness of the importance of informed decision making –– particularly in the area of screening. The provision of high-quality, evidence-based, and comprehensive information on benefit and harm is an important approach in achieving this objective. The current paper presents a project that was funded by the Federal Ministry of Health. It examines whether existing information material is appropriate to support informed decision making. In the first phase of the project, different screening procedures were assessed systematically and compared using several indicators. Based on the results of an expert workshop, the subsequent research activities focused on colorectal cancer (CRC) screening as one example. Phase II included the systematic search and assessment of print media, e.g., flyers and brochures, while phase III applied the same methods to websites on CRC screening. The information material was analyzed with a mix of methods, involving both experts and users. Finally, the results were presented and discussed with the authors/providers of the information material. Based on the results of this project, the Federal Center for Health Education developed a module on CRC screening for an Internet platform on women’s health that is currently being evaluated. In sum, this research project contributes to the development of evidence-based and balanced information as well as informed decision making.     

Data warehousing: toward knowledge management

With rapid changes taking place in the practice and delivery of health care, decision support systems have assumed an increasingly important role. More and more health care institutions are deploying data warehouse applications as decision support tools for strategic decision making. By making the right information available at the right time to the right decision makers in the right manner, data warehouses empower employees to become knowledge workers with the ability to make the right decisions and solve problems, creating strategic leverage for the organization. Health care management must plan and implement data warehousing strategy using a best practice approach. Through the power of data warehousing, health care management can negotiate bettermanaged care contracts based on the ability to provide accurate data on case mix and resource utilization. Management can also save millions of dollars through the implementation of clinical pathways in better resource utilization and changing physician behavior to best practices based on evidence-based medicine.     

Applicability and transferability of interventions in evidence-based public health

The context in which public health programmes operate can play an important role in influencing their implementation and effectiveness. An intervention that has been shown to be effective in one setting may turn out to be ineffective somewhere else, even supposing it can be implemented there. Therefore, systematic reviews of public health interventions should appraise the applicability of the intervention process and the transferability of the intervention effectiveness to other localities. However, applicability and transferability appraisal is seldom reported in systematic reviews of public health and health promotion interventions. This paper aims to introduce an innovative approach to bridging this gap. A list of attributes that may impact on applicability and transferability can be developed, based on knowledge of the proposed intervention. Then the applicability and transferability of the intervention to the local setting can be rated, and given a score, based on knowledge of the local setting. This approach provides a useful tool for evaluating public health interventions and provides a reliable basis for informed decision making in resource-poor settings, where rigorous primary studies are lacking and where very limited resources put a high demand on evidence-based approaches to health promotion.