Are diagnosis specific outcome indicators based on administrative data useful in assessing quality of hospital care?

Background: Hospital performance reports based on administrative data should distinguish differences in quality of care between hospitals from case mix related variation and random error effects. A study was undertaken to determine which of 12 diagnosis-outcome indicators measured across all hospitals in one state had significant risk adjusted systematic (or special cause) variation (SV) suggesting differences in quality of care. For those that did, we determined whether SV persists within hospital peer groups, whether indicator results correlate at the individual hospital level, and how many adverse outcomes would be avoided if all hospitals achieved indicator values equal to the best performing 20% of hospitals.

Methods: All patients admitted during a 12 month period to 180 acute care hospitals in Queensland, Australia with heart failure (n = 5745), acute myocardial infarction (AMI) (n = 3427), or stroke (n = 2955) were entered into the study. Outcomes comprised in-hospital deaths, long hospital stays, and 30 day readmissions. Regression models produced standardised, risk adjusted diagnosis specific outcome event ratios for each hospital. Systematic and random variation in ratio distributions for each indicator were then apportioned using hierarchical statistical models.

Results: Only five of 12 (42%) diagnosis-outcome indicators showed significant SV across all hospitals (long stays and same diagnosis readmissions for heart failure; in-hospital deaths and same diagnosis readmissions for AMI; and in-hospital deaths for stroke). Significant SV was only seen for two indicators within hospital peer groups (same diagnosis readmissions for heart failure in tertiary hospitals and inhospital mortality for AMI in community hospitals). Only two pairs of indicators showed significant correlation. If all hospitals emulated the best performers, at least 20% of AMI and stroke deaths, heart failure long stays, and heart failure and AMI readmissions could be avoided.

Conclusions: Diagnosis-outcome indicators based on administrative data require validation as markers of significant risk adjusted SV. Validated indicators allow quantification of realisable outcome benefits if all hospitals achieved best performer levels. The overall level of quality of care within single institutions cannot be inferred from the results of one or a few indicators.

     

Hospital type and patient outcomes: an empirical examination using AMI readmission and mortality records

This paper investigates whether there are differences in patient outcomes across different types of hospitals using patient‐level data on readmission and mortality associated with acute myocardial infarction (AMI). Hospitals are grouped according to their ownership type (private, public teaching, public non‐teaching) and their location (metropolitan, country and remote country). Using data collected from 130 Victorian hospitals on 19 000 patients admitted to a hospital with their first AMI between January 2001 and December 2003, we consider how the likelihood of unplanned re‐admission and mortality varies across hospital type. We find that there are significant differences across hospital types in the observed patient outcomes – private hospitals persistently outperform public hospitals. Copyright © 2009 John Wiley & Sons, Ltd.     

In-hospital mortality among rural Medicare patients with acute myocardial infarction: the influence of demographics, transfer, and health factors

Context/Purpose: Most rural hospitals can provide medical care to acute myocardial infarction (AMI) patients, but a need for advanced cardiac care requires timely transfer to a tertiary hospital. There is little information on AMI in‐hospital mortality predictors among rural transfer patients. Methods: Cross‐sectional retrospective analyses on 2003‐2005 Medicare hospital inpatient data from 5 states were conducted to compare predictors of in‐hospital AMI mortality between rural hospital transferred and nontransferred patients. A total of 9,690 rural hospital AMI patients were identified: 3,087 were transferred to receiving hospitals and 6,603 were not transferred. Separate logistic regressions were conducted for transferred and nontransferred patient cohorts and results were compared. Results: Transfer patients were younger, more likely male, had fewer comorbidities/complications, and were less likely to expire (5.3% vs 16.7%) in the hospital. Congestive heart failure and cardiac dysrhythmia were the most common comorbidities/complications among transfer and no‐transfer AMI patients, but shock (OR = 9.44) and acute renal failure (OR = 3.67) had the strongest associations with in‐hospital mortality for both cohorts. Undergoing a percutaneous coronary intervention (PCI) was associated with a 42% reduction in hospital mortality risk for transfer patients. Conclusions: Transfer was associated with a greater likelihood of in‐hospital AMI survival, largely but not fully explained by transfer patients being younger with fewer comorbidities/complications who are receiving advanced cardiac care. Additional studies are needed to clarify other factors that explain higher in‐hospital mortality among nontransfers, such as patients’ health care decision‐making.     

Comparing health outcomes among hospitals: the experience of the Lombardy Region

In recent years, governments and other stakeholders have increasingly used administrative data for measuring healthcare outcomes and building rankings of health care providers. However, the accuracy of such data sources has often been questioned. Starting in 2002, the Lombardy (Italy) regional administration began monitoring hospital care effectiveness on administrative databases using seven outcome measures related to mortality and readmissions. The present study describes the use of benchmarking results of risk-standardized mortality from Lombardy regional hospitals. The data usage is part of a general program of continuous improvement directed to health care service and organizational learning, rather than at penalizing or rewarding hospitals. In particular, hierarchical regression analyses - taking into account mortality variation across hospitals - were conducted separately for each of the most relevant clinical disciplines. Overall mortality was used as the outcome variable and the mix of the hospitals’ output was taken into account by means of Diagnosis Related Group data, while also adjusting for both patient and hospital characteristics. Yearly adjusted mortality rates for each hospital were translated into a reporting tool that indicates to healthcare managers at a glance, in a user-friendly and non-threatening format, underachieving and over-performing hospitals. Even considering that benchmarking on risk-adjusted outcomes tend to elicit contrasting public opinions and diverging policymaking, we show that repeated outcome measurements and the development and dissemination of organizational best practices have promoted in Lombardy region implementation of outcome measures in healthcare management and stimulated interest and involvement of healthcare stakeholders.     

Mortality after admission for acute myocardial infarction in Aboriginal and non-Aboriginal people in New South Wales, Australia: a multilevel data linkage study

ABSTRACT: BACKGROUND: Heart disease is a leading cause of the gap in burden of disease between Aboriginal and non-Aboriginal Australians. Our study investigated short- and long-term mortality after admission for Aboriginal and non-Aboriginal people admitted with acute myocardial infarction (AMI) to public hospitals in New South Wales, Australia, and examined the impact of the hospital of admission on outcomes. METHODS: Admission records were linked to mortality records for 60047 patients aged 25-84 years admitted with a diagnosis of AMI between July 2001 and December 2008. Multilevel logistic regression was used to estimate adjusted odds ratios (AOR) for 30- and 365-day all-cause mortality. RESULTS: Aboriginal patients admitted with an AMI were younger than non-Aboriginal patients, and more likely to be admitted to lower volume, remote hospitals without on-site angiography. Adjusting for age, sex, year and hospital, Aboriginal patients had a similar 30-day mortality risk to non-Aboriginal patients (AOR: 1.07; 95% CI 0.83-1.37) but a higher risk of dying within 365 days (AOR: 1.34; 95% CI 1.10-1.63). The latter difference did not persist after adjustment for comorbid conditions (AOR: 1.12; 95% CI 0.91-1.38). Patients admitted to more remote hospitals, those with lower patient volume and those without on-site angiography had increased risk of short and long-term mortality regardless of Aboriginal status. CONCLUSIONS: Improving access to larger hospitals and those with specialist cardiac facilities could improve outcomes following AMI for all patients. However, major efforts to boost primary and secondary prevention of AMI are required to reduce the mortality gap between Aboriginal and non-Aboriginal people.     

Does It Pay to Penalize Hospitals for Excess Readmissions? Intended and Unintended Consequences of Medicare's Hospital Readmissions Reductions Program

To incentivize hospitals to provide better quality care at a lower cost, the Affordable Care Act of 2010 included the Hospital Readmissions Reduction Program (HRRP), which reduces payments to hospitals with excess 30‐day readmissions for Medicare patients treated for certain conditions. We use triple difference estimation to identify the HRRP's effects in Virginia hospitals; this method estimates the difference in changes in readmission over time between patients targeted by the policy and a comparison group of patients and then compares those difference‐in‐differences estimates in patients treated at hospitals with readmission rates above the national average (i.e., those at risk for penalties) and patients treated at hospitals with readmission rates below or equal to the national average (those not at risk). We find that the HRRP significantly reduced readmission for Medicare patients treated for acute myocardial infarction (AMI). We find no evidence that hospitals delay readmissions, treat patients with greater intensity, or alter discharge status in response to the HRRP, nor do we find changes in the age, race/ethnicity, health status, and socioeconomic status of patients admitted for AMI. Future research on the specific mechanisms behind reduced AMI readmissions should focus on actions by healthcare providers once the patient has left the hospital. Copyright © 2016 John Wiley & Sons, Ltd.     

Hospital competition in a national health service: Evidence from a patient choice reform

We study the impact of exposing hospitals in a National Health Service (NHS) to non-price competition by exploiting a patient choice reform in Norway in 2001. The reform facilitates a difference-in-difference approach due to plausibly exogenous (geographical) variation in pre-reform market structure. Employing rich, administrative data, covering the universe of hospital admissions from 1998 to 2005, we estimate models with hospital and treatment (DRG) fixed-effects and use only emergency admissions to limit patient selection issues. The results show that hospitals in more competitive areas have a sharper reduction in AMI mortality but no effect on stroke mortality. We also find that exposure to competition reduces all-cause mortality, shortens length of stay, but increases readmissions, though the effects are small in magnitude. In years with high (DRG) prices, the negative effect on readmissions almost vanishes. Finally, exposure to competition tends to reduce waiting times and increase admissions, but the effects must be interpreted with care as the outcomes include elective treatments.     

Outcomes for Whites and Blacks at Hospitals That Disproportionately Care for Black Medicare Beneficiaries

Objective

Hospital care for blacks is concentrated among a small number of hospitals and whether they have worse outcomes across common medical conditions is unknown.

Data Source

We used the 2007 100% Medicare file to calculate 30- and 90-day mortality rates for white and black patients admitted for acute myocardial infarction (AMI), congestive heart failure (CHF), or pneumonia.

Study Design

We ranked all hospitals in the country by their proportion of discharged black patients and identified the top 10 percent of these hospitals as black serving. We examined race-specific adjusted mortality rates and adjusted for differences in hospital characteristics.

Principal Findings

At 30 days, black-serving hospitals had, compared with nonblack-serving hospitals, similar mortality for AMI, lower mortality for CHF, and higher mortality for pneumonia. At 90 days, mortality was higher at black-serving hospitals for both AMI and pneumonia and comparable for CHF compared with nonblack-serving hospitals. White patients had worse outcomes at black-serving hospitals for two conditions at 30 days and all three conditions at 90 days. Blacks also had worse outcomes at black-serving hospitals.

Conclusions

Hospitals with a high proportion of black patients had worse outcomes than other hospitals for both their white and black elderly patients.     

Changes in case mix and outcomes of readmissions to nursing homes between 1980 and 1984.

This study compares the personal characteristics, measures of functional status/case mix, and immediate discharge outcomes of two cohorts of nursing home patients (1980 and 1984). All of these patients had a prior history of nursing home care and all were readmitted to skilled nursing facilities from hospitals. In 1984, readmissions were more disabled, more debilitated, and significantly less likely to return home. They were almost twice as likely to be rehospitalized within 30 days of discharge from the hospital (26.7 percent versus 48.9 percent). Analyses showed poorer health status and an increased proportion of nursing home deaths and rehospitalizations in the 1984 group to be a function of time (1984 versus 1980) rather than of insurance coverage (Medicare versus other). Nursing home readmissions appear to be quite sensitive to cost-containment efforts, and they may require additional hospital days to stabilize their conditions in an effort to reduce the rate of hospital readmissions and the overall cost of care.     

Hospital readmission rates: Signal of failure or success?

Hospital readmission rates are increasingly used as signals of hospital performance and a basis for hospital reimbursement. However, their interpretation may be complicated by differential patient survival rates. If patient characteristics are not perfectly observable and hospitals differ in their mortality rates, then hospitals with low mortality rates are likely to have a larger share of un-observably sicker patients at risk of a readmission. Their performance on readmissions will then be underestimated. We examine hospitals’ performance relaxing the assumption of independence between mortality and readmissions implicitly adopted in many empirical applications. We use data from the Hospital Episode Statistics on emergency admissions for fractured hip in 290,000 patients aged 65 and over from 2003 to 2008 in England. We find evidence of sample selection bias that affects inference from traditional models. We use a bivariate sample selection model to allow for the selection process and the dichotomous nature of the outcome variables.     

Acute Myocardial Infarction and Coronary Artery Bypass Grafting Outcomes in Specialty and General Hospitals: Analysis of State Inpatient Data

Objective. Compare characteristics and outcomes of patients hospitalized in specialty cardiac and general hospitals for acute myocardial infarction (AMI) and coronary artery bypass grafting (CABG).
Data. 2000–2005 all-payor administrative data from Arizona, California, Texas, and Wisconsin.
Study Design. We identified patients admitted to specialty and competing general hospitals with AMI or CABG and compared patient demographics, comorbidity, and risk-standardized mortality in specialty and general hospitals.
Principal Findings. Specialty hospitals admitted a lower proportion of women and blacks and treated patients with less comorbid illness than general hospitals. Unadjusted in-hospital AMI mortality for Medicare enrollees in specialty and general hospitals was 6.1 and 10.1 percent ( p <.0001) and for non-Medicare enrollees was 2.8 and 4.0 percent ( p <.04). Unadjusted in-hospital CABG mortality for Medicare enrollees in specialty and general hospitals was 3.2 and 4.7 percent ( p <.01) and for non-Medicare enrollees was 1.1 and 1.8 percent ( p =.02). After adjusting for patient characteristics and hospital volume, risk-standardized in-hospital mortality for all AMI patients was 2.7 percent for specialty hospitals and 4.1 percent for general hospitals ( p <.001) and for CABG was 1.5 percent for specialty hospitals and 2.0 percent for general hospitals ( p =.07).
Conclusions. In-hospital mortality in specialty hospitals was lower than in general hospitals for AMI but similar for CABG. Our results suggest that specialty hospitals may offer significantly better outcomes for AMI but not CABG.     

Hospital cost and quality performance in relation to market forces: an examination of U.S. community hospitals in the “post-managed care era”

Managed care substantially transformed the U.S. healthcare sector in the last two decades of the twentieth century, injecting price competition among hospitals for the first time in history. However, total HMO enrollment has declined since 2000. This study addresses whether managed care and hospital competition continued to show positive effects on hospital cost and quality performance in the “post-managed care era.” Using data for 1,521 urban hospitals drawn from the Healthcare Cost and Utilization Project, we examined hospital cost per stay and mortality rate in relation to HMO penetration and hospital competition between 2001 and 2005, controlling for patient, hospital, and other market characteristics. Regression analyses were employed to examine both cross-sectional and longitudinal variation in hospital performance. We found that in markets with high HMO penetration, increase in hospital competition over time was associated with decrease in mortality but no change in cost. In markets without high HMO penetration, increase in hospital competition was associated with increase in cost but no change in mortality. Overall, hospitals in high HMO penetration markets consistently showed lower average costs, and hospitals in markets with high hospital competition consistently showed lower mortality rates. Hospitals in markets with high HMO penetration also showed lower mortality rates in 2005 with no such difference found in 2001. Our findings suggest that while managed care may have lost its strength in slowing hospital cost growth, differences in average hospital cost associated with different levels of HMO penetration across markets still persist. Furthermore, these health plans appear to put quality of care on a higher priority than before.     

Implications of the California Nurse Staffing Mandate for Other States

Objectives. To determine whether nurse staffing in California hospitals, where state‐mandated minimum nurse‐to‐patient ratios are in effect, differs from two states without legislation and whether those differences are associated with nurse and patient outcomes. Data Sources. Primary survey data from 22,336 hospital staff nurses in California, Pennsylvania, and New Jersey in 2006 and state hospital discharge databases. Study Design. Nurse workloads are compared across the three states and we examine how nurse and patient outcomes, including patient mortality and failure‐to‐rescue, are affected by the differences in nurse workloads across the hospitals in these states. Principal Findings. California hospital nurses cared for one less patient on average than nurses in the other states and two fewer patients on medical and surgical units. Lower ratios are associated with significantly lower mortality. When nurses' workloads were in line with California‐mandated ratios in all three states, nurses' burnout and job dissatisfaction were lower, and nurses reported consistently better quality of care. Conclusions. Hospital nurse staffing ratios mandated in California are associated with lower mortality and nurse outcomes predictive of better nurse retention in California and in other states where they occur.     

Present-at-admission diagnoses improved mortality risk adjustment among acute myocardial infarction patients

OBJECTIVE: Hospital mortality outcomes for acute myocardial infarction (AMI) patients are a focus of quality improvement programs conducted by government agencies. AMI mortality risk-adjustment models using administrative data typically adjust for baseline differences in mortality risk with a limited set of common and definite comorbidities. In this study, we present an AMI mortality risk-adjustment model that adjusts for comorbid disease and for AMI severity using information from secondary diagnoses reported as present at admission for California hospital patients. STUDY DESIGN AND SETTING: AMI patients were selected from California hospital administrative data for 1996 through 1999 according to criteria used by the California Hospital Outcomes Project Report on Heart Attack Outcomes, a state-mandated public report that compares hospital mortality outcomes. We compared results for the new model to two mortality risk-adjustment models used to assess hospital AMI mortality outcomes by the state of California, and to two other models used in prior research. RESULTS: The model using present-at-admission diagnoses obtained substantially better discrimination between predicted survival and inpatient death than the other models we considered. CONCLUSION: AMI mortality risk-adjustment methods can be meaningfully improved using present-at-admission diagnoses to identify comorbid disease and conditions related closely to AMI.     

Output congestion leads to compromised care in Peruvian public hospital neonatal units

Peru is moving toward a universal health insurance system, and it is facing important challenges in the provision of public health services. As more citizens gain access to health insurance, the flow of patients exceeds the capacity of public hospitals to provide care with quality. In this study we explore the relationship between technical efficiency and patient safety events in neonatal care units of Peru’s public hospitals. We use Data Envelope Analysis (DEA) with output congestion to assess the association between technical efficiency and patient safety events. We study 35 neonatal care units of public hospitals in Peru’s Social Security Health System, and identify two undesirable (risk-adjusted) safety outcomes: neonatal mortality and near-miss neonatal mortality. We found that for about half of hospital’s neonatal care units, technical efficiency is affected by output congestion. For those hospitals, patient safety is being compromised by receiving too many patients. Our results are consistent with public reports indicating that hospitals in the Peru’s Social Security Health System are overcrowded, affecting efficiency and jeopardizing quality of care. We found that most congested hospitals are located in the capital city and suburban areas, and are more likely to be hospitals with the lowest and the highest level of care. Our results call for improvements in the patient referral system and capacity expansion.     

Acute Myocardial Infarction in New York State: 1996–2008

We examined the Acute Myocardial Infarction (AMI) incidence and mortality rates in New York State for a recent 13-year period. Hospital discharge data and death certificate information are combined to create patient episodes for AMI. Trends in the risk-adjusted AMI incidence and mortality are examined for the years 1996 through 2008. Between 1996 and 2008, the AMI incidence rate declined by 35.8% and AMI mortality fell from 161.0 to 71.6 per 100,000 population. This 55.5% decline in mortality is accompanied by a 23.9% decline in the number of AMI admissions to acute care hospitals and by a 37.8% improvement in mortality among those hospitalized. New York State follows the national trend in decline in AMI. That decline is accompanied by reductions in AMI mortality, reduced demand on hospitals, and significant improvement in hospital care quality among AMI patients.     

A national disease registry moves beyond clinical impact, fostering measurable cost savings at the community hospital level

National disease registries have existed for many years, and give hospitals and medical professionals centralized, disease-specific databases that can be used to study both treatment protocols and quality outcomes. To date, most efforts have focused on the quality management and clinical aspects of disease registries. However, Sierra Nevada Memorial Hospital, using the National Registry for Myocardial Infarction, recently concluded a study that identified and then attempted to quantify several positive financial effects on the hospital in terms of improved cost outcomes and resource management. The study concluded that activities that improve clinical outcomes (reduce mortality, morbidity, and complications) for acute myocardial infarction (AMI) patients can have a wide range of effects not only for the patients themselves, but also on the cost of care and the utilization of resources. The study discovered that these effects can be measured and expressed quantitatively or qualitatively. Consequently, improving the clinical quality of AMI patient care or reducing the costs of that care can be expected to produce enhanced value for health care consumers, providers, and the health care economy. Furthermore, it is highly likely that this principle would apply to many other kinds of disease registry programs when used to support quality improvement activities.     

MEASURING THE RELATIONSHIP BETWEEN COSTS AND OUTCOMES: THE EXAMPLE OF ACUTE MYOCARDIAL INFARCTION IN GERMAN HOSPITALS

In this paper, we propose a methodological approach to measure the relationship between hospital costs and health outcomes. We propose to investigate the relationship for each condition or disease area by using patient‐level data. We examine health outcomes as a function of costs and other patient‐level variables by using the following: (1) two‐stage residual inclusion with Murphy–Topel adjustment to address costs being endogenous to health outcomes, (2) random‐effects models in both stages to correct for correlation between observation, and (3) Cox proportional hazard models in the second stage to ensure that the available information is exploited. To demonstrate its application, data on mortality following hospital treatment for acute myocardial infarction (AMI) from a large German sickness fund were used. Provider reimbursement was used as a proxy for treatment costs. We relied on the Ontario Acute Myocardial Infarction Mortality Prediction Rules as a disease‐specific risk‐adjustment instrument. A total of 12,284 patients with treatment for AMI in 2004–2006 were included. The results showed a reduction in hospital costs by €100 to increase the hazard of dying, that is, mortality, by 0.43%. The negative association between costs and mortality confirms that decreased resource input leads to worse outcomes for treatment after AMI. Copyright © 2013 John Wiley & Sons, Ltd.     

How do hospitalization experience and institutional characteristics influence inpatient satisfaction? A multilevel approach

Over the last several years, interest in benchmarking health services' quality—particularly patient satisfaction (PS)—across organizations has increased. Comparing patient experiences of care across hospitals requires risk adjustment to control for important differences in patient case‐mix and provider characteristics. This study investigates the individual‐level and organizational‐level determinants of PS with public hospitals by applying hierarchical models. The analysis focuses on the effect of hospital characteristics, such as self‐discharges, on overall evaluations and on across hospital variation in scores. Sociodemographics, admission mode, place of residence, hospitalization ward and continuity of care were statistically significant predictors of inpatient satisfaction. Interestingly, it was observed that hospitals with a higher percentage of Patients Leaving Against Medical Advice (PLAMA) received lower scores. The latter result suggests that the percentage of PLAMA may provide a useful measure of a hospital's inability to meet patient needs and a proxy indicator of PS with hospital care. © 2013 The Authors. International Journal of Health Planning and Management published by John Wiley & Sons, Ltd.