Affiliation: | (1) Childrens Hospital Informatics Program, Enders Building, 5th Floor, 320 Longwood Avenue, Boston, Massachusetts, USA;(2) Division of Health Sciences and Technology, Harvard University and MIT, Cambridge, Massachusetts, USA;(3) Medical Intensive Care Unit, Department of Medicine, KEM Hospital, Parel, Mumbai, India;(4) Decision Systems Group, Brigham and Womens Hospital, Boston, Massachusetts, USA;(5) School of Biomedical Engineering, Indian Institute of Technology, Powai, Mumbai, India;(6) Department of Computer Science and Engineering, Indian Institute of Technology, Powai, Mumbai, India |
Abstract: | Objective To compare hospital outcome prediction using an artificial neural network model, built on an Indian data set, with the APACHE II (Acute Physiology and Chronic Health Evaluation II) logistic regression model.Design Analysis of a database containing prospectively collected data.Setting Medical-neurological ICU of a university hospital in Mumbai, India.Subjects Two thousand sixty-two consecutive admissions between 1996 and1998.Interventions None.Measurements and results The 22 variables used to obtain day-1 APACHE II score and risk of death were recorded. Data from 1,962 patients were used to train the neural network using a back-propagation algorithm. Data from the remaining 1,000 patients were used for testing this model and comparing it with APACHE II. There were 337 deaths in these 1,000 patients; APACHE II predicted 246 deaths while the neural network predicted 336 deaths. Calibration, assessed by the Hosmer-Lemeshow statistic, was better with the neural network (=22.4) than with APACHE II (=123.5) and so was discrimination (area under receiver operating characteristic curve =0.87 versus 0.77, p=0.002). Analysis of information gain due to each of the 22 variables revealed that the neural network could predict outcome using only 15 variables. A new model using these 15 variables predicted 335 deaths, had calibration (=27.7) and discrimination (area under receiver operating characteristic curve =0.88) which was comparable to the 22-variable model (p=0.87) and superior to the APACHE II equation (p<0.001).Conclusion Artificial neural networks, trained on Indian patient data, used fewer variables and yet outperformed the APACHE II system in predicting hospital outcome.Electronic Supplementary Material Supplementary material is available in the online version of this article at Part of this work was presented at the Sixth Annual Critical Care Congress of the Indian Society for Critical Care Medicine, Bangalore, India |