Reliability of level of care decisions in a Long-Term Care program

This paper addresses the question of the degree of agreement between experienced assessors making level-of-care placement decisions for the same client, given a comparable opportunity to obtain and record client information in a community-based Long-Term Care program.A systematic sample of 246 cases was selected, consisting of 47 preadmission assessments and 199 reviews. The resulting data were subjected to analysis using the statistic Kappa and the degree of agreement categories suggested by Fleiss.¹ It was found that at the level-of-care extremes— Extended Care and Personal Care—the agreement between two nurse assessors for reviews could be considered excellent. In the Intermediate Care range, however, the reliability of the level-of-care decision can only be considered fair. Agreement for initial assessments was less, withK=0.469 indicating, overall, only fair agreement. While there was most often only a one-care-level difference between assessors, the program assessor tended to recommend a higher level than the study or check assessor. This has implications for funding agencies and/or facility planners who must assess the likely care requirements of an increasing number of disabled elderly. From a program management perspective, the preceding analyses allow an objective judgement of the extent of the placement decision problem, if any, and further provide a definition of areas most in need of revision. The value of collaboration between practitioner and researcher is evident in these analyses.Dr. Stark is Director, Division of Health Services Research and Development and Assistant Professor, Department of Health Care and Epidemiology, The University of British Columbia. Dr. Gutman is Director, Gerontology Centre and Associate Professor, Faculty of Interdisciplinary Studies, Simon Fraser University. Dr. Brothers is Research Associate, Division of Health Systems, The University of British Columbia. Address enquiries to Dr. A. Stark, Director, Division of Health Services Research and Development, Office of the Coordinator of Health Sciences, The John F. McCreary Health Sciences Centre, 2194 Health Sciences Mall, The University of British Columbia, Vancouver, B.C., V6T 1Z6.The research described in this paper, as well as the larger study of which it is a part, is supported by a grant from the B.C. Health Care Research Foundation. In addition, the cooperation and support of the Ministry of Health, Province of British Columbia is gratefully acknowledged.