Ensuring content validity of patient-reported outcomes: a shadow-test approach to their adaptive measurement

Purpose

Most computerized adaptive testing (CAT) applications in patient-reported outcomes (PRO) measurement to date are reliability-centric, with a primary objective of maximizing measurement efficiency. A key concern and a potential threat to validity is that, when left unconstrained, individual CAT administrations could have items with systematically different attributes, e.g., sub-domain coverage. This paper aims to provide a solution to the problem from an optimal test design framework using the shadow-test approach to CAT.

Methods

Following the approach, a case study was conducted using the PROMIS^® (Patient-Reported Outcomes Measurement Information System) fatigue item bank both with empirical and simulated response data. Comparisons between CAT administrations without and with the enforcement of content and item pool usage constraints were examined.

Results

The unconstrained CAT exhibited a high degree of variation in items selected from different substrata of the item bank. Contrastingly, the shadow-test approach delivered CAT administrations conforming to all specifications with a minimal loss in measurement efficiency.

Conclusions

The optimal test design and shadow-test approach to CAT provide a flexible framework for solving complex test-assembly problems with better control of their domain coverage than for the conventional use of CAT in PRO measurement. Applications in a wide array of PRO domains are expected to lead to more controlled and balanced use of CAT in the field.

     

A Descriptive Analysis of a Community Clinic Providing Hepatitis C Treatment to Poor and Uninsured Patients

This study describes clinical characteristics of poor and uninsured patients living with hepatitis C virus (HCV) who received care from a multidisciplinary HCV clinic, reports treatment completion and cure rates, and estimates the cost of HCV medications provided at no cost to uninsured patients. A retrospective chart review was performed and identified 69 uninsured HCV patients who received medical care at Mercy Health Center, a small non-profit community clinic, between January 2008 and March 2015. Three-fourths of the patients were unemployed, a third had multiple HCV exposures, nearly half acquired HCV due to illicit drug use, and more than half had active psychiatric disorders. Of those who received HCV treatment, 81% completed treatment and 85% were achieved virological cure. The multidisciplinary community clinic provided >?$1.4 million of HCV antivirals at no cost to uninsured patients. Findings suggest a multidisciplinary community clinic comprised of a social worker, pharmacist, gastroenterologist, nurse, nurse practitioner, psychologist, and dietitian can help patients achieve HCV treatment completion and cure rates comparable to traditional physician-led clinics, and successfully manage uninsured and underserved HCV patients—who are often regarded as “difficult-to-treat” patients. Public health social workers and other health professionals are encouraged to advocate for treatment and care of poor and uninsured patients living with HCV in health agencies and health systems, otherwise population-wide reductions in HCV morbidity and mortality will not be realized.     

Motives for Filing a False Allegation of Rape

The list of motives by Kanin (1994) is the most cited list of motives to file a false allegation of rape. Kanin posited that complainants file a false allegation out of revenge, to produce an alibi or to get sympathy. A new list of motives is proposed in which gain is the predominant factor. In the proposed list, complainants file a false allegation out of material gain, emotional gain, or a disturbed mental state. The list can be subdivided into eight different categories: material gain, alibi, revenge, sympathy, attention, a disturbed mental state, relabeling, or regret. To test the validity of the list, a sample of 57 proven false allegations were studied at and provided by the National Unit of the Dutch National Police (NU). The complete files were studied to ensure correct classification by the NU and to identify the motives of the complainants. The results support the overall validity of the list. Complainants were primarily motivated by emotional gain. Most false allegations were used to cover up other behavior such as adultery or skipping school. Some complainants, however, reported more than one motive. A large proportion, 20% of complainants, said that they did not know why they filed a false allegation. The results confirm the complexity of motivations for filing false allegations and the difficulties associated with archival studies. In conclusion, the list of Kanin is, based on the current results, valid but insufficient to explain all the different motives of complainants to file a false allegation.