Ensuring content validity of patient-reported outcomes: a shadow-test approach to their adaptive measurement

Purpose

Most computerized adaptive testing (CAT) applications in patient-reported outcomes (PRO) measurement to date are reliability-centric, with a primary objective of maximizing measurement efficiency. A key concern and a potential threat to validity is that, when left unconstrained, individual CAT administrations could have items with systematically different attributes, e.g., sub-domain coverage. This paper aims to provide a solution to the problem from an optimal test design framework using the shadow-test approach to CAT.

Methods

Following the approach, a case study was conducted using the PROMIS^® (Patient-Reported Outcomes Measurement Information System) fatigue item bank both with empirical and simulated response data. Comparisons between CAT administrations without and with the enforcement of content and item pool usage constraints were examined.

Results

The unconstrained CAT exhibited a high degree of variation in items selected from different substrata of the item bank. Contrastingly, the shadow-test approach delivered CAT administrations conforming to all specifications with a minimal loss in measurement efficiency.

Conclusions

The optimal test design and shadow-test approach to CAT provide a flexible framework for solving complex test-assembly problems with better control of their domain coverage than for the conventional use of CAT in PRO measurement. Applications in a wide array of PRO domains are expected to lead to more controlled and balanced use of CAT in the field.

     

Motives for Filing a False Allegation of Rape

The list of motives by Kanin (1994) is the most cited list of motives to file a false allegation of rape. Kanin posited that complainants file a false allegation out of revenge, to produce an alibi or to get sympathy. A new list of motives is proposed in which gain is the predominant factor. In the proposed list, complainants file a false allegation out of material gain, emotional gain, or a disturbed mental state. The list can be subdivided into eight different categories: material gain, alibi, revenge, sympathy, attention, a disturbed mental state, relabeling, or regret. To test the validity of the list, a sample of 57 proven false allegations were studied at and provided by the National Unit of the Dutch National Police (NU). The complete files were studied to ensure correct classification by the NU and to identify the motives of the complainants. The results support the overall validity of the list. Complainants were primarily motivated by emotional gain. Most false allegations were used to cover up other behavior such as adultery or skipping school. Some complainants, however, reported more than one motive. A large proportion, 20% of complainants, said that they did not know why they filed a false allegation. The results confirm the complexity of motivations for filing false allegations and the difficulties associated with archival studies. In conclusion, the list of Kanin is, based on the current results, valid but insufficient to explain all the different motives of complainants to file a false allegation.     

The combination of cardiorespiratory fitness and muscle strength,and mortality risk

Little is known about the combined associations of cardiorespiratory fitness (CRF) and hand grip strength (GS) with mortality in general adult populations. The purpose of this study was to compare the relative risk of mortality for CRF, GS, and their combination. In UK Biobank, a prospective cohort of >?0.5 million adults aged 40–69 years, CRF was measured through submaximal bike tests; GS was measured using a hand-dynamometer. This analysis is based on data from 70,913 men and women (832 all-cause, 177 cardiovascular and 503 cancer deaths over 5.7-year follow-up) who provided valid CRF and GS data, and with no history of heart attack/stroke/cancer at baseline. Compared with the lowest CRF category, the hazard ratio (HR) for all-cause mortality was 0.76 [95% confidence interval (CI) 0.64–0.89] and 0.65 (95% CI 0.55–0.78) for the middle and highest CRF categories, respectively, after adjustment for confounders and GS. The highest GS category had an HR of 0.79 (95% CI 0.66–0.95) for all-cause mortality compared with the lowest, after adjustment for confounders and CRF. Similar results were found for cardiovascular and cancer mortality. The HRs for the combination of highest CRF and GS were 0.53 (95% CI 0.39–0.72) for all-cause mortality and 0.31 (95% CI 0.14–0.67) for cardiovascular mortality, compared with the reference category of lowest CRF and GS: no significant association for cancer mortality (HR 0.70; 95% CI 0.48–1.02). CRF and GS are both independent predictors of mortality. Improving both CRF and muscle strength, as opposed to either of the two alone, may be the most effective behavioral strategy to reduce all-cause and cardiovascular mortality risk.