The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency

ObjectiveTo document the development and psychometric evaluation of the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) item bank and static instruments.Study Design and SettingThe items were evaluated using qualitative and quantitative methods. A total of 16,065 adults answered item subsets (n > 2,200/item) on the Internet, with oversampling of the chronically ill. Classical test and item response theory methods were used to evaluate 149 PROMIS PF items plus 10 Short Form-36 and 20 Health Assessment Questionnaire-Disability Index items. A graded response model was used to estimate item parameters, which were normed to a mean of 50 (standard deviation [SD] = 10) in a US general population sample.ResultsThe final bank consists of 124 PROMIS items covering upper, central, and lower extremity functions and instrumental activities of daily living. In simulations, a 10-item computerized adaptive test (CAT) eliminated floor and decreased ceiling effects, achieving higher measurement precision than any comparable length static tool across four SDs of the measurement range. Improved psychometric properties were transferred to the CAT's superior ability to identify differences between age and disease groups.ConclusionThe item bank provides a common metric and can improve the measurement of PF by facilitating the standardization of patient-reported outcome measures and implementation of CATs for more efficient PF assessments over a larger range.     

Development of short form questionnaires for the assessment of work capacity in cardiovascular rehabilitation patients

Objectives

Prevention of job loss is an essential objective of cardiovascular rehabilitation. However, comprehensive and economic diagnostic instruments on work limitations are missing. The present study describes development of short form questionnaires from 2 domains of the WCIB-Cardio item banks for the assessment of work capacity in cardiovascular rehabilitation patients.

Materials and Methods

283 cardiovascular rehabilitation patients were recruited from 14 German rehabilitation clinics. Based on the WCIB-Cardio with the domains of cognitive and physical work capacity, we developed a short form for both domains. Item selection criteria were content coverage, content appropriateness, internal consistency reliability (≥ 0.8). We used correlation of person location scores of the short forms with person location scores of the full item banks to examine the extent of measurement precision.

Results

For each domain of the WCIB-Cardio a short form was developed (cognitive work capacity — 14 items; physical work capacity 7 — items). In both domains psychometric properties were good (person separation index: cognitive work capacity — 0.80; physical work capacity — 0.80). Correlation meaures of the short form with the full item banks showed a high accordance of person locations for both domains (cognitive work capacity: r = 0.97; physical work capacity: r = 0.95).

Conclusions

The calibrated instrument WCIB-Cardio provides the possibility to develop short form questionnaires with high psychometric quality. These short forms make it possible to monitor patient’s work capacity in cardiovascular rehabilitation settings in a more economical way.     

The PROMIS fatigue item bank has good measurement properties in patients with fibromyalgia and severe fatigue

Purpose

Efficient management of fibromyalgia (FM) requires precise measurement of FM-specific symptoms. Our objective was to assess the measurement properties of the Patient-Reported Outcome Measurement Information System (PROMIS) fatigue item bank (FIB) in people with FM.

Methods

We applied classical psychometric and item response theory methods to cross-sectional PROMIS-FIB data from two samples. Data on the clinical FM sample were obtained at a tertiary medical center. Data for the U.S. general population sample were obtained from the PROMIS network. The full 95-item bank was administered to both samples. We investigated dimensionality of the item bank in both samples by separately fitting a bifactor model with two group factors; experience and impact. We assessed measurement invariance between samples, and we explored an alternate factor structure with the normative sample and subsequently confirmed that structure in the clinical sample. Finally, we assessed whether reporting FM subdomain scores added value over reporting a single total score.

Results

The item bank was dominated by a general fatigue factor. The fit of the initial bifactor model and evidence of measurement invariance indicated that the same constructs were measured across the samples. An alternative bifactor model with three group factors demonstrated slightly improved fit. Subdomain scores add value over a total score.

Conclusions

We demonstrated that the PROMIS-FIB is appropriate for measuring fatigue in clinical samples of FM patients. The construct can be presented by a single score; however, subdomain scores for the three group factors identified in the alternative model may also be reported.

     

The use of focus groups in the development of the PROMIS pediatrics item bank

PURPOSE: To understand differences in perceptions of patient-reported outcome domains between children with asthma and children from the general population. We used this information in the development of patient-reported outcome items for the Patient-Reported Outcomes Measurement Information System Pediatrics project. METHODS: We conducted focus groups composed of ethnically, racially, and geographically diverse youth (8-12, 13-17 years) from the general population and youth with asthma. We performed content analysis to identify important themes. RESULTS: We identified five unique and different challenges that may confront youth with asthma as compared to general population youth: (1) They experience more difficulties when participating in physical activities; (2) They may experience anxiety about having an asthma attack at anytime and anywhere; (3) They may experience sleep disturbances and fatigue secondary to their asthma symptoms; (4) Their health condition has a greater effect on their emotional well-being and interpersonal relationships; and (5) Youth with asthma report that asthma often leaves them with insufficient energy to complete their school activities, especially physical activities. CONCLUSIONS: The results confirm unique experiences for children with asthma across a broad range of health domains and enhance the breadth of all domains when creating an item bank.     

Measuring everyday functional competence using the Rasch assessment of everyday activity limitations (REAL) item bank

Objective

Traditional patient-reported physical function instruments often poorly differentiate patients with mild-to-moderate disability. We describe the development and psychometric evaluation of a generic item bank for measuring everyday activity limitations in outpatient populations.

Study design and setting

Seventy-two items generated from patient interviews and mapped to the International Classification of Functioning, Disability and Health (ICF) domestic life chapter were administered to 1128 adults representative of the Dutch population. The partial credit model was fitted to the item responses and evaluated with respect to its assumptions, model fit, and differential item functioning (DIF). Measurement performance of a computerized adaptive testing (CAT) algorithm was compared with the SF-36 physical functioning scale (PF-10).

Results

A final bank of 41 items was developed. All items demonstrated acceptable fit to the partial credit model and measurement invariance across age, sex, and educational level. Five- and ten-item CAT simulations were shown to have high measurement precision, which exceeded that of SF-36 physical functioning scale across the physical function continuum. Floor effects were absent for a 10-item empirical CAT simulation, and ceiling effects were low (13.5%) compared with SF-36 physical functioning (38.1%). CAT also discriminated better than SF-36 physical functioning between age groups, number of chronic conditions, and respondents with or without rheumatic conditions.

Conclusion

The Rasch assessment of everyday activity limitations (REAL) item bank will hopefully prove a useful instrument for assessing everyday activity limitations. T-scores obtained using derived measures can be used to benchmark physical function outcomes against the general Dutch adult population.

     

Health status assessment for the twenty-first century: item response theory, item banking and computer adaptive testing

Health status assessment is frequently used to evaluate the combined impact of human immunodeficiency virus (HIV) disease and its treatment on functioning and well-being from the patient's perspective. No single health status measure can efficiently cover the range of problems in functioning and well-being experienced across HIV disease stages. Item response theory (IRT), item banking and computer adaptive testing (CAT) provide a solution to measuring health-related quality of life (HRQoL) across different stages of HIV disease. IRT allows us to examine the response characteristics of individual items and the relationship between responses to individual items and the responses to each other item in a domain. With information on the response characteristics of a large number of items covering a HRQoL domain (e.g. physical function, and psychological well-being), and information on the interrelationships between all pairs of these items and the total scale, we can construct more efficient scales. Item banks consist of large sets of questions representing various levels of a HRQoL domain that can be used to develop brief, efficient scales for measuring the domain. CAT is the application of IRT and item banks to the tailored assessment of HRQoL domains specific to individual patients. Given the results of IRT analyses and computer-assisted test administration, more efficient and brief scales can be used to measure multiple domains of HRQoL for clinical trials and longitudinal observational studies.     

Sexuality assessment as a tool for sexual rehabilitation in cancer patients

In working with cancer patients, health care personnel aim toward as total a rehabilitation as possible. Ideally this would include sexual rehabilitation for those who so desire. Toward this end a sexual assessment of the patient is necessary. This article deals with some of the underlying assumptions about cancer patients and sexuality, some of the patient's main sexual concerns, difficulties involved in obtaining sexual information, and finally, what should be included in the sexual assessment. There is also a discussion of some helpful interviewing skills necessary for doing a sexual assessment.     

Use of cognitive interviews in the development of the PLUS-M item bank

Purpose

Measuring constructs such as mobility with patient-reported outcomes (PROs) can enhance clinical and scientific understanding of how health conditions, like lower limb amputation, impact patients’ lives. When developing PRO questionnaires, cognitive interviews (CIs) are used to examine whether survey items are understandable, clear, and meaningful. The aim of this study was to use CIs to inform item development for the Prosthetic Limb Users Survey of Mobility (PLUS-M), a PRO that measures mobility in prosthetic limb users.

Methods

Thirty-six CIs were conducted with 30 prosthetic limb users. Each participant responded to up to 30 items from the PLUS-M candidate item set. Each item was reviewed by a minimum of five participants who differed in self-reported mobility, literacy, level of amputation, and time since amputation. Items were revised based on participant feedback, and substantially revised items were re-evaluated through additional CIs.

Results

Feedback from CIs identified substantial issues in 76 of the total 156 items. These items were subsequently modified or eliminated.

Conclusion

Cognitive interviews were an essential qualitative step in the development of the PLUS-M item bank and resulted in better functioning items.     

Ethnic differential item functioning in the assessment of quality of life in cancer patients

Background  

Past research has shown that Filipino cancer patients report lower levels of quality of life (QoL) than other ethnic groups. One possible explanation for this is that Filipinos do not define QoL in the same manner as others, resulting in bias in their assessments. Hence, Filipinos would not necessarily have lower QoL.     

Development of an Exergame for individual rehabilitation of patients with cardiovascular diseases

An Exergame prototype for improved and patient-adapted rehabilitation was developed. A target heart rate for individual users was defined and tracked using a chest belt. Physical activity was tracked by two 3-axis accelerometers, fixed to both wrists. Dependent on the recorded heart rate and by means of a supporting factor and linear regression the movement of the user within the game was supported or hindered. The Exergame was evaluated on 15 healthy users regarding entertaining aspects, physical effort, and impressions concerning the handling of the whole setup. The support factor algorithm to reach the target heart rate was reliable in all subjects.     

Psychometric evaluation of an item bank for computerized adaptive testing of the EORTC QLQ-C30 cognitive functioning dimension in cancer patients

Background

The European Organisation of Research and Treatment of Cancer (EORTC) Quality of Life Group is developing computerized adaptive testing (CAT) versions of all EORTC Quality of Life Questionnaire (QLQ-C30) scales with the aim to enhance measurement precision. Here we present the results on the field-testing and psychometric evaluation of the item bank for cognitive functioning (CF).

Methods

In previous phases (I–III), 44 candidate items were developed measuring CF in cancer patients. In phase IV, these items were psychometrically evaluated in a large sample of international cancer patients. This evaluation included an assessment of dimensionality, fit to the item response theory (IRT) model, differential item functioning (DIF), and measurement properties.

Results

A total of 1030 cancer patients completed the 44 candidate items on CF. Of these, 34 items could be included in a unidimensional IRT model, showing an acceptable fit. Although several items showed DIF, these had a negligible impact on CF estimation. Measurement precision of the item bank was much higher than the two original QLQ-C30 CF items alone, across the whole continuum. Moreover, CAT measurement may on average reduce study sample sizes with about 35–40% compared to the original QLQ-C30 CF scale, without loss of power.

Conclusion

A CF item bank for CAT measurement consisting of 34 items was established, applicable to various cancer patients across countries. This CAT measurement system will facilitate precise and efficient assessment of HRQOL of cancer patients, without loss of comparability of results.

     

个性化健康教育对脑卒中患者康复效果及抑郁、焦虑心理状况的影响

目的探讨个性化健康教育对脑卒中住院患者康复效果及抑郁、焦虑心理状况的影响。方法按照随机数法将90例患者随机分为对照组和干预组,每组45例,干预组采取个性化健康教育,对照组采取常规健康教育,在患者在入院时和3个月时进行自填式问卷调查。结果干预前,干预组MBI评分（33.59±5.82）、Fugl-Meyer评分（28.31±10.32）、ESS评分（46.21±12.18）和MMSE评分（15.17±7.49）与对照组比较差异无统计学意义（P〉0.05）。干预后,干预组患者的MBI评分（66.26±7.57）,Fugl-Meyer评分（52.89±9.75）,ESS评分（62.27±11.36）,MMSE评分（21.92±8.35）均高于对照组及干预前评分（P〈0.01）;干预后,干预组患者无抑郁（35.56%）、轻度抑郁（46.67%）均高于对照组,差异有统计学意义（P〈0.05）。干预组患者无焦虑（42.22%）、轻度焦虑（42.22%）均高于对照组,差异有统计学意义（P〈0.05）。结论个性化健康教育可以改善脑卒中患者的运动功能和心理情绪,提高患者的治疗康复效果。     

Assessment of the psychometrics of a PROMIS item bank: self-efficacy for managing daily activities

Purpose

The aim of this study is to investigate the psychometrics of the Patient-Reported Outcomes Measurement Information System self-efficacy for managing daily activities item bank.

Methods

The item pool was field tested on a sample of 1087 participants via internet (n = 250) and in-clinic (n = 837) surveys. All participants reported having at least one chronic health condition. The 35 item pool was investigated for dimensionality (confirmatory factor analyses, CFA and exploratory factor analysis, EFA), item-total correlations, local independence, precision, and differential item functioning (DIF) across gender, race, ethnicity, age groups, data collection modes, and neurological chronic conditions (McFadden Pseudo R ² less than 10 %).

Results

The item pool met two of the four CFA fit criteria (CFI = 0.952 and SRMR = 0.07). EFA analysis found a dominant first factor (eigenvalue = 24.34) and the ratio of first to second eigenvalue was 12.4. The item pool demonstrated good item-total correlations (0.59–0.85) and acceptable internal consistency (Cronbach’s alpha = 0.97). The item pool maintained its precision (reliability over 0.90) across a wide range of theta (3.70), and there was no significant DIF.

Conclusion

The findings indicated the item pool has sound psychometric properties and the test items are eligible for development of computerized adaptive testing and short forms.

     

The Academic Medical Center Linear Disability Score (ALDS) item bank: item response theory analysis in a mixed patient population

Background  

Currently, there is a lot of interest in the flexible framework offered by item banks for measuring patient relevant outcomes. However, there are few item banks, which have been developed to quantify functional status, as expressed by the ability to perform activities of daily life. This paper examines the measurement properties of the Academic Medical Center linear disability score item bank in a mixed population.     

New complementary perspectives for inpatient physical function assessment: matched clinician-report and patient-report short form measures from the PROMIS adult physical function item bank

Quality of Life Research - To develop two item content-matched, precise, score-level targeted inpatient physical function (PF) short form (SF) measures: one clinician-reported, one...     

糖尿病心脏自主神经病变患者抑郁及焦虑状态分析

目的 观察分析不同阶段糖尿病心脏自主神经病变(Diabetic cardiovascular autonomic neuropathy,DCAN)患者心理学状态.方法 采用Holter分析系统进行心率变异性(HRV)分析,依据评价CAN的标准分别对非DCAN、DCAN临床前期以及DCAN阳性患者进行HAMA和SDS量表测评.结果 278例观察对象中筛查并分类出DCAN阳性组62例(22.30/%),DCAN临床前期组88例(31.65/%),DCAN阴性组128例(46.04/%);3组间年龄、诊断糖尿病时间及HbA1c差异均有统计学意义(P<0.05),3组间HRV时域指标SDNN、SDANN、SDNNI,频域指标LF及MeanHR等比较其差异均有统计学意义(P<0.05).观察对象中53.95%的住院糖尿病患者存在不同程度DCAN,DCAN临床前期组46.59%的患者伴有轻中度抑郁而56.82%则伴有焦虑状态,DCAN阳性组56.45%的患者伴有中重度抑郁而69.35%伴有焦虑状态,DCAN阳性组轻度、中重度抑郁状态频数及焦虑状态频数均显著高于其他2组(P<0.05).结论 伴有不同程度的抑郁和(或)焦虑状态是DCAN及其临床前期患者的主要心理病理学特征.     

The future of outcomes measurement: item banking,tailored short-forms,and computerized adaptive assessment

The use of item banks and computerized adaptive testing (CAT) begins with clear definitions of important outcomes, and references those definitions to specific questions gathered into large and well-studied pools, or “banks” of items. Items can be selected from the bank to form customized short scales, or can be administered in a sequence and length determined by a computer programmed for precision and clinical relevance. Although far from perfect, such item banks can form a common definition and understanding of human symptoms and functional problems such as fatigue, pain, depression, mobility, social function, sensory function, and many other health concepts that we can only measure by asking people directly. The support of the National Institutes of Health (NIH), as witnessed by its cooperative agreement with measurement experts through the NIH Roadmap Initiative known as PROMIS (www.nihpromis.org), is a big step in that direction. Our approach to item banking and CAT is practical; as focused on application as it is on science or theory. From a practical perspective, we frequently must decide whether to re-write and retest an item, add more items to fill gaps (often at the ceiling of the measure), re-test a bank after some modifications, or split up a bank into units that are more unidimensional, yet less clinically relevant or complete. These decisions are not easy, and yet they are rarely unforgiving. We encourage people to build practical tools that are capable of producing multiple short form measures and CAT administrations from common banks, and to further our understanding of these banks with various clinical populations and ages, so that with time the scores that emerge from these many activities begin to have not only a common metric and range, but a shared meaning and understanding across users. In this paper, we provide an overview of item banking and CAT, discuss our approach to item banking and its byproducts, describe testing options, discuss an example of CAT for fatigue, and discuss models for long term sustainability of an entity such as PROMIS. Some barriers to success include limitations in the methods themselves, controversies and disagreements across approaches, and end-user reluctance to move away from the familiar.     

144例心血管病患者拔牙牙科焦虑症流行病学调查

目的 调查心血管病患者拔牙术前牙科焦虑症(DA)的流行情况。方法 采用改良的牙科焦虑量表(DAS)对144例心血管病患者拔牙前DA进行调查和统计分析。结果 该类患者拔牙DA发生率为7.6％;麻醉前焦虑水平最高;对拔牙的认知程度消极、女性、60岁以下、有既往拔牙痛苦史或未拔过牙、心血管病单一、初次心电监护下拔牙、复杂牙拔除的患者拔牙前DAS得分高,男女间、不同认知程度间差异有显著性;对心血管病患者拔牙DAS得分的影响因素从大到小依次为:认知程度、性别、拔牙经历、心血管病史单一否、年龄、是否为复杂牙拔除、是否是初次监护下拔牙等。其中认知程度有非常显著性影响(P=0.000)。结论 7.6％的心血管病患者拔牙术前存在DA,并受多种因素影响,医护人员应予以术前相应的心理治疗和护理。