Controlling for occasion-specific effects when assessing the test–retest reliability of self-report health questionnaires

OBJECTIVE: This study proposes a method for self-report health questionnaires to adjust test-retest reliability for changes during the test-retest interval based on an external measure, and to distinguish such changes from random response errors. METHODS: In our application, eighty participants completed the Symptoms of Illness Checklist (SIC) on two occasions, two weeks apart, immediately before interviews given on each occasion by one of two physicians in a crossover design. The physician interview scores served as external measures, and structural equation modeling was used to estimate the parameters of a model that corrected for the occasion-specific effect of participants' responses using information from the interviews. RESULTS: Correcting for changes in symptoms during the test-retest interval increased SIC test-retest reliability from .744 to .804 and significantly improved model fit (chi2(diff)(1) = 30.78, p < .001). CONCLUSIONS: The results suggest methods that can improve the evaluation of self-report health questionnaire test-retest reliability by identifying changes using an external measure, and distinguishing these from random response errors; these increased the estimated SIC test-retest reliability and indicated that the SIC was indeed able to measure changes over the studied time interval. This method can be applied across a broad range of questionnaires.     

Evidence for reliability, validity and usefulness of the Medical Outcomes Study HIV Health Survey (MOS-HIV)

The Medical Outcomes Study HIV Health Survey (MOS-HIV) is a brief, comprehensive measure of health-related quality of life (HRQoL) used extensively in human immunodeficiency virus/acquired immune deficiency syndrome (HIV/AIDS). The 35-item questionnaire includes ten dimensions (health perceptions, pain, physical, role, social and cognitive functioning, mental health, energy, health distress and quality of life (QoL)) and takes approximately 5 minutes to complete. Subscales are scored on a 0–100 scale (a higher score indicates better health) and physical and mental health summary scores can be generated. The MOS-HIV has been shown to be internally consistent, correlate with concurrent measures of health, discriminate between distinct groups, predict future outcomes and be responsive to changes over time. Limited experience suggests acceptable reliability and validity in women, injecting drug users and African–American and lower socioeconomic status patients. The MOS-HIV is available in 14 languages and has been included as a secondary outcome measure in numerous clinical trials for all stages of disease. In several studies it has detected significant differences between treatments; in some cases concordant with conventional end-points and, in others, discordant. The interpretation of scores is facilitated by an explanation in terms meaningful to the intended audience. Research is needed to compare the MOS-HIV to other strategies for HRQoL assessment in early HIV disease.     

Simple screening test for risk of falls in the elderly

Background:   The aim of this study is to construct a simple screening test for the risk of falls in community-dwelling elder persons.
Methods:   A total of 1378 community-dwelling people aged 65 years and older in five different communities in Japan were asked to answer a self rated questionnaire including 22 items covering physical, cognitive, emotional and social aspects of functioning and environmental factors. At a six-month follow-up, the outcome of fall occurrence and the number of falls was ascertained by social workers, health visitors or nurses.
Results:   Five out of 22 items were selected using a logistic regression model. Using this five-item version, a screening test was constructed, and at the best cut-off point, the sensitivity and specificity were 68% and 70%, respectively. The validity of this scale was tested on persons with cognitive dysfunction.
Conclusion:   The simplicity and the predictive validity of the screening test support the use of this test in health check ups or general outpatient facilities.     

DXA-Generated Z-Scores and T-Scores May Differ Substantially and Significantly in Young Adults

Central dual-energy X-ray absorptiometry (DXA) is the gold standard for non-invasive measurement of bone mineral density (BMD). Using this value and subject demographics, DXA software calculates T-scores and Z-scores. Professional society guidelines for the management of osteoporosis are based on T-scores and Z-scores, rather than on the actual BMD value. Although one expects T-scores and Z-scores to be very similar in young men and women for any given BMD measurement, little literature exists on this issue. Our clinical experience shows that some younger adult individuals (premenopausal women and men younger than 50 yr) have larger than expected difference between their DXA T-score and Z-score. This cross-sectional study evaluates the extent of this discordance between Z-scores and T-scores in a sample of 4275 men and women aged 20–49 yr. All subjects were scanned by central DXA using equipment manufactured by GE Lunar, GE, Madison, WI, or Hologic, Inc., Bedford, MA. Significant differences between Z-scores and T-scores were seen within individuals at the lumbar spine, total hip, femoral neck, and trochanter (p value < 0.001) for both DXA systems. Although these differences were less than half a standard deviation (SD) in most instances, the magnitude of difference was substantial at times, being 1 or more SD in up to 11% of cases (range: −1.95 to +1.54 SD). The smallest differences were seen at the total hip and the largest differences were seen at the femoral neck for both technologies. This is in part because there is no single standard Z-score definition, resulting in different methods of calculation across, and even within, DXA manufacturers. Standardization of Z-score definition and method of calculation is indicated. DXA Z-scores should be interpreted with caution in men and women aged 20–50 yr.     

Clinical performance of non-contact tonometry by Reichert AT550® in glaucomatous patients

Measuring intraocular pressure (IOP) by non-contact tonometry (NCT) has been demonstrated to be a valid and reliable technique to be used in primary eye care; it is easier to use, it does not transmit infectious diseases, and it is not necessary to use anaesthetic or staining eye drops. Recently, a new NCT device has showed an excellent level of agreement with Goldmann tonometry, but there are no records of its performance in glaucomatous eyes. To rectify this, IOP was measured in twenty-two patients (44 eyes) receiving medical treatment to control elevated IOP, with AT550 and Goldmann tonometry. Mean values of IOP were 18.98 +/- 2.77 and 19.08 +/- 3.02 mmHg using Goldmann and AT550, respectively. Plots of differences against means displayed good agreement (mean difference +/- limits of agreement, -0.09 +/- 3.30); this value was not significantly different from zero (t-test for dependent samples, p = 0.709). In conclusion, IOP values as measured with the AT550 NCT are clinically comparable with those obtained with Goldmann tonometry in glaucomatous patients. This validates this NCT not only for screening of IOP but to follow-up glaucomatous patients with a rapid, non-invasive method.     

The ensemble-averaged impedance cardiogram: An evaluation of scoring methods and interrater reliability

The interrater reliability and concurrent validity of two methods of scoring the ensemble-averaged impedance cardiogram were evaluated. Impedance cardiographic and electrocardiographic signals were recorded from 40 undergraduate men and women during a baseline rest period and a vocal mental arithmetic task period. Recordings were scored by four raters using a conventional method, involving ensemble averaging after careful editing of beat-to-beat waveforms, and a streamlined method, involving ensemble averaging without beat-to-beat editing. Intraclass correlations for interrater reliability exceeded .92, whereas intraclass correlations for concurrent validity exceeded .97, indicating excellent agreement between raters and scoring methods for all cardiac measures. The streamlined method was significantly faster than the conventional method. The results indicate that variations in beat-to-beat editing do not constitute a serious source of error in the ensemble-averaged impedance cardiogram and support the interrater reliability and concurrent validity of the two scoring methods.     

Developing the occupational stress indicator (OSI) for use in Brazil: A report on the reliability and validity of the translated OSI

The Occupational Stress Indicator (OSI) was translated into Brazilian Portuguese and administered to a sample of 84 white-collar workers in Brazil. Five of the six scales of the OSI (job satisfaction, mental and physical health, coping, type A behaviour, sources of stress) showed acceptable reliability. The reliability of the sixth scale (locus of control) was disappointing, in keeping with earlier findings that suggest that this scale requires further development. Alternative measures of the stress outcomes — job satisfaction, mental health and physical health — were taken in order to assess the construct validity of these three scales. These measures included translations of the Hackman-Oldham job satisfaction measure and the Crown–Crisp Experiential Index, as well as subjective measures of health-related behaviours. Correlational and multivariate analyses of these data suggested that the job satisfaction, mental health and physical health scales of the OSI had good validity, with the physical health measure probably including a psychosomatic component. These findings are promising for the development of a new version of the OSI designed for use in South America.     

Reliability and validity of dyspnea measures in patients with obstructive lung disease

Dyspnea, the clinical term for shortness of breath, is the primary symptom and an important outcome measure in evaluations of patients with lung disease. It is a subjective symptom that has proved difficult to quantify. Many dyspnea measures are available, yet it is difficult, based on the existing literature, to determine the most reliable and valid. In this study, we evaluated 6 measures of dyspnea for reliability and validity: (a) Baseline Dyspnea Index (BDI) and Transition Dyspnea Index, (b) UCSD Shortness of Breath Questionnaire (SOBQ), (c) American Thoracic Society Dyspnea Scale, (d) Oxygen Cost Diagram, (e) Visual Analog Scale, and (f) Borg Scale. Subjects were 143 patients (74 women and 69 men) with obstructive lung disease, ages 40 to 86, FEV., 0.36 to 3.53 L, FVC 1.07 to 5.74 L. Dyspnea measures were assessed for test-retest reliability, internal consistency, interrater reliability, and construct validity (i.e.. correlations among dyspnea measures and correlations of dyspnea measures with exercise tolerance, health-related quality of life, lung function, anxiety, and depression). Results suggest that the SOBQ and BDI demonstrated the highest levels of reliability and validity among the dyspnea measures examined. This research was supported by University of California Tobacco Related Disease Research Program Grant 2RT026S, National Heart. Lung, and Blood Institute Grant HL 34732 to Robert M. Kaplan, and National Institutes of Health NHLBI Preventive Pulmonary Academic Award No. HL02215 to Andrew L. Ries.     

对Bem性别角色量表的考察与修订

目的：对在性别角色研究中使用得最为广泛的工具-Bem量表进行介绍，考察它在中国文化下的信、效度并进行修订。方法：选取两个城市三所大学中的340名本科生为被试。经过项目分析、因素分析等统计方法，对构成量表的条目进行删除和保留。结果：最后由14项男性化条目和12项女性化条目构成新的Bem量表简本。结论：修订后的Bem量表在信、效度上有了明显的提高，可以成为进一步研究的工具。