Test–Retest Reliability of the Isernhagen Work Systems Functional Capacity Evaluation in Patients with Chronic Low Back Pain

The aim of this study was to investigate test–retest reliability of the Isernhagen Work System Functional Capacity Evaluation (IWS FCE) in a sample of patients (n = 30) suffering from Chronic Low Back Pain (CLBP) and selected for rehabilitation treatment. The IWS FCE consists of 28 tests that reflect work-related activities like lifting, carrying, bending, etc. In this study, a slightly modified IWS FCE was used. Patients were included in the study if they were still at work or were less than 1 year out of work because of CLBP. Participants' mean age was 40 years, the duration of low back pain ranged between 5 and 10 years. Fifteen patients (50%) were out of work for a mean of 17 weeks, and they all received financial compensation. Two FCE sessions were held with a 2-week interval in between. Means per session, 95% confidence intervals of the mean difference, one-way random Intra Class Correlations (ICC), limits of agreement, Cohen's kappa and percentage of absolute agreement were calculated where appropriate. An ICC of 0.75 or more, a kappa value of more than 0.60 and a percentage of absolute agreement of 80% were considered as an acceptable reliability. Tests of the IWC FCE were divided into tests with and tests without an acceptable test–retest reliability on the basis of the kappa values, the percentage of absolute agreement and the ICC values. Fifteen tests (79%) showed an acceptable test–retest reliability based on Kappa values and percentage of absolute agreement. Eleven tests (61%) showed an acceptable test–retest reliability based on ICC values.     

A Patient-Reported Outcomes Measurement Information System Short Form for Measuring Physical Function During Geriatric Rehabilitation: Test-Retest Reliability,Construct Validity,Responsiveness, and Interpretability

ObjectivesTo study the test-retest reliability and measurement error, construct validity, responsiveness, interpretability, and floor/ceiling effects of a Patient-Reported Outcomes Measurement Information System (PROMIS) short form designed to measure physical function in geriatric rehabilitation patients (PROMIS-PF-GR).DesignProspective cohort.Setting and ParticipantsInpatient geriatric rehabilitation patients.MethodsWe evaluated the test-retest reliability by re-administering PROMIS-PF-GR 3 to 5 days after the admission measurement. The intraclass correlation coefficient (ICC) was calculated to determine test-retest reliability; an ICC of ≥0.70 was considered sufficient. Measurement error was established by calculating the standard error of measurement and smallest detectable change. Construct validity and responsiveness were determined by testing a priori formulated hypotheses (criterion: ≥75% hypothesis not rejected). Interpretability was evaluated by calculating the minimal important change using predictive modeling and a global rating as criterion for change. Floor/ceiling effects were established by calculating the percentage patients with the minimum/maximum raw score (criterion: ≤15%) at admission and discharge.ResultsA total of 207 patients participated in the study [mean ± standard deviation age (80 ± 8.3 years), 58% female]. More than one-half of patients (56%) reported to be improved during rehabilitation. The ICC was 0.79 (95% confidence interval 0.70–0.84), the standardized error of measurement was 3.8, and the smallest detectable change 10.6. None of the 4 hypotheses for construct validity were rejected; 2 out of 5 hypotheses for responsiveness were rejected. The minimal important change was 8.0 (95% confidence interval 4.1–12.5). No floor/ceiling effects were found.Conclusions and ImplicationsThe PROMIS-PG-GR showed sufficient test-retest reliability, measurement error, and construct validity. We did not find sufficient evidence for responsiveness, which may be due to the unexplained weak correlation between the PROMIS change score and the Global Rating Scale. We still recommend the use the PROMIS-PG-GR for measuring self-reported physical function in geriatric rehabilitation.     

Test-retest reliability of lifting and carrying in a 2-day functional capacity evaluation

The objectives of this study were to establish test-retest reliability of lifting and carrying of a functional capacity evaluation (FCE) on two consecutive days and to verify the need for a 2-day protocol. A cohort of 50 patients (39 men, 11 women) with nonspecific low back pain were evaluated using a 2-day FCE protocol. Intraclass correlation coefficients (ICC) were calculated for weight lifted and carried. Predictive relationschips between test and retest were explored by means of a regression analysis. The results of ICC were lifting low 0.87, lifting overhead 0.87, and carrying 0.77. Performances on day 2 were on an average 6–9% higher. Other than the amount of weight handled on day 1, no variable was found to predict performance on day 2. It was concluded that test-retest reliability of lifting and carrying was good, and the need for a 2-day protocol could not be confirmed.     

Updating the Evidence on Functional Capacity Evaluation Methods: A Systematic Review

Objectives To synthesize the evidence on the psychometrics functional capacity evaluation (FCE) methods. Methods A systematic literature search in nine databases. The resulting articles were screened based on predefined in- and exclusion criteria. Two reviewers independently performed this screening. Included studies were appraised based on their methodological quality. Results The search resulted in 20 eligible studies about nine different FCE methods. The Baltimore Therapeutic Equipment work simulator showed a moderate predictive validity. The Ergo-Kit (EK) showed moderate variability and high inter- and intra-rater reliability. Low discriminative abilities and high convergent validity were found for the EK. Concurrent validity of the EK and the ERGOS Work Simulator was low to moderate. Moderate to high test–retest, inter- and intra-reliability was found in the Isernhagen Work-Systems (IWS) FCE. The predictive validity of the IWS was low. The physical work performance evaluation (PWPE) showed moderate test–retest reliability and moderate to high inter-rater reliability. Low internal and external responsiveness were found for the PWPE, predictive validity was high. The predictive validity of the short-form FCE was also high but need to be further examined on several psychometric properties. Low discriminative and convergent validity were found for the work disability functional assessment battery. The WorkHab showed moderate to high test–retest, inter- and intra-rater reliability. Conclusion Well-known FCE methods have been rigorously studied, but some of the research indicates weaknesses in their reliability and validity. Future research should address how these weaknesses can be overcome.     

Exercise Capacity in Non-Specific Chronic Low Back Pain Patients: A Lean Body Mass-Based Ǻstrand Bicycle Test; Reliability, Validity and Feasibility

OBJECTIVE: Measurement of exercise capacity is essential in patients with non-specific chronic low back pain (CLBP). However, the conventional Astrand bicycle test is not feasible in patients with a very poor aerobic capacity. Therefore the Astrand bicycles test for non-specific CLBP patients based on lean body mass (LBM) was developed as an alternative. The aim of this study was to evaluate reliability and validity of the LBM-based Astrand test. SUBJECTS: Twenty patients with non-specific CLBP and 20 healthy subjects were included for the reliability evaluation, and 19 healthy subjects for the validity evaluation. METHOD: Patients and healthy subjects were assessed twice. Intra class correlation (ICC), repeatability coefficient (RC) and the limits of agreement (LOA) were calculated as a measure of test re-tests reliability. An ICC >or= 0.75 was considered acceptable. Validity was tested by calculating ICC between the LBM-based Astrand test and a maximal bicycle test. RESULTS: The LBM-based Astrand test shows good reliability, reflected by an ICC >or= 0.91 and 95% of the 20 patients could perform the test. However, differences with the estimated true value reflected by the RC and natural variation reflected by the LOA were substantial in patients. Validity was good, reflected by ICC >or= 0.88. CONCLUSION: The present study shows that the LBM-based Astrand test is a reliable, valid, and feasible method for patients with non-specific CLBP. However, a substantial amount of variation should be taken into account in patients when interpreting the test results clinically.     

Upper Lifting Performance of Healthy Young Adults in Functional Capacity Evaluations: A Comparison of Two Protocols

The objectives of this study were to explore the concurrent validity of test results of upper lifting tasks of the Ergo-Kit FCE and the Isernhagen Work Systems (IWS) FCE. Seventy-one healthy young adults performed 5 upper lifting tests with at least 5 min of rest in between. The lifting tests included 3 standard protocols and 2 modified protocols. Three criteria for concurrent validity were established: 1) Pearson correlation higher than .75, 2) nonsignificant two-tailed t test, and 3) mean difference smaller than 5 kg. The results showed that none of the criteria were met for the standard protocols. For the modified protocols criteria 2 and 3 were not met. Individual differences larger than 10 kg were found for both standard and modified protocols. It was concluded that the standard protocols for upper lifting tasks of the Ergo-Kit FCE and the IWS FCE do not meet the criteria for concurrent validity and can, therefore, not be used interchangeably.     

Development of a reliable measure of walking within and outside the local neighborhood: RESIDE's Neighborhood Physical Activity Questionnaire

BACKGROUND: The RESIDential Environment project (RESIDE) is a longitudinal study evaluating the impact of a new residential design code on walking. OBJECTIVE: To develop a reliable measure of walking--undertaken within and outside the neighborhood--and overall physical activity. METHODS: A test-retest reliability study was undertaken (n = 82, mean age 39 years). The instrument was based on the International Physical Activity Questionnaire (IPAQ-short version) and Active Australia Survey. It measured usual frequency and duration of (1) recreational- and transport-related walking within and outside the neighborhood and (2) other vigorous and moderate physical activities. RESULTS: Reliability of recall of whether participants had walked within (k = 0.84) and outside (0.73) the neighborhood was acceptable. Similarly, recall of frequency and duration of transport and recreational-related walking within the neighborhood was excellent (ICC > or = 0.82), as was recall of transport-related walking trips outside the neighborhood (ICC > or = 0.84). Reliability for duration of recreational walking outside the neighborhood was fair to good (ICC = 0.55). The reliability of indices of total physical activity based on MET min/week (ICC = 0.82) and MET min/week dichotomized to 'sufficient' physical activity for health (kappa = 0.67) were both acceptable. CONCLUSIONS: The Neighborhood Physical Activity Questionnaire (NPAQ) is sufficiently reliable for studies examining environmental correlates of walking within the neighborhood.     

工作场所工效学负荷综合暴露评估方法的建立及信度评价

[目的]建立一种新的工效学负荷评估方法,检验方法的信度。[方法]引进国外工效学快速暴露检查法(QEC),进行修订和补充;应用Kendall和谐系数W、Kappa值以及ICC对方法进行评估者间和评估者内(重测)的信度检验。[结果]新建的CQEC法简单实用,有9个观察条目和8个自评条目,评估身体5个部位。在不同评估者间,W值0.532~0.800,各部位负荷得分ICC值0.340~0.799,负荷等级分类的Kappa值0.528~0.819,表明CQEC评估者间的信度较好(P<0.01)。对同一评估者,观察条目的Kappa值0.409~0.778,ICC值0.681~0.911,等级分类Kappa值0.549~0.645,说明CQEC在评估者内的一致性较好(P<0.01)。[结论]新建立的CQEC方法具有一定的可靠性,适合我国职业人群应用。     

Development of Food Literacy Assessment Tool Targeting Adults With Low Income

ObjectiveDevelop and test validity and reliability of the Food Literacy Assessment Tool (FLitT) in adults with low income.DesignFace validity was tested using cognitive interviews, content validity using expert review, and internal consistency reliability and test-retest reliability based on 2 administrations of the survey.SettingUrban choice food pantry in Cincinnati, OH.ParticipantsThere were 10 and 98 adults with low income for the cognitive interview and survey, respectivelyVariables MeasuredKnowledge, self-efficacy, and behavior required to plan and manage, select, prepare, and eat in relation to food.AnalysisCronbach α and Kuder-Richardson Formula 20 for internal consistency reliability and intraclass correlation coefficient (ICC) for test-retest reliability.ResultsCognitive interviews and expert feedback suggested modifications to improve the clarity of FLitT and offer more response options. Testing shows acceptable internal consistency in self-efficacy (Cronbach α = 0.92) and behavior (Cronbach α = 0.90) but not in knowledge (Kuder-Richardson Formula 20 = 0.51). The FLitT shows acceptable test-retest reliability for knowledge (ICC = 0.84), self-efficacy (ICC = 0.70), and behavior (ICC = 0.93).Conclusions and ImplicationsThe FLitT was developed and tested for face and content validity and internal and test-retest reliability in adults with low income. Additional research is needed to conduct a second round of face validity and test construct validity using factor analysis with a larger size.     

Repeatability and Safety of the Functional Capacity Evaluation-One-Handed for Individuals with Upper Limb Reduction Deficiency and Amputation

Purpose To assess repeatability and safety of the functional capacity evaluation-one-handed (FCE-OH), a FCE-OH individuals, consisting of eight items. Method The FCE-OH protocol was administered twice to 23 individuals with upper limb absence (87% male; median age 46 years; median 2 days between sessions). To examine repeatability, test–retest reliability and agreement were assessed with the intraclass correlations coefficient (ICC) and limits of agreement (LoA), respectively. Reliability was considered acceptable when ICC-values were ≥0.75. Widths of LoA of four tests were compared with those of healthy adults. Safety and pain response were assessed with a questionnaire. Results After controlling for stability of construct, ICC-values ranged between 0.23 and 0.96, and widths of LoA ranged between 16 and 79%. Intertrial (learning) effects were present in three test items. No serious adverse reactions were reported. A pain response was reported by 30% of the participants. Conclusion Good or excellent reliability was observed in five tests, while three items showed poor or moderate test–retest reliability. Interpretation of agreement was possible for four tests, of which three showed widths of LoA similar to those reported in healthy adults. Learning effects were present; therefore, interpretation at the individual level should be performed with care. As the CI of several items were wide, confirmation of results in a larger sample is warranted. Safety was confirmed.