Functional Capacity Evaluation Research: Report from the Second International Functional Capacity Evaluation Research Meeting

Introduction Functional capacity evaluations are an important component of many occupational rehabilitation programs and can play a role in facilitating reintegration to work thus improving health and disability outcomes. The field of functional capacity evaluation (FCE) research has continued to develop over recent years, with growing evidence on the reliability, validity and clinical utility of FCE within different patient and healthy worker groups. The second International FCE Research Conference was held in Toronto, Canada on October 2nd 2014 adjacent to the 2014 Work Disability Prevention Integration conference. This paper describes the outcomes of the conference. Report Fifty-four participants from nine countries attended the conference where eleven research projects and three workshops were presented. The conference provided an opportunity to discuss FCE practice, present new research and provide a forum for discourse around the issues pertinent to FCE use. Conference presentations covered aspects of FCE use including the ICF–FCE interface, aspects of reliability and validity, consideration of specific injury populations, comparisons of FCE components and a lively debate on the merits of ‘Man versus Machine’ in FCE’s. Future directions Researchers, clinicians, and other professionals in the FCE area have a common desire to improve the content and quality of FCE research and to collaborate to further develop research across systems, cultures and countries.     

Validity and Reliability of the Upper Extremity Work Demands Scale

Purpose To evaluate validity and reliability of the upper extremity work demands (UEWD) scale. Methods Participants from different levels of physical work demands, based on the Dictionary of Occupational Titles categories, were included. A historical database of 74 workers was added for factor analysis. Criterion validity was evaluated by comparing observed and self-reported UEWD scores. To assess structural validity, a factor analysis was executed. For reliability, the difference between two self-reported UEWD scores, the smallest detectable change (SDC), test–retest reliability and internal consistency were determined. Results Fifty-four participants were observed at work and 51 of them filled in the UEWD twice with a mean interval of 16.6 days (SD 3.3, range = 10–25 days). Criterion validity of the UEWD scale was moderate (r = .44, p = .001). Factor analysis revealed that ‘force and posture’ and ‘repetition’ subscales could be distinguished with Cronbach’s alpha of .79 and .84, respectively. Reliability was good; there was no significant difference between repeated measurements. An SDC of 5.0 was found. Test–retest reliability was good (intraclass correlation coefficient for agreement = .84) and all item-total correlations were >.30. There were two pairs of highly related items. Conclusion Reliability of the UEWD scale was good, but criterion validity was moderate. Based on current results, a modified UEWD scale (2 items removed, 1 item reworded, divided into 2 subscales) was proposed. Since observation appeared to be an inappropriate gold standard, we advise to investigate other types of validity, such as construct validity, in further research.     

Reliability,Construct and Predictive Validity of the Hong Kong Chinese Orebro Musculoskeletal Pain Screening Questionnaire

Purpose The aim of this study was to evaluate the reliability, construct validity and predictive validity of the Hong Kong Chinese version of the Orebro Musculoskeletal Pain Screening Questionnaire (COMPSQ-HK). Methods The COMPSQ-HK was developed using the forward–backward translation. Internal consistency was assessed using Cronbach’s alpha and test–retest reliability was examined using intraclass correlation coefficient with one-way random-effects model (ICC_1,1), minimum detectable change (MDC) and 95% limits of agreement (LoA). Construct validity was evaluated by correlating the COMPSQ-HK with the Numeric Pain Rating Scale, Roland-Morris Disability Questionnaire, Northwick Park Neck Pain Questionnaire, Tampa Scale for Kinesiophobia, and Medical Outcomes Study Short Form 12. The predictive validity was investigated using receiver operating characteristics (ROC) curve analyses with sick leave?>60 days and return-to-work for ≥4 consecutive weeks as outcomes at 1 year follow-up. The areas under the curve (AUC) were calculated. Results The COMPSQ-HK was administered to 305 patients with acute/subacute low back pain and 160 patients with acute/subacute neck pain. The Cronbach’s alphas and ICC_1,1 ranged from 0.83 to 0.84 and 0.81 to 0.92 respectively. The MDC were 32.1 and 21.1. The 95% LoA were ?32.4 to 31.8 and ?15.4 to 26.7. The Pearson r ranged from 0.333 to 0.697 in absolute value. The AUC for the ROC curve analyses ranged from 0.59 to 0.71. Conclusions The COMPSQ-HK has good internal consistency, moderate test–retest reliability, satisfactory construct validity and predictive validity as a screening tool for patients with back and neck pain at risk of chronic disability.     

Reliability and validity of Functional Capacity Evaluation methods: a systematic review with reference to Blankenship system,Ergos work simulator,Ergo-Kit and Isernhagen work system

Objectives: Functional Capacity Evaluation methods (FCE) claim to measure the functional physical ability of a person to perform work-related tasks. The purpose of the present study was to systematically review the literature on the reliability and validity of four FCEs: the Blankenship system (BS), the ERGOS work simulator (EWS), the Ergo-Kit (EK) and the Isernhagen work system (IWS). Methods: A systematic literature search was conducted in five databases (CINAHL, Medline, Embase, OSH-ROM and Picarta) using the following keywords and their synonyms: functional capacity evaluation, reliability and validity. The search strategy was performed for relevance in titles and abstracts, and the databases were limited to literature published between 1980 and April 2004. Two independent reviewers applied the inclusion criteria to select all relevant articles and evaluated the methodological quality of all included articles. Results: The search resulted in 77 potential relevant references but only 12 papers were identified for inclusion and assessed for their methodological quality. The interrater reliability and predictive validity of the IWS were evaluated as good while the procedure used in the intrarater reliability (test–retest) studies was not rigorous enough to allow any conclusion. The concurrent validity of the EWS and EK was not demonstrated while no study was found on their reliability. No study was found on the reliability and validity of the BS. Conclusions: More rigorous studies are needed to demonstrate the reliability and the validity of FCE methods, especially the BS, EWS and EK.     

Measurement Properties of the Modified Spinal Function Sort (M-SFS): Is It Reliable and Valid in Workers with Chronic Musculoskeletal Pain?

Purpose To analyze the reliability and validity of a picture-based questionnaire, the Modified Spinal Function Sort (M-SFS). Methods Sixty-two injured workers with chronic musculoskeletal disorders (MSD) were recruited from two work rehabilitation centers. Internal consistency was assessed by Cronbach’s alpha. Construct validity was tested based on four a priori hypotheses. Structural validity was measured with principal component analysis (PCA). Test–retest reliability and agreement was evaluated using intraclass correlation coefficient (ICC) and measurement error with the limits of agreement (LoA). Results Total score of the M-SFS was 54.4 (SD 16.4) and 56.1 (16.4) for test and retest, respectively. Item distribution showed no ceiling effects. Cronbach’s alpha was 0.94 and 0.95 for test and retest, respectively. PCA showed the presence of four components explaining a total of 74% of the variance. Item communalities were >0.6 in 17 out of 20 items. ICC was 0.90, LoA was ±12.6/16.2 points. The correlations between the M-SFS were 0.89 with the original SFS, 0.49 with the Pain Disability Index, ?0.37 and ?0.33 with the Numeric Rating Scale for actual pain, ?0.52 for selfreported disability due to chronic low back pain, and 0.50, 0.56–0.59 with three distinct lifting tests. No a priori defined hypothesis for construct validity was rejected. Conclusions The M-SFS allows reliable and valid assessment of perceived self-efficacy for work-related tasks and can be recommended for use in patients with chronic MSD. Further research should investigate the proposed M-SFS score of <56 for its predictive validity for non-return to work.     

Validation study of a Chinese version of Partners in Health in Hong Kong (C-PIH HK)

Background

The Partners in Health (PIH) scale is a measure designed to assess the generic knowledge, attitudes, behaviors, and impacts of self-management. A cross-cultural adaptation of the PIH for use in Hong Kong was evaluated in this study. This paper reports the validity and reliability of the Chinese version of PIH (C-PIH[HK]).

Method

A 12-item PIH was translated using forward–backward translation technique and reviewed by individuals with chronic diseases and health professionals. A total of 209 individuals with chronic diseases completed the scale. The construct validity, internal consistency, and test–retest reliability were evaluated in two waves.

Results

The findings in Wave 1 (n = 73) provided acceptable psychometric properties of the C-PIH(HK) but supported the adaptation of question 5 to improve the cultural relevance, validity, and reliability of the scale. An adapted version of C-PIH(HK) was evaluated in Wave 2. The findings in Wave 2 (n = 136) demonstrated good construct validity and internal consistency of C-PIH(HK). A principal component analysis with Oblimin rotation yielded a 3-factor solution, and the Cronbach’s alphas of the subscales ranged from 0.773 to 0.845. Participants were asked whether they perceived the self-management workshops they attended and education provided by health professionals as useful or not. The results showed that the C-PIH(HK) was able to discriminate those who agreed and those who disagreed related to the usefulness of individual health education (p < 0.0001 in all subscales) and workshops (p < 0.001 in the knowledge subscale) as hypothesized. The test–retest reliability was high (ICC = 0.818).

Conclusion

A culturally adapted version of PIH for use in Hong Kong was evaluated. The study supported good construct validity, discriminate validity, internal consistency, and test–retest reliability of the C-PIH(HK).

     

Functional Capacity Evaluation Research: Report from the Third International Functional Capacity Evaluation Research Meeting

Purpose Based on the success of the first two conferences the Third International FCE Research Conference was held in The Netherlands on September 29, 2016. The aim was to provide ongoing opportunity to share and recent FCE research and discuss its implications. Methods Invitations and call for abstracts were sent to previous attendees, researchers, practicing FCE clinicians and professionals. Fifteen abstracts were selected for presentation. The FCE research conference contained two keynote lectures. Results 54 participants from 12 countries attended the conference where 15 research projects and 2 keynote lectures were presented. The conference provided an opportunity to present and discuss recent FCE research, and provided a forum for discourse related to FCE use. Conference presentations covered aspects of practical issues in administration and interpretation; protocol reliability and validity; consideration of specific injury populations; and a focused discussion on proposed inclusion of work physiology principles in FCE testing with the Heart Rate Reserve Method. Details of this Third International FCE Research Conference are available from http://repro.rcnheliomare.nl/FCE.pdf. Conclusions Researchers, clinicians, and other professionals in the FCE area have a common desire to further improve the content and quality of FCE research and to collaborate to further develop research across systems, cultures and countries. A fourth, 2-day, International FCE research conference will be held in Valens, Switzerland in August or September 2018. A ‘FCE research Society’ will be developed.     

Reliability and Validity of the Work and Well-Being Inventory (WBI) for Employees

Purpose The purpose of this study is to measure the psychometric properties of the Work and Wellbeing Inventory (WBI) (in Dutch: VAR-2), a screening tool that is used within occupational health care and rehabilitation. Our research question focused on the reliability and validity of this inventory. Methods Over the years seven different samples of workers, patients and sick listed workers varying in size between 89 and 912 participants (total: 2514), were used to measure the test–retest reliability, the internal consistency, the construct and concurrent validity, and the criterion and predictive validity. Results The 13 scales displayed good internal consistency and test–retest reliability. The constructive validity of the WBI could clearly be demonstrated in both patients and healthy workers. Confirmative factor analyses revealed a CFI?>.90 for all scales. The depression scale predicted future work absenteeism (>6 weeks) because of a common mental disorder in healthy workers. The job strain scale and the illness behavior scale predicted long term absenteeism (>3 months) in workers with short-term absenteeism. The illness behavior scale moderately predicted return to work in rehab patients attending an intensive multidisciplinary program. Conclusions The WBI is a valid and reliable tool for occupational health practitioners to screen for risk factors for prolonged or future sickness absence. With this tool they will have reliable indications for further advice and interventions to restore the work ability.     

Validity and Reliability of the 8-Item Work Limitations Questionnaire

Purpose To evaluate factorial validity, scale reliability, test–retest reliability, convergent validity, and discriminant validity of the 8-item Work Limitations Questionnaire (WLQ) among employees from a public university system. Methods A secondary analysis using de-identified data from employees who completed an annual Health Assessment between the years 2009–2015 tested research aims. Confirmatory factor analysis (CFA) (n?=?10,165) tested the latent structure of the 8-item WLQ. Scale reliability was determined using a CFA-based approach while test–retest reliability was determined using the intraclass correlation coefficient. Convergent/discriminant validity was tested by evaluating relations between the 8-item WLQ with health/performance variables for convergent validity (health-related work performance, number of chronic conditions, and general health) and demographic variables for discriminant validity (gender and institution type). Results A 1-factor model with three correlated residuals demonstrated excellent model fit (CFI?=?0.99, TLI?=?0.99, RMSEA?=?0.03, and SRMR?=?0.01). The scale reliability was acceptable (0.69, 95% CI 0.68–0.70) and the test–retest reliability was very good (ICC?=?0.78). Low-to-moderate associations were observed between the 8-item WLQ and the health/performance variables while weak associations were observed between the demographic variables. Conclusions The 8-item WLQ demonstrated sufficient reliability and validity among employees from a public university system. Results suggest the 8-item WLQ is a usable alternative for studies when the more comprehensive 25-item WLQ is not available.     

Psychometric properties of Functional Assessment of Cancer Therapy-Prostate (FACT-P) in Chinese patients with prostate cancer

Purpose

The aim of the study was to assess the validity, reliability and sensitivity of the FACT-P (version 4) in Chinese males with prostate cancer.

Methods

Construct validity was assessed using Spearman’s correlation test against the 12-item Short Form Health Survey (SF-12v2). Internal consistency and test–retest reliability were assessed using Cronbach’s α coefficient and intra-class correlation coefficient, respectively. Sensitivity was determined by performing known-group comparisons by independent t test.

Results

FACT-P subscale scores had a moderate correlation with the corresponding SF-12v2 domain score that conceptually measures the similar construct providing evidence for adequate construct validity. Internal consistency was acceptable (α: 0.687–0.900) for all subscales aside from the Prostate Cancer Subscale (α: 0.505) and Trial Outcome Index (α: 0.562). FACT-P subscale and total scores showed good test–retest reliability (range 0.753–0.913). All total scales and most of the subscales were sensitive in detecting differences between patients with different levels of functional impairment but not different cancer stages or levels of prostate-specific antigen.

Conclusions

The measure is a valid and reliable measure to assess the health-related quality of life of Chinese males with prostate cancer. The FACT-P is sensitive to detect difference between patients with varying functional status.

     

Test–retest reliability of <Emphasis Type="Italic">HeartQoL</Emphasis> and its comparability to the <Emphasis Type="Italic">MacNew</Emphasis> heart disease health-related quality of life questionnaire

Objectives

Heart Quality of Life (HeartQoL) is a new “hybrid” developed from the MacNew and two condition-specific questionnaires measuring health-related quality of life (HRQoL) in patients with ischemic heart disease (IHD). This study investigates test–retest reliability of HeartQoL (English version) according to international criteria (e.g., COSMIN, GRRAS). Findings on HeartQoL are compared to the published data on MacNew in view that both serve as the core IHD-specific HRQoL instrument.

Methods

Out of 105 patients with IHD, 76 completed self-administration of HeartQoL at the clinic followed by at home within a 2-week interval. In retest, patients responded using non-interview methods (phone messaging, email, fax, and post). Phone interviewing was reserved for non-respondents to reminder.

Results

Reliability of HeartQoL was good (intraclass correlation coefficients = 0.78–0.82), was supported in the Bland–Altman plot, and was comparable to five studies on MacNew of similar retest interval (MacNew-English = 0.70–0.75; translated MacNew = 0.72–0.91). Applicability of its standard error of measurement (0.20–0.25) and smallest detectable change (0.55–0.70) will depend on availability of normative data in future.

Conclusion

The reliability of HeartQoL is comparable to its parent instrument, the MacNew. The HeartQoL is a potentially reliable core IHD-specific HRQoL instrument in measuring group change.

     

Adaptation and validation of the “tolerability and quality of life” (TOOL) questionnaire in Chinese bipolar patients

Background

It is well known that the antipsychotic drugs impact the health-related quality of life (HRQoL) of the bipolar patients. The side effects had been assessed only from the doctors’ perspective and neglected the patients’ subjective feeling. The aim of the study is to validate the specific instrument “tolerability and quality of life” (TOOL) into Chinese to describe and grade the impact of antipsychotic drugs on HRQoL from patients’ view.

Methods

A psychometric study was conducted with euthymic bipolar disorder patients (N = 105) under antipsychotic treatment. The psychometric properties of the TOOL, including internal consistency, retest reliability, concurrent validity, content validity, discriminative validity, item analysis, confirmatory factor analysis and feasibility, were analyzed.

Results

The internal consistency and intraclass correlation coefficient (ICC) were adequate (Cronbach’s alpha = 0.80 and ICC = 0.81). A confirmatory factor analysis (CFA) validated the one-factor model. Significant Spearman’s rank correlations between the TOOL and both Bref QoL.BD (Brief version of Quality of Life in Bipolar Disorder) (r = ?0.33, P < 0.01) and UKU (Udvalg for Kliniske Undersogelser side effects scale) (r = 0.13, P < 0.05) were found.

Limitations

Small sample size and no specific self-report instrument in Chinese to evaluate the criterion validity.

Conclusions

TOOL appears to be a reliable and valid measure to assess the impact of adverse events of antipsychotic drugs on HRQoL from the patients’ perspective.

     

Work and Health Questionnaire (WHQ): A Screening Tool for Identifying Injured Workers at Risk for a Complicated Rehabilitation

Purpose Unintentional injuries occur frequently and many of the accident survivors suffer from temporary or permanent disabilities. Although most accident victims recover quickly, a significant fraction of them shows a complicated recovery process and accounts for the majority of disability costs. Thus, early identification of vulnerable persons may be beneficial for compensation schemes, government bodies, as well as for the worker themselves. Here we present the Work and Health Questionnaire (WHQ), a screening tool that is already implemented in the case management process of the Swiss Accident Insurance Fund (Suva). Moreover, we demonstrate its prognostic value for identifying workers at risk of a complicated recovery process. Methods A total of 1963 injured workers answered the WHQ within the first 3 months after their accident. All of them had minor to moderate accidental injuries; severely injured workers were excluded from the analyses. The anonymized individual-level data were extracted from insurance databases. We examined construct validity by factorial analyses, and prognostic validity by hierarchical multiple regression analyses on days of work disability. Further, we evaluated well-being and job satisfaction 18 months post-injury in a subsample of 192 injured workers (9.8 %) Results Factor analyses supported five underlying factors (Job Design, Work Support, Job Strain, Somatic Condition/Pain, and Anxiety/Worries). These subscales were moderately correlated, thus indicating that different subscales measured different aspects of work and health-related risk factors of injured workers. Item analysis and reliability analysis showed accurate psychometric properties. Each subscale was predictive at least for one of the evaluated outcomes 18 months post-injury. Conclusion The WHQ shows good psychometric qualities with high clinical utility to identify injured persons with multiple psychosocial risk factors. Thus, the questionnaire appears to be suitable for exploring different rehabilitation needs among minor to moderate injured workers.     

Test–Retest Reliability of the Isernhagen Work Systems Functional Capacity Evaluation in Patients with Chronic Low Back Pain

The aim of this study was to investigate test–retest reliability of the Isernhagen Work System Functional Capacity Evaluation (IWS FCE) in a sample of patients (n = 30) suffering from Chronic Low Back Pain (CLBP) and selected for rehabilitation treatment. The IWS FCE consists of 28 tests that reflect work-related activities like lifting, carrying, bending, etc. In this study, a slightly modified IWS FCE was used. Patients were included in the study if they were still at work or were less than 1 year out of work because of CLBP. Participants' mean age was 40 years, the duration of low back pain ranged between 5 and 10 years. Fifteen patients (50%) were out of work for a mean of 17 weeks, and they all received financial compensation. Two FCE sessions were held with a 2-week interval in between. Means per session, 95% confidence intervals of the mean difference, one-way random Intra Class Correlations (ICC), limits of agreement, Cohen's kappa and percentage of absolute agreement were calculated where appropriate. An ICC of 0.75 or more, a kappa value of more than 0.60 and a percentage of absolute agreement of 80% were considered as an acceptable reliability. Tests of the IWC FCE were divided into tests with and tests without an acceptable test–retest reliability on the basis of the kappa values, the percentage of absolute agreement and the ICC values. Fifteen tests (79%) showed an acceptable test–retest reliability based on Kappa values and percentage of absolute agreement. Eleven tests (61%) showed an acceptable test–retest reliability based on ICC values.     

The validation of a computer-adaptive test (CAT) for assessing health-related quality of life in children and adolescents in a clinical sample: study design,methods and first results of the Kids-CAT study

Purpose

Recently, we developed a computer-adaptive test (CAT) for assessing health-related quality of life (HRQoL) in children and adolescents: the Kids-CAT. It measures five generic HRQoL dimensions. The aims of this article were (1) to present the study design and (2) to investigate its psychometric properties in a clinical setting.

Methods

The Kids-CAT study is a longitudinal prospective study with eight measurements over one year at two University Medical Centers in Germany. For validating the Kids-CAT, 270 consecutive 7- to 17-year-old patients with asthma (n = 52), diabetes (n = 182) or juvenile arthritis (n = 36) answered well-established HRQoL instruments (Pediatric Quality of Life Inventory? (PedsQL), KIDSCREEN-27) and scales measuring related constructs (e.g., social support, self-efficacy). Measurement precision, test–retest reliability, convergent and discriminant validity were investigated.

Results

The mean standard error of measurement ranged between .38 and .49 for the five dimensions, which equals a reliability between .86 and .76, respectively. The Kids-CAT measured most reliably in the lower HRQoL range. Convergent validity was supported by moderate to high correlations of the Kids-CAT dimensions with corresponding PedsQL dimensions ranging between .52 and .72. A lower correlation was found between the social dimensions of both instruments. Discriminant validity was confirmed by lower correlations with non-corresponding subscales of the PedsQL.

Conclusions

The Kids-CAT measures pediatric HRQoL reliably, particularly in lower areas of HRQoL. Its test–retest reliability should be re-investigated in future studies. The validity of the instrument was demonstrated. Overall, results suggest that the Kids-CAT is a promising candidate for detecting psychosocial needs in chronically ill children.

     

Development and Validation of a Pain Behavior Assessment in Patients with Chronic Low Back Pain

Purpose High levels of pain behavior adversely affect the success of multidisciplinary rehabilitation of patients with chronic nonspecific low back pain (CNSLBP). Functional capacity evaluation (FCE) assessment should detect high levels of pain behavior to prevent the inclusion of unsuitable patients to functional rehabilitation programs. The aim of this study was to develop a Pain Behavior Assessment (PBA) and to evaluate its construct validity. Methods The PBA was developed by experts in the field and is literature-based. Inclusion criteria for participants of the validation study were: CNSLBP, age 20–60 years, referral for fitness-for-work evaluation. The PBA was applied by physiotherapists during FCE. Rasch analysis was performed to evaluate the construct validity of the PBA. Internal consistency was indicated by the person separation index (PSI), which corresponds to Cronbach’s alpha. Results 145 male (72.5 %) and 55 female patients were included. Rasch analysis removed 11 items due to misfit and redundancy, resulting in a final PBA of 41 items. Item mean fit residual was ?0.33 (SD 1.06) and total item Chi square 100.39 (df = 82, p = 0.08). The PSI value was 0.83. DIF analysis for age and gender revealed no bias. Conclusions The PBA is a valid assessment tool to describe pain behavior in CNSLBP patients. The high PSI-value justifies the use of the PBA in individuals. The PBA may help to screen patients for high levels of pain behavior.     

Reliability,validity and responsiveness of the Greek MacDQoL individualized measure of the impact of macular degeneration on quality of life

Purpose

To assess the psychometric properties of the Greek Macular Disease-Dependent Quality of Life Questionnaire (MacDQoL).

Methods

The MacDQoL was translated in Greek and administered to 191 patients with neovascular age-related macular degeneration (AMD). To assess validity, all patients completed the Greek SF-12 health survey and underwent vision measurements. For test–retest reliability, a subset of twenty participants completed the MacDQoL twice, 2 weeks apart. Responsiveness was assessed on 102 patients who completed the MacDQoL at a follow-up visit, 1 year later. Rasch analysis was used to assess the Greek MacDQoL’s response category functioning, precision, unidimensionality, targeting and differential item functioning.

Results

Internal and test–retest reliability of the average weighted impact (AWI) was 0.952 and 0.97, respectively. Test–retest reliability of MacDQoL items ranged from 0.78 to 0.99. Principal component analysis revealed three subscales (activities, embarrassment and family life), which were also confirmed by confirmatory factor analysis. Rasch analysis revealed poor functionality of response categories and that was resolved by collapsing response categories and using the impairment scores only. In terms of convergent validity, the AWI and revised MacDQoL scales showed significant correlations with SF-12 summary scales (ρ = 0.21–0.30) and vision assessments (ρ = 0.31–0.46). Poorer AMD-related QoL at 1-year follow-up was associated with deterioration in distance visual acuity and worse eye near visual acuity.

Conclusions

The Greek MacDQoL is a reliable, valid and sensitive to change in vision instrument for assessing AMD patients’ perceptions of QoL. However, Rasch analysis revealed that its multiplicative rating scale is flawed. Scientific measurement was restored with a number of revisions to the questionnaire.

     

Repeatability and Safety of the Functional Capacity Evaluation-One-Handed for Individuals with Upper Limb Reduction Deficiency and Amputation

Purpose To assess repeatability and safety of the functional capacity evaluation-one-handed (FCE-OH), a FCE-OH individuals, consisting of eight items. Method The FCE-OH protocol was administered twice to 23 individuals with upper limb absence (87% male; median age 46 years; median 2 days between sessions). To examine repeatability, test–retest reliability and agreement were assessed with the intraclass correlations coefficient (ICC) and limits of agreement (LoA), respectively. Reliability was considered acceptable when ICC-values were ≥0.75. Widths of LoA of four tests were compared with those of healthy adults. Safety and pain response were assessed with a questionnaire. Results After controlling for stability of construct, ICC-values ranged between 0.23 and 0.96, and widths of LoA ranged between 16 and 79%. Intertrial (learning) effects were present in three test items. No serious adverse reactions were reported. A pain response was reported by 30% of the participants. Conclusion Good or excellent reliability was observed in five tests, while three items showed poor or moderate test–retest reliability. Interpretation of agreement was possible for four tests, of which three showed widths of LoA similar to those reported in healthy adults. Learning effects were present; therefore, interpretation at the individual level should be performed with care. As the CI of several items were wide, confirmation of results in a larger sample is warranted. Safety was confirmed.     

Functional Capacity Evaluation in Upper Limb Reduction Deficiency and Amputation: Development and Pilot Testing

Purpose To develop and pilot test a functional capacity evaluation (FCE) for individuals with upper limb absence (ULA) due to reduction deficiency or amputation, and to examine the relationship between FCE results and presence of musculoskeletal complaints (MSC). Method Five tests (overhead lifting, overhead working, repetitive reaching, fingertip dexterity, and handgrip strength) were selected and adapted if necessary. The newly developed FCE, called FCE-One-Handed (FCE-OH), was pilot tested in 20 adults individuals with ULA, and 20 matched controls. MSC were assessed via a questionnaire. Results Adaptations were considered necessary for all tests, except the handgrip strength test. The repetitive overhead lifting test of the non-affected limb was added. On the overhead lifting test, individuals with above-elbow ULA (ten males), performed similar to controls using one hand. When lifting bimanually using the prosthesis, a trend for lower lifting capacity of individuals with below-elbow ULA (seven males, three females) was observed compared to controls. On the overhead working test, individuals with above-elbow ULA performed worse compared to controls. Other tests showed no significant differences between groups. Relationships between FCE results and presence of MSC were non-significant. Conclusion The FCE-OH can be used to test functional capacity of one-handed individuals. Individuals with ULA generally showed similar functional capacity as two-handed individuals. FCE results were not related to MSC. It was discussed that a higher physical load on the non-affected limb might reflect a relative deficit of functional capacity.     

Is It Safe? Reliability and Validity of Structured Versus Unstructured Child Safety Judgments

Background

The LIRIK, an instrument for the assessment of child safety and risk, is designed to improve assessments by guiding professionals through a structured evaluation of relevant signs, risk factors, and protective factors.

Objective

We aimed to assess the interrater agreement and the predictive validity of professionals’ judgments made with the LIRIK in comparison to unstructured judgments.

Method

In study 1, professionals made safety and risk judgments for 12 vignettes with the LIRIK (group 1, n = 36) or without an instrument (group 2, n = 43). In study 2, we compared professionals’ safety and risk judgments for 370 children made with the LIRIK (group 1, n = 278) or with no instrument (group 2, n = 92), with outcomes indicating actual unsafety in files 6 months later.

Results

In study 1, agreement about safety and risks was poor to moderate in both groups. Differences between groups were small and inconsistent. In study 2, the predictive validity of judgments was weak to moderate in both groups. In neither group had unsafe outcomes increased consistently when unsafety or risks were assessed as higher.

Conclusions

Judgments made with the LIRIK were not more reliable or valid than unstructured professional judgments. These findings raise important questions about the value of risk assessment instruments and about how professional safety and risk judgments can be improved.