Validation of the Test of Visual Perceptual Skills-Third Edition in patients with stroke

Purpose: The Test of Visual Perceptual Skills-Third Edition (TVPS-3) with seven subscales has been used to assess visual perception in patients with stroke. The purpose of this study was to investigate ecological validity, convergent validity, and discriminative validity of the TVPS-3 in patients with stroke.

Methods: One hundred patients were assessed with the TVPS-3, two measures of activities of daily living, and two cognitive measures. To examine ecological validity, we calculated correlations (Pearson’s r) among the TVPS-3 and two measures of activities of daily living. To examine convergent validity, correlations (r) were estimated among the TVPS-3 and two cognitive measures. To examine discriminative validity, independent t-test was used to compare the two groups with different levels of disability and to detect whether there were statistically significant differences in the TVPS-3 between these groups.

Results: The correlations were 0.21–0.48 among the TVPS-3 and two measures of activities of daily living. The correlations were 0.29–0.68 among the TVPS-3 and two cognitive measures. Between the two groups, the t-test results showed statistically significant difference (p?<?0.05) for the overall scale and the five subscales of the TVPS-3.

Conclusions: The TVPS-3 has acceptable convergent validity, ecological validity, and discriminative validity and is useful to assess the visual perception in patients with stroke.

• Implications for rehabilitation

• The Test of Visual Perceptual Skills-Third Edition is a motor free visual perception test, which is an adequate tool for use in patients with stroke.

• The Test of Visual Perceptual Skills-Third Edition showed acceptable ecological validity, convergent validity, and discriminative validity in patients with stroke.

     

ICF通用组合在中国人群临床应用中的效度研究

目的:探讨ICF通用组合在中国人群临床功能评估中的结构效度,为其临床应用提供依据。方法:采用ICF通用组合功能评估量表,于入院和出院时两个时间点对来自全国21个省份和自治区50家医院康复医学科、神经内科或脑外科、心血管科、呼吸科和骨科4510名患者进行评估。所得数据用于评价ICF通用组合在临床功能评估中的结构效度。结果:"d850有报酬的就业"不适用于NRS评分,缺失值较大。除去此项,患者出院时ICF通用组合评分(15.25±13.48)分,低于入院时(23.76±15.15)分,差异有显著性意义(P0.001)。探索性因子分析结果表明,抽取特征根1的公因子共有2个,累积贡献率为78.018%。采用结构方程模型方法,拟合了"b130能量和驱力功能"、"b152情感功能"、"b280痛感"、"d230执行日常事务"、"d450步行"、"d455到处移动"关系模型,结构方程模型调整的拟合优度指数RMSEA=0.026,NFI=0.999,CFI=0.999,AGFI=0.994,模型较好的拟合了数据。结论:ICF通用组合能反映出、入院时患者的不同功能状态且其结构效度良好,是一种临床上有效的测量患者功能状态的工具。     

Reliability and validity issues in social validation research involving persons with developmental disabilities

Social validation procedures have become increasingly important in research involving persons with developmental disabilities. Unfortunately, there has not been a corresponding increase in the methodological rigor in which the social validation approaches have been utilized. This paper addresses reliability and validity issues in social validation research involving persons with developmental disabilities. Suggestions on how to better utilize reliability and validity measures are offered.     

Construct validation of the English version of Readiness for Interprofessional Learning Scale (RIPLS): Are Chinese undergraduate students ready for ‘shared learning’?

Interprofessional education has been receiving attention as a result of research suggesting the benefits of interpersonal collaboration in healthcare. In Hong Kong, the implementation of the Interprofessional Team-based Learning programme provides implicit call to study the psychometric properties of Readiness for Interprofessional Learning Scale (RIPLS) to clarify if this is a valid measure when used in the Chinese undergraduate healthcare context. This study examines the psychometric properties of RIPLS involving predominantly Chinese undergraduate healthcare students in Hong Kong. Using within- and between-network approaches to construct validity, we investigated the applicability of English version of RIPLS among 469 predominantly Hong Kong Chinese students who have competence in the English language. These participants were from complementary health professional programmes: biomedical sciences, chinese medicine, medicine, nursing, and pharmacy, from two universities in Hong Kong. The within-network test results indicated that RIPLS had good internal consistency reliability. Results of the confirmatory factor analysis lend support to the overall factor structure of hypothesized four-factor solution although one item obtained non-significant factor loading. The between-network test also suggests that various subscales of RIPLS correlated systematically with theoretically relevant constructs: collective efficacy, team impact on quality of learning, and team impact on clinical reasoning ability. The RIPLS is a valid measure to estimate the Chinese undergraduate healthcare students’ readiness to engage in interprofessional learning.     

Cross-validation and discriminant validity of Adolescent Health Promotion Scale among overweight and nonoverweight adolescents in Taiwan

This study used cross-validation and discriminant analysis to evaluate the construct and discriminant validity of Adolescent Health Promotion (AHP) scale between the overweight and nonoverweight adolescents in Taiwan. A cross-sectional survey method was used and 660 adolescents participated in this study. Cluster and discriminant analyses were used to analyze the data. Our findings indicate that the AHP is a valid and reliable scale to discriminate between the health-promoting behaviors of overweight and nonoverweight adolescents. For the total scale, cluster analyses revealed two distinct patterns, which we designated the healthy and unhealthy groups. Discriminate analysis supported this clustering as having good discriminant validity, as nonoverweight adolescents tended to be classified as healthy, while the overweight tended to be in the unhealthy group. In general, overweight adolescents practiced health-related behaviors at a significantly lower frequency than the nonoverweight. These included exercise behavior, stress management, life appreciation, health responsibility, and social support. These findings can be used to further develop and refine knowledge of adolescent overweight and related strategies for intervention.     

结构化面试在护士长选拔中的效度实证研究

目的通过分析用于护士长选拔工作中结构化面试的结构效度和实证效度，提出进一步完善结构化面试测评指标体系的建议。方法运用因素分析法对结构化面试的结构效度进行分析，运用追踪调查问卷法，把已上岗1年后的护士长的工作实绩作为效标，对结构化面试的实证效度进行研究。结果根据因子分析的结果可知，结构化面试通过7个测评要素，主要测查了考生的4种潜在特质，其中每种潜在特质都通过某一测评要素充分体现出来。通过问卷调查可知，用人部门对通过结构化面试选拔任用的护士长的工作表现非常满意，有87．5％的选用护士长被用人部门评价为优秀。结论结构化面试具有较好的结构效度和实证效度，但是测评指标需要进一步修正完善。     

临床记忆量表在帕金森病患者中的效度分析

目的对临床记忆量表在帕金森病患者中效度进行分析。方法对60 例帕金森病患者进行临床记忆量表及MMSE 测评。结果帕金森病患者临床记忆量表与MMSE 显著相关(r=0.608, P<0.001)。无记忆障碍组临床记忆量表得分高于记忆障碍组(P<0.05)。结论临床记忆量表用于评价帕金森病患者的记忆损害其标准效度及区分效度较好。     

Psychometric properties of the Five-Digit Test in patients with stroke

Purpose: To examine the ecological validity, predictive validity, and responsiveness of the Five Digit Test (FDT) in patients with stroke. Methods: We included inpatients with stroke (n?=?144, 114 and 105 in the ecological validity, predictive validity, and responsiveness analysis, respectively) in the study. At admission, the FDT and Barthel Index (BI) were assessed; at discharge, the FDT, BI, Postural Assessment Scale for Stroke Patients (PASS), and Mobility Subscale of the Stroke Rehabilitation Assessment of Movement (MO-STREAM) were assessed. Results: In the ecological validity analysis, the scores of the selective and alternating attention indices of the FDT were moderately correlated with those of the BI at admission and discharge (Spearman ρ?=?–0.38 to –0.45). In the predictive validity analysis, the scores of the two attention indices of the FDT at admission were moderately correlated with the scores of the BI, PASS, and MO-STREAM at discharge (ρ?=?–0.33 to –0.45). In the responsiveness analysis, the two attention indices of the FDT between admission and discharge had large differences (success rate difference?=?0.56–0.67, Wilcoxon Z?=?–5.90 to –6.60). Conclusion: Our results indicate that the selective and alternating attention indices of the FDT have acceptable ecological validity, predictive validity, and good responsiveness in patients with stroke.

• Implications for Rehabilitation

• The Five Digit Test (FDT), an efficient and culture-free assessment tool, has been used to assess selective attention and alternating attention

• The selective index and alternating attention index of the FDT showed acceptable ecological validity, predictive validity, and good responsiveness in patients with stroke.

     

Triangulation in clinical practice

• The aim of the article is to clarify the research term ‘triangulation’.
• Examples are given to illustrate the use of triangulation in clinical practice.
• The strength of using triangulation in both the design and analysis stages are highlighted.

     

Using an interpreter in qualitative interviews: does it threaten validity?

There is an extensive literature on the problem of translating scales for use across cultures, but very little is published on the problems of conducting qualitative interviews in another language with assistance of an interpreter. The aim of this paper is to describe and discuss threats to validity that arise when conducting qualitative interviews using an interpreter. Ten female student nurses in two cities in Lithuania were interviewed about how they perceived their educational program. All interviews were conducted in English with an interpreter. When using an interpreter to conduct interviews, potential threats to validity arise at various points in the interview process. A threat arises when the researcher, whose first language is Swedish, addresses a question in English to the interpreter, another during the translation by the interpreter from English to Lithuanian, and again when the interpreter translates the interviewee's Lithuanian responses to English. In the last situation, the researcher may not know whether the interpreter has summarized and/or modified the responses. To mitigate these problems, the interpreter should not only have the required linguistic abilities, but also be trained in the research field. The researcher has to be aware of these threats to validity and make efforts to meet and limit their effects.     

Reliability and validity of the UTBAS-TR (The Unhelpful Thoughts and Beliefs Scale-the Turkish version) in the Turkish population

Abstract

Purpose: This paper decribes the development of the Turkish adaptation of UTBAS (UTBAS-TR) and reports the results concerning its applicability and psychometric structure.

Method: The sample consisted of 81 males and 19 females diagnosed with developmental stuttering in two centres. Test-retest reliability score was obtained by correlating results of repeated aplications of the scale within a one-week interval and a paired t-test was calculated to see the differences in the total and UTBAS I, II and III scores. The internal consistency was assessed using the Cronbach’s alpha. Construct validity was also assessed by examining inter-scale correlations and with the correlations of the UTBAS-TR with two other scales (State-Trait Anxiety Inventory (STAI) and Beck Anxiety Inventory (BAI)).

Result: The internal consistency of the UTBAS-TR and the test and retest reliability score was stati?stically significant. The correlation between UTBAS-TR total score and the UTBAS-TR I, II and III correlations were high. A significant correlation was observed between UTBAS-TR total score with State Anxiety Inventory. However, the correlations between UTBAS-TR-Total Score and Trait Anxiety Inventory and Beck Anxiety Inventory were low.

Conclusion: The UTBAS-TR proved to be suitable for use with the Turkish population.     

The Reliability and Validity of Measures of Gait Variability in Community-Dwelling Older Adults

Brach JS, Perera S, Studenski S, Newman AB. The reliability and validity of measures of gait variability in community-dwelling older adults.

Objective

To examine the test-retest reliability and concurrent validity of variability of gait characteristics.

Design

Cross-sectional study.

Setting

Research laboratory.

Participants

Older adults (N=558) from the Cardiovascular Health Study.

Interventions

Not applicable.

Main Outcome Measures

Gait characteristics were measured using a 4-m computerized walkway. SD determined from the steps recorded were used as the measures of variability. Intraclass correlation coefficients (ICC) were calculated to examine test-retest reliability of a 4-m walk and two 4-m walks. To establish concurrent validity, the measures of gait variability were compared across levels of health, functional status, and physical activity using independent t tests and analysis of variances.

Results

Gait variability measures from the two 4-m walks demonstrated greater test-retest reliability than those from the single 4-m walk (ICC=.22–.48 and ICC=.40–.63, respectively). Greater step length and stance time variability were associated with poorer health, functional status and physical activity (P<.05).

Conclusions

Gait variability calculated from a limited number of steps has fair to good test-retest reliability and concurrent validity. Reliability of gait variability calculated from a greater number of steps should be assessed to determine if the consistency can be improved.     

Responsiveness and predictive validity of the computerized digit vigilance test in patients with stroke

Abstract

Purpose: To investigate the responsiveness and predictive validity of the computerized digit vigilance test (C-DVT) in inpatients receiving rehabilitation following stroke.

Methods: Forty-nine patients completed the C-DVT and the Barthel Index (BI) after admission to and before discharge from the rehabilitation ward. The standardized response mean (SRM) was used to examine the responsiveness of the C-DVT. We used a paired t-test to determine the statistical significance of the changes in scores on the C-DVT. We estimated the predictive validity of the C-DVT with the Pearson correlation coefficient (r) to investigate the association between the scores of the C-DVT at admission and the scores of the BI at discharge.

Results: Our data showed a small SRM (?0.31) and a significant difference (paired t-test, p?=?0.034) between the C-DVT scores at admission and discharge. These findings indicate that the C-DVT can appropriately detect changes in sustained attention. In addition, we found a moderate association (r?=?0.48) between the scores of the C-DVT at admission and the scores of the BI at discharge, suggesting the sufficient predictive validity of the C-DVT.

Conclusions: Our results showed that the C-DVT had adequate responsiveness and sufficient predictive validity in inpatients receiving rehabilitation following stroke.

• Implications for rehabilitation

• The computerized digit vigilance test (C-DVT) had adequate responsiveness to be an outcome measure for assessing the sustained attention in inpatients receiving rehabilitation after stroke.

• The C-DVT had sufficient predictive validity to predict daily function in inpatients receiving rehabilitation after stroke.

     

Descriptions of functioning and health and relations to a gross motor classification in adults with cerebral palsy

Purpose:?The aim of this study was to describe functioning and health, and explore the use of the Gross Motor Function Classification System (GMFCS) in an adult population with cerebral palsy (CP).

Methods:?From a cohort of 199 persons, 48 persons were selected for structured interviews and functional assessments regarding activities of daily living, motor function, range of motion, pain and general health.

Results:?A third of the population had deteriorated in function from adolescence to adulthood according to the GMFCS. The majority were independent in personal ADL, but many of those were dependent in instrumental ADL. Motor function scores reflected problems in walking ability, and limited ROM and pain were common in all functional levels. General health was lower than in a general population. GMFCS seems valid for classifying adults with CP since it is correlated with instruments measuring motor function and ADL in terms of dependence.

Conclusion:?Decreased functional ability and secondary musculoskeletal problems are common in adults with CP and general health can be associated with those problems. It is important to further explore health aspects and relations between health status and self-perceived health. The GMFCS is a useful tool, especially for comparisons throughout the life span, but in order to use in an adult population further development is needed.     

The Spinal Cord Independence Measure (SCIM) version III: Reliability and validity in a multi-center international study

Purpose. To examine the third version of the Spinal Cord Independence Measure (SCIM III) for reliability and validity in a multi-center cohort study.

Method. Four hundred and twenty-five patients with spinal cord lesions from 13 spinal cord units in six countries from three continents were assessed with SCIM III and the Functional Independence measure (FIM) on admission to rehabilitation and before discharge.

Results. Total agreement between raters was above 80% in most SCIM III tasks, and all kappa coefficients were statistically significant (P < 0.001). The coefficients of Pearson correlation between the paired raters were above 0.9, and intraclass correlation coefficients were above 0.94. Cronbach's α was above 0.7. The coefficient of Pearson correlation between FIM and SCIM III was 0.790 (P < 0.01). SCIM III was more responsive to changes than FIM in the subscales of Respiration and sphincter management and Mobility indoors and outdoors.

Conclusions. The results support the reliability and validity of SCIM III in a multi-cultural setup. Despite several limitations of the study, the results indicate that SCIM III is an efficient measure for functional assessment of SCL patients and can be safely used for clinical and research trials, including international multi-center studies.     

Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review

Abstract

Background: This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. Methods: A systematic review study design was used and searched six databases, including one website. The research question guiding the search was developed a priori and registered with the PROSPERO database of systematic reviews: “Are there reliable and valid instruments for measuring fatigue among EMS personnel?” (2016:CRD42016040097). The primary outcome of interest was criterion-related validity. Important outcomes of interest included reliability (e.g., internal consistency), and indicators of sensitivity and specificity. Members of the research team independently screened records from the databases. Full-text articles were evaluated by adapting the Bolster and Rourke system for categorizing findings of systematic reviews, and the rated data abstracted from the body of literature as favorable, unfavorable, mixed/inconclusive, or no impact. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology was used to evaluate the quality of evidence. Results: The search strategy yielded 1,257 unique records. Thirty-four unique experimental and non-experimental studies were determined relevant following full-text review. Nineteen studies reported on the reliability and/or validity of ten different fatigue survey instruments. Eighteen different studies evaluated the reliability and/or validity of four different sleepiness survey instruments. None of the retained studies reported sensitivity or specificity. Evidence quality was rated as very low across all outcomes. Conclusions: In this systematic review, limited evidence of the reliability and validity of 14 different survey instruments to assess the fatigue and/or sleepiness status of EMS personnel and related shift worker groups was identified.