Inter- and Intra-Rater Reliability of a Newly Developed Assessment Scale: The Dyadic Interaction in Dementia Transfer Assessment Scale (DIDTAS)

ABSTRACT

Aim: To study the inter- and intra-rater reliability of a newly developed assessment scale, the Dyadic Interaction in Dementia Transfer Assessment Scale (DIDTAS). Methods: Two physiotherapists completed the observational form of the DIDTAS while watching 20 video-films of sit-to-stand-transfers or bedside transfers (i.e., caregiver-assisted transfers), videotaped in a dementia special care unit. Two-way analyses of variance (ANOVAs) were used for calculating ICC values of each item. Results: The results supported the overall reliability of the DIDTAS items with variations in inter- and intra-rater reliability, with ICC values from 0.35 to 0.92. Conclusion: On the basis of the transfer-related actions of dementia care dyads, the DIDTAS was shown to be sufficiently reliable. This in turn can provide healthcare professionals seeing and treating individuals suffering from dementia with a new method for assessing actions related to person transfer situations in dementia care facilities.     

Reliability,validity, and responsiveness of the Persian version of Shoulder Activity Scale in a group of patients with shoulder disorders

Abstract

Purpose: The aim of this methodological study was to cross-culturally translate the Shoulder Activity Scale (SAS) into the Persian and determine its clinimetric properties including reliability, validity, and responsiveness in patients with shoulder disorders. Method: Persian version of the SAS was obtained after standard forward-backward translation. Three questionnaires were completed by the respondents: SAS, shoulder pain and disability index (SPADI), and Short-Form 36 Health Survey (SF-36). The patients completed the SAS, 1 week after the first visit to evaluate the test–retest reliability. Construct validity was evaluated by examining the associations between the scores on the SAS and the scores obtained from the SPADI, SF-36, and age of the patients. To assess responsiveness, data were collected in the first visit and then again after 4 weeks physiotherapy intervention. Test–retest reliability and internal consistency were assessed using Intra-class Correlation Coefficient (ICC) and Cronbach’s alpha, respectively. To evaluate construct validity, Spearman’s rank correlation was used. The ability of the SAS to detect changes was evaluated by the receiver-operating characteristics method. Results: No problem or language difficulties were reported during translation process. Test–retest reliability of the SAS was excellent with an ICC of 0.98. Also, the marginal Cronbach’s alpha level of 0.64 was obtained. The correlation between the SAS and the SPADI was low, proving divergent validity, whereas the correlations between the SAS and the SF-36/age were moderate proving convergent validity. A marginally acceptable responsiveness was achieved for the Persian SAS. Conclusions: The study provides some evidences to support the test–retest reliability, internal consistency, construct validity, and responsiveness of the Persian version of the SAS in patients with shoulder disorders. Therefore, it seems that this instrument is a useful measure of shoulder activity level in research setting and clinical practice.

• Implications for Rehabilitation

• The shoulder activity scale (SAS) is a reliable, valid, and responsive measure of shoulder activity level in Persian-speaking patients with different shoulder disorders.

• The results on clinimetric properties of the Persian SAS are comparable with its original, English version.

• Persian version of the SAS can be used in “clinical” and “research” settings of patients with shoulder disorders.

     

French translation and validation of 3 functional disability scales for neck pain

OBJECTIVE: To translate and assess the reliability and the construct validity of 3 functional disability scales for neck pain. DESIGN: Reliability and validity study. SETTING: Tertiary care teaching hospital and outpatient clinic. PARTICIPANTS: One hundred one patients (mean age, 49 y). INTERVENTION: French translations were obtained by using the "translation-backward translation" method. Adaptations were made after a pilot study. MAIN OUTCOME MEASURES: Impairment outcome measures (visual analog scale [VAS] pain, neck range of motion, morning stiffness, score of neck sensitivity, radiologic score of Kellgren) and patients' perceived handicap (VAS) were recorded at the baseline visit. Three functional disability scales (Neck Disability Index [NDI], Neck Pain and Disability Scale [NPDS], Northwick Park Neck Pain Questionnaire [NPQ]) were recorded twice, at baseline visit and 24 hours later. Reliability was assessed by using the intraclass correlation coefficient (ICC) and the Bland and Altman method. Construct (convergent and divergent) validity was investigated by using the Spearman rank correlation coefficient and a factor analysis was performed. RESULTS: Test-retest was excellent for the NPDS and NDI (ICC =.91,.93, respectively) and good for the NPQ (ICC =.84). The Bland and Altman method showed no systematic trend. Expected convergent and divergent validity were observed only for the NPDS; 3 main factors were extracted by factor analysis and explained 78% of the cumulative variance. CONCLUSION: The 3 translated scales are valid, but the NPDS seems to have the best construct validity.     

Validation of a new lower-extremity motor coordination test

OBJECTIVE: To determine the test-retest reliability and construct validity of a new lower-extremity motor coordination test, the Lower Extremity MOtor COordination Test (LEMOCOT). DESIGN: To test reliability, subjects with impairments in at least 1 lower extremity were evaluated twice by the same evaluator. To test construct validity, the LEMOCOT scores obtained from subjects who had had a stroke were correlated with physical, functional, cognitive, and perceptual tests. SETTING: Geriatric day hospital and functional intensive rehabilitation unit. PARTICIPANTS: In the reliability test, 29 people (mean age, 69.6y; range, 28-87y); in the construct validity, 144 people who recently had had a stroke. INTERVENTION: Not applicable. MAIN OUTCOME MEASURES: In addition to the LEMOCOT, the following measures were used for construct validity: the Fugl-Meyer Assessment (motor function), Berg Balance Scale, 5-m walking test, 2-minute walking test, Functional Autonomy Measurement System, Modified Mini-Mental State Examination, and Motor-Free Visual Perceptual Test. RESULTS: Intraclass correlation coefficients (ICCs) indicated that test-retest reliability is good (right-side ICC=.88; left-side ICC=.83). The construct validity of the LEMOCOT was demonstrated by obtaining high correlations with physical and functional tests ( r range, .62-.79; P <.001) and no correlations with cognitive ( r =.11, P =.20) or visual perceptual tests ( r =.15, P =.08) and by discriminating between subjects discharged to long-term care versus other living environments ( P <.001). CONCLUSIONS: The LEMOCOT is a simple lower-extremity motor coordination test that showed good test-retest reliability and construct validity. It can be used in clinical and research settings, specifically with people who have had a stroke. Other studies should be carried out to confirm its psychometric properties.     

Psychometric properties of the extended Care Dependency Scale for older persons in Egypt

Aim. The aim of this study was to determine the validity and reliability of the modified Arabic Care Dependency Scale for self‐assessment of older persons in Egypt and to compare these self‐assessments to proxy assessments by care givers and family members. Background. The Care Dependency Scale is an internationally used instrument to measure care dependency. The Arabic version may improve data collection on this phenomenon in the Middle East where the population is ageing. Design. A cross‐sectional study with a sample of 611 older persons living in Greater Cairo. Participants belonged to three groups: nursing home residents, home care recipients and non‐care recipients; 459 participants were also rated by proxies and 171 repeated their self‐assessment after two weeks. Methods. The correlation between sum scores of the Care Dependency Scale and the Activities of Daily Living scale was calculated to establish criterion validity. Construct validity was determined by comparing care recipients and non‐care recipients with regard to their Care Dependency Scale sum scores and by exploratory factor analysis. Intraclass coefficients were used to assess test‐retest reliability of self‐ratings for each item. Mean differences between self and proxy assessment were calculated. Results. The Care Dependency Scale had a strong correlation to the Activities of Daily Living scale and is able to distinguish between care recipients and non‐care recipients. Factor analysis revealed one factor for basic needs and one factor for psychosocial needs. ICC values were >0·7 for most items related to the factor for basic needs among care recipients. Proxy assessment yielded higher care dependency than self assessment. Conclusion. Care Dependency Scale items for basic needs are suitable to assess care dependency among Egyptian care recipients. Relevance to clinical practice. Assessment of care dependency is useful to obtain data for appropriate resource allocation among care recipients.     

Assessment of pain and disability in patients with chronic neck pain: reliability and construct validity of the Turkish version of the neck pain and disability scale

OBJECTIVES: The objective of this study was to test whether a Turkish version of the Neck Pain and Disability Scale retains its reliability and validity of the original English version. METHODS: Sixty-one patients with chronic neck pain were enrolled in the study. The Neck Pain and Disability Scale (NPDS), the Pain Disability Index (PDI) and The Hospital Anxiety and Depression Scale (HADS) were filled by all subjects. Reliability was determined by internal consistency. Internal consistency was measured by calculating Cronbach's alpha and item-total correlation. Validity was examined by correlating the NPDS scores to the Visual Analogue Scale (VAS), PDI and HADS scores. RESULTS: Cronbach's alpha value for NPDS was found to be 0.86 and this was statistically significant (p<0.0001). The item-total correlations of NPDS varied between 0.08 and 0.69. The cross-sectional construct validity coefficients were 0.51 for PDI, 0.45 for VAS, 0.35 and 0.33 for Hospital Anxiety and Depression Scales. CONCLUSION: Despite its major limitations, our results seem to support previous findings of the English and French versions of the Neck Pain and Disability Scale, indicating that this functional scale is valid and reliable.     

The Cumberland ankle instability tool: a report of validity and reliability testing

OBJECTIVE: To test the Cumberland Ankle Instability Tool (CAIT), a 9-item 30-point scale, for measuring severity of functional ankle instability. DESIGN: Cross-sectional study. SETTING: General community. PARTICIPANTS: Volunteer sample of 236 subjects. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Concurrent validity by comparison with the Lower Extremity Functional Scale (LEFS) and a visual analog scale (VAS) of global perception of ankle instability by using the Spearman rho. Construct validity and internal reliability with Rasch analysis using goodness-of-fit statistics for items and subjects, separation of subjects, correlation of items to the total scale, and a Cronbach alpha equivalent. Discrimination score for functional ankle instability by maximizing the Youden index and tested for sensitivity and specificity. Test-retest reliability by intraclass correlation coefficient, model 2,1 (ICC(2,1)). RESULTS: There were significant correlations between the CAIT and LEFS (rho=.50, P<.01) and VAS (rho=.76, P<.01). Construct validity and internal reliability were acceptable (alpha=.83; point measure correlation for all items, >0.5; item reliability index, .99). The threshold CAIT score was 27.5 (Youden index, 68.1); sensitivity was 82.9% and specificity was 74.7%. Test-retest reliability was excellent (ICC(2,1)=.96). CONCLUSIONS: CAIT is a simple, valid, and reliable tool to measure severity of functional ankle instability.     

脑卒中后失能综合评估量表的汉化与信效度检验

目的 对脑卒中后失能综合评估量表进行汉化及信效度检验,探索该量表在国内的临床适用性。方法 采用Brislin双人直译-回译法、专家评议、预调查对量表进行文化调适,便利抽取203名脑卒中患者进行调查,对中文版量表进行项目分析,并验证其重测信度、评定者间信度、内容效度、效标关联效度。结果 脑卒中后失能综合评估量表重测信度相关性分析结果显示相关系数为0.988;评定者间信度Kappa系数为0.846（95%置信区间为0.793~0.899）,P<0.001;各条目内容效度指数均在0.833~1.000之间,量表内容效度指数为0.935;以改良Rankin量表为标准,效标关联效度系数为0.896。结论 中文版脑卒中后失能综合评估量表具有良好的信效度,可作为我国临床脑卒中失能评估工具。     

中文版决策自我效能量表在原发性肝癌患者治疗决策中的信效度检验

目的 对决策自我效能量表汉化,并通过在原发性肝癌患者决策中的应用进行信效度检验,以评价该量表在我国癌症患者治疗决策领域应用的可行性.方法 按照Brislin量表汉化原则,对量表进行翻译、回译和跨文化调适.采用便利抽样法选取150名原发性肝癌住院患者为研究对象,检验中文版决策自我效能量表的信效度.结果 中文版决策自我效能...     

情绪抑制量表的汉化及信效度检验

目的 汉化、修订情绪抑制量表,并检验其信度和效度。方法 基于Brislin翻译模型,采用专家咨询法进行跨文化调适,形成中文版情绪抑制量表,并对广州市某三级甲等医院302名癌症患者进行问卷调查以评估其信效度。结果 中文版情绪抑制量表包含14个条目,量表的内容效度指数为0.915。探索性因子分析提取了4个公因子,累计方差贡献率为65.58%,并通过验证性因子分析进行了验证。总量表的Cronbach α系数为0.717,各因子的Cronbach α系数范围为0.602~0.882,量表重测信度ICC值为0.855。结论 中文版情绪抑制量表具有良好的信度和效度,可以作为评估情绪抑制水平和情绪表达干预效果的有效量表。     

Reliability and validity of the Algase Wandering Scale – version 2 for Japanese people with dementia

In Japan, where older people already make up more than 23% of the population and the proportion is still growing, the burden on those caring for people with dementia is an increasing problem. This burden is magnified by wandering behavior, a peripheral symptom. Thus, there is a need for an objective measure of wandering behavior to determine what constitutes effective care. In this study, we translated the Algase Wandering Scale – Version 2 into Japanese, and examined its reliability and validity. Ambulatory residents with dementia were selected from two nursing homes and two wards specializing in dementia care in hospitals in Japan. Nurses and care workers taking care of these residents answered questionnaires regarding the residents. From the results, the Algase Wandering Scale – Version 2, Japanese version, was examined for inter‐rater reliability, stability, internal consistency, and concurrent validity. The results of the analysis in the present study demonstrated that the Algase Wandering Scale – Version 2, Japanese version, has reliability and validity, and that it can measure the presence or absence of wandering and its severity. Surveys of residents with various wandering patterns in many facilities and verification of construct validity are warranted in the future.     

照顾者内疚感量表的汉化及在老年痴呆患者家庭照顾者中的信效度检验

目的 汉化照顾者内疚感量表（Caregiver Guilt Questionnaire,CGQ）,并在老年痴呆患者家庭照顾者中检验其信效度。方法 依据Brislin翻译模型,翻译、回译量表,通过专家咨询和预调查,调试、修订量表。2021年4月—9月,对大连市120名老年痴呆患者的家庭照顾者进行调查,验证量表的信效度。结果 中文版CGQ共22个条目,总量表和各维度的Cronbach’s α系数为0.953、0.799～0.941;总量表和各维度的分半信度为0.881、0.799～0.936。内容效度指数为0.91,各条目均≥0.80,共析出5个公因子,分别为对受照顾者做错了事感到内疚、忽视其他亲人的内疚感、对他人有负面感觉的内疚感、未能应对护理挑战的内疚感、自我照顾的内疚感,累计方差贡献率为76.821%。结论中文版CGQ的信效度良好,适合国内老年痴呆患者照顾者内疚感水平的测量。     

A Chinese version of the Caring Assessment Report Evaluation Q-sort scale for measuring patients' perception on nurses' caring behaviours: Reliability and validity assessment

A reliable and valid instrument for understanding patients' perceptions of nurses' caring behaviour as well as assessing the quality of nursing care is necessary. The purpose of this study was to assess the reliability and validity of a Chinese version of the Caring Assessment Report Evaluation Q-sort (CARE-Q) Scale for the measurement of patients' perceptions of nurses' caring behaviours. The study sample comprised 250 patients from a medical centre in central Taiwan. Content validity, construct validity, internal consistency and stability reliability were assessed. The Content Validity Index of the Chinese version of CARE-Q was 0.90. Cronbach's alpha indicated good internal consistency reliability. Stability reliabilities for the six subscales ranged from 0.83 to 0.92. The results reveal that the Chinese version of the CARE-Q scale for the measurement of patients' perceptions on nurses' caring behaviours indicates high reliability (internal consistency and stability) and good content validity.     

Alberta infant motor scale: reliability and validity when used on preterm infants in Taiwan

BACKGROUND AND PURPOSE: The goal of this study was to examine the reliability and validity of measurements obtained with the Alberta Infant Motor Scale (AIMS) for evaluation of preterm infants in Taiwan. SUBJECTS: Two independent groups of preterm infants were used to investigate the reliability (n=45) and validity (n=41) for the AIMS. METHODS: In the reliability study, the AIMS was administered to the infants by a physical therapist, and infant performance was videotaped. The performance was then rescored by the same therapist and by 2 other therapists to examine the intrarater and interrater reliability. In the validity study, the AIMS and the Bayley Motor Scale were administered to the infants at 6 and 12 months of age to examine criterion-related validity. RESULTS: Intraclass correlation coefficients (ICCs) for intrarater and interrater reliability of measurements obtained with the AIMS were high (ICC=.97-.99). The AIMS scores correlated with the Bayley Motor Scale scores at 6 and 12 months (r=.78 and.90), although the AIMS scores at 6 months were only moderately predictive of the motor function at 12 months (r=.56). CONCLUSION AND DISCUSSION: The results suggest that measurements obtained with the AIMS have acceptable reliability and concurrent validity but limited predictive value for evaluating preterm Taiwanese infants.     

老年住院患者安全危险因素评估量表的初步研制

目的：初步研制老年住院患者安全危险因素评估量表。方法：在文献研究、问卷调查的基础上拟定量表条目池,通过两轮专家函询对条目进行评定形成预测量表,选取217名老年住院患者进行调查,筛选预测量表条目并检验其信度、效度,进一步完善量表。结果：该量表由5个维度、27个条目构成。各维度内部一致性Cronbach’sα系数为0.677～0.805,量表总体Cronbach’sα系数为0.799,重测信度Pearson相关系数为0.857～0.933,量表总体重测信度系数为0.938。各维度的内容效度为0.78～0.95,量表总体内容效度为0.90。结论：该量表具有良好的信度与效度,为正式量表的形成奠定了基础。     

Reliability and Feasibility of the Pain Assessment in Advanced Dementia Scale–Korean Version (PAINAD-K)

BackgroundThere is currently no observational instrument for assessing pain in aged patients who are unable to provide self-report in long-term care hospitals in Korea.AimsThe goal of this research was to culturally adapt and test the validity, reliability, and feasibility of the Korean version of the Pain Assessment in Advanced Dementia Scale.DesignThis was a methodologic study aiming to translate the Pain Assessment in Advanced Dementia Scale.Participants/SubjectsThe inpatients in a 270-bed LTC hospital in D metropolitan city were assessed pain levels.MethodsThe Pain Assessment in Advanced Dementia (PAINAD) Scale was used as an observation scale to assess 192 long-term care hospital patients, with observation durations of 1 and 5 minutes.ResultsThe interrater reliability (1 minute) for the scale showed substantial kappa agreement of .62, and scores for the 1- and 5-minute observations showed almost perfect agreement of .95. The criterion validity of the scale (1 minute) was high relative to the Face-Legs-Activity-Cry-Consolability (FLACC) Scale, and low compared with the numeric rating scale (NRS). Discriminant validity was established between patients with and without pain. The feasibility of the Pain Assessment in Advanced Dementia Scale–Korean Version (PAINAD-K) (1 minute) indicated low sensitivity of 41.3% and high specificity of 92.6%.ConclusionsTherefore, the PAINAD-K is a valid and reliable tool to determine the absence of pain in non-verbal aged patients.     

French translation and validation of a functional disability scale for neck pain]

OBJECTIVES: To translate and to assess the reliability and the construct validity of the French translation of the Neck Pain and Disability Scale (NPDS), an American functional disability scale for neck pain. PATIENTS AND METHODS: Non randomised prospective study, where patients with neck disorders were included. Impairment outcomes measures (VAS Pain, range of motion of neck, score of neck sensitivity, radiologic score of Kellgren) and patientsperceived handicap (VAS) were recorded at the baseline visit. Disability was assessed with the NPDS, that was recorded twice, at baseline visit and 24 hours later. Reliability was assessed using the intraclass correlation coefficient (ICC) and the Bland and Altman method. Construct (convergent and divergent) validity was investigated using the Spearman rank correlation coefficient and a factor analysis was performed. RESULTS: One hundred and one patients were included. French versions were obtained using the "translation/backward translation" method. Expected convergent (r = 0.51 with VAS Pain, 0.63 with VAS Functional Disability, 0.67 with VAS Handicap) and divergent (r = 0.39 and 0.49 respectively for the anxiety and depression scores of HAD, palpation sensitivity r = 0.31, neck mobility r = - 0.45 and 0.28, and Kellgrens radiologic score r = 0.04) validity were observed, suggested good construct validity. Test-retest was excellent for NPDS with ICC = 0.91. The Bland and Altman method showed distribution of differences homogenous and no systematic trend. Three mains factors were extracted by factors analysis of the NPDS, and explained 78% of the cumulative variance. CONCLUSION: The French version of NPDS has good metrologic qualities. This scale can be used in clinical practice to assess disability in neck pain and to normalise disability assessment.     

Chinese translation and validation of the Nowicki-Strickland Locus of Control Scale for Children

The objective of this study is to evaluate the psychometric properties of the Chinese version of the Nowicki-Strickland Locus of Control Scale for Children for its utility in clinical research and nursing practice. The scale was translated from the original English language into the Chinese language and the reliability and validity of the translated scale were tested. Results showed that there was high test re-test reliability, acceptable internal consistency reliability, appropriate content validity, concurrent validity and construct validity. It is concluded that the psychometric properties of the Chinese version of the Nowicki-Strickland Locus of Control Scale for Children presented in this paper supports its feasibility as a research instrument to measure children's locus of control objectively and appropriately in the Chinese population.     

Development and validation of the Chinese version of the Diabetes Management Self-efficacy Scale

OBJECTIVE: The purpose of this study was to translate the Diabetes Management Self-Efficacy Scale (DMSES) into Chinese and test the validity and reliability of the instrument within a Taiwanese population. RESEARCH DESIGN AND METHODS: A two-stage design was used for this study. Stage I consisted of a multi-stepped process of forward and backward translation, using focus groups and consensus meetings to translate the 20-item Australia/English version DMSES to Chinese and test content validity. Stage II established the psychometric properties of the Chinese version DMSES (C-DMSES) by examining the criterion, convergent and construct validity, internal consistency and stability testing. The sample for Stage II comprised 230 patients with type 2 diabetes aged 30 years or more from a diabetes outpatient clinic in Taiwan. RESULTS: Three items were modified to better reflect Chinese practice. The C-DMSES obtained a total average CVI score of .86.The convergent validity of the C-DMSES correlated well with the validated measure of the General Self-Efficacy Scale in measuring self-efficacy (r=.55; p<.01). Criterion-related validity showed that the C-DMSES was a significant predictor of the Summary of Diabetes Self-Care Activities scores (Beta=.58; t=10.75, p<.01). Factor analysis supported the C-DMSES being composed of four subscales. Good internal consistency (Cronbach's alpha=.77 to .93) and test-retest reliability (Pearson correlation coefficient r=.86, p<.01) were found. CONCLUSIONS: The C-DMSES is a brief and psychometrically sound measure for evaluation of self-efficacy towards management of diabetes by persons with type 2 diabetes in Chinese populations.