Reliability in the assessment of paediatric somatosensory evoked potentials post cardiac arrest

ObjectiveTo measure inter- and intra-rater agreement in the interpretation of cortical somatosensory evoked potential (SSEP) components following paediatric cardiac arrest (CA) in multi-professional neurophysiology teams.MethodsThirteen professionals blinded to patient outcome interpreted 96 SSEPs in paediatric patients 24-/48-/72-hours following CA. Of these, 34 were duplicates used to assess intra-rater agreement. Consistent interpretations (absent/present/indeterminate) between scientists (who record/identify SSEP components) and neurophysiologists (who provide prognostic SSEP interpretation) were expressed as percentages. Rates of agreement were calculated using Fleiss’ kappa coefficient (K).ResultsUnanimous agreement between professionals was present in 40% (95%CI: 28–54%) of the interpreted SSEPs, with a K value of 0.62 (95%CI: 0.55–0.70) based on average agreement. Agreement was similar between neurophysiologists (K = 0.67; 95%CI: 0.57–0.77) and scientists (K = 0.62; 95%CI: 0.54–0.70) but lower in patients < 2 years old (K = 0.23; 95%CI: 0.14–0.33) and in those with poor outcome (K = 0.21; 95%CI: 0.07–0.35). No SSEP was unanimously interpreted as absent and 92% (95%CI: 89–95%) of duplicate SSEPs were interpreted consistently.ConclusionDespite substantial agreement when interpreting prognostic SSEPs, this was significantly lower in children with poor outcome and of younger age.SignificanceClinicians using SSEPs in the intensive care unit should be aware of the inter-rater variability when interpreting SSEPs as absent.     

Confirmatory factor analysis and psychometric properties of the Emotion Regulation Questionnaire in participants with personality disorders

Emotional dysregulation is a key symptom in participants with personality disorders. The Emotional Regulation Questionnaire (ERQ) has been studied with nonclinical samples; however, it is necessary to confirm the factorial structure of the ERQ in participants with personality disorders. The aims of the present study were to confirm the factorial structure of the Spanish version of the ERQ and analyse its psychometric properties as well as the association between the ERQ and the Borderline Symptoms List (BSL-23) and the Difficulties in Emotion Regulation Scale (DERS). The overall sample was composed of 250 patients with personality disorders, of whom 195 met the criteria for borderline personality disorder. Confirmatory factor analysis was conducted. The two-factor model showed an acceptable fit, similar to the original structure, in the participants with personality disorders and with borderline personality disorder. Cognitive reappraisal was negatively correlated with the DERS and BSL-23, and expressive suppression was positively correlated with the BSL-23. The ERQ is a reliable and valid instrument to evaluate emotional dysregulation in participants with personality disorders and participants with borderline personality disorder.     

Puzzling With Online Games (BAM-COG): Reliability,Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults

Background

Online interventions are aiming increasingly at cognitive outcome measures but so far no easy and fast self-monitors for cognition have been validated or proven reliable and feasible.

Objective

This study examines a new instrument called the Brain Aging Monitor–Cognitive Assessment Battery (BAM-COG) for its alternate forms reliability, face and content validity, and convergent and divergent validity. Also, reference values are provided.

Methods

The BAM-COG consists of four easily accessible, short, yet challenging puzzle games that have been developed to measure working memory (“Conveyer Belt”), visuospatial short-term memory (“Sunshine”), episodic recognition memory (“Viewpoint”), and planning (“Papyrinth”). A total of 641 participants were recruited for this study. Of these, 397 adults, 40 years and older (mean 54.9, SD 9.6), were eligible for analysis. Study participants played all games three times with 14 days in between sets. Face and content validity were based on expert opinion. Alternate forms reliability (AFR) was measured by comparing scores on different versions of the BAM-COG and expressed with an intraclass correlation (ICC: two-way mixed; consistency at 95%). Convergent validity (CV) was provided by comparing BAM-COG scores to gold-standard paper-and-pencil and computer-assisted cognitive assessment. Divergent validity (DV) was measured by comparing BAM-COG scores to the National Adult Reading Test IQ (NART-IQ) estimate. Both CV and DV are expressed as Spearman rho correlation coefficients.

Results

Three out of four games showed adequate results on AFR, CV, and DV measures. The games Conveyer Belt, Sunshine, and Papyrinth have AFR ICCs of .420, .426, and .645 respectively. Also, these games had good to very good CV correlations: rho=.577 (P=.001), rho=.669 (P<.001), and rho=.400 (P=.04), respectively. Last, as expected, DV correlations were low: rho=−.029 (P=.44), rho=−.029 (P=.45), and rho=−.134 (P=.28) respectively. The game Viewpoint provided less desirable results with an AFR ICC of .167, CV rho=.202 (P=.15), and DV rho=−.162 (P=.21).

Conclusions

This study provides evidence for the use of the BAM-COG test battery as a feasible, reliable, and valid tool to monitor cognitive performance in healthy adults in an online setting. Three out of four games have good psychometric characteristics to measure working memory, visuospatial short-term memory, and planning capacity.     

Reliability of the Cutting Alignment Scoring Tool (CAST) to Assess Trunk and Limb Alignment During a 45-Degree Side-Step Cut

BackgroundThree-dimensional (3D) motion analysis is considered the gold standard for evaluating human movement. However, its clinical utility is limited due to cost, operating expertise, and lengthy data processing time. Numerous qualitative scoring systems have been introduced to assess trunk and lower extremity biomechanics during functional tasks. However, the reliability of qualitative scoring systems to evaluate cutting movements is understudied. Purpose/Hypotheses: To assess the inter-rater and intra-rater reliability of the Cutting Alignment Scoring Tool (CAST) among sports medicine providers and to evaluate rater agreement of each component of the CAST. The hypotheses were: 1) there would be good–to-excellent inter-rater and intra-rater reliability among sports medicine providers, 2) there would be good to almost perfect agreement for cut width and trunk lean variables and moderate to good agreement for valgus variables of the CAST.Study DesignRepeated MeasuresMethodsTen videos of a 45-degree side-step cut performed by adolescent athletes were independently rated on two occasions by six raters (2 medical doctors, 2 physical therapists, and 2 athletic trainers). The variables assessed include trunk lean to the opposite direction of the cut, increased cut width, knee valgus at initial load acceptance (static), and knee valgus throughout the task (dynamic). Variables were scored as either present, which were given a score of “1”, or not present, which were given a score of “0”. Video sequence was randomized in each rating session, and a two-week wash out period was given.ResultsThe cumulative inter-rater and intra-rater reliabilities were good (ICC: 0.808 and ICC: 0.753). Almost perfect kappa coefficients were recorded for cut width (k=0.949). Moderate kappa coefficients were found for trunk lean (k= 0.632) and fair kappa coefficients were noted for dynamic and static valgus (k=0.462 and k= 0.533 respectively).ConclusionThese findings suggest that the CAST is a reliable tool to evaluate trunk and LE alignment during a cutting task by sports medicine providers.Level of EvidenceLevel 2 Diagnosis     

Is “fear of passive movement” a distinctive component of the Fear-Avoidance Model in whiplash?

Objectives:Modify the Tampa Scale for Kinesiophobia (TSK) for ‘fear of passive motion’ beliefs.Methods:With permission, a 14-item modification, the TSK-PM (passive movement), was created. Test-retest reliability was tested first. Construct validity was tested in chronic whiplash patients by comparing the TSK-PM with the TSK, the Neck Disability Index (NDI) and cervical ranges of motion.Results:The TSK-PM showed high test-retest reliability (r = 0.83) and high correlation with the original TSK (r = 0.84). Low, non-significant correlations were found with other variables. NDI scores were strongly correlated with ranges of motion.Conclusions:While having high test-retest reliability and a single factor structure, the TSK-PM failed to demonstrate distinctive construct validity vs the original TSK. The original TSK is likely to be sufficient to assess fear of being moved in neck pain patients in a clinical setting. Modifications to the current version of the TSK-PM might improve its construct validity in future studies.     

中文修订版护理院治疗性环境筛查量表的信效度检验

目的检验中文修订版护理院治疗性环境筛查(Therapeutic Environment Screening Survey for Nursing Home,TESS-NH)量表信度和效度。方法通过系统的翻译、回译、德尔菲专家咨询对英文版TESS-NH量表汉化、修订,确立中文修订版TESS-NH量表的内容和条目,并进行信度和效度检验。结果中文修订版TESS-NH量表内容效度指数(CVI)平均值为0.980,折半信度为0.712,总量表Cronbach′sα系数为0.808,5个维度Cronbach′sα系数为0.716~0.770,重测信度为0.859,不同评定者间信度为0.872;各条目在所提取的相应公因子上的载荷值均大于0.5,因子分析提取的6个公因子共解释总变异的69.706%。结论中文修订版TESS-NH量表具有较好的信度和效度,可用于中国养老机构老年痴呆治疗性环境质量水平的评价和研究。     

The prevalence of asthma in Victorian adults

To determine the prevalence of asthma in Victorian adults, we carried out a cross-sectional postal survey utilising a new screening questionnaire which gathered data on self reported respiratory symptoms, whether asthma had been diagnosed and, if so, how it had been treated. Questionnaires were returned by 2198 (72%) of 3095 adults selected randomly from the Victorian electoral roll, an adequate response rate. The reported prevalences of individual asthmatic symptoms in the last 12 months ranged from 8% for nocturnal wheeze to 22% for current wheeze. Thirteen per cent of respondents had ever had asthma, 7% had experienced an attack within the last 12 months and 6% were currently taking medication.
The high prevalence of asthma revealed by our study has major implications for the planning of health services.