The Visual Association Test-Extended: a cross-sectional study of the performance validity measures

Objective: Given the hazards of knowledge about performance validity tests (PVTs) being proliferated among the general public, there is a continuous need to develop new PVTs. The purpose of these studies was to validate the newly developed Visual Association Test-Extended (VAT-E). Method: The VAT-E consists of 24 pairs of line drawings; it is partly based on Green’s Word Memory Test (WMT) paradigm. In study 1, we compared VAT-E total scores of healthy controls (n = 226), patients with mild cognitive impairment (MCI) (n = 76), patients with Alzheimer’s disease (AD) (n = 26), and persons instructed to feign memory deficit (n = 29). In study 2, we compared litigating patients classified by Slick’s criteria as Malingering of Neurocognitive Dysfunction (MND) (n = 26) or non-MND (n = 67). In addition, we compared the VAT-E to the Test of Memory Malingering (TOMM) (study 1) and the WMT (study 2). Results: Results showed that the VAT-E differentiated patients with MCI (specificity 93–100%) or patients with AD (specificity 92–100%) from persons instructed to feign (sensitivity 86–100%). The VAT-E also differentiated MND from non-MND (sensitivity 54%, specificity 97%). The VAT-E was in perfect agreement with the TOMM in classifying healthy controls and persons instructed to feign, and it was in moderate agreement with the WMT in classifying non-MND and MND. Conclusion: Preliminary evidence shows that the VAT-E may be a useful PVT based on the ability to differentiate between those with genuine memory impairment, persons instructed to feign memory impairment, and a group suspected of malingering cognitive deficits.     

Exploring the sensitivity of the Personality Assessment Inventory symptom validity tests in detecting response bias in a mixed neuropsychological outpatient sample

Objective: Few studies have evaluated the symptom validity tests (SVTs) within the Personality Assessment Inventory (PAI) in a neuropsychological assessment context. Accordingly, the present study explored the accuracy of PAI SVTs in identifying exaggerated cognitive dysfunction in a mixed sample of outpatients referred for neuropsychological assessment. Method: Participants who failed two or more Performance Validity Tests (PVTs) were classified as having exaggerated cognitive dysfunction (n = 49). Their responses on PAI SVTs were compared to examinees who did not fail PVTs (n = 257). Results: Multivariate analysis of variance indicated the Negative Impression Management (NIM) scale most strongly discriminated between those with exaggerated cognitive dysfunction from honest responders (Cohen’s d = .58). Nonetheless, its classification accuracy was low (area under the curve [AUC] = .65). A k-means cluster analysis and a subsequent multinomial logistic regression indicated evidence for two distinct groups of exaggerators. In particular, one group seemed to exaggerate symptoms, whereas another presented in a defensive manner, implying that individuals with positive and NIM biases on the PAI were apt to display invalid performance on PVTs. Conclusions: Findings indicated that exaggerated cognitive dysfunction tends to be present when NIM is very high and that evidence exists for a defensive response style on the PAI in the context of PVT failure.     

Psychometric properties of the Actual Week test: a naturalistic prospective memory task

Objective: Prospective memory is the ability to ‘remember to remember’ and a facet of memory important to everyday functioning. For older adults, prospective memory slips are a common concern. In the present study, we conducted an initial validation of a paper-and-pencil adaptation of the Actual Week test, and reported on internal consistency, inter-rater and test-retest reliability, convergent and divergent validity, as well as veridicality of the task. Method: Fifty-eight healthy, community-dwelling older adults were recruited from a larger randomized controlled trial and tested at baseline. The Actual Week test was a naturalistic five-day prospective memory task where participants were assigned eight hypothetical tasks to remember per day for five days. Tasks were either time-cued or event-cued and regular (i.e. occurring daily) or irregular (i.e. varied each day). The proportion of tasks that were recorded as on time and accurate was used as the primary measure of performance. Results: The Actual Week test had good internal consistency (Kuder–Richardson: r > .8), intra-test (intraclass correlation: α > .9) and test-retest reliability (r = .76). There was also evidence for convergent and divergent validity. Task performance was associated with age, but not years of education or sex. Conclusion: The Actual Week test demonstrated strong psychometric qualities and promising evidence for validity as a performance-based measure of everyday prospective memory in older adults. Avenues for future studies include extending the evidence for convergent validity and evaluating feasibility and utility with other clinical populations.     

Neuropsychological functioning in preschool-aged children undergoing evaluation for organ transplant

Abstract

Objective: The purpose of this study was to review the current literature on neuropsychological functioning in two groups of children requiring organ transplants (liver or heart) and present recent clinical data collected through the liver and cardiac transplantation programs at a large pediatric academic medical center. Method: Data included in this study came from 18 patients who completed evaluations for heart transplant (n = 8) or liver transplant (n = 10) between the ages of 2 and 6 years (inclusive). Measures examining neurocognitive, emotional-behavioral, and adaptive functioning were collected as part of standard pre-transplant clinical neuropsychological evaluations. Within each organ group, mean scores were calculated and compared with normative population mean scores using one sample t-tests. In addition, non-parametric binomial tests were calculated to examine whether the proportion of individuals falling more than one standard deviation below the population mean was significantly greater in the patient groups than the normative population base rate of 16%. Results: Patients in both groups performed below normative expectation in several neurocognitive and adaptive domains. However, neither group showed significant difficulties in behavioral or emotional regulation. Conclusions: Results from this study document cognitive delays in preschool-aged children undergoing evaluations for liver transplant or heart transplant, highlighting the importance of intervention and long-term monitoring of these two patient populations, as well as the need for neuropsychologist involvement with transplant teams.     

Performance validity in older adults: Observed versus predicted false positive rates in relation to number of tests administered

Introduction: This study examined false positive rates on embedded performance validity tests (PVTs) in older adults grouped by cognitive status.

Method: The research design involved secondary analysis of data from the National Alzheimer’s Coordinating Center database. Participants (N = 22,688) were grouped by cognitive status: normal (n = 10,319), impaired (n = 1,194), amnestic or nonamnestic mild cognitive impairment (MCI; n = 5,414), and dementia (n = 5,761). Neuropsychological data were used to derive 5 PVTs.

Results: False positive rates on individual PVTs ranged from 3.3 to 26.3% with several embedded PVTs showing acceptable specificity across groups. The proportion of participants failing two or more PVTs varied by cognitive status: normal (1.9%), impaired (6.6%), MCI (13.2%), and dementia (52.8%). Comparison of observed and predicted false positive rates at different specificity levels (.85 or .90) demonstrated significant differences in all comparisons. In normal and impaired groups, predicted rates were higher than observed rates. In the MCI group, predicted and observed comparisons varied: Predicted rates were higher with specificity at .85 and lower with specificity at .90. In the dementia group, predicted rates underestimated observed rates.

Conclusions: Despite elevated false positives in conditions involving severe cognitive compromise, several measures retain acceptable specificity regardless of cognitive status. Predicted false positive rates based on the number of PVTs administered were not observed empirically. These findings do not support the utility of simulated data in predicting false positive rates in older adults.     

Poor peer relations predict parent- and self-reported behavioral and emotional problems of adolescents with gender dysphoria: a cross-national,cross-clinic comparative analysis

This study is the third in a series to examine behavioral and emotional problems in children and adolescents with gender dysphoria in a comparative analysis between two clinics in Toronto, Ontario, Canada and Amsterdam, the Netherlands. In the present study, we report Child Behavior Checklist (CBCL) and Youth Self-Report (YSR) data on adolescents assessed in the Toronto clinic (n = 177) and the Amsterdam clinic (n = 139). On the CBCL and the YSR, we found that the percentage of adolescents with clinical range behavioral and emotional problems was higher when compared to the non-referred standardization samples but similar to the referred adolescents. On both the CBCL and the YSR, the Toronto adolescents had a significantly higher Total Problem score than the Amsterdam adolescents. Like our earlier studies of CBCL data of children and Teacher’s Report Form data of children and adolescents, a measure of poor peer relations was the strongest predictor of CBCL and YSR behavioral and emotional problems in gender dysphoric adolescents.     

Normative data for phonemic and semantic verbal fluency test in the adult French–Quebec population and validation study in Alzheimer’s disease and depression

Objective: Verbal fluency tasks are principally used to assess lexical access and have shown usefulness for differential diagnosis. The purpose of Study 1 was to provide normative data in the adult French–Quebec population (Canada) for semantic verbal fluency (animals), for two sets of phonemic verbal fluency (TNP and PFL), and for letter P alone (60 seconds per category/letter). The objectives of Study 2 were to establish the diagnostic and predictive validity of the present tasks and normative data in Alzheimer’s disease (AD) and major depressive episode (MDE). Method: The normative sample consisted of 932 participants aged 19–91 years. Based on multiple linear regressions, equations to calculate Z-scores were provided. To assess validity, performance of 62 healthy participants was compared to 62 participants with AD and 41 with MDE aged over 50. Results: Age and education, but not gender, predicted performance on each verbal fluency task. Healthy adults aged 50 and younger had a better performance on semantic than phonemic verbal fluency. In comparison to MDE, AD participants had lower performance on animals and TNP, but not on letter P. Ninety percent of people with a Z-score ≤ ?1.50 on semantic verbal fluency had AD and the global accuracy was 76.6%. Test–retest reliability over one year was high for both animals (r = .711) and TNP (r = .790) in healthy older participants, but dropped for animals in people with AD (r = .493). Conclusions: These data will strengthen accurate detection of verbal fluency deficits in French–Quebec adults.     

Strategies of successful and unsuccessful simulators coached to feign traumatic brain injury*

Objective: The present study evaluated strategies used by healthy adults coached to simulate traumatic brain injury (TBI) during neuropsychological evaluation. Method: Healthy adults (n = 58) were coached to simulate TBI while completing a test battery consisting of multiple performance validity tests (PVTs), neuropsychological tests, a self-report scale of functional independence, and a debriefing survey about strategies used to feign TBI. Results: “Successful” simulators (n = 16) were classified as participants who failed 0 or 1 PVT and also scored as impaired on one or more neuropsychological index. “Unsuccessful” simulators (n = 42) failed ≥2 PVTs or passed PVTs but did not score impaired on any neuropsychological index. Compared to unsuccessful simulators, successful simulators had significantly more years of education, higher estimated IQ, and were more likely to use information provided about TBI to employ a systematic pattern of performance that targeted specific tests rather than performing poorly across the entire test battery. Conclusion: Results contribute to a limited body of research investigating strategies utilized by individuals instructed to feign neurocognitive impairment. Findings signal the importance of developing additional embedded PVTs within standard cognitive tests to assess performance validity throughout a neuropsychological assessment. Future research should consider specifically targeting embedded measures in visual tests sensitive to slowed responding (e.g. response time).     

The Beneficial Effects of Massage on Motor Development and Sensory Processing in Young Children with Developmental Delay: A Randomized Control Trial Study

ABSTRACT

Purpose: We investigated the effects of massage on young children with developmental delay but no clear diagnosis (e.g., cerebral palsy, genetic diseases, or autism).

Methods: Thirty-six children with DD, at 1–3 years of age, were randomly assigned to the massage (n = 18) or control group (n = 18) after being stratified by age and motor developmental quotient. The two groups continued to receive routine rehabilitation intervention, whereas the massage group additionally received 20 min of massage twice a week for 12 weeks. The Comprehensive Development Inventory for Infants and Toddlers – Diagnostic Test, the Infant/Toddler Sensory Profile – Chinese version, anthropometric measures, and a sleep questionnaire were administrated before and after the massage intervention.

Results: The results of analysis of covariance revealed that the massage group exhibited a greater improvement in the total motor score (p = 0.023), gross motor score (p = 0.047), and sensory sensitivity behavior (p = 0.042).

Conclusion: These findings suggest that massage can effectively enhance motor and sensory processing in children with DD.     

Performance on a 1-week delayed recall task is associated with medial temporal lobe structures in neurologically normal older adults

Objective: Traditional episodic memory tests employ a delayed recall length ranging from 10 to 30 min. The neurobiological process of memory consolidation extends well beyond these time intervals, however, raising the possibility that these tests might not be fully sensitive to the subtle neurocognitive changes found in early disease or age-related decline. We aimed to determine the sensitivity of a 1-week delayed recall paradigm to medial temporal lobe (MTL) structure among neurologically normal older adults. Methods: One hundred and forty functionally intact, older adults (mean age = 75.8) completed a story recall test in which participants learned to 90% criterion. Recall was tested after 30-min and 1-week. Participants also completed a standardized list learning task with a 20-min delay (n = 129) and a structural brain MRI. The MTL, including the parahippocampal gyrus, hippocampus, and entorhinal, was our primary region of interest. Results: Controlling for age, education, gender and total intracranial volume, the standard 20- and 30-min recalls showed no significant relationship with MTL. In contrast, 1-week recall was uniquely associated with MTL structure (partial r = .24, p = .006), specifically entorhinal (partial r = .27; p = .001) and hippocampal (partial r = .21, p = .02) volumes. Conclusion: Memory paradigms that utilize 1-week delays are more sensitive than standard paradigms to MTL volumes in neurologically normal older adults. Longer delay periods may improve detection of memory consolidation abilities associated with age-related, and potentially pathological, neurobehavioral change.     

Behavioural/emotional problems in Brazilian children: findings from parents' reports on the Child Behavior Checklist

Background.To compare Child Behavior Checklist (CBCL) findings for a large Brazilian general population sample with those for US children considering: (a) mean problem item ratings; (b) fit of the US-derived CBCL 8-syndrome model; (c) scale internal consistency measured by Cronbach''s alphas; (d) effects of society, age, gender on CBCL problem scores; and (e) ability to discriminate referred from non-referred children.Methods.Parents of 1228 non-referred 6-to-11-year-olds from three different regions of Brazil and 247 referred 6-to-11-year-olds from one clinic rated their children''s behavioural and emotional problems using the CBCL/6–18.Results.Results for mean item ratings and scale internal consistencies were very similar to those found in the US and in Uruguay. Confirmatory factor analysis indicated that Brazilian data showed the best fit to the US 8-syndrome model of all countries studied to date. Gender patterns were comparable to those reported in other societies, but mean problem scores for non-referred Brazilian children were higher than those for US children. Therefore, the CBCL discriminated less well between non-referred and referred children in Brazil than in the US.Conclusions.Overall, our findings replicated those reported in international comparisons of CBCL scores for 31 societies, thereby providing support for the multicultural robustness of the CBCL in Brazil.Key words: CBCL, confirmatory factor analysis, psychological assessment, psychometric, multicultural     

Family appraisal of paediatric acquired brain injury: a social work clinical intervention trial

ABSTRACT

Objective: To compare the efficacy of a new intervention ‘Family Forward’ with ‘Usual Care’ social work practice in optimising family appraisal of a child’s acquired brain injury to ensure better adaptation during the inpatient rehabilitation phase of care and early transition home.

Research Design: Single site, prospective, sequential comparison group design.

Methods and Procedures: Families were recruited on admission to an inpatient rehabilitation service based at a tertiary paediatric hospital. The ‘Usual Care’ group (n = 22; 29 parents) recruitment, intervention and data collection were completed first (Phase 1), followed by the ‘Family Forward’ group (n = 25; 43 parents) (Phase 2). Parents/caregivers completed measures: (Impact of Event Scale- Revised: IES-R; Parents Experience of Childhood Illness and Brief Illness Perception Questionnaire: Brief IPQ) at the time of their child’s inpatient rehabilitation admission, inpatient rehabilitation discharge, and 6 weeks post-discharge.

Main Outcomes and Results: There were more children with traumatic brain injuries in the Family Forward group (n = 13) than Usual Care (n = 6) and the Family Forward group had a longer hospital admission (days, M = 56.4, SD = 46.1 vs. M = 37.5, SD = 16.4, p = 0.019). No significant group differences were found for family appraisal outcomes at any of the three time-points. Both groups reported reductions in trauma and grief responses, emotional experiences and perceptions of their child’s injury at post-intervention and follow-up. Both groups continued to have depleted emotional resources (PECI scale) at 6 weeks post-discharge.

Conclusions: The study contributes important insights into family appraisal experience in the early stages following paediatric acquired brain injury. In this context, ‘Family Forward’ needs to incorporate interventions that support and promote ongoing family appraisal as issues related to their child’s injury arise over time. Future research is needed to focus on whether the Family Forward approach does sustain family system adaptation (a key aim informing the design of the intervention) over the longer term.     

Embedded performance validity tests within the Hopkins Verbal Learning Test – Revised and the Brief Visuospatial Memory Test – Revised

Objective: Various research studies and neuropsychology practice organizations have reiterated the importance of developing embedded performance validity tests (PVTs) to detect potentially invalid neurocognitive test data. This study investigated whether measures within the Hopkins Verbal Learning Test – Revised (HVLT-R) and the Brief Visuospatial Memory Test – Revised (BVMT-R) could accurately classify individuals who fail two or more PVTs during routine clinical assessment.Method: The present sample of 109 United States military veterans (Mean age = 52.4, SD = 13.3), all consisted of clinically referred patients and received a battery of neuropsychological tests. Based on performance validity findings, veterans were assigned to valid (n = 86) or invalid (n = 23) groups. Of the 109 patients in the overall sample, 77 were administered the HLVT-R and 75 were administered the BVMT-R, which were examined for classification accuracy.Results: The HVLT-R Recognition Discrimination Index and the BVMT-R Retention Percentage showed good to adequate discrimination with an area under the curve of .78 and .70, respectively. The HVLT-R Recognition Discrimination Index showed sensitivity of .53 with specificity of .93. The BVMT-R Retention Percentage demonstrated sensitivity of .31 with specificity of .92.Conclusions: When used in conjunction with other PVTs, these new embedded PVTs may be effective in the detection of invalid test data, although they are not intended for use in patients with dementia.     

Reliability and validity of the CogState computerized battery in patients with seizure disorders and healthy young adults: comparison with standard neuropsychological tests

Objective: The aim was to examine the reliability and validity of two measures of learning and memory within the CogState Computerized Battery: the One Card Learning (OCL) and the Continuous Paired Associative Learning (CPAL). Comparison of various reliable change measures was also included to examine rate of correct cognitive change classification, in particular, when using the Within-Subject Standard Deviation (WSD). Method: The OCL and the CPAL tests were administered twice and compared to standard and experimental versions of conventional neuropsychological tests in patients with seizure disorders (Baseline n = 80, Follow-up = 54) and university students (Baseline n = 89, Follow-up n = 87). Calculations of Reliable Change Indices (RCIs) on individual performance were obtained to detect reliable change across time using published CogState and current study parameters. Results: Results showed low retest reliabilities in both OCL and CPAL tests (r’s = .49–.77). Small to medium convergent validity correlations with traditional tests of learning and working memory were also found. Discrepancies in RCIs methods on performance estimation were observed when different test parameters and reliabilities were used. In contrast to recent recommendations by publishers of the CogState tests, the WSD method was found to substantially increase the rate of Type-I error when tests reliabilities were low. Conclusions: Unsatisfactory reliability and validity estimates suggest caution regarding the CogState computerized measures of learning and memory as opposed to conventional tests. Caution should be used when interpreting OCL and CPAL test scores, as confidence intervals may be wide and encompass much of the population range. In line with previous recommendations, use of the WSD to detect change in performance over time should be avoided in neuropsychological testing, as this change measure is prone to elevated misclassification rates compared to other methods. Further independent research is needed to improve the psychometrics of CogState OCL and CPAL measures.     

Base rate comparison of suboptimal scores on the RBANS effort scale and effort index in Parkinson’s disease

Objective: The effort index (EI) and the effort scale are commonly used embedded effort indicators on the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). This investigation examined the rates of suboptimal scores on the EI and effort scale in a Parkinson’s disease (PD) sample. Method: One hundred and sixty-three participants who have been diagnosed with PD by a board-certified neurologist were included in the study. The base rate of suboptimal scores on the EI and effort scale was calculated for the entire group. Results: On average, participants were 66.8 years of age (SD = 9.5) and had a mean education of 13.5 years (SD = 2.79). The mean Mini-Mental State Examination score was 27.0 (SD = 3.1). Overall, 8% of participants scored below the cut-off for optimal performance on the EI while 62.6% performed in the suboptimal range for the effort scale. Conclusion: The utility of the EI and the effort scale in PD populations warrants further examination. Additionally, results demonstrate the need for validation of embedded RBANS effort measures in various disease populations.     

Duruöz Hand Index: Is it valid and reliable in children with unilateral cerebral palsy?

ABSTRACT

Purpose: To investigate the validity and reliability of the Duruöz Hand Index (DHI) in patients with unilateral cerebral palsy (CP). Methods: Assessments of patients (n = 23) were performed using the Modified Ashworth Scale (MAS), the Manual Ability Classification System (MACS), the grip and pinch strength tests, and DHI. Following the data collection, retest of DHI was administered telephonically within a 2-week period. Results: Test–retest reliability and internal consistency of DHI were found to be excellent with a Cronbach’s alpha value of 0.93 and an intraclass correlation coefficient value of 0.94. The correlation between the DHI and MACS was detected significantly high (r = 0.840, p = < 0.010). The DHI also correlated with grip and pinch strength in the affected side (r = ?0.459, p = < 0.050; r = ?0.509, p = < 0.050). Conclusions: DHI is a valid and reliable questionnaire for patients with unilateral CP.     

Together at school intervention programme. A pilot study on the feasibility and perceived benefits of a programme focusing on improving socio-emotional skills among schoolchildren in Finland

The aim of the Together at School Intervention Programme developed for the Finnish school system was to improve socio-emotional skills and prevent psychosocial problems among children (7?12 years). The aim of this pilot study was to evaluate the feasibility, safety and perceived benefits of the programme in order to justify its large-scale implementation for a randomized controlled study. Altogether, 23 classrooms from Grades 1–6 (N = 549, n = 451 children) in four schools participated in the study. Informants were teachers (n = 23), head masters (n = 4), children (n = 451) and their parents. Data were collected by questionnaires at three time points. The different tools assessed were considered to be beneficial for the children by 92?100% of the teachers, and pleasant to participate in by 73?89% of the children. During the follow-up, emotional symptoms reduced significantly among boys. Bullying behaviour was significantly reduced according to both teachers and children. The findings of this pilot study were encouraging.     

A cross-cultural comparison between samples of Brazilian and German children with ADHD/HD using the Child Behavior Checklist

Introduction This study aims to assess cross-cultural similarities and differences in broadband psychopathology in two naturalistic clinical samples of children diagnosed with Attention Deficit Hyperactivity Disorder (ADHD) combined type according to DSM-IV criteria or with Hyperkinetic Disorder (HD) according to ICD-10 criteria. Methods We compared two clinical samples of children with ADHD combined type (Brazil, N = 248) and HD (Germany; N = 154) to controls (Brazil N = 71; Germany N = 135) using the Child Behavior Checklist (CBCL). ROC-curves (Receiver Operating Characteristic) were determined to evaluate the discriminating validity of the CBCL Attention Problem scale. A two-factorial ANOVA was computed across all 8 scales of the CBCL. Results Although Brazilian parents reported significantly higher scores on all CBCL scales than German parents (P < 0.05), a similar CBCL profile was detected in both cultures. Conclusion Despite the use of different diagnostic systems (DSM-IV vs. ICD-10) and the presence of other clinical differences, the similar broadband psychopathological profile of the CBCL in the two samples provides evidence that dimensional symptoms associated with the categorical diagnosis of ADHD combined type might be comparable in two clinical settings with diverse cultural background.