Parent and Teacher Concordance of Child Outcomes for Youth with Autism Spectrum Disorder

Cross-informant ratings of are considered gold standard for child behavioral assessment. To date, little work has examined informant ratings of adaptive functioning for youth with autism spectrum disorder (ASD). In a large, diverse sample of youth with ASD, this study evaluated parent–teacher concordance of ratings of adaptive functioning and ASD-specific symptomatology across time. The impact of child clinical characteristics on concordance was also examined. Participants included 246 children, their caregivers and teachers. Parent–teacher concordance was variable but generally consistent across time. Concordance was significantly impacted by autism severity and child cognitive abilities. Findings inform the broader concordance literature and support the need to consider child clinical factors when assessing child functioning in samples of children with ASD.     

Parents report more ADHD symptoms than do teachers in children with epilepsy

Children with epilepsy have a high rate of attention deficit/hyperactivity disorder (ADHD), yet parent-teacher agreement on ADHD symptoms in epilepsy is unknown despite the need to assess symptoms across settings such as home and school. Parent-teacher agreement on ADHD ratings was investigated in 208 children with epilepsy (mean age = 11.2, SD = 3.6) using the ADHD Rating Scale IV, along with associations with demographic variables, epilepsy severity, adaptive level, and quality of life. Children were four times more likely to be identified as having clinically elevated ADHD symptoms when parent ratings were the benchmark versus teachers. Agreement was highest for children with more severe ADHD symptoms, for the Hyperactivity-Impulsivity dimension of behavior, and for children with broadly normal adaptive behavior. Higher parent and teacher ADHD ratings were related to reduced quality of life, but unrelated to epilepsy severity. Exclusive reliance on parent or teacher ratings may yield variable rates of ADHD symptoms in children with epilepsy.     

Patterns of agreement among parent, teacher and youth ratings in a referred sample

ObjectiveThe purpose of this study was to investigate the degree of agreement among parents, teachers and adolescents with respect to the Child Behavior Checklist (CBCL), the Teacher's Report Form (TRF), and the Youth Self Report (YSR). In addition we evaluated the suitability of these three forms (CBCL, TRF and YSR) in terms of their contribution to understanding internalizing and externalizing disorders in youths being referred to a child and adolescent unit of a psychiatric care facility.MethodsA total of 611 patients aged 11–18 years (mean age 13.0, SD 1.6) were assessed using the CBCL, the TRF and the YSR.ResultsIntraclass coefficients (ICC) showed low to moderate agreement among informants. Furthermore, the level of agreement was generally less among patients suffering from internalizing disorders than for young patients who displayed externalizing disorders. Logistic regression revealed that the TRF internalizing syndrome scale, the CBCL internalizing syndrome scale and gender were relevant prognostic factors for the occurrence of internalizing disorders in youth. The YSR internalizing syndrome scale, on the other hand, was not a relevant factor among adolescents of a clinical target population. Likewise, only the TRF externalizing syndrome scale, the CBCL externalizing syndrome scale and gender were relevant prognostic factors for the occurrence of externalizing disorders in youth.ConclusionsParticularly the CBCL and TRF are useful instruments in assessing internalizing and externalizing disorders in adolescents referred to a mental health setting.     

Assessment of child psychopathology: relationships between different methods, different informants and clinical judgment of severity

The purpose of this study was to assess the relationships between information on children's problem behavior obtained by different methods (rating scales and clinical interviews) and from different sources (adolescent, parents and teacher). From a sample of 132 14-year-old international adoptees and their parents, information was obtained via the Child Behavior Checklist (CBCL), the Youth Self-Report and the Teacher's Report Form, the Child Assessment Schedule, and the Graham and Rutter Parent Interview. Agreement between the CBCL and the clinical judgment of the severity of psychopathology was substantial. Assessment procedures providing data on the adolescents' functioning derived from different sources revealed less agreement than those derived from the same informant. Agreement was higher for externalizing than for internalizing behaviors. Data from different sources made unique contributions to clinicians' judgments of the severity of psychopathology.     

Examining the Criterion Validity of CBCL and TRF Problem Scales and Items in a Large Singapore Sample

This study examined the criterion validity of the Child Behavior Checklist (CBCL) and Teacher’s Report Form (TRF) problem scales and items in demographically-matched Singapore samples of referred and non-referred children (840 in each sample for the CBCL and 447 in each sample for the TRF). Internal consistency estimates for both the CBCL and TRF scales were good. Almost all CBCL and TRF problem scales and items significantly discriminated between referred and non-referred children, with referred children scoring higher, as expected. The largest referral status effects were on attention problems scales and their associated items, with the TRF having larger effects than the CBCL. Effect sizes for demographic variables such as age, gender, ethnicity and SES were much smaller than effect sizes for referral status, across both the CBCL and TRF forms and at both the scale and item levels. These findings suggest that teachers can be effective partners in identifying children who need mental health services and those who do not.     

Dysregulation in pediatric obsessive compulsive disorder

Although obsessive compulsive disorder (OCD) and common co-occurring conditions share deficits in self-regulatory abilities, there has been minimal examination of impaired self-regulation (dysregulation) in youth with OCD. This study examined the association of dysregulation with symptom severity, impairment, and treatment outcome in pediatric OCD. Clinicians assessed obsessive-compulsive severity, family accommodation and global severity in 144 youth with OCD. Youth completed self-report severity ratings of anxiety and depressive symptoms. Parents completed the Child Behavior Checklist (CBCL), and both children and parents completed parallel ratings of obsessive-compulsive impairment. Ninety-seven youth received cognitive behavioral therapy (CBT) and were re-assessed after treatment. Dysregulation was assessed using the CBCL-Dysregulation Profile. Before treatment, dysregulated youth exhibited greater obsessive-compulsive symptom severity, depressive mood, family accommodation, and impairment than non-dysregulated youth. The magnitude of dysregulation directly predicted child-rated impairment, parent-rated impairment, and family accommodation, beyond obsessive-compulsive severity. The magnitude of pretreatment dysregulation predicted treatment discontinuation but not treatment response. Obsessive-compulsive symptom severity and dysregulation level significantly decreased after CBT. Dysregulated youth with OCD presented as more clinically severe than their non-dysregulated counterparts, and may require more individualized interventions to reduce dysregulated behavior to prevent CBT attrition. For treatment completers, CBT was associated with a decrease in dysregulation level.     

A method for estimating duration of illness in Alzheimer's disease

BACKGROUND: We developed a set of questions for generating an estimate regarding the date of first symptoms to the nearest half-year. Physicians then revised this estimate in conjunction with medical record review and patient/informant interviews, and by testing the estimate by recall of life events. One experienced examiner rated 36 patients, and each was independently rated by a second, less experienced rater. The physician ratings were compared to each other and to an unstructured caregiver estimate of duration using Lin concordance coefficients. There was excellent agreement between independent physician raters (rho = 0.95, p < 0.001). Caregiver estimates of duration were usually shorter because of failure to relate the first symptoms to the onset of disease.     

Patient versus informant reported quality of life in the earliest phases of Alzheimer's disease

OBJECTIVES: The study investigated if patient and informant reported Quality of Life (QoL) differed in early Alzheimer's disease (AD). In addition, we examined whether anosognosia had an impact on the agreement between patient and informant ratings of QoL and whether anosognosia, dementia severity, depression and behavioural symptoms were significantly correlated to QoL in early AD. METHODS: From a prospective research program including newly referred patients (age >60 years and MMSE > or = 20), 48 patients with very early AD were included. QoL was assessed using the QoL-AD and EQ-5D scales. Anosognosia was rated on a categorical scale by an examiner. MMSE, Geriatric Depression Scale, Danish Adult Reading Test and Frontal Behavioural Inventory were also administered. RESULTS: On most QoL measures patients rated their QoL higher than their informants. Anosognosia was not associated with QoL but significantly with an inverse impact on the agreement between patient and informant ratings of QoL. Self-reported QoL was significantly correlated to depression but not to age, dementia severity, behavioural symptoms or memory impairment. Informant ratings of QoL were significantly correlated to behavioural symptoms and informant ratings on the EQ-5D Visual Analogue Scale were significantly correlated to patient reported depression. CONCLUSION: Patients with early AD generally reported higher QoL than their informants. This disagreement was associated with the presence of anosognosia. Self-reported QoL did not correlate with the MMSE score. Behavioural changes and depressive symptoms may be associated with low QoL.     

The premonitory urge revisited: An individualized premonitory urge for tics scale

BackgroundPremonitory urge ratings have advanced our understanding of urge phenomenology among individuals with tic disorders (TD). However, these ratings have been limited by their reliance on a single global dimension of urge severity. This study examined the psychometric properties of a novel scale called the Individualized Premonitory Urge for Tics Scale (I-PUTS) that assesses urge severity across multiple dimensions (number, frequency, and intensity).MethodSeventy-five youth with a TD and their parents participated. Clinicians assessed youth's tic severity, depression severity, rages, and premonitory urges. Parents completed ratings of youth's anxiety, affect lability, and general psychopathology. Youth completed self-report ratings of anxiety, urge severity, and distress tolerance.ResultsThe I-PUTS identified that youth experienced an average of three distinct urges, but had an average of seven tics over the past week. Urges were primarily localized in the head/face, neck/throat, and arm regions. All I-PUTS dimensions exhibited excellent inter-rater reliability. The I-PUTS dimensions exhibited good convergent validity with global urge ratings and tic severity, and appropriate divergent validity from other clinical constructs. Youth who exhibited discrepant reports between clinician-administered and self-report urge ratings had less anxiety and tic severity, and greater inattention and externalizing problems compared to youth who exhibited good agreement.ConclusionsThe I-PUTS is a reliable and valid assessment of urge phenomena, which provides additional and complementary information to existing urge scales. It highlights the existence of multiple dimensions of urge severity, and presents particular utility when assessing urges in youth with TD who have inattention and externalizing problems.     

A twin study investigating the genetic and environmental aetiologies of parent,teacher and child ratings of autistic-like traits and their overlap

In the present study we investigated phenotypic agreement between informants (parent, teacher and child self-report) on ratings of autistic-like traits and compared the genetic and environmental aetiologies of the informants’ ratings and of their covariance. Parents and teachers of >2,500 pairs from a community twin sample completed an abbreviated Childhood Asperger Syndrome Test (CAST). The twins also completed an adapted self-report version of the CAST. Structural equation model-fitting was carried out. Correlations between raters were significant but moderate (0.16–0.33). The magnitude of heritability estimates of autistic-like traits varied across raters, being highest for parent-rated autistic-like traits (82–87%) and more modest for child self-reported autistic-like traits (36–47%). Genetic overlap was significant but moderate across all raters. These findings are discussed in relation to population screening for autism and future genetic research.     

Ratings of Early Major Depressive Disorder Symptom Change During a Brief Psychiatric Hospitalization

Ratings of change in MDD severity during a brief psychiatric hospitalization were examined across informant sources to determine the extent of change from admission to discharge and if specific symptoms are especially likely to change. Study participants were 137 inpatients with a primary diagnosis of MDD. Symptom data were collected at admission and discharge from attending psychiatrists, nurses, and patients. Global ratings of MDD severity and specific MDD symptoms significantly decreased during the course of hospitalization. This effect held across informant sources. All symptoms were equally likely to change. Females were rated as more depressed at admission and discharge by psychiatrists, but no gender differences were seen in self-report or nurse ratings. Shorter length of stay and involuntary admission status were associated with greater reduction in MDD severity. The temporal course and magnitude of the symptom reduction may result in part from unique aspects of an inpatient setting or from an underreporting of symptoms. The association between a shorter length of stay and greater symptom reduction may reflect a distinction between treatment responders and nonresponders.     

Agreement between parent- and self-reports of Algerian adolescents' behavioral and emotional problems

The present study examined agreement between scores obtained from self-reports of behavioral and emotional problems obtained from 513 Algerian adolescents on the Youth Self-Report (YSR) with scores obtained from reports provided by their parents on the Child Behavior Checklist (CBCL). The correlations between self- and parent-report were larger than those observed in many other cultures (e.g., intraclass correlation coefficient = 0.60 and Pearson r = 0.65 for Total Problems). On the whole, cross-informant agreement did not vary significantly as a function of problem type, identity of the parental informant, gender and age of the adolescent. Similar to all studied cultures, adolescents on average reported more problems than their parents reported about them, but the discrepancies were smaller than in all previous societies. Mean YSR/CBCL score discrepancies indicated higher YSR scores for several scales, but variability across dyads was large, and many dyads showed the opposite pattern.     

Rating scales for dystonia: a multicenter assessment.

The evaluation of dystonia requires a reliable rating scale. The widely used Fahn-Marsden Scale (F-M) has not been sufficiently tested across multiple centers and investigators. The Dystonia Study Group developed the Unified Dystonia Rating Scale (UDRS) and a Global Dystonia Rating Scale (GDS) to serve as instruments to assess dystonia severity. In this study, 25 dystonia experts evaluated the UDRS, F-M, and GDS for internal consistency and reliability. One hundred dystonia patients were videotaped using a standardized videotape protocol. Each examiner rated 20 patients using the UDRS, F-M, and GDS in random order. The examiner then assessed each scale for ease of use. Statistical analysis used Cronbach's alpha, intraclass correlation coefficients (ICC), generalized weighted kappa statistic, and Kendall's coefficient of concordance. The UDRS, F-M, and GDS showed excellent internal consistency (Cronbach's alpha 0.89-0.93) and good to excellent correlation among the raters (ICC range from 0.71-0.78). Inter-rater agreement was fair to excellent (Kendall's 0.54-0.87; kappa 0.37-0.91) being lowest for eyes, jaw, face, and larynx. The modifying ratings (Duration in the UDRS and Provoking Factor in the F-M) showed less agreement than the motor severity ratings. Among scales, the total scores correlated (Pearson's r, 0.977-0.983). Overall, 74% of raters found the GDS the easiest to apply. The GDS with its simplicity and ease of application may be the most useful dystonia rating scale.     

Multiple Informant Agreement of Child,Parent, and Teacher Ratings of Child Anxiety Within Community Samples

Objective:

Extant research concerning the degree of multiple informant (that is, parent, clinician, teacher, and child) agreement for child anxiety ratings generally uses clinical samples, and results have been mixed.

Method:

Our study used a community sample of public school children (n = 1039) to investigate child (self), parent, and teacher reports of child anxiety across 3 time points (pretreatement, posttreatment, and follow-up) in 3 independent school prevention and intervention trials.

Results:

Results showed that parents and teachers had high informant agreement for ratings on anxiety across the 3 time points (r = 0.95 to 0.96, P < 0.001); agreement between parent and child (self) reports and between teacher and child (self) reports consistently showed lower agreement across the 3 time points (r = 0.14 and 0.28, respectively, P < 0.001). Group differences were also significant for sex and grade, whereby females more commonly self-reported higher anxiety and children in grades 3 and 4 self-reported higher anxiety, compared with students in grades 5 to 7.

Conclusion:

Correlations between parent and teacher with child ratings were poor over 3 time points, and significant differences were found for sex and grade. Research is needed to understand reasons for poor concordance between parent, child, and teacher ratings of anxiety for all children.     

The Symptoms and Functioning Severity Scale (SFSS): Psychometric Evaluation and Discrepancies Among Youth, Caregiver, and Clinician Ratings Over Time

This paper describes the development and psychometric evaluation of the symptoms and functioning severity scale (SFSS), which includes three parallel forms to systematically capture clinician, youth, and caregiver perspectives of youth symptoms on a frequent basis. While there is widespread consensus that different raters of youth psychopathology vary significantly in their assessment, this is the first paper that specifically investigated the discrepancies among clinician, youth, and caregiver ratings throughout the treatment process within a community mental health setting. Results for all three respondent versions indicated the SFSS is a psychometrically sound instrument for use in this population. Significant discrepancies in scores existed at baseline among the three respondents. Longitudinal analyses reveal the youth-clinician and caregiver-clinician score discrepancies decreased significantly over time. Differences by youth gender existed for caregiver-clinician discrepancies. The average youth-caregiver score discrepancy remained consistent throughout treatment. Implications for future research and clinical practice are discussed.     

Do non-referred young people with Autism Spectrum Disorders and their caregivers agree when reporting anxiety symptoms? A preliminary investigation using the Spence Children's Anxiety Scale

Anxiety difficulties and disorders are common in children and youth people with Autism Spectrum Disorders (ASD), but only a few studies have specifically examined informant agreement in non-referred samples. The present study examined informant agreement between 38 Singaporean caregiver–child dyads using the Spence Children's Anxiety Scale Parent Version (SCAS-P) and the SCAS Child self-report (SCAS-C) respectively. The young people with ASD (mean age 12 years 10 months) completed the SCAS-C, while their caregivers completed the SCAS-P, the Scales of Independent Behavior-Revised and the Developmental Behavior Checklist. There was overall moderately good agreement between caregivers and children's reporting of anxiety symptoms. Intra-class correlations were highest in the Separation Anxiety, Generalized Anxiety and Physical Injury subscales. Fourteen of the 38 SCAS items, most of which described overt anxiety symptoms, showed strong or moderate inter-rater agreement. Higher severity of autism symptoms was associated with poorer agreement in the Generalized Anxiety, Panic and Obsessions/Compulsions SCAS subscales. These preliminary findings suggest that the SCAS may be a useful measure for reporting anxiety symptoms in terms of satisfactory agreement between caregivers and young people in non-referred settings. Implications for screening for anxiety in non-referred young people with ASD are also discussed.     

Symptoms of autism and schizophrenia spectrum disorders in clinically referred youth with oppositional defiant disorder

Examined autism spectrum disorder (ASD) and schizophrenia spectrum disorder (SSD) symptoms in a clinically referred, non-ASD sample (N=1160; ages 6-18) with and without oppositional defiant disorder (ODD). Mothers and teachers completed DSM-IV-referenced symptom checklists. Youth with ODD were subdivided into angry/irritable symptom (AIS) or noncompliant symptom (NS) subtypes. Two different classification strategies were used: within-informant (source-specific) and between-informant (source-exclusive). For the source-specific strategy, youth were classified AIS, NS, or Control (C) according to mothers' and teachers' ratings separately. A second set of analyses focused on youth classified AIS according to mother or teacher report but not both (source-exclusive) versus both mother and teacher (cross-informant) AIS. Results indicated the mother-defined source-specific AIS groups generally evidenced the most severe ASD and SSD symptoms (AIS>NS>C), but this was more pronounced among younger youth. Teacher-defined source-specific ODD groups exhibited comparable levels of symptom severity (AIS, NS>C) with the exception of SSD (AIS>NS>C; younger youth). Source-exclusive AIS groups were clearly differentiated from each other, but there was little evidence of differential symptom severity in cross-informant versus source-exclusive AIS. These findings were largely dependent on the informant used to define the source-exclusive groups. AIS and NS groups differed in their associations with ASD and SSD symptoms. Informant discrepancy provides valuable information that can inform nosological and clinical concerns and has important implications for studies that use different strategies to configure clinical phenotypes.     

The latent classes of subclinical ADHD symptoms: convergences of multiple informant reports

The purpose of the present study was to conduct latent class analysis on the Hyperactivity scale of the Strengths and Difficulties Questionnaire in order to identify distinct subgroups of subclinical ADHD in a multi-informant framework. We hypothesized a similar structure between teachers and parents, and differences in symptom severity across latent classes. Data was collected from a non-referred sample of children aged 8-13 years. We performed latent class analyses on parent (n = 383) and teacher (n = 391) ratings of the Hyperactivity scale items from both versions of the questionnaire. Those children who had ratings from both informants (n = 272) were included in the cross-informant analyses, in which the similar or equivalent classes across raters were determined. A three-class solution for parent report and a five-class solution for teacher report emerged in the subsample of boys. For girls, a three-class structure for parents and a four-class structure for teachers were optimal. Besides non-symptomatic groups, mild and severe combined classes, mild inattentive-impulsive classes, and among boys, a mild hyperactive-impulsive class was obtained. The cross-informant analyses demonstrated that quite similar subgroups were detached regardless of informant; however, the teacher classes were somewhat more elaborated. The results are in line with the previous latent class analytic studies, and support the combination of dimensional and categorical approaches. The importance of milder symptoms and sub-threshold ADHD categories are emphasized for the fields of neuropsychology, neuroscience, and education, as well as for diagnosis and personalized treatment.     

Psychometric properties of ADHD rating scales among children with mental retardation I: reliability

The reliability of Attention-Deficit/Hyperactivity Disorder (ADHD) rating scales in children with mental retardation was assessed. Parents, teachers, and teaching assistants completed ADHD rating scales on 48 children aged 5-12 diagnosed with mental retardation. Measures included the Child Behavior Checklist (CBCL), Conners Rating Scales, the Attention-Deficit/Hyperactivity Disorder Test (ADHDT), the Swanson, Nolan, and Pelham (SNAP) Checklist, the Werry-Weiss-Peters Activity Rating Scale (WWPARS), the ADD-H Comprehensive Teacher's Rating Scale (ACTeRS), and the Aberrant Behavior Checklist-Community (ABC-C). The internal consistency, test-retest, and interrater reliability of each scale was examined. Results showed best support for teacher completed scales, followed by ratings made by teaching assistants, and parent-report scales. Strong support for the internal consistency of the teacher-report measures was found, and it was quite similar to previously reported internal consistencies with typically developing children. Test-retest reliabilities of the teacher report measures were also quite good but tended to be lower than those reported for typically developing children. For teaching assistant ratings, test-retest reliabilities were adequate to very good. The internal consistency reliabilities for parent completed measures were adequate to excellent, but test-retest reliabilities were low. Interrater reliability was best for teacher-teaching assistants. The ABC-C was the only measure on which the interrater reliability was adequate for clinical purposes.     

Self-efficacy for seizure management and youth depressive symptoms: caregiver and youth perspectives

The aims of this study were to (1) compare caregiver and youth measures of self-efficacy for seizure management (SESM), as well as report of depressive symptoms and suicidal ideation in youth with epilepsy (YWE) and (2) examine the potential relationship between caregiver SESM and caregiver report of depressive symptoms in YWE. Seventy-seven YWE ages 9-17 completed the Children's Depression Inventory (CDI) and the Seizure Self-Efficacy Scale for Children with Epilepsy (SSES-C). Sixty-five caregivers completed the Behavior Assessment System for Children (BASC-II) and the Epilepsy Self-Efficacy Scale (ESES). Results showed no agreement between youth and caregiver self-efficacy scores. However, there was low to modest agreement in published classifications of depressive symptoms between youth and caregiver ratings of depressive symptoms in youth, with caregivers reporting higher levels of symptoms than the youth reported. Twenty-seven percent of YWE endorsed suicidal ideation. When caregiver report of their own self-efficacy towards their child's seizures and their assessment of their child's depressive symptoms were compared, there was a significant inverse relationship. These findings suggest a multi-informant approach to assessment of depressive symptoms in YWE, the importance of including self-efficacy for seizure management in assessment and treatment of YWE, and provide support for transactional patterns of psychosocial adjustment.