Evidence-Based Assessment of Attention Deficit Hyperactivity Disorder in Children and Adolescents

This article examines evidence-based assessment practices for attention deficit hyperactivity disorder (ADHD). The nature, symptoms, associated features, and comorbidity of ADHD are briefly described, followed by a selective review of the literature on the reliability and validity of ADHD assessment methods. It is concluded that symptom rating scales based on the Diagnostic and Statistical Manual of Mental Disorders (4th ed. [DSM-IV]; American Psychiatric Association, 1994), empirically and rationally derived ADHD rating scales, structured interviews, global impairment measures, and behavioral observations are evidence-based ADHD assessment methods. The most efficient assessment method is obtaining information through parent and teacher rating scales; both parent and teacher ratings are needed for clinical purposes. Brief, non-DSM based rating scales are highly correlated with DSM scales but are much more efficient and just as effective at diagnosing ADHD. No incremental validity or utility is conferred by structured interviews when parent and teacher ratings are utilized. Observational procedures are empirically valid but not practical for clinical use. However, individualized assessments of specific target behaviors approximate observations and have both validity and treatment utility. Measures of impairment that report functioning in key domains (peer, family, school) as well as globally have more treatment utility than nonspecific global measures of impairment. DSM diagnosis per se has not been demonstrated to have treatment utility, so the diagnostic phase of assessment should be completed with minimal time and expense so that resources can be focused on other aspects of assessment, particularly treatment planning. We argue that the main focus of assessment should be on target behavior selection, contextual factors, functional analyses, treatment planning, and outcome monitoring.     

A Practical Measure of Impairment: Psychometric Properties of the Impairment Rating Scale in Samples of Children With Attention Deficit Hyperactivity Disorder and Two School-Based Samples

Assessing impairment is an explicit component of current psychiatric diagnostic systems. A brief parent and teacher rating scale for assessing impairment was developed and studied using attention deficit hyperactivity disorder (ADHD) as an exemplar disorder. The psychometric properties of the Impairment Rating Scale (IRS) were measured in 4 samples. Two included ADHD and matched comparison children and the other 2 a school sample. Overall, IRS ratings exhibited very good temporal stability. They correlated with other impairment ratings and behavioral measures and displayed evidence of convergent and discriminant validity. The IRS was highly effective in discriminating between children with and without ADHD. Evidence that the parent and teacher IRS accounted for unique variance beyond ratings of ADHD symptoms is also presented. The scale is brief, practical, and in the public domain. The results of the studies and implications for the assessment of impairment are discussed.     

Multimethod Assessment of Attention-Deficit Hyperactivity Disorder: The Diagnostic Utility of Clinic-Based Tests

Investigated the utility of two clinic-based tests, the Matching Familiar Figures Test (MFFT; Kagan, 1966) and a version of the Continuous Performance Test (CPT; Gordon, 1983), in the assessment of children with attention-deficit hyperactivity disorder (ADHD). At a group level of analysis, scores on the CPT and MFFT were found to share little variance with parent and teacher report on several behavior rating scales used to evaluate ADHD. Further, clinic test scores, either alone or in combination, resulted in classification decisions that frequently disagreed with a diagnosis of ADHD based on parent interview and behavior-rating-scale data. The limited utility of currently available tests in the evaluation of ADHD suggests the need to develop clinic-based measures of sufficient ecological validity, which can be used in conjunction with parent and teacher report.     

Predictive Utility of Four Methods of Incorporating Parent and Teacher Symptom Ratings of ADHD for Longitudinal Outcomes

Despite robust evidence that parents and teachers provide incremental validity in the assessment of attention-deficit/hyperactivity disorder (ADHD), far less is known about the predictive utility of various strategies for incorporating these multi-informant data. Thus, we compared the 2-year predictive validity of four common assessment methods (i.e., algorithms) for ADHD symptoms—(a) parent only, (b) teacher only, (c) parent or teacher (“or rule”), and (d) parent and teacher (“and rule”)—with respect to psychopathology and multidomain functional outcomes. At baseline, separate parent and teacher ratings of ADHD were obtained from an ethnically diverse (53% non-White) sample of 195 6- to 10-year-old children (30% female) to classify children according to the 4 algorithms. We then evaluated the predictive validity of each baseline ADHD algorithm with respect to its prediction of separate measures of internalizing and externalizing psychopathology, as well as normed ratings of academic and social impairment obtained at a 2-year follow-up. The “or rule” algorithm, based on symptoms being endorsed by either informant, optimally predicted psychopathology and functional outcomes relative to the other algorithms. These findings converge with previous evidence that incorporating data from multiple informants, and more sensitive approaches in particular, provide incremental validity in the assessment of ADHD.     

The role of children's ethnicity in the relationship between teacher ratings of attention-deficit/hyperactivity disorder and observed classroom behavior

Significant ethnic differences have been consistently documented on attention-deficit/hyperactivity disorder (ADHD) teacher rating scales. Whether these ethnic differences result from a teacher rating bias or reflect actual classroom behavior patterns is unknown. Ethnic differences between Caucasian and African American (AA) elementary schoolchildren on teacher ratings and codings of observed classroom behavior were examined with latent variables. In structural equation models, correlations between teacher ratings and observed classroom behavior suggested nonbiased teacher ratings of AA schoolchildren with diagnosed ADHD. Ethnic differences were documented for both teacher ratings of ADHD and classroom behavior. Differences in classroom behavior were attenuated when the behavior of an average child in the classroom was taken into account. Multiple explanations for this pattern of results are discussed.     

Parent-Rated Externalizing Behavior in Preschoolers: The Predictive Utility of Structured Interviews,Teacher Reports,and Classroom Observations

This study investigated multiple forms of home and school assessment as predictors of parent-rated behavior problems across a preschool year. Participants were a community sample of 79 preschool children, their parents, and their teachers. Parent ratings of behavior problems were obtained toward the beginning of the school year and approximately 6 months later. Behavior problems were also assessed early in the school year using parent structured interviews, teacher-rating scales, and classroom observations of problem and prosocial behavior. Consistent with hypotheses, each assessment method significantly predicted year-end parent ratings of behavior problems, even above initial ratings.     

Parent-rated externalizing behavior in preschoolers: the predictive utility of structured interviews, teacher reports, and classroom observations.

This study investigated multiple forms of home and school assessment as predictors of parent-rated behavior problems across a preschool year. Participants were a community sample of 79 preschool children, their parents, and their teachers. Parent ratings of behavior problems were obtained toward the beginning of the school year and approximately 6 months later. Behavior problems were also assessed early in the school year using parent structured interviews, teacher-rating scales, and classroom observations of problem and prosocial behavior. Consistent with hypotheses, each assessment method significantly predicted year-end parent ratings of behavior problems, even above initial ratings.     

Manic symptoms in psychiatrically hospitalized children--what do they mean?

OBJECTIVE: To examine the clinical implications of manic symptoms in psychiatrically hospitalized children aged 5-12. METHODS: DSMIIIR manic symptoms, along with symptoms of other psychiatric disorders, were rated by parents and teachers on the Child Symptom Inventory IIIR prior to hospitalization. The Child Behavior Checklist (CBCL; was also completed. During hospitalization children were evaluated by structured interview (K-SADS-E), and numerous rating scales weekly. Children with symptoms of mania (mania criteria with/without episodes) were compared to those without mania. Severity of attention deficit hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), depression, CBCL factors, and comparable factors from teacher and parent inpatient rating scales were examined. Finally, a subgroup of both groups of children treated with stimulants were compared at baseline and at least two weeks of treatment. RESULTS: Children with manic symptoms had more severe ADHD, ODD and depression symptoms. CBCL scores on aggression, social and thought problems were higher. Teachers and nursing staff made similar observations. Time in hospital was greater for children with manic symptoms. Both groups improved significantly on stimulant medication though reduction in overall psychopathology was often modest. CONCLUSIONS: Manic symptoms, regardless of whether or not they represent bipolar disorder, are a marker of serious psychopathology and treatment resistance.     

Parents and Teachers Make Different Contributions to a Shared Perspective on Hyperactive–Impulsive and Inattentive Symptoms: A Multivariate Analysis of Parent and Teacher Ratings on the Symptom Domains of ADHD

Attention deficit hyperactivity disorder (ADHD) is characterised by developmentally inappropriate and impairing levels of inattentive and hyperactive–impulsive behaviours. We aimed to investigate the differential effects of parent and teacher ratings on inattention and hyperactivity–impulsivity and the extent of genetic overlap between the two behavioural dimensions. Multivariate structural equation modelling was performed on DSM-IV based ADHD ratings by parents and teachers collected on a general population sample of 672 twin pairs, at ages 7–10 years. This study is the first to simultaneously use parent and teacher ratings in twin modelling to examine the effects of different raters on the two behavioural dimensions of ADHD. The findings indicated that hyperactivity–impulsivity and inattention load on to separate latent factors that represent a common behavioural view for both parents and teachers, although there are additional aspects to the observations of these behaviours that are unique to each type of rater. The findings further indicate some shared aetiology for hyperactivity–impulsivity and inattention as measured by both parent and teacher ratings, in agreement with previous findings on the aetiology of the two symptom dimensions of ADHD.     

Multi-Informant Assessment of ADHD Symptom-Related Impairments Among Children and Adolescents

Existing methods of assessing attention-deficit/hyperactivity disorder (ADHD) are limited because they do not examine impairments in relation to symptoms of ADHD. This study investigated parent and teacher ratings of multiple domains of impairment, assessed in relation to the symptom dimensions of ADHD using the ADHD Rating Scale–5. Nationally representative samples of children rated by parents and teachers were recruited through commercial research firms. One sample included 2,079 parents who rated one of their children of age 5 to 17 years. The second sample included 1,070 teachers in grades K to 12 who rated 2 randomly selected students on their class rosters. Informants rated the extent to which each child displayed the 18 behaviors symptomatic of ADHD over the previous 6 months, as well as symptom-related impairments in the areas of family/teacher relationships, peer relationships, academics, behavior problems, homework, and self-esteem. Respondents were asked to complete the 6 impairment items after rating each of the Inattention and Hyperactivity/Impulsivity symptom items. For both informants a 6-factor model that combined impairment items across source of impairment was adequate and superior to a 2-factor structure based on source of impairment (i.e., impairment due to Inattention vs. Hyperactivity-Impulsivity). Impairment ratings were impacted by child demographic factors, but effect sizes were low. In contrast, impairment ratings were strongly related to ratings on the ADHD symptom dimensions. The study provides support for assessing 6 symptom-related domains of impairment but does not support differentiating whether Inattention or Hyperactivity-Impulsivity is the source of impairment.     

Construct validity of the auditory continuous performance test for preschoolers

Development of diagnostic instruments directed toward neuropsychological assessment of preschoolers lags significantly behind those available for school-age children (DeWolfe, Byrne, & Bawden, 2000). This is particularly true for measures of executive function (EF). The Auditory Continuous Performance Test for Preschoolers (ACPT--P; Mahone, Pillion, & Hiemenz, 2001) is a computerized, Go-No-go test developed to measure selected EF skills in preschoolers. First, to determine whether performance on the ACPT--P is associated with hearing impairment, we compared performance of children with mild hearing loss (MHL) to controls on the ACPT--P, and measures of spatial working memory (SWM) and motor persistence (MP). There were no differences between performance of the MHL group and controls on any of these measures. Second, to examine the construct validity of the ACPT--P, we compared performance of 40 preschoolers with ADHD to 40 age- and sex-matched controls, using the ACPT--P to measure response preparation, sustained attention, and inhibitory control. We also compared these groups on measures of SWM and MP. The group with attention deficit hyperactivity disorder (ADHD) performed significantly worse than controls on the ACPT--P (omissions, mean response time, variability) and MP. The ACPT--P was correlated with the MP, but not with the SWM measure. Both the ACPT--P and the MP measures showed low to moderate correlations with parent ratings of behavior associated with ADHD. These findings support the use of performance-based assessment of executive control skills in preschoolers suspected of having ADHD. In this age group, the ACPT--P may be particularly useful in assessing sustained attention and response preparation and may complement behavior rating scales.     

High Heritability of Speech and Language Impairments in 6-year-old Twins Demonstrated Using Parent and Teacher Report

Previous twin studies have demonstrated high heritability of specific language impairment (SLI) when the diagnosis is based on psychometric testing. The current study measured the effectiveness of parent and teacher ratings of communication skills in identifying heritable language impairment. The Children’s Communication Checklist was completed by parents and teachers of 6-year-old twins recruited from a general population sample. One hundred and thirty twin pairs (65 MZ) were selected because at least one twin had low language skills at 4 years of age; a further 66 pairs (37 MZ) were a low risk group with no indication of language difficulties at 4 years. Internal consistency, inter-rater reliability, and validity in identifying language impairment were assessed for all CCC scales. CCC scales, especially those assessing structural language skills, were highly effective in identifying cases of language impairment, but agreement between parent and teacher ratings was modest. Genetic analysis revealed negligible environmental influence and substantial genetic influence on most scales. A rater-specific effects model was fit to the data to assess how far parents and teachers assess a common genetic factor on the CCC. Ratings of parents and teachers were influenced to some extent by the same child characteristics, but rater-specific effects were also evident, especially on scales measuring pragmatic aspects of communication. This study shows that there are strong genetic influences on both structural and pragmatic language impairments in children, and these can be detected using a simple checklist completed by parents or teachers.     

Validity of the behavior rating inventory of executive function in children with ADHD and/or Tourette syndrome.

The dynamic, multidimensional nature of executive function (EF), thought to be characteristically impaired in those with attention deficit hyperactivity disorder (ADHD), has been challenging to operationalize and assess in a clinical setting [Barkley, R. A. (1997). ADHD and the nature of self-control. New York: Guilford Press.]. Gioia, Isquith, Guy, and Kenworthy [Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000) Behavior Rating Inventory of Executive Function. Odessa, FL: Psychological Assessment Resources.] developed the Behavior Rating Inventory of Executive Function (BRIEF) to address these concerns. In order to provide concurrent validity information on the BRIEF, parents of 76 children (ADHD=18; Tourette syndrome (TS)=21; TS+ADHD=17; controls=20) completed the BRIEF, additional behavior rating scales and interviews, measures of psychoeducational (PE) competence, and performance-based measures of EF. Both ADHD and TS+ADHD groups were rated as more impaired (P<.0001) than the other groups on the five primary BRIEF indices. BRIEF index scores showed no significant correlation with performance-based EF or PE measures, with the exception of math achievement; however, the BRIEF showed a strong relationship with interviews and other parent rating measures of behaviors seen in ADHD. Future attempts to validate the BRIEF should focus on differences within subtypes of ADHD (e.g., inattentive, combined subtypes), and separating ADHD from other clinical groups in which EF is reported to be a problem.     

Toward Guidelines for Evidence-Based Assessment of Depression in Children and Adolescents

We aim to provide a starting point toward the development of an evidence-based assessment of depression in children and adolescents. We begin by discussing issues relevant to the diagnosis and classification of child and adolescent depression. Next, we review the prevalence, selected clinical correlates, course, and treatment of juvenile depression. Along with some general considerations in assessment, we discuss specific approaches to assessing depression in youth (i.e., interviews, rating scales) and briefly summarize evidence on the reliability and validity of a few selected instruments. In addition, we touch on the assessment of several other constructs that are important in a comprehensive evaluation of depression (i.e., social functioning, life stress, and family history of psychopathology). Last, we highlight areas in which further research is necessary and conclude with some broad recommendations for clinical practice given the current state of the knowledge.     

Toward guidelines for evidence-based assessment of depression in children and adolescents.

We aim to provide a starting point toward the development of an evidence-based assessment of depression in children and adolescents. We begin by discussing issues relevant to the diagnosis and classification of child and adolescent depression. Next, we review the prevalence, selected clinical correlates, course, and treatment of juvenile depression. Along with some general considerations in assessment, we discuss specific approaches to assessing depression in youth (i.e., interviews, rating scales) and briefly summarize evidence on the reliability and validity of a few selected instruments. In addition, we touch on the assessment of several other constructs that are important in a comprehensive evaluation of depression (i.e., social functioning, life stress, and family history of psychopathology). Last, we highlight areas in which further research is necessary and conclude with some broad recommendations for clinical practice given the current state of the knowledge.     

No More Secrets: Protecting Your Child From Sexual Assault (Book)

Investigated the psychometric properties of the Home Situations Questionnaire-Revised (HSQ-R) and School Situations Questionnaire-Revised (SSQ-R) completed by parents and teachers, respectively, for a large sample of urban elementary school children. These instruments were developed to assess the severity and cross-situational pervasiveness of attention problems. HSQ-R and SSQ-R scores were found to possess adequate levels of internal consistency, test-retest reliability, construct validity; and to share considerable variance with criterion measures such as parent and teacher behavior ratings, direct observations of classroom on-task behavior, and productivity on academic tasks. Boys displayed more severe attention problems across a wider number of settings than did girls, regardless of grade level. The HSQ-R and SSQ-R appear to have utility in the assessment of attention-deficit hyperactivity disorder and related behavior disorders in which attention problems are an important focus of evaluation.     

Emotional functioning among children with neurofibromatosis type 1 or Noonan syndrome

While neurofibromatosis type 1 (NF1) and Noonan syndrome (NS) are clinically distinct genetic syndromes, they have overlapping features because they are caused by pathogenic variants in genes encoding molecules within the Ras‐mitogen‐activated protein kinase signaling pathway. Increased risk for emotional and behavioral challenges has been reported in both children and adults with these syndromes. The current study examined parent‐report and self‐report measures of emotional functioning among children with NF1 and NS as compared to their unaffected siblings. Parents and children with NS (n = 39), NF1 (n = 39), and their siblings without a genetic condition (n = 32) completed well‐validated clinical symptom rating scales. Results from parent questionnaires indicated greater symptomatology on scales measuring internalizing behaviors and symptoms of attention deficit hyperactivity disorder (ADHD) in both syndrome groups as compared with unaffected children. Frequency and severity of emotional and behavioral symptoms were remarkably similar across the two clinical groups. Symptoms of depression and anxiety were higher in children who were also rated as meeting symptom criteria for ADHD. While self‐report ratings by children generally correlated with parent ratings, symptom severity was less pronounced. Among unaffected siblings, parent ratings indicated higher than expected levels of anxiety. Study findings may assist with guiding family‐based interventions to address emotional challenges.     

Executive function in XXY: Comparison of performance‐based measures and rating scales

Few studies have systematically assessed executive functioning (EF) skills in boys with XXY, and these are limited by small samples and restricted EF assessment. This study used a broader battery of performance‐based measures as well as parent‐rating scales of EF in 77 boys and adolescents with XXY (mean age = 12.5 years), recruited from a clinical trial and an outpatient clinic. Exploratory factor analyses were used to create EF domains from performance‐based measures, and similar domains were measured using the Behavior Rating Inventory of Executive Function and Conners Parent‐Rating Scales. The boys with XXY showed a distinct EF profile, with the greatest deficit in attention and more moderate deficits in working memory, switching, and planning/problem solving. Parent ratings showed similar challenges, as well as impaired inhibition. Independent sample t‐tests showed no difference on performance measures between boys diagnosed or not diagnosed with attention‐deficit/hyperactivity disorder (ADHD), although parents of boys diagnosed with ADHD reported more difficulties. There were no differences on performance‐based tests between those diagnosed pre‐ and postnatally, although parents of postnatally diagnosed boys reported more metacognitive problems. Language deficits, cognition, and socio‐economic status did not account for EF deficits.     

Assessing ADHD Across Settings: Contributions of Behavioral Assessment to Categorical Decision Making

Adapted methods of behavioral assessment to assess home and school functioning in a way that maps directly to the Diagnostic and Statistical Manual of Mental Disorders (4th ed., [DSM-IV]; American Psychiatric Association, 1994). The study was conducted in a school-based sample with 5- to 12-year-old children referred to a school intervention team. A multigate set of procedures was used to assign children to one of 3 groups: attention deficit hyperactivity disorder (ADHD), inattentive group; ADHD, combined group; and a non-ADHD control group. The ADHD Rating Scale-IV was used to assess parent and teacher ratings of ADHD symptoms as delineated in DSM-IV. The findings suggest that the use of a fixed cutoff point (i.e., 6 or more symptoms), which is employed in the DSM-IV, is often not the best strategy for making diagnostic decisions. The optimal approach depends on whether diagnostic information is being provided by the parent or teacher and whether the purpose of assessment is to conduct a screening or a diagnostic evaluation. Also, the results indicate that a strategy that aggregates symptoms in the order in which they are accurate in predicting a diagnosis of ADHD is a more effective strategy than the approach used in DSM-IV, which aggregates any combination of a specific number of items. Implications for using methods of behavioral assessment to make diagnostic decisions using DSM-IV criteria are discussed.     

The Childhood Executive Functioning Inventory (CHEXI): A New Rating Instrument for Parents and Teachers

Poor executive functioning has been shown to be of central importance in disruptive behavior disorders such as attention deficit hyperactivity disorder (ADHD), and a large number of laboratory measures of executive functioning have been developed. There are, however, few available questionnaires tapping executive functioning and those that exist also include items focused directly on the symptom criteria for ADHD, which makes it difficult to draw conclusions regarding executive functioning per se. In the present study, a new rating instrument, the Childhood Executive Functioning Inventory (CHEXI) was therefore introduced. This instrument was shown to have good test-retest reliability. Using factor analysis, two factors tapping working memory and inhibition emerged using parent ratings and these two factors were replicated using teacher ratings. Modest, yet mostly significant, relations to laboratory measures of working memory and inhibition were found. Ratings on the CHEXI were also found to be significantly related to ADHD symptoms as well as early academic achievement. Interestingly, ratings on the CHEXI and laboratory measures of working memory and inhibition were shown to explain independent variance in ADHD symptoms and academic achievement, which point to the importance of using a multi-assessment strategy when studying executive functioning.