Factorial Structure and Invariance of the Academic Expectations Stress Inventory Across Hispanic and Chinese Adolescent Samples

Using confirmatory factor analysis, the current study provided further evidence for the two-factor structure of the Academic Expectations Stress Inventory [AESI; Ang RP, Huan VS (2006) Educ Psych Meas 66:522–539] using a sample of 191 US Hispanic adolescents and a sample of 211 Singapore Chinese adolescents. This study also examined the cross-cultural validity of the AESI using multigroup confirmatory factor analysis to investigate the invariance of the factor structure of the AESI across both samples. Results from multigroup confirmatory factor analysis suggested that while partial invariance was observed across the samples, the consistency of fit indices indicating either no change or a minimal loss of fit between the unconstrained basic model and the partially constrained models, provided support that partial invariance was acceptable. Analyses of covariance results indicated that perceived overall academic stress and academic stress arising from self-expectations were significantly higher among Singapore Chinese adolescents compared with US Hispanic adolescents.     

Validating the cross-cultural factor structure and invariance property of the Insomnia Severity Index: evidence based on ordinal EFA and CFA

ObjectiveThe purpose of this study is to examine the factor structure of the Insomnia Severity Index (ISI) across samples recruited from different countries. We tried to identify the most appropriate factor model for the ISI and further examined the measurement invariance property of the ISI across samples from different countries.MethodsOur analyses included one data set collected from a Taiwanese sample and two data sets obtained from samples in Hong Kong and Canada. The data set collected in Taiwan was analyzed with ordinal exploratory factor analysis (EFA) to obtain the appropriate factor model for the ISI. After that, we conducted a series of confirmatory factor analyses (CFAs), which is a special case of the structural equation model (SEM) that concerns the parameters in the measurement model, to the statistics collected in Canada and Hong Kong. The purposes of these CFA were to cross-validate the result obtained from EFA and further examine the cross-cultural measurement invariance of the ISI.ResultsThe three-factor model outperforms other models in terms of global fit indices in Taiwan's population. Its external validity is also supported by confirmatory factor analyses. Furthermore, the measurement invariance analyses show that the strong invariance property between the samples from different cultures holds, providing evidence that the ISI results obtained in different cultures are comparable.ConclusionsThe factorial validity of the ISI is stable in different populations. More importantly, its invariance property across cultures suggests that the ISI is a valid measure of the insomnia severity construct across countries.     

Consistency and factorial invariance of the Davidson trauma scale in heterogeneous populations: results from the 2010 Chilean earthquake

This investigation seeks to validate an application of a standardized post‐traumatic stress symptom self‐report survey, the Davidson Trauma Scale (DTS), with a large, heterogeneous population of earthquake victims. While previous studies have focused primarily on small samples, this investigation uses a unique dataset to assess the validity of this application of the DTS while accounting for heterogeneity and sample size. We use concurrent validity and reliability analysis tests to confirm the validity of the scale. Further, confirmatory factor analysis is used to test the fit of the data's factor structure against previously established trauma models. Finally, these fit tests are repeated across different mutually exclusive vulnerability subsets of the data in order to investigate how the invariance of the scale is affected by sample heterogeneity. We find that this particular application of the scale is, on the whole, reliable and valid, showing good concurrent validity. However, evidence of variability is found across specific vulnerability subsets, indicating that a heterogeneous sample can have a measurable impact on model fit. © 2016 The Authors International Journal of Methods in Psychiatric Research Published by John Wiley & Sons Ltd     

Social Anxiety Scale for Adolescents: Factorial invariance and latent mean differences across gender and age in Spanish adolescents

Little is known about the factorial invariance across gender and age for self-report measures of social anxiety in adolescence. This study examined the factorial invariance and latent mean differences of the Social Anxiety Scale for Adolescents (SAS-A) across gender and age groups in 1570 Spanish adolescents (54% girls), ranging in age from 14 to 17 years. Equality of factor structures was compared using multi-group confirmatory factor analyses. Measurement invariance for the correlated three-factor model of the SAS-A was found across gender and age samples. Analyses of latent mean differences revealed that girls exhibited higher means than boys on two SAS-A subscales, Fear of Negative Evaluation and Social Avoidance and Distress-New (SAD-New). In addition, on the SAD-New subscale, the structured means significantly diminished from 14-year olds to 16- and 17-year olds and from 15-year olds to 17-year olds. Findings are discussed in terms of the use of the SAS-A with Spanish adolescents.     

The intellectual disability version of the very short form of the physical self-inventory (PSI-VS-ID): cross-validation and measurement invariance across gender, weight, age and intellectual disability level

Recently Maïano, Bégarie, Morin, and Ninot (2009) developed and validated an intellectual disability (ID) version of the very short form of the physical self-inventory (PSI-VS-ID). In a recent review of the various physical self-concept instruments Marsh and Cheng (in press) noted that the short and very short versions of the French PSI represent an important contribution to applied research but that further research was needed to investigate the robustness of their psychometric properties in new and diversified samples. Thus, this study is specifically designed to investigate the robustness of the PSI-VS-ID psychometric properties in a new independent sample of 248 adolescents and young adults with ID. In particular, tests of measurement invariance were conducted across the present sample and the original sample from Maïano et al. (2009) study in order to more precisely assess the degree of replication of the results. Overall, results from a series of confirmatory factor analyses of the PSI-VS-ID provided support for its: (i) factorial validity and reliability; (ii) factorial invariance across gender and weight status; (iii) partial (strict or strong) factorial invariance across age, ID level and samples; and (iv) latent mean differences across gender, weight status and ID level groups.     

Psychosis risk screening: Validation of the youth psychosis at‐risk questionnaire – brief in a community‐derived sample of adolescents

There have been several attempts to identify individuals potentially at high risk for psychotic‐spectrum disorders using brief screening measures. However, relatively few studies have tested the psychometric properties of the psychosis screening measures in representative samples of adolescents. The main purpose of the present study was to analyse the prevalence, factorial structure, measurement invariance across gender, and reliability of the Youth Psychosis At‐Risk Questionnaire – Brief (YPARQ‐B) in a community‐derived sample of adolescents. Additionally, the relationship between YPARQ‐B, depressive symptoms, psychopathology, stress manifestations, and prosocial skills was analysed. One thousand and twenty students from high schools participated in a cross‐sectional survey. The YPARQ‐B, the Reynolds Adolescent Depression Scale, the Strengths and Difficulties Questionnaire, and the Student Stress Inventory – Stress Manifestations were used. A total of 85.1% of the total sample self‐reported at least one subclinical psychotic experience. We observed a total of 10.9% of adolescents with a cutoff score of ≥11 or 6.8% with a cutoff score of ≥13. The analysis of internal structure of the YPARQ‐B yielded an essentially unidimensional structure. The YPARQ‐B scores showed measurement invariance across gender. The internal consistency of the YPARQ‐B total score was 0.94. Furthermore, self‐reported subclinical psychotic experiences were associated with depressive symptoms, emotional and behavioural problems, poor prosocial skills, and stress manifestations. These results would appear to indicate that YPARQ‐B is a brief and easy tool to assess self‐reported subclinical psychotic experiences in adolescents from the general population. The assessment of these experiences in community settings, and its associations with psychopathology, may help us to enhance the possibility of an early identification of adolescents potentially at risk for psychosis and mental health problems.     

Psychometric properties of the Arabic self-report version of the strengths and difficulties questionnaire

Students in middle school tend to display emotional and behavioural difficulties (EBDs) compared to other forms of psychopathology. Early identification of EBDs is therefore a priority in order to prevent the chronic co-morbidity with other forms of psychopathology which may affect students’ academic achievement. Assessment of EBDs has been traditionally undertaken via proxy reporting; but psychometrically rigorous instruments are needed so that children and adolescents can report on their own emotions and behaviours. Such need increases in the Omani context given the lack of EBDs adequate assessment instruments. In the current study the factor structure of the Arabic self-report version of the Strengths and Difficulties Questionnaire (A-SDQ) was examined in a sample of 815 middle school students (mean age = 14 years). The study tested the SDQ original five-factor model which received considerable empirical support. Responses on the A-SDQ were compared to responses obtained via proxy reports from teachers and parents through confirmatory factor analyses (CFAs). Results showed a reasonable fit for the three informant forms. Nevertheless, there were differences in item loadings across the three informant forms. Additionally, participants’ self-report responses were tested for invariance across gender. CFAs provided support to the invariance hypothesis for item loadings, indicating that the items were similarly valid indices of the five factors for males and females. Factor correlations, factor variances and item residuals were not invariant across gender.What this paper addsThis paper, to our knowledge, is the first research paper that provides empirical evidence on the Arabic self report version of the Strengths and Difficulties Questionnaire (A-SDQ) within a school-based sample. Though the focus was on the self-report version we collected data from the proxy versions for parents and teachers to provide additional evidence on the construct validity of the (A-SDQ) through cross informant data.     

Factor structure of the Impact of Event Scale‐Revised in two different Peruvian samples

Background: This article studied the factor structure of the Impact of Event Scale‐Revised (IES‐R) in two samples in Peru, i.e., a sample of survivors of a fire (N=174) and a university student sample (N=562). Methods: First, confirmatory factor analysis was used to compare nine different models of posttraumatic stress disorder symptoms as evaluated by the IES‐R in both of the samples separately. The model with the best fit in both samples had four correlated factors, i.e., Intrusion, Avoidance, Hyperarousal and Sleep Disturbance. Second, the degree of factorial invariance of the IES‐R was compared in both the samples using multiple group confirmatory factor analysis. Results and Conclusions: The results showed almost no differences between both samples. Finally, the results supported the internal consistency, as well as the concurrent and convergent validity of the IES‐R in Peru. Depression and Anxiety, 2009. © 2009 Wiley‐Liss, Inc.     

Construct validity of the Nutrition and Activity Knowledge Scale in a French sample of adolescents with mild to moderate intellectual disability

The purpose of this study was to test the reliability (i.e. internal consistency and test–retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual Disability (ID). A total sample of 260 adolescents (144 boys and 116 girls), aged between 12 and 18 years old, with mild to moderate ID was involved in two studies. In the first study, analysis of items’ content reveals that many words from the original version were not understood or induced confusion. These items were reworded and simplified while retaining their original meaning. In the second study, results provided support for: (i) the factor validity and reliability of a 15-item French version of the NAKS; (ii) the measurement invariance of the resulting NAKS across genders and ID levels; (iii) the partial measurement invariance of the resulting NAKS across age groups and type of school placement. In addition, the latent means of the 15-item French version of the NAKS proved to be invariant across gender, age categories, and ID levels, but to vary across type of school placement (with adolescents schooled in self-contained classes from regular schools presenting higher levels of NAK than adolescents placed in specialized establishments). The present results thus provide preliminary evidence regarding the construct validity of a 15-item French version of the NAKS in a sample of adolescents with ID.     

The Penn State Worry Questionnaire for Children: Age,Gender and Clinical Invariance

The Penn State Worry Questionnaire for Children (PSWQ-C) is one of the most frequently used instruments to assess worry in children. The current study examines the measurement invariance of the PSWQ-C in a Romanian sample. Participants (n = 759) were recruited from both community and clinical populations. Our findings have replicated the good psychometric properties of the PSWQ-C and of the short PSWQ-C (the original scale with the negative items deleted). Multigroup confirmatory factor analysis has supported measurement invariance (configural, metric, scalar) across gender, age and clinical diagnosis. Convergent validity with other assessment measures has also been established. Finally, the implications of the use of the PSWQ-C in the assessment of anxiety in children and adolescents are discussed.     

Multigroup Ethnic Identity Measurement invariance across adolescence and diverse ethnic groups

IntroductionEthnic identity is an important protective factor for various ethnic groups and developmental periods. Although existing measures assessing ethnic identity are well known, less is known about the measurement invariance of the Multigroup Ethnic Identity Measure (MEIM) across adolescent ethnic groups. The present study evaluates the factor structure of MEIM (Roberts et al., 1999) and tests the measurement invariance across early and middle adolescence and ethnic background (N = 4940).MethodsData from an ethnic minority sample of youth (54% girls; M_age = 13.88, grades 6th – 12th; 60% African American, 22% multi-ethnic, 8% Latinx, 5% Asian, 5% American Indian) in the United States of America were examined using confirmatory factor analysis (CFA) and multi-group measurement invariance via a structural equation modeling (SEM) framework. Models for invariance were tested using full information maximum likelihood-robust (FIML-R) estimation in Mplus.ResultsCFA supported a three-factor solution (i.e., cognitive clarity, behavioral engagement, and affective pride). The model indicated scalar invariance across early and middle adolescence and partial scalar invariance across the five self-identified racial/ethnic minority groups. There were no grade differences on the ethnic identity factors. Among the racial/ethnic groups, multi-ethnic youth reported the lowest levels on all three ethnic identity factors compared to the other groups.ConclusionsResults of this study point to the validity of using the MEIM for meaningful comparisons of ethnic identity across ethnic groups and across early and middle adolescence. Implications for the interpretation and use of this measure with diverse adolescents are discussed.     

Factor Structure and Invariance of the Reactive and Proactive Aggression Questionnaire in a Large Sample of Young Adolescents in Singapore

The present study investigated the factor structure, gender invariance, and convergent validity of the scores associated with the Reactive–Proactive Aggression Questionnaire (RPQ) in a Singapore sample of 1027 school-going adolescents. Results demonstrated that the 2-factor reactive–proactive aggression model had a superior fit compared with the 1-factor general aggression model, providing evidence that while reactive and proactive aggression were correlated, they were nevertheless distinct and separable. Current findings also provided empirical support for the invariance of the 2-factor model of the RPQ across gender. Furthermore, convergent validity was examined; while both reactive and proactive aggression were shown to be positively and significantly related to delinquency and narcissism, it was proactive aggression rather than reactive aggression that showed relatively stronger associations with delinquency and narcissism. Collectively, these findings provided evidence that there are meaningful differences between reactive and proactive aggression, and contributed to the cross-cultural generalizability of the RPQ.     

Assessment and characterization of phenotypic heterogeneity of anxiety disorders across five large cohorts

To achieve sample sizes necessary for effectively conducting genome‐wide association studies (GWASs), researchers often combine data from samples possessing multiple potential sources of heterogeneity. This is particularly relevant for psychiatric disorders, where symptom self‐report, differing assessment instruments, and diagnostic comorbidity complicates the phenotypes and contribute to difficulties with detecting and replicating genetic association signals. We investigated sources of heterogeneity of anxiety disorders (ADs) across five large cohorts used in a GWAS meta‐analysis project using a dimensional structural modeling approach including confirmatory factor analyses (CFAs) and measurement invariance (MI) testing. CFA indicated a single‐factor model provided the best fit in each sample with the same pattern of factor loadings. MI testing indicated degrees of failure of metric and scalar invariance which depended on the inclusion of the effects of sex and age in the model. This is the first study to examine the phenotypic structure of psychiatric disorder phenotypes simultaneously across multiple, large cohorts used for GWAS. The analyses provide evidence for higher order invariance but possible break‐down at more detailed levels that can be subtly influenced by included covariates, suggesting caution when combining such data. These methods have significance for large‐scale collaborative studies that draw on multiple, potentially heterogeneous datasets. Copyright © 2016 John Wiley & Sons, Ltd.     

Does the Revised Child Anxiety and Depression Scale (RCADS) measure anxiety symptoms consistently across adolescence? The TRAILS study

We assessed if the Revised Child Anxiety and Depression Scale (RCADS) measures anxiety symptoms similarly across age groups within adolescence. This is crucial for valid comparison of anxiety levels between different age groups. Anxiety symptoms were assessed biennially in a representative population sample (n = 2226) at three time points (age range 10–17 years) using the RCADS anxiety subscales (generalized anxiety disorder [GAD], obsessive‐compulsive disorder [OCD], panic disorder [PD], separation anxiety [SA], social phobia [SP]). We examined longitudinal measurement invariance of the RCADS, using longitudinal confirmatory factor analysis, by examining the factor structure (configural invariance), factor loadings (metric invariance) and thresholds (strong invariance). We found that all anxiety subtypes were configural invariant. Metric invariance held for items on the GAD, OCD, PD and SA subscales; yet, for the SP subscale three items showed modest longitudinal variation at age 10–12. Model fit decreased modestly when enforcing additional constraints across time; however, model fit for these models was still adequate to excellent. We conclude that the RCADS measures anxiety symptoms similarly across time in a general population sample of adolescents; hence, measured changes in anxiety symptoms very likely reflect true changes in anxiety levels. We consider the instrument suitable to assess anxiety levels across adolescence. Copyright © 2013 John Wiley & Sons, Ltd.     

The factor structure of the Childhood Anxiety Sensitivity Index in German children

The factor structure of the Childhood Anxiety Sensitivity Index (CASI) was investigated in four nonclinic German samples (N = 1244, 225, 230, and 143) with participants aged 8–16-years-old. Factor solutions suggested for different CASI versions were tested using confirmatory factor analysis. The best goodness-of-fit indices were found for the 13-item CASI version with 4 factors (Disease Concerns, Unsteady Concerns, Mental Incapacitation Concerns, and Social Concerns). Testing for factorial invariance of this model with respect to age and gender revealed non-invariant factor loadings between children and adolescents as well as between boys and girls. The theoretical and clinical implications of these findings for anxiety sensitivity in children and adolescents are discussed.     

Measurement equivalence of neuropsychological tests across education levels in older adults

Objective. The objective was to determine whether neuropsychological tests provide an equivalent measure of the same psychological constructs in older adults with low versus higher levels of education. Method. Confirmatory factor analysis was used to evaluate the fit of a three-factor model (Verbal Ability, Visuospatial Ability, Long-Term Retention) to scores from the neuropsychological battery of the Canadian Study of Health and Aging (CSHA). Measurement equivalence of the model across lower educated (LE; ≤8 years) and higher educated (HE; ≥9 years) participants was evaluated using invariance testing. Results. The measurement model demonstrated adequate fit across LE and HE samples but the loadings of the 11 tests onto the three factors could not be constrained equally across groups. Animal Fluency and the Token Test were identified as noninvariant tests of Verbal Ability that, when freed from constraints, produced a partial metric invariance model. Scalar invariance testing identified the Buschke Cued Recall Test and Block Design as measures with invariant factor loadings but noninvariant intercepts. Analyses were replicated in age- and sex-matched subsamples. Conclusions. Metric and scalar invariance across HE and LE samples was achieved for seven of the 11 tests in the CSHA battery. Animal Fluency and the Token Test were noninvariant measures of Verbal Ability, suggesting that cognitive processes underlying performance on these tests may vary as a function of education. In addition, scores from Block Design and the Buschke Cued Recall Test were observed to differ in their scale of measurement between HE and LE examinees.     

Factorial validity and measurement equivalence of the Client Assessment of Treatment Scale for psychiatric inpatient care - a study in three European countries

Patients' views of inpatient care need to be assessed for research and routine evaluation. For this a valid instrument is required. The Client Assessment of Treatment Scale (CAT) has been used in large scale international studies, but its psychometric properties have not been well established. The structural validity of the CAT was tested among involuntary inpatients with psychosis. Data from locations in three separate European countries (England, Spain and Bulgaria) were collected. The factorial validity was initially tested using single sample confirmatory factor analyses in each country. Subsequent multi-sample analyses were used to test for invariance of the factor loadings, and factor variances across the countries. Results provide good initial support for the factorial validity and invariance of the CAT scores. Future research is needed to cross-validate these findings and to generalise them to other countries, treatment settings, and patient populations.     

The Brief Multidimensional Students' Life Satisfaction Scale (BMSLSS): Reliability,validity, and gender invariance in an Indian adolescent sample

This study examined the internal consistency reliability, factorial, convergent, discriminant, and predictive validity, as well as gender invariance of the Brief Multidimensional Students' Life Satisfaction Scale (BMSLSS; Seligson, Huebner, & Valois, 2003) in a sample of 445 adolescents (M_age = 16.04 years) hailing from the southernmost state of India, Kerala. The study also examined the test-retest reliability (n = 392) of the BMSLSS. The Cronbach's alpha coefficient suggested that the BMSLSS was reliable. Confirmatory factor analyses demonstrated the factorial validity of the BMSLSS. Bivariate correlational analyses provided support for the convergent, discriminant, and predictive validity of the BMSLSS. The test-retest reliability coefficient indicated the temporal stability of the BMSLSS. Finally, multi-group confirmatory factor analysis provided support for the gender invariance of the BMSLSS.     

Brief report: Testing measurement invariance and differences in self-concept between adolescents with and without physical illness or developmental disability

The aim of this study was to test for measurement invariance and examine differences in global self-concept between adolescents with and without physical illness or developmental disability. The sample consisted of adolescents 10–19 years who participated in the Canadian National Longitudinal Survey of Children and Youth (N = 8491). Multiple group confirmatory factor analysis was used to test for measurement invariance. Twenty-three percent (n = 1966) of participants had a physical illness or developmental disability. Support was found for strict measurement invariance between groups suggesting adolescents in both groups perceived items similarly, indicating that comparisons between adolescents with and without physical illness or developmental disability are meaningful. Controlling for several sociodemographic characteristics, evidence suggested that self-concept is lower in adolescents with physical illness or developmental disability, β = −0.24, p = 0.0005, compared to their healthy peers. Future work should attempt to understand the processes leading to compromised self-concept in adolescents with physical illness or developmental disability.     

Patient experiences with care across various types of mental health care: Questionnaire development,measurement invariance,and patients' reports

To describe the development, validation, and findings of a patient experience questionnaire across 7 types of residential and ambulatory mental health care services. Thirty‐five items were hypothesized to cover information, participation, therapeutic relationship, personalized care, organization and collaboration, safety, patient rights, outcomes of care, and discharge preparation and after‐care. Also included were 2 overall rating items (scoring and recommending the organization). This Dutch questionnaire was applied in 79 organizations in Belgium (N patients = 5,168). Exploratory structural equation modelling was conducted on a random split‐half sample to examine dimensionality. Confirmatory factor analysis and multiple group confirmatory factor analyses were conducted on the holdout sample to confirm dimensionality and assess measurement invariance across type of service and patient characteristics. Multilevel logistic regression models linking subscale top box scores to overall rating items were used to assess criterion validity. The hypothesized dimensionality was partly confirmed, and configural and scalar invariance were demonstrated across types of organizations and patient characteristics. Subscale scores were significantly associated with overall ratings. Process evaluation showed that participating organizations strongly support continued use of this questionnaire. This validated patient experience questionnaire supports comparison across organizations from different types of services to improve the quality of mental health care.