Cross-cultural invariance of the Academic Expectations Stress Inventory: Adolescent samples from Canada and Singapore

We provide further evidence for the two-factor structure of the 9-item Academic Expectations Stress Inventory (AESI) using confirmatory factor analysis on a sample of 289 Canadian adolescents and 310 Singaporean adolescents. Examination of measurement invariance tests the assumption that the model underlying a set of scores is directly comparable across groups. This study also examined the cross-cultural validity of the AESI using multigroup confirmatory factor analysis across both the Canadian and Singaporean adolescent samples. The results suggested cross-cultural invariance of form, factor loadings, and factor variances and covariances of the AESI across both samples. Evidence of AESI's convergent and discriminant validity was also reported. Findings from t-tests revealed that Singaporean adolescents reported a significantly higher level of academic stress arising from self expectations, other expectations, and overall academic stress, compared to Canadian adolescents. Also, a larger cross-cultural effect was associated with academic stress arising from other expectations compared with academic stress arising from self expectations.     

Validity and reliability of the Caregiver Reaction Assessment scale among primary informal caregivers for older persons in Singapore

Previous studies evaluating the validity and reliability of the Caregiver Reaction Assessment (CRA) scale (24 items; five subscales: schedule, health, finances, family support, and esteem) in different countries are not fully congruent. This article assesses the validity and reliability of the CRA among informal caregivers of older persons in Singapore. Data from a national survey of 1190 primary informal caregivers of Singaporeans aged ≥75 years with ≥1 activity of daily living limitation was analyzed. Fit of the five-factor model was tested in half of the sample using confirmatory factor analysis (CFA) and the other half subjected to exploratory factor analysis (EFA). The CRA was modified accordingly and again subjected to CFA. The CRA's measurement equivalence/invariance (ME/I) across language of administration (Chinese/English/Malay) was assessed. CFA showed a poor fit for the five-factor model. EFA suggested the presence of four factors, three items to have neither sufficient nor unique factor loadings and items on two of the subscales to load on a single factor. CFA of the ‘modified’ CRA (21 items; four subscales: schedule and health, finances, family support, and esteem) suggested a better fit for the four-factor model than for the five-factor model. ME/I analysis supported partial invariance of the CRA across language of administration. The CRA scale should be assessed for relevance in Asian settings. With the suggested modifications, it is suitable for assessing negative and positive effects of caregiving among informal caregivers of older persons with activity limitations in Singapore.     

The intellectual disability version of the very short form of the physical self-inventory (PSI-VS-ID): cross-validation and measurement invariance across gender, weight, age and intellectual disability level

Recently Maïano, Bégarie, Morin, and Ninot (2009) developed and validated an intellectual disability (ID) version of the very short form of the physical self-inventory (PSI-VS-ID). In a recent review of the various physical self-concept instruments Marsh and Cheng (in press) noted that the short and very short versions of the French PSI represent an important contribution to applied research but that further research was needed to investigate the robustness of their psychometric properties in new and diversified samples. Thus, this study is specifically designed to investigate the robustness of the PSI-VS-ID psychometric properties in a new independent sample of 248 adolescents and young adults with ID. In particular, tests of measurement invariance were conducted across the present sample and the original sample from Maïano et al. (2009) study in order to more precisely assess the degree of replication of the results. Overall, results from a series of confirmatory factor analyses of the PSI-VS-ID provided support for its: (i) factorial validity and reliability; (ii) factorial invariance across gender and weight status; (iii) partial (strict or strong) factorial invariance across age, ID level and samples; and (iv) latent mean differences across gender, weight status and ID level groups.     

Validating the cross-cultural factor structure and invariance property of the Insomnia Severity Index: evidence based on ordinal EFA and CFA

ObjectiveThe purpose of this study is to examine the factor structure of the Insomnia Severity Index (ISI) across samples recruited from different countries. We tried to identify the most appropriate factor model for the ISI and further examined the measurement invariance property of the ISI across samples from different countries.MethodsOur analyses included one data set collected from a Taiwanese sample and two data sets obtained from samples in Hong Kong and Canada. The data set collected in Taiwan was analyzed with ordinal exploratory factor analysis (EFA) to obtain the appropriate factor model for the ISI. After that, we conducted a series of confirmatory factor analyses (CFAs), which is a special case of the structural equation model (SEM) that concerns the parameters in the measurement model, to the statistics collected in Canada and Hong Kong. The purposes of these CFA were to cross-validate the result obtained from EFA and further examine the cross-cultural measurement invariance of the ISI.ResultsThe three-factor model outperforms other models in terms of global fit indices in Taiwan's population. Its external validity is also supported by confirmatory factor analyses. Furthermore, the measurement invariance analyses show that the strong invariance property between the samples from different cultures holds, providing evidence that the ISI results obtained in different cultures are comparable.ConclusionsThe factorial validity of the ISI is stable in different populations. More importantly, its invariance property across cultures suggests that the ISI is a valid measure of the insomnia severity construct across countries.     

Factor Structure and Invariance of the Reactive and Proactive Aggression Questionnaire in a Large Sample of Young Adolescents in Singapore

The present study investigated the factor structure, gender invariance, and convergent validity of the scores associated with the Reactive–Proactive Aggression Questionnaire (RPQ) in a Singapore sample of 1027 school-going adolescents. Results demonstrated that the 2-factor reactive–proactive aggression model had a superior fit compared with the 1-factor general aggression model, providing evidence that while reactive and proactive aggression were correlated, they were nevertheless distinct and separable. Current findings also provided empirical support for the invariance of the 2-factor model of the RPQ across gender. Furthermore, convergent validity was examined; while both reactive and proactive aggression were shown to be positively and significantly related to delinquency and narcissism, it was proactive aggression rather than reactive aggression that showed relatively stronger associations with delinquency and narcissism. Collectively, these findings provided evidence that there are meaningful differences between reactive and proactive aggression, and contributed to the cross-cultural generalizability of the RPQ.     

Does the Revised Child Anxiety and Depression Scale (RCADS) measure anxiety symptoms consistently across adolescence? The TRAILS study

We assessed if the Revised Child Anxiety and Depression Scale (RCADS) measures anxiety symptoms similarly across age groups within adolescence. This is crucial for valid comparison of anxiety levels between different age groups. Anxiety symptoms were assessed biennially in a representative population sample (n = 2226) at three time points (age range 10–17 years) using the RCADS anxiety subscales (generalized anxiety disorder [GAD], obsessive‐compulsive disorder [OCD], panic disorder [PD], separation anxiety [SA], social phobia [SP]). We examined longitudinal measurement invariance of the RCADS, using longitudinal confirmatory factor analysis, by examining the factor structure (configural invariance), factor loadings (metric invariance) and thresholds (strong invariance). We found that all anxiety subtypes were configural invariant. Metric invariance held for items on the GAD, OCD, PD and SA subscales; yet, for the SP subscale three items showed modest longitudinal variation at age 10–12. Model fit decreased modestly when enforcing additional constraints across time; however, model fit for these models was still adequate to excellent. We conclude that the RCADS measures anxiety symptoms similarly across time in a general population sample of adolescents; hence, measured changes in anxiety symptoms very likely reflect true changes in anxiety levels. We consider the instrument suitable to assess anxiety levels across adolescence. Copyright © 2013 John Wiley & Sons, Ltd.     

Consistency and factorial invariance of the Davidson trauma scale in heterogeneous populations: results from the 2010 Chilean earthquake

This investigation seeks to validate an application of a standardized post‐traumatic stress symptom self‐report survey, the Davidson Trauma Scale (DTS), with a large, heterogeneous population of earthquake victims. While previous studies have focused primarily on small samples, this investigation uses a unique dataset to assess the validity of this application of the DTS while accounting for heterogeneity and sample size. We use concurrent validity and reliability analysis tests to confirm the validity of the scale. Further, confirmatory factor analysis is used to test the fit of the data's factor structure against previously established trauma models. Finally, these fit tests are repeated across different mutually exclusive vulnerability subsets of the data in order to investigate how the invariance of the scale is affected by sample heterogeneity. We find that this particular application of the scale is, on the whole, reliable and valid, showing good concurrent validity. However, evidence of variability is found across specific vulnerability subsets, indicating that a heterogeneous sample can have a measurable impact on model fit. © 2016 The Authors International Journal of Methods in Psychiatric Research Published by John Wiley & Sons Ltd     

Assessment and characterization of phenotypic heterogeneity of anxiety disorders across five large cohorts

To achieve sample sizes necessary for effectively conducting genome‐wide association studies (GWASs), researchers often combine data from samples possessing multiple potential sources of heterogeneity. This is particularly relevant for psychiatric disorders, where symptom self‐report, differing assessment instruments, and diagnostic comorbidity complicates the phenotypes and contribute to difficulties with detecting and replicating genetic association signals. We investigated sources of heterogeneity of anxiety disorders (ADs) across five large cohorts used in a GWAS meta‐analysis project using a dimensional structural modeling approach including confirmatory factor analyses (CFAs) and measurement invariance (MI) testing. CFA indicated a single‐factor model provided the best fit in each sample with the same pattern of factor loadings. MI testing indicated degrees of failure of metric and scalar invariance which depended on the inclusion of the effects of sex and age in the model. This is the first study to examine the phenotypic structure of psychiatric disorder phenotypes simultaneously across multiple, large cohorts used for GWAS. The analyses provide evidence for higher order invariance but possible break‐down at more detailed levels that can be subtly influenced by included covariates, suggesting caution when combining such data. These methods have significance for large‐scale collaborative studies that draw on multiple, potentially heterogeneous datasets. Copyright © 2016 John Wiley & Sons, Ltd.     

Factor structure of the Impact of Event Scale‐Revised in two different Peruvian samples

Background: This article studied the factor structure of the Impact of Event Scale‐Revised (IES‐R) in two samples in Peru, i.e., a sample of survivors of a fire (N=174) and a university student sample (N=562). Methods: First, confirmatory factor analysis was used to compare nine different models of posttraumatic stress disorder symptoms as evaluated by the IES‐R in both of the samples separately. The model with the best fit in both samples had four correlated factors, i.e., Intrusion, Avoidance, Hyperarousal and Sleep Disturbance. Second, the degree of factorial invariance of the IES‐R was compared in both the samples using multiple group confirmatory factor analysis. Results and Conclusions: The results showed almost no differences between both samples. Finally, the results supported the internal consistency, as well as the concurrent and convergent validity of the IES‐R in Peru. Depression and Anxiety, 2009. © 2009 Wiley‐Liss, Inc.     

Attending to the Attentional Control Scale for Children: Confirming its factor structure and measurement invariance

The Attentional Control Scale for Children (ACS-C) is a widely used self-report questionnaire that measures attentional control in youth. Previous research examined factor-structure and validation of the ACS-C and yielded a 2-factor structure with Attentional Focusing and Attentional Shifting subscales. This study used a confirmatory factor analysis in a large, ethnically diverse sample of clinic-referred anxious youth (N = 442, ages 7–16 years) to compare model fit of three models, the original two-factor model of the ACS-C, a two-factor model of a modified ACS-C (two items re-assigned from Attentional Focusing to Attentional Shifting, three items removed from Attentional Focusing, and two items removed from Attentional Shifting), and a single-factor model. Results reveal best model fit for the two-factor modified ACS-C. This model had strong factorial invariance across sex, partial invariance across ethnicity, and was variant across age. Also, total and subscale scores for the two-factor modified ACS-C correlated with anxiety and depression symptom scale scores, supporting its concurrent validity. Findings confirm the two-factor structure of the modified ACS-C. Future research implications relating to attentional control in children are discussed.     

Three-Dimensional Model of Strengths: Examination of Invariance Across Gender,Age, Education Levels,and Marriage Status

Strengths are positive qualities that significantly contributed to well-being of individuals and community. Therefore, a reliable and valid measure of strengths for research and practice is needed. The Brief Strengths Scale (BSS) is a newly developed tool for measuring the three-dimensional strengths model (i.e., temperance, intellectual, and interpersonal strength). However, empirical support for the measurement invariance of the BSS has not been obtained. This study examined the three-factor structure of BSS across gender, age, education, and marriage groups in a community sample (n?=?375) using multi-group confirmatory factor analysis. After removing one item of each subscale from the original version, the revised model provided a good fit to the data at different subgroups. The revised nine-item BSS indicated that measurement invariance across gender and age groups was achieved. In addition, the measurement was more influenced by social-cultural factors than biological factors.     

Use of structural equation modeling to test the construct validity of a case definition of Gulf War syndrome: invariance over developmental and validation samples, service branches and publicity.

To attempt to replicate the syndrome-like structure identified by exploratory factor analysis of symptom reports from 249 Gulf War veterans of a Naval reserve battalion (the developmental sample), we administered Haley's original symptom questionnaire to 335 Gulf War veterans who served primarily in active-duty US Army units living in North Texas (the validation sample). On the basis of recently validated goodness-of-fit criteria (SRMRor=0.95), a structural equation model (Model 1) with four symptom scales loading on each of three first-order latent syndrome factors fit both the developmental and validation samples well and was invariant across both samples. Additional models validated a higher-order latent factor (a single Gulf War syndrome) explaining the variances and covariances of the first-order factors, four additional symptom scales loading on the higher-order factor, and four possible secondary factor loadings that also fit the data well. All structural models were invariant across cohorts of the validation sample surveyed before and after intense publicity following publication of the case definition. These findings suggest that the apparent syndrome structure of a single Gulf War syndrome with three variants may be found widely and justify a confirmatory sample survey of Gulf War-era veterans.     

Psychometric properties of the Malay Schizotypal Personality Questionnaire: Measurement invariance and latent mean comparisons in Malaysian adults

Introduction

The Schizotypal Personality Questionnaire (SPQ) is a widely used self‐report measurement instrument for the assessment of schizotypal personality traits. However, the factor structure of the SPQ has been a matter of some debate. As a contribution to this debate, we examined the factor structure of the SPQ in Malaysian adults.

Method

A total of 382 Malaysian adults completed a Malay translation of the SPQ. Confirmatory factory analysis was used to examine the fit of 3‐ and 4‐factor solutions for the higher‐order dimensionality of the SPQ. Ethnic invariance for the best‐fitting model was tested at the configural, metric, and scalar levels, and a multivariate analysis of variance was used to examine sex and ethnicity differences in domain scores.

Results

The 4‐factor model provided a better fit to the data than did the 3‐factor model. The 4‐factor model also demonstrated partial measurement invariance across ethnic groups. Latent mean comparisons for sex and ethnicity revealed a number of significant differences for both factors, but effect sizes were small.

Discussion

The 4‐factor structure of the SPQ received confirmatory support and can be used in Malay‐speaking populations.     

Testing Measurement Invariance of the Positive and Negative Affect Schedule (PANAS) in American and Arab University Students

Affect describes any feelings, emotions, or moods that a person experiences and is generally divided into two broad dimensions—positive affect and negative affect. The most widely used measure of affect, the Positive and Negative Affect Schedule (PANAS), has recently been translated to Arabic (see Appendix), yet the psychometric equivalence of this adapted measure is not fully understood. Using a series of multigroup confirmatory factor analyses, the current study examined measurement invariance of the English and adapted Arabic versions of the PANAS among 979 American and 1470 Arab university students. Although the two-factor structure of the 20-item PANAS was observed in both groups (configural variance), results did not support full invariance of factor loadings (metric invariance). A partial metric invariance model, however, revealed invariant loadings for all positive affect items and all but four negative affect items; dissimilar factor loadings emerged between groups for irritable, nervous, scared, and jittery. Evidence did not support scalar invariance of the 16 metric-invariant items, with only ten items demonstrating equivalent intercepts across groups. Finally, tests for strict invariance indicated nine of the ten scalar-invariant items had equivalent residual variances across groups.

All told, results suggest that the PANAS is partially invariant in American and Arab groups.

     

Factorial Invariance for Combined Wechsler Adult Intelligence Scale-Revised and Wechsler Memory Scale-Revised Scores in a Sample of Clients With Alcohol Dependency*

This study examined the joint factor structure of the WAIS-R and WMS-R in a sample of 289 participants (mostly males) with alcohol dependency. In a confirmatory phase we contrasted a range of factor models derived from previous analyses of the Wechsler scales. The best fitting model incorporated five factors representing Verbal Comprehension, Perceptual Organization, Attention-Concentration, Verbal Memory, and Visual Memory, with reassignment of factor loadings for two subtests. The invariance of the measurement model was then examined comparing data from a large sample of healthy participants (J. R. Carstairs E. A. Shores, 1999). The results indicated that the number of factors was invariant across samples, and four of the factors satisfied the criterion of partial measurement invariance.     

Confirmatory factor analysis of posttraumatic stress symptoms assessed by the Impact of Event Scale-Revised in Chinese earthquake victims: examining factor structure and its stability across sex

The current study investigated the factor structure of posttraumatic stress symptoms assessed by the Impact Event Scale-Revised (IES-R) in a large sample of individuals from China who recently experienced a destructive earthquake. The results of the confirmatory factor analysis indicated that a four-factor structure (intrusion, avoidance-numbing, hyperarousal, and sleep disturbance) emerged as the model best fit in total sample, female and male subsamples, respectively. Moreover, multiple-group confirmatory factor analysis further demonstrated that the four-factor model was quite stable across sex. Implication and limitations for the results are discussed.     

Construct validity of the Nutrition and Activity Knowledge Scale in a French sample of adolescents with mild to moderate intellectual disability

The purpose of this study was to test the reliability (i.e. internal consistency and test–retest reliability) and construct validity (i.e. content validity, factor validity, measurement invariance, and latent mean invariance) of the Nutrition and Activity Knowledge Scale (NAKS) in a sample of French adolescents with mild to moderate Intellectual Disability (ID). A total sample of 260 adolescents (144 boys and 116 girls), aged between 12 and 18 years old, with mild to moderate ID was involved in two studies. In the first study, analysis of items’ content reveals that many words from the original version were not understood or induced confusion. These items were reworded and simplified while retaining their original meaning. In the second study, results provided support for: (i) the factor validity and reliability of a 15-item French version of the NAKS; (ii) the measurement invariance of the resulting NAKS across genders and ID levels; (iii) the partial measurement invariance of the resulting NAKS across age groups and type of school placement. In addition, the latent means of the 15-item French version of the NAKS proved to be invariant across gender, age categories, and ID levels, but to vary across type of school placement (with adolescents schooled in self-contained classes from regular schools presenting higher levels of NAK than adolescents placed in specialized establishments). The present results thus provide preliminary evidence regarding the construct validity of a 15-item French version of the NAKS in a sample of adolescents with ID.     

Four-factor structure of obsessive-compulsive disorder symptoms in children, adolescents, and adults

ObjectiveTo determine whether the four-factor category-based obsessive-compulsive disorder (OCD) symptom structure from a previous confirmatory factor analysis (CFA) may be appropriately used in child, adolescent, and adult groups. Symptom dimensions are increasingly used as quantitative traits in genetic, neuroimaging, and treatment studies of OCD across all ages. Identification of a category-based OCD symptom dimension structure that is validated for use across child, adolescent, and adult age groups is necessary to guide ongoing translational research.MethodFour OCD samples comprising 356 individuals were divided into child, adolescent, and adult groups. The fit of the only CFA-defined four-factor model was compared across these independent age group samples. Multiple-group CFA using maximum likelihood estimation assessed adequacy of fit comparing unconstrained and measurement weight-constrained models. The fit of previous exploratory factor analysis-defined three- and five-factor models on adults was also examined using CFA.ResultsA four-factor solution provided adequate but imperfect fit across age groups, with comparable indices to the only previous OCD CFA: factor 1 (aggressive/sexual/religious/somatic/checking); factor 2 (symmetry/ordering/counting/repeating); factor 3 (contamination/cleaning), and factor 4 (hoarding). Models in which factor loadings were constrained and unconstrained across the three age groups yielded comparable model fit. Factors were highly correlated and were not mutually exclusive. The four-factor solution provided an improved fit to both three- and five-factor solutions using CFA across the three age groups.ConclusionsA four-factor, CFA-defined, category-based model of OCD symptom dimensions is adequate for use in children, adolescents, and adult age groups. The factor structure of this multiple age group sample has limitations and is imperfect, but current findings support the comparability of the defined latent OCD dimensions across age groups. Further work is needed to optimize a comprehensive symptom dimension model reflecting clinical heterogeneity for use in emergent translational studies. J. Am. Acad. Child Adolesc. Psychiatry, 2008; 47(7):763–772.     

Multigroup Ethnic Identity Measurement invariance across adolescence and diverse ethnic groups

IntroductionEthnic identity is an important protective factor for various ethnic groups and developmental periods. Although existing measures assessing ethnic identity are well known, less is known about the measurement invariance of the Multigroup Ethnic Identity Measure (MEIM) across adolescent ethnic groups. The present study evaluates the factor structure of MEIM (Roberts et al., 1999) and tests the measurement invariance across early and middle adolescence and ethnic background (N = 4940).MethodsData from an ethnic minority sample of youth (54% girls; M_age = 13.88, grades 6th – 12th; 60% African American, 22% multi-ethnic, 8% Latinx, 5% Asian, 5% American Indian) in the United States of America were examined using confirmatory factor analysis (CFA) and multi-group measurement invariance via a structural equation modeling (SEM) framework. Models for invariance were tested using full information maximum likelihood-robust (FIML-R) estimation in Mplus.ResultsCFA supported a three-factor solution (i.e., cognitive clarity, behavioral engagement, and affective pride). The model indicated scalar invariance across early and middle adolescence and partial scalar invariance across the five self-identified racial/ethnic minority groups. There were no grade differences on the ethnic identity factors. Among the racial/ethnic groups, multi-ethnic youth reported the lowest levels on all three ethnic identity factors compared to the other groups.ConclusionsResults of this study point to the validity of using the MEIM for meaningful comparisons of ethnic identity across ethnic groups and across early and middle adolescence. Implications for the interpretation and use of this measure with diverse adolescents are discussed.     

Factor structure and construct validity of the Anxiety Sensitivity Index among island Puerto Ricans

The factor structure and convergent and discriminant validity of the Anxiety Sensitivity Index (ASI) were examined among a sample of 275 island Puerto Ricans. Results from a confirmatory factor analysis (CFA) comparing our data to factor solutions commonly reported as representative of European American and Spanish populations indicated a poor fit. A subsequent exploratory factor analysis (EFA) indicated that a two-factor solution (Factor 1, Anxiety Sensitivity; Factor 2, Emotional Concerns) provided the best fit. Correlations between the ASI and anxiety measures were moderately high providing evidence of convergent validity, while correlations between the ASI and BDI were significantly lower providing evidence of discriminant validity. Scores on all measures were positively correlated with acculturation, suggesting that those who ascribe to more traditional Hispanic culture report elevated anxiety.