Psychometric properties of the self-reporting questionnaire (SRQ-20): Measurement invariance across women from Brazilian community settings

BackgroundSRQ-20 is a validated screening tool for common psychiatric disorders in several countries. Exploration of the latent structure of this instrument resulted in conflicting evidence. This study aimed to explore the latent structure of SRQ-20 among Brazilian women from community settings. We also tested the model invariance across different sociodemographic conditions.MethodsExploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were conducted on a sample of 1668 women from four different geographical regions of Brazil. Invariance of the model was tested through multi-group CFA according to sociodemographic variables.ResultsEFA has shown two potential solutions with two and three factors. CFA resulted in indices of the two-factor solution slightly worse than the three-factor solution. Invariance testing has shown this model was not invariant across cities, but was invariant across different social classes. The structure was also invariant for the two lower educated groups. The respecified model (i.e., excluding item 16) was not invariant across groups with different educational levels.ConclusionThe three-factor solution seems to be the most suitable model of SRQ-20 for Brazilian women in community settings. Furthermore, sociodemographic variables seem to reflect on the latent structure of this instrument. Validation of screening tools should consider sociodemographic variables.     

Validity and reliability of the Caregiver Reaction Assessment scale among primary informal caregivers for older persons in Singapore

Previous studies evaluating the validity and reliability of the Caregiver Reaction Assessment (CRA) scale (24 items; five subscales: schedule, health, finances, family support, and esteem) in different countries are not fully congruent. This article assesses the validity and reliability of the CRA among informal caregivers of older persons in Singapore. Data from a national survey of 1190 primary informal caregivers of Singaporeans aged ≥75 years with ≥1 activity of daily living limitation was analyzed. Fit of the five-factor model was tested in half of the sample using confirmatory factor analysis (CFA) and the other half subjected to exploratory factor analysis (EFA). The CRA was modified accordingly and again subjected to CFA. The CRA's measurement equivalence/invariance (ME/I) across language of administration (Chinese/English/Malay) was assessed. CFA showed a poor fit for the five-factor model. EFA suggested the presence of four factors, three items to have neither sufficient nor unique factor loadings and items on two of the subscales to load on a single factor. CFA of the ‘modified’ CRA (21 items; four subscales: schedule and health, finances, family support, and esteem) suggested a better fit for the four-factor model than for the five-factor model. ME/I analysis supported partial invariance of the CRA across language of administration. The CRA scale should be assessed for relevance in Asian settings. With the suggested modifications, it is suitable for assessing negative and positive effects of caregiving among informal caregivers of older persons with activity limitations in Singapore.     

Cross-cultural invariance of the Academic Expectations Stress Inventory: Adolescent samples from Canada and Singapore

We provide further evidence for the two-factor structure of the 9-item Academic Expectations Stress Inventory (AESI) using confirmatory factor analysis on a sample of 289 Canadian adolescents and 310 Singaporean adolescents. Examination of measurement invariance tests the assumption that the model underlying a set of scores is directly comparable across groups. This study also examined the cross-cultural validity of the AESI using multigroup confirmatory factor analysis across both the Canadian and Singaporean adolescent samples. The results suggested cross-cultural invariance of form, factor loadings, and factor variances and covariances of the AESI across both samples. Evidence of AESI's convergent and discriminant validity was also reported. Findings from t-tests revealed that Singaporean adolescents reported a significantly higher level of academic stress arising from self expectations, other expectations, and overall academic stress, compared to Canadian adolescents. Also, a larger cross-cultural effect was associated with academic stress arising from other expectations compared with academic stress arising from self expectations.     

Factorial validity and measurement equivalence of the Client Assessment of Treatment Scale for psychiatric inpatient care - a study in three European countries

Patients' views of inpatient care need to be assessed for research and routine evaluation. For this a valid instrument is required. The Client Assessment of Treatment Scale (CAT) has been used in large scale international studies, but its psychometric properties have not been well established. The structural validity of the CAT was tested among involuntary inpatients with psychosis. Data from locations in three separate European countries (England, Spain and Bulgaria) were collected. The factorial validity was initially tested using single sample confirmatory factor analyses in each country. Subsequent multi-sample analyses were used to test for invariance of the factor loadings, and factor variances across the countries. Results provide good initial support for the factorial validity and invariance of the CAT scores. Future research is needed to cross-validate these findings and to generalise them to other countries, treatment settings, and patient populations.     

Cross‐cultural measurement invariance of the General Health Questionnaire‐12 in a German and a Colombian population sample

While the General Health Questionnaire, 12‐item version (GHQ‐12) has been widely used in cross‐cultural comparisons, rigorous tests of the measurement equivalence of different language versions are still lacking. Thus, our study aims at investigating configural, metric and scalar invariance across the German and the Spanish version of the GHQ‐12 in two population samples. The GHQ‐12 was applied in two large‐scale population‐based samples in Germany (N = 1,977) and Colombia (N = 1,500). To investigate measurement equivalence, confirmatory factor analyses were conducted in both samples. In the German sample mean GHQ‐12 total scores were higher than in the Colombian sample. A one‐factor model including response bias on the negatively worded items showed superior fit in the German and the Colombian sample; thus both versions of the GHQ‐12 showed configural invariance. Factor loadings and intercepts were not equal across both samples; thus GHQ‐12 showed no metric and scalar invariance. As both versions of the GHQ‐12 did not show measurement equivalence, it is not recommendable to compare both measures and to conclude that mental distress is higher in the German sample, although we do not know if the differences are attributable to measurement problems or represent a real difference in mental distress. The study underlines the importance of measurement equivalence in cross‐cultural comparisons.     

Factorial Invariance for Combined Wechsler Adult Intelligence Scale-Revised and Wechsler Memory Scale-Revised Scores in a Sample of Clients With Alcohol Dependency*

This study examined the joint factor structure of the WAIS-R and WMS-R in a sample of 289 participants (mostly males) with alcohol dependency. In a confirmatory phase we contrasted a range of factor models derived from previous analyses of the Wechsler scales. The best fitting model incorporated five factors representing Verbal Comprehension, Perceptual Organization, Attention-Concentration, Verbal Memory, and Visual Memory, with reassignment of factor loadings for two subtests. The invariance of the measurement model was then examined comparing data from a large sample of healthy participants (J. R. Carstairs E. A. Shores, 1999). The results indicated that the number of factors was invariant across samples, and four of the factors satisfied the criterion of partial measurement invariance.     

Factorial Structure and Invariance of the Academic Expectations Stress Inventory Across Hispanic and Chinese Adolescent Samples

Using confirmatory factor analysis, the current study provided further evidence for the two-factor structure of the Academic Expectations Stress Inventory [AESI; Ang RP, Huan VS (2006) Educ Psych Meas 66:522–539] using a sample of 191 US Hispanic adolescents and a sample of 211 Singapore Chinese adolescents. This study also examined the cross-cultural validity of the AESI using multigroup confirmatory factor analysis to investigate the invariance of the factor structure of the AESI across both samples. Results from multigroup confirmatory factor analysis suggested that while partial invariance was observed across the samples, the consistency of fit indices indicating either no change or a minimal loss of fit between the unconstrained basic model and the partially constrained models, provided support that partial invariance was acceptable. Analyses of covariance results indicated that perceived overall academic stress and academic stress arising from self-expectations were significantly higher among Singapore Chinese adolescents compared with US Hispanic adolescents.     

Autonomy is equally important across East and West: Testing the cross-cultural universality of self-determination theory

IntroductionSelf-determination theory (SDT) posits the importance of three basic psychological needs (i.e., relatedness, autonomy, and competence) in promoting achievement. However, some cross-cultural researchers have cast doubt on the generalizability of the theory to non-Western cultures. The primary aim of the study was to test whether provision of support for relatedness, autonomy, and competence would be associated with achievement across both Western and Eastern cultures.MethodWe drew on a subsample of students from the Program for International Student Assessment (PISA) (n = 92,325 students from Australia, Canada, New Zealand, UK, and USA (Western societies); and Hong Kong SAR, Japan, Macau SAR, Shanghai, South Korea, and Taipei (Eastern societies); 46,006 were females and 46,319 were males, with a mean age of 15.77 (SD = 0.29) years). We used multi-group confirmatory factor analysis (MG-CFA) and multi-group structural equation modeling (MG-SEM) to analyze the data.ResultsProvision of the three basic needs correlated positively with achievement across cultures, providing broad support for the cross-cultural universality of SDT. MG-SEM indicated that relatedness and autonomy support were equally important for student achievement in both Western and Eastern cultures, whereas competence support was found to be more important to students in the West than in the East.ConclusionFindings support the cross-cultural relevance of SDT while at the same time highlighting important cultural variations such as greater importance of competence support in the West, suggesting the need to be cognizant of both cross-cultural universality and variability in motivational theorizing.     

Multigroup Ethnic Identity Measurement invariance across adolescence and diverse ethnic groups

IntroductionEthnic identity is an important protective factor for various ethnic groups and developmental periods. Although existing measures assessing ethnic identity are well known, less is known about the measurement invariance of the Multigroup Ethnic Identity Measure (MEIM) across adolescent ethnic groups. The present study evaluates the factor structure of MEIM (Roberts et al., 1999) and tests the measurement invariance across early and middle adolescence and ethnic background (N = 4940).MethodsData from an ethnic minority sample of youth (54% girls; M_age = 13.88, grades 6th – 12th; 60% African American, 22% multi-ethnic, 8% Latinx, 5% Asian, 5% American Indian) in the United States of America were examined using confirmatory factor analysis (CFA) and multi-group measurement invariance via a structural equation modeling (SEM) framework. Models for invariance were tested using full information maximum likelihood-robust (FIML-R) estimation in Mplus.ResultsCFA supported a three-factor solution (i.e., cognitive clarity, behavioral engagement, and affective pride). The model indicated scalar invariance across early and middle adolescence and partial scalar invariance across the five self-identified racial/ethnic minority groups. There were no grade differences on the ethnic identity factors. Among the racial/ethnic groups, multi-ethnic youth reported the lowest levels on all three ethnic identity factors compared to the other groups.ConclusionsResults of this study point to the validity of using the MEIM for meaningful comparisons of ethnic identity across ethnic groups and across early and middle adolescence. Implications for the interpretation and use of this measure with diverse adolescents are discussed.     

The two scaled versions of the Chinese General Health Questionnaire: a comparative analysis

The four scales of the Chinese 28-item General Health Questionaire (GHQ-28), and the five scales of the Chinese GHQ-20 were separately subjected to confirmatory factor analysis (in individual sample analyses and simultaneous multi-sample analyses) based on four Chinese samples of 150 general psychiatric patients, 549 school teachers, 653 university undergraduates, and 1082 secondary school students. While the two scaled versions were comparable in discriminating patients from nonpatients, the five scales of the GHQ-20 assessing five correlated dimensions were interpreted as mapping salient symptom areas in the Hong Kong Chinese population as they were empirically derived in the Chinese setting. The need for using samples from different cultural settings in multi-sample confirmatory analysis was discussed.     

Social Anxiety Scale for Adolescents: Factorial invariance and latent mean differences across gender and age in Spanish adolescents

Little is known about the factorial invariance across gender and age for self-report measures of social anxiety in adolescence. This study examined the factorial invariance and latent mean differences of the Social Anxiety Scale for Adolescents (SAS-A) across gender and age groups in 1570 Spanish adolescents (54% girls), ranging in age from 14 to 17 years. Equality of factor structures was compared using multi-group confirmatory factor analyses. Measurement invariance for the correlated three-factor model of the SAS-A was found across gender and age samples. Analyses of latent mean differences revealed that girls exhibited higher means than boys on two SAS-A subscales, Fear of Negative Evaluation and Social Avoidance and Distress-New (SAD-New). In addition, on the SAD-New subscale, the structured means significantly diminished from 14-year olds to 16- and 17-year olds and from 15-year olds to 17-year olds. Findings are discussed in terms of the use of the SAS-A with Spanish adolescents.     

Assessment and characterization of phenotypic heterogeneity of anxiety disorders across five large cohorts

To achieve sample sizes necessary for effectively conducting genome‐wide association studies (GWASs), researchers often combine data from samples possessing multiple potential sources of heterogeneity. This is particularly relevant for psychiatric disorders, where symptom self‐report, differing assessment instruments, and diagnostic comorbidity complicates the phenotypes and contribute to difficulties with detecting and replicating genetic association signals. We investigated sources of heterogeneity of anxiety disorders (ADs) across five large cohorts used in a GWAS meta‐analysis project using a dimensional structural modeling approach including confirmatory factor analyses (CFAs) and measurement invariance (MI) testing. CFA indicated a single‐factor model provided the best fit in each sample with the same pattern of factor loadings. MI testing indicated degrees of failure of metric and scalar invariance which depended on the inclusion of the effects of sex and age in the model. This is the first study to examine the phenotypic structure of psychiatric disorder phenotypes simultaneously across multiple, large cohorts used for GWAS. The analyses provide evidence for higher order invariance but possible break‐down at more detailed levels that can be subtly influenced by included covariates, suggesting caution when combining such data. These methods have significance for large‐scale collaborative studies that draw on multiple, potentially heterogeneous datasets. Copyright © 2016 John Wiley & Sons, Ltd.     

Cross-Cultural Adaptation and Validation of the Quality of Life Questionnaire for Caregivers of Patients with Schizophrenia (S-CGQoL) in Latin America

ObjectivesThe aim of this study was to adapt and validate the Schizophrenia Caregiver's Quality of Life Questionnaire (S-CGQoL) for use in the Hispanic-American population from the caregiver's perspective.MethodsA cross-sectional instrumental model was used, with a sample of 253 caregivers of patients suffering of Schizophrenia in Bolivia, Peru and Chile. The psychometric properties of the S-CGQoL were tested through construct validity, reliability and some aspects of external validity. In addition, in order to assess the nature of the different items across the three countries, a Differential Performance Analysis (DPA) was conducted.ResultsA confirmatory factor analysis showed that the scale structure was well correlated to the initial structure of the QoL-MDS. The results confirmed the existence of adequate reliability indicators (α> .70 and ω> .80) and the absence of FIDs supporting the invariance of item calibrations among the three Latin American countries.ConclusionsThe adaptation and validation of the S-CGQoL questionnaire demonstrate adequate psychometric properties to assess the quality of life of caregivers in samples of middle-income countries in Latin America.     

The intellectual disability version of the very short form of the physical self-inventory (PSI-VS-ID): cross-validation and measurement invariance across gender, weight, age and intellectual disability level

Recently Maïano, Bégarie, Morin, and Ninot (2009) developed and validated an intellectual disability (ID) version of the very short form of the physical self-inventory (PSI-VS-ID). In a recent review of the various physical self-concept instruments Marsh and Cheng (in press) noted that the short and very short versions of the French PSI represent an important contribution to applied research but that further research was needed to investigate the robustness of their psychometric properties in new and diversified samples. Thus, this study is specifically designed to investigate the robustness of the PSI-VS-ID psychometric properties in a new independent sample of 248 adolescents and young adults with ID. In particular, tests of measurement invariance were conducted across the present sample and the original sample from Maïano et al. (2009) study in order to more precisely assess the degree of replication of the results. Overall, results from a series of confirmatory factor analyses of the PSI-VS-ID provided support for its: (i) factorial validity and reliability; (ii) factorial invariance across gender and weight status; (iii) partial (strict or strong) factorial invariance across age, ID level and samples; and (iv) latent mean differences across gender, weight status and ID level groups.     

Reliability and validity of the coping strategy inventory-short form applied to hemodialysis patients in 13 countries: Results from the Dialysis Outcomes and Practice Patterns Study (DOPPS)

ObjectivesThe Coping Strategies Inventory-Short Form (CSI-SF) measures four coping strategies based on 16 items: 4 items each indicating problem- vs. emotion-focused engagement or disengagement. Here we provide the first assessment of reliability and construct validity of the CSI-SF among hemodialysis patients across 13 countries.MethodsThe CSI-SF was completed by patients in 9 languages in phase 4 of the Dialysis Outcomes and Practice Patterns Study (2009–11). Cronbach's alpha was used to assess internal consistency. Exploratory and confirmatory factor analyses were applied to assess the factor structure of the CSI-SF by country and language. CSI-SF data were analyzed from 7201 patients (60% male; median age 62.5 [range 18–96] years).ResultsGood internal consistency (α = 0.56–0.80) was seen for three scales in English (US, UK, Canada, Australia, New Zealand), German, and Swedish versions. The fourth scale was internally consistent if two items were dropped. In these countries, both exploratory and confirmatory factor analyses indicated a factor structure consistent with the four CSI-SF scales. Other language versions showed a factor structure inconsistent with these four scales.ConclusionThe slightly modified English, German, and Swedish versions of the CSI-SF are reliable and valid instruments for measuring coping strategies in hemodialysis patients.     

Psychometric properties of the World Health Organization Disability Assessment Schedule used in the European Study of the Epidemiology of Mental Disorders

This study assessed the factor structure, internal consistency, and discriminatory validity of the World Health Organization Disability Assessment Schedule (WHODAS) version used in the European Study of the Epidemiology of Mental Disorders (ESEMeD). In total 8796 adults were assessed using the ESEMeD WHODAS (22 severity and 8 frequency items). An Exploratory Factor Analysis (EFA) with promax rotation was done with a random 50%. The other half was used for confirmatory factor analysis (CFA) comparing models (a) suggested by EFA; (b) hypothesized a priori; and (c) reduced with four items. A CFA model with covariates was conducted in the whole sample to assess invariance across Mediterranean (Spain, France and Italy) and non-Mediterranean (Belgium, Germany and the Netherlands) countries. Cronbach's alphas and discriminatory validity were also examined. EFA identified seven factors (explained variance: 80%). The reduced model (six factors, four frequency items excluded) presented the best fit [Confirmatory Fit Index (CFI) = 0.992, Tucker-Lewis Index (TLI) = 0.996, Root Mean Square Error of Approximation (RMSEA) = 0.024]. The second-order factor structure also fitted well (CFI = 0.987, TLI = 0.991, RMSEA = 0.036). Measurement non-invariance was found for Embarrassment. Cronbach's alphas ranged from 0.84 for Participation to 0.93 for Mobility. Preliminary data suggest acceptable discriminatory validity. Thus, the ESEMeD WHODAS may well be a valuable shortened version of the WHODAS-II, but future users should reconsider the filter questions.     

Measuring disability across cultures — the psychometric properties of the WHODAS II in older people from seven low‐ and middle‐income countries. The 10/66 Dementia Research Group population‐based survey

We evaluated the psychometric properties of the 12‐item interviewer‐administered screener version of the World Health Organization Disability Assessment Schedule – version II (WHODAS II) among older people living in seven low‐ and middle‐income countries. Principal component analysis (PCA), confirmatory factor analysis (CFA) and Mokken analyses were carried out to test for unidimensionality, hierarchical structure, and measurement invariance across 10/66 Dementia Research Group sites. PCA generated a one‐factor solution in most sites. In CFA, the two‐factor solution generated in Dominican Republic fitted better for all sites other than rural China. The two factors were not easily interpretable, and may have been an artefact of differing item difficulties. Strong internal consistency and high factor loadings for the one‐factor solution supported unidimensionality. Furthermore, the WHODAS II was found to be a ‘strong’ Mokken scale. Measurement invariance was supported by the similarity of factor loadings across sites, and by the high between‐site correlations in item difficulties. The Mokken results strongly support that the WHODAS II 12‐item screener is a unidimensional and hierarchical scale confirming to item response theory (IRT) principles, at least at the monotone homogeneity model level. More work is needed to assess the generalizability of our findings to different populations. Copyright © 2010 John Wiley & Sons, Ltd.     

The Peer Aggressive and Reactive Behavior Questionnaire (Parb-Q): Measurement Invariance Across Italian and Brazilian Children, Gender and Age

This study examines measurement invariance, reliability and scores differences of the Peer Aggressive and Reactive Behaviors Questionnaire (PARB-Q) across Italian and Brazilian children, gender and age. Participants were 587 Italian and 727 Brazilian children, aged 7–13 years from 12 elementary schools. The PARB-Q is a brief self-report instrument composed by two scales that assess aggressive behavior and reactions to peer aggression. Multigroup confirmatory factor analyses indicated full measurement invariance of the PARB-Q across groups based on country, gender and age, providing support for the unidimensionality of the first scale (direct peer aggression, PA) and a 3-factor model of the second scale (reactive aggression, RA; seeking teacher support, STS; internalizing reaction, IR). Reliability indices were good for all factors. Italian children reported a higher frequency of PA and a lower frequency of IR than the Brazilian children. Boys scored higher than girls on PA and RA, while girls scored higher than boys on STS and IR. Younger children reported a lower frequency of PA and a higher frequency of STS than older children. Results provide support for structure validity and reliability of the PARB-Q in two countries and information on differences related to gender, age and culture in peer relationships in elementary school.     

Investigating the Measurement Properties of the Social Responsiveness Scale in Preschool Children with Autism Spectrum Disorders

The purpose of this study was to examine the measurement properties of the Social Responsiveness Scale in an accelerated longitudinal sample of 4-year-old preschool children with the complementary approaches of categorical confirmatory factor analysis and Rasch analysis. Measurement models based on the literature and other hypothesized measurement models which were tested using categorical confirmatory factor analysis did not fit well and were not unidimensional. Rasch analyses showed that a 30-item subset met criteria of unidimensionality and invariance across item, person, and over time; and this subset exhibited convergent validity with other child outcomes. This subset was shown to have enhanced psychometric properties and could be used in measuring social responsiveness among preschool age children with Autism Spectrum Disorders.     

Are the Insomnia Severity Index and Pittsburgh Sleep Quality Index valid outcome measures for Cognitive Behavioral Therapy for Insomnia? Inquiry from the perspective of response shifts and longitudinal measurement invariance in their Chinese versions

ObjectiveThe purpose of this study was to examine whether the Insomnia Severity Index (ISI) and Pittsburgh Sleep Quality Index (PSQI) are valid outcome measures for Cognitive Behavioral Therapy for Insomnia (CBT-I). Specifically, we tested whether the factorial parameters of the ISI and the PSQI could remain invariant against CBT-I, which is a prerequisite to using their change scores as an unbiased measure of the treatment outcome of CBT-I.MethodsA clinical data set including scores on the Chinese versions of the ISI and the PSQI obtained from 114 insomnia patients prior to and after a 6-week CBT-I program in Taiwan was analyzed. A series of measurement invariance (MI) tests were conducted to compare the factorial parameters of the ISI and the PSQI before and after the CBT-I treatment program.ResultsMost factorial parameters of the ISI remained invariant after CBT-I. However, the factorial model of the PSQI changed after CBT-I treatment. An extra loading with three residual correlations was added into the factorial model after treatment.ConclusionsThe partial strong invariance of the ISI supports that it is a valid outcome measure for CBT-I. In contrast, various changes in the factor model of the PSQI indicate that it may not be an appropriate outcome measure for CBT-I. Some possible causes for the changes of the constructs of the PSQI following CBT-I are discussed.