The Thai version of Effort-Reward Imbalance Questionnaire (Thai ERIQ): a study of psychometric properties in garment workers

This study aimed to test the psychometric properties of the Thai version of the Effort-Reward Imbalance Questionnaire (T-ERIQ). The English version of the 23-item ERIQ was translated and back-translated. Content validity was examined by five experts and face validity was examined by twelve key informants before being tested for construct validity with 828 workers from six garment factories. Predictive validity was assessed through the relationship between the ERI constructs and psychological health outcomes including psychosomatic symptoms, state of anxiety, depression, and job satisfaction. The internal consistency of the Thai ERIQ was tested using the first survey (n=828), and test-retest stability was examined 2 to 4 wk later with a subsample (n=408). The results show that 2% of workers reported effort-reward imbalance (ERI ratio>/=1). The Thai ERIQ has good content validity with a Content Validity Index of 0.95. Cronbach's alpha coefficients for the effort, reward, and overcommitment scales were 0.77, 0.81, and 0.66, respectively. The 2-4 wk stability of these three constructs was moderate (r=0.496-0.576, p<0.001). Overall, the factorial validity was demonstrated as the best model fit, with high values of the goodness-of-fit indices, using confirmatory factor analysis, indicating accordance with the theoretical constructs of the ERI model. Logistic regression analyses supported significant associations of reward with all psychological health outcomes (p<0.05). The findings suggest that the Thai ERIQ has adequate reliability and validity to investigate the psychosocial work environment. The Thai ERIQ can be applied to the Thai working population, particularly industrial manufacturing workers.     

Psychometric properties of the Korean version of the effort–reward imbalance questionnaire: a study in a petrochemical company

Objective To evaluate the criterion validity, factorial validity, and internal consistency of Korean version of effort–reward imbalance (ERI) for the scales of effort, reward, and overcommitment as well as to examine the effect of psychosocial factors on physical and mental illness among petroleum refinery workers in South Korea. Methods The Korean version of ERI questionnaire was constructed using the translation and back-translation technique, and its psychometric properties were explored among 908 male workers in a large petroleum refinery in South Korea in 2002. Cronbach’s alpha coefficient was used to test internal consistency. An exploratory factor analysis was conducted on all items of the instrument. Confirmatory factor analyses were conducted on each dimension of effort, reward and overcommitment. Physical and mental health was measured by self-rated health (SF-8). The lowest tertiles of the scores were defined as illness. Multiple logistic regression models were used to test the effect of job stress on the physical and mental health (criterion validity of ERI scales). Results The Cronbach’s alpha coefficients for effort, reward, and overcommitment were 0.71, 0.86, and 0.75, respectively, indicating satisfactory internal consistency. Exploratory factor analysis found three latent factors, which closely corresponded to the theoretical structure of the ERI model. Acceptable construct validity was shown using confirmatory factor analysis. The highest tertile of effort–reward ratio was significantly associated with physical illness (OR 2.4, 95% CI 1.7–3.6) and mental illness (OR 2.9, 95% CI 2.0–4.2), compared to lower tertiles. Overcommitment was significantly associated with mental illness, but not with physical illness. Conclusions These findings contribute to the validity and reliability of the Korean ERI questionnaire. Importantly, in the context of a rapid change in the labour market, the lack of reciprocity between efforts and rewards at work is strongly associated with self-rated physical and mental health.     

A short generic measure of work stress in the era of globalization: effort–reward imbalance

Objective  We evaluate psychometric properties of a short version of the original effort–reward imbalance (ERI) questionnaire. This measure is of interest in the context of assessing stressful work conditions in the era of economic globalization. Methods  In a representative sample of 10,698 employed men and women participating in the longitudinal Socio-Economic Panel (SOEP) in Germany, a short version of the ERI questionnaire was included in the 2006 panel wave. Structural equation modeling and logistic regression analysis were applied. Results  In addition to satisfactory internal consistency of scales, a model representing the theoretical structure of the scales provided the best data fit in a competitive test (RMSEA = 0.059, CAIC = 4124.19). Scoring high on the ERI scales was associated with elevated risks of poor self-rated health. Conclusions  This short version of the ERI questionnaire reveals satisfactory psychometric properties, and can be recommended for further use in research and practice.     

The Brazilian version of the effort-reward imbalance questionnaire to assess job stress

The effort-reward imbalance (ERI) model has been used to assess the health impact of job stress. We aimed at describing the cross-cultural adaptation of the ERI questionnaire into Portuguese and some psychometric properties, in particular internal consistency, test-retest reliability, and factorial structure. We developed a Brazilian version of the ERI using a back-translation method and tested its reliability. The test-retest reliability study was conducted with 111 health workers and University staff. The current analyses are based on 89 participants, after exclusion of those with missing data. Reproducibility (interclass correlation coefficients) for the "effort", "'reward", and "'overcommitment"' dimensions of the scale was estimated at 0.76, 0.86, and 0.78, respectively. Internal consistency (Cronbach's alpha) estimates for these same dimensions were 0.68, 0.78, and 0.78, respectively. The exploratory factorial structure was fairly consistent with the model's theoretical components. We conclude that the results of this study represent the first evidence in favor of the application of the Brazilian Portuguese version of the ERI scale in health research in populations with similar socioeconomic characteristics.     

Burnout and job stress among mongolian doctors and nurses

Due to the inherent demands of their profession, doctors and nurses are at great risk of suffering from burnout caused by job stress. This study examined the prevalence of burnout among doctors and nurses in Mongolia and identified the factors influencing their burnout. A self-administered questionnaire of 180 doctors (45.9%) and 212 nurses (54.1%) resulted in a response rate of 87%. Burnout was measured by the Copenhagen Burnout Inventory (CBI) in three scales: personal burnout, work-related burnout, and client-related burnout. Job stress was measured by the effort-reward imbalance (ERI) model. Compared with the prior studies of hospital staffs in other countries, doctors and nurses in Mongolia had relatively higher burnout rates, with personal, work-related and client-related average scores of 45.39, 44.45, and 32.46, respectively. Multiple regression analysis revealed that ERI significantly influenced all dimensions of burnout but over-commitment significantly influenced only personal and work-related burnout. Both ERI and over-commitment were different among professions.     

Effort-reward imbalance among nurses in stable countries and in countries in transition

The effort-reward imbalance (ERI) model was used to analyze burnout and intention to leave the nursing profession (ITL) in nurses (n = 21,229) in seven European countries, as part of the NEXT-Study. Data were gathered using the short form of the ERI questionnaire. Burnout was assessed using the Copenhagen Burnout Inventory. Multivariate logistic regression analysis controlled for age and gender. ERI was very high in Poland, Germany, Italy, and Slovakia. High ERI was associated with burnout. Odds ratios (ORs) ranged from 2.6 to 13.2 for ERI and from 3.0 to 5.5 for overcommitment (OC). Nurses with high ERI also had high ORs for ITL (2.6-5.7). The association of OC and ITL was weaker (1.1-1.7). The strong and consistent associations of ERI model results with psychological health and with ITL support the relevance of the model for examining different outcome levels. Nurses in transitional countries, as expected, experienced high ERI. High ERI in stable countries suggests that their economic sectors, particularly health care, may be in transition.     

Reproducibility and Clinical and Concurrent Validity of the MSF-4: A Four-Item Male Sexual Function Questionnaire for Patients with Benign Prostatic Hyperplasia

Introduction: The MSF-4 (Male Sexual Function 4-item) questionnaire is a condition-specific four-item scale of men's sexuality. We describe two studies that were conducted to assess the reproducibility and validity of the MSF-4 questionnaire.
Methods: Study 1 was a Phase III, multicenter study with a double-blind, parallel group design which was conducted in five countries. The objectives were to check the construct validity and factorial structure of the MSF-4, along with internal consistency reliability and clinical validity. Study 2 was a longitudinal, noncomparative, observational multicenter study to assess the reproducibility and the clinical and concurrent validity of the MSF-4.
Results: When exploratory factor analysis was performed with a free number of factors, the variability of the global MSF-4 score was based on a single factor across all countries in Study 1 except Spain. There was a high level of internal consistency reliability (Cronbach's alphas 0.68–0.90) and the MSF-4 was able to significantly discriminate different health states as assessed by the International Prostate Symptom Score (I-PSS) or Quality of Life (QoL) questionnaire. In study 2, there was a significant correlation between the MSF-4 and the International Index of Erectile Function (IIEF) scores ( p = .0001 for all items) especially erectile function (correlation coefficient −0.77). The MSF-4 was able to distinguish among patients with differing degrees of benign prostatic hyperplasia (BPH) symptoms as measured by the I -PSS ( p = .0001) and between those with and without sexual disorders ( p = .0001).
Conclusion: The MSF-4 is a psychometrically validated questionnaire with good reproducibility and clinical validity, which allows easy and appropriate assessment of male sexual function in the clinical setting.     

工作场所中社会心理因素的测量--两种职业紧张检测模式的应用

目的　对工作要求 -自主模式和付出 -回报失衡模式相应的 2个问卷 (工作内容问卷和付出 -回报失衡问卷 )的中文译本的信度和效度进行测评。方法　以 92 8名医护人员为研究对象 ,运用相关分析、因子分析和Logistic回归分析评价 2个问卷 6个模块 (“工作要求”、“自主程度”、“社会支持”、“外在付出”、“回报”、“内在投入”)的同质信度、结构效度和效标关联效度。结果　 2个问卷 6个模块的Cronbach’sα系数在可接受的范围内 (0 .5 6～ 0 .82 ) ,说明同质信度较好 ;因子分析显示 ,2个问卷的结构效度与理论模式基本吻合 ,但“工作要求”与“内在投入”2个模块需要进一步修订 ;并且 2个问卷均表明职业紧张与抑郁症状具有明显的相关性 (OR :1.6 3～ 2 .6 4 ,P <0 .0 1) ,提示良好的效标关联效度。结论　工作要求 -自主模式和付出 -回报失衡模式及其相应问卷能够较好地应用于中国 ,评价社会心理因素对职业人群的影响 ,但仍需要进一步的修订。     

Measuring job stress and family stress in Chinese working women: a validation study focusing on blood pressure and psychosomatic symptoms

Psychometric properties of a questionnaire measuring psychosocial work-related stress in terms of effort-reward imbalance and a short family stress scale were examined in a population sample of 421 working women from four work sites in Beijing, China. The internal consistency of the scales was satisfactory, and the theoretically postulated structure of scales of the work stress questionnaire was replicated. The criterion validity of the scales was tested using psychosomatic symptoms and blood pressure. Combined exposure to work and family- related stress was associated with an adjusted mean 6.4 mmHg increase in systolic blood pressure. Recurrent sleeping problems were also associated with the two stress measures. In conclusion, standardized measures of psychosocial stress in terms of effort-reward imbalance and of family stress can be used in occupational health research in China, with particular relevance for working women.     

The measurement of threat orientations

OBJECTIVE: To develop measures of 3 threat orientations that affect responses to health behavior messages. METHOD: In Study 1, college students (N = 47) completed items assessing threat orientations and health behaviors. In Study 2, college students and community adults (N = 110) completed the threat orientation items and measures of convergent and discriminant validity. RESULTS: In Study 1, the control-based, denial-based, and heightened-sensitivity-based threat orientation scales demonstrated good internal consistency and correlated with engagement in health behaviors. In Study 2, the convergent and discriminant validity of the 3 measures was established. CONCLUSION: The 3 scales have good internal reliability and construct validity.     

Measuring Effort–Reward Imbalance in School Settings: A Novel Approach and Its Association With Self-Rated Health

Background

We attempted to apply the model of effort–reward imbalance (ERI) to school settings in order to measure students’ psychosocial stress and analyze its association with self-rated health in adolescents.

Methods

A cross-sectional survey was conducted in Kunming, China among 1004 Chinese students (468 boys and 536 girls) in grades 7 through 12, using a 19-item effort–reward imbalance questionnaire.

Results

Satisfactory internal consistencies for the scales for effort and reward were obtained; the value for the scale for overcommitment was acceptable. Factor analysis replicated the theoretical structure of the ERI construct in this sample of Chinese students. All 3 scales were associated with an elevated odds ratio for diminished self-rated health, and the effect was strongest for the effort–reward ratio, as predicted by the theory. Sex and grade differences were also observed.

Conclusions

The ERI questionnaire is a valid instrument for identifying sources of stressful experience, in terms of effort–reward imbalance, among adolescents in school settings.Key words: effort–reward imbalance, psychosocial school stress, self-rated health, adolescents     

The trucker strain monitor: an occupation-specific questionnaire measuring psychological job strain

Objectives: To develop and validate a short and user-friendly questionnaire measuring psychological job strain in truck drivers. Methods: In cooperation with an occupational physician in the Dutch road transport industry we developed items on the basis of face validity and information of existing questionnaires on the subject. These items were pilot-tested, by means of interviews, in 15 truck drivers. Study I examined the factorial structure of the initial 30-item trucker strain monitor (TSM) in a sample of 153 truck drivers. Subsequently, number of items per factor was reduced on the basis of reliability analyses (Cronbach's alpha). Study II examined construct and criterion validity of the TSM in a randomly selected group of 2,000 truck drivers, of whom 1,111 participated (adjusted response=63%). Additionally, sensitivity and specificity were assessed by examining the ability of the TSM to identify truck drivers with or without self-reported sickness absence in the past 12 months because of psychological complaints. Results: Factor analyses of the initial 30-item TSM revealed a two-factor solution. Item reduction resulted in a six-item work-related fatigue scale and four-item sleeping problems scale with high internal consistency. Results of study II confirmed the internal consistency of the TSM scales and provided support for construct and criterion validity. The composite, work-related fatigue, and sleeping problems scale had a sensitivity of 83%, 80% and 71% respectively, in identifying truck drivers with prior sickness absence because of psychological complaints. Specificity rates were 72%, 73% and 72% respectively. Conclusion: Despite methodological limitations, the results suggest that the TSM is a reliable and valid indicator of psychological job strain in truck drivers. In particular, the composite and work-related fatigue scale identified drivers with prior absenteeism because of psychological complaints, quite accurately. Future longitudinal research in specific sub-groups of truck drivers including both self-reported and objective psychological health measures should evidence whether (1) the distinction between two indicators of psychological job strain is useful, and whether (2) the TSM can be used in screening out truck drivers at risk of developing psychological health problems. Received: 20 July 2000 / Accepted: 30 March 2001     

Development of measures of individual leadership for health promotion

PURPOSE: This purpose of this research was to develop and establish psychometric properties of scales measuring individual leadership for health promotion. DESIGN/METHODOLOGY/APPROACH: Scales to measure leadership in health promotion were drafted based on capacity assessment instruments developed by other provinces involved in the Canadian Heart Health Initiative (CHHI), and on the literature. Content validity was established through a series of focus groups and expert opinion appraisals and pilot testing. Psychometric analyses provided empirical evidence of the construct validity and reliability of the leadership scales in the baseline survey (n = 144) of the Alberta Heart Health Project. FINDINGS: Principal component analysis verified the construct of the leadership scales of personal work-related practices and satisfaction with work-related practices. Each of the theoretically a prior determined scales factored into two scales each for a total of four final scales. Scale alpha coefficients (Cronbach's alpha) ranged between 0.71 and 0.78, thus establishing good scale internal consistencies. RESEARCH LIMITATIONS/IMPLICATIONS: Limitations include the relatively small sample size used in determining psychometric properties. In addition, further qualitative work would enhance understanding of the complexity of leadership in health organizations. These measures can be used by both researchers and practitioners for the assessment leadership for health promotion and to tailor interventions to increase leadership for health promotion in health organizations. ORIGINALITY/VALUE: Establishing the psychometric properties and quality of leadership measures is an innovative step toward achieving capacity assessment instruments which facilitate evaluation of key relationships in developing health sector capacity for health promotion.     

Applying the effort-reward imbalance model to household and family work: a population-based study of German mothers

Background  

This paper reports on results of a newly developed questionnaire for the assessment of effort-reward imbalance (ERI) in unpaid household and family work. Methods: Using a cross-sectional population-based survey of German mothers (n = 3129) the dimensional structure of the theoretical ERI model was validated by means of Confirmatory Factor Analysis (CFA). Analyses of Variance were computed to examine relationships between ERI and social factors and health outcomes.     

Validating abbreviated measures of effort-reward imbalance at work in European cohort studies: the IPD-Work consortium

Background

Effort-reward imbalance (ERI) is an established conceptualisation of work stress. Although a validated effort-reward questionnaire is available for public use, many epidemiological studies adopt shortened scales and proxy measures. To examine the agreement between different abbreviated measures and the original instrument, we compared different versions of the effort-reward scales available in 15 European cohort studies participating in the IPD-Work (Individual-participant-data meta-analysis in working populations) consortium.

Methods

Five of the 15 studies provide information on the original (‘complete’) scales measuring ‘effort’ and ‘reward’, whereas the 10 remaining studies used ‘partial’ scales. To compare different versions of the ERI scales, we analyse individual-level data from 31,790 participants from the five studies with complete scales.

Results

Pearson’s correlation between partial and complete scales was very high in case of ‘effort’ (where 2 out of 3 items were used) and very high or high in case of ‘reward’, if at least 4 items (out of 7) were included. Reward scales composed of 3 items revealed good to satisfactory agreement, and in one case, a reward scale consisting of 2 items only demonstrated a modest, but still acceptable degree of agreement. Sensitivity and specificity of a composite measure, the ratio of effort and reward, comparing partial versus complete scales ranged between 59–93 and 85–99 %, respectively. Complete and partial scales were strongly associated with poor self-rated health.

Conclusion

Our results support the notion that short proxy measures or partial versions of the original scales can be used to assess effort-reward imbalance.     

Reliability and validity of the short form of the child health questionnaire for parents (CHQ-PF28) in large random school based and general population samples

STUDY OBJECTIVES: This study assessed the feasibility, reliability, and validity of the 28 item short child health questionnaire parent form (CHQ-PF28) containing the same 13 scales, but only a subset of the items in the widely used 50 item CHQ-PF50. DESIGN: Questionnaires were sent to a random regional sample of 2040 parents of schoolchildren (4-13 years); in a random subgroup test-retest reliability was assessed (n = 234). Additionally, the study assessed CHQ-PF28 score distributions and internal consistencies in a nationwide general population sample of (parents of) children aged 4-11 (n = 2474) from Statistics Netherlands. MAIN RESULTS: Response was 70%. In the school and general population samples seven scales showed ceiling effects. Both CHQ summary measures and one multi-item scale showed adequate internal consistency in both samples (Cronbach's alpha>0.70). One summary measure and one scale showed excellent test-retest reliability (intraclass correlation coefficient >0.70); seven scales showed moderate test-retest reliability (intraclass correlation coefficient 0.50-0.70). The CHQ could discriminate between a subgroup with no parent reported chronic conditions (n = 954) and subgroups with asthma (n = 134), frequent headaches (n = 42), and with problems with hearing (n = 38) (Cohen's effect sizes 0.12-0.92; p<0.05 for 39 of 42 comparisons). CONCLUSIONS: This study showed that the CHQ-PF28 resulted in score distributions, and discriminative validity that are comparable to its longer counterpart, but that the internal consistency of most individual scales was low. In community health applications, the CHQ-PF28 may be an acceptable alternative for the longer CHQ-PF50 if the summary measures suffice and reliable estimates of each separate CHQ scale are not required.     

两种问卷在民航后勤职工职业紧张调查中信效度分析

目的比较工作内容问卷1．0（JCQ1．0）与付出-回报失衡问卷（ERI）对民航后勤职工的职业紧张调查结果及信效度的差别。方法分别使用JCQ1．0核心版和ERI核心版对110名民航后勤职工进行职业紧张问卷调查,评定问卷的信度和效度。结果根据JCQ1．0的测试结果,高职业紧张、被动型、主动型及低职业紧张的比例分别为23．6％、20．9％、24．5％和30．9％;根据ERI的测试结果,59．1％的员工存在职业紧张。JCQ1．0三个模块的Cronbach仪系数为0．10～0．51,分半信度0．50;ERI三个模块的Cronbach“系数为0．35～0．79,分半信度0．78。Pearson相关检验证实两问卷大部分条目的结构效度较好,提取的因子方差累计贡献率分别为64．62％（JCQ1．0）和58．08％（ERI）。结论ERI问卷在民航职工中具有较好的信度与效度,JCQ1．0问卷在该人群中的应用尚需要进一步验证和修订。     

The SF-36 in an Australian sample: validating a new,generic health status measure

Abstract: The SF-36 is a self-reported, 36-item, generic measure of health status that has been validated for adult age groups in the United States, the United Kingdom and in some non-English-speaking countries. The Australian Bureau of Statistics used it in the 1995 National Health Survey and it has been used in health status measurement, in monitoring health outcomes and in clinical trials. The validity of the SF-36 was examined in the National Centre for Epidemiology and Population Health Record Linkage Study using a sample of 555 respondents to the National Heart Foundation Risk Factor Prevalence Survey in 1989; they were followed up in 1992. Items chosen for the scale had been used in health status assessment and had stood the test of time. The health concepts measured demonstrated good internal consistency. The eight scales of the SF-36 formed factors as predicted in the general health dimensions of physical and mental health. The component scales of the SF-36 demonstrated good discrimination between people with and without health conditions, including those with medical and those with psychiatric types of conditions. Although the SF-36 was a valid measure of general health status among Australian respondents, further work is needed to establish clinical validity and to produce population norms for Australia. Use of the SF-36 will allow Australian and international comparison of health status from the point of view of the users of health services.     

Television, physical activity, diet, and body weight status: the ARIC cohort

Objective

This study investigated the construct validity of a computerised self-assessment tool to measure psychological, social and environmental influences of young peoples' physical activity. First, analyses of the measure's factorial validity, invariance across, age, gender culture were conducted. Second, the ability of the derived subscales to discriminate between children representing different levels of self-reported and objectively measured physical activity behaviour was examined.

Methods

Participants were 1875 boys and 2078 girls (total = 3958) aged 9–10 years (n = 1955, mean age = 9.65 ± 0.42) and 15–16 years (n = 2003, mean age = 15.49 ± 0.50) from four European countries in Northern, Southern and Eastern Europe who took part in the European Youth Heart Study (EYHS). Children completed the computerised self-assessment tool with support from the researcher if requested. Self-reported exercise and an objective measure of physical activity (Actigraph model 7164) were used for additional construct validation purposes.

Results

Overall evidence of good fit indicating satisfactory factorial validity and cross-cultural, age and gender invariance for 3 of the 4 measurement models were obtained. The majority of measures were also significantly different for those with high versus low levels of physical activity.

Conclusion

Overall, the computerised questionnaire holds promise for use cross-culturally with male and female children and adolescents to measure perceived personal, social and environmental influences on physical activity. Further development of the measures pertaining to perceived environmental influences seems warranted.     

Factorial validity of the effort–reward imbalance scale: evidence from multi-sample and three-wave follow-up studies

Purpose

The present study investigated whether the factor structure of the effort–reward imbalance (ERI) scale (Siegrist et al. Soc Sci Med 58:1483–1499, 2004) remains same across two white-collar samples (i.e., factorial group invariance) and across three measurement times (i.e., factorial time invariance).

Methods

The factorial group invariance was tested using two different samples including 1,301 managers and 758 young white-collar professionals. The factorial time invariance was tested in the latter sample with a four-year three-wave follow-up design.

Results

The confirmatory factor analysis performed supported the theoretically based structure of the ERI scale, that is, the scale included two first-order factors of effort and overcommitment and one second-order factor of reward with first-order factors of esteem, career opportunities, and job security. The factorial group invariance of this structure was also supported. In addition, the factor loadings of all factors remained same across three measurements; thus, lending support for the factorial time invariance.

Conclusion

The ERI scale was found to be a valid tool to measure costs and gains of social exchanges at work as well as individual orientation toward work in these two occupational samples including a longitudinal study design.