The Satisfaction with Information about Medicines Scale (SIMS): a new measurement tool for audit and research

OBJECTIVE:To develop and examine the psychometric properties of the Satisfaction with Information about Medicines Scale (SIMS), a new 17-item tool designed to assess the extent to which patients feel they have received enough information about prescribed medicines. METHODS:Patients from eight diagnostic categories were recruited at hospitals in London and Brighton and completed the SIMS questionnaire during hospital admission or attendance at outpatient clinic appointments. The SIMS was evaluated in terms of its ease of use, internal consistency, test-retest reliability, and criterion related validity using existing self-report measures of adherence and patient beliefs about medicines. RESULTS:The SIMS was well accepted by patients in a variety of clinical settings and showed satisfactory internal consistency and test-retest reliability. As predicted, higher levels of satisfaction with medicines information were associated with higher levels of reported adherence, and lower levels of satisfaction were associated with stronger concerns about the potential adverse effects of medicines, providing evidence of criterion related validity. CONCLUSION:The SIMS performed well on a number of psychometric indicators and shows promise as a tool for audit (measuring patients' satisfaction with information about their prescribed medicines), research (evaluating current or new forms of information provision), and clinical practice (identifying the information needs of individual patients and as an aid to planning medicine related consultations).     

Outpatient satisfaction: validation of a French-language questionnaire: data quality and identification of associated factors

OBJECTIVES: Following 1996 legislation requiring French hospitals to assess patient satisfaction, this study developed and validated a brief French-language multidimensional questionnaire designed to measure outpatient satisfaction with hospital visits and compared data quality for two patient-satisfaction survey methods. DESIGN: Authors developed a 19-item questionnaire following a strict procedure (identification of dimensions to explore, formulation, and selection of items). SETTING: Validation data were obtained from patients of six outpatient clinics in a teaching hospital. PARTICIPANTS: 586 consenting eligible patients were randomized to receive the questionnaire 2 weeks after their visit with one of two survey methods: a mailed self-administered questionnaire or a telephone interview. RESULTS: The response rate (79%) was not significantly different between the two survey methods. The risk of having one or more missing values was higher in the mail survey group (odds ratio, 1.65; 95% confidence interval, 1.03-2.63), but mail respondents were less likely to use the "extremely positive" response category. Principal component analysis identified four factors that accounted for 56% of the variance: interpersonal skills and information transfer, physical surroundings, convenience, and appointment delay. Patients' comments on open-ended questions validated the semantic content of the factorial construct. The internal consistency coefficient was greater than 0.70 for three of four subscales. Patient background characteristics accounted for less than 10% of the factorial score variance. Patient satisfaction was correlated with age, type of visit, and, to a lesser extent, gender and education level. CONCLUSION: This easily administered, multidimensional out-patient-satisfaction questionnaire provided encouraging preliminary psychometric characteristics.     

Developing a Japanese hospital physician satisfaction scale

PURPOSE: Hospital physician shortages are widely recognized as a national problem in Japan. Although physician job satisfaction has a relationship with service quality and physician turnover, there is no measure to assess Japanese hospital physician satisfaction. This paper aims to establish a measure of job satisfaction for Japanese hospital physicians and evaluated its psychometric performance. DESIGN/METHODOLOGY/APPROACH: Two cross-sectional physician surveys were used--a pilot survey, conducted as a self-administered questionnaire; and a validation survey conducted on-line. FINDINGS: A total of 82 hospital physicians completed the pilot questionnaire. Factor and reliability analyses produced a 28-item, 6-subscale and 2-global satisfaction scale measure, the Japan hospital physicians satisfaction scale (HPSS). Results supported the measure's reliability and validity. For the validation survey, 146 hospital physicians completed the online questionnaire. One question item was substituted following factor analysis. Results also displayed the measure's adequate psychometric properties. RESEARCH LIMITATIONS/IMPLICATIONS: Participating physicians were convenience samples, which may not fully represent Japanese hospital physicians. ORIGINALITY/VALUE: The JHPSS, a brief questionnaire measuring Japanese hospital physician job satisfaction, should be useful for providing better quality care and improving our understanding of and ability to deal with Japanese hospital workforce issues.     

Psychometric evaluation of the Danish version of Satisfaction with Daily Occupations (SDO)

Abstract

Aims: The Satisfaction with Daily Occupations (SDO) scale assesses satisfaction within the domains of work, leisure, domestic tasks, and self-care. The aim was to investigate the psychometric properties of the Danish version of the SDO when used with asylum seekers. Methods: The participants were 93 Danes without known ill health and 43 asylum seekers. They completed the SDO and rated their perceived health, activity level, and general satisfaction with daily occupations. Translation into Danish and back-translation into Swedish was made by professional interpreters. Results: Internal consistency was α = 0.75 for the Danish sample and α = 0.79 for the asylum seekers. The SDO distinguished between asylum seekers and the Danish sample, suggesting criterion validity. Concurrent validity, analysed against general satisfaction with daily occupations, was indicated for both samples. Discriminant validity was indicated against self-rated health for both samples and against activity level for the Danish sample. There was, however, a correlation of 0.65 between the SDO satisfaction score and activity level for the asylum seekers. Conclusion: The SDO exhibited satisfactory internal consistency and criterion and concurrent validity. The findings regarding discriminant validity were somewhat inconclusive. The Danish SDO may be regarded as psychometrically sound but further psychometric testing is needed.     

Cross-cultural evaluation of the French version of the LEIPAD, a health-related quality of life instrument for use in the elderly living at home

Purpose

To cross-culturally adapt a French version of the LEIPAD, a self-administered questionnaire assessing the health-related quality of life (HRQoL) in adults aged 65 years and over living at home, and to evaluate its psychometric properties.

Methods

After having translated LEIPAD in accordance with guidelines, we studied psychometric properties: reliability and construct validity—factor analysis, relationships between items and scales, internal consistency, concurrent validity with the Medical Outcome Study Short-Form 36 and known-groups validity.

Results

The results obtained in a sample of 195 elderly from the general population showed very good acceptability, with response rates superior to 93 %. Exploratory factor analysis extracted eight factors providing a multidimensionality structure with five misclassifications of items in the seven theoretical scales. Good internal consistency (Cronbach’s alpha ranging from 0.73 and 0.86) and strong test–retest reliability (ICCs higher than 0.80 for six scales and 0.70 for one) were demonstrated. Concurrent validity with the SF-36 showed small to strong expected correlations.

Conclusion

This first evaluation of the French version of LEIPAD’s psychometric properties provides evidence in construct validity and reliability. It would allow HRQoL assessment in clinical and common practice, and investigators would be able to take part in national and international research projects.     

Inpatient and ambulatory patient satisfaction with nursing care

This study reports on the development and psychometric testing of inpatient and ambulatory patient satisfaction scales designed to measure patient satisfaction using the standards of nursing practice within a medical center. The surveys were administered to patients 4-6 weeks after discharge from the hospital or following a clinic visit. A total of 619 inpatient and 955 ambulatory patient questionnaires were analyzed. Factor analyses suggest there exist four scales for inpatient satisfaction anf five scales for outpatient satisfaction with high reliability and reasonable validity.     

Measuring the psychosocial health of adolescent and young adult (AYA) cancer survivors: a critical review

Background

Adolescent and young adult (AYA) cancer survivors require psychometrically rigorous measures to assess their psychosocial well-being. Without methodologically adequate scales the accuracy of information obtained on the prevalence of needs, predictors of risk, and the potential success of any interventions, can be questioned. This review assessed the psychometric properties of measures designed specifically to identify the psychosocial health of this unique population.

Methods

Medline, PsycINFO, CINAHL and EMBASE databases were searched to identify measures developed to assess the psychosocial health of AYA cancer survivors. Searches were limited to the years 1998-2008. A search of Medline revealed that the number of publications related to the assessment of psychosocial well-being in AYA cancer survivors prior to this period were minimal. The psychometric properties of identified measures were evaluated against pre-determined and generally accepted psychometric criteria including: reliability (internal consistency and test-retest); validity (face, content, construct, and criterion); responsiveness; acceptability; and feasibility.

Results

Seven quality of life measures met the inclusion criteria. No measures of unmet need were identified. All seven measures reported adequate internal consistency, face, content, and construct validity. Test-retest reliability, criterion (predictive) validity, responsiveness, acceptability, and feasibility were rarely examined.

Conclusions

There is a need to further evaluate the psychometric properties of existing quality of life measures for AYA cancer survivors. Valid, reliable, and acceptable measures which can assess the psychosocial needs of this population should also be developed.     

门诊顾客满意度指标体系的建立与评价

通过借鉴国内、外顾客满意度调查方法,结合我国医院的实际,探讨建立门诊顾客满意度指标体系。从顾客期望、价值感知、质量感知、顾客满意、抱怨处理、顾客忠诚度6个维度选出32个项目,构成指标体系初始内容,通过专家调查、预调查分析,筛选出20个项目形成正式调查量表。正式调查结果Cronbach α系数为0．9096,经因子分析,因子负荷和结构与量表内容基本吻合,维度内相关性强于维度间相关性,支持该量表的有效性和广泛适用性。可以认为,本研究研制的顾客满意度指标体系是可信和有效的。     

A cardiovascular extension of the Health Measurement Questionnaire

OBJECTIVE: To investigate the psychometric properties of a cardiovascular extension of an existing utility-based quality of life questionnaire (Health Measurement Questionnaire). The new instrument has been named the Utility Based Quality of life--Heart questionnaire, or UBQ-H. DESIGN: Explored the test-retest reliability, construct validity, and responsiveness of the UBQ-H. PATIENTS: A sample of 322 patients attending cardiac outpatient clinics were recruited from two large metropolitan teaching hospitals. A second sample of 1112 patients taking part in the LIPID trial was also used to investigate the validity and responsiveness of the UBQ-H. RESULTS: Ninety per cent of all UBQ-H questionnaires were returned, and item completion rates were high (median of less than 1% missing or N/A answers). Cronbach's alpha measure of internal consistency for the scales ranged between 0.79-0.91, and each item was also most strongly correlated with its hypothesised domain than alternative domains. The intra-class test-retest reliability of the UBQ-H scales ranged from 0.65 to 0.81 for patients with stable health. Results supported the construct validity of the UBQ-H. The UBQ-H was significantly correlated with other information on quality of life (for example, General Health Questionnaire) as anticipated. The instrument was able to distinguish between contrasted groups of patients (for example, with versus without symptoms of dyspnoea, prior myocardial infarction versus none, etc), and was responsive to changes in health associated with adverse events requiring hospitalisation. CONCLUSIONS: The modifications made to the Health Measurement Questionnaire has resulted in an assessment designed for cardiovascular patients that has proved to be both reliable and valid.     

Development and validation of an in-patient satisfaction questionnaire.

OBJECTIVE: To develop a psychometrically sound, hospital patient satisfaction questionnaire to be administered to patients discharged from medical and surgical services. DESIGN: Cross-sectional survey in Spanish. SETTING: Four acute care general hospitals of the Basque Health Service. STUDY PARTICIPANTS: Random samples of 650 discharged patients from each hospital during February and March 2002. A total of 1910 patients responded to the questionnaire (73.5%). MAIN OUTCOME MEASURES: Overall perceived quality of health care and perceived health improvement. RESULTS: No sociodemographic differences were found between respondents and non-respondents. Six dimensions were identified from the factor analysis, explaining 50% of the variance. All items, except two, revealed loadings above 0.4. Cronbach's alpha exceeded 0.7 for all dimensions, except privacy. Comfort was the dimension with the lowest level of patient satisfaction, whereas privacy was the most satisfactory. The interscale correlations never exceeded the internal consistency of each scale. The analysis of the dimensions with two items of global assessment showed a positive correlation. CONCLUSIONS: The results obtained from the development and validation of the questionnaire provide evidence of its psychometric properties, although it would be useful to carry out further analyses to assess time-based properties of reliability. We found a positive relation between the degree of patient satisfaction and overall evaluation of the quality of health care, providing evidence of the ability of the questionnaire to correlate with other concepts. The in-patient satisfaction questionnaire could become a useful instrument in quality-of-care assessment.     

Towards patient-centered health services in India--a scale to measure patient perceptions of quality.

OBJECTIVE: . (i) To develop a reliable and valid scale to measure in-patient and outpatient perceptions of quality in India and (ii) to identify aspects of perceived quality which have large effects on patient satisfaction. DESIGN: Cross-sectional survey of health facilities and patients at clinics. SETTING: Primary health centers, community health centers, district hospitals, and female district hospitals in the state of Uttar Pradesh in north India. MAIN OUTCOME MEASURES: Internal consistency, validity, and factor structure of the scale are evaluated. The association between patient satisfaction and perceived quality dimensions is examined. RESULTS: A 16-item scale having good reliability and validity is developed. Five dimensions of perceived quality are identified-medicine availability, medical information, staff behavior, doctor behavior, and hospital infrastructure. Patient perceptions of quality at public health facilities are slightly better than neutral. Multivariate regression analysis results indicate that for outpatients, doctor behavior has the largest effect on general patient satisfaction followed by medicine availability, hospital infrastructure, staff behavior, and medical information. For in-patients, staff behavior has the largest effect followed by doctor behavior, medicine availability, medical information, and hospital infrastructure. CONCLUSIONS: The scale developed can be used to measure perceived quality at a range of facility types for outpatients and in-patients. Perceived quality at public facilities is only marginally favorable, leaving much scope for improvement. Better staff and physician interpersonal skills, facility infrastructure, and availability of drugs have the largest effect in improving patient satisfaction at public health facilities.     

Psychometric properties of the General Well-Being Index

There is a growing interest in the measurement of quality of life as an important marker of health outcomes. The General Well-Being Index (GWBI) is a quality of life measure that has been specifically designed to assess psychological distress rather than physical incapacitation. Previous studies using the GWBI have mainly focussed on clinical samples (e.g., depressed patients). The aim of the current study was to examine the psychometric properties of the GWBI in a non-clinical population. Using data gathered from 447 first year University students, the GWBI was found to have excellent psychometric properties. Both internal consistency and test-retest reliability were high, and the concurrent and construct validity of the measure were sound. Factor analysis revealed three significant factors, which were labelled 'general mood/affect', 'life satisfaction/vitality', and 'poor physical health/somatic complaints'. Limitations to the present study are further discussed.     

Development of a French inpatient satisfaction questionnaire.

OBJECTIVE: To develop a brief French-language, generic, self-administered questionnaire to measure inpatient satisfaction. DESIGN: Issues relevant to patients were identified using three open-ended questions designed in accordance with the disconfirmation paradigm. The content of patients' responses was analysed and then supplemented by items taken from published instruments in order to generate a pool of 93 items. Twenty-nine items were selected following a strict procedure. Content validity was judged by comparing the questionnaire to existing instruments. Construct validity was supported by testing specific hypotheses derived from the literature and by performing principal component analysis. Reliability was estimated by calculating Cronbach's alpha. SETTING: A 2200-bed French teaching hospital. SUBJECTS: A mail survey was carried out on a random sample of 1000 inpatients within 2-4 weeks of discharge. Eligible subjects were medical, surgical and obstetrics inpatients who had stayed in the hospital for more than 24 hours. RESULTS: The participation rate (71%) and the completion rate (95%) were indicators of acceptability. There were modest differences between the questionnaire and published instruments (financial aspects, amenities). Construct representation by principal component analysis consisted of six scales which accounted for 58% of the variance in total satisfaction scores. The reliability estimates of internal consistency ranged from 0.67 to 0.86. CONCLUSION: We propose that the self-administered multidimensional inpatient satisfaction questionnaire provided encouraging preliminary psychometric information. This instrument is intended to involve patient feedback in a continuous quality health care improvement strategy.     

The NORPEQ patient experiences questionnaire: data quality, internal consistency and validity following a Norwegian inpatient survey

AIMS: This article describes the development of a questionnaire designed for comparisons of patient experiences of hospital care within the Nordic countries. The results of testing for data quality, reliability, and validity are presented following a Norwegian survey. METHODS: Following a literature review and consultation within an expert group six items were developed measuring patient experiences together with two items assessing global satisfaction and perception of incorrect treatment. The questions were included in a questionnaire that was mailed to 500 patients randomly selected from patients receiving inpatient treatment at a large university hospital in Norway. Principal component analysis was used to assess dimensionality. Reliability was assessed by the internal consistency and test-retest methods. Construct validity was assessed by the scale's correlation with variables known to be related to patient experiences. RESULTS: A total of 244 (48.8%) patients responded. Levels of missing data ranged from 0.4% to 2.5%. The six items in the questionnaire that measured important aspects of patient experiences with the services contributed to a single scale with item-total correlations in the range 0.59-0.71 and a Cronbach's alpha of 0.85. The test-retest intraclass correlation was 0.88. CONCLUSIONS: The NORPEQ is a brief measure of patient experiences that covers important aspects of the healthcare encounter. It shows good evidence of reliability and validity and is relatively easy to apply alongside existing national surveys.     

The GPs' Experiences Questionnaire (GPEQ): reliability and validity following a national survey to assess GPs' views of district psychiatric services

BACKGROUND: The measurement of patient and professional views of quality are important components in the evaluation of health care delivery. OBJECTIVE: To describe the development and evaluation of the GPs' Experiences Questionnaire (GPEQ) for assessing the quality of community mental health clinics in Norway. METHODS: Design: Literature review, GP interviews, pre-testing of questionnaire items and a cross-sectional national survey. Setting: Postal survey of GPs in Norway evaluating 73 community mental health clinics in the five health regions in Norway during spring of 2006. Subjects: Three thousand four hundred and sixty-three GPs were sent a postal questionnaire with the GPEQ and were asked to assess their community mental health clinic responsible for general adult psychiatric services. RESULTS: Two thousand one hundred and thirty (61.5%) GPs returned a completed questionnaire. Low levels of missing data suggest that the questionnaire is acceptable. Factor analysis identified five scales: workforce situation (four items), discharge letter (three items), competence (four items), guidance (three items) and emergency situations (two items). All scales met the criterion of 0.7 for Cronbach's alpha and test-retest correlations were 0.72-0.87. The results of validity testing were as hypothesized with scale scores significantly related to knowledge of the community mental health clinic, overall satisfaction, negative experiences with the clinic, waiting time and acceptance of referrals. CONCLUSIONS: The GPEQ is a self-administered questionnaire that includes the most important aspects of the GPs' experience of quality at community mental health clinics. All scales have good evidence for internal consistency, test-retest reliability and validity.     

Reliability and Validity of the Work and Well-Being Inventory (WBI) for Employees

Purpose The purpose of this study is to measure the psychometric properties of the Work and Wellbeing Inventory (WBI) (in Dutch: VAR-2), a screening tool that is used within occupational health care and rehabilitation. Our research question focused on the reliability and validity of this inventory. Methods Over the years seven different samples of workers, patients and sick listed workers varying in size between 89 and 912 participants (total: 2514), were used to measure the test–retest reliability, the internal consistency, the construct and concurrent validity, and the criterion and predictive validity. Results The 13 scales displayed good internal consistency and test–retest reliability. The constructive validity of the WBI could clearly be demonstrated in both patients and healthy workers. Confirmative factor analyses revealed a CFI?>.90 for all scales. The depression scale predicted future work absenteeism (>6 weeks) because of a common mental disorder in healthy workers. The job strain scale and the illness behavior scale predicted long term absenteeism (>3 months) in workers with short-term absenteeism. The illness behavior scale moderately predicted return to work in rehab patients attending an intensive multidisciplinary program. Conclusions The WBI is a valid and reliable tool for occupational health practitioners to screen for risk factors for prolonged or future sickness absence. With this tool they will have reliable indications for further advice and interventions to restore the work ability.     

Translation and psychometric testing of the Farsi version of the Seattle angina questionnaire

Background

Angina pectoris causes substantial psychological and functional disabilities and adversely effects quality of life in patients. The aim of this study was to investigate the psychometric properties including validity and reliability of the Farsi version of the Seattle angina questionnaire.

Methods

The ‘forward-backward’ procedure was applied to translate this questionnaire from English to Farsi. The translated version of the Seattle angina questionnaire was assessed in terms of validity and reliability with a convenience sample of 200 patients suffering from angina pectoris who were recruited from the inpatient ward (post CCU) and outpatient department at two teaching hospitals in an urban area of Iran. Validity was assessed using content, face and construct validity. The calculation of the Cronbach’s alpha coefficient and the test-retest method helped with the assessment of reliability of the questionnaire’s five subscales. Construct validity of the questionnaire was evaluated using exploratory factor analysis.

Results

The results of exploratory factor analysis indicated a five-factor solution for the questionnaire including ‘physical limitation in middle to strenuous activities’, ‘physical limitation in slight activities’, ‘angina pattern and discomfort of treatment’, ‘treatment satisfaction’ and ‘disease perception’ that jointly accounted for 64.42% of variance observed. Convergent validity was mostly supported by the pattern of association between the Seattle angina questionnaire-Farsi version and the SF-36. Cronbach’s alpha of the subscales ranged from 0.60 to 0.86 and test-retest scores ranged from 0.79 to 0.97 indicating a good range of reliability.

Conclusions

The Seattle angina questionnaire-Farsi version had acceptable psychometric properties. Therefore, it can be used to assess health-related quality of life and assess the effects of different medical and nursing interventions on patients’ quality of life.

     

Psychometric properties of a new health needs analysis tool designed for cardiac patients

BACKGROUND AND OBJECTIVES: Assessing health needs is pivotal in healthcare systems, ensuring that services are appropriate for a population's genuine needs. In the absence of an appropriate investigational tool, a comprehensive process of questionnaire development was undertaken to evaluate and validate a specific health needs assessment tool for cardiac patients (Nottingham Health Needs Assessment; NHNA). Its psychometric properties were investigated in a survey of patients admitted with acute coronary syndromes. METHOD: Two hundred and forty-two consecutive patients admitted to an acute cardiac unit with symptoms suggestive of acute myocardial infarction completed a postal questionnaire about health needs and quality-of-life, using generic (Short Form 12 and EuroQol-5D) and specific (Seattle Angina Questionnaire) health-related quality-of-life instruments. RESULTS: Forty-six items were assigned to five domains of health-related needs according to principal component analysis, with high internal consistency (0.83-0.89). Each domain in the NHNA questionnaire correlated highly with its quality-of-life counterpart, indicating relatively high concurrent validity. CONCLUSION: The NHNA questionnaire has acceptable psychometric features, with satisfactory construct validity as determined by quality-of-life analysis. This health needs assessment instrument appears to be a reliable means of identifying patients' needs, which is an important landmark for directing health services.     

Hungarian adaptation of a questionnaire for determining depression-specific quality of life

INTRODUCTION: The Quality of Life in Depression Scale (QLDS) is a widely used outcome measure available in a large number of languages. No measure of quality of life was available for use with depressed patients in Hungary and a decision was taken to adapt the QLDS for this purpose. The adaptation of a questionnaire for use in a new language involves three stages; translation, testing for face and content validity and assessment of the translated measure's psychometric properties. OBJECTIVES: To adapt the QLDS for use in Hungary and to evaluate its psychometric properties. METHOD: The dual panel method was used to translate the QLDS into Hungarian. The translation was tested for face and content validity by interviews conducted with depressed patients. Finally, a test-retest postal survey was conducted to determine internal consistency, reproducibility and construct validity. RESULTS: Interviews conducted with 25 patients indicated that the QLDS was an appropriate measure and that it was well accepted and completed. The postal survey ( n = 50) showed that the measure had good internal consistency (Cronbach's alpha-coefficients were 0.95 at both administrations) and that the test-retest reliability (0.89) indicated good reproducibility with limited random measurement error. Correlations of QLDS scores with those for the Nottingham Health Profile sections were as expected, providing evidence of convergent and divergent validity. CONCLUSION: Given the acceptability of the Hungarian version of QLDS to depressed patients and the excellent psychometric properties of the adapted questionnaire it is concluded that the adaptation was successful. The measure is suitable for use in clinical practice and studies involving depressed patients in Hungary.