The acceptability of a depression screening tool in an urban, Aboriginal community-controlled health service

OBJECTIVE: To assess the acceptability and face validity of a psychological assessment instrument, the Patient Health Questionnaire 9 (PHQ-9), as a depression screening tool for use with Aboriginal and Torres Strait Islander patients. METHODS: Four focus groups were held in an urban, Aboriginal community-controlled health service. Participants' attitudes to screening for depression and the specific components of PHQ-9 were explored. RESULTS: Process-oriented and PHQ-9-specific themes were raised. They included the role of family in the screening process, the need for a trusting relationship between the tool administrator and patient, the risk of confounding by social disadvantage or physical co-morbidities, the absence of a question assessing the presence of anger as a symptom of depression, and the importance of culturally appropriate language within the tool. CONCLUSION: Modification of the screening process and wording of the PHQ-9 in response to these concerns should render it acceptable for use with Aboriginal and Torres Strait Islander patients in this setting. IMPLICATIONS: These results may apply to the use of other psychological screening tools in the Aboriginal and Torres Strait Islander population. This is particularly relevant given the policy emphasis on screening in Indigenous health.     

A systematic review of studies assessing and facilitating attitudes towards professionalism in medicine

OBJECTIVES: An essential aspect of medical education is to facilitate the development and assessment of appropriate attitudes towards professionalism in medicine. This systematic review provides a summary of evidence for measures that have been used to assess these attitudes and their psychometric rigour. It also describes interventions that have been found to be effective in changing such attitudes. METHODS: MEDLINE, EMBASE, ERIC, PsychINFO, Sociological Abstracts and CINAHL were searched from the respective start date of each database to May 2006. Three key journals and reference lists of existing reviews were also searched. Articles that were published in English and reported primary empirical research measuring medical students' attitudes towards medical professionalism were included. The findings are integrated in narrative structured in such a way as to address the research questions. RESULTS: A total of 97 articles were included in the review. Most measures of attitudes assessed attitudes towards attributes of professionalism such as ethical issues, the patient-doctor relationship and cultural issues. Fourteen studies measured attitudes towards professionalism as a whole and 44 studies reported both the reliability and validity of measures. No interventions reported a change in attitudes over time. CONCLUSIONS: There is little evidence of reported measures that are effective in assessing attitudes towards professionalism in medicine as a whole. Likewise, there is scant evidence of interventions that influence attitude change over a period of time. Future studies should take into account the need to measure more global attitudes rather than attitudes towards specific issues in professionalism and the need to track attitudes throughout the curriculum.     

Utility of the Community Integration Questionnaire in a sample of adults with neurological and neuropsychiatric disorders receiving prevocational training

Purpose: To investigate utility of the Community Integration Questionnaire (CIQ) in a mixed sample of adults with neurological and neuropsychiatric disorders. Method: Cross-sectional, interview-based study. Participants were community-dwelling adults with disabilities resulting from neurological and neuropsychiatric disorders (N?=?54), who participated in a pre-vocational readiness and social skills training program. Psychometric properties of the Community Integration Questionnaire (CIQ) were assessed and validated against Mayo-Portland Adaptability Inventory (MPAI) and The Problem Checklist from the New York University Head Injury Family Interview (PCL). Results: Based on the revised scoring procedures, psychometric properties of the CIQ Home Competency scale were excellent, followed by the Total score and Social Integration scale. Productive Activity scale had low content validity and a weak association with the total score. Convergent and discriminant validity of the CIQ were demonstrated by correlation patterns with MPAI scales in the expected direction. Significant relationship was found with PCL Physical/Dependency scale. Significant associations were found with sex, living status, and record of subsequent employment. Conclusions: The results provide support for the use of the CIQ as a measure of participation in individuals with neurological and neuropsychiatric diagnoses and resulting disabilities.

• Implications for Rehabilitation

• An important goal of rehabilitation and training programs for individuals with dysfunction of the central nervous system is to promote their participation in social, vocational, and domestic activities.

• The Community Integration Questionnaire (CIQ) is a brief and efficient instrument for measuring these participation domains.

• This study demonstrated good psychometric properties and high utility of the CIQ in a sample of 54 individuals participating in a prevocational training program.

     

Assessing the skills for family planning nurse prescribing: development of a psychometrically sound training needs analysis instrument

RATIONALE AND AIMS: Family planning nurses have been identified for early development for prescribing authority in the United Kingdom (UK). Currently, no psychometrically founded training needs analysis instrument exists that can reliably assess the nature and extent of the specific educational provision required for this role. This paper is concerned with the development of an instrument capable of defining the development needs for family planning nurse prescribing. METHODS: A national survey was conducted with 388 family planning nurses, using a modified training needs analysis instrument. Respondents were required to assess the importance of 40 tasks, firstly for the role of the family planning nurse (FPN), and again for the role of the family planning nurse prescriber (FPNP). The data from each set of ratings were separately factor analysed using orthogonal Varimax rotations and Cronbach's alpha was computed for each factor. RESULTS: Six factors emerged from the family planning nurse ratings ('professional development', 'managing patient consultations', 'critical appraisal', 'clinical information giving and professional accountability', 'collaborative working and current National Health Service (NHS) issues' and 'dispensing of drugs') and nine factors emerged from the FPNP ratings ('research and practice development', 'prescribing and professional accountability', 'management/leadership', 'clinical decision making and risk assessment', 'advanced health assessment', 'critical appraisal', 'referral processes', 'core nursing skills' and 'dispensing of drugs'. This suggests that the role of the FPNP is more extended and, moreover, that the two roles are configured very differently but in a way that makes logical and coherent sense within existing research and government policy. This indicates that the instrument is valid. Moreover, all but two of the factors had a Cronbach's alpha score of >0.7 and so can be considered reliable. CONCLUSIONS: The results indicate that the modified instrument is valid and reliable and therefore can be used with confidence to assess the training needs of FPNPs. In addition, the factors have outlined a cogent definition of the role of the FPNP, which can be used both to inform educational programmes and to assess their efficacy.     

Cultural adaptation and construct validation of the Arabic version of children’s assessment of participation and enjoyment and preferences for activities of children measures

Purpose: To establish the construct validity and internal consistency of the Arabic Children Assessment of Participation and Enjoyment (CAPE) and Preferences for Activities of Children (PAC) and to determine the effects of age, gender, and disability status on diversity and intensity of participation.

Methods: The World Health Organization guidelines for translation of measures were applied to translate the CAPE and PAC, 75 children with cerebral palsy (mean age?=?10.7?±?2.9 years) and 75 children with typical development (mean age?=?10.8?±?2.7 years) completed the translated measures. The construct validity of the translated measures was demonstrated by principle component analyses in addition to the known-groups method by examining the effects of age, gender, and presence of disability on diversity and intensity scores. The internal consistencies of the extracted components were examined by Cronbach’s alpha.

Results: Four components emerged: (1) physical activities; (2) home-based activities; (3) self-improvement activities; and (4) social activities. Cronbach’s alpha varied from 0.61 (social activities) to 0.83 (physical activities). Age, gender, and disability were significant determinants of types of activities.

Conclusions: The Arabic CAPE and PAC are culturally valid in measuring participation of children with or without disabilities in Jordan. The child’s age, gender, and disability should be considered to provide participation-based plans of care that are considerate for children and their families.

• Implications for rehabilitation

• The Arabic CAPE and PAC are culturally valid measures for participation of children with or without disabilities in Jordan.

• The Arabic CAPE and PAC measures can guide participation-based plans of care that are meaningful and considerate for children and their families.

• Child age and gender should be considered to provide appropriate activities and to facilitate participation of children with and without disabilities.

• Families and service providers in Jordon are encouraged to provide children opportunities to participate in desired physical, self-improvement, and social activities.

     

Development and Testing of the Multidimensional Trust in Health Care Systems Scale

Objective  To describe the development and psychometric testing of the Multidimensional Trust in Health Care Systems Scale (MTHCSS). Methods  Scale development occurred in 2 phases. In phase 1, a pilot instrument with 70 items was generated from the review of the trust literature, focus groups, and expert opinion. The 70 items were pilot tested in a sample of 256 students. Exploratory factor analysis was used to derive an orthogonal set of correlated factors. In phase 2, the final scale was administered to 301 primary care patients to assess reliability and validity. Phase 2 participants also completed validated measures of patient-centered care, health locus of control, medication nonadherence, social support, and patient satisfaction. Results  In phase 1, a 17-item scale (MTHCSS) was developed with 10 items measuring trust in health care providers, 4 items measuring trust in health care payers, and 3 items measuring trust in health care institutions. In phase 2, the 17-item MTHCSS had a mean score of 63.0 (SD 8.8); the provider subscale had a mean of 40.0 (SD 6.2); the payers subscale had a mean of 12.8 (SD 3.0); and the institutions subscale had a mean of 10.3 (SD 2.1). Cronbach’s α for the MTHCSS was 0.89 and 0.92, 0.74, and 0.64 for the 3 subscales. The MTHCSS was significantly correlated with patient-centered care (r = .22 to .62), locus of control—chance (r = .42), medication nonadherence (r = −.22), social support (r = .25), and patient satisfaction (r = .67). Conclusions  The MTHCSS is a valid and reliable instrument for measuring the 3 objects of trust in health care and is correlated with patient-level health outcomes.     

Standard Setting Methods for Pass/Fail Decisions on High-Stakes Objective Structured Clinical Examinations: A Validity Study

Construct: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. Background: The objective structured clinical examination (OSCE) was established for valid, reliable, and objective assessment of clinical skills in health professions education. Various standard setting methods have been proposed to identify objective, reliable, and valid cutoff scores on OSCEs. These methods may identify different cutoff scores for the same examinations. Identification of valid and reliable cutoff scores for OSCEs remains an important issue and a challenge. Approach: Thirty OSCE stations administered at least twice in the years 2010–2012 to 393 medical students in Years 2 and 3 at Aga Khan University are included. Psychometric properties of the scores are determined. Cutoff scores and pass/fail decisions of Wijnen, Cohen, Mean–1.5SD, Mean–1SD, Angoff, borderline group and borderline regression (BL-R) methods are compared with each other and with three variants of cluster analysis using repeated measures analysis of variance and Cohen's kappa. Results: The mean psychometric indices on the 30 OSCE stations are reliability coefficient = 0.76 (SD = 0.12); standard error of measurement = 5.66 (SD = 1.38); coefficient of determination = 0.47 (SD = 0.19), and intergrade discrimination = 7.19 (SD = 1.89). BL-R and Wijnen methods show the highest convergent validity evidence among other methods on the defined criteria. Angoff and Mean–1.5SD demonstrated least convergent validity evidence. The three cluster variants showed substantial convergent validity with borderline methods. Conclusions: Although there was a high level of convergent validity of Wijnen method, it lacks the theoretical strength to be used for competency-based assessments. The BL-R method is found to show the highest convergent validity evidences for OSCEs with other standard setting methods used in the present study. We also found that cluster analysis using mean method can be used for quality assurance of borderline methods. These findings should be further confirmed by studies in other settings.