Staff and patient assessments of need in an epidemiologically representative sample of patients with psychosis

BACKGROUND: The present study aimed to assess, in an epidemiologically representative sample of patients with psychosis, the relationship between patient and staff perception of need and to investigate the association between unmet need and study variables when assessed by patients and staff, respectively. METHOD: Of 474 cases of functional psychosis identified in the locality, 225 were assessed using the Camberwell Assessment of Need Short Appraisal Schedule (CANSAS) to rate staff and patients' perceptions of need. RESULTS: Unmet need was rated most highly in social/relationship domains by patients and keyworkers. Levels of total met and unmet need were rated similarly as aggregate scores and in differing domains, by staff and patients. Levels of staff agreement between patient and staff ratings were "substantial" in all domains except safety to others, where agreement was "fair" and in which staff appeared to perceive higher risk than patients. Staff, but not patients, rated significantly more unmet need in non-Caucasian groups. No other variable studied was associated with unmet need. CONCLUSIONS: The levels of agreement between patient and staff ratings were significantly higher in the present study than previously reported. Possible reasons for the higher concordance found in this study were the use of keyworkers who knew patients well. Further, keyworkers may have been influenced in their assessment of need by awareness of patients' perceived need. Joint needs assessment may strengthen the therapeutic alliance, improve our understanding of priority needs and aid in service development. Work is needed to ensure that care is targeted explicitly towards unmet need.     

The validity of using patient self-report to assess psychotic symptoms in schizophrenia

Brief, reliable and valid measures of psychosis can be very useful in both clinical practice and research, and for identifying unmet treatment needs in persons with schizophrenia. This study examines the concurrent validity and receiver operating characteristics of the psychosis scale of the Revised Behavior and Symptom Identification Scale (BASIS-R). The study was conducted with 71 adults with schizophrenia who were randomly sampled from a large mental health clinic. Study participants at the West Los Angeles Veterans Healthcare Center were assessed using the BASIS-R, a subjective, self-report measure, and the UCLA Brief Psychiatric Rating Scale (BPRS), a clinician-rated measure administered by highly trained research staff. The psychosis scale of the BASIS-R shows good concurrent validity with the psychosis items on the BPRS. Using the BPRS as the gold standard for measuring psychosis, receiver operating characteristics suggest that both the weighted and unweighted versions of the BASIS-R psychosis scale adequately identify psychosis that is moderate or greater or severe. The performance of the two versions was similar. Unweighted scores are easier to calculate, and we therefore recommend cutoff scores based on the unweighted BASIS-R. We identified a cutoff score of 0.5 to best detect moderate or greater psychosis, and a cutoff score of 1.0 to best detect severe or extremely severe psychosis. The BASIS-R has potential as an assessment tool and screening instrument in schizophrenia.     

Psychometric evaluation of the Nurses Observation Scale for Inpatient Evaluation in The Netherlands

The interrater reliability, temporal stability and factorial, convergent, discriminant and predictive validity of the Nurses Observation Scale for Inpatient Evaluation (NOSIE-30) were investigated in a heterogeneous group of psychiatric inpatients in the Netherlands (n = 179). Data in support of the scale's dimensional structure (recoverability of Anglo-American subscale structure in this Dutch sample and distinctiveness of subscales), discriminatory power and convergent validity are presented. Interrater reliability was satisfactory at global scale level. However, 3 subscales (irritability, psychosis and depression) were found to lack interrater reliability. Although temporal stability coefficients were high, large score changes are presupposed to show that pre- versus posttherapy differences are attributable to real change rather than error. NOSIE-30 had limited predictive value.     

Sensorimotor and Activity Psychosis-Risk (SMAP-R) Scale: An Exploration of Scale Structure With Replication and Validation

BackgroundSensorimotor abnormalities precede and predict the onset of psychosis. Despite the practical utility of sensorimotor abnormalities for early identification, prediction, and individualized medicine applications, there is currently no dedicated self-report instrument designed to capture these important behaviors. The current study assessed and validated a questionnaire designed for use in individuals at clinical high-risk for psychosis (CHR). MethodsThe current study included both exploratory (n = 3009) and validation (n = 439) analytic datasets—that included individuals identified as meeting criteria for a CHR syndrome (n = 84)—who completed the novel Sensorimotor Abnormalities and Psychosis-Risk (SMAP-R) Scale, clinical interviews and a finger-tapping task. The structure of the scale and reliability of items were consistent across 2 analytic datasets. The resulting scales were assessed for discriminant validity across CHR, community sample non-psychiatric volunteer, and clinical groups. ResultsThe scale showed a consistent structure across 2 analytic datasets subscale structure. The resultant subscale structure was consistent with conceptual models of sensorimotor pathology in psychosis (coordination and dyskinesia) in both the exploratory and the validation analytic dataset. Further, these subscales showed discriminant, predictive, and convergent validity. The sensorimotor abnormality scales discriminated CHR from community sample non-psychiatric controls and clinical samples. Finally, these subscales predicted to risk calculator scores and showed convergent validity with sensorimotor performance on a finger-tapping task. ConclusionThe SMAP-R scale demonstrated good internal, discriminant, predictive, and convergent validity, and subscales mapped on to conceptually relevant sensorimotor circuits. Features of the scale may facilitate widespread incorporation of sensorimotor screening into psychosis-risk research and practice.     

The CANSAS Self-report for Screening of Needs in Outpatients with Schizophrenia and Schizoaffective Disorders

The importance of needs assessment for service development has been widely recognized. In this study we examined the agreement between the Camberwell Assessment of Need Short Appraisal Schedule self-report version (CANSAS-P) and the Camberwell Assessment of Need interview-based scale in 100 outpatients with schizophrenia and schizoaffective disorders. We found equivalent number of met, unmet, and no needs for most of the domains of the two instruments. Both intraclass correlations and Kappa reliability coefficients were high for most need domains. The high agreement between the two instruments suggests that the CANSAS-P can be used as a screening tool to detect unmet needs in both clinical routine practice and research surveys in mental health outpatient settings.     

From research to practice

Background: Service planning based on aggregated needs assessment is rarely practised. There is a lack of research into how population-based needs assessment approaches can be translated into routine clinical settings. Aims: This study aimed to ascertain the 2-month period prevalence of psychosis in Gloucester City, to investigate the level of need among those in contact with mental health services, and to identify the compromises which are involved in routine collection of data to inform services, compared with specifically funded research studies. Method People with ICD-10 diagnosis of functional psychosis were identified by searching General Practice and mental health service records in Gloucester City. The needs of the sub-sample in touch with mental health services were assessed using the Camberwell Assessment of Need Short Appraisal Schedule (CANSAS). Results: Four hundred and seventy-four cases were identified, including 403 in contact with mental health services. Staff CANSAS data were collected for 225 patients, with a mean rating of 7.0 met and 3.6 unmet needs per patient. Unmet need was higher in the non-Caucasian group. Conclusions: In this locality, patients with functional psychosis were largely in contact with mental health services, were in employment, were disproportionately looked after by a few City centre General Practitioners, and high levels were in supported accommodation. Higher levels of need were found than previously demonstrated. Systematic assessment of needs with research instruments to contribute to locality service planning is possible without a major research grant, but involves compromises on established research designs. Accepted: 11 November 2002 Correspondence to Dr. R. Macpherson, MB, MRCPsych, MD     

The Schizophrenia Care and Assessment Program Health Questionnaire (SCAP-HQ): an instrument to assess outcomes of schizophrenia care

Advances in treatment technologies and development of evidence-based standards of care demand better methods for routine assessment of outcomes for schizophrenia in systems of care. This article describes the development and psychometrics of a new instrument to assess outcomes of routine care for persons with schizophrenia in service systems. Candidate items for the Schizophrenia Care and Assessment Program Health Questionnaire (SCAP-HQ) were drawn from existing measures. Domains covered include disease outcomes (symptoms, subjective medication effects, substance abuse), functional status, health status, quality of life, and public safety. A sample of 1,584 patients with schizophrenia or schizoaffective disorder who were recruited into a large prospective, naturalistic study on the course of treatment for schizophrenia completed the SCAP-HQ at baseline and 1 year later (n = 434), providing data for factor analysis, assessment of internal consistency, convergent validity, and responsiveness to change. A subsample of 121 patients completed a test-retest protocol. Fifteen scales were derived by factor analysis from 55 outcome items on the SCAP-HQ. These factors covered psychiatric symptoms, life satisfaction, instrumental activities of daily living, health-related disability, subjective medication side effects, vitality, legal problems, social relations, mental health-related disability, suicidality, drug and alcohol use, daily activities, victimization, violence, and employment. For most scales, standard psychometric parameters, including internal consistency and test-retest reliability, convergent validity, and responsiveness to change, were acceptable for application to large sample evaluations of care systems. This new measure represents an advance in the development of outcome measures for schizophrenia for use in large-scale studies of routine care.     

Validation of the Health of the Nation Outcome Scales as a routine measure of outcome in early intervention programmes

Aim: So far, no study has assessed the validity of the Health of the Nation Outcome Scales (HoNOS) in patients enrolled in early intervention programmes, nor has any study evaluated the validity of the HoNOS in people at ultra high‐risk (UHR) of psychosis. This study set out to assess the validity and reliability of the HoNOS as a measure of outcome in the patients enrolled in an early intervention programme. Methods: The concurrent, discriminant and predictive validity, and the reliability of the HoNOS as a measure of outcome in an early intervention programe were assessed in 87 first‐episode psychosis (FEP) patients, and in 81 patients at UHR of psychosis. Results: Reliability indexes were good in the FEP sample, and less good in the UHR sample. HoNOS total scores differentiated between FEP and UHR patients, and the HoNOS subscales proved able to assess a specific profile of symptoms in the two samples, demonstrating a helpful adjunctive measure of health status without complete overlap with other scales. Sensitivity to change was also very good, again with differences between FEP and UHR patients. HoNOS scores at intake did not predict failure to attain remission in FEP patients. There were too few cases of transition to psychosis (n = 2) to assess predictive validity of HoNOS in the UHR sample. Conclusion: HoNOS possesses satisfactory sensitivity and validity to be used in the routine assessment in early intervention programmes.     

A preliminary examination of the validity and reliability of a new brief rating scale for symptom domains of psychosis: Brief Evaluation of Psychosis Symptom Domains (BE-PSD)

BackgroundBrief assessments have the potential to be widely adopted as outcome measures in research but also routine clinical practice. Existing brief rating scales that assess symptoms of schizophrenia or psychosis have a number of limitations including inability to capture five symptom domains of psychosis and a lack of clearly defined operational anchor points for scoring.MethodsWe developed a new brief rating scale for five symptom domains of psychosis with clearly defined operational anchor points – the Brief Evaluation of Psychosis Symptom Domains (BE-PSD). To examine the psychometric properties of the BE-PSD, fifty patients with schizophrenia or schizoaffective disorder were included in this preliminary cross-sectional study. To test the convergent and discriminant validity of the BE-PSD, correlational analyses were employed using the consensus Positive and Negative Syndrome Scale (PANSS) five-factor model. To examine the inter-rater reliability of the BE-PSD, single measures intraclass correlation coefficients (ICCs) were calculated for 11 patients.ResultsThe BE-PSD domain scores demonstrated high convergent validity with the corresponding PANSS factor score (r_s = 0.81–0.93) as well as good discriminant validity, as evidenced by lower correlations with the other PANSS factors (r_s = 0.23–0.62). The BE-PSD also demonstrated excellent inter-rater reliability for each of the domain scores and the total scores (ICC(2,1) = 0.79–0.96).ConclusionsThe present preliminary study found the BE-PSD measure to be valid and reliable; however, further studies are needed to establish the psychometric properties of the BE-PSD because of the limitations such as the small sample size and lacking data on test-retest reliability or sensitivity to change.     

Psychometric Properties of the Dutch Version of the Self-Sufficiency Matrix (SSM-D)

Measuring treatment outcomes can be challenging in patients who experience multiple interlinked problems, as is the case in public mental health care (PMHC). This study describes the development and psychometric properties of a Dutch version of the self-sufficiency matrix (SSM-D), an instrument that measures outcomes and originates from the US. In two different settings, clients were rated using the SSM-D in combination with the Health of the Nation Outcome Scales (HoNOS) and the Camberwell assessment of need short appraisal schedule (CANSAS). The results provided support for adequate psychometric properties of the SSM-D. The SSM-D had a solid single factor structure and internal consistency of the scale was excellent. In addition, convergent validity of the SSM-D was indicated by strong correlations between HoNOS and CANSAS, as well as between several subdomains. Further research is needed to establish whether the results presented here can be obtained in other PMHC settings.     

Development and psychometric validation of the Clinical Assessment Interview for Negative Symptoms (CAINS)

Progress in the development of new pharmacological and psychosocial treatments for the negative symptoms of schizophrenia is impeded by limitations of available assessment instruments. The multi-site Collaboration to Advance Negative Symptom Assessment in Schizophrenia (CANSAS) was established to develop and validate a new clinical rating scale using a transparent, iterative, and data-driven process. The Clinical Assessment Interview for Negative Symptoms (CAINS) was designed to address limitations of existing measures and assess consensus-based sub-domains, including asociality, avolition, anhedonia, affective blunting, and alogia. The structure and psychometric properties of the CAINS were evaluated in a sample of 281 schizophrenia and schizoaffective outpatients at four sites. Converging structural analyses indicated that the scale was comprised of two moderately correlated factors - one reflecting experiential impairments (diminished motivation and enjoyment of social, vocational, and recreational activities) and one reflecting expressive impairments (diminished non-verbal and verbal communication). Item-level analyses revealed generally good distributional properties, inter-rater agreement, discriminating anchor points, and preliminary convergent and discriminant validity. Results indicate that the CAINS is a promising new measure for quantifying negative symptoms in clinical neuroscience and treatment studies. Results guided item modification or deletion, and the reliability and validity of the revised, shorter version of the CAINS is in the final phase of development within the CANSAS project.     

Development and Evaluation of a Patient-rated Version Of the Camberwell Assessment of Need Short Appraisal Schedule (CANSAS-P)

The comprehensive assessment of patients with severe mental health problems includes the evaluation of needs, as this informs service planning, and levels of unmet need have been found to be associated with lower subjective quality of life. The Camberwell Assessment of Need is the most widely used instrument for this purpose. We report the development and evaluation of a new, patient-rated, short form (CANSAS-P). The CANSAS-P exhibited comparable detection of needs with its predecessor, better identification of domains that are problematic for patients to respond to, good test-retest reliability, especially for unmet needs, and generally positive evaluations by patients. We recommend the CANSAS-P as the needs assessment measure of choice for completion by patients. Tom Trauer, Glen Tobias, and Mike Slade are affiliated with Department of Psychiatry, University of Melbourne, Australia.     

Assessing depression in youth at clinical high risk for psychosis: A comparison of three measures

Depressive symptoms are prevalent among individuals at clinical high-risk (CHR) for psychosis. Prior studies have used the Beck Depression Inventory (BDI), Hamilton Depression Rating Scale (HDRS), and the “dysphoric mood” item of the Scale of Prodromal Symptoms (SOPS) to assess depressive symptoms in CHR samples. We compared the psychometric properties of these instruments in a CHR cohort, to support the selection of appropriate depressive symptoms measures in future studies and in clinical settings. Internal consistency was assessed using Cronbach's alpha. Construct validity was assessed through correlations with SOPS items that were expected or not expected to be related to depressive symptoms. Criterion validity was assessed by comparing scores between patients with and without a major depressive disorder diagnosis. We hypothesized based on the schizophrenia literature that the BDI would have superior internal consistency and discriminant validity compared to the HDRS, and that all three measures would show convergent validity and criterion validity. The BDI demonstrated superior internal consistency and construct validity in this at-risk sample. The BDI and HDRS differentiated patients with major depressive disorder, but SOPS dysphoria did not. This has implications for the choice of depression measures in future CHR studies and for the interpretation of past findings.     

The validity of the German version of the Health of the Nation Outcome Scales (HoNOS‐D): a clinician‐rating for the differential assessment of the severity of mental disorders

The Health of the Nation Outcome Scales (HoNOS) is an internationally‐established clinician‐rating instrument for the differential assessment of the severity of patients with mental disorders. The aim of this study was to examine the validity of the German version of the HoNOS (HoNOS‐D). Evaluation of validity, including factor validity, convergent and discriminant validity and sensitivity to change, was conducted on a large, virtually representative, clinical sample of patients with mental disorders in inpatient psychotherapy (Study 1, N = 3169). Additional assessment of criterion‐based validity was completed using another clinical sample of patients with mental disorders (Study 2, N = 55). Although factor validity of the HoNOS‐D and its total score could not be confirmed as expected, the majority of single items of the HoNOS‐D proved to be valid in terms of convergent validity, criterion‐based validity and sensitivity to change. Hence, single items, rather than the total score of the HoNOS‐D, can be recommended for obtaining a picture of the impairment of patients with mental disorders in the clinical setting. Copyright © 2010 John Wiley & Sons, Ltd.     

The association between needs and quality of life in an epidemiologically representative sample of people with psychosis.

The impact of meeting needs on quality of life in the severely mentally ill is investigated in this study. An epidemiologically representative sample of 133 patients meeting ICD-10 criteria for psychosis completed standardized instruments for measuring needs and quality of life. Covariance structure modelling was used to investigate the extent to which latent factors of met and unmet need were associated with latent quality of life. Patients rated about 0.7 more total (met plus unmet) needs than staff, mainly due to differences in rating unmet need. Patient ratings were more reliable than ratings by others of unmet need and quality of life. Both underlying unmet need and met need were negatively associated with underlying quality of life, but unmet need was the stronger relationship. The patient's perspective on their difficulties (especially their unmet needs) must be central to mental health care.     

Comparison of generic and disease-specific measures of quality of life in first-episode psychosis

Background

Quality of life (QOL) is now recognised as an important measure of outcome that could potentially influence clinical decision-making for those with a first-episode psychosis (FEP). A number of QOL instruments are available however; many differ in their conceptual orientation which may have serious implications for the outcome of QOL studies, interpretation of findings and clinical utility. We aimed to compare two commonly used tools representing both generic and disease-specific constructs to examine whether both tools appraise the same underlying QOL traits and also whether disease-specific tools retain their psychometric properties when used in FEP groups.

Methods

We assessed 159 consecutive individuals presenting with FEP in a defined catchment area with two commonly used QOL tools and examined the findings using the multi-trait multi-method matrix.

Results

Similarly named domains of QOL between both tools (Psychological Wellbeing, Physical Health, Social Relations) showed good convergent validity using confirmatory factor analysis. However, discriminant validity was not established given that domains loading onto their indicated latent factors were more strongly correlated with their non-corresponding latent factors.

Conclusions

A major consideration in undertaking the present study was to assess the extent to which the outcome of QOL studies in FEP were valid and that systematic error did not provide another plausible explanation for findings. Establishing convergent validity demonstrates that either tool could be used satisfactorily to measure the QOL construct identified however; we did not establish discriminant validity. Doing so would have demonstrated that QOL domains are substantively different in that they contain some unique piece of information determining clinical utility. These findings are important for our understanding of multi-dimensional models of QOL.     

Factors associated with changing patient needs in an assertive outreach team

BACKGROUND, AIMS: Although clinical use of needs assessment tools is widespread, there is little evidence about their value in longitudinal use. This study aimed to identify the factors associated with changing needs in an assertive outreach (AO) team's caseload, over a 6-month rating period. METHODS: The Camberwell Assessment of Needs Short Appraisal Schedule (CANSAS) and the Engagement Measure (EM) were used to assess need and engagement with services respectively, in an AO team caseload. Care planning was based partly on awareness of current unmet needs. The patients were then reassessed at a 6-month follow-up, to determine to what extent identified unmet need had been successfully addressed, and whether levels of engagement had altered. RESULTS: Data were obtained for 79 of 82 patients on the AO team caseload. At 6-month follow-up patient-rated unmet need, but not staff-rated unmet need, was significantly reduced. Patient-, but not staff-rated met need was significantly increased. Measures of engagement were unchanged. Patients' needs changed across a variety of physical, social and psychological domains, rather than in one specific area. In regression analyses, only accommodation type was independently associated with patient-rated changing met need; only diagnosis was significantly related to changing patient-related unmet need. CONCLUSION: In this study, the CANSAS was used routinely in a standard AO team, and the finding that over a 6-month period patient-rated unmet need reduced significantly suggests that formal rating of needs assessment may have helped to target care planning effectively. The results suggest that accommodation type and diagnosis may play an important role in the ability of services to effectively meet patient needs, but further work in larger samples is needed to address these questions.     

Validity of a brief measure of post-hospital adjustment for psychiatric patients

This study examined the psychometric properties of a 14-item self-administered outcome measure of post-hospital adjustment for former psychiatric inpatients. Such scales are frequently used in follow-up assessment, often without knowledge of scale reliability or validity. Responses to the scale items were factor analyzed for two samples, former patients and their therapists, each group rating the patient's post-hospital adjustment. Two strong factors emerged and were consistent across both samples: an anxiety-depression (intrapsychic) dimension and a functioning/productivity (external adjustment) dimension. Both scales showed good convergent validity with longer, standardized measures. Agreement between patients and therapists was adequate for anxiety-depression, indicating good consensual validity, but poor for functional adjustment. For the expatients, discriminant validity was not evident.     

QUALIDEM: development and evaluation of a dementia specific quality of life instrument--validation

OBJECTIVE: To validate the QUALIDEM, a quality of life measure for people with dementia within residential settings rated by professional caregivers. METHOD: In a sample of 202 residents of nursing homes Spearman rank correlations were calculated between the QUALIDEM subscales aand indices of convergent validity and discriminant validity, with dementia severity and need of care, with global QOL scores by the head nurse and family, and with self-report on COOP/WONCA Charts. RESULTS: The one-method multi-trait matrix showed 90.5% of the correlations to be in support for convergent and discriminant validity. Low to moderate correlations were observed with dementia severity and need of care, confirming that QOL is not merely disease severity. Support for concurrent validity was found in correlations with QOL ratings by the head nurse. The QUALIDEM did not correlate with most of the family ratings or with the COOP/WONCA Charts. CONCLUSION: The results of this validation study together with the obtained content validity through the method of construction provide sufficient support for validity of the QUALIDEM to be used for care evaluation and research in residential settings.     

Characteristics and needs of asylum seekers and refugees in contact with London community mental health teams

BACKGROUND: Asylum seekers and refugees may have substantial needs for mental health care, to which both pre-migration and post-migration traumas are likely to contribute. However, there is a paucity of data available to guide appropriate service development. AIMS: To ascertain numbers and describe the characteristics and needs of asylum seekers and refugees in contact with London Community Mental Health Teams (CMHTs). METHOD: Data were obtained from staff and clinical records regarding socio-demographic and clinical characteristics and service use. Camberwell Assessment of Need Short Appraisal Schedule (CANSAS) and Health of the Nation Outcome Scales (HoNOS) were completed. RESULTS: A total of 104 (11%) of the CMHT population were asylum seekers or refugees. Co-morbidity was frequent, and psychiatrists reported significant diagnostic uncertainty for 30%. The most common diagnoses were depression (50%) and post-traumatic stress disorder (PTSD) (41%), and just over half had a psychotic diagnosis (53%). Social isolation was common, levels of unmet need were high (mean of 6.8 unmet needs each using CANSAS) and the group used few services other than CMHTs. CONCLUSIONS: The combination of high levels of need and limited service use suggests a need to develop more effective services. High rates of diagnostic uncertainty suggest a need for a clearer understanding of the complex clinical syndromes afflicting this group.