The Spanish version of the FibroFatigue Scale: validation of a questionnaire for the observer's assessment of fibromyalgia and chronic fatigue syndrome

OBJECTIVE: To examine some of the psychometric properties of the Spanish version of the FibroFatigue Scale (FFS). METHODS: FFS was administered to 120 patients diagnosed with fibromyalgia and chronic fatigue syndrome. Internal consistency was evaluated by using Cronbach's alpha, test-retest reliability with weighted kappa and construct validity by correlations among FFS, the Fibromyalgia Impact Questionnaire (FIQ), the EuroQol 5D (EQ-5D) and the Hospital Anxiety and Depression Scale (HADS). The interrater reliability was tested using analysis of variance with patients and raters as independent factors. RESULTS: Internal consistency (alpha) was .88, test-retest reliability was .91, and interrater reliability was .93. Significant correlations were obtained between overall FFS and the FIQ (.55, P<.01), the EQ-5D (-.48, P<.01) and the HADS depression subscale (.25, P<.01), but not with the HADS anxiety subscale. CONCLUSION: These results support the reliability and validity of the data obtained with the Spanish version of the FSS.     

Diagnostic Interview for Genetic Studies (DIGS): inter-rater and test-retest reliability and validity in a Spanish population.

OBJECTIVE: To test the reliability and validity of the DIGS in Spanish population. METHODS: Inter-rater and test-retest reliability of the Spanish version of DIGS was tested in 95 inpatients and outpatients. The resultant diagnoses were compared with diagnoses obtained by the LEAD (Longitudinal Expert All Data) procedure as "gold standard". The kappa statistic was used to measure concordance between blind inter-raters and between the diagnoses obtained by LEAD procedure and through the DIGS. RESULTS: Overall kappa coefficient for inter-rater reliability was 0.956. The kappa value for individual diagnosis varied from major depression=0.877 to schizophrenia=1. Test-retest reliability was 0.926. Kappa for all individual target diagnoses ranged from 0.776 (major depression) to 1. Kappa between LEAD procedure and DIGS ranged from 0.704 (major depression) to 0.825 (bipolar I disorder). CONCLUSION: Most of the DSM-IV major psychiatric disorders can be assessed with acceptable to excellent reliability with the Spanish version of the DIGS interview. The Spanish version of DIGS showed an acceptable to excellent concurrent validity. Giving the good reliability and validity of Spanish version of DIGS it should be considered to identify psychiatric phenotypes for genetics studies.     

Measuring common mental disorders in women in Ethiopia

BACKGROUND: There is a dearth of methodological studies critically evaluating reliability, validity and feasibility of measures of common mental disorders (CMD) in low-income countries. METHODS: Test-retest and inter-rater reliability of categorisation of CMD caseness, according to locally agreed criteria using the Comprehensive Psychopathological Rating Scale (CPRS), was measured in 99 women from out-patient clinics (inter-rater) and 99 women from a primary healthcare centre (test-retest) in Ethiopia. The construct validity of CMD as measured with CPRS was assessed with exploratory factor analysis using maximum likelihood with varimax rotation. RESULTS: Test-retest reliability was fair (kappa = 0.29). Subsequent assessment of inter-rater reliability found excellent agreement (kappa = 0.82). The construct of CMD appeared unidimensional, combining depressive, anxiety and somatic symptoms. CONCLUSIONS: Detection of socioculturally meaningful cases of CMD in Ethiopia can be reliably achieved with local psychiatrist assessment using CPRS, although thorough training is essential.     

Inter-rater reliability of family history information on psychiatric disorders in relatives

The family history method in psychiatric family studies is an important and necessary way of obtaining information on family members who are not available for personal interview. Studies on the validity of this method have shown that family history information on psychiatric disorders in relatives is neither accurate nor sensitive but highly specific. However, its inter-rater reliability has rarely been assessed, even though this is a prerequisite for adequate validity. In the present investigation we examined the inter-rater reliability of family history information obtained with a semi-structured and symptom-oriented interview. Forty informants were interviewed twice by two different raters within 3 and 20 days. The inter-rater reliability was found to be good for dementia (kappa=0.82, 95 % CI=0.61–1.00), alcohol related disorders (kappa=0.93, 95 % CI=0.80–1.00), for depressive disorders (kappa=0.72, 95 % CI=0.42–1.00), anxiety disorders (kappa=0.75, 95 % CI=0.41–1.00) and any psychiatric disorder (kappa=0.79, 95 % CI=0.66–0.91). We concluded that the family history interview is a useful family study instrument that can be applied reliably by different raters for frequent psychiatric disorders. Received: 13 September 2001 / Accepted: 28 September 2001     

Development of a new seizure severity questionnaire: initial reliability and validity testing

PURPOSE: This report describes the initial steps for development of a new scale to assess seizure severity as a treatment response. METHODS: Standard methodology was used to develop the test instrument. Item generation was performed by selecting items from other questionnaires, and asking patients and epileptologists about seizure components. Face and content validity were assessed in a pilot study with patients and observers. The questionnaire was formatted as a structured interview for a reliability study. Construct validity was assessed with three existing questionnaires. Inter-rater reliability and test-retest reliability were performed as two independent ratings on one day, and one re-interview. RESULTS: Based on item generation and pilot testing (33 patients, 28 observers), the Seizure Severity Questionnaire (SSQ) was organized into warning, activity-movement, and recovery (cognitive, emotional, and physical aspects) stages of seizures. Questions reviewed duration, severity, bothersomeness and overall ratings, and the most bothersome aspect of seizures. The mean SSQ Summary Score was 5.78+/-3.24, inter-rater reliability was 0.76 (N=91), and test-retest reliability was 0.74 (N=63). Construct validity showed statistically significant correlations with other scales. CONCLUSION: This study has explored the psychometric properties of the SSQ for face and content validity, inter-rater and test-retest reliability, and construct validity. The Summary Score reliably represents the major components of seizures.     

The development of a valid and reliable scale for rating anxiety in dementia (RAID)

A rating scale to measure anxiety in dementia sufferers was developed and evaluated in a sample of 51 inpatients and 32 day-hospital patients. Anxiety scores were not related to sex, age, accommodation or DSM-IV diagnosis of the type of dementia. However, both subjects with physical illnesses and subjects with insight into their memory problems had significantly higher anxiety scores.The kappa values for inter-rater reliability ranged from 0.51 to 1 and for test-retest reliability from 0.53 to 1, which indicates moderate to good reliability.The overall agreement on individual items ranged from 82-100% (inter-rater) and 84-100% (test-retest).The professionals working in the care of the elderly and carer groups felt that the scale was comprehensive and all the items in the scale were important, thereby confirming that it has good content validity. The scale significantly correlated with other anxiety scales and also with independent ratings both by a consultant psychiatrist and also nursing staff, indicating good concurrent validity. Anxiety scores were significantly higher in dementia patients who fulfilled modified DSM-IV criteria for anxiety and clinical diagnosis of anxiety disorder.This showed evidence of good criterion validity. Factor analysis showed five factors, including all items of the scale. Scores of 11 and above on the scale indicated significant clinical anxiety. Overall, the scale had good reliability and validity. It should be a useful clinical and research instrument for assessing anxiety in dementia sufferers.     

Reliability of a Rating Scale to Assess Post-stroke Psychiatric Symptoms

Background : Various rating scales for post-stroke psychiatric symptoms such as cognitive impairment have long been used in drug efficacy trials in Japan. However, their reliability has not been established. The purpose of the present study was to examine the inter-rater and intra-rater reliability of a rating scale, which has been conventionally used in Japan.
Methods : The most frequent symptoms, including apathy, emotional and cognitive impairment, found in post-stroke patients were assessed using a rating scale comprising 17 items and 4 global assessment scales. Semi-structured interviews of 18 patients with symptoms with various degrees of severity were videotaped. Twelve physicians who were not interviewers independently assessed the severity of symptoms in the 18 patients by replaying the videotapes. This procedure was repeated twice with an interval of two months to examine inter-rater and test-retest reliability.
Results : The results revealed almost satisfactory reliability. Intraclass correlation coefficients were over 0.6 in the inter-rater analysis for most items and the concordance correlation coefficients were over 0.7 in the intra-rater analysis. The rating scale was considered to be reliable, although some items showed relatively low agreement.
Conclusion : The conventional rating scale to assess post-stroke psychiatric symptoms showed satisfactory inter-rater and intra-rater reliability by the videotape method. The validity study should be further investigated.     

Assessment of the severity of dementia: validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS)

BACKGROUND: With the rapid growth of the older population, early detection of cognitive deficits is crucial in slowing down functional deterioration of the elderly persons. OBJECTIVES: To examine the validity and reliability of the Chinese (Cantonese) version of the Hierarchic Dementia Scale (CV-HDS) for Chinese older persons in Hong Kong. METHODS: The HDS was translated into Cantonese Chinese. The content and cultural validity were evaluated by six expert panel members. Sixty-two participants with diagnosis of dementia were recruited for evaluation. Inter-rater reliability, test-retest reliability, internal consistency and concurrent validity were examined. RESULTS: The CV-HDS demonstrated satisfactory psychometric properties. inter-rater reliability and test-retest reliability were high (alpha = 0.89 and alpha = 0.94 respectively). High value of Cronbach's alpha (alpha = 0.94) demonstrated good internal consistency. The concurrent validity of CV-HDS, through correlation with its scores with that of the Chinese version of Mini Mental Status Examination, was established (ranged from r = 0.58 to r = 0.78, p < 0.01). CONCLUSIONS: The CV-HDS is a reliable and valid instrument for assessing severity of cognitive impairment in Cantonese speaking Chinese people with dementia. It facilitates treatment planning to optimize the effects of functional training and rehabilitation. Copyright (c) 2008 John Wiley & Sons, Ltd.     

Test-retest reliability of the unified Parkinson's disease rating scale in patients with early Parkinson's disease: results from a multicenter clinical trial.

Our objective was to assess the test-retest reliability of the Unified Parkinson's Disease Rating Scale (UPDRS). The UPDRS is the most widely used instrument for measuring severity of parkinsonian symptoms in clinical research and in practice. The validity and inter-rater reliability of this scale have been previously studied. We examined the test-retest (intrarater) reliability of the UPDRS and derived subscales. Four hundred patients with early-stage Parkinson's disease (PD) who were participating in a multicenter clinical trial were evaluated using the UPDRS on two separate occasions (screening and baseline visits) prior to receiving treatment. The same neurologist at each center rated the subjects at both examinations that were, on average, 14.6 +/- 7.6 days apart (range 3-36 days). Test-retest reliability was estimated using the intraclass correlation coefficient (ICC) for the total UPDRS score, the mental, ADL, and motor subscale scores, and other derived subscale scores. Weighted kappa statistics were calculated for individual UPDRS items. The ICCs for the UPDRS scores were as follows: total score, 0.92; mental, 0.74; ADL, 0.85; motor, 0.90. ICCs for derived symptom-based scales ranged from 0.69-0.88. Reliability of specific items was generally lower than for summary scales. Reliability was slightly better in patients for whom the testing interval was within 14 days. Based on conventional standards, the UPDRS scores were found to have excellent test-retest reliability in this sample of patients with early PD rated by academic movement disorder specialists. The findings are in agreement with previous reports on interrater reliability.     

Measurements of acute cerebral infarction: a clinical examination scale

We designed a 15-item neurologic examination stroke scale for use in acute stroke therapy trials. In a study of 24 stroke patients, interrater reliability for the scale was found to be high (mean kappa = 0.69), and test-retest reliability was also high (mean kappa = 0.66-0.77). Test-retest reliability did not differ significantly among a neurologist, a neurology house officer, a neurology nurse, or an emergency department nurse. The stroke scale validity was assessed by comparing the scale scores obtained prospectively on 65 acute stroke patients to the patients' infarction size as measured by computed tomography scan at 1 week and to the patients' clinical outcome as determined at 3 months. These correlations (scale-lesion size r = 0.68, scale-outcome r = 0.79) suggested acceptable examination and scale validity. Of the 15 test items, the most interrater reliable item (pupillary response) had low validity. Less reliable items such as upper or lower extremity motor function were more valid. We discuss methods for improving the reliability and validity of brief examination scales to be used in stroke therapy trials.     

Reliability of the Hamilton Rating Scale for Depression: a meta-analysis over a period of 49 years

The aim of this study was to provide a comprehensive meta-analytic review of the reliability of the Hamilton Rating Scale for Depression (HRSD) for the period 1960-2008, taking into consideration all three types of reliability: internal consistency, inter-rater, and test-retest reliability. This is the first such meta-analytic study of a clinician-administered psychiatric scale. A thorough literature search was conducted using MEDLINE and PsycINFO. The total number of collected articles was 5548, of which 409 reported one or more reliability coefficients. The effect size was obtained by the z-transformation of reliability coefficients. The meta-analysis was performed separately for internal consistency, inter-rater and test-retest reliability. A pooled mean for alpha coefficient in random effects model was 0.789 (95%CI 0.766-0.810). The meta-regression analysis revealed that higher alpha coefficients were associated with higher variability of the HRSD total scores. With regard to inter-rater reliability, pooled means in random effects model were 0.937 (95%CI 0.914-0.954) for the intraclass correlation coefficient, 0.81 (95%CI 0.72-0.88) for the kappa coefficient, 0.94 (95%CI 0.90-0.97) for the Pearson correlation coefficient, and 0.91 (95%CI 0.78-0.96) for the Spearman rank correlation coefficient. A meta-regression analysis showed positive association between inter-rater reliability and publication year. Test-retest reliability of HRSD ranged between 0.65 and 0.98 and generally decreased with extending the interval between two measurements (Spearman r between the duration of interval and test-retest reliability figures = -0.74). Results suggest that HRSD provides a reliable assessment of depression. Figures indicate good overall levels of internal consistency, inter-rater and test-retest reliability, but some HRSD items (e.g., “loss of insight”) do not appear to possess a satisfactory reliability.     

Scalability, reliability, and validity of the benzodiazepine dependence self-report questionnaire in outpatient benzodiazepine users.

As there is no multidimensional instrument available that reflects the severity of benzodiazepine (BZD) dependence comprehensively, the Benzodiazepine Dependence Self-Report Questionnaire (Bendep-SRQ) was developed and investigated. The Bendep-SRQ, Symptom Checklist-90 (SCL-90), Schedules for Clinical Assessments in Neuropsychiatry (SCAN), and Addiction Severity Index-Revised (ASI-R) were administered to 115 general practice (GP) patients, 124 psychiatric outpatients, and 33 self-help patients who were using BZDs. Factor and Rasch analyses were applied to construct scales. Reliability assessments were made in terms of subject discriminability, item discriminability, and test-retest stability. To support the construct validity of the scales, theoretical rationales were required to explain the specific item order provided by the Rasch scale values. To assess the concurrent and discriminant validity, a matrix consisting of the above-mentioned measures was factor-analyzed. Four Rasch-homogeneous scales were delineated: problematic use, preoccupation, lack of compliance, and withdrawal. Nearly all subject discriminability, item discriminability, and test-retest results indicated good reliability. A BZD dependence factor was extracted with high loadings for the Bendep-SRQ scales and the concurrent measures. The discriminant measures had high loadings on other factors. The scalability, reliability, and validity of the Bendep-SRQ scales appeared to be good. The Bendep-SRQ shows great promise as a useful and easily manageable instrument for assessment of the severity of BZD dependence in clinical practice and scientific research.     

The Need of Support and Service Questionnaire (NSSQ): a brief scale to assess needs in clients with long-term mental disabilities

We present the Need of Support and Service Questionnaire (NSSQ), a new instrument developed to provide professionals in psychiatric care and community social services with a tool to assess needs of support and service in mentally disabled clients. The final version of the instrument was designed after comments from professionals in psychiatric care, community social services, and the clients and their relatives. A reliability study (test-retest, n=77), inter-rater (n=69) and a validity study (n=529) were performed. In the validity study, comparisons were done with the Camberwell Assessment of Need (CAN) scale, the Global Assessment of Functioning (GAF) scale and the Social and Occupational Functioning Assessment Scale (SOFAS). The test-retest and inter-rater reliability were 0.86 and 0.76, respectively. The percentage of agreement on the individual items ranged from 83.1% to 100.0% (test-retest) and 76.8% to 100.0% (inter-rater reliability). The corresponding kappa coefficients ranged from 0.63 to 1.00 (test-retest) and 0.33 to 1.00 (inter-rater reliability). The comparison between NSSQ and CAN items demonstrated high sensitivity and specificity as well as satisfactory likelihood ratios (LRs). The correlations between GAF and SOFAS scores and the number of needs of support, number of needs of service and the total number of needs of support and service were -0.49, -0.32 and -0.47, and -0.48, -0.26 and -0.45, respectively. All correlations were statistically significant (P<0.01). The results demonstrated that the psychometric characteristics of the NSSQ were satisfactory. Moreover, professionals without any formal training easily used it.     

Development and Validation of a Computerized Adaptive Assessment Tool for Discrimination and Measurement of Psychotic Symptoms

ObjectiveTime constraints limit the use of measurement-based approaches in research and routine clinical management of psychosis. Computerized adaptive testing (CAT) can reduce administration time, thus increasing measurement efficiency. This study aimed to develop and test the capacity of the CAT-Psychosis battery, both self-administered and rater-administered, to measure the severity of psychotic symptoms and discriminate psychosis from healthy controls.MethodsAn item bank was developed and calibrated. Two raters administered CAT-Psychosis for inter-rater reliability (IRR). Subjects rated themselves and were retested within 7 days for test-retest reliability. The Brief Psychiatric Rating Scale (BPRS) was administered for convergent validity and chart diagnosis, and the Structured Clinical Interview (SCID) was used to test psychosis discriminant validity.ResultsDevelopment and calibration study included 649 psychotic patients. Simulations revealed a correlation of r = .92 with the total 73-item bank score, using an average of 12 items. Validation study included 160 additional patients and 40 healthy controls. CAT-Psychosis showed convergent validity (clinician: r = 0.690; 95% confidence interval [95% CI]: 0.610–0.757; self-report: r = .690; 95% CI: 0.609–0.756), IRR (intraclass correlation coefficient [ICC] = 0.733; 95% CI: 0.611–0.828), and test-retest reliability (clinician ICC = 0.862; 95% CI: 0.767–0.922; self-report ICC = 0.815; 95%CI: 0.741–0.871). CAT-Psychosis could discriminate psychosis from healthy controls (clinician: area under the receiver operating characteristic curve [AUC] = 0.965, 95% CI: 0.945–0.984; self-report AUC = 0.850, 95% CI: 0.807–0.894). The median length of the clinician-administered assessment was 5 minutes (interquartile range [IQR]: 3:23–8:29 min) and 1 minute, 20 seconds (IQR: 0:57–2:09 min) for the self-report.ConclusionCAT-Psychosis can quickly and reliably assess the severity of psychosis and discriminate psychotic patients from healthy controls, creating an opportunity for frequent remote assessment and patient/population-level follow-up.     

The reliability and validity of the Complex Task Performance Assessment: A performance-based assessment of executive function

The objective of this study was to evaluate the inter-rater reliability, test-retest reliability, concurrent validity, and discriminant validity of the Complex Task Performance Assessment (CTPA): an ecologically valid performance-based assessment of executive function. Community control participants (n?=?20) and individuals with mild stroke (n?=?14) participated in this study. All participants completed the CTPA and a battery of cognitive assessments at initial testing. The control participants completed the CTPA at two different times one week apart. The intra-class correlation coefficient (ICC) for inter-rater reliability for the total score on the CTPA was .991. The ICCs for all of the sub-scores of the CTPA were also high (.889–.977). The CTPA total score was significantly correlated to Condition 4 of the DKEFS Color-Word Interference Test (p?=??.425), and the Wechsler Test of Adult Reading (p =??.493). Finally, there were significant differences between control subjects and individuals with mild stroke on the total score of the CTPA (p?=?.007) and all sub-scores except interpretation failures and total items incorrect. These results are also consistent with other current executive function performance-based assessments and indicate that the CTPA is a reliable and valid performance-based measure of executive function.     

The “Carers’ needs assessment for Schizophrenia”

Objective For the purpose of service planning, an instrument was developed for the systematic assessment of interventions needed by the caregivers of schizophrenia patients. Method The development of this instrument was based on in-depth interviews and focus groups. It consists of 18 areas describing common problems of schizophrenia caregivers. For each of these problem areas several possible interventions are offered. Concurrent validity, inter-rater and retest reliability were tested among 50 caregivers. Results The kappa values for the inter-rater reliability are predominantly excellent (kappa > 0.75). The values for the retest reliability show a wide range between excellent (kappa > 0.75) and fair agreement (kappa 0.40–0.60). The significant correlations found between summary scores of this new instrument and several sub-scales of the Family Problem Questionnaire support the assumption that the concurrent validity is satisfactory. Conclusion These results suggest that this instrument is both valid and reliable.     

WHOQOL-BREF as a measure of quality of life in older patients with depression

OBJECTIVE: To assess the reliability and validity of a brief measure of quality of life recently developed by the World Health Organization, the WHOQOL-BREF, and to examine its association with a variety of clinical and sociodemographic factors in older depressed patients. DESIGN: Cross-sectional study. METHODS: Older depressed patients (N=41) underwent diagnostic assessment using the Composite International Diagnostic Interview (CIDI) and were independently assessed on a variety of measures including the WHOQOL-BREF (a 26-item self-report questionnaire generating four domain scores), Hamilton Depression Rating Scale (HAM-D); Geriatric Depression Scale (GDS); Mini-mental State Examination (MMSE); Modified Barthel Index (MBI); Instrumental activities of daily living (IADL), and measures of physical health status and social relationships. Estimates of inter-rater and test-retest reliability, and concurrent validity were made. RESULTS: 39 subjects completed the study. The majority of subjects (94.9%) received a diagnosis of DSM-IV Major Depressive Disorder. Levels of comorbidity were high. Three of the four domains of the WHOQOL-BREF (Physical, Psychological and Environment domains) demonstrated satisfactory reliability and validity. However, the Social Relationships domain exhibited poor validity. Quality of life scores were strongly correlated with severity of depression, number of self-reported physical symptoms and self-assessed general health status. There was no relationship between diagnostic comorbidity and quality of life scores. CONCLUSIONS: The WHOQOL-BREF was successfully administered to older depressed patients although the concurrent validity of one of its four domains was poor. Quality of life scores were strongly correlated with severity of depression, raising the issue of measurement redundancy.     

Reliability and validity of the Greek version of the Derogatis Psychiatric Rating Scale (DPRS)

BACKGROUND: The aim of this paper is to report on the Greek version of the Derogatis Psychiatric Rating Scale (DPRS) and its validity and reliability when administered to a Greek sample. The DPRS is a clinician-rated measure of psychiatric symptoms with nine basic and eight complementary symptom dimensions and a Global Pathology Index. METHOD: The DPRS was translated into Greek and administered to 161 psychiatric patients and healthy volunteers. Its validity was assessed against the Semistructured Clinical Interview (SCID) and the Symptoms Checklist-90-Revised (SCL-90-R). The inter-rater reliability and test-retest reliability were also evaluated for each symptom dimension. RESULTS: All the symptom dimensions of the DPRS, except euphoria, have concurrent validity with the SCID on the relevant symptom dimensions diagnoses set by the interview. At the cut-off point 2/3 the DPRS has a sensitivity of 98% and a specificity of 74% in indicating active psychiatric patients. The symptom dimensions of the DPRS also have strong correlations with the relevant dimensions of SCL-90-R. The range for inter-rater reliability was from 0.48 to 0.88, the range for test-retest reliability was from 0.25 to 0.85, and the internal consistency was 0.90. CONCLUSION: The Greek version of the DPRS has acceptable psychometric properties, rendering it a useful screening instrument of global psychopathology as well as a multidimensional measure of some basic psychiatric symptoms.     

The stressful life events schedule for children and adolescents: development and validation

The development and psychometric properties of the Stressful Life Events Schedule (SLES), an interview instrument to assess stressors in children and adolescents, are described. Children (< or =12 years) and adolescents (>12 years) with psychopathology (n=30) and non-psychiatric controls (n=30) were interviewed with the SLES about the occurrence of stressful life events during the prior year. To examine concurrent validity of the SLES, all subjects also completed the self-report Life Events Checklist (LEC) and half the sample completed the Life Events and Difficulties Schedule (LEDS). To examine informant validity, the parent/guardian also reported on stressful life events occurring to their child during the year prior to interview. Test-retest reliability of the SLES was examined by re-assessing all children approximately one week after the initial interview. Subjects rated subjectively how stressful an event was on a 4-point scale. Additionally, panel ratings of objective stress and behavior-dependence/independence were made on 4-point scales. The SLES was found to have substantial inter-rater consensus reliability for objective threat (kappa=0.67) and almost perfect reliability for event behavior-dependence/independence (kappa=0.84). Similarly, the test-retest reliability of the SLES was also found to be substantial at the level of specific event comparisons (kappa=0.68). The SLES discriminated between children with and without psychopathology on all measures of stressful life events. Total stressful life events assessed with the SLES concurred well with those assessed by the LEC (ICC=0.83) and the LEDS (kappa=0.77) although, as expected, examination of specific events showed much smaller overlap between the SLES and the LEC (kappa=0.26). Child-parent agreement for the occurrence of severe events was substantial (kappa=0.73) but tended to be only moderate when all events were examined (kappa=0.48). The results of this study indicate that the SLES has good psychometric properties. The SLES is a useful, cost-effective tool for assessing stressful life events in children and adolescents.     

A semi-structured clinical interview for psychosis sub-groups (SCIPS): development and psychometric properties

Background

Clinical sub-groups of schizophrenia, namely drug related, traumatic, anxiety and stress sensitivity sub-types, have been proposed for use in research, training and practice. They were developed on the basis of clinical observation but have not yet been used in research or clinical practice to any great extent.

Aims

To develop a semi-structured clinical interview for psychosis sub-groups (SCIPS) and determine the best diagnostic criteria with the highest inter-rater reliability, test–retest reliability and concurrent validity for sub-grouping patients with schizophrenia according to a newly developed classification scheme.

Methods

The SCIPS was developed based upon discussion with the clinician researchers who had developed and were using the sub-groups. Kappa coefficients were calculated between two independent diagnostic assessments with the SCIPS (for inter-rater reliability and test–retest reliability, n?=?20) and between the SCIPS diagnosis and the sub-groupings as determined independently with highest achievable validity (for concurrent validity, n?=?21) for patients with schizophrenia. These inter-rater reliability and concurrent validity were compared among five different sets of diagnostic criteria to determine which was most reliable and valid.

Results

A set of diagnostic criteria with the highest inter-rater reliability and concurrent validity was determined. Kappa coefficients (95% confidence interval) for the inter-rater reliability and concurrent validity were 0.93 (0.66–1.20) and 0.73 (0.47–1.00), respectively, with these diagnostic criteria.

Conclusions

The SCIPS is a promising tool with which to sub-group patients with schizophrenia according to this recently developed classification scheme. The semi-structured interview achieves acceptable inter-rater and test–retest reliability and concurrent validity.