The Consumer Quality Index in an accident and emergency department: internal consistency,validity and discriminative capacity

Background

Patients’ experiences are an indicator of health‐care performance in the accident and emergency department (A&E). The Consumer Quality Index for the Accident and Emergency department (CQI A&E), a questionnaire to assess the quality of care as experienced by patients, was investigated. The internal consistency, construct validity and discriminative capacity of the questionnaire were examined.

Methods

In the Netherlands, twenty‐one A&Es participated in a cross‐sectional survey, covering 4883 patients. The questionnaire consisted of 78 questions. Principal components analysis determined underlying domains. Internal consistency was determined by Cronbach''s alpha coefficients, construct validity by Pearson''s correlation coefficients and the discriminative capacity by intraclass correlation coefficients and reliability of A&E‐level mean scores (G‐coefficient).

Results

Seven quality domains emerged from the principal components analysis: information before treatment, timeliness, attitude of health‐care professionals, professionalism of received care, information during treatment, environment and facilities, and discharge management. Domains were internally consistent (range: 0.67–0.84). Five domains and the ‘global quality rating’ had the capacity to discriminate among A&Es (significant intraclass correlation coefficient). Four domains and the ‘global quality rating’ were close to or above the threshold for reliably demonstrating differences among A&Es. The patients’ experiences score on the domain timeliness showed the largest range between the worst‐ and best‐performing A&E.

Conclusions

The CQI A&E is a validated survey to measure health‐care performance in the A&E from patients’ perspective. Five domains regarding quality of care aspects and the ‘global quality rating’ had the capacity to discriminate among A&Es.     

The alcohol-related problems survey: identifying hazardous and harmful drinking in older primary care patients

OBJECTIVES: Older adults can incur problems at low levels of alcohol consumption because of age-related physiological changes, declining health and functional status, and medication use. We have developed and tested a screening measure specifically for older people, the Alcohol-Related Problems Survey (ARPS), to identify older adults with these risks. DESIGN: Survey. SETTING: Academic and community primary care clinics. PARTICIPANTS: Five hundred forty-nine current drinkers aged 65 and older, mostly white with high school or more education. MEASURES: Alcohol use was classified as harmful, hazardous, or nonhazardous depending upon consumption alone or combined with selected comorbidities and medication use. Harmful drinking (including alcohol abuse or dependence) means the presence of problems (e.g., hypertension, adverse drug events, legal problems) due to drinking. Hazardous drinking means risks for problems are likely. Nonhazardous drinking poses no known risks for problems. RESULTS: Eleven percent of subjects were harmful drinkers and 35% were hazardous drinkers. Harmful drinking was more common in men than women and in persons younger than 75 than those aged 75 and older. Similar proportions of men and women and younger and older age groups were hazardous drinkers. Most harmful drinkers were identified by their use of alcohol with their comorbidity, whereas most hazardous drinkers were identified by their use of alcohol with medications. Test-retest reliability was substantial (kappa = 0.65). CONCLUSION: Physicians are urged to screen for alcohol-related problems in older persons. The ARPS reliably identifies harmful, hazardous, and nonhazardous drinking in older adults resulting most often from the interaction between alcohol and disease and medication use.     

Spinal cord injury pain

Spinal cord injury pain encompasses musculoskeletal and neuropathic pain. Its management is often multidisciplinary and involves specific drugs such as antidepressants and antiepileptics, and nonpharmacological treatment including psychotherapy, physical therapy and neuromodulation techniques. Recent progress in the diagnosis, assessment, and understanding of its mechanisms offers the perspective of a more rational therapeutic management, which should result in better therapeutic outcome.     

Evaluation of 3-Dimensional Exoscopes in Brain Tumor Surgery

ObjectiveThough the operating microscope (OM) has been the standard optical system in neurosurgery, a new technology called three-dimensional (3D) exoscope has emerged as an alternative. Herein, two types of 3D exoscopes for brain tumor surgery are presented. In addition, the advantages and limitations compared with the OM are discussed. MethodsIn the present study, 3D exoscope VOMS-100 or VITOM 3D was used in 11 patients with brain tumor who underwent surgical resection; the Kinevo 900 OM was used only in emergency. After completion of all surgeries, the participants were surveyed with a questionnaire regarding video image quality on the display monitor, handling of equipment, ergonomics, educational usefulness, 3D glasses, and expectation as a substitute for the OM. ResultsAmong 11 patients, nine patients underwent neurosurgical resection with only 3D exoscope; however, two patients required additional aid with the OM due to difficulty in hemostasis. Regarding video image quality, VITOM 3D was mostly equivalent to the OM, but VOMS-100 was not. However, both 3D exoscopes showed advantages in accessibility of instruments in the surgical field and occupied less space in the operating theater. Differences in ergonomics and educational usefulness between the exoscopes were not reported. Respondents did not experience discomfort in wearing 3D glasses and thought the exoscopes could be currently, and in the future, used as a substitute for the OM. ConclusionAlthough many neurosurgeons are not familiar with 3D exoscopes, they have advantages compared with the OM and similar image quality. Exoscopes could be a substitute for OM in the future if some limitations are overcome.     

Why Patients Visit Dentists – A Study in all World Health Organization Regions

ObjectiveThe dimensions of oral health–related quality of life (OHRQoL) Oral Function, Orofacial Pain, Orofacial Appearance, and Psychosocial Impact are the major areas where patients are impacted by oral diseases and dental interventions. The aim of this study was to evaluate whether dental patients' reasons to visit the dentist fit the 4 OHRQoL dimensions.MethodsDentists (N = 1580) from 32 countries participated in a web-based survey. For their patients with current oral health problems, dentists were asked whether these problems were related to teeth, mouth, and jaws' function, pain, appearance, or psychosocial impact or whether they do not fit the aforementioned 4 categories. Dentists were also asked about their patients who intended to prevent future oral health problems. For both patient groups, the proportions of oral health problems falling into the 4 OHRQoL dimensions were calculated.ResultsFor every 100 dental patients with current oral health problems, 96 had problems related to teeth, mouth, and jaws' function, pain, appearance, or psychosocial impact. For every 100 dental patients who wanted to prevent future oral health problems, 92 wanted to prevent problems related to these 4 OHRQoL dimensions. Both numbers increased to at least 98 of 100 patients when experts analyzed dentists' explanations of why some oral health problems would not fit the four dimension. For the remaining 2 of 100 patients, none of the dentist-provided explanations suggested evidence against the OHRQoL dimensions as the concepts that capture dental patients' suffering.ConclusionOral Function, Orofacial Pain, Orofacial Appearance, and Psychosocial Impact capture dental patients' oral health problems worldwide. These 4 OHRQoL dimensions offer a psychometrically sound and practical framework for patient care and research, identifying what is important to dental patients.     

Reliability and Validity of a Korean Version of the Leicester Cough Questionnaire

Purpose

There are no specific tools for measurement of the severity of chronic cough in Korea. We developed a Korean version of the Leicester Cough Questionnaire (LCQ) and tested its scaling and clinical properties.

Methods

The LCQ was adapted for Korean conditions following a forward-backward translation procedure. All patients referred to chronic cough clinics at 5 university hospitals between May 2011 and October 2013 completed 2 questionnaires, the LCQ and the Short-Form 36 (SF-36), upon presentation and completed the LCQ and the Global Rating of Change (GRC) upon follow-up visits after 2 or 4 weeks. Concurrent validation, internal consistency, repeatability, and responsiveness were determined.

Results

For the concurrent validation, the correlation coefficients (n=202 patients) between the LCQ and SF-36 varied between 0.42 and 0.58. The internal consistency of the LCQ (n=207) was high for each of the domains with a Cronbach''s alpha coefficient of 0.82-0.94. The repeatability of the LCQ in patients with no change in cough (n=23) was high, with intra-class correlation coefficients of 0.66-0.81. Patients who reported an improvement in cough (n=30) on follow-up visits demonstrated significant improvement in each of the domains of the LCQ.

Conclusions

The Korean version of the LCQ is a valid and reliable questionnaire for measurement of the severity of cough in patients with chronic cough.     

Uncontrolled Web-Based Administration of Surveys on Factual Health-Related Knowledge: A Randomized Study of Untimed Versus Timed Quizzing

Background

Health knowledge and literacy are among the main determinants of health. Assessment of these issues via Web-based surveys is growing continuously. Research has suggested that approximately one-fifth of respondents submit cribbed answers, or cheat, on factual knowledge items, which may lead to measurement error. However, little is known about methods of discouraging cheating in Web-based surveys on health knowledge.

Objective

This study aimed at exploring the usefulness of imposing a survey time limit to prevent help-seeking and cheating.

Methods

On the basis of sample size estimation, 94 undergraduate students were randomly assigned in a 1:1 ratio to complete a Web-based survey on nutrition knowledge, with or without a time limit of 15 minutes (30 seconds per item); the topic of nutrition was chosen because of its particular relevance to public health. The questionnaire consisted of two parts. The first was the validated consumer-oriented nutrition knowledge scale (CoNKS) consisting of 20 true/false items; the second was an ad hoc questionnaire (AHQ) containing 10 questions that would be very difficult for people without health care qualifications to answer correctly. It therefore aimed at measuring cribbing and not nutrition knowledge. AHQ items were somewhat encyclopedic and amenable to Web searching, while CoNKS items had more complex wording, so that simple copying/pasting of a question in a search string would not produce an immediate correct answer.

Results

A total of 72 of the 94 subjects started the survey. Dropout rates were similar in both groups (11%, 4/35 and 14%, 5/37 in the untimed and timed groups, respectively). Most participants completed the survey from portable devices, such as mobile phones and tablets. To complete the survey, participants in the untimed group took a median 2.3 minutes longer than those in the timed group; the effect size was small (Cohen’s r=.29). Subjects in the untimed group scored significantly higher on CoNKS (mean difference of 1.2 points, P=.008) and the effect size was medium (Cohen’s d=0.67). By contrast, no significant between-group difference in AHQ scores was documented. Unexpectedly high AHQ scores were recorded in 23% (7/31) and 19% (6/32) untimed and timed respondents, respectively, very probably owing to “e-cheating”.

Conclusions

Cribbing answers to health knowledge items in researcher-uncontrolled conditions is likely to lead to overestimation of people’s knowledge; this should be considered during the design and implementation of Web-based surveys. Setting a time limit alone may not completely prevent cheating, as some cheats may be very fast in Web searching. More complex and contextualized wording of items and checking for the “findability” properties of items before implementing a Web-based health knowledge survey may discourage help-seeking, thus reducing measurement error. Studies with larger sample sizes and diverse populations are needed to confirm our results.     

Validity of Internet-Based Longitudinal Study Data: The Elephant in the Virtual Room

Background

Internet-based data collection relies on well-designed and validated questionnaires. The theory behind designing and validating questionnaires is well described, but few practical examples of how to approach validation are available in the literature.

Objective

We aimed to validate data collected in an ongoing Internet-based longitudinal health study through direct visits to participants and recall of their health records. We demonstrate that despite extensive pre-planning, social desirability can still affect data in unexpected ways and that anticipation of poor quality data may be confounded by positive validation.

Methods

Dogslife is a large-scale, Web-based longitudinal study of canine health, in which owners of Labrador Retrievers were recruited and questioned at regular intervals about the lifestyle and health of their dogs using an Internet-based questionnaire. The Dogslife questionnaire predominantly consists of closed-answer questions. In our work, two separate validation methodologies were used: (1) direct interviews with 43 participants during visits to their households and (2) comparison of owner-entered health reports with 139 historical health records.

Results

Our results indicate that user-derived measures should not be regarded as a single category; instead, each measurement should be considered separately as each presents its own challenge to participants. We recommend trying to ascertain the extent of recall decay within a study and, if necessary, using this to guide data collection timepoints and analyses. Finally, we recommend that multiple methods of communication facilitate validation studies and aid cohort engagement.

Conclusions

Our study highlighted how the theory underpinning online questionnaire design and validation translates into practical data issues when applied to Internet-based studies. Validation should be regarded as an extension of questionnaire design, and that validation work should commence as soon as sufficient data are available. We believe that validation is a crucial step and hope our suggested guidelines will help facilitate validation of other Internet-based cohort studies.