Development and psychometric testing of the Clinician Readiness for Measuring Outcomes Scale

Background If allied health professionals are to begin measuring outcomes routinely, a change in attitudes and behaviour is necessary. However, individuals need to be ready to change and often move through several stages before practice change is observed. Aim To develop and test the psychometric properties of a questionnaire that determines clinicians' readiness to measure outcomes. Methods A study of instrument development, validation and reliability. Ten expert allied health professionals were involved in content validity testing. A further 396 allied health professionals completed the questionnaire to establish content and construct validity, internal consistency and temporal reliability (or stability). Of these 396 allied health professionals, 70 participated in the temporal reliability assessment. Content validity was established using the Content Validity Index (CVI). Construct validity was determined using confirmatory factor analysis (CFA) and internal consistency was ascertained using Cronbach's alpha. Temporal reliability was confirmed using intraclass correlation coefficients (ICC 3,1). Results A 30‐item questionnaire was developed, reflecting the five stages of change from the Transtheoretical Model of Change, and commonly cited barriers to outcome measurement. Content validity was excellent (CVI = 0.96). Using CFA, a two‐factor model provided best fit. Based on CFA results, four items were dropped resulting in a 26‐item questionnaire (range 26–156). Internal consistency reliability was excellent (α = 0.94). Temporal (stability) reliability ICC (3,1) was very good (r = 0.86, P = 0.0001). Conclusions The final 26‐item questionnaire takes 10 minutes to complete and 5 minutes to score. The Clinician Readiness for Measuring Outcomes Scale provides educators with useful information about clinician readiness and helps identify strategies for affecting behaviour change.     

Design and validation of a questionnaire for psychosocial nursing diagnosis in Primary Care

AimTo develop a valid, reliable and easy-to-use questionnaire for a psychosocial nursing diagnosis.MethodThe study was performed in two phases: first phase, questionnaire design and construction; second phase, validity and reliability tests. A bank of items was constructed using the NANDA classification as a theoretical framework. Each item was assigned a Likert scale or dichotomous response. The combination of responses to the items constituted the diagnostic rules to assign up to 28 labels. A group of experts carried out the validity test for content. Other validated scales were used as reference standards for the criterion validity tests. Forty-five nurses provided the questionnaire to the patients on three separate occasions over a period of three weeks, and the other validated scales only once to 188 randomly selected patients in Primary Care centres in Tenerife (Spain).ResultsValidity tests for construct confirmed the six dimensions of the questionnaire with 91% of total variance explained. Validity tests for criterion showed a specificity of 66%-100%, and showed high correlations with the reference scales when the questionnaire was assigning nursing diagnoses. Reliability tests showed agreement of 56%-91% (P<.001), and a 93% internal consistency. The Questionnaire for Psychosocial Nursing Diagnosis was called CdePS, and included 61 ítems.ConclusionsThe CdePS is a valid, reliable and easy-to-use tool in Primary Care centres to improve the assigning of a psychosocial nursing diagnosis.     

护士公众形象评价问卷编制及信效度检测

目的 编制适用于调查我国护士公众形象评价的问卷,并检测其信效度.方法 以班杜拉的"社会认知理论"为问卷概念框架,采用两轮专家函询法确定问卷初始条目,通过对203名社会公众进行预调查检测条目的信效度.结果 最终形成的问卷包含33个条目,其中23个条目为量表型条目,10个条目为非量表型选择题条目.非量表型各条目内容效度指数...     

Psychometric properties of the Swedish version of the selection,optimization, compensation questionnaire

Scand J Caring Sci; 2013; 27; 460–467 Psychometric properties of the Swedish version of the selection, optimization, compensation questionnaire Background: The model of selection, optimization and compensation has been proposed as a model of adaptive management strategies throughout the lifespan. Aim: The aim of this study was to test the psychometric properties of a translated Swedish version of the 12‐item selection, optimization, and compensation (SOC) questionnaire. Method: The 12‐item SOC questionnaire is composed of four subscales: elective selection (ES), loss‐based selection, optimization and compensation. A convenience sample of 122 Swedish‐speaking people, aged 19–85, participated in a study of the validity and reliability of the SOC questionnaire. Cronbach’s alpha coefficient, corrected item–total correlation and Cronbach’s alpha if item deleted were used for reliability testing. Two other scales, the ways of coping questionnaire and Rosenberg’s self‐esteem scale, were used to test convergent validity, and the geriatric depression scale was used to test discriminant validity. Stability over time was evaluated using a test–retest model with a 2‐week interval. Results: The 12‐item SOC questionnaire showed a Cronbach’s alpha value of 0.50, and the subscales ranged from α = 0.16 to α = 0.64. Two items in the ES subscale had negative values on the corrected item–total correlation and showed substantial improvement (>0.05) in Cronbach’s alpha when item deleted. When these two items that influenced internal consistency were deleted, Cronbach’s alpha rose to 0.68. Conclusion: The Swedish version of the 12‐item SOC questionnaire showed deficiencies in a test of internal consistency because of two items in the ES subscale, and these two items were deleted. A consequence of the reduction is a weakening of the ES subscale and thereby to some extent the SOC questionnaire in total. Further testing is advisable. However, the 10‐item SOC questionnaire was acceptable in a test of validity and reliability.     

Modifying a generic postoperative recovery profile instrument to an instrument specifically targeting coronary artery bypass grafting

Patients may suffer from a wide range of postoperative symptoms after coronary artery bypass grafting. In‐depth knowledge of the recovery process is a prerequisite for nursing interventions. However, we found no specific instrument covering the entire range and duration of postoperative symptoms related to this procedure. We therefore modified and extended the 19 items, generic Postoperative Recovery Profile questionnaire for the specific evaluation of the recovery after coronary artery bypass grafting. We here report on the development process of the new questionnaire. Procedure‐specific symptoms were identified by a literature review and by experts. The content validity was assessed by healthcare professionals (n = 15), inpatients (n = 12) and outpatients (n = 4). A test run was done with inpatients (n = 10), which was followed by a test–retest reliability evaluation with inpatients (n = 24). We identified 15 new symptoms in the literature review and six in the content validity assessment. Only three of the 35 items had an acceptable content validity index, but all 35 items in the test run were reported by at least two patients. The questionnaire took 4–9 minutes to complete and was considered easy to use. The final instrument used in the reliability test included 22 new items, and 25 of the 35 items were satisfactory stable. To conclude, we developed a 35 items, procedure‐specific questionnaire that was easy to use and may aid systematic assessment of the recovery after coronary artery bypass grafting.     

疼痛共情量表的汉化及其在医学生中的信效度检验

目的引进并汉化疼痛共情量表(the Empathy for Pain Scale,EPS),检验中文版EPS在医学生中的信效度。方法经过翻译、回译、语义分析、专家咨询及文化调试,最终确定中文版EPS条目。于2018年6—10月,采用便利抽样法,选取531名在校本科生进行问卷调查。采用相关分析法和临界比值法进行项目分析,采用内容效度、结构效度、效标关联效度进行量表的效度检验,计算Cronbach'sα系数、折半信度检验量表的内在一致性。结果中文版EPS保留原12个条目,析出2个因子,2个因子命名为身心不适反应和移情反应,累计方差贡献率为69.059%。量表各条目的内容效度为0.83~1.00,总内容效度为0.94。中文版EPS总分与中文版人际反应指针量表(IRI-C)得分呈正相关(r=0.370,P<0.01);量表的Cronbach'sα系数为0.914,身心不适反应、移情反应2个维度的Cronbach'sα系数分别为0.935和0.775,量表的折半信度为0.896。结论中文版EPS包含4个场景、2个维度,具有良好的信效度,可用于测量我国医学生的疼痛共情水平。     

Development of a 32-item scale to assess postoperative dysfunction after upper gastrointestinal cancer resection

Aim. The purpose of this study was to develop a 32‐item scale to assess postoperative dysfunction in patients who underwent surgery for gastric and oesophageal cancer and to evaluate its reliability and validity. Background. For the objective assessment of postoperative dysfunction in patients with upper gastointestinal cancer, we performed a preliminary survey by mail using a 34‐item questionnaire as a initial version. The results of the survey were assessed by item analysis of the scale. The scale items were further refined by researchers and specialists, and a 32‐item scale for the assessment of postoperative dysfunction (initial scale) was developed. Methods. Using this 32‐item scale (initial scale), a mail survey was performed of 379 subjects selected by random sampling. Results. The questionnaire was returned by 292 patients (77·1%) and 283 responses (74·7%) were valid. Of these, 221 respondents had gastric cancer and 62 oesophageal cancer. The mean age of respondents was 64·9 SD 9·8 (range 35–89) years. The mean total score of the 32‐items on the initial version for the assessment of postoperative dysfunction was 60·8 SD 16·7. The mean total score for gastric cancer patients and oesophageal cancer patients was 58·1 SD 15·8 and 70·1 SD 16·7 respectively. After the elimination of scale items regarded as irrelevant based on statistical considerations and the judgement of experts, factor analysis was performed. Seven factors were valid: ‘regurgitation reflux’, ‘limited activity because of decreased food consumption’, ‘passage dysfunction immediately after eating’, ‘dumping‐like symptoms’, ‘transfer dysfunction’, ‘hypoglycaemic symptoms’ and ‘diarrhoea‐like symptoms’. The cumulative proportion of variance by scale reliability was confirmed by a Cronbach's α‐coefficient of 0·926. The Cronbach's α‐coefficient for all 32 items on the initial version was 0.926, the Cronbach's α‐coefficient for sub‐items was 0·705–0·856, and Pearson's correlation coefficient of re‐test for the total score of the 32 items was 0·865, which confirmed a high degree of internal consistency. The construct validity of the scale was confirmed using the known‐group technique by operative procedures, and from the result of factorial validity. This scale was named ‘Postoperative Dysfunction for Upper Gastrointestinal Cancer 32; PODUGC‐32’. Conclusion. This scale is sufficiently reliable and valid and will be useful clinically. Relevance to clinical practice. We can use the new scale to assess postoperative dysfunction in patients with upper gastointestinal cancer for nursing practice.     

Evaluation of the psychometric properties of the Korean version of the Cultural Competence Assessment

Aim

The 25 item Cultural Competence Assessment assesses the cultural competence of multiple types of healthcare providers. This study aimed to examine the validity and reliability of the Korean version of the questionnaire (KCCA) and to determine the need for changes to improve its validity and reliability.

Methods

Data from 161 hospital nurses were used for the item analysis and to assess the reliability and construct validity of the KCCA before and after the deletion of nine items.

Results

The KCCA did not demonstrate acceptable construct validity and subscale internal reliability. Nine items with high interitem correlations, high modification indices, and relatively lower factor loadings were deleted. The 16 item Modified KCCA showed improved construct validity, convergent and discriminant validity, and reliability.

Conclusion

While further psychometric evaluation of the Modified KCCA should be undertaken with larger samples and diverse professionals, the study's data provide evidence that the Modified KCCA might be a more suitable measure for use among Korean healthcare providers.     

产妇产后需求问卷的信效度检验

目的 初步研制适合评估我国产妇产后需求的问卷,并对其进行信效度检验。方法 通过问卷条目编制、三轮的专家函询、预试验,最终形成初版问卷,且在342名顺产产妇中进行信效度评价。结果 问卷共有31个条目、4个维度（生理需求6个条目,心理需求9个条目,环境及设备需求4个条目,服务需求12个条目）。该问卷的Cronbach’sα系数为0.952,分半信度为0.940,各维度的Cronbach’sɑ系数均>0.8,内容效度指数（CVI）=0.943。探索性因子分析结果表明,各条目的因子最大负荷值均>0.4,主成分分析可提取4个公因子,累积方差贡献率为59.123%,各维度与总分间的相关系数为0.719～0.798(P<0.01)。结论 产妇产后需求问卷经初步检验有较好的信、效度,可作为顺产产妇产后需求的调查工具。     

糖尿病眼科随访依从性问卷的汉化及信效度检验

目的:编译中文版糖尿病眼科随访依从性问卷并评价其信效度。方法:按Brislin翻译模型将英文版糖尿病眼科随访依从性问卷译成中文并进行文化调适。采用便利抽样法,于2019年6—12月抽取广州市某医联体内287例糖尿病患者进行问卷调查,对中文版问卷进行内容效度、结构效度、内部一致性、校标效度和重测信度的检验。结果:提取出5个公因子,共含25个条目,累计方差贡献率为62.878%,问卷及其各维度间呈正相关。问卷总的Cronbach'sα系数为0.902;问卷总分及各维度得分与校标的相关系数为0.472~0.658(P<0.01);问卷及其各维度的重测信度系数为0.813~0.917(P<0.01)。结论:中文版糖尿病眼科随访依从性问卷具有良好的信度和效度,条目内容与理论框架契合度较好,可用于我国糖尿病患者眼科随访依从性的测量。     

Validation and test–retest reliability of the Risser patient satisfaction scale in Cyprus

charalambous a. (2010) Journal of Nursing Management   18 ,61–69
Validation and test–retest reliability of the Risser patient satisfaction scale in Cyprus
Aim  To describe the translation, adaptation and validation of the Risser Patient Satisfaction Scale (RPSS) questionnaire into Greek language and discuss possibilities of its use in cancer care settings.
Background  The translation and cultural adaptation of a widely accepted, psychometrically tested tool is regarded as an essential component of effective human resource management or quality monitoring and improvement in the healthcare arena.
Methods  The original version of the English self-administered questionnaire consisting of 25 items was translated and validated using the internationally accepted and recommended methodology. The validation process included: assessment of the item internal consistency, using the alpha coefficient of Cronbach. Reproducibility (test–retest reliability) was tested by the Kappa correlation coefficient.
Results  The psychometric properties of the Greek version of the PSS were good. The internal consistency of the instrument was very good, Cronbach's alpha was found to be 0.89 ( P  < 0.001) and Kappa coefficient for reproducibility was found to be 0.84 (95% CI: 0.83–0.85, P  < 0.0001).
Conclusions  The translated and adapted Greek version is comparable with the original instrument in terms of validity and reliability.
Implications for nursing management  Managers should use validated patient satisfaction scales such as the RPSS in order to evaluate the quality of care in cancer care departments. The findings should be also compared using a bench mark on national and international levels.     

《临床不良事件上报知信行问卷》编制及其信效度检验

  目的  编制不良事件上报知信行问卷, 并评价其信度和效度。  方法  采用知信行理论为问卷构架, 在文献阅读、医护人员和专家访谈的基础上初步编制不良事件上报知信行问卷; 随机抽取北京协和医院医护人员进行问卷调查。以Cronbach'α系数检验内部一致性信度, 以内部相关系数(intraclass correlation coefficient, ICC)检验重测信度, 以内容效度指数(content validity index, CVI)检验内容效度, 探索因子分析检验结构效度, 以问卷得分的高分组和低分组之间的独立样本t检验评价区分效度。  结果  回收有效问卷130份; 各维度及总问卷的Cronbach'α系数均 > 0.6;各条目ICC系数均 > 0.75;各维度CVI系数均 > 0.9;因子分析共提取5个公因子, 累计方差贡献率61.8%, 各条目的共性方差均>0.4;高分组和低分组得分差异具有统计学意义(P < 0.01)。  结论  《临床不良事件上报知信行问卷》具有理想的信度和效度, 可作为不良事件上报现状的调研工具。     

早产儿出院后父母应对能力问卷的编制及信度效度检验

目的:编制并评价早产儿出院后父母应对能力问卷。方法:运用文献分析法、半结构访谈法和德尔菲专家函询法形成初始问卷,采用方便抽样法选取257例早产儿父母进行调查,采用项目分析、相关性分析、探索性因子分析、内容效度、结构效度、内在一致性信度、折半信度对问卷进行评价。结果:初步形成55个条目的初始问卷,经问卷测评后删除15个条目;探索性因子分析提取了8个共同因子,累积解释变异量为59.864%;提取的共同因子作为问卷维度,分别为早产儿照护技能、父母角色适应、亲子关系、家庭功能、积极应对、消极应对、外界支持、早产儿保健知识;整个问卷的Cronbach’sα系数为0.916、折半信度为0.845,各维度的Cronbach’sα系数为0.724~0.906,折半信度为0.712~0.897;问卷整体的内容效度指数(S-CVI)为0.946,问卷各条目的内容效度指数(I-CVI)为0.824~1.000,校正后的Kappa值为0.823~1.000。结论:早产儿出院后父母应对能力问卷信度、效度良好,可作为评价我国早产儿出院后父母应对能力的工具,能在一定程度上反映早产儿父母院外存在的问题与困惑,为早产儿延续性护理实施方案的制定与评价提供参考。     

Scale development of job stress for home care nurses

The purpose of this study was to develop a job stress scale for hospital-based home care nurses in Korea. The process was construction of the conceptual framework, development of the preliminary items, verification of the content validity, item analysis and test of the reliability. The preliminary items were based on literature review and in-depth interviews with home care nurses. As a result, eight categories and sixty items were selected. These were reviewed by seven specialists for content validity and finally fifty one items were chosen. Data was collected from 180 home care nurses who were engaged in 87 hospitals from August to September 2003. The result of item analysis one was excepted. The final item count was 50. Categories were as follows: overload work (8 items), lack of specialized knowledge and technique (5 items), ethical dilemma (4 items), role conflict (5 items), interpersonal relationships (6 items), visiting home environment (9 items), driving conditions (4 items) and lack of administrative support (9 items), The reliability of the scale by Cronbach's alpha was .948 and the domain's reliability ranged from .649 to .841. The result of this study could be used to measure the job stress of home care nurses. However, for further validity and reliability, repeated studies will be necessary.     

Measuring personal recovery in people with a psychotic disorder based on CHIME: A comparison of three validated measures

Living well in spite of residual symptoms of mental illness is measured with the construct of personal recovery. The CHIME framework might be suitable to evaluate personal recovery measures and guide instrument choice. Three validated measures were evaluated in Dutch patients with a psychotic disorder (N = 52). We compared the Recovery Assessment Scale (RAS), the Mental Health Recovery Measure (MHRM), and the Netherlands Empowerment List (NEL). The measures were assessed on six criteria: content validity (based on CHIME), convergent validity with a social support measure, internal consistency, floor and ceiling effects, item interpretability, and ease of administration. The MHRM scored high on content validity with a balanced distribution of items covering the CHIME framework. The MHRM and the NEL showed moderate convergent validity with social support. In all three measures, internal consistency was moderate and floor and ceiling effects were absent. The NEL scores demonstrated a high degree of item interpretability. Ease of administration was moderate for all three measures. Finally, the CHIME framework demonstrated good utility as a framework in guiding instrument choice and evaluation of personal recovery measures. The MHRM showed the best overall result. However, differences between measures were minimal. Generalization of the results is limited by cultural and linguistic factors in the assessment for the subjective measures (i.e. content validity and item interpretability). The broad and multidimensional construct of personal recovery might lead to ambiguous interpretations. Scientific consensus on a well‐defined personal recovery construct is needed.     

中国老年人休闲活动调查问卷的编制及信效度检验

目的:初步编制适合中国老年人的休闲活动调查问卷,并进行信效度检验.方法:通过查阅文献确定中国老年人常见的休闲活动类型及维度,并通过专家函询进行初步的条目筛选,通过5名课题组成员和14名老年人对各条目在3个维度的权重评分对比形成共识评分,经过小样本预调查后确定问卷初稿,运用问卷初稿对252名社区老年人进行问卷调查,测定问...     

Self-efficacy of caring for patients in the intensive care unit with delirium: Development and validation of a scale for intensive care unit nurses

BackgroundImproving the self-efficacy of intensive care unit nurses for delirium care could help them adapt to the changing situation of delirium patients. Validated measures of nurses' self-efficacy of delirium care are lackingObjectivesThe objective of this study was to develop a Delirium Care Self-Efficacy Scale for assessing nurses' confidence about caring for patients in the intensive care unit and to examine the scale's psychometric properties.MethodsDraft scale items were generated from a review of relevant literature and face-to-face interviews with intensive care unit nurses; content validity was conducted with a panel of five experts in delirium. A group of nurses were recruited by convenience sampling from intensive care units (N = 299) for item analysis of the questionnaire, assessment of validity, and reliability of the scale. Nurse participants were recruited from nine adult critical care units affiliated with a hospital in Taiwan. Data were collected from August 2020 to July 2021.ResultsContent validity index was 0.98 for the initial 26 items, indicating good validity. The critical ratio for item discrimination was 14.47–19.29, and item-to-total correlations ranged from 0.67 to 0.81. Principal component analysis reduced items to 13 and extracted two factors, confidence in delirium assessment and confidence in delirium management, which explained 66.82% of the total variance. Cronbach's alpha for internal consistency was 0.94 with good test–retest reliability (r = 0.92). High scale scores among participants were significantly associated with age (≥40 years), work experience in an intensive care unit (≥10 years), delirium education, and willingness to use delirium assessment tools.ConclusionsThe newly developed Delirium Care Self-Efficacy Scale demonstrated acceptable reliability and validity as a measure of confidence for intensive care nurses caring for and managing patients with delirium in the intensive care unit.     

Development of the nursing practice scale for end-of-life family conferences in critical care

ObjectivesThis study aimed to develop the Nursing Practice Scale for End-of-life Family conferences in critical care and to clarify the current status of nursing practice regarding family conferences.Research methodology/designWe conducted a cross-sectional, self-administered questionnaire survey with 955 critical care unit nurses in 97 hospitals. Content validity, factor validity and criterion-related validity, known-group validity, internal consistency and test–retest reliability were evaluated. Data were then analysed statistically.SettingAdult intensive care units or high dependency units in Japan.ResultsThree factors with 39 items were extracted through item analysis and confirmatory factor analysis as hypothesised (Factor 1: Preparation, Factor 2: Discussion and Factor 3: Follow-up), and the mean score per item for each factor was 3.57, 3.73 and 3.75, respectively. Nurses who had any certification or had worked in critical care unit for >5 years had a significantly greater score than the others. The Cronbach’s α were 0.86–0.96 and the intraclass correlation coefficients were 0.79–0.87.ConclusionThe Nursing Practice Scale for End-of-life Family conferences in critical care is a valid and reliable scale. This study could effectively facilitate communication among patients, their families and healthcare providers.