基于经典测量理论与项目反应理论的药物成瘾生命质量测定量表QLICD-DA（V2.0）条目分析

目的 运用经典测量理论（CTT）和项目反应理论（IRT）对药物成瘾生命质量测定量表QLICD-DA（V2.0）的条目进行进一步分析。方法 采用QLICD-DA（V2.0）对192名药物成瘾患者进行调查,利用IRT中的Samejima模型计算每个条目的平均信息量、区分度和难度系数,并结合CTT中的克朗巴赫法、变异度法、相关系数法和因子分析法四种统计方法对条目进行分析。结果 在IRT分析中,除了条目GPH1、GPH2、GPH3、GPH4、GPH5、GPH9,其余条目平均信息量都大于0.11,区分度0.79~2.30,难度系数都在-5.07~3.38,且随难度等级（B1→B4）增加而单调递增;在CTT分析中一共有28条目均满足3种及以上的统计方法要求,结合CTT和IRT共选出39个条目。结论 QLICD-DA（V2.0）的大部分条目性能良好,但仍有部分条目需要进一步评价和修订。     

基于经典测量理论与项目反应理论的消化性溃疡生命质量测定量表QLICD-PU(V2.0)条目分析

目的 运用经典测量理论与项目反应理论对消化性溃疡患者生命质量量表QLICD-PU(V2.0)的条目进行分析与评价,为量表的改进与完善提供依据。方法 应用QLICD-PU(V2.0)对170例消化性溃疡患者进行测评,采用经典测量理论中的变异度法、相关系数法、因子分析法、克朗巴赫系数法,同时应用项目反应理论中的Samejima等级反应模型计算每个条目的难度、区分度系数和信息量,来评价QLICD-PU(V2.0)量表条目的质量。结果 经典测量理论结果提示QLICD-PU(V2.0)共性模块中变异法计算在总的41个条目中条目标准差小于0.90的有7个; 在总的41个条目中有9个条目与其所在领域的相关性比较低; 项目反应理论结果显示所有条目的区分度较好,取值范围均在1.01～1.69; 在总的41个条目中33个条目的难度系数取值范围在-3.94～3.70,且随着难度等级(B1→B4)的增加呈现出单调递增的趋势; 共性模块条目的平均信息量均较好,特异模块的平均信息量不太理想。结论 QLICD-PU(V2.0)量表所有条目区分度,大部分条目的难度以及共性模块平均信息量比较好,量表具较好的信度,但仍然有部分条目有待进一步修订并验证效果。     

基于经典测量理论与项目反应理论的宫颈癌生命质量测定量表QLICP-CE（V2.0）条目分析

目的 应用 CTT 与 IRT 两种分析理论对宫颈癌患者生命质量量表（QLICP-CE V2.0）的条目进行分析与评价。 方法 通过应用 QLICP-CE（V2.0）对 186 例宫颈癌病人进行测评,采用经典测量理论 CTT 中的四种统计方法（变异度法、相关系数法、因子分析法、克朗巴赫系数法）来评价条目质量的好坏。同时采用项目反应理论IRT中的 Samejima 等级反应模型计算每个条目的难度、区分度系数和信息量。 结果 CTT 分析结果提示 QLICP-CE（V2.0）共性模块中有 9 个条目与其所在领域的相关性比较低,而特异模块中有3个。IRT结果显示所有条目的区分度较好,取值范围均在0.64～1.33;44个条目中有35个条目的难度系数取值范围在-3.49～3.76,且随着难度等级（B1→B4）的增加呈现出单调递增的趋势;除 3 个条目外所有条目的平均信息量均较好。 结论 QLICP-CE（V2.0）量表所有条目区分度比较好,大部分条目的性能良好,但仍然有少部分条目有待进一步修订并验证效果。     

基于经典测量理论与项目反应理论的慢性肺源性心脏病生命质量测定量表QLICD-CPHD(V2.0)条目分析

目的 应用经典测量理论(classical test theory, CTT)和项目反应理论(item response theory, IRT)对慢性肺源性心脏病生命质量测定量表[QLICD-CPHD(V2.0)]进行条目分析与评价。方法 采用QLICD-CPHD(V2.0)量表对184名慢性肺源性心脏病患者进行调查,运用经典测量理论中的相关系数法、变异度法、因子分析法、克朗巴赫系数法对QLICD-CPHD(V2.0)量表的条目进行分析评定,同时运用项目反应理论中的Samejima等级反应模型计算量表每个条目的难度、信息量和区分度系数。结果 CTT结果提示存在7个条目不满足至少3种的统计学要求,其中共性模块6个,特异模块1个。IRT结果显示条目区分度范围为1.18～1.44较为适宜。难度系数随难度等级(B1→B4)增加而单调递增,存在部分条目难度系数b超过标准值范围。各条目平均信息量分布在0.185～0.576。结论 经CTT与IRT分析,QLICD-CPHD(V2.0)量表的大部分条目质量较高,具有较好的区分度,但仍有少量条目需进一步分析和修订。     

基于经典测量理论与项目反应理论的老年COPD患者多维健康测定量表条目分析

目的对MHIEC-COPD测试版量表的条目再次分析和筛选,以便形成正式版量表MHIEC-COPD(V1.0)。方法采用测试版老年COPD患者多维健康测评量表,对451例60岁及以上老年COPD患者进行调查。采用项目反应理论IRT中的塞姆吉玛等级反应模型计算每个条目的难度、区分度系数,并结合经典测量理论CTT的四种统计方法来评价条目。结果除共性模块中4个条目(GPH4、GPH9、GPS1、GSO4)外,其余条目3种CTT统计分析均入选。各条目的区分度均在1.00～1.39,所有条目的难度系数均在-5.12～4.49,且随难度等级(B1→B4)增加单调递增。最后结合专家讨论,从21个条目中选出16个条目组成正式版量表ECMH-COPD(V1.0)。结论按严格的程序选出16个条目质量较高具有较好的代表性,其中共性模块9条,特异模块7条。     

慢性病生命质量量表共性模块项目反应理论分析

目的 运用项目反应理论(IRT)对慢性病患者生命质量测定量表共性模块(QLICD-GM)条目进行分析,筛选信息量较高条目.方法 应用QLICD-GM测评7种慢性病患者620例,采用塞姆吉玛等级反应模型计算每个条目的难度、区分度系数和信息量,绘制项目特征曲线;根据平均信息量筛选条目;采用MULTILOG 7.0软件进行计算和作图.结果 QLICD-GM共性模块29个条目的区分度均为1.2～1.9;难度(程度)均呈严格单调递增,取值范围为-3.05 ～2.18;依据平均信息量,结合条目特征筛选保留24个条目.结论 QLICD-GM各条目区分度均较好、选项设置合理、难度合适,分析模型选择正确;项目反应理论可筛选出信息量较高条目,弥补经典测量理论(CTT)的不足.     

基于项目反应理论的中国职业人群职业紧张测量核心量表条目分析

目的 利用项目反应理论（item response theory,IRT）对《中国版职业紧张核心量表》质量进行分析与评价,为后期量表使用和修订提供参考依据。方法 采用方便抽样方法,抽取湖北省两家三甲医院和多家一、二级医院共1261名医务人员作为研究对象,应用《中国版职业紧张核心量表》调查其职业紧张情况。采用主成分分析验证量表4个维度的单维性。采用IRT中的Same Jima等级反应模型计算每个条目的区分度、难度系数和信息量,从微观角度评价量表的测量特性。结果 量表4个维度均满足单维性假设。IRT结果显示所有条目的区分度较好,取值范围在0.67~3.10;17个条目中有13个条目的难度系数在-2.78~2.30之间,且不存在难度逆反现象,条目9和11难度过高且难度逆反,条目15和16难度过低过高并存且有难度逆反现象,提示待改进;除了条目9、11和15提供的信息量中等,条目16和17提供的信息量较差以外,其余条目的信息量均较好。结论 《中国版职业紧张核心量表》所有条目的区分度较好。从难度系数和信息量两个角度,条目9、11、15、16、17的测验质量均是有待改进的,其余条目性能良好,建议针对上述分析结果结合专家意见对问题条目进行修订。     

慢性病生命质量量表中慢性胃炎量表研制

目的 研制慢性病患者生命质量测定量表体系之慢性胃炎量表(QLICD-CG),并对其信度进行考评.方法 采用共性模块和特异模块相结合的方式,经过文献回颐、核心小组讨论、重要性评分、统计筛选等过程研制量表;通过124名慢性胃炎患者的测定计算内部一致性系数α、重测相关系数r来反映量表的信度.结果 慢性病患者生命质量测定量表之慢性胃炎量表[QLICD-CG(V1.0)].其共性模块(QLICD-GM)含30个条目,慢性胃炎特异模块包含5个亚领域14个条目,总量表及各领域的内部一致性系数α、分半信度和重测相关系数分别为:总量表0.892,0.733,0.98;躯体功能0.784,0.851,0.958;心理功能0.878,0.891,0.99;社会功能0.686,0.678,0.955;慢性胃炎特异模块0.728,0.799,0.97.结论 QLICD-CG(V1.0)具有较好的信度和可行性.     

慢性病患者生命质量测定量表共性模块的难度与区分度再次评价

目的用经典测量理论(Classical test theory,CTT)分析慢性病患者生命质量测定量表体系共性模块(QLICD-GM)每个条目的难度与区分度。方法调查8种慢性病的1024例患者,采用经典测量理论计算每个条目的难度、区分度系数,采用SPSS软件进行计算和作图。结果共性模块条目难度适中,不是太难也不是太简单。条目的区分度总体适中,但是个别条目区分度过低,比如生理领域的条目PH2、PH6、PH7,需要对条目加以考虑。结论慢性病患者生命质量测定量表体系共性模块具有较好的难度和区分度,可以作为我国慢性病患者生命质量的测评工具,但QLICD-GM(V1.0)的理论结构还有待进一步补充完善。     

慢性病患者生命质量测定量表体系共性模块的难度与区分度分析

[目的]用项目反应理论分析慢性病患者生命质量测定量表体系共性模块(QLICD-GM)每个条目的难度与区分度。[方法]用QLICD-GM量表对8种慢性病1024名患者进行测试,采用项目反应理论中的塞姆吉玛等级反应模型计算每个条目的难度、区分度系数,采用MULTILOG软件进行计算和作图。[结果]30个条目的区分度都在1.17～1.88之间,每个条目从1～4级呈单向递增,难度参数为-2.88～2.27。[结论]慢性病患者生命质量测定量表体系共性模块具有较好的难度和区分度,均不存在逆反阈值,可以作为我国慢性病患者生命质量的测评工具。     

老年人社会支持行为量表简化版的研制

目的 研制老年人社会支持行为量表（the social support behaviors scale,SSB-31）的简化版,并对其进行评价。方法通过整群随机抽样的方法抽取东莞市1 130名符合纳入标准的老年人进行一对一访问调查,随机抽取565名被调查者作为训练样本,利用经典测量理论和项目反应理论对老年人社会支持行为量表（SSB-31）进行简化版量表的研制,剩余565名被调查者作为考核样本,评价简化版量表的心理测量学特性。结果 经训练样本分析,最终建议或指导维度保留6个条目,情感支持维度保留5个条目,社会化维度保留3个条目,实际援助维度保留7个条目,形成21个条目的老年人社会支持行为量表简化版（SSB-21）。考核样本结果显示,SSB-21的Cronbach α系数为0.958,各维度Cronbachα系数在0.871～0.911之间;验证性因子分析模型拟合显示卡方自由度为4.212,比较拟合指数为0.934,增值适配指数为0.934,拟合优度指数为0.877,非标准适配指标为0.924,渐进残差均方和平方根为0.075,残差均方和平方根为0.039;项目反应理论结果显示,区分度在2...     

A primer on classical test theory and item response theory for assessments in medical education

Context A test score is a number which purportedly reflects a candidate’s proficiency in some clearly defined knowledge or skill domain. A test theory model is necessary to help us better understand the relationship that exists between the observed (or actual) score on an examination and the underlying proficiency in the domain, which is generally unobserved. Common test theory models include classical test theory (CTT) and item response theory (IRT). The widespread use of IRT models over the past several decades attests to their importance in the development and analysis of assessments in medical education. Item response theory models are used for a host of purposes, including item analysis, test form assembly and equating. Although helpful in many circumstances, IRT models make fairly strong assumptions and are mathematically much more complex than CTT models. Consequently, there are instances in which it might be more appropriate to use CTT, especially when common assumptions of IRT cannot be readily met, or in more local settings, such as those that may characterise many medical school examinations. Objectives The objective of this paper is to provide an overview of both CTT and IRT to the practitioner involved in the development and scoring of medical education assessments. Methods The tenets of CCT and IRT are initially described. Then, main uses of both models in test development and psychometric activities are illustrated via several practical examples. Finally, general recommendations pertaining to the use of each model in practice are outlined. Discussion Classical test theory and IRT are widely used to address measurement‐related issues that arise from commonly used assessments in medical education, including multiple‐choice examinations, objective structured clinical examinations, ward ratings and workplace evaluations. The present paper provides an introduction to these models and how they can be applied to answer common assessment questions. Medical Education 2010: 44 : 109–117     

项目反应理论在SF-36心理测量学特征评价中的应用

目的使用项目反应理论(item response theory,IRT)对SF-36量表进行分析,探讨更适合于量表分析的方法。方法采用横断面研究。使用SF-36量表调查526例确诊的鼻咽癌患者,使用部分评分模型对反映生理健康的21个条目进行分析:计算PSI(person separation index),估计阈值参数和生存质量,对性别、年龄、婚姻等进行项目功能差异(DIF)分析。结果 PSI=0.85,整个模型的拟合效果好;除了条目3i、3j、8的阈值参数顺序出现颠倒外,其余条目均符合理论假设;DIF分析结果显示,所有的条目都没有非一致性DIF,条目4a在性别上存在一致性DIF,条目3g、10a在病人来源上存在一致性DIF。结论 SF-36生理健康的21个条目基本满足单维性、局部独立性的要求,可以放在一起进行IRT分析。IRT能够克服等级资料的限制,能力参数与阈值参数定义在同一个标尺上,而且存在参数不变性的优点,更加适合量表的分析评价。     

Evaluation properties of the French version of the OUT-PATSAT35 satisfaction with care questionnaire according to classical and item response theory analyses

Purpose

The present study investigates the properties of the French version of the OUT-PATSAT35 questionnaire, which evaluates the outpatients’ satisfaction with care in oncology using classical analysis (CTT) and item response theory (IRT).

Methods

This cross-sectional multicenter study includes 692 patients who completed the questionnaire at the end of their ambulatory treatment. CTT analyses tested the main psychometric properties (convergent and divergent validity, and internal consistency). IRT analyses were conducted separately for each OUT-PATSAT35 domain (the doctors, the nurses or the radiation therapists and the services/organization) by models from the Rasch family. We examined the fit of the data to the model expectations and tested whether the model assumptions of unidimensionality, monotonicity and local independence were respected.

Results

A total of 605 (87.4 %) respondents were analyzed with a mean age of 64 years (range 29–88). Internal consistency for all scales separately and for the three main domains was good (Cronbach’s α 0.74–0.98). IRT analyses were performed with the partial credit model. No disordered thresholds of polytomous items were found. Each domain showed high reliability but fitted poorly to the Rasch models. Three items in particular, the item about “promptness” in the doctors’ domain and the items about “accessibility” and “environment” in the services/organization domain, presented the highest default of fit. A correct fit of the Rasch model can be obtained by dropping these items. Most of the local dependence concerned items about “information provided” in each domain. A major deviation of unidimensionality was found in the nurses’ domain.

Conclusions

CTT showed good psychometric properties of the OUT-PATSAT35. However, the Rasch analysis revealed some misfitting and redundant items. Taking the above problems into consideration, it could be interesting to refine the questionnaire in a future study.     

Graded response model-based item selection for behavior and symptom identification

In measuring outcomes of health care, information is obtained from subjects employing instruments that often use Likert scales. These instruments are typically designed using classical testing theory which assumes the errors around the true scores are normally distributed and constant. Advances in psychometric practices through the use of item response theory (IRT) models have led to more flexibility in scale development and in data analyses. In this paper, we introduce statisticians and health services researchers to IRT models through a case-study of data collected to measure subjective distress. The data consist of self-reports of symptom and problem difficulty obtained from a sample of 2,656 patients discharged with a psychiatric disorder from 13 hospitals in the United States between May 2001 and April 2002. Dimensionality of the trait is assessed using principal factor analysis. Model assessment is made using χ² statistics and residual analyses. We select items for the scale using the Fisher Information available at selected levels of the underlying trait.     

Health status assessment for the twenty-first century: item response theory, item banking and computer adaptive testing

Health status assessment is frequently used to evaluate the combined impact of human immunodeficiency virus (HIV) disease and its treatment on functioning and well-being from the patient's perspective. No single health status measure can efficiently cover the range of problems in functioning and well-being experienced across HIV disease stages. Item response theory (IRT), item banking and computer adaptive testing (CAT) provide a solution to measuring health-related quality of life (HRQoL) across different stages of HIV disease. IRT allows us to examine the response characteristics of individual items and the relationship between responses to individual items and the responses to each other item in a domain. With information on the response characteristics of a large number of items covering a HRQoL domain (e.g. physical function, and psychological well-being), and information on the interrelationships between all pairs of these items and the total scale, we can construct more efficient scales. Item banks consist of large sets of questions representing various levels of a HRQoL domain that can be used to develop brief, efficient scales for measuring the domain. CAT is the application of IRT and item banks to the tailored assessment of HRQoL domains specific to individual patients. Given the results of IRT analyses and computer-assisted test administration, more efficient and brief scales can be used to measure multiple domains of HRQoL for clinical trials and longitudinal observational studies.