Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation

CONTEXT: The Consolidated Standards for Reporting of Trials (CONSORT) statement was developed to help improve the quality of reports of randomized controlled trials (RCTs). To date, a paucity of data exists regarding whether it has achieved this goal. OBJECTIVE: To determine whether use of the CONSORT statement is associated with improvement in the quality of reports of RCTs. DESIGN AND SETTING: Comparative before-and-after evaluation in which reports of RCTs published in 1994 (pre-CONSORT) were compared with RCT reports from the same journals published in 1998 (post-CONSORT). We included 211 reports from BMJ, JAMA, and The Lancet (journals that adopted CONSORT) as well as The New England Journal of Medicine (a journal that did not adopt CONSORT and was used as a comparator). MAIN OUTCOME MEASURES: Number of CONSORT items included in a report, frequency of unclear reporting of allocation concealment, and overall trial quality score based on the Jadad scale, a 5-point quality assessment instrument. RESULTS: Compared with 1994, the number of CONSORT checklist items in reports of RCTs increased in all 4 journals in 1998, and this increase was statistically significant for the 3 adopter journals (pre-CONSORT, 23.4; mean change, 3.7; 95% confidence interval [CI], 2.1-5.3). The frequency of unclear reporting of allocation concealment decreased for each of the 4 journals, and this change was statistically significant for adopters (pre-CONSORT, 61%; mean change, -22%; 95% CI, -38% to -6%). Similarly, 3 of the 4 journals showed an improvement in the quality score for reports of RCTs, and this increase was statistically significant for adopter journals overall (pre-CONSORT, 2.7; mean change, 0.4; 95% CI, 0.1-0.8). CONCLUSION: Use of the CONSORT statement is associated with improvements in the quality of reports of RCTs.     

采用CONSORT和STRICTA评价针刺治疗糖尿病胃轻瘫随机对照试验报告质量

[目的] 采用试验报告统一标准(CONSORT)和报告针刺临床试验中干预措施(STRICTA)标准评价针刺治疗糖尿病胃轻瘫随机对照试验的报告质量。 [方法] 计算机检索Cochrane 图书馆临床对照试验数据库、PubMed、中国知识基础设施工程、维普等数据库。文种限制为中英文。纳入针刺治疗糖尿病胃轻瘫的随机对照试验, 并采用CONSORT声明和STRICTA标准进行报告质量评价。[结果] 共纳入针刺治疗糖尿病胃轻瘫随机对照研究28篇文献。根据CONSORT声明和STRICTA标准对纳入文献进行分析, 无文献提及随机分配方案的隐藏、样本量的计算方法和治疗师资历。大部分研究对随机方法描述不清、盲法使用率低、未使用流程图、不良反应报道少、针刺细节报道不充分等问题。[结论] 目前针刺治疗糖尿病胃轻瘫的研究报告质量普遍较低。今后应采用国际公认的CONSORT声明和STRICTA标准对针刺疗法进行规范报告。     

CONSORT 2010说明与详述：报告平行对照随机临床试验指南的更新

大量证据显示随机对照临床试验（randomised controlled trial,RCT）的报告质量不理想。报告不透明,则读者既不能评判试验结果是否真实可靠,也不能从中提取可用于系统综述的信息。最近的方法学分析表明,报告不充分和设计不合理与对治疗效果产生评价偏倚有关。这种系统误差对RCT损害严重,而RCT正是以其能减少或避免偏倚而被视为评价干预措施的金标准。为了提高RCT的报告质量,一个由专家和编辑组成的工作组制定了临床试验报告的统一标准（Consolidated Standards of Reporting Trials,CONSORT）声明。CONSORT声明于1996年首次发表,并于2001年更新。声明由对照检查清单和流程图组成,供作者在报告RCT时使用。许多核心医学期刊和主要国际性编辑组织都已认可CONSORT声明。该声明促进了对RCT的严格评价和解释。2001年,在对CONSORT进行修订时,人们就已经清楚地认识到,解释和说明制定CONSORT声明的原理,有助于研究人员等撰写或评价临床试验报告。一篇CONSORT说明与详述文章于2001年同2001版CONSORT声明一起发表。2007年1月的专家会议之后,对CONSORT声明作了进一步修订并已发表,即＂CONSORT2010声明＂。这次更新对原版对照检查清单作了文字上的修改,使其更为明晰,并收入了与一些新近才认识到的主题相关的建议,如选择性报告结局产生的偏倚。说明与详述文件旨在加强人们对CONSORT声明的理解、应用和传播,这次也作了大量修订,对每一项新增或更新的清单条目的含义和增改理由进行了解释,提供了优秀的报告实例,还尽可能地提供了相关的经验性研究的参考文献。文中收入了若干流程图实例。＂CONSORT2010声明＂、其说明与详述文件,以及相关网站（www.consort-statement.org）,对于改进随机临床试验报告必将有所裨益。     

提高中草药随机对照试验的质量Ⅳ:采用修改后的CONSORT条目评价临床随机对照试验报告的质量

目的:以Cochrane图书馆中有关中草药治疗2型糖尿病系统评价中的66个临床随机对照试验为基础,分析在中草药临床随机对照试验研究报告中存在的问题,以及如何提高临床随机对照试验报告的质量。方法:文献检索2005年7月前发表于Cochrane图书馆的纳入随机对照试验最多的系统评价—中草药治疗2型糖尿病系统评价,共包含66个临床随机对照试验。以原有的CONSORT条目为基础,增加有关中医药方面的5项内容,即中医证型、组方依据、复方组成、制剂类型及质量控制。修订后的CONSORT评估表共包含63项条目,并以此为标准评估66篇临床随机对照试验报告的质量。结果:按修改后的CONSORT条目,66篇临床随机对照试验的总体报告率为19%~44%,中位数32%(标准差8%)。结论:中草药临床随机对照试验报告的总体质量较低。建议:以CONSORT条目为基础,进行中草药临床随机对照试验报告规范化的研究。同时建议中医药类杂志的编辑要求作者按照规范格式发表临床研究报告。     

Standards for reporting randomized controlled trials in medical informatics: a systematic review of CONSORT adherence in RCTs on clinical decision support

Introduction

The Consolidated Standards for Reporting Trials (CONSORT) were published to standardize reporting and improve the quality of clinical trials. The objective of this study is to assess CONSORT adherence in randomized clinical trials (RCT) of disease specific clinical decision support (CDS).

Methods

A systematic search was conducted of the Medline, EMBASE, and Cochrane databases. RCTs on CDS were assessed against CONSORT guidelines and the Jadad score.

Result

32 of 3784 papers identified in the primary search were included in the final review. 181 702 patients and 7315 physicians participated in the selected trials. Most trials were performed in primary care (22), including 897 general practitioner offices. RCTs assessing CDS for asthma (4), diabetes (4), and hyperlipidemia (3) were the most common. Thirteen CDS systems (40%) were implemented in electronic medical records, and 14 (43%) provided automatic alerts. CONSORT and Jadad scores were generally low; the mean CONSORT score was 30.75 (95% CI 27.0 to 34.5), median score 32, range 21–38. Fourteen trials (43%) did not clearly define the study objective, and 11 studies (34%) did not include a sample size calculation. Outcome measures were adequately identified and defined in 23 (71%) trials; adverse events or side effects were not reported in 20 trials (62%). Thirteen trials (40%) were of superior quality according to the Jadad score (≥3 points). Six trials (18%) reported on long-term implementation of CDS.

Conclusion

The overall quality of reporting RCTs was low. There is a need to develop standards for reporting RCTs in medical informatics.     

The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials

To comprehend the results of a randomized controlled trial (RCT), readers must understand its design, conduct, analysis, and interpretation. That goal can be achieved only through complete transparency from authors. Despite several decades of educational efforts, the reporting of RCTs needs improvement. Investigators and editors developed the original CONSORT (Consolidated Standards of Reporting Trials) statement to help authors improve reporting by using a checklist and flow diagram. The revised CONSORT statement presented in this article incorporates new evidence and addresses some criticisms of the original statement. The checklist items pertain to the content of the Title, Abstract, Introduction, Methods, Results, and Comment. The revised checklist includes 22 items selected because empirical evidence indicates that not reporting the information is associated with biased estimates of treatment effect or because the information is essential to judge the reliability or relevance of the findings. We intended the flow diagram to depict the passage of participants through an RCT. The revised flow diagram depicts information from 4 stages of a trial (enrollment, intervention allocation, follow-up, and analysis). The diagram explicitly includes the number of participants, according to each intervention group, included in the primary data analysis. Inclusion of these numbers allows the reader to judge whether the authors have performed an intention-to-treat analysis. In sum, the CONSORT statement is intended to improve the reporting of an RCT, enabling readers to understand a trial's conduct and to assess the validity of its results.     

The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials

To comprehend the results of a randomized, controlled trial (RCT), readers must understand its design, conduct, analysis, and interpretation. That goal can be achieved only through complete transparency from authors. Despite several decades of educational efforts, the reporting of RCTs needs improvement. Investigators and editors developed the original CONSORT (Consolidated Standards of Reporting Trials) statement to help authors improve reporting by using a checklist and flow diagram. The revised CONSORT statement presented in this paper incorporates new evidence and addresses some criticisms of the original statement. The checklist items pertain to the content of the Title, Abstract, Introduction, Methods, Results, and Discussion. The revised checklist includes 22 items selected because empirical evidence indicates that not reporting the information is associated with biased estimates of treatment effect or because the information is essential to judge the reliability or relevance of the findings. We intended the flow diagram to depict the passage of participants through an RCT. The revised flow diagram depicts information from four stages of trial (enrollment, intervention allocation, follow-up, and analysis). The diagram explicitly includes the number of participants, for each intervention group, that are included in the primary data analysis. Inclusion of these numbers allows the reader to judge whether the authors have performed an intention-to-treat analysis. In sum, the CONSORT statement is intended to improve the reporting of an RCT, enabling readers to understand a trial's conduct and to assess the validity of its results.     

Value of flow diagrams in reports of randomized controlled trials

CONTEXT: Diagrams of the flow of participants through a clinical trial are recommended in the Consolidated Standards for Reporting of Trials (CONSORT) statement, but it is unclear whether such flow diagrams improve the quality of trial reports. OBJECTIVE: To examine the information contributed by flow diagrams and the completeness of reporting overall in reports of randomized controlled trials (RCTs) published in 5 general and internal medicine journals. DESIGN AND SETTING: Analysis of 270 reports of RCTs published in 1998 in the Annals of Internal Medicine (AIM; n = 19), BMJ (n = 42), JAMA (n = 45), The Lancet (n = 81), and The New England Journal of Medicine (NEJM; n = 83). MAIN OUTCOME MEASURES: Proportion of reports that included a flow diagram, information provided in flow diagrams, and completeness of reporting about flow of participants overall in flow diagrams or text. RESULTS: A total of 139 reports (51.5%) of RCTs included a flow diagram, but this varied widely among journals (AIM, 21.0%; BMJ, 38.1%; JAMA, 80.0%; The Lancet, 93.8%; and NEJM, 8.4%). Diagrams generally provided useful information, but only 73 (52.5%) included the number of participants who received allocated interventions and only 32 (23.0%) included the number of participants included in the analysis. In logistic regression analysis, overall completeness of reporting about flow of study participants was associated with publication of a flow diagram. CONCLUSIONS: Flow diagrams are associated with improved quality of reporting of randomized controlled trials. However, the structure of current flow diagrams is less than ideal. We propose a revised flow diagram that includes all important counts through the stages of parallel group trials.     

国内肿瘤坏死因子α抑制剂治疗类风湿关节炎随机对照试验方法学及报告质量评价

目的：评价国内肿瘤坏死因子α抑制剂治疗类风湿关节炎（RA）随机对照试验（RCT）的方法学质量和报告质量,以期揭示现存问题,规范未来研究。方法：计算机检索中国生物医学文献数据库、中国期刊全文数据库、数字化期刊全文数据库等资源,收集目前我国发表的有关肿瘤坏死因子α抑制剂治疗RA的RCT,文献检索时间为建库至2014年1月。采用Jadad等设计的文献质量评价方法对纳入RCT的方法学质量进行评价,采用CONSORT声明（2010修订版）对纳入RCT的报告质量进行评价。结果：最终纳入45个RCT。方法学质量评价结果显示,84.44%的文献为低质量研究;报告质量评价结果显示,主要存在的问题有文题缺乏识别标识、引言阐述不充分、方法报告不确切、缺乏局限性讨论、结论推导缺乏科学性、注册工作不完善等。结论：目前该领域RCT的方法学质量普遍存在问题,报告亦不充分,文献质量整体处于较低水平。未来急需开展多方面工作,致力于我国RCT方法学水平的提高和报告规范。     

期刊与学术会议论文摘要中报告随机对照试验的CONSORT声明：说明与详述

背景：对于与随机对照试验（randomized controlled trial. RCT）有关的学术会议论文或期刊中发表的文章来说，清楚、明了、信息、量充足的摘要是十分重要的，因为读者经常仅仅根据报告的摘要对一个临床试验作出评价。句此，我们需要对“临床试验报告的统一标准（Consolidated Standards of Reporting Trials,ials-CONSORT）声明”进行扩充，制定一个期刊与学术会议论文摘要中报告RCT的必备条目清单。争后在任阿期刊发表的论文或学术会议论文摘要中，怍者对RCT结果的报告都要包含这些内容。 方法与结果：我们根据现有的质量评价工具和基于经验的证据总结出一个条目清单。运用三轮修正式德尔菲法（modified-Delphi process）进行条目筛选。邀请共计109人参与电子网络调查，反馈率为61%。调查结果干2007年1月在加拿大蒙特贝罗举行的CONSORT小组会议中公布，与会的26人中有临床试验实施人员、统计学家、流行病学家以及生物医学编辑。经过讨论最终确定条目，随后对其进行修订以保证这些条目体现了会议期间以及会后的讨论思路。摘要CONSORT建议RCT报告的摘要需要有一个结构化的格式，其中立该包括具体的试验目的、试验设计（随机分配的方法、盲法或遮蔽等）、研究对象（对象描述、随机分组的样本量以及用于分析的样本量）、每组实施的干预、实施的干预对主要疗效结果的影响及其危害、试验结论、试验注册名称和编号以及资金来源。本文对每一条能够找到例子的纳入条目都配有良好报告范制、基本原理以及证据等。十分明了易懂，因此我们建议与清单同时使用。     

世界主要消化病杂志上随机对照试验报告质量比较分析

目的系统研究主要消化病杂志上发表的随机对照试验报告质量现状。方法系统分析并比较2008年和1998年发表在5本主要消化病杂志上的随机对照试验报告质量。相关文章通过检索MEDLINE获得。质量评价采用CONSORT声明修订版中的部分条目,内容包括随机序号产生、分配隐藏、盲法、样本量估算和意向性处理分析等。结果共检索到2008年的随机对照试验107个,1998年的99个。2008年的随机对照试验中．有76％（81／107）报告了恰当的随机序号产生方法,58％（62／107）报告了恰当的序号隐藏方法,58％（62／107）盲法恰当．78％（83／107）报告了恰当的样本量估算方法,69％（74／107）使用了意向性处理分析;而1998年相应的结果分别为35％（35／99）,25％（25／99）,53％（52／99）,47％（47／99）,42％（42／99）。结论2008年与1998年相比,5本主要消化病杂志上的随机对照试验报告质量有了明显的提高,说明CONSORT声明修订版对于随机对照试验报告质量的提高有很大作用,但目前其报告质量仍有很大的提升空间。     

Impact Evaluation of CONSORT and STRICTA Guidelines on Reporting Quality for Randomized Controlled Trials of Acupuncture Conducted in China

Objective:To evaluate and compare the reports' qualities of acupuncture randomized controlled trials(RCTs) conducted in China before and after the implementation of two guidelines,i.e.,the Consolidated Standards of Reporting Trials(CONSORT) statement and the Standards for Reporting Interventions in Controlled Trials of Acupuncture(STRICTA).Methods:Proportions of studies that reported CONSORT and STRICTA items were compared for the years before and after implementation of these two guidelines.In addition,the total score of each item's reporting were calculated and reported differences during different date ranges were compared.Results:For CONSORT items(maximum score 8),there was evidence of a slight improvement in reporting between 1994-1995 and 1999-2000 combined(2.5 + 0.6) and 2004-2005 and2009-2010 combined(3.0 ±0.9;difference 0.4,95%confidence interval,0.3 to 0.6,P0.01).For STRICTA items(maximum score 17),there was evidence that a slight improvement in reporting between 1994-1995 and 1999-2000 combined(8.6±2.1) and 2004-2005 and 2009-2010 combined(10.1 ±1.8;difference1.5,95%confidence interval,1.1 to 1.9,P0.01).Conclusion:Quality of reporting for RCTs of acupuncture treatment conducted in China have generally improved since the introduction of the STRICTA and CONSORT guidelines.     

中草药治疗阿尔茨海默病的临床试验报告质量评价

目的：中草药治疗阿尔茨海默病的临床试验逐渐增多,本文就中草药治疗该病的文献发表质量进行系统评价。方法通过检索PubMed和CNKI数据库,选择随机对照试验,依据CONSORT报告条目、草药制剂质量补充条目及专业设计要求,对文献发表质量进行评价。结果纳入文献29篇,其中英文11篇,中文18篇。6篇（20．7％）CONSORT条目报告数超过50％,中文平均10．94条（30％）,英文平均20．27条（55％）。 Jadad评分3分或以上文献共9篇（31％）,中文1．67±0．77分,英文（3．18±1．66）分。草药制剂质量报告条目评分2．5分及以上者共7篇（24.1％）,中文（1．58±0．39）分,英文（2.61±0．93）分。1篇（3．4％）中文文献对纳入病例证候进行了评价,并对治疗前后证候变化进行了比较。结论英文文献发表质量相对较好,中文文献主要不足表现为随机和盲法设计细节欠详细、疗程相对较短、对照药物及结局指标选择欠妥。     

应用CONSORT声明对随机对照试验报告的质量分析

目的应用CONSORT 2010声明评价随机对照试验(RCT)论文的质量。方法组建并培训熟悉CON-SORT 2010声明和视觉模拟(VAS)评分的工作小组,针对论文"促性腺激素释放激素激动剂联合反向添加疗法治疗子宫内膜异位症的临床疗效研究",用CONSORT 2010声明清单的25个条目逐一对照和点评,并对各条目的报告质量给予VAS评分,经过统计学分析之后对论文的整体质量进行评价。结果被评价论文有15个条目提及了完整性和准确性程度不等的内容;对于全文25个条目的报告:VAS得分95分2条、90分4条、80分2条、75分2条、60分2条、45分2条、23分1条、0分10条;每个条目平均VAS评分为(43.7±40.0)分,其中VAS评分在80分以上的有8条,占32%;被评价论文有10个条目未报告,占40%。结论被评价论文报告的质量不高。建议我国RCT的报告仍需规范,报告质量有待提高,尤其是与试验设计原则有关的报告质量;撰稿人报告RCT与审稿人面对RCT论文时均应参照CONSORT声明;编辑部可酌情把CONSORT声明逐步引入稿约;建议用CONSORT声明对照撰写RCT。     

中草药临床研究的评价

补充替代医学正被广泛应用,并呈现出良好的增长趋势。随着寻求补充替代医学疗法的人口比例的增长,无论是补充替代医学被单独使用,还是与传统的对抗疗法联合应用,对补充替代医学临床报告质量的研究变得日益迫切。大部分这种质量研究是针对那些主要目的在于为临床医师提供参考的临床研究报告,我们发现,在解释临床研究的结果及其意义时,人们不得不面对其方法学质量低劣的问题。如何解决这个问题,将是我们面临的巨大挑战。临床医师要有效地利用这些科学研究的文献,就必须熟悉循证医学的基本原则。本文的目的在于向临床医师介绍临床研究评价的概念,使他们在阅读研究论文时能带着评判的眼光,以便更好地评价论文中的研究结果,并将其合理地运用到自己的日常医疗实践中去。本文主要讨论了以下六个方面的问题:(1)循证医学的基本原理;(2)临床研究的类型;(3)证据的分级;(4)应用临床试验报告统一标准评价随机对照试验报告的质量;(5)随机对照试验方法学质量的评分;(6)中草药临床研究质量评价的有关问题。     

针灸联合复位治疗良性阵发性位置性眩晕的系统评价与Meta分析

目的 对针灸联合复位治疗良性阵发性位置性眩晕的研究进行系统评价和Meta分析.方法 检索中国知网(CNKI)、维普数据库(VIP)、万方数据库(WF)和美国国立医学图书馆生物医学信息数据库(Pubmed),纳入关于针灸联合复位治疗良性阵发性位置性眩晕的随机对照试验.使用CONSORT声明和STRICTA国际标准对纳入的研究进行质量评价,并使用RevMan 5.2软件对纳入的数据进行Meta分析.结果 最终纳入14篇文献,Meta分析结果显示,针灸联合复位治疗良性阵发性位置性眩晕能明显提高治疗的有效率,并能明显降低患者的中医症候积分.结论 针灸联合复位治疗良性阵发性位置性眩晕疗效明确,具有良好的安全性.