An observational study of orthopaedic abstracts and subsequent full-text publications

BACKGROUND: Research abstracts are frequently referenced in orthopaedic textbooks and influence orthopaedic care. However, little is known about the quality of information provided in the abstracts, the frequency of publication of complete papers after presentation of abstracts, or any discrepancies between abstracts and published papers. The objective of this study was to determine the quality of information provided in orthopaedic abstracts, rates of publication of full-text articles after presentation of abstracts, predictors of publication of full-text articles, and consistency between abstracts and full-text articles. METHODS: We retrieved all abstracts from the 1996 scientific program of the sixty-third Annual Meeting of the American Academy of Orthopaedic Surgeons. For each abstract, we recorded the completeness of reporting and key features of the study design, conduct, analysis, and interpretation. A computerized Medline and PubMed search established whether the abstract had been followed by publication of a full-text article. Finally, we evaluated the consistency of reporting between abstracts and final publications. RESULTS: The program included 465 abstracts, 66% of which were on prognostic studies. All abstracts described the study design, and 70.7% of the designs were observational. Key methodological issues were reported in less than half of the abstracts, and information on data analysis was reported in <15%. One hundred and fifty-nine (34%) of the 465 abstracts were followed by publication of a full-text article. The mean time to publication (and standard deviation) was 17.6 +/- 12 months (range, one to fifty-six months). Inconsistencies between the abstract and the full-text article included the primary outcome measure, which differed 14% of the time, and the results, which differed 19% of the time. CONCLUSIONS: Two-thirds of the orthopaedic abstracts in this sample were not followed by publication of a full-text paper. The overall quality of reporting in abstracts proved inadequate, and inconsistencies between the final published paper and the original abstract occurred frequently. The routine use of abstracts as a guide to orthopaedic practice needs to be reconsidered.     

Publish or be damned? The fate of abstracts presented at the International Continence Society Meeting 2003

AIMS: This study examined the presented abstracts from the International Continence Society (ICS) Meeting, 2003. It analyzed the rate and timing of full publication, the factors predicting successful publication, the consistency of reporting between presented abstracts and published abstracts, and the barriers to publication. MATERIALS AND METHODS: The abstracts presented at ICS 2003, were categorized according to topic, nationality, and a range of methodological factors. Using keywords and author names, PubMed was searched for published papers corresponding to the work presented. For abstracts that had been published, the original abstract was compared with the abstract accompanying the full-text paper. For abstracts that could not be identified in PubMed, the main authors were surveyed with an email questionnaire, asking about reasons for non-publication. RESULTS: Of 130 presented abstracts, 77 (61.6%) had been published in full by February 2006. Authors from the US were significantly more likely to have had their work published. Uniquely among topics, "Clinical Pharmacology" abstracts were significantly more likely to have been published. Fourteen (18.2%) abstracts were classified as having major inconsistencies between the presented abstract and the abstract accompanying the full-text paper. Inconsistencies between presented and published abstracts were significantly associated with delay in publication on Kaplan-Meier analysis. Most unpublished abstracts had never been submitted for publication. CONCLUSIONS: The high publication rate reflects well on the scientific quality of the ICS meeting. All authors should be encouraged to publish their work after presentation. Caution is advised when referencing or generalizing from abstracts that have not been published in full.     

Fate of Abstracts Presented at the Transplantation Society of Australia and New Zealand Annual Scientific Meetings

BackgroundThe numbers and characteristics of the abstracts presented at the Annual Scientific Meetings (ASM) of the Transplantation Society of Australia and New Zealand (TSANZ) that are converted to peer-reviewed publications have not been analyzed previously.MethodsAll abstracts presented at the TSANZ ASM from 2013 to 2017 were reviewed. A literature search was performed using a search algorithm to identify the full-text publications of the presented abstracts. Correlation between abstract characteristics and publication rate was then examined using Cox proportional hazards regression and Kaplan-Meier curves to distinguish the predictors for publication.Over the 5-year period, 576 abstracts were presented, with a total of 164 (28.6%) presentations converted to publications. The majority of publications occurred within the first 3 years, with the mean time to publication being 16.6 (standard deviation = 14.6) months. The median impact factor for published research was 4.74 (interquartile range = 3.06-5.58). Multivariate analysis identified clinical science papers, systematic reviews and surveys (likelihood ratio = 1.42, 5.02, and 2.01; P = .040, .000, and .010, respectively) as the most important predictors for publication.ConclusionsThe rate of abstracts presented at the TSANZ ASM over 5 years that were converted to publication in a peer-reviewed journal was 28.6%. Clinical papers, systematic reviews, and surveys were more likely to be published. An ongoing strict abstract selection process will contribute to improving conversion of abstracts into full-text peer-reviewed articles.     

Conversion rates of abstracts presented at the Urological Society of Australia and New Zealand (USANZ) Annual Scientific Meeting into full-text journal articles

What's known on the subject? and What does the study add? It is well known that the transition of a presented abstract in a scientific meeting to a journal article improves the quality of the meeting and prevents an abstract being incorporated into meta‐analyses or practice guidelines without proper appraisal. This is the first analysis of USANZ Annual Scientific Meeting abstracts’ conversion to full publication. With relatively low publication rates compared to other international meetings, this review identifies the need for mechanisms to encourage USANZ researchers to convert their abstracts into published articles. The numbers and characteristics of the abstracts presented at the Annual Scientific Meetings (ASM) of the Urological Society of Australia and New Zealand (USANZ) that are converted to peer‐reviewed publications have not previously been analysed and published. We undertook a review of all abstracts presented at the USANZ ASM from 2005 to 2009. A PubMed search was performed between 15 June and 15 July 2012, using a search algorithm to identify the full‐text publications of the presented abstracts. Correlation between abstract characteristics and publication rate was then examined to distinguish the predictors for publications. Of 614 abstracts that were presented at USANZ ASM between 2005 and 2009, 183 papers were published, giving a publication rate of 29.80%. The papers were predominantly published in urological journals and were more likely to be published if they were presented by an international author or were retrospective studies or if basic science research. The mean (SD) time to publication was 14.46 (13.89) months and the mean Impact Factor of journals where papers were published was 2.90. The overall publication rate was relatively low compared with other urological meetings held in America and Europe. USANZ has a challenge of encouraging higher‐quality research from the authors to further enhance its publication rate and consequently the calibre of the meeting itself.     

Observational analysis of BOA free-papers (2001): from presentation to publication and comparison with the American Academy of Orthopaedic Surgeons (AAOS)

Aim

The objectives of this study were to: determine the presentation to publication conversion rate (PPCR) in peer-reviewed indexed journals of free papers and posters presented at 12-14th September 2001 British Orthopaedic Association (BOA) annual meeting and to compare the publication rate with the American Academy of Orthopaedic Surgeons (AAOS) meeting in 2001.

Methodology

We looked at all presentations including both podium and poster presentations at British Orthopaedic Association meeting held in 2001 and assessed for subsequent publication as full-text article with a fixed PubMed search protocol. Once the abstract was identified as being published, we noted the name of the journal, citation, and time to presentation. The level of evidence was assigned for each abstract along the guidelines published by the centre for evidence-based medicine, Oxford, UK. This conversion rate was compared with the presentation to publication rate for the AAOS meeting in 2001.

Results

A total of 179 abstracts were presented at the 2001 BOA meeting. 65 of these were published as full-text articles in 30 different journals. The overall publication rate was 36.3%. The publication rate of the papers presented at AAOS annual meeting 2001 was 49% (367/756). The mean time from presentation to publication was 18.6 months (±9.4 months). Three fourths of them were published after 2 years of presentations (63% for AAOS). Majority of studies were either level III or IV. 14 full-text articles were published in Journal of Bone and Joint Surgery British (JBJS Br) and 8 in the Injury Journal.

Conclusions

This is the first study reporting the publication rate of presentations for BOA meeting and comparing it with the publication rate of AAOS meeting in 2001. The publication rate of BOA presentations is much lower than the AAOS meeting. We believe the publication rate is an important tool in judging the quality of research work and the reputation of a scientific meeting with higher conversion rates suggesting better quality. Thus, more stringent selection criteria need to be introduced so that the selected abstracts can withstand peer-view for publication as full-text articles.     

Publication rates of abstracts presented at the 23rd (2013) and 24th (2014) National Turkish Orthopedics and Traumatology Congresses: We are not improving

ObjectivesThe aim of this study was to determine 1) the publication rates of podium and poster presentations from the 23rd (2013) and the 24th (2014) National Turkish Orthopedics and Traumatology Congresses in peer-reviewed journals and (2) compare these rates with publication rates from the 20th congress (2007) published previously. The secondary objective was to determine the time lag to publication and compare this data with the data from the 20th congress.MethodsAll abstracts from the scientific programs of the 23rd (2013) and the 24th (2014) National Turkish Orthopedics and Traumatology Congresses were identified and computerized PubMed searches were conducted to determine whether an abstract had been followed by publication of a full-text article in peer-reviewed journals. The time lag to publication was also noted.ResultsOf the 993 presentation abstracts (302 podium and 691 poster presentations) from the 23rd congress and of the 940 presentation abstracts (310 podium and 630 poster presentations) from the 24th congress, 278 (28%) and 234 (24.9%) were followed by a full-text article in peer-reviewed journals indexed by PubMed, respectively. The rates of publication of the podium and poster presentations were 39.4% (119/302) and 23% (159/691), respectively from the 23rd and 37.7% (117/310) and 18.6% (117/630), respectively from the 24th congresses. The mean time to publication of the abstracts from the 23rd congress was 12.8 ± 18.8 (median: 13, range: −140 to 47) months and the mean time to publication of the abstracts from the 24th congress was 11.1 ± 14.42 (median: 11, range: −73 to 39) months. Fifty (50/278, 18%) abstracts from the 23rd congress (mean −11, range: [−32]−[−1], median −5 months) and 37 (37/234, 15.8%) abstracts from the 24th congress (mean −10.4, range: [−73]−[−1], median −4 months) were published as full-text articles prior to the presentation at the congress.ConclusionThe vast majority of abstracts presented at 23rd (2013) and the 24th (2014) National Turkish Orthopedics and Traumatology Congresses were not followed by publication of a full-text article in peer-reviewed journals. The publication rates of the abstracts presented at these congresses did not improve when compared with the 20th (2007) congress.     

Publication outcome for research presented at the Vascular Society of Great Britain and Ireland annual meetings

BACKGROUND The Vascular Society of Great Britain and Ireland (VSGBI) annual meeting is a major international vascular surgery conference. Studies suggest that the percentage of presentations that result in full-text publications are a measure of the quality of the meeting. We investigated the publication outcome of abstracts presented to the VSGBI in 2001 and 2002. MATERIALS AND METHODS We retrospectively identified abstracts from the conference programmes and conducted a detailed electronic Medline and PubMed search to determine publication. We collected data regarding the study design, subject matter,publishing journal, time to publication, institution of origin, impact factors and RAE levels. RESULTS There were 63 publications from 106 abstracts (59.4%), with a median impact factor of 3.507. Prospective observational studies accounted for 20.6% of publications, with abdominal aortic aneurysms being the commonest subject matter(34.9%). The median time to publication was 12 months, with the European Journal of Vascular and Endovascular Surgery publishing 33.3% of the articles. Leicester achieved the highest number of publications and the majority of work came from centres with Research Assessment Exercise (RAE) level scores of 4, university centres accounted for 74.6% of publications. CONCLUSIONS We conclude that when compared to equivalent meetings in other specialties and geographical regions, the annual meeting of the VSGBI is of the very highest quality.     

Publication rate of Trauma abstracts presented at an International Orthopaedic conference

INTRODUCTION: Oral presentations at major conferences are often used to present new material and generate discussion. However, conference abstracts that ultimately fail to be published are of little use to the wider medical community. The aim of this study was to evaluate the publication rate of trauma papers presented at an international orthopaedic conference, and to assess the factors which predict publication. METHODS: All abstracts presented orally at the trauma sessions of the European Federation of National Associations of Orthopaedics and Traumatology (EFORT) Congresses in 1999 (Belgium) and 2001 (Greece) were assessed. A MEDLINE and EMBASE search was performed to identify articles written by the first, second and last authors of each abstract to identify a matching journal article. Subspecialty, country of origin of abstract, study type, journal of publication and publication year were tabulated. RESULTS: Two hundred and seventy eight trauma abstracts were presented orally, and 112 (40.3%) achieved subsequent publication. Abstracts on fractures of the proximal femur were the most common (18.7%) and had one of the highest rates of publication (44.2%). Greece and the UK provided the largest number of abstracts, and randomised trials were the study type with the highest rate of publication (80.0%). Thirty two percent of journal articles appeared within 1 year of the conference and 63% within 2 years. Injury was the journal most likely to publish the articles. CONCLUSION: About 60% of Trauma abstracts presented did not result in a subsequent full-text publication. The citation of conference proceedings should be discouraged, and clinicians should be wary of implementing information gleaned from conference presentations into their clinical practice.     

Publication rate of General Surgery abstracts presented at the Royal Australasian College of Surgeons Annual Scientific Congress

Background

A commonly used metric for evaluating the quality and impact of presentations at a scientific meeting is the frequency with which the findings presented are published as full research papers in peer‐reviewed journals. The purpose of this study was to determine the full article publication rates of abstract presentations for General Surgery and related sub‐specialities at the Royal Australasian College of Surgeons Annual Scientific Congress (RACS ASC) from 2010 to 2014.

Methods

All General Surgical (including its sub‐speciality groups) abstracts presented at the RACS ASC from 2010 to 2014 were identified from the ANZ Journal of Surgery. We determined the rates of full paper publication, time to publication, journals of publication and specialty rates of conversion. Full article publications were identified using the PubMed, MEDLINE and Google Scholar databases.

Results

A total of 1386 abstracts were identified, of which 356 (26%) were converted to full paper publications. The number of abstracts presented annually increased from 206 in 2010 to 386 in 2014, but the percentage of abstracts converted to full paper publications did not follow any temporal trend. The majority (74%) of full papers were published within 2 years of the abstract presentation.

Conclusion

In total, 26% of General Surgery abstracts presented at the RACS ASC from 2010 to 2014 were converted to full paper publications. This could provide a baseline against which to judge the quality of presentations at other national General Surgical congresses, as well as at future RACS ASC meetings.     

Scientific impact of women in academic surgery

OBJECTIVE: To evaluate the scientific impact of women in the surgical literature. METHODS: Gender of the principal investigator of every abstract presented at the 2002, 2003, and 2004 annual meetings of the Association for Academic Surgery and Society of University Surgeons was identified by internet search. Resulting publications were identified using PubMed. Journal impact factor and number of article citations were determined using ISI Web of Knowledge. RESULTS: The principal investigator's gender was identified for 649 (98.8%) of the 657 abstracts presented at the 2002--2004 AAS meetings. Women authored 9.1% of abstracts and 11.8% of total resulting publications. The publication rate of abstracts by women was significantly higher than that of men (69.5% versus 52.4%, P = 0.0132). There was a trend toward higher average impact factors of journals in which female authors published (3.265 versus 2.673, P = 0.0626). There was no significant difference in mean number of citations per publication. The principal investigator's gender was identified for all 337 (100%) abstracts presented at the 2002--2004 SUS meetings. Women authored 11.0% of abstracts and 11.2% of resulting publications. Publication rates and average citation numbers were similar for female and male authors. The average impact factors of journals in which women published were significantly higher (4.741 versus 3.348, P = 0.0082). CONCLUSIONS: Although women comprise a small proportion of principal investigators on abstracts presented at these conferences, the quality of their presented work is equal to or better than those of their male counterparts.     

Evidence supporting functional rhinoplasty or nasal valve repair: A 25-year systematic review

OBJECTIVE: To systematically review the existing literature supporting the efficacy of modern-day rhinoplasty techniques for treatment of nasal obstruction due to nasal valve compromise. DATA SOURCES: PubMed search of the English-language literature from January 1982 to August 2007 combined with manual review of citations within article bibliographies. REVIEW METHODS: A systematic review of the literature for the targeted objective was conducted. Citations acquired from the targeted search were filtered and primary articles were reviewed to abstract information including interventions and outcome measures. Articles were then assigned level-of-evidence grades as defined by the Oxford Centre for Evidence-Based Medicine. RESULTS: A total of 861 citations were generated and 291 abstracts were identified as potentially relevant articles. Of these abstracts, 82 articles merited full-text review. A total of 44 articles met inclusion criteria. The majority of the studies were classified as level 4 evidence, and only two studies met level 2b criteria. There was considerable variation in the quality of the studies within the level 4 category. All articles generally supported the effectiveness of functional rhinoplasty techniques for treatment of nasal obstruction. CONCLUSIONS: There is substantial level 4 evidence to support the efficacy of modern-day rhinoplasty techniques for treatment of nasal obstruction due to nasal valve collapse. More recent studies have incorporated validated patient-reported outcome measures, with more rigorous statistical analysis. Future study design improvements include the use of comparison cohorts and incorporating standardized objective outcome measures.     

The publication rates of presentations at major Spine Specialty Society meetings (NASS, SRS, ISSLS)

STUDY DESIGN: A review of all the presentations at three major spine specialty meetings held over a 3-year period. OBJECTIVES: To determine the rate of publication in peer-reviewed journals after presentations at major spine meetings conducted annually by the following three organizations: North American Spine Society (NASS), Scoliosis Research Society (SRS), and International Society for the Study of the Lumbar Spine (ISSLS). SUMMARY OF BACKGROUND DATA: The rate of publication for presentations at national and international meetings has been determined for medical and surgical subspecialties. This rate has been used to judge the quality of the content of the meetings and to determine the validity of the research presentations. METHODS: All presentations either in poster or oral presentation form were entered into a database covering a 3-year period for spine specialty meetings conducted annually by the following three organizations: NASS 1990 to 1992, SRS 1991 to 1993, and ISSLS 1991 to 1993. A computer search for each abstract was performed with the Melvyl Medline Plus database to determine if the abstract had been published in a peer-reviewed journal from 1990 to the end of 1997. Publication rates for presentations at these three meetings were determined over a 3-year period. RESULTS: A total of 1186 abstracts were listed over a 3-year period in the final programs of these three meetings for the years 1991 to 1993 (SRS, ISSLS) and 1990 to 1992 (NASS). Of these 1186 abstracts, 516 were published in peer-reviewed journals, giving an overall publication rate of 43.5%. The publication rates for the three different meetings (NASS, SRS, ISSLS) were similar, with values of 40%, 47%, and 45% respectively. More than 90% of the publications resulting from these meetings were published within a period of 4 years from the data of the meeting. CONCLUSIONS: The publication rates of presentations at three major spine specialty meetings are high and quite comparable with the publication rates of meetings in other medical subspecialties. This reflects the high quality of the meeting programs and validates their selection process.     

Publication bias in abstracts presented to the annual meeting of the American Academy of Orthopaedic Surgeons

PURPOSE: To examine possible causes of publication bias in the orthopaedic literature so as to avoid inappropriate clinical decisions based on reviews of the literature. METHODS: Two reviewers independently reviewed abstracts presented to the 1999 American Academy of Orthopaedic Surgeons annual meeting. Data pertaining to sample size, statistical significance, study setting, country of origin, outcome, study type, and sponsorship were extracted from each abstract. The publication rate was measured after 5 years, by electronic searching and author contact. Predictors of publication were identified using logistic regression analysis. RESULTS: Of the 318 abstracts listed in the proceedings, 175 (55%) were published within 5 years. Publication was associated with positive rather than neutral outcomes (odds ratio, 1.62; 95% confidence interval, 1.01-2.59; p<0.05) and with the reporting of statistical significance (odds ratio, 2.05; 95% confidence interval 1.24-3.39; p=0.005). Sponsorship, country of origin, sample size, study setting, and study type did not significantly influence the publication rate. CONCLUSION: Evidence of publication bias exists in abstracts presented at the 1999 American Academy of Orthopaedic Surgeons annual meeting. Clinical decisions based on the literature may be biased due to an over-representation of studies with positive outcomes.     

Fate of abstracts from the Paris 1995 European Society of Anaesthesiologists meeting

BACKGROUND AND OBJECTIVE: To assess the publication rate of full papers presented as abstracts at the 1995 meeting of the European Society of Anaesthesiologists, and to assess factors that might predict subsequent full publication. METHODS: All abstracts presented at the meeting and published in the British Journal of Anaesthesia (Suppl 1, 1995) were included. To verify subsequent full publication, a MEDLINE search was performed and validated. We studied the average time from the meeting to publication, the first author's country, the subspeciality, the publishing journal of the full report, the type of presentation (oral or poster), the object of investigation, and the quality of research design and of statistical reporting in the abstract. RESULTS: Of 472 meeting abstracts, 199 (42.2%) were eventually published. The average (+/- SD) delay between meeting and publication was 16.8 (15.6) months (range 24-60 months). Most papers (79.4%) had been published within 3 yr of the meeting. Circulation, pharmacology and intensive care papers had the highest rates of publication. Sixty-three journals attracted papers, with the British Journal of Anaesthesia publishing most (n = 29). No difference in subsequent publication was found between oral and poster presentations. Randomized trials and animal research were more likely to be published. The number of authors or their positions differed between the abstract and the full publication in 145 cases (72.9%); the first author was changed in 43 cases. CONCLUSIONS: Less than half of the abstracts accepted at the 1995 European Society of Anesthesiologists' meeting were subsequently published in journals indexed by MEDLINE in the 3 yr following the meeting. Many changes in authorship occurred between the abstract and the full publication. The study architecture and the object of investigation predicted full publication.