What is the ultimate fate of presented abstracts? The conversion rates of presentations to publications over a five-year period from three North American plastic surgery meetings

BACKGROUND:

Advancements in clinical decision-making are influenced by presentations made at scientific conferences or publications in journals with extensive readership. However, many ideas shared at annual conferences fail to be published, and most surgeons attend these meetings only sporadically.

OBJECTIVE:

To quantify the conversion rates of meeting presentations to publications in North American plastic surgery.

METHODS:

MEDLINE (OvidSP) and PubMed databases were cross-referenced with abstracts accepted for podium presentation at the Canadian Society of Plastic Surgeons, American Society of Plastic Surgeons, and American Association of Plastic Surgeons annual meetings from 2003 to 2007. Parameters reviewed included publication rate, time to publication, subspecialty, trial type, publication journal and journal impact factor.

RESULTS:

Over the five-year study period, 45.00% of the 888 presentations were published in peer-reviewed journals. The mean time to publication was 22 months (range 1.00 to 85.90 months). In total, 57.00% of the 400 publications appeared in Plastic and Reconstructive Surgery; 47.20% of publications were case series study design. The majority of publications were of the reconstruction subspecialty (31.00%). Abstracts from the American Society of Plastic Surgeons had the highest conversion rate (57.70%). Publications based on abstracts presented at the American Association of Plastic Surgeons had the highest mean journal impact factor (2.33). The Canadian Society of Plastic Surgeons had the highest total number of publications (n=161).

CONCLUSIONS:

From the three North American annual general meetings reviewed, there was a modest conversion rate of mainly reconstructive case series published predominantly in a single journal, Plastic and Reconstructive Surgery. Several years often pass from the genesis of a research hypothesis to final publication, and because the majority of presentations fail to be published, presentations should be observed with a critical eye given the more stringent peer review process and time required for final publication. In an effort to improve conversion rates, departments and faculty members must foster a culture that prioritizes publication.     

English publication rate of 3,205 abstracts presented at the Annual Meeting of the Japanese Orthopaedic Association and the Annual Research Meeting of the Japanese Orthopaedic Association

Background

Previous studies reported that the publication rate of abstracts presented at overseas meetings was around 50 %. The study objectives were to determine the rate of publication in English-language journals and the impact factor (IF) for all papers presented at the Annual Meeting of the Japanese Orthopaedic Association (JOA) and Annual Research Meeting of the Japanese Orthopaedic Association (JOAR), and to compare the publication rates and IFs from abstracts accepted for oral versus poster presentations.

Methods

Titles and first authors were identified for 1,676 abstracts of free papers accepted for presentation to the JOA in 2006 and 2007, and 1,529 abstracts to the JOAR from 2006 to 2008. We identified the associated journal publications by searching PubMed, and IFs were determined using the journal citation reports. The publication rates and IFs for papers accepted for oral versus poster presentations were compared using statistical analysis.

Results

The overall publication rate was 25.5 % from the JOA and 50 % from the JOAR. There were no significant differences in yearly publication rates, or between oral and poster presentations for each year. The average IFs for all publications from the JOA was 2.45 and that from the JOAR was 3.5. There were no significant differences in yearly IFs, or between oral and poster presentations for each year (P > 0.05).

Conclusions

The rate from JOAR was similar to publication rates for abstracts presented at overseas orthopedic meetings, however, the rate from JOA was half that of publication rates for abstracts presented at overseas orthopedic meetings, indicating that JOA may provide a below average contribution of new medical data to the international scientific community. No significant difference in publication rates between oral and poster presentations were found, and this suggests a need for improvement of the review system for the annual meeting and that review scores at the meetings did not predict the publication fate of abstracts.     

DOES PRESENTATION AT THE REGISTRARS’ PAPERS DAY PREDICT FUTURE PUBLICATION?

There are research requirements for trainees to be eligible to present for their final examinations (Fellowship of Royal Australasian College of Surgeons, FRACS). One option is the presentation of a paper or poster at a meeting of which abstracts are subject to review and selection. This includes presentation at the annual Registrars' Papers Day (RPD) in New South Wales. There has been some debate surrounding whether research requirements are fulfilled by presentation at such meetings. Publication in a peer-reviewed journal should be the ultimate aim. A high publication rate will validate the quality of the meeting. All abstracts submitted to the RPD in 1998 and 1999 were analysed. A Medline search was performed in 2005 to identify publication of these presentations in a peer-reviewed journal. Variables of the study that were potentially predictive of subsequent publication were analysed. This included type of presentation, surgical specialty, clinical or laboratory-based study, study design (prospective or retrospective) and sample size. Chi-squared test with Yates' continuity correction was used to compare two independent proportions and significance was set at P < 0.05. The publication rates were: oral presentations 50% (17/34), poster presentations 39% (9/23) and rejected presentations 20% (2/10). The mean and median time to publication was 23.8 and 21.0 months. Prospective design was the only variable identified to have a statistically significant effect on the publication rate (P < 0.002). The most common publishing journal was the Australian and New Zealand Journal of Surgery (12 of 26). Overall consistency (author and study sample consistency) from presentation to publication was 32%. The overall 46% publication rate of this state-based trainees-organized meeting compares favourably with international meetings. The research requirement of the Royal Australasian College of Surgeons (RACS), which includes presentation at the RPD in New South Wales, produces good quality papers for publication.     

The publication rates of presentations at major Spine Specialty Society meetings (NASS, SRS, ISSLS)

STUDY DESIGN: A review of all the presentations at three major spine specialty meetings held over a 3-year period. OBJECTIVES: To determine the rate of publication in peer-reviewed journals after presentations at major spine meetings conducted annually by the following three organizations: North American Spine Society (NASS), Scoliosis Research Society (SRS), and International Society for the Study of the Lumbar Spine (ISSLS). SUMMARY OF BACKGROUND DATA: The rate of publication for presentations at national and international meetings has been determined for medical and surgical subspecialties. This rate has been used to judge the quality of the content of the meetings and to determine the validity of the research presentations. METHODS: All presentations either in poster or oral presentation form were entered into a database covering a 3-year period for spine specialty meetings conducted annually by the following three organizations: NASS 1990 to 1992, SRS 1991 to 1993, and ISSLS 1991 to 1993. A computer search for each abstract was performed with the Melvyl Medline Plus database to determine if the abstract had been published in a peer-reviewed journal from 1990 to the end of 1997. Publication rates for presentations at these three meetings were determined over a 3-year period. RESULTS: A total of 1186 abstracts were listed over a 3-year period in the final programs of these three meetings for the years 1991 to 1993 (SRS, ISSLS) and 1990 to 1992 (NASS). Of these 1186 abstracts, 516 were published in peer-reviewed journals, giving an overall publication rate of 43.5%. The publication rates for the three different meetings (NASS, SRS, ISSLS) were similar, with values of 40%, 47%, and 45% respectively. More than 90% of the publications resulting from these meetings were published within a period of 4 years from the data of the meeting. CONCLUSIONS: The publication rates of presentations at three major spine specialty meetings are high and quite comparable with the publication rates of meetings in other medical subspecialties. This reflects the high quality of the meeting programs and validates their selection process.     

Publication Rates in Podium and Poster Presentations at the 2012-2014 American Association of Hip and Knee Surgeons Annual Meetings

Background

Subspecialty conferences are an important forum for disseminating the latest research relevant to clinical practice. The purpose of this study was to identify publication rates in podium and poster abstracts for the American Association of Hip and Knee Surgeons (AAHKS) Annual Meeting and to identify the most common journals of publication and the reasons for nonpublication.

Publication rate of General Surgery abstracts presented at the Royal Australasian College of Surgeons Annual Scientific Congress

Background

A commonly used metric for evaluating the quality and impact of presentations at a scientific meeting is the frequency with which the findings presented are published as full research papers in peer‐reviewed journals. The purpose of this study was to determine the full article publication rates of abstract presentations for General Surgery and related sub‐specialities at the Royal Australasian College of Surgeons Annual Scientific Congress (RACS ASC) from 2010 to 2014.

Methods

All General Surgical (including its sub‐speciality groups) abstracts presented at the RACS ASC from 2010 to 2014 were identified from the ANZ Journal of Surgery. We determined the rates of full paper publication, time to publication, journals of publication and specialty rates of conversion. Full article publications were identified using the PubMed, MEDLINE and Google Scholar databases.

Results

A total of 1386 abstracts were identified, of which 356 (26%) were converted to full paper publications. The number of abstracts presented annually increased from 206 in 2010 to 386 in 2014, but the percentage of abstracts converted to full paper publications did not follow any temporal trend. The majority (74%) of full papers were published within 2 years of the abstract presentation.

Conclusion

In total, 26% of General Surgery abstracts presented at the RACS ASC from 2010 to 2014 were converted to full paper publications. This could provide a baseline against which to judge the quality of presentations at other national General Surgical congresses, as well as at future RACS ASC meetings.     

Publication outcome for research presented at the Vascular Society of Great Britain and Ireland annual meetings

BACKGROUND The Vascular Society of Great Britain and Ireland (VSGBI) annual meeting is a major international vascular surgery conference. Studies suggest that the percentage of presentations that result in full-text publications are a measure of the quality of the meeting. We investigated the publication outcome of abstracts presented to the VSGBI in 2001 and 2002. MATERIALS AND METHODS We retrospectively identified abstracts from the conference programmes and conducted a detailed electronic Medline and PubMed search to determine publication. We collected data regarding the study design, subject matter,publishing journal, time to publication, institution of origin, impact factors and RAE levels. RESULTS There were 63 publications from 106 abstracts (59.4%), with a median impact factor of 3.507. Prospective observational studies accounted for 20.6% of publications, with abdominal aortic aneurysms being the commonest subject matter(34.9%). The median time to publication was 12 months, with the European Journal of Vascular and Endovascular Surgery publishing 33.3% of the articles. Leicester achieved the highest number of publications and the majority of work came from centres with Research Assessment Exercise (RAE) level scores of 4, university centres accounted for 74.6% of publications. CONCLUSIONS We conclude that when compared to equivalent meetings in other specialties and geographical regions, the annual meeting of the VSGBI is of the very highest quality.     

Publication rate of abstracts presented at the British Association of Urological Surgeons Annual Meeting

OBJECTIVE: To determine the number of peer-reviewed publications arising from the abstracts presented at the annual meetings of the British Association of Urological Surgeons (BAUS), and to assess urological trainees' attitudes to research in relationship to the pursuit of Specialist Registrar (SpR) training numbers and their perception of academic urology in the UK. METHODS: Publications resulting from presentations at the annual meetings of the BAUS 2001 and 2002 were searched for using the PubMed database. Variables that might influence the subsequent publication of abstracts in peer-reviewed journals were analysed. Whether institutions from other countries had similar publication rates to those in the UK was also assessed. SpRs were interviewed about their motivation to convert presentations to publications before and after their appointment to SpR training. RESULTS: In July 2004, 142 of 449 abstracts presented at BAUS 2001 and 2002 were published, giving a publication rate of approximately 42% on Kaplan-Meier analysis. The rate of publication appeared to continue to the end of the period of searching for publications. The publication rate arising from UK presentations was lower than that from the non-UK presentations (hazard ratio 0.75, 95% confidence interval 0.49-1.15, P = 0.14). Publication rates from podium and poster presentations were similar. Urology journals accounted for 75% of the publications. Of the SpRs evaluated, 83% did research and presented papers to obtain a training number rather than because of an inherent interest to pursue an academic career. CONCLUSIONS: The conversion rate from BAUS presentation to peer-reviewed publication at 36 months was similar on Kaplan-Meier analysis to that of the American Urological Association (AUA, 38%). Interestingly, the rate of publication from the AUA seems to be faster than from BAUS. In addition, presentations from outside the UK appeared to be published faster than those from the UK. Delegates attending these conferences need to consider this when deciding whether a particular presentation will influence their practice. British urology requires academics who are interested in pursuing high-quality research, and which is presented at major conferences with an intention to publish it in peer-reviewed journals.     

Publication rates of abstracts presented at annual musculoskeletal tumor society meetings

Beware of the unpublished abstract! What is the publication rate of abstracts presented at Musculoskeletal Tumor Society meetings, and how does this compare with other orthopaedic and medical meetings? Three hundred thirty-six podium presentations from six annual meetings were identified and their publication was searched at a minimum of 3 years after the event. An effort was made to determine what percent of these abstracts eventually were published in a peer-reviewed journal. It was determined that 137 abstracts were published for a publication rate of 41%. The average time between presentation at the meeting and publication was 21.8 plus or minus 13.5 months. The published articles appeared in 48 peer-reviewed journals. The rate of publication and time until publication was similar to other orthopaedic meetings and to other medical disciplines. Changes to the cohort, title, or authors occurred in approximately (1/3) of the published articles compared with the abstracts. These results suggest that for various reasons the majority of presented material at Musculoskeletal Tumor Society meetings may not survive peer review and may not be scientifically valid.     

When will I see you again? The fate of research findings from international wound care conferences*

Medical conferences provide a forum for the rapid dissemination of research directly to health professionals and academics. However, the published record of poster and oral presentations from these meetings is usually limited to abstracts. We aimed to assess how many wound studies presented as conference abstracts were eventually published in journals and to identify the factors that predicted publication. The study was a retrospective review. We identified abstracts relating to oral and poster presentation from two large wound conferences. Following data extraction from the abstracts, a systematic search was conducted to examine if the research was subsequently published as a journal article. A time-to-event analysis was conducted to assess predictive associations between features of the research reported in the conference abstracts and time to full publication. In total, 492 abstracts from two European wound care conferences were identified (467 after exclusions). Of the abstracts included, 60% (279) were for posters and 40% (188) were for oral presentations. Over half of the abstracts (53%) reported results from case studies or case series design. In total, only 57 (12%) of the abstracts included resulted in a related publication. Analysis suggested that those studies reporting positive findings were significantly more likely to be published (hazard ratio 1.79, P= 0.001, 95% CIs 1.26-2.55). Few studies presented as conference abstracts at these two wounds conferences were subsequently published. This may be because of the low methodological quality of studies accepted for poster or oral presentation.     

Publication rate of abstracts presented at the annual meeting of the American Urological Association

OBJECTIVE: To determine the rate and time-course of peer-reviewed publication of abstracts presented at the annual meetings of the American Urological Association (AUA). METHODS: All abstracts presented at the annual meetings of the AUA from 1998 to 2000 were searched in the PubMed database. To assess any significant predictors of ultimate peer-reviewed publication, abstract number, meeting year, presentation type (podium vs poster), type of research (basic vs clinical), date of publication and session name (i.e. prostate cancer: advanced) were entered into a database. RESULTS: The overall rate of publication was 37.8%. Survival analysis indicated that most abstracts were published within 2 years of their respective meetings. Univariate and multivariate techniques showed that none of the tested covariates were significant predictors of publication. CONCLUSIONS: Information presented at the AUA annual meetings should be carefully considered by physicians before implementation into their clinical practice. Researchers are encouraged to publish their data.     

Publication rates of presentations made at annual meetings of the American Orthopaedic Society for Sports Medicine and the Arthroscopy Association of North America

The purpose of this study was to determine the publication rates of presentations made at the annual meetings of 2 sports medicine specialty societies--the American Orthopaedic Society for Sports Medicine (AOSSM) and the Arthroscopy Association of North America (AANA). We created a database covering annual AOSSM meetings from 1990 to 1993 (4 years) and annual AANA meetings from 1991 to 1993 (3 years) and searched the Melvyl Medline Plus database for abstracts from 1990 through 1998 to determine which had been published in peer-reviewed journals. Of the 333 abstracts listed for the 1990 to 1993 meetings, 198 (59.5%) were published in peer-reviewed journals. Publication rates of the AOSSM and AANA meetings were 68.1% and 50.9%, respectively. The majority of articles were published in American Journal of Sports Medicine (40.1%) and Arthroscopy (30.3%). Publication rates of presentations made at meetings of these sports medicine specialty societies are high and exceed the publication rates associated with meetings of other medicine specialty societies.     

Discrepancies between proceedings abstracts and posters at a scientific meeting

The proceedings handbook of abstracts from scientific meetings aims to provide meeting attendees with an accurate summary of scientific presentations. Given that posters are prepared closer to the meeting than the abstracts for the proceedings book, we hypothesized that there is a high rate of inconsistency between abstracts in the proceedings handbook and the corresponding posters. We compared the poster abstracts printed in the proceedings handbook with the actual posters at the 71st annual meeting of the American Academy of Orthopaedic Surgeons in 2004. Our comparison included all 50 trauma posters and 52 adult reconstruction knee posters. This comparison revealed discrepancies in 76% of the presented posters. These changes were detected in all parts of the posters including titles (33%), authorship (49%), methods (8%), results (30%), and conclusions (2%). The sample size changed in 15% of the studies. Discrepancies between the trauma posters versus the adult reconstruction knee posters were similar. Our findings suggest that discrepancies between the poster abstracts in the proceedings handbook and actual poster presentations are common, but changes in conclusions are rare. Meeting attendees should not assume that the proceedings handbook provides an accurate reflection of poster presentations. Visiting the poster section is recommended.     

Observational analysis of BOA free-papers (2001): from presentation to publication and comparison with the American Academy of Orthopaedic Surgeons (AAOS)

Aim

The objectives of this study were to: determine the presentation to publication conversion rate (PPCR) in peer-reviewed indexed journals of free papers and posters presented at 12-14th September 2001 British Orthopaedic Association (BOA) annual meeting and to compare the publication rate with the American Academy of Orthopaedic Surgeons (AAOS) meeting in 2001.

Methodology

We looked at all presentations including both podium and poster presentations at British Orthopaedic Association meeting held in 2001 and assessed for subsequent publication as full-text article with a fixed PubMed search protocol. Once the abstract was identified as being published, we noted the name of the journal, citation, and time to presentation. The level of evidence was assigned for each abstract along the guidelines published by the centre for evidence-based medicine, Oxford, UK. This conversion rate was compared with the presentation to publication rate for the AAOS meeting in 2001.

Results

A total of 179 abstracts were presented at the 2001 BOA meeting. 65 of these were published as full-text articles in 30 different journals. The overall publication rate was 36.3%. The publication rate of the papers presented at AAOS annual meeting 2001 was 49% (367/756). The mean time from presentation to publication was 18.6 months (±9.4 months). Three fourths of them were published after 2 years of presentations (63% for AAOS). Majority of studies were either level III or IV. 14 full-text articles were published in Journal of Bone and Joint Surgery British (JBJS Br) and 8 in the Injury Journal.

Conclusions

This is the first study reporting the publication rate of presentations for BOA meeting and comparing it with the publication rate of AAOS meeting in 2001. The publication rate of BOA presentations is much lower than the AAOS meeting. We believe the publication rate is an important tool in judging the quality of research work and the reputation of a scientific meeting with higher conversion rates suggesting better quality. Thus, more stringent selection criteria need to be introduced so that the selected abstracts can withstand peer-view for publication as full-text articles.     

Summary of the 42nd Annual Meeting of the Pancreas Club

The annual meeting of the Pancreas Club, traditionally held during the same week as the meetings of the Society for the Surgery of the Alimentary Tract and Digestive Disease Week was held at the University of California San Diego on May 18, 2008 and consisted of both oral presentations and selected poster sessions. Submissions for the program numbered 143 abstracts of which 29 were chosen for oral presentation. There were 19 10-min presentations and ten were 3 min in length. Each was followed by 5- and 2-min discussion periods, respectively. In addition, 50 of the submitted abstracts were chosen for a designated poster session. Summaries of the presentations comprise the body of this report. A summary of the work presented at the 42nd Pancreas Club Meeting, May 18, 2008, University of California San Diego.     

Fate of abstracts from the Paris 1995 European Society of Anaesthesiologists meeting

BACKGROUND AND OBJECTIVE: To assess the publication rate of full papers presented as abstracts at the 1995 meeting of the European Society of Anaesthesiologists, and to assess factors that might predict subsequent full publication. METHODS: All abstracts presented at the meeting and published in the British Journal of Anaesthesia (Suppl 1, 1995) were included. To verify subsequent full publication, a MEDLINE search was performed and validated. We studied the average time from the meeting to publication, the first author's country, the subspeciality, the publishing journal of the full report, the type of presentation (oral or poster), the object of investigation, and the quality of research design and of statistical reporting in the abstract. RESULTS: Of 472 meeting abstracts, 199 (42.2%) were eventually published. The average (+/- SD) delay between meeting and publication was 16.8 (15.6) months (range 24-60 months). Most papers (79.4%) had been published within 3 yr of the meeting. Circulation, pharmacology and intensive care papers had the highest rates of publication. Sixty-three journals attracted papers, with the British Journal of Anaesthesia publishing most (n = 29). No difference in subsequent publication was found between oral and poster presentations. Randomized trials and animal research were more likely to be published. The number of authors or their positions differed between the abstract and the full publication in 145 cases (72.9%); the first author was changed in 43 cases. CONCLUSIONS: Less than half of the abstracts accepted at the 1995 European Society of Anesthesiologists' meeting were subsequently published in journals indexed by MEDLINE in the 3 yr following the meeting. Many changes in authorship occurred between the abstract and the full publication. The study architecture and the object of investigation predicted full publication.