Content Analysis of Reporting Templates and Free-Text Radiology Reports

The Radiological Society of North America (RSNA) has developed a set of templates for structured reporting of radiology results. To measure how much of the content of conventional narrative (“free-text”) reports is covered by the concepts included in the RSNA reporting templates, we selected five reporting templates that represented a variety of imaging modalities and organ systems. From a sample of 8,275 consecutive, de-identified radiology reports from an academic medical center, we identified one corresponding imaging procedure code for each reporting template. The reports were annotated with RadLex and SNOMED CT terms using the BioPortal Annotator web service. The reporting templates we examined accounted for 17 to 49 % of the concepts that actually appeared in a sample of corresponding radiology reports. The findings suggest that the concepts that appear in the reporting templates occur frequently within free-text clinical reports; thus, the templates provide useful coverage of the “domain of discourse” in radiology reports. The techniques used in this study may be helpful to guide the development of reporting templates by identifying concepts that occur frequently in radiology reports, to evaluate the coverage of existing templates, and to establish global benchmarks for reporting templates.     

Efficacy of a Checklist-Style Structured Radiology Reporting Template in Reducing Resident Misses on Cervical Spine Computed Tomography Examinations

The increasing use of medical checklists to promote patient safety raises the question of their utility in diagnostic radiology. This study evaluates the efficacy of a checklist-style reporting template in reducing resident misses on cervical spine CT examinations. A checklist-style reporting template for cervical spine CTs was created at our institution and mandated for resident preliminary reports. Ten months after implementation of the template, we performed a retrospective cohort study comparing rates of emergent pathology missed on reports generated with and without the checklist-style reporting template. In 1,832 reports generated without using the checklist-style template, 25 (17.6 %) out of 142 emergent findings were missed. In 1,081 reports generated using the checklist-style template, 13 (11.9 %) out of 109 emergent findings were missed. The decrease in missed pathology was not statistically significant (p = 0.21). However, larger differences were noted in the detection of emergent non-fracture findings, with 17 (28.3 %) out of 60 findings missed on reports without use of the checklist template and 5 (9.3 %) out of 54 findings missed on reports using the checklist template, representing a statistically significant decrease in missed non-fracture findings (p = 0.01). The use of a checklist-style structured reporting template resulted in a statistically significant decrease in missed non-fracture findings on cervical spine CTs. The lack of statistically significant change in missed fractures was expected given that residents’ search patterns naturally include fracture detection. Our findings suggest that the use of checklists in structured reporting may increase diagnostic accuracy.     

Prepopulated Radiology Report Templates: A Prospective Analysis of Error Rate and Turnaround Time

Current speech recognition software allows exam-specific standard reports to be prepopulated into the dictation field based on the radiology information system procedure code. While it is thought that prepopulating reports can decrease the time required to dictate a study and the overall number of errors in the final report, this hypothesis has not been studied in a clinical setting. A prospective study was performed. During the first week, radiologists dictated all studies using prepopulated standard reports. During the second week, all studies were dictated after prepopulated reports had been disabled. Final radiology reports were evaluated for 11 different types of errors. Each error within a report was classified individually. The median time required to dictate an exam was compared between the 2 weeks. There were 12,387 reports dictated during the study, of which, 1,173 randomly distributed reports were analyzed for errors. There was no difference in the number of errors per report between the 2 weeks; however, radiologists overwhelmingly preferred using a standard report both weeks. Grammatical errors were by far the most common error type, followed by missense errors and errors of omission. There was no significant difference in the median dictation time when comparing studies performed each week. The use of prepopulated reports does not alone affect the error rate or dictation time of radiology reports. While it is a useful feature for radiologists, it must be coupled with other strategies in order to decrease errors.     

Creation and Implementation of Department-Wide Structured Reports: An Analysis of the Impact on Error Rate in Radiology Reports

The purpose of this study was to evaluate and compare textual error rates and subtypes in radiology reports before and after implementation of department-wide structured reports. Randomly selected radiology reports that were generated following the implementation of department-wide structured reports were evaluated for textual errors by two radiologists. For each report, the text was compared to the corresponding audio file. Errors in each report were tabulated and classified. Error rates were compared to results from a prior study performed prior to implementation of structured reports. Calculated error rates included the average number of errors per report, average number of nongrammatical errors per report, the percentage of reports with an error, and the percentage of reports with a nongrammatical error. Identical versions of voice-recognition software were used for both studies. A total of 644 radiology reports were randomly evaluated as part of this study. There was a statistically significant reduction in the percentage of reports with nongrammatical errors (33 to 26 %; p = 0.024). The likelihood of at least one missense omission error (omission errors that changed the meaning of a phrase or sentence) occurring in a report was significantly reduced from 3.5 to 1.2 % (p = 0.0175). A statistically significant reduction in the likelihood of at least one comission error (retained statements from a standardized report that contradict the dictated findings or impression) occurring in a report was also observed (3.9 to 0.8 %; p = 0.0007). Carefully constructed structured reports can help to reduce certain error types in radiology reports.     

Analysis of Pattern-Reversal Visual Evoked-Potential Topography: Replicability in Normal Subjects and Comparisons with Alzheimer''s Disease

This paper reports two studies using multivariate analysis to aid the interpretation of cross-coherence of multiple electrode sites in evoked potential responses. In the first study, the replicability of principal components and multidimensional scaling was evaluated by applying both methods to pattern-reversal visual evoked potentials recorded from 28 scalp sites in two subgroups of sex- and age-matched healthy subjects, and then comparing the results. Four dimensions replicated in the two initial multidimensional scaling solutions and appeared to reflect differences in: 1) anterior versus posterior scalp areas, 2) laterality, 3) separation of frontal and occipital sites from other scalp regions, and 4) proximal versus distal placements. The initial principal components did not match well in the two groups, but rotation to congruence improved their replicability and ultimately yielded axes similar to those of the multidimensional scaling dimensions. In the second study, Alzheimer's disease and sex- and age-matched control subjects were evaluated. The four axes identified were the same as those described above, but after the solutions were rotated to align them, the group differences appeared negligible. Examination of the components and dimensions from both studies showed some consistent departures from being merely reflectors of site location, and the apparently visual dimension appeared clearly in all four groups. Judged on the basis of initial interpretability and replicability of the solutions, the results suggest that multidimensional scaling, with appropriate transformation, may provide an effective tool for analyzing pattern-reversal visual evoked-potential topography.     

Histological Analysis of Benign Breast Imaging Reporting and Data System Categories 4c and 5 Breast Lesions in Imaging Study

Purpose

The objective of this study was to analyze the histology of breast lesions categorized as Breast Imaging Reporting and Data System (BI-RADS) 4c or 5 breast lesions during the imaging evaluation, but diagnosed as benign during the histological evaluation.

Materials and Methods

We retrospectively reviewed 71 breast lesions categorized as BI-RADS 4c or 5 during imaging study, but diagnosed as benign upon histological evaluation.

Results

Breast lesions were classified into six groups upon histological analysis: intraductal papilloma (18 cases), inflammatory group (15 cases), fibroepithelial tumor (14 cases), clustered microcalcification (10 cases), minimal histological alteration (10 cases), and adenosis (4 cases). Sclerosis and architectural complexity were associated with most of the biopsies that were morphologically similar to malignancy.

Conclusion

Among 71 cases categorized as 4c or 5 during the imaging study, but diagnosed as benign upon histological examination, intraductal papilloma was the most frequently identified histological lesion. These 71 cases exhibited histological characteristics of sclerosis and/or complex/complicated features that should be histologically differentiated from malignancy during evaluation.