Natural Language Processing for Identification of Incidental Pulmonary Nodules in Radiology Reports

PurposeTo develop natural language processing (NLP) to identify incidental lung nodules (ILNs) in radiology reports for assessment of management recommendations.Methods and MaterialsWe searched the electronic health records for patients who underwent chest CT during 2014 and 2017, before and after implementation of a department-wide dictation macro of the Fleischner Society recommendations. We randomly selected 950 unstructured chest CT reports and reviewed manually for ILNs. An NLP tool was trained and validated against the manually reviewed set, for the task of automated detection of ILNs with exclusion of previously known or definitively benign nodules. For ILNs found in the training and validation sets, we assessed whether reported management recommendations agreed with Fleischner Society guidelines. The guideline concordance of management recommendations was compared between 2014 and 2017.ResultsThe NLP tool identified ILNs with sensitivity and specificity of 91.1% and 82.2%, respectively, in the validation set. Positive and negative predictive values were 59.7% and 97.0%. In reports of ILNs in the training and validation sets before versus after introduction of a Fleischner reporting macro, there was no difference in the proportion of reports with ILNs (108 of 500 21.6%] versus 101 of 450 22.4%]; P = .8), or in the proportion of reports with ILNs containing follow-up recommendations (75 of 108 69.4%] versus 80 of 101 79.2%]; P = .2]. Rates of recommendation guideline concordance were not significantly different before and after implementation of the standardized macro (52 of 75 69.3%] versus 60 of 80 75.0%]; P = .43).ConclusionNLP reliably automates identification of ILNs in unstructured reports, pertinent to quality improvement efforts for ILN management.