Annotated normal CT data of the abdomen for deep learning: Challenges and strategies for implementation

PurposeThe purpose of this study was to report procedures developed to annotate abdominal computed tomography (CT) images from subjects without pancreatic disease that will be used as the input for deep convolutional neural networks (DNN) for development of deep learning algorithms for automatic recognition of a normal pancreas.Materials and methodsDual-phase contrast-enhanced volumetric CT acquired from 2005 to 2009 from potential kidney donors were retrospectively assessed. Four trained human annotators manually and sequentially annotated 22 structures in each datasets, then expert radiologists confirmed the annotation. For efficient annotation and data management, a commercial software package that supports three-dimensional segmentation was used.ResultsA total of 1150 dual-phase CT datasets from 575 subjects were annotated. There were 229 men and 346 women (mean age: 45 ± 12 years; range: 18–79 years). The mean intra-observer intra-subject dual-phase CT volume difference of all annotated structures was 4.27 mL (7.65%). The deep network prediction for multi-organ segmentation showed high fidelity with 89.4% and 1.29 mm in terms of mean Dice similarity coefficients and mean surface distances, respectively.ConclusionsA reliable data collection/annotation process for abdominal structures was developed. This process can be used to generate large datasets appropriate for deep learning.