Temporal subtraction for the detection of hazy pulmonary opacities on chest radiography

OBJECTIVE: The purpose of this study was to evaluate the accuracy of temporal subtraction with a commercially available computer-assisted diagnosis system for the detection of multifocal hazy pulmonary opacities on chest radiographs, which are sometimes difficult to detect directly on chest radiographs. MATERIALS AND METHODS: Thirty healthy patients and 30 patients with new multifocal hazy pulmonary opacities that were confirmed by serial chest CT examinations were evaluated with and without temporal subtraction images. Chest radiographs were taken from either film-screen or digital radiography images and were digitized with a spatial resolution of 0.171 mm per pixel. Temporal subtraction images were produced by an iterative image-warping technique. We designed an observer performance study in which observers (six chest radiologists and four residents) indicated their confidence level for the presence or absence of hazy pulmonary opacities on two sets of images, current and previous radiographs only (set A), and current and previous radiographs with temporal subtraction images (set B). Receiver operating characteristic curves were generated. RESULTS: For chest radiologists, observer performance with set B (with temporal subtraction images; A(z) = 0.947) was superior to that with set A (without temporal subtraction images; A(z) = 0.916) (p < 0.05). For residents, no statistically significant difference was found between sets A and B. CONCLUSION: The temporal subtraction technique clearly improves diagnostic accuracy for the detection of multifocal hazy pulmonary opacities on chest radiographs, especially when the observers are experienced chest radiologists who have sufficient skill to evaluate the patient's condition as revealed on the images.     

Improved detection of lung nodules by using a temporal subtraction technique

PURPOSE: To evaluate the effect of a temporal subtraction technique for digital chest radiography with regard to the accuracy of detection of lung nodules. MATERIALS AND METHODS: Twenty solitary lung nodules smaller than 30 mm in diameter, including 10 lung cancers and 10 benign nodules, were used. The nodules were grouped subjectively according to their subtlety. For non-nodular cases, 20 nodules without perceptible interval changes were selected. All chest radiographs were obtained by using a computed radiographic system, and temporal subtraction images were produced by using a program developed at the University of Chicago. The effect of the temporal subtraction image was evaluated by using an observer performance study, with use of receiver operating characteristic analysis. RESULTS: Observer performance with temporal subtraction images was substantially improved (A(z) = 0.980 and 0.958), as compared with that without temporal subtraction images (A(z) = 0.920 and 0.825) for the certified radiologists and radiology residents, respectively. The temporal subtraction technique clearly improved diagnostic accuracy for detecting lung nodules, especially subtle cases. CONCLUSION: The temporal subtraction technique is useful for improving detection accuracy for peripheral lung nodules on digital chest radiographs.     

Evaluation of usefulness of color digital summation radiography for solitary pulmonary nodules on chest radiographs

Purpose The aim of this study was to evaluate the usefulness of novel color digital summation radiography (CDSR) for detecting solitary pulmonary nodules on chest radiographs by observers with different levels of experience. Materials and methods A total of 30 healthy controls and 30 patients with newly detected solitary pulmonary nodules were evaluated. Six radiologists and five residents evaluated three image sets: set A, current and prior radiographs only; set B, set A with temporal subtraction images; and set C, set A with CDSR. The observers were asked to rate each image set using a continuous rating scale. In addition, the reading time required for each set was recorded. Results The radiologists showed no significant differences in the mean A_z value between set A, set B, and set C. However, the residents showed significant differences between set A and set B and between set A and set C. In addition, for set B and set C, the mean reading time per case of all readers was significantly shorter than that for set A. Conclusion The detection capability of observers with little experience is comparable to that of experienced observers when reading radiographs with temporal subtraction images or with CDSR. The usefulness of CDSR is comparable to that of temporal subtraction.     

深度卷积网络骨抑制技术对孤立性肺结节诊断效能的研究

目的评估新型骨抑制技术—深度卷积网络骨抑制成像(deep bone suppression imaging,deepBSI)对孤立性肺结节(solitary pulmonary nodule,SPN)的诊断效能,并与数字化X线片(digital radiograph,DR)、双能量减影技术(dual energy substraction,DES)进行对比分析。方法收集我院2016年12月~2017年9月拍摄标准胸部正位片247例(114例诊断SPN,133例无结节)。3位低年资及3位高年资医师按DR图像→DR+deepBSI图像→DR+DES图像的阅片顺序,分别在三组图像上标出结节可能位置并评分,进行Z检验,应用ROC曲线分析三种检查方法对SPN的诊断效能。结果6位医师,DR、deepBSI、DES三种检查方法诊断SPN的ROC曲线下面积分别约0.715、0.804、0.800,deepBSI、DES诊断效能均优于DR(P<0.05)。当结节与肋骨重叠面积>50%时,deepBSI、DES二种方法相比于DR诊断SPN的诊断效能越好。结论deepBSI、DES诊断效能均优于DR,有助于肺结节的检出,与肋骨重叠面积大的结节优势更显著,deepBSI、DES诊断敏感性及特异性始终相似。     

ROC Analysis of Detection of Metastatic Pulmonary Nodules on Digital Chest Radiographs with Temporal Subtraction

RATIONALE AND OBJECTIVES: The authors' purpose was to evaluate the effect of temporal subtraction on digital chest radiographs in the detection of metastatic pulmonary nodules. MATERIALS AND METHODS: The study included 21 cases with metastatic pulmonary nodule and 21 cases without metastatic nodule. Eleven radiologists, including eight residents and three certified radiologists, provided their confidence levels for the presence or absence of pulmonary nodules without and with temporal subtraction. Their performances without and with temporal subtraction were evaluated by means of receiver operating characteristic analysis with both independent and sequential tests. RESULTS: For the independent test, the radiologists' Az (area under the receiver operating characteristic curve) values were 0.871 without and 0.954 with temporal subtraction, compared with 0.882 and 0.955, respectively, for the sequential test. Diagnosis accuracy was significantly improved with the use of temporal subtraction. There was no significant difference in Az values between the independent and sequential tests. CONCLUSION: Temporal subtraction is useful in the detection of metastatic pulmonary nodules, and this technique augments the value of digital chest radiography.     

Clinical evaluation of pulmonary nodules with dual-exposure dual-energy subtraction chest radiography

PURPOSE: The purpose of this study was to assess the effect of dual-exposure dual-energy (DE) subtraction chest radiography with flat-panel detector. MATERIALS AND METHODS: One hundred patients underwent dual-exposure DE subtraction chest radiography and chest CT for evaluation of pulmonary nodules. Fifty-two patients with pulmonary nodules and 48 patients with normal lungs were selected for receiver operating characteristic (ROC) curve analysis. Ten radiologists who were unaware of the CT results evaluated chest radiography alone and chest radiography with DE subtraction images in the detection of pulmonary nodules. For each radiologist, we calculated the areas under the ROC curve (Az) for chest radiography alone and chest radiography with DE subtraction images. RESULTS: The average detectability of dual-exposure DE subtraction chest radiography was statistically significantly higher than that of chest radiography without subtraction images (mean Az value increased from 0.784 to 0.815, p<0.001). CONCLUSION: Dual-exposure DE subtraction chest radiography improves diagnostic accuracy of pulmonary nodules.     

Detection of lung nodules on digital chest radiographs: potential usefulness of a new contralateral subtraction technique

PURPOSE: To evaluate the potential usefulness of a contralateral subtraction technique developed for radiologists' performance in the detection of subtle lung nodules on chest radiographs. MATERIALS AND METHODS: Fifty chest radiographs (25 normal and 25 abnormal with a subtle lung nodule) that were digitized with a 0.175-mm pixel size and 4,096 gray levels were used. Twelve radiologists (10 attending and two residents) participated in observer tests and read both original and contralateral subtraction images with a sequential testing method. Radiologists' performance was evaluated by means of receiver operating characteristic analysis with use of a continuous rating scale. The beneficial and detrimental effects of the contralateral subtraction technique on the radiologists' performance were also evaluated. RESULTS: The area under the receiver operating characteristic curve values obtained without and with contralateral subtraction images were 0.926 and 0.962, respectively. Results indicated that the contralateral subtraction images significantly (P <.05) improved diagnostic accuracy, particularly for radiologists with limited experience. CONCLUSION: The contralateral subtraction technique can assist radiologists in the correct identification of subtle lung nodules on chest radiographs.     

Computerized analysis of the likelihood of malignancy in solitary pulmonary nodules with use of artificial neural networks

PURPOSE: To develop a computer-aided diagnostic scheme by using an artificial neural network (ANN) to assist radiologists in the distinction of benign and malignant pulmonary nodules. MATERIALS AND METHODS: Fifty-six chest radiographs of 34 primary lung cancers and 22 benign nodules were digitized with a 0.175-mm pixel size and a 10-bit gray scale. Eight subjective image features were evaluated and recorded by radiologists in each case. A computerized method was developed to extract objective features that could be correlated with the subjective features. An ANN was used to distinguish benign from malignant nodules on the basis of subjective or objective features. The performance of the ANN was compared with that of the radiologists by means of receiver operating characteristic (ROC) analysis. RESULTS: Performance of the ANN was considerably greater with objective features (area under the ROC curve, Az = 0.854) than with subjective features (Az = 0.761). Performance of the ANN was also greater than that of the radiologists (Az = 0.752). CONCLUSION: The computerized scheme has the potential to improve the diagnostic accuracy of radiologists in the distinction of benign and malignant solitary pulmonary nodules.     

ROC analysis of detection of interval changes in interstitial lung diseases on digital chest radiographs using the temporal subtraction technique

PURPOSE: To demonstrate the clinical usefulness of a temporal subtraction technique for the detection of interval changes in various interstitial lung diseases on digital chest radiographs. MATERIALS AND METHODS: One hundred pairs of chest radiographs in 34 patients (63 with and 37 without interval changes) with various interstitial lung diseases were selected. All cases were confirmed by serial chest computed tomography (CT) and ascertained by radiologists. All chest radiographs were obtained with a computed radiography (CR) system, and temporal subtraction images were produced with an iterative image-warping technique. Four radiologists and two thoracic physicians provided confidence levels for interval changes in interstitial lung diseases with and without temporal subtraction. Their performances with and without temporal subtraction were evaluated by means of receiver operating characteristic (ROC) analysis using a sequential test. RESULTS: The area under the ROC curve (Az) values of six observers obtained with and without temporal subtraction were 0.90 and 0.78, respectively. Results showed that the detection of interval changes in interstitial lung diseases was significantly improved by the use of temporal subtraction images compared with CR images alone(P = 0.002). Furthermore, the high detection rate was achieved with temporal subtraction images regardless of the subtlety and location of interval changes. CONCLUSION: Temporal subtraction improved the diagnostic accuracy of radiologists in detecting interval changes in interstitial lung diseases on chest radiographs. It was also useful for cases of multiple interval changes.     

Detectability of lung nodules using flat panel detector with dual energy subtraction by two shot method: evaluation by ROC method

The aim of this study was to evaluate the effectiveness of dual-exposure dual energy subtraction technique in flat-panel chest radiography for lung nodules detection. Chest radiographs were acquired in 100 patients (57 men and 43 women; mean age, 60.2 years; range, 18-89 years) using a flat-panel digital chest system. These images were evaluated by seven radiologists. A continuous rating scale of 0-100 was used to represent each observer's confidence level regarding the presence or absence of lung nodules. Observer performance for detection of lung nodules with subtraction images was tested by using receiver operating characteristic (ROC) analysis of individual and averaged reader data. The average area under the ROC curve (Az value) significantly increased with subtraction images (Az=0.79 in standard radiographs versus Az=0.84 with subtraction images, p<0.05). In conclusion, the two-exposure dual-energy subtraction chest radiography significantly would improve detection of lung nodules.     

Effect of temporal subtraction technique on the diagnosis of primary lung cancer with chest radiography

PURPOSE: The purpose of this study was to assess the diagnostic accuracy of the temporal subtraction technique in the detection of primary lung cancers by readers with different levels of experience. METHODS: Previous and current chest radiographs from 40 patients with histologically proven lung cancer and 40 controls were studied. Temporal subtraction images were produced using an automated digital subtraction technique. We evaluated the effect of temporal subtraction images in the diagnosis of lung cancer with chest radiographs via an observer performance study with the use of receiver operating characteristic analysis. Six experienced radiologists and six residents participated as observers. RESULTS: Observer performance for all observers was superior when temporal subtraction images were used (mean Az value increased from 0.764 to 0.836, p=0.0006). Although the average Az value for residents increased significantly, from 0.707 to 0.795 (p=0.0038), the average Az value for experienced radiologists increased only from 0.821 to 0.878 (n.s.). CONCLUSION: In conclusion, the temporal subtraction technique clearly improves diagnostic accuracy for the detection of primary lung cancer. The results indicated that the use of temporal subtraction images was more beneficial for the residents than for the experienced radiologists. This method would compensate to some extent for experience-dependent diagnostic accuracy in the detection of lung cancer.     

"Single-exposure" dual energy digital radiography in the detection of pulmonary nodules and calcifications

We studied the detectability of mineralized and non-mineralized simulated pulmonary nodules with dual energy digital radiography. "Soft tissue" and "bone" images (pixel size = 0.2 mm, 10 bits deep) were obtained with subtraction image processing after a single simultaneous exposure (100 kVp, 8 mAs, 17 mR skin exposure dose) of two storage phosphors with an interleaved 0.9 mm copper wafer. Three classes of paraffin-based nodules (0.5 to 3.0 cm) of varying mineral concentration (0, 120 and 190 mg/cm3 K2HPO4) were randomly positioned on the chest wall of two healthy volunteers to simulate calcified and non-calcified nodules. The average receiver operating characteristics (ROC) area of six readers (n = 2880 observations) showed that digital "bone" images (ROC area: 0.77 +/- 0.03) were significantly better (P less than 0.04) than conventional radiographs (OC Film, Lanex medium screens, 141 kVp, 19 mR skin exposure dose) (ROC area: 0.71 +/- 0.05) in detecting calcification in nodules. The unsubtracted digital images of lower kilovoltage were not superior to the 141 kVp conventional radiographs in a subgroup of two readers (ROC area: 0.73 +/- 0.02). Digital "soft tissue" images were equivalent to conventional chest radiographs in detecting soft tissue pulmonary nodules (ROC areas: 0.92 +/- 0.04 and 0.92 +/- 0.05, respectively.     

Effect of high sensitivity in a computerized scheme for detecting extremely subtle solitary pulmonary nodules in chest radiographs: observer performance study

RATIONALES AND OBJECTIVES: This study investigated the effect of a high sensitivity in computer-aided diagnosis (CAD) for detecting lung nodules in chest radiographs when extremely subtle cases were presented to radiologists. MATERIAL AND METHODS: The chest radiographs used in this study consisted of 36 normal images and 54 abnormals containing solitary lung nodules, of which 25 were extremely subtle and 29 were very subtle. Receiver operating characteristic analysis for detecting lung nodules was performed without and with CAD. The levels of CAD output were simulated with a hypothetical ideal performance of 100% sensitivity, but with three or four false positives per image. Six radiologists participated in an observer study in which cases were interpreted first without and then with the use of CAD. RESULTS: The average A(z) values for radiologists without and with CAD were 0.682 and 0.808, respectively. The performance of radiologists was improved significantly when high sensitivity was used (P = .0003). However, the radiologists were not able to recognize some extremely subtle nodules (5 of 54 nodules by all radiologists), even with the correct CAD output; these nodules were then considered as non-actionable. None of 306 computer-false positives was incorrectly regarded as a nodule by all radiologists, but 63 false positives were incorrectly identified by one or more radiologists. CONCLUSION: The accuracy of radiologists in the detection of some extremely subtle solitary pulmonary nodules can be improved significantly when the sensitivity of a CAD scheme can be made to be at an extremely high level. However, all of the six radiologists failed to identify some nodules (about 10%), even with the correct output of the CAD.     

Improved detection of lung nodules on chest radiographs using a commercial computer-aided diagnosis system

OBJECTIVE: The aim of this study was to evaluate the usefulness of a new commercially available computer-aided diagnosis (CAD) system with an automated method of detecting nodules due to lung cancers on chest radiograph. MATERIALS AND METHODS: For patients with cancer, 45 cases with solitary lung nodules up to 25 mm in diameter (nodule size range, 8-25 mm in diameter; mean, 18 mm; median, 20 mm) were used. For healthy patients, 45 cases were selected on the basis of confirmation on chest CT. All chest radiographs were obtained with a computed radiography system. The CAD output images were produced with a newly developed CAD system, which consisted of an image server including CAD software called EpiSight/XR. Eight radiologists (four board-certified radiologists and four radiology residents) participated in observer performance studies and interpreted both the original radiographs and CAD output images using a sequential testing method. The observers' performance was evaluated with receiver operating characteristic analysis. RESULTS: The average area under the curve value increased significantly from 0.924 without to 0.986 with CAD output images. Individually, the use of CAD output images was more beneficial to radiology residents than to board-certified radiologists. CONCLUSION: This CAD system for digital chest radiographs can assist radiologists and has the potential to improve the detection of lung nodules due to lung cancer.     

Computer-aided diagnosis in chest radiography: results of large-scale observer tests at the 1996-2001 RSNA scientific assemblies.

Since 1996, computer-aided diagnosis (CAD) schemes have been presented as interactive demonstrations on computer workstations at each scientific assembly of the Radiological Society of North America. The schemes involved (a) detection of pulmonary nodules, (b) temporal subtraction, (c) detection of interstitial lung disease, (d) differential diagnosis of interstitial lung disease, and (e) distinction between benign and malignant pulmonary nodules on chest radiographs. Large-scale observer tests were carried out to examine how radiologists can benefit from CAD systems. Observer performance was evaluated by analysis of receiver operating characteristic (ROC) curves. The statistical significance of the difference between the areas under the ROC curves without and with CAD was analyzed with the Student t test. In all of the tests, the diagnostic accuracy of the radiologists in total improved significantly when CAD was used. This result provides additional evidence that CAD has the potential to improve the performance of radiologists in their decision-making process in interpreting chest radiographs. Copyright RSNA, 2003.     

肋骨抑制成像在胸部平片肺结节检出中的应用

目的 评价肋骨抑制成像技术在胸部平片检出肺结节中的价值.方法 回顾性分析141例胸部后前位X线片,其中95例有单发肺结节,作为研究组,46例无肺结节作为对照组.2名高年资与2名低年资放射科医师分别独立阅读所有胸部后前位X线片和经肋骨抑制成像技术处理后的胸部后前位X线片.阅读、记录结节的部位、大小并对结节存在的肯定度进行评分.观察的结果采用受试者工作特征(ROC)曲线进行分析.结果 肺结节的平均直径为(1.9±1)cm,直径范围是0.9~2.9 cm.胸部后前位X线片ROC曲线下面积(AUC)为0.844,肋骨抑制成像技术处理后的胸部后前位X线片AUC为0.873,两者有统计学差异(P<0.01).结论 肋骨抑制成像技术可以显著提高放射科医师对胸部后前位X片中肺结节的检出率.     

Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules

OBJECTIVE: We developed a digital image database (www.macnet.or.jp/jsrt2/cdrom_nodules.html ) of 247 chest radiographs with and without a lung nodule. The aim of this study was to investigate the characteristics of image databases for potential use in various digital image research projects. Radiologists' detection of solitary pulmonary nodules included in the database was evaluated using a receiver operating characteristic (ROC) analysis. MATERIALS AND METHODS: One hundred and fifty-four conventional chest radiographs with a lung nodule and 93 radiographs without a nodule were selected from 14 medical centers and were digitized by a laser digitizer with a 2048 x 2048 matrix size (0.175-mm pixels) and a 12-bit gray scale. Lung nodule images were classified into five groups according to the degrees of subtlety shown. The observations of 20 participating radiologists were subjected to ROC analysis for detecting solitary pulmonary nodules. Experimental results (areas under the curve, Az) obtained from observer studies were used for characterization of five groups of lung nodules with different degrees of subtlety. RESULTS: ROC analysis showed that the database included a wide range of various nodules yielding Az values from 0.574 to 0.991 for the five categories of cases for different degrees of subtlety. CONCLUSION: This database can be useful for many purposes, including research, education, quality assurance, and other demonstrations.     

Pulmonary nodules: estimation of malignancy at thin-section helical CT--effect of computer-aided diagnosis on performance of radiologists

PURPOSE: To evaluate the effect of a computer-aided diagnosis (CAD) system on the diagnostic performance of radiologists for the estimation of the malignancy of pulmonary nodules on thin-section helical computed tomographic (CT) scans. MATERIALS AND METHODS: The institutional review board approved use of the CT database; informed specific study-related consent was waived. The institutional review board approved participation of radiologists; informed consent was obtained from all observers. Thirty-three (18 malignant, 15 benign) pulmonary nodules of less than 3.0 cm in maximal diameter were evaluated. Receiver operating characteristic (ROC) analysis with a continuous rating scale was used to compare observer performance for the estimation of the likelihood of malignancy first without and then with the CAD system. The participants were 10 board-certified radiologists and nine radiology residents. RESULTS: For all 19 participants, the mean area under the best-fit ROC curve (A(z)) values achieved without and with the CAD system were 0.843 +/- 0.097 (standard deviation) and 0.924 +/- 0.043, respectively. The difference was significant (P = .021). The mean A(z) values achieved without and with the CAD system were 0.910 +/- 0.052 and 0.944 +/- 0.040, respectively, for the 10 board-certified radiologists (P = .190) and 0.768 +/- 0.078 and 0.901 +/- 0.036, respectively, for the nine radiology residents (P = .009). CONCLUSION: Use of the CAD system significantly (P = .009) improved the diagnostic performance of radiology residents for assessment of the malignancy of pulmonary nodules; however, it did not improve that of board-certified radiologists.     

Comparison of LCD and CRT monitors for detection of pulmonary nodules and interstitial lung diseases on digital chest radiographs by using receiver operating characteristic analysis

Soft copy reading of digital images has been practiced commonly in the PACS environment. In this study, we compared liquid-crystal display (LCD) and cathode-ray tube (CRT) monitors for detection of pulmonary nodules and interstitial lung diseases on digital chest radiographs by using receiver operating characteristic (ROC) analysis. Digital chest images with a 1000x1000 matrix size and a 8 bit grayscale were displayed on LCD/CRT monitor with 2M pixels in each observer test. Eight and ten radiologists participated in the observer tests for detection of nodules and interstitial diseases, respectively. In each observer test, radiologists marked their confidence levels for diagnosis of pulmonary nodules or interstitial diseases. The detection performance of radiologists was evaluated by ROC analyses. The average Az values (area under the ROC curve) in detecting pulmonary nodules with LCD and CRT monitors were 0.792 and 0.814, respectively. In addition, the average Az values in detecting interstitial diseases with LCD and CRT monitors were 0.951 and 0.953, respectively. There was no statistically significant difference between LCD and CRT for both detection of pulmonary nodules (P=0.522) and interstitial lung diseases (P=0.869). Therefore, we believe that the LCD monitor instead of the CRT monitor can be used for the diagnosis of pulmonary nodules and interstitial lung diseases in digital chest images.     

Liquid-Crystal Display Monitors and Cathode-Ray Tube Monitors: A Comparison of Observer Performance in the Detection of Small Solitary Pulmonary Nodules

Objective

To compare observer performance using liquid-crystal display (LCD) and cathode-ray tube (CRT) monitors in the interpretation of soft-copy chest radiographs for the detection of small solitary pulmonary nodules.

Materials and Methods

By reviewing our Medical Center''s radiologic information system, the eight radiologists participating in this study (three board-certified and five resident) retrospectively collected 40 chest radiographs showing a solitary noncalcified pulmonary nodule approximately 1 cm in diameter, and 40 normal chest radiographs. All were obtained using a storage-phosphor system, and CT scans of the same patients served as the gold standard for the presence of a pulmonary nodule. Digital images were displayed on both high-resolution LCD and CRT monitors. The readers were requested to rank each image using a five-point scale (1 = definitely negative, 3 = equivocal or indeterminate, 5 = definitely positive), and the data were interpreted using receiver operating characteristic (ROC) analysis.

Results

The mean area under the ROC curve was 0.8901±0.0259 for the LCD session, and 0.8716±0.0266 for the CRT session (p > 0.05). The reading time for the LCD session was not significantly different from that for the CRT session (37.12 and 41.46 minutes, respectively; p = 0.889).

Conclusion

For detecting small solitary pulmonary nodules, an LCD monitor and a CRT monitor are comparable.