Receiver-operating-characteristic study of chest radiographs in children: digital hard-copy film vs 2K x 2K soft-copy images.

Two methods are commonly used to visualize digital radiologic imaging data: (1) hard-copy viewing, in which the digital data are used to modulate the intensity of a laser beam that exposes an analog film and (2) soft-copy viewing, in which the digital data are converted to an analog video signal and presented on a CRT monitor. The film method allows new digital imaging systems to be easily integrated into conventional radiologic management and viewing methods. The second method, soft-copy viewing, allows digital imaging data to be managed and viewed electronically in a picture archiving and communication system (PACS). These PACS systems are hypothesized to have improved operational efficiency and enhanced image-analysis capabilities. The quality of soft-copy images is still not widely accepted. This article reports on the results of a large-scale receiver-operating-characteristic study comparing observers' performance in detecting various pediatric chest abnormalities on soft-copy 2048 x 2048K byte displays with their performance with digital laser-printed film from computed radiography. The disease categories studied were pneumothorax, linear atelectasis, air bronchogram, and interstitial disease. The selected data set included 239 images; 77 contained no proved abnormality and 162 contained one or more of the abnormalities mentioned. Seven pediatric radiologists participated in the study, two as judges and five as observers. Our results show no significant difference between viewing images on digital hard copy and soft copy for the detection of pneumothoraces and air bronchograms. A slight performance edge for soft copy was seen for interstitial disease and linear atelectasis. This result indicates that computed chest radiographs in children viewed in a soft-copy PACS environment should result in diagnoses similar to or slightly more accurate than those obtained in a laser-printed film-based environment.     

Interpretation of chest radiographs in the intensive care unit: a hard- versus soft-copy comparative study

PURPOSE: To compare the reliability of hard- versus soft-copy interpretation of intensive care unit chest radiographs, using a non-specialized standard resolution computer screen. MATERIALS AND METHODS: 104 chest radiographs were included in this study. Three physicians (one radiology resident, one intensive care unit resident and one experienced intensive care unit physician) gave their interpretations on computerized grids. Results were analyzed statistically using ROC curves and Kappa (kappa) index of concordance with experts. RESULTS: Results for reanimation equipment detection are almost independent from the modality (kappa(soft-copy)=0.891+/-0.037, kappa(hard-copy)=0.899+/-0.037). Regarding pathology detection, a global analysis only shows a difference at the limits of significance to the advantage of hard-copy films (kappa(soft)=0.514 +/-0.028, kappa(hard)=0.572+/-0.028). Overall results were significantly better for the radiologist compared to the intensive care unit physicians (kappa(radiologist)=0.751+/-0.048, kappa(intensive-care)=0.405+/-0.048). CONCLUSION: Concerning the task that is studied here, which requires only routine computer equipment, our results suggest that human factors can be more important than material factors.     

MRI of meniscal lesions: soft-copy (PACS) and hard-copy evaluation versus reviewer experience

OBJECTIVE: The purpose of our study was to compare diagnostic performance, reviewer confidence, and time requirements in the MRI diagnosis of meniscal tears for three types of reviewers and two types of image documentations (PACS vs hard copies). MATERIALS AND METHODS: An experienced musculoskeletal radiologist (reviewer 1), a fellow in musculoskeletal radiology (reviewer 2), and a junior staff member in orthopedic surgery (reviewer 3) evaluated MR images displayed on PACS monitors and hard copies independently and in a blinded fashion with regard to the presence or absence of meniscal tears. Seventy-one patients (mean age, 45.4 years; range, 16-80 years) were consecutively included if they had undergone both MRI of the knee and arthroscopy within 4 months. Arthroscopy was the standard of reference. Evaluation time and the reviewer's confidence in his or her diagnosis (Visual Analogue Scale, possible values of 0-100) were determined. RESULTS: Accuracies, sensitivities, and specificities in diagnosing meniscal tears were 80-87%, 63-85%, and 87-93% for soft copies and 82-85%, 64-76%, and 87-94.0%, respectively, for hard copies. Intrareviewer differences between PACS and hard copies were not significant for any of the three reviewers (McNemar tests). Reviewer 3 was less sensitive but more specific in the diagnosis of meniscal tears than reviewers 1 and 2. This difference was significant for both the PACS and hard copies. The reviewers' confidence in their diagnoses and evaluation times were not significantly different for PACS and hard copies (analysis of variance with Bonferroni post hoc analysis). CONCLUSION: Differences in the diagnostic performance of suspected meniscal tears depend on reviewer experience rather than on the type of documentation.     

Schematic interpretation of lateral neck radiographs of adults in the emergency department: a pictorial review

The lateral neck radiograph is widely utilized for the evaluation of common neck conditions in the emergency department. The anatomy of the neck is complex and it can be difficult to differentiate between soft tissue structures on a lateral radiograph. We suggest a schematic pattern of interpreting the lateral neck radiograph with case images of various pathologies that can present in the emergency setting.     

Urinary calculi on computed radiography: comparison of observer performance with hard-copy versus soft-copy images on different viewer systems.

OBJECTIVE: The purpose of this study was to compare observer performance for detecting urinary calculi using abdominal computed radiography with hard-copy versus soft-copy images and with a high-resolution video monitor versus a liquid-crystal-display (LCD) monitor. MATERIALS AND METHODS: We compared observer performance for detecting urinary calculi using three sets of radiographs-hard-copy images, soft-copy images displayed on a LCD monitor (1280 x 1024 bits), and soft-copy images displayed on a high-resolution video monitor using receiver operating characteristic curve analysis with a continuous rating scale. Computed radiography was archived with a 2140 x 1760 pixel resolution and a 10-bit depth. The selected data set included 62 images: 27 images showing proven urinary calculi smaller than 6 mm and three in number, and 35 images containing no proven abnormalities. Eleven radiologists (three genitourinary radiologists and eight general radiologists) participated in the study. Interpretations of three sets of randomly distributed radiographs were performed individually in three separate sessions at 1-week intervals. RESULTS: No statistically significant differences were found in the area under the receiver operating characteristic curve for detecting urinary calculi or in the interpreting times between soft-copy and hard-copy images; the mean areas under the receiver operating characteristic curve of hard-copy images, soft-copy images displayed on an LCD monitor, and soft-copy images displayed on a high-resolution video monitor were 0.579, 0.610, and 0.732, respectively. However, soft-copy images showed relatively improved diagnostic accuracy among less experienced radiologists (p < 0.05). CONCLUSION: For detecting urinary calculi, soft-copy images offered a diagnostic accuracy similar to or slightly more accurate than that of hard-copy images obtained in a laser-printed film-based environment. The diagnostic performance with soft-copy images viewed on an LCD monitor was comparable to that of soft-copy images viewed on a high-resolution video monitor.     

Soft copy interpretation of emergency department examinations

The ability of the radiology department to fully support 24-hour emergency services is becoming increasingly critical in the modern health care environment. Physical separation of departments and the unique requirements of the emergency department, however, can limit the quality of the resulting services provided by radiology with both unreported studies and an undesirable delay in interpretation. The introduction of a picture archiving and communication system (PACS) with diagnostic quality workstations has allowed the initiation of full-time soft copy image interpretation for services rendered to the emergency department. Soft copy interpretation with PACS archiving has reduced the number of unreported examinations, shortened the time to interpretation, and markedly improved the accountability for examinations performed for the emergency department.The opinions or assertions contained in this article are the private views of the authors and are not to be construed as official or as reflecting the views of the Army Medical Department, the Department of the Army, or the Department of Defense.Presented at the 6th Annual Meeting of the American Society of Emergency Radiology, Scottsdale, AZ, March 25–29, 1995.     

Soft-copy versus hard-copy interpretation of voiding cystourethrography in neonates, infants, and children

OBJECTIVE: Our aim is to determine whether agreement occurs between soft-copy (at a review workstation) and hard-copy (on laser-printed film) interpretations of fluoroscopic voiding cystourethrograms in neonates, infants, and children. SUBJECTS AND METHODS: Voiding cystourethrography was performed on 74 children (range, 2 weeks to 11 years old; mean, 3 years 6 months) for the evaluation of vesicoureteral reflux. The right and left ureters were scored separately by two observers on a scale of 0-5 using the international grading standard. Differences were tested for statistical significance with a marginal homogeneity test, and the strength of agreement was assessed using the kappa statistic. RESULTS: Of the 148 ureters evaluated, 39 showed vesicoureteral reflux and 109 showed no vesicoureteral reflux on both soft copy and hard copy. For 128 of 148 evaluations, interpretations of soft copy and hard copy produced agreement as to the grade of vesicoureteral reflux. For 11 of the 20 ureters with divergent interpretations, hard copy was scored one grade lower than soft copy; for the remaining nine ureters, hard copy was scored one grade higher than soft copy. No score differed by more than one grade. We found no statistically significant difference between soft-copy and hard-copy scores (p = .65), and agreement using the kappa statistic was substantial (.68). CONCLUSION: Soft-copy interpretation of voiding cystourethrograms is similar to hard-copy interpretation for vesicoureteral reflux.     

Cranial CT interpretation by senior emergency department staff

The aims of the present study were to determine the rate of misinterpretation of non-contrast cranial CT scans by emergency specialists and trainees compared with specialist radiologists, and the proportion of misinterpretations that is consequential. A 12-month prospective blinded cohort study was performed. One-hundred and ninety of 1,282 scans (14.8%) were misinterpreted, and 78 of these (41.1%) were of potential or actual consequence. We conclude that the performance of senior emergency department staff in non-contrast cranial CT interpretation is no better than moderately good, and a large proportion of misinterpretations are of potential or actual clinical consequence.     

Flat-panel digital mammography system: contrast-detail comparison between screen-film radiographs and hard-copy images

PURPOSE: To compare the contrast-detail (CD) characteristics of screen-film (SF) and postprocessed digital images by using a phantom-based method. MATERIALS AND METHODS: Images of a CD phantom with polymerized methyl methacrylate were acquired with SF and full-field digital mammography systems at matched exposure conditions. A four-alternative forced-choice experiment was conducted with seven observers participating in the study. Each observer was required to identify randomly located disks in phantom images from which detection curves were computed. The CD diagrams for the SF and digital systems were estimated from the detection curves and compared at 50% and 62.5% threshold levels. Furthermore, a theoretic model was used to estimate the CD performance of the SF and digital systems. RESULTS: Analysis of covariance for mixed models was used with the natural logarithm of disk thickness as the dependent variable, the natural logarithm of disk diameter as the covariate, and the observer as a random factor. The results of statistical analysis indicated significant differences between the CD characteristics of SF and digital mammographic images at both 50% (P <.001) and 62.5% (P <.001) detection thresholds. CONCLUSION: The authors conclude that digital CD curves, on average, exhibit threshold contrast characteristics that are lower (better) than those of SF mammography.     

Comparison of observer performance on soft-copy reading of digital chest radiographs: high resolution liquid-crystal display monitors versus cathode-ray tube monitors

The purpose of this study is to compare observer performance for detection of abnormalities on chest radiographs with 5-megapixel resolution liquid-crystal displays (LCD) and 5-megapixel resolution cathode-ray tube (CRT) monitors under bright and subdued ambient light conditions. Six radiologists reviewed a total of 254 digital chest radiographs under four different conditions with a combination of two types of monitors (a 5-megapixel resolution LCD and a 5-megapixel resolution CRT monitor) and with two types of ambient light (460 and 50 lux). The abnormalities analyzed were nodules, pneumothorax and interstitial lung disease. For each reader, the detection performance using 5-megapixel LCD and 5-megapixel CRT monitors under bright and subdued ambient light conditions were compared using multi-case and multi-modality ROC analysis. For each type of ambient light, the average detection performance with the two types of monitors was also compared. For each reader, the observer performance of 5-megapixel LCD and 5-megapixel CRT monitors, under both bright and subdued ambient light conditions, showed no significant statistical differences for detecting nodules, pneumothorax and interstitial lung disease. In addition, there was no significant statistical difference in the average performance when the two monitor displays, under both bright and subdued ambient light conditions, were compared.     

Acute abdominal pain in children: usefulness of three-view abdominal radiographs in the emergency department

Diagnostic imaging is often an integral component in the workup of a pediatric patient with acute abdominal pain. The purpose of this study was to compare the diagnostic value of a three-view acute abdominal series (AAS) with that of a single supine view (SSV) in children with acute abdominal pain. All subjects aged ≤18 years that underwent an emergency three-view AAS examination for acute abdominal pain at a single urban hospital system were included. Retrospective evaluation of radiological diagnosis, number of radiological images, further imaging, management, and clinical outcomes was performed. “Positive” AAS studies were compared with corresponding SSV images for direct comparison of diagnostic value. Standard nonparametric statistical evaluation was performed. Five hundred forty-one AAS studies were included in the study. Greater than three radiographs were acquired in 29 % (153/541) of the subjects. Two hundred ninety-nine out of 541 AAS studies included a technically adequate SSV of the abdomen and pelvis. Most AAS examinations were categorized as negative (n = 485; 90 %). Of the 56 examinations initially classified as positive, there was no significant statistical difference between diagnostic accuracy between the AAS and SSV on retrospective evaluation. For pediatric subjects with nontraumatic acute abdominal pain, the yield of conventional radiographic study is exceedingly low. If required, a technically adequate single supine anteroposterior (AP) view of the abdomen and pelvis is sufficient for initial radiographic evaluation while reducing unnecessary radiation exposure to the patient.