Image quality assessment in digital mammography: part I. Technical characterization of the systems

In many European countries, image quality for digital x-ray systems used in screening mammography is currently specified using a threshold-detail detectability method. This is a two-part study that proposes an alternative method based on calculated detectability for a model observer: the first part of the work presents a characterization of the systems. Eleven digital mammography systems were included in the study; four computed radiography (CR) systems, and a group of seven digital radiography (DR) detectors, composed of three amorphous selenium-based detectors, three caesium iodide scintillator systems and a silicon wafer-based photon counting system. The technical parameters assessed included the system response curve, detector uniformity error, pre-sampling modulation transfer function (MTF), normalized noise power spectrum (NNPS) and detective quantum efficiency (DQE). Approximate quantum noise limited exposure range was examined using a separation of noise sources based upon standard deviation. Noise separation showed that electronic noise was the dominant noise at low detector air kerma for three systems; the remaining systems showed quantum noise limited behaviour between 12.5 and 380 μGy. Greater variation in detector MTF was found for the DR group compared to the CR systems; MTF at 5 mm(-1) varied from 0.08 to 0.23 for the CR detectors against a range of 0.16-0.64 for the DR units. The needle CR detector had a higher MTF, lower NNPS and higher DQE at 5 mm(-1) than the powder CR phosphors. DQE at 5 mm(-1) ranged from 0.02 to 0.20 for the CR systems, while DQE at 5 mm(-1) for the DR group ranged from 0.04 to 0.41, indicating higher DQE for the DR detectors and needle CR system than for the powder CR phosphor systems. The technical evaluation section of the study showed that the digital mammography systems were well set up and exhibiting typical performance for the detector technology employed in the respective systems.     

Quality control for digital mammography: part II. Recommendations from the ACRIN DMIST trial

The Digital Mammography Imaging Screening Trial (DMIST), conducted under the auspices of the American College of Radiology Imaging Network (ACRIN), is a clinical trial designed to compare the accuracy of digital versus screen-film mammography in a screening population [E. Pisano et al., ACRIN 6652-Digital vs. Screen-Film Mammography, ACRIN (2001)]. Part I of this work described the Quality Control program developed to ensure consistency and optimal operation of the digital equipment. For many of the tests, there were no failures during the 24 months imaging was performed in DMIST. When systems failed, they generally did so suddenly rather than through gradual deterioration of performance. In this part, the utility and effectiveness of those tests are considered. This suggests that after verification of proper operation, routine extensive testing would be of minimal value. A recommended set of tests is presented including additional and improved tests, which we believe meet the intent and spirit of the Mammography Quality Standards Act regulations to ensure that full-field digital mammography systems are functioning correctly, and consistently producing mammograms of excellent image quality.     

Evaluation of a software package for automated quality assessment of contrast detail images--comparison with subjective visual assessment

Contrast detail analysis is commonly used to assess image quality (IQ) associated with diagnostic imaging systems. Applications include routine assessment of equipment performance and optimization studies. Most frequently, the evaluation of contrast detail images involves human observers visually detecting the threshold contrast detail combinations in the image. However, the subjective nature of human perception and the variations in the decision threshold pose limits to the minimum image quality variations detectable with reliability. Objective methods of assessment of image quality such as automated scoring have the potential to overcome the above limitations. A software package (CDRAD analyser) developed for automated scoring of images produced with the CDRAD test object was evaluated. Its performance to assess absolute and relative IQ was compared with that of an average observer. Results show that the software does not mimic the absolute performance of the average observer. The software proved more sensitive and was able to detect smaller low-contrast variations. The observer's performance was superior to the software's in the detection of smaller details. Both scoring methods showed frequent agreement in the detection of image quality variations resulting from changes in kVp and KERMA(detector), which indicates the potential to use the software CDRAD analyser for assessment of relative IQ.     

Amorphous selenium flat panel detectors for digital mammography: validation of a NPWE model observer with CDMAM observer performance experiments

Model observers have been developed which incorporate a specific imaging task, system performance, and human observer characteristics and can potentially overcome some of the limitations in using detective quantum efficiency for optimization and comparison of detectors. In this paper, a modified nonprewhitening matched filter (NPWE) model observer was developed and validated to predict object detectability for an amorphous selenium (a-Se) direct flat-panel imager (FPI) where aliasing is severe. A preclinical a-Se digital mammography FPI with 85 microm pixel size was used in this investigation. Its physical imaging properties including modulation transfer function (MTF), noise power spectrum, and DQE were fully characterized. An observer performance study was conducted by imaging the CDMAM 3.4 contrast-detail phantom designed specifically for digital mammography and presenting these images to a panel of seven observers. X-ray attenuation and scatter due to the phantom were determined experimentally for use in development of the model observer. The observer study results were analyzed via threshold averaging and signal detection theory (SDT) based techniques to produce contrast-detail curves where threshold contrast is plotted as a function of disk diameter. Validity of the model was established using SDT analysis of the experimental data. The effect of aliasing on the detectability of small diameter disks was determined using the NPWE model observer. The signal spectrum was calculated using the presampling MTF of the detector with and without including the aliased terms. Our results indicate that the NPWE model based on Fourier domain parameters provides reasonable prediction of object detectability for the signal-known-exactly task in uniform image noise for a-Se direct FPI.     

Development of a randomised contrast detail digital phantom for observer detectability study

The accuracy and the efficacy of radiological diagnosis depend, to a large extent, on the conditions under which radiographs and images are viewed. This mainly involves the luminance of the display devices and the ambient room illumination. We report a perceptual study to investigate the relationship between detectability and monitor luminance as well as ambient illuminance. A statistical test pattern was used in this study, and the test pattern was developed using Microsoft® Visual Basic 6. The test pattern contained a set of randomised contrast detail objects, that is, disks of different diameters (0.7, 1.0, 1.4, and 2.0 mm) and contrasts against a black background (2.7, 3.9, 5.5, and 7.8%), simulating lesions in digital images. The receiver operating characteristic (ROC) analysis was used in this study. The results indicated that a set of optimal viewing conditions exists and that it has a significant effect on detectability performance.     

Image quality in digital chromosome analysis systems

This paper reports on an investigation into the differences in image quality of different components used in a digital image processing system for chromosome analysis. As chromosome aberrations are important tools in the cloning of genes, it is important to know if the introduction of computerized analysis systems increases the risk of missing small aberrations. In this investigation the number of visible bands on a number of chromosomes has been used as a measure of quality. The images compared are microscope ocular images, photographs from a microscope builtin camera, digital images from a high and from a standard resolution camera, presented both on screen and print-out on paper. The main conclusions are that: (1) the view in the microscope ocular gives the best resolution, (2) there are risks of losing vital information using the digital image processing system for chromosome analysis, and (3) this risk is significantly reduced when using a high resolution camera.     

Threshold contrast detail detectability measurement of the fluoroscopic image quality of a dynamic solid-state digital x-ray image detector

Solid-state digital x-ray imaging detectors of flat-panel construction will play an increasingly important role in future medical imaging facilities. Solid-state detectors that will support both dynamic (including fluoroscopic) and radiographic image recording are under active development. The image quality of an experimental solid-state digital x-ray image detector operating in a continuous fluoroscopy mode has been investigated. The threshold contrast detail detectability (TCDD) technique was used to compare the fluoroscopic imaging performance of an experimental dynamic solid-state digital x-ray image detector with that of a reference image intensifier television (IITV) fluoroscopy system. The reference system incorporated Plumbicon TV. Results were presented as a threshold detection index, or H(T)(A), curves. Measurements were made over a range of mean entrance air kerma (EAK) rates typically used in conventional IITV fluoroscopy. At the upper and mid EAK rate range (440 and 220 nGy/s) the solid-state detector outperformed the reference IITV fluoroscopy system as measured by TCDD performance. At the lowest measured EAK rate (104 nGy/s), the solid-state detector produces slightly inferior TCDD performance compared with the reference system. Although not statistically significant at this EAK rate, the difference will increase as EAK is lowered further. Overall the TCDD results and early clinical experiences support the proposition that a current design of dynamic solid-state detector produces image quality competitive with that of modern IITV fluoroscopy systems. These findings encourage the development of compact and versatile universal x-ray imaging systems based upon solid-state detector technology to support R & F and vascular/interventional applications.     

Image feature analysis and computer-aided diagnosis in digital radiography. I. Automated detection of microcalcifications in mammography

We have investigated the application of computer-based methods to the detection of microcalcifications in digital mammograms. The computer detection system is based on a difference-image technique in which a signal-suppressed image is subtracted from a signal-enhanced image to remove the structured background in a mammogram. Signal-extraction techniques adapted to the known physical characteristics of microcalcifications are then used to isolate microcalcifications from the remaining noise background. We employ Monte Carlo methods to generate simulated clusters of microcalcifications that are superimposed on normal mammographic backgrounds. This allows quantitative evaluation of detection accuracy of the computer method and the dependence of this accuracy on the physical characteristics of the microcalcifications. Our present computer method can achieve a true-positive cluster detection rate of approximately 80% at a false-positive detection rate of one cluster per image. The potential application of such a computer-aided system to mammographic interpretation is demonstrated by its ability to detect microcalcifications in clinical mammograms.     

A new test phantom with different breast tissue compositions for image quality assessment in conventional and digital mammography

Our objective is to describe a new test phantom that permits the objective assessment of image quality in conventional and digital mammography for different types of breast tissue. A test phantom, designed to represent a compressed breast, was made from tissue equivalent materials. Three separate regions, with different breast tissue compositions, are used to evaluate low and high contrast resolution, spatial resolution and image noise. The phantom was imaged over a range of kV using a Contour 2000 (Bennett) mammography unit with a Kodak MinR 2190-MinR L screen-film combination and a Senograph 2000D (General Electric) digital mammography unit. Objective image quality assessments for different breast tissue compositions were performed using the phantom for conventional and digital mammography. For a similar mean glandular dose (MGD), the digital system gives a significantly higher contrast-to-noise ratio (CNR) than the screen-film system for 100% glandular tissue. In conclusion, in mammography, a range of exposure conditions is used for imaging because of the different breast tissue compositions encountered clinically. Ideally, the patient dose-image quality relationship should be optimized over the range of exposure conditions. The test phantom presented in this work permits image quality parameters to be evaluated objectively for three different types of breast tissue. Thus, it is a useful tool for optimizing the patient dose-image quality relationship.     

Retrospective analysis of a detector fault for a full field digital mammography system

This paper describes objective and subjective image quality measurements acquired as part of a routine quality assurance (QA) programme for an amorphous selenium (a-Se) full field digital mammography (FFDM) system between August-04 and February-05. During this period, the FFDM detector developed a fault and was replaced. A retrospective analysis of objective image quality parameters (modulation transfer function (MTF), normalized noise power spectrum (NNPS) and detective quantum efficiency (DQE)) is presented to try and gain a deeper understanding of the detector problem that occurred. These measurements are discussed in conjunction with routine contrast-detail (c-d) results acquired with the CDMAM (Artinis, The Netherlands) test object. There was significant reduction in MTF over this period of time indicating an increase in blurring occurring within the a-Se converter layer. This blurring was not isotropic, being greater in the data line direction (left to right across the detector) than in the gate line direction (chest wall to nipple). The initial value of the 50% MTF point was 6 mm(-1); for the faulty detector the 50% MTF points occurred at 3.4 mm(-1) and 1.0 mm(-1) in the gate line and data line directions, respectively. Prior to NNPS estimation, variance images were formed of the detector flat field images. Spatial distribution of variance was not uniform, suggesting that the physical blurring process was not constant across the detector. This change in variance with image position implied that the stationarity of the noise statistics within the image was limited and that care would be needed when performing objective measurements. The NNPS measurements confirmed the results found for the MTF, with a strong reduction in NNPS as a function of spatial frequency. This reduction was far more severe in the data line direction. A somewhat tentative DQE estimate was made; in the gate line direction there was little change in DQE up to 2.5 mm(-1) but at the Nyquist frequency the DQE had fallen to approximately 35% of the original value. There was severe attenuation of DQE in the data line direction, the DQE falling to less than 0.01 above approximately 3.0 mm(-1). C-d results showed an increase in threshold contrast of approximately 25% for details less than 0.2 mm in diameter, while no reduction in c-d performance was found at the largest detail diameters (1.0 mm and above). Despite the detector fault, the c-d curve was found to pass the European protocol acceptable c-d curve.     

Laboratory audit as part of the quality assessment of a primary HPV-screening program

BackgroundAs primary HPV screening programs are rolled out, methods are needed for routine quality assurance of HPV laboratory analyzes.ObjectiveTo explore the use of similar design for audit as currently used in cytology-based screening, to estimate the clinical sensitivity to identify women at risk for CIN 3 or worse (CIN3+).Study designPopulation-based cohort study conducted within the cervical screening program in Stockholm, Sweden, in 2011–2012. All women with histopathologically confirmed CIN3+ in the following two years were identified by registry analysis. Primary HPV and cytology screening results were collected. For women who had not been HPV tested, biobanked cytology samples were HPV-tested. If the original HPV result had been negative, the sample and subsequent biopsies were analyzed with broad HPV typing (general primer PCR and Luminex).Results154 women had a biobanked prediagnostic cytology sample taken up to 2 years before a histopathologically confirmed CIN3+. The high-risk HPV-positivity was 97% (148/154 women), whereas 143/154 (94%) women had had a cytological abnormality. Among the six HPV-negative samples, one sample was HPV 33 positive in repeat testing whereas the other five cases were HPV-negative also on repeat testing, but HPV-positive in the subsequent tumor tissue.ConclusionsA sensitivity of the HPV test that is higher than the sensitivity of cytology suggests adequate quality of the testing. Regular audits of clinical sensitivity, similar to those of cytology-based screening, should be used also in HPV-based screening programs, in order to continuously monitor the performance of the analyzes.     

Dual-energy imaging in full-field digital mammography: a phantom study

A dual-energy technique which employs the basis decomposition method is being investigated for application to digital mammography. A three-component phantom, made up of plexiglas, polyethylene, and water, was doubly exposed with the full-field digital mammography system manufactured by General Electric. The 'low' and 'high' energy images were recorded with a Mo/Mo anode-filter combination and a Rh/Rh combination, respectively. The total dose was kept within the acceptable levels of conventional mammography. The first hybrid images obtained with the dual-energy algorithm are presented in comparison with a conventional radiograph of the phantom. Image-quality characteristics at contrast cancellation angles between plexiglas and water are discussed. Preliminary results show that a combination of a standard Mo-anode 28 kV radiograph with a Rh-anode 49 kV radiograph provides the best compromise between image-quality and dose in the hybrid image.     

A comparison between objective and subjective image quality measurements for a full field digital mammography system

This paper presents pre-sampling modulation transfer function (MTF), normalized noise power spectrum (NNPS) and detective quantum efficiency (DQE) results for an amorphous selenium (a-Se) full field digital mammography system. MTF was calculated from the image of an angled 0.5 mm thick Cu edge, acquired without additional beam filtration. NNPS data were acquired at detector air-kerma levels ranging from 9.1 microGy to 331 microGy, using a standard mammography x-ray spectrum of 28 kV, Mo/Mo target/filter combination and 4 cm of PMMA additional filtration. Prior to NNPS estimation, the image statistics were assessed using a variance image. This method was able to easily identify a detector artefact and should prove useful in routine quality assurance (QA) measurements. Detector DQE, calculated from the NNPS and MTF data, dropped to 0.3 for low detector air-kerma settings but reached an approximately constant value of 0.6 above 50 microGy at the detector. Subjective image quality data were also obtained at these detector air-kerma settings using the CDMAM contrast-detail (c-d) test object. The c-d data reflected the trend seen in DQE, with threshold contrast increasing at low detector air-kerma values. The c-d data were then compared against predictions made using two established models, the Rose model and a standard signal detection theory model. Using DQE(0), the Rose model gave results within approximately 15% on average for all the detector air-kerma values studied and for detail diameters down to 0.2 mm. Similar agreement was also found between the measured c-d data and the signal detection theory results, which were calculated using an ideal human visual response function and a system magnification of unity. The use of full spatial frequency DQE improved the agreement between the calculated and observer results for detail sizes below 0.13 mm.     

Antimicrobial susceptibility testing of Neisseria gonorrhoeae: a trial organised as part of the United Kingdom national external quality assessment scheme for microbiology.

Six strains of Neisseria gonorrhoeae were distributed to 411 United Kingdom laboratories who were asked to test the susceptibility of the strains to penicillin, cefuroxime, tetracycline and spectinomycin and to test for production of beta-lactamase. Details of methods used were requested by means of a questionnaire. The number of reports recording sensitive strains as resistant was 5% for penicillin, 0.7% for cefuroxime, 3% for tetracycline and 4% for spectinomycin. The number of reports recording resistant strains as sensitive was 7% for penicillin (0.2% with beta-lactamase producing strains, 20% with non-beta-lactamase producing strains), 96% for cefuroxime, 76% for tetracycline and 8% for spectinomycin. There was an association between greater error rates and the use of high content discs for testing tetracycline, the use of low content discs for testing spectinomycin, failure to dilute the inoculum, and use of acidimetric methods rather than methods that use a chromogenic cephalosporin for detecting beta-lactamase.     

High-resolution imager for digital mammography: physical characterization of a prototype sensor

The physical performance characteristics of a high-resolution sensor module for digital mammography were investigated. The signal response of the imager was measured at various detector entrance air kerma and was found to be linear. The spatial resolution was determined by measuring the presampling modulation transfer function, MTF(f), of the system. The noise power spectra, NPS(f), of the system were estimated using 26 kVp: Mo/Mo, 28 kVp: Mo/Rh and 30 kVp: Rh/Rh, with polymethyl methacrylate (PMMA) 'tissue equivalent material' of thickness 20, 45 and 57 mm for each of three x-ray spectra at detector entrance air kerma in the range between approximately 80.2 and 92.3 microGy. The noise equivalent quanta, NEQ(f), and detective quantum efficiencies, DQE(f), for the various spectral conditions were computed. In addition, dose dependence of NPS(f) and DQE(f) was studied at various detector entrance air kerma ranging from 9.4 to 169.7 microGy. A spatial resolution of about 10 cycles mm(-1) was obtained at the 10% MTF(f) level. A small increase in NEQ(f)was observed under higher energy spectral conditions while the DQE(f) decreased marginally. For a given spectrum, increasing PMMA filtration produced negligible change in DQE(f). The estimated DQE values at zero frequency were in the range between 0.45 and 0.55 under the conditions investigated in this study.     

Image quality control for digital mammographic systems: Initial experience and outlook

This report presents (1) a broad topical review and a tutorial of the possibilities for image quality control (IQC) with digital systems, and (2) results and initial experience for IQC with two commercial digital imaging systems, but with limited discussion on any particular method. Digital imaging systems used for mammographically guided digital stereotactic breast biopsy were evaluated extensively at the University of Arizona. Measurements were made of linearity, sensitivity, signal-to-noise ratio, and square-wave modulation. Images of phantoms such as the American College of Radiology Accreditation Phantom and the contrast detail mammography Phantom were evaluated as well as images of the x-ray source’s focal spot. The evaluation also included the cathode ray tubes for the imaging systems. The data collected show that digital imaging systems have an important advantage over film-screen systems because they provide a digital signal as output that can be used for quantitative analysis. As a result, IQC can become a much more quantitative discipline than presently practiced, providing more information on the imaging systems under evaluation, and providing better control over their properties during actual operation.     

Computation of realistic virtual phantom images for an objective lesion detectability assessment in digital mammography

Image quality assessment is required for an optimal use of mammographic units. On the one hand, there are objective image quality assessment methods based on the measurement of technical parameters such as modulation transfer function (MTF), noise power spectrum (NPS) or detection quantum efficiency (DQE) describing performances of digital detectors. These parameters are, however, without direct relationship with lesion detectability in clinical practice. On the other hand, there are image quality assessment methods involving time consuming procedures, but presenting a direct relationship with lesion detectability. This contribution describes an X-ray source/digital detector model leading to the simulation of virtual contrast-detail phantom (CDMAM) images. The virtual image computation method requires the acquisition of only few real images and allows for an objective image quality assessment presenting a direct relationship with lesion detectability. The transfer function of the proposed model takes as input physical parameters (MTF* and noise) measured under clinical conditions on mammographic units. As presented in this contribution, MTF* is a modified MTF taking into account the effects due to X-ray scatter in the breast and magnification. Results obtained with the structural similarity index prove that the simulated images are quite realistic in terms of contrast and noise. Tests using contrast detail curves highlight the fact that the simulated and real images lead to very similar data quality in terms of lesion detectability. Finally, various statistical tests show that quality factors computed for both the simulated images and the real images are very close for the two data sets.     

Porous titanium-nickel for intervertebral fusion in a sheep model: part 2. Surface analysis and nickel release assessment

Porous titanium-nickel (PTN) devices represent an alternative to traditional cage implants. PTN materials possess an interconnecting network of pores with capillarity properties that may promote bone ingrowth, long-term fixation, and intervertebral fusion without the need for bone grafting. However, their considerable surface area and nickel content may elicit concerns over sensitization potential. Therefore, PTN surface corrosion and nickel release resistance must be carefully studied. To evaluate this possibility, a PTN interbody fusion device (IFD) was compared to a conventional nonporous cage made of TiAlV, a well-known biocompatible biomaterial, in a sheep model. PTN and TiAlV IFDs were inserted at two non-contiguous lumbar sites for 3, 6, and 12 months postsurgery. Their surface was then evaluated by scanning electron microscopy (SEM) combined with backscattered electron analysis (BSE). No evidence of surface corrosion was observed either pre- or postimplantation, regardless of device type. Dosage of nickel ions was also performed with the use of inductively coupled plasma-mass spectrometry (ICP-MS). Blood nickel levels were observed to be within acceptable levels at all postinstrumentation times. Nickel content in PTN-adjacent tissue, as well as in detoxification and remote organs, was equivalent both in PTN-treated and control sheep. Therefore, porous titanium-nickel demonstrated resistance to both in vivo surface corrosion and nickel ion release and compared very well with a conventional titanium implant in the course of a 12-month sheep study.