Enhancing obstetric and gynecology ultrasound images by adaptation of the speckle reducing anisotropic diffusion filter

OBJECTIVE: So far there is no ideal speckle reduction filtering technique that is capable of enhancing and reducing the level of noise in medical ultrasound (US) images, while efficiently responding to medical experts' validation criteria which quite often include a subjective component. This paper presents an interactive tool called evolutionary speckle reducing anisotropic diffusion filter (EVOSRAD) that performs adaptive speckle filtering on ultrasound B-mode still images. The medical expert runs the algorithm interactively, having a permanent control over the output, and guiding the filtering process towards obtaining enhanced images that agree to his/her subjective quality criteria. METHODS AND MATERIAL: We employ an interactive evolutionary algorithm (IGA) to adapt on-line the parameters of a speckle reducing anisotropic diffusion (SRAD) filter. For a given input US image, the algorithm evolves the parameters of the SRAD filter according to subjective criteria of the medical expert who runs the interactive algorithm. The method and its validation are applied to a test bed comprising both real and simulated obstetrics and gynecology (OB/GYN) ultrasound images. RESULTS: The potential of the method is analyzed in comparison to other speckle reduction filters: the original SRAD filter, the anisotropic diffusion, offset and median filters. Results obtained show the good potential of the method on several classes of OB/GYN ultrasound images, as well as on a synthetic image simulating a real fetal US image. Quality criteria for the evaluation and validation of the method include subjective scoring given by the medical expert who runs the interactive method, as well as objective global and local quality criteria. CONCLUSIONS: The method presented allows the medical expert to design its own filters according to the degree of medical expertise as well as to particular and often subjective assessment criteria. A filter is designed for a given class of ultrasound images and for a given medical expert who will later use the respective filter in clinical practice. The process of designing a filter is simple and employs an interactive visualization and scoring stage that does not require image processing knowledge. Results show that filters tailored using the presented method achieve better quality scores than other more generic speckle filtering techniques.     

Enhancement of the ultrasound images by modified anisotropic diffusion method

Speckle is a primary factor which degrades the contrast resolution and masks the meaningful texture information present in an ultrasound image. Its presence severely hampers the interpretation and analysis of ultrasound images. When speckle reduction technique is applied for visual enhancement of ultrasound images, it is to be kept in mind that blurring associated with speckle reduction should be less and fine details are properly enhanced. With these points in consideration, the modified speckle reduction anisotropic diffusion (MSRAD) method is proposed in the present study to improve the visual quality of the ultrasound images. In the proposed MSRAD method, the four neighboring pixel template in speckle reduction anisotropic diffusion (SRAD) method of Yu and Acton (IEEE Trans Image Process 11:1260–1270, 2002) have been replaced by a new template of larger number of neighboring pixels to calculate the diffusion term. To enhance visual quality of ultrasound images, nonquadratic regularization (Yu and Yadegar, Proceedings of the IEEE international conference on image processing, 2006) is incorporated with MSRAD method and accordingly changes in parameter settings have been made. The performance of MSRAD method was evaluated using clinical ultrasound images, interpretation by the medical experts and results of MSRAD method by subjective and objective criteria.     

Computers in ultrasonic imaging

This article describes the role of computers and digital electronics in state-of-the-art diagnostic ultrasound scanners. An overview of the computational requirements is provided, and limits on color flow image frame rates are discussed. The new scanner architectures emerging may be used to extend current limitations of ultrasonography, making features such as automatic phase aberration correction, speckle reduction, and tissue characterization available.     

眼科高频超声成像中斑点噪声抑制算法的研究

目的 斑点噪声是超声图像中存在的固有问题,而在眼科高频超声这种更为精细的超声检查中,有效地抑制斑点噪声能提高图像的质量,有助于临床医生对病情的判别.方法 提出了一种新的基于拉普拉斯（Laplacian）金字塔的多尺度斑点去噪方法.采用Laplacian金字塔,从斑点噪声中分离出临床图像特征,根据每层子带图像不同尺度及特点,从小尺度到大尺度,首先采用改进后的八方向各向异性斑点去噪（SRAD）去除图像斑点,然后增强图像的边缘、细节及对比度等方面.该方法与传统的SRAD滤波及相干增强滤波（CEDIF）进行对比,采用等效视数及算法的时间耗费对实验结果进行量化评估.结果 与传统SRAD滤波及CEDIF滤波方法相比,基于Laplacian金字塔的多尺度各向异性斑点去噪方法均高于前两种方法（1.172 3 vs 1.122 3、0.929 3及0.864 0 vs 1.396 0、1.468 3）.结论 本研究提出的基于Laplacian金字塔的多尺度各向异性斑点去噪方法在更有效地去除图像斑点噪声的同时,能很好地保存图像边缘及图像细节等.     

Snakes based segmentation of the common carotid artery intima media

Ultrasound measurements of the human carotid artery walls are conventionally obtained by manually tracing interfaces between tissue layers. In this study we present a snakes segmentation technique for detecting the intima-media layer of the far wall of the common carotid artery (CCA) in longitudinal ultrasound images, by applying snakes, after normalization, speckle reduction, and normalization and speckle reduction. The proposed technique utilizes an improved snake initialization method, and an improved validation of the segmentation method. We have tested and clinically validated the segmentation technique on 100 longitudinal ultrasound images of the carotid artery based on manual measurements by two vascular experts, and a set of different evaluation criteria based on statistical measures and univariate statistical analysis. The results showed that there was no significant difference between all the snakes segmentation measurements and the manual measurements. For the normalized despeckled images, better snakes segmentation results with an intra-observer error of 0.08, a coefficient of variation of 12.5%, best Bland–Altman plot with smaller differences between experts (0.01, 0.09 for Expert1 and Expert 2, respectively), and a Hausdorff distance of 5.2, were obtained. Therefore, the pre-processing of ultrasound images of the carotid artery with normalization and speckle reduction, followed by the snakes segmentation algorithm can be used successfully in the measurement of IMT complementing the manual measurements. The present results are an expansion of data published earlier as an extended abstract in IFMBE Proceedings (Loizou et al. IEEE Int X Mediterr Conf Medicon Med Biol Eng POS-03 499:1–4, 2004).     

Robust non-homomorphic approach for speckle reduction in medical ultrasound images

Most existing wavelet-based image denoising techniques are developed for additive white Gaussian noise. In applications to speckle reduction in medical ultrasound (US) images, the traditional approach is first to perform the logarithmic transform (homomorphic processing) to convert the multiplicative speckle noise model to an additive one, and then the wavelet filtering is performed on the log-transformed image, followed by an exponential operation. However, this non-linear operation leads to biased estimation of the signal and increases the computational complexity of the filtering method. To overcome these drawbacks, an efficient, non-homomorphic technique for speckle reduction in medical US images is proposed. The method relies on the true characterisation of the marginal statistics of the signal and speckle wavelet coefficients. The speckle component was modelled using the generalised Nakagami distribution, which is versatile enough to model the speckle statistics under various scattering conditions of interest in medical US images. By combining this speckle model with the generalised Gaussian signal first, the Bayesian shrinkage functions were derived using the maximum a posteriori (MAP) criterion. The resulting Bayesian processor used the local image statistics to achieve soft-adaptation from homogeneous to highly heterogeneous areas. Finally, the results showed that the proposed method, named GNDShrink, yielded a signal-to-noise ratio (SNR) gain of 0.42 dB over the best state-of-the-art despeckling method reported in the literature, 1.73 dB over the Lee filter and 1.31 dB over the Kaun filter at an input SNR of 12.0 dB, when tested on a US image. Further, the visual comparison of despeckled US images indicated that the new method suppressed the speckle noise well, while preserving the texture and organ surfaces.     

基于光学相干层析离体牙图像的去噪算法研究

目的光学相干层析成像因其高分辨率、无损等优点,适于早期龋检测;但由于系统中存在的噪声,影响其成像质量。为了重建牙齿的原貌信息,需寻找一种适于早期龋检测的光学相干层析成像实时图像去噪算法。方法比较平均曲率流滤波、非线性扩散拉普拉斯金字塔算法、非局部均值滤波3种滤波方法对光学相干层析人离体牙图像的去噪效果,从噪声抑制、边界保持、运算时间3方面分析上述3种算法的实时去噪性能及其优缺点。结果非局部均值滤波在噪声抑制和边界保持2个方面能达到很好的平衡,但实时性差;而非线性扩散拉普拉斯金字塔算法则能在滤波效果和运算效率达到较好的平衡;平均曲率流滤波次之。结论非线性扩散拉普拉斯金字塔算法较适于早期龋检测的光学相干层析成像实时图像去噪。     

基于变分法的超声图像斑点噪声自适应滤波算法

各向异性扩散模型在去除超声图像斑点噪声时不能有效保护图像细节,针对上述问题本文提出基于变分法的自适应最小能量去噪模型.首先直接将由微分方程表示的各向异性扩散模型转化为最小能量变分模型;然后引入欧拉弹性能量模型,在去除噪声的同时有效地保护和增强图像细节.同时为了解决数值求解过程中出现的迭代次数与迭代步长的矛盾,本文还提出迭代停止准则和自适应变步长去噪算法.仿真和真实超声图像的实验结果表明基于变分法的超声图像斑点噪声自适应滤波算法在去噪的同时能够很好地保护细节信息,而且能有效地减少迭代次数.     

基于卷积神经网络的超声图像散斑去噪算法

为了提高超声图像质量,解决传统去噪算法在抑制散斑噪声和保留超声图像纹理特征方面的难题,提出一种基于卷积神经网络的超声图像散斑去噪算法DSCNN(De-speckling CNN)。本文提出的算法利用卷积神经网络强大的拟合能力来学习从超声图像到其相应的高质量图像的复杂映射,同时,通过改进损失函数的方式来减少去噪过程中纹理信息的损失和细节的模糊。不同于以往简单地假设超声散斑噪声为乘性噪声,本文利用基于超声图像采集模型和散斑噪声形成模型的模拟超声成像技术为去噪模型生成更贴合真实超声图像的训练数据,解决深度学习方法训练数据匮乏以及在临床上无法获得与超声图像空间配准作为标签的无噪声图像的难题。通过与其他具有代表性的超声图像去噪算法比较,经DSCNN去噪后的超声图像无论在视觉效果还是图像质量评价指标上都取得了更好的结果,其中SSIM达到0.856 9,在文中所有方法中最高。     

Nonlocal total variation based on symmetric Kullback-Leibler divergence for the ultrasound image despeckling

Background

Ultrasound imaging is safer than other imaging modalities, because it is noninvasive and nonradiative. Speckle noise degrades the quality of ultrasound images and has negative effects on visual perception and diagnostic operations.

Methods

In this paper, a nonlocal total variation (NLTV) method for ultrasonic speckle reduction is proposed. A spatiogram similarity measurement is introduced for the similarity calculation between image patches. It is based on symmetric Kullback-Leibler (KL) divergence and signal-dependent speckle model for log-compressed ultrasound images. Each patch is regarded as a spatiogram, and the spatial distribution of each bin of the spatiogram is regarded as a weighted Gamma distribution. The similarity between the corresponding bins of the two spatiograms is computed by the symmetric KL divergence. The Split-Bregman fast algorithm is then used to solve the adapted NLTV object function. Kolmogorov-Smirnov (KS) test is performed on synthetic noisy images and real ultrasound images.

Results

We validate our method on synthetic noisy images and clinical ultrasound images. Three measures are adopted for the quantitative evaluation of the despeckling performance: the signal-to-noise ratio (SNR), structural similarity index (SSIM), and natural image quality evaluator (NIQE). For synthetic noisy images, when the noise level increases, the proposed algorithm achieves slightly higher SNRS than that of the other two algorithms, and the SSIMS yielded by the proposed algorithm is obviously higher than that of the other two algorithms. For liver, IVUS and 3DUS images, the NIQE values are 8.25, 6.42 and 9.01, all of which are higher than that of the other two algorithms.

Conclusions

The results of the experiments over synthetic and real ultrasound images demonstrate that the proposed method outperforms current state-of-the-art despeckling methods with respect to speckle reduction and tissue texture preservation.

     

Novel Genetic-Neuro-Fuzzy Filter for Speckle Reduction from Sonography Images

Edge-preserving speckle noise reduction is essential to computer-aided ultrasound image processing and understanding. A new class of genetic-neuro-fuzzy filter is proposed to optimize the trade-off between speckle noise removal and edge preservation. The proposed approach combines the advantages of the fuzzy, neural, and genetic paradigms. Neuro-fuzzy approaches are very promising for nonlinear filtering of noisy images. Fuzzy reasoning embedded into the network structure aims at reducing errors while fine details are being processed. The learning method based on the real-time genetic algorithms (GAs) performs an effective training of the network from a collection of training data and yields satisfactory results after a few generations.The performance of the proposed filter has been compared with that of the commonly used median and Wiener filters in reducing speckle noises on ultrasound images. We evaluate this filter by passing the filters output to the edge detection algorithm and observing its ability to detect edge pixels.Experimental results show that the proposed genetic-neuro-fuzzy technique is very effective in speckle noise reduction as well as detail preserving even in the presence of highly noise corrupted data, and it works significantly better than other well-known conventional methods in the literature.     

基于比率距离的自适应超声图像去噪方法

针对超声图像噪声的瑞利分布特性,使用一种新的自适应超声图像去噪方法,改进固定窗口包含边缘时无法做到沿边缘方向滤波的不足。采用可自由伸缩的自适应滤波窗口,首先针对瑞利分布的噪声引入比率距离,得到超声图像像素间的相似度距离,然后考虑像素的邻域图像块均值,解决相似度距离之间比较的问题,最后像素根据新的相似度距离进行八方向伸展,得到不规则形状的滤波窗口进行去噪。用仿真超声图像和临床超声图像进行实验,图像评价指标结果表明该算法优于经典算法,更适用于去除超声图像的斑点噪声,在去除噪声的同时能够较好地保留细节边缘。     

Speckle reduction in ultrasound medical images using adaptive filter based on second order statistics

This article discusses an adaptive filtering technique for reducing speckle using second order statistics of the speckle pattern in ultrasound medical images. Several region-based adaptive filter techniques have been developed for speckle noise suppression, but there are no specific criteria for selecting the region growing size in the post processing of the filter. The size appropriate for one local region may not be appropriate for other regions. Selection of the correct region size involves a trade-off between speckle reduction and edge preservation. Generally, a large region size is used to smooth speckle and a small size to preserve the edges into an image. In this paper, a smoothing procedure combines the first order statistics of speckle for the homogeneity test and second order statistics for selection of filters and desired region growth. Grey level co-occurrence matrix (GLCM) is calculated for every region during the region contraction and region growing for second order statistics. Further, these GLCM features determine the appropriate filter for the region smoothing. The performance of this approach is compared with the aggressive region-growing filter (ARGF) using edge preservation and speckle reduction tests. The processed image results show that the proposed method effectively reduces speckle noise and preserves edge details.     

Speckle reduction in ultrasound medical images using adaptive filter based on second order statistics

This article discusses an adaptive filtering technique for reducing speckle using second order statistics of the speckle pattern in ultrasound medical images. Several region-based adaptive filter techniques have been developed for speckle noise suppression, but there are no specific criteria for selecting the region growing size in the post processing of the filter. The size appropriate for one local region may not be appropriate for other regions. Selection of the correct region size involves a trade-off between speckle reduction and edge preservation. Generally, a large region size is used to smooth speckle and a small size to preserve the edges into an image. In this paper, a smoothing procedure combines the first order statistics of speckle for the homogeneity test and second order statistics for selection of filters and desired region growth. Grey level co-occurrence matrix (GLCM) is calculated for every region during the region contraction and region growing for second order statistics. Further, these GLCM features determine the appropriate filter for the region smoothing. The performance of this approach is compared with the aggressive region-growing filter (ARGF) using edge preservation and speckle reduction tests. The processed image results show that the proposed method effectively reduces speckle noise and preserves edge details.     

A Motion Compounding Technique for Speckle Reduction in Ultrasound Images

The quality of ultrasound images is usually influenced by speckle noise and the temporal decorrelation of the speckle patterns. To reduce the speckle noise, compounding techniques have been widely applied. Partially correlated images scanned on the same subject cross-section are combined to generate a compound image with improved image quality. However, the compounding technique might introduce image blurring if the transducer or the target moves too fast. This blurring effect becomes especially critical when assessing tissue deformation in clinical motion examinations. In this paper, an ultrasound motion compounding system is proposed to improve the quality of ultrasound motion sequences. The proposed motion compounding technique uses a hierarchical adaptive feature weighted motion estimation method to realign the frames before compounding. Each frame is first registered and warped to the reference frame before being compounded to reduce the speckle noise. Experimental results showed that the motion could be assessed accurately and better visualization could be achieved for the compound images, with improved signal-to-noise and contrast-to-noise ratios.     

基于多层小波分解与稳定分布的超声图像散粒噪声抑制新方法

医学超声图像在应用中遇到的一个重要问题是如何消除图像中由于散射现象的相干本质而引起的多径乘性散粒噪声。对数超声图像的二维小波系数服从具有尖峰和拖尾的边缘分布的非高斯分布。α稳定分布可以用来描述这类重拖尾非高斯尖峰脉冲信号和噪声。本研究利用一种散粒噪声模型，通过对对数超声图像的多层小波分解的高频系数的分析与稳定分布建模，提出了一种新的基于闽值的二维小波分解系数的检测分类方法，得到一种基于多层小波分解与稳定分栉模型的超声图像散粒噪声的抑制新方法。仿真结果表明，该方法比传统的基于高斯假设下的阈值去噪方法性能更好。     

Assessment of hybrid speckle reduction algorithms.

A consequence of employing coherent detection methods in medical ultrasound imaging systems is the occurrence of interference effects in the received echo field, which produce the speckle artefact. Speckle can severely degrade the information content of the image, and its efficient removal from ultrasound pulse-echo images is the focus of a number of research projects. Traditionally, the approach towards speckle reduction in pulse-echo images has been based on two classes of technique, either employing some form of spatial/frequency compounding or a data (image) filter. Both approaches have inherent shortcomings, and two alternative techniques are suggested here: 'local frequency diversity' and 'frequency differencing'. These algorithms deterministically identify where speckle occurs, and correct for speckle only within short, localized, corrupted segments of the A-line. This provides the potential for real-time implementation. Simulated and clinical in vivo images have been obtained, and the capabilities of the alternative speckle reduction algorithms are assessed against the more conventional approaches.     

GPU-accelerated 3D mipmap for real-time visualization of ultrasound volume data

Ultrasound volume rendering is an efficient method for visualizing the shape of fetuses in obstetrics and gynecology. However, in order to obtain high-quality ultrasound volume rendering, noise removal and coordinates conversion are essential prerequisites. Ultrasound data needs to undergo a noise filtering process; otherwise, artifacts and speckle noise cause quality degradation in the final images. Several two-dimensional (2D) noise filtering methods have been used to reduce this noise. However, these 2D filtering methods ignore relevant information in-between adjacent 2D-scanned images. Although three-dimensional (3D) noise filtering methods are used, they require more processing time than 2D-based methods. In addition, the sampling position in the ultrasonic volume rendering process has to be transformed between conical ultrasound coordinates and Cartesian coordinates. We propose a 3D-mipmap-based noise reduction method that uses graphics hardware, as a typical 3D mipmap requires less time to be generated and less storage capacity. In our method, we compare the density values of the corresponding points on consecutive mipmap levels and find the noise area using the difference in the density values. We also provide a noise detector for adaptively selecting the mipmap level using the difference of two mipmap levels. Our method can visualize 3D ultrasound data in real time with 3D noise filtering.     

Bayesian Framework-Based Adaptive Hybrid Filtering for Speckle Noise Reduction in Ultrasound Images Via Lion Plus FireFly Algorithm

Journal of Digital Imaging - The existence of speckle noise in ultrasound (US) image processing distorts the image quality and also hinders the development of systematic approaches for US images....     

Why is TOF PET reconstruction a more robust method in the presence of inconsistent data?

In order to obtain an accurate and quantitative positron emission tomography (PET) image, emission data need to be corrected for random coincidences, photon attenuation and Compton scattering of photons in the tissue, and detector efficiency response or normalization. The accuracy of these corrections strongly affects the quality of the PET image. There is evidence that time-of-flight (TOF) PET reconstruction is less sensitive than non-TOF reconstruction to inconsistencies between emission data and corrections. The purpose of this study is to analyze and discuss such experimental evidence. In this work, inconsistent correction data (inconsistent normalization, absence of scatter correction and mismatched attenuation correction) are introduced in experimental phantom data. Both TOF and non-TOF reconstructed images are analyzed to examine the effect of flawed data. The behavior of TOF reconstruction in respiratory artifacts, a very common example of inconsistency in the data, is studied in patient images. TOF reconstruction is less sensitive to mismatched attenuation correction, erroneous normalization and poorly estimated scatter correction. Such robustness depends strongly on the time resolution of the TOF PET scanner. In particular, the robustness of TOF in the presence of attenuation correction inconsistencies is discussed, using a simulation of a simple model of respiratory artifacts. We expect new generations of PET scanners, with improved time resolution, to be less and less sensitive to poor quality normalization, scatter and attenuation corrections. This not only reduces artifacts in the PET image, but also opens the way to less stringent requirements for the quality of the CT image (reducing either the equipment cost or the dose to the patient), and for the normalization protocols (simplifying or shortening the normalization procedures). Moreover, TOF reconstruction can be beneficial in multimodalities such as PET/MR, where a direct attenuation measurement is not available and attenuation correction can only be approximated.