A dual-snake model of high penetrability for ultrasound image boundary extraction

Most deformable models require the initial contour to be placed close to the boundary of the object of interest for boundary extraction of ultrasound (US) images, which is impractical in many clinical applications. To allow a distant initial contour, a new dual-snake model promising high penetrability through the interference of the noises is proposed in this paper. The proposed dual-snake model features a new far-reaching external force, called the discrete gradient flow, a connected component-weighted image force, and an effective stability evaluation of two underlying snakes. The experimental results show that, with a distant initial contour, the mean distance from the derived boundary to the desired boundary is less than 1.4 pixels, and most snake elements are within 2.7 pixels of the desired boundaries for the synthetic images with CNR ≥ 1. For the clinical US images, the mean distance is less than 1.9 pixels, and most snake elements are within 3 pixels of the desired boundaries. (E-mail: chung@lotus.mc.ntu.edu.tw)     

An adaptive snake model for ultrasound image segmentation: modified trimmed mean filter, ramp integration and adaptive weighting parameters

The snake model is a widely-used approach to finding the boundary of the object of interest in an ultrasound image. However, due to the speckles, the weak edges and the tissue-related textures in an ultrasound image, conventional snake models usually cannot obtain the desired boundary satisfactorily. In this paper, we propose a new adaptive snake model for ultrasound image segmentation. The proposed snake model is composed of three major techniques, namely, the modified trimmed mean (MTM) filtering, ramp integration and adaptive weighting parameters. With the advantages of the mean and median filters, the MTM filter is employed to alleviate the speckle interference in the segmentation process. The weak edge enhancement by ramp integration attempts to capture the slowly varying edges, which are hard to capture by conventional snake models. The adaptive weighting parameter allows weighting of each energy term to change adaptively during the deformation process. The proposed snake model has been verified on the phantom and clinical ultrasound images. The experimental results showed that the proposed snake model achieves a reasonable performance with an initial contour placed 10 to 20 pixels away from the desired boundary. The mean minimal distances from the derived boundary to the desired boundary have been shown to be less than 3.5 (for CNR > or = 0.5) and 2.5 pixels, respectively, for the phantom and ultrasound images.     

An early vision-based snake model for ultrasound image segmentation

Due to the speckles and the ill-defined edges of the object of interest, the classic image-segmentation techniques are usually ineffective in segmenting ultrasound (US) images. In this paper, we present a new algorithm for segmenting general US images that is composed of two major techniques; namely, the early-vision model and the discrete-snake model. By simulating human early vision, the early-vision model can capture both grey-scale and textural edges while the speckle noise is suppressed. By performing deformation only on the peaks of the distance map, the discrete-snake model promises better noise immunity and more accurate convergence. Moreover, the constraint for most conventional snake models that the initial contour needs to be located very close to the actual boundary has been relaxed substantially. The performance of the proposed snake model has been shown to be comparable to manual delineation and superior to that of the gradient vector flow (GVF) snake model.     

Discriminant snakes for 3D reconstruction of anatomical organs

In this work a new statistic deformable model for 3D segmentation of anatomical organs in medical images is proposed. A statistic discriminant snake performs a supervised learning of the object boundary in an image slice to segment the next slice of the image sequence. Each part of the object boundary is projected in a feature space generated by a bank of Gaussian filters. Then, clusters corresponding to different boundary pieces are constructed by means of linear discriminant analysis. Finally, a parametric classifier is generated from each contour in the image slice and embodied into the snake energy-minimization process to guide the snake deformation in the next image slice. The discriminant snake selects and classifies image features by the parametric classifier and deforms to minimize the dissimilarity between the learned and found image features. The new approach is of particular interest for segmenting 3D images with anisotropic spatial resolution, and for tracking temporal image sequences. In particular, several anatomical organs from different imaging modalities are segmented and the results compared to expert tracings.     

3-D breast ultrasound segmentation using active contour model

In this study, we made use of the discrete active contour model to overcome the natural properties of ultrasound (US) images, speckle, noise and tissue-related textures, to segment the breast tumors precisely. Determination of the real tumor boundary with the snake-deformation process requires an initial contour estimate. However, the manual way to sketch an initial contour is very time-consuming. Thus, we propose an automatic initial contour-finding method that not only maintains the tumor shape, but also is close to the tumor boundary and inside the tumor. During the deformation process, to prevent the snake trapping into the false position caused by tissue-related texture or speckle, we added the edge information as an image feature to define the external force. In addition, because the 3-D volume of a tumor is essentially constructed by a sequence of 2-D images, our method for finding boundaries of a tumor can be extended to 3-D cases. By precisely counting the volume of the 3-D images, we can get the volume of tumor. Finally, we will show that the proposed techniques have rather good performance and lead to a satisfactory result in comparison with the estimated volume and physician's estimate.     

Fetal abdominal contour extraction and measurement in ultrasound images

A novel method is developed for the fetal abdominal contour extraction and measurement in ultrasound images. Fetal abdominal circumference (AC) is one of the standardized measurements in the antepartum ultrasound monitoring. Among several standardized measurements, AC is best correlated with fetal growth but is also the most difficult to be accurately measured. To overcome the difficulties in the abdominal contour extraction, the proposed method is a four-step procedure that integrates several image segmentation techniques. The proposed method is able to make the best use of the strength of different segmentation algorithms, while avoiding their deficiencies. An enhanced instantaneous coefficient of variation (ICOV) edge detector is first developed to detect edges of the abdominal contour and alleviate the effects of most speckle noise. Then, the Fuzzy C-Means clustering is employed to distinguish salient edges attributable to the abdominal contour from weak edges due to the other texture. Subsequently, the iterative Hough transform is applied to determine an elliptical contour and obtain an initial estimation of the AC. Finally, the gradient vector field (GVF) snake adapts the initial ellipse to the real edges of the abdominal contour. Quantitative validation of the proposed method on synthetic images under different imaging conditions achieves satisfactory segmentation accuracy (98.78%+/-0.16%). Experiments on 150 clinical images are carried out in three aspects: comparisons between inter-observer and inter-run variation, the fitness analysis between the automatically detected ellipse and the manual delineation, and the accuracy comparisons between automatic measurements and manual measurements in estimation of fetal weight (EFW). Experimental results show that the proposed method can provide consistent and accurate measurements. The reductions of the mean absolute difference and the standard deviation of EFW based on automatic measurements are about 1.2% and 2.1%, respectively, which indicate its potential in clinical antepartum monitoring application.     

Dynamic programming in parallel boundary detection with application to ultrasound intima-media segmentation

Segmentation of carotid artery intima-media in longitudinal ultrasound images for measuring its thickness to predict cardiovascular diseases can be simplified as detecting two nearly parallel boundaries within a certain distance range, when plaque with irregular shapes is not considered. In this paper, we improve the implementation of two dynamic programming (DP) based approaches to parallel boundary detection, dual dynamic programming (DDP) and piecewise linear dual dynamic programming (PL-DDP). Then, a novel DP based approach, dual line detection (DLD), which translates the original 2-D curve position to a 4-D parameter space representing two line segments in a local image segment, is proposed to solve the problem while maintaining efficiency and rotation invariance. To apply the DLD to ultrasound intima-media segmentation, it is imbedded in a framework that employs an edge map obtained from multiplication of the responses of two edge detectors with different scales and a coupled snake model that simultaneously deforms the two contours for maintaining parallelism. The experimental results on synthetic images and carotid arteries of clinical ultrasound images indicate improved performance of the proposed DLD compared to DDP and PL-DDP, with respect to accuracy and efficiency.     

Serial registration of intraoperative MR images of the brain

The increased use of image-guided surgery systems during neurosurgery has brought to prominence the inaccuracies of conventional intraoperative navigation systems caused by shape changes such as those due to brain shift. We propose a method to track the deformation of the brain and update preoperative images using intraoperative MR images acquired at different crucial time points during surgery. We use a deformable surface matching algorithm to capture the deformation of boundaries of key structures (cortical surface, ventricles and tumor) throughout the neurosurgical procedure, and a linear finite element elastic model to infer a volumetric deformation. The boundary data are extracted from intraoperative MR images using a real-time intraoperative segmentation algorithm. The algorithm has been applied to a sequence of intraoperative MR images of the brain exhibiting brain shift and tumor resection. Our results characterize the brain shift after opening of the dura and at the different stages of tumor resection, and brain swelling afterwards. Analysis of the average deformation capture was assessed by comparing landmarks identified manually and the results indicate an accuracy of 0.7+/-0.6 mm (mean+/-S.D.) for boundary surface landmarks, of 0.9+/-0.6 mm for landmarks inside the boundary surfaces, and 1.6+/-0.9 mm for landmarks in the vicinity of the tumor.     

Measuring size and shape of the hippocampus in MR images using a deformable shape model.

A method for segmentation and quantification of the shape and size of the hippocampus is proposed, based on an automated image analysis algorithm. The algorithm uses a deformable shape model to locate the hippocampus in magnetic resonance images and to determine a geometric representation of its boundary. The deformable model combines three types of information. First, it employs information about the geometric properties of the hippocampal boundary, from a local and relatively finer scale to a more global and relatively coarser scale. Second, the model includes a statistical characterization of normal shape variation across individuals, serving as prior knowledge to the algorithm. Third, the algorithm utilizes a number of manually defined boundary points, which can help guide the model deformation to the appropriate boundaries, wherever these boundaries are weak or not clearly defined in MR images. Excellent agreement is demonstrated between the algorithm and manual segmentations by well-trained raters, with a correlation coefficient equal to 0.97 and algorithm/rater differences statistically equivalent to interrater differences for manual definitions.     

一种半自动分割脑部MRI中胼胝体的方法

针对胼胝体的图像特点以及实际应用要求,采用半自动方法对MRI中的胼胝体进行分割。首先采用基于Live-Wire的算法对胼胝体影像的起始层和终止层进行初始分割,然后利用基于距离变换的形状插值算法获取中间层的初始轮廓信息,对插值获得的初始轮廓采用Snake模型进行局部收缩,获得真实的胼胝体边界。对序列MRI脑影像中的胼胝体进行分割、重建、标定。实验结果与临床医师的使用反馈证明,本文提出的算法具有较高的灵活性与可信度,对胼胝体的分割精度与解剖统计信息相符,分割结果可满足临床需求。     

Segmentation in Echocardiographic Sequences using Shape-based Snake Model Combined with Generalized Hough Transformation

A novel method for segmentation of cardiac structures in temporal echocardiographic sequences based on the snake model is presented. The method is motivated by the observation that the structures of neighboring frames have consistent locations and shapes that aid in segmentation. To cooperate with the constraining information provided by the neighboring frames, we combine the template matching with the conventional snake model. It means that the model not only is driven by conventional internal and external forces, but also combines an additional constraint, the matching degree to measure the similarity between the neighboring prior shape and the derived contour. Furthermore, in order to auto or semi-automatically segment the sequent images without manually drawing the initial contours in each image, generalized Hough transformation (GHT) is used to roughly estimate the initial contour by transforming the neighboring prior shape. The method is particularly useful in case of the large frame-to-frame displacement of structure such as mitral valve. As a result, the active contour can easily detect the desirable boundaries in ultrasound images and has a high penetrability through the interference of various undesirables, such as the speckle, the tissue-related textures and the artifacts.     

4D deformable models with temporal constraints: application to 4D cardiac image segmentation

Segmentation of time series of 3D cardiac images is clinically used for the assessment of the mechanical function of the left ventricle. To take into account the 4D (3D+T) nature of those images, we propose to extend the deformable surface framework by introducing time-dependent constraints. Thus, in addition to computing an internal force for enforcing the regularity of the deformable model, prior motion knowledge is introduced in the deformation process through either temporal smoothing or trajectory constraints. In this paper, deformable surfaces are represented as simplex meshes owing to their generality and their ability to compute mean curvature at each vertex. The segmentation accuracy of this 4D deformable model is estimated on synthetic SPECT image sequences for which a ground truth about the LV volume is known. Segmentation of non-synthetic SPECT and other modalities 4D images is also discussed.     

基于边界信息的医学图像三维插值

目的Cubic卷积插值是医学图像三维插值的常用方法,针对其插值处的结果边界模糊和精度不高的缺陷,建立一种精确度较高的插值方法。方法首先通过模糊对比度增强精确定位图像边界,再运用形态学运算确定出新插值图像边界,对于新插值图像边界点采用最佳匹配对应点插值;对于非边界点采用一种新的Cubic卷积插值方法确定其灰度值。结果本文方法的均方差、不符合像素点数和最大误差均小于传统插值方法。结论本文提出的方法具有较高的精确性。     

Moment-based texture segmentation of luminal contour in intravascular ultrasound images

Purpose A system for luminal contour segmentation in intravascular ultrasound images is proposed. Methods Moment-based texture features are used for clustering of the pixels in the input image. After the clustering, morphological smoothing and a boundary detection process are applied and the final image is obtained. Results The proposed method was applied to 15 images from different patients, and a correlation coefficient of 0.86 was obtained between the areas of lumen automatically and manually defined. Conclusion Moment-based texture features together with the radial feature are powerful tools for identification of the lumen region in intravascular ultrasound images. Morphological filtering was useful for improving the segmentation results.     

Direct EIT Jacobian calculations for conductivity change and electrode movement

Electrical impedance tomography (EIT) is very sensitive to deformations of the medium boundary shape. For lung imaging, breathing and changes in posture move the electrodes and change the chest shape, resulting in image artefacts. Several approaches have been proposed to improve the reconstructed images; most methods reconstruct both the boundary deformation and conductivity change from the measured data. These techniques require the calculation of the 'movement Jacobian', reflecting measurement changes due to the boundary deformation. Previous papers have calculated this Jacobian using perturbation techniques, which are slow (requiring multiple solutions of the forward problem) and become inaccurate with increasing finite element model size. This effect has limited reconstruction algorithms for deformable media to mostly 2D. To address this problem, we propose a direct method to calculate the Jacobian, based on a formulation of the derivatives of the finite element system matrix with respect to geometry changes. An illustrative example of these calculations is given, as well as a comparison between the proposed method and a perturbation method. Results show this method is approximately 300 times faster; and for larger model sizes, the perturbation method begins to diverge from those from the direct method proposed.     

A textural approach based on Gabor functions for texture edge detection in ultrasound images

Edge detection is an important, but difficult, step in quantitative ultrasound (US) image analysis. In this paper, we present a new textural approach for detecting a class of edges in US images; namely, the texture edges with a weak regional mean gray-level difference (RMGD) between adjacent regions. The proposed approach comprises a vision model-based texture edge detector using Gabor functions and a new texture-enhancement scheme. The experimental results on the synthetic edge images have shown that the performances of the four tested textural and nontextural edge detectors are about 20%-95% worse than that of the proposed approach. Moreover, the texture enhancement may improve the performance of the proposed texture edge detector by as much as 40%. The experiments on 20 clinical US images have shown that the proposed approach can find reasonable edges for real objects of interest with the performance of 0.4 +/- 0.08 in terms of the Pratt's figure.     

Compensation of log-compressed images for 3-D ultrasound

In this study, a Bayesian approach was used for 3-D reconstruction in the presence of multiplicative noise and nonlinear compression of the ultrasound (US) data. Ultrasound images are often considered as being corrupted by multiplicative noise (speckle). Several statistical models have been developed to represent the US data. However, commercial US equipment performs a nonlinear image compression that reduces the dynamic range of the US signal for visualization purposes. This operation changes the distribution of the image pixels, preventing a straightforward application of the models. In this paper, the nonlinear compression is explicitly modeled and considered in the reconstruction process, where the speckle noise present in the radio frequency (RF) US data is modeled with a Rayleigh distribution. The results obtained by considering the compression of the US data are then compared with those obtained assuming no compression. It is shown that the estimation performed using the nonlinear log-compression model leads to better results than those obtained with the Rayleigh reconstruction method. The proposed algorithm is tested with synthetic and real data and the results are discussed. The results have shown an improvement in the reconstruction results when the compression operation is included in the image formation model, leading to sharper images with enhanced anatomical details.     

A variational change detection method for multitemporal SAR images

In this letter, we develop a variational model for change detection in multitemporal synthetic aperture radar (SAR) images. SAR images are typically polluted by multiplicative noise, therefore ordinary active contour model (ACM), or the snake model, for image segmentation is not suitable for change detection in multitemporal SAR images. Our model is a generalization of ACM under the assumption that the image data fits the Generalized Gaussian Mixture (GGM) model. Our method first computes the log-ratio image of the input multitemporal SAR images. Then the method iteratively executes the following two steps until convergence: (1) estimate the parameters for the generalized Gaussian distributions inside and outside the current evolving curve using maximum-likelihood estimation; (2) evolve the current curve according to the image data and the parameters previously estimated. When convergence is achieved, the location of the evolving curve depicts the changed and the unchanged areas.

Experiments were carried out on both semi-simulated data set and real data set. Results showed that the proposed method achieves total error rates of 0.43% and 1.05%, for semi-simulated and real data sets, respectively, which were comparable to other prevalent methods.     

Contour propagation using non-uniform cubic B-splines for lung tumor delineation in 4D-CT

Purpose

Accurate target delineation is a critical step in radiotherapy. In this study, a robust contour propagation method is proposed to help physicians delineate lung tumors in four-dimensional computer tomography (4D-CT) images efficiently and accurately.

Methods

The proposed method starts with manually delineated contours on the reference phase. Each contour is fitted by a non-uniform cubic B-spline curve, and its deformation on the target phase is achieved by moving its control vertexes such that the intensity similarity between the two contours is maximized. Since contour is usually the boundary of lesion or tissue which may deform quite differently from the tissues outside the boundary, the proposed method treats each contour as a deformable entity, a non-uniform cubic B-spline curve, and focuses on the registration of contour entity instead of the entire image to avoid the deformation of contour to be smoothed by its surrounding tissues, meanwhile to greatly reduce the time consumption while keeping the accuracy of the contour propagation. Eighteen 4D-CT cases with 444 gross tumor volume (GTV) contours manually delineated slice by slice on the maximal inhale and exhale phases are used to verify the proposed method.

Results

The Jaccard similarity coefficient (JSC) between the propagated GTV and the manually delineated GTV is 0.885 ± 0.026, and the Hausdorff distance (HD) is \(2.93\,\pm \,0.93\) mm. In addition, the time for propagating GTV to all the phases is 3.67 ± 3.41 minutes. The results are better than fast adaptive stochastic gradient descent (FASGD) B-spline method, 3D+t B-spline method and diffeomorphic Demons method.

Conclusions

The proposed method is useful to help physicians delineate target volumes efficiently and accurately.

     

Application of a parallel spectral–spatial convolution neural network in object-oriented remote sensing land use classification

Due to the abundance of spatial information and relative lack of spectral information in high spatial resolution remote sensing images, a land use classification method for high-resolution remote sensing images is proposed based on a parallel spectral-spatial convolutional neural network (CNN) and object-oriented remote sensing technology. The contour of a remote sensing object is taken as the boundary and the set of pixels that comprises the object are extracted to form the input data set for the deep neural network. The proposed network considers both the features of the object and the pixels which forms the object. The spatial and spectral features of remote sensing image objects are extracted independently in the parallel network using panchromatic and multispectral remote sensing techniques. Then, through a fully connected layer, both spectral and spatial information are integrated to produce remote sensing object class coding. The experimental results demonstrate that the parallel spectral-spatial CNN, which combines spatial and spectral features, achieves better classification performance than the individual CNN. Therefore, the proposed method provides a novel approach to land use classification based on high spatial resolution remote sensing images.