An adaptive snake model for ultrasound image segmentation: modified trimmed mean filter, ramp integration and adaptive weighting parameters

The snake model is a widely-used approach to finding the boundary of the object of interest in an ultrasound image. However, due to the speckles, the weak edges and the tissue-related textures in an ultrasound image, conventional snake models usually cannot obtain the desired boundary satisfactorily. In this paper, we propose a new adaptive snake model for ultrasound image segmentation. The proposed snake model is composed of three major techniques, namely, the modified trimmed mean (MTM) filtering, ramp integration and adaptive weighting parameters. With the advantages of the mean and median filters, the MTM filter is employed to alleviate the speckle interference in the segmentation process. The weak edge enhancement by ramp integration attempts to capture the slowly varying edges, which are hard to capture by conventional snake models. The adaptive weighting parameter allows weighting of each energy term to change adaptively during the deformation process. The proposed snake model has been verified on the phantom and clinical ultrasound images. The experimental results showed that the proposed snake model achieves a reasonable performance with an initial contour placed 10 to 20 pixels away from the desired boundary. The mean minimal distances from the derived boundary to the desired boundary have been shown to be less than 3.5 (for CNR > or = 0.5) and 2.5 pixels, respectively, for the phantom and ultrasound images.     

Refined segmentation of ship target in SAR images based on GVF snake with elliptical constraint

Ocean surveillance is an important application of synthetic aperture radar (SAR) image interpretation. In the ocean, the ship target usually attracts the attention of researchers, hence many interpretation works focus on it. The precise ship segmentation can facilitate further processing, such as feature extraction and target recognition. This paper proposes a refined segmentation method for ship target, in which the ratio of exponentially weighted averages (ROEWA) operator is used to produce the edge map and the elliptical constraint (EC) is incorporated into the energy function of the gradient vector flow (GVF) snake model to extract the ship target precisely. With this prior shape constraint, the snake contour can overcome unexpected distortions stemming from speckle noise and side lobe effect, etc. experimental results based on TerraSAR X-band and RADARSAT-2 C-band data illustrate the effective performance of the proposed method on refined segmentation for ship targets.     

Cell-based dual snake model: a new approach to extracting highly winding boundaries in the ultrasound images

Two common deficiencies of most conventional deformable models are the need to place the initial contour very close to the desired boundary and the incapability of capturing a highly winding boundary for sonographic boundary extraction. To remedy these two deficiencies, a new deformable model (namely, the cell-based dual snake model) is proposed in this paper. The basic idea is to apply the dual snake model in the cell-based deformation manner. While the dual snake model provides an effective mechanism allowing a distant initial contour, the cell-based deformation makes it possible to catch the winding characteristics of the desired boundary. The performance of the proposed cell-based dual snake model has been evaluated on synthetic images with simulated speckles and on the clinical ultrasound (US) images. The experimental results show that the mean distances from the derived to the desired boundary points are 0.9 +/- 0.42 pixels and 1.29 +/- 0.39 pixels for the synthetic and the clinical US images, respectively.     

Segmentation of breast tumor in three-dimensional ultrasound images using three-dimensional discrete active contour model

In this paper, we apply the three-dimensional (3-D) active contour model to a 3-D ultrasonic data file for segmenting of the breast tumor. The 3-D ultrasonic file is composed of a series of two-dimensional (2-D) images. Most of traditional techniques of 2-D image segmentation will not use the information between adjacent images. To suit the property of the 3-D data, we introduce the concept of the 3-D stick, the 3-D morphologic process and the 3-D active contour model. The 3-D stick can get over the problem that the ultrasonic image is full of speckle noise and highlight the edge information in images. The 3-D morphologic process helps to determine the contour of the tumor and the resulting contour can be regarded as the initial contour of the active contour model. Finally, the 3-D active contour model will make the initial contour approach to the real contour of the tumor. However, there is emphasis on these 3-D techniques that they do not consist of a series of 2-D techniques. When they work, they will consider the horizontal, vertical and depth directions at the same time. The use of these 3-D techniques not only segments the 3-D shape but also obtains the volume of the tumor. The volume of the tumor calculated by the proposed method will be compared with the volume calculated by the VOCAL software with the physician's manually drawn shape and it shows that the performance of our method is satisfactory.     

Segmentation by retrieval with guided random walks: Application to left ventricle segmentation in MRI

In this paper, a new segmentation framework with prior knowledge is proposed and applied to the left ventricles in cardiac Cine MRI sequences. We introduce a new formulation of the random walks method, coined as guided random walks, in which prior knowledge is integrated seamlessly. In comparison with existing approaches that incorporate statistical shape models, our method does not extract any principal model of the shape or appearance of the left ventricle. Instead, segmentation is accompanied by retrieving the closest subject in the database that guides the segmentation the best. Using this techniques, rare cases can also effectively exploit prior knowledge from few samples in training set. These cases are usually disregarded in statistical shape models as they are outnumbered by frequent cases (effect of class population). In the worst-case scenario, if there is no matching case in the database to guide the segmentation, performance of the proposed method reaches to the conventional random walks, which is shown to be accurate if sufficient number of seeds is provided. There is a fast solution to the proposed guided random walks by using sparse linear matrix operations and the whole framework can be seamlessly implemented in a parallel architecture. The method has been validated on a comprehensive clinical dataset of 3D+t short axis MR images of 104 subjects from 5 categories (normal, dilated left ventricle, ventricular hypertrophy, recent myocardial infarction, and heart failure). The average segmentation errors were found to be 1.54 mm for the endocardium and 1.48 mm for the epicardium. The method was validated by measuring different algorithmic and physiologic indices and quantified with manual segmentation ground truths, provided by a cardiologist.     

Deep level set method for optic disc and cup segmentation on fundus images

Glaucoma is a leading cause of blindness. The measurement of vertical cup-to-disc ratio combined with other clinical features is one of the methods used to screen glaucoma. In this paper, we propose a deep level set method to implement the segmentation of optic cup (OC) and optic disc (OD). We present a multi-scale convolutional neural network as the prediction network to generate level set initial contour and evolution parameters. The initial contour will be further refined based on the evolution parameters. The network is integrated with augmented prior knowledge and supervised by active contour loss, which makes the level set evolution yield more accurate shape and boundary details. The experimental results on the REFUGE dataset show that the IoU of the OC and OD are 93.61% and 96.69%, respectively. To evaluate the robustness of the proposed method, we further test the model on the Drishthi-GS1 dataset. The segmentation results show that the proposed method outperforms the state-of-the-art methods.     

3-D breast ultrasound segmentation using active contour model

In this study, we made use of the discrete active contour model to overcome the natural properties of ultrasound (US) images, speckle, noise and tissue-related textures, to segment the breast tumors precisely. Determination of the real tumor boundary with the snake-deformation process requires an initial contour estimate. However, the manual way to sketch an initial contour is very time-consuming. Thus, we propose an automatic initial contour-finding method that not only maintains the tumor shape, but also is close to the tumor boundary and inside the tumor. During the deformation process, to prevent the snake trapping into the false position caused by tissue-related texture or speckle, we added the edge information as an image feature to define the external force. In addition, because the 3-D volume of a tumor is essentially constructed by a sequence of 2-D images, our method for finding boundaries of a tumor can be extended to 3-D cases. By precisely counting the volume of the 3-D images, we can get the volume of tumor. Finally, we will show that the proposed techniques have rather good performance and lead to a satisfactory result in comparison with the estimated volume and physician's estimate.     

A framework for automatic analysis of the dynamic behaviour of coronary angiograms

A framework for coronary vessels analysis in digital subtracted angiograms is described. This method combines the motion estimation with the frame-to-frame structure detection in a natural way such that they act interactively. The first step consists of the extraction of the vessel centrelines in one image and their organization into meaningful constituents or branches of the coronary arterial tree. The motion is then estimated along the centrelines through a gradient based method. These motion estimates supply an initial positioning of an active contour model (or ‘snake“) in the next image. This model adapts itself by changing its shape to accurately fit onto the new centrelines. This process is then reiterated on the subsequent images to depict the dynamic behaviour of all the relevant branches. The main interests of this scheme are: (1) the active models operate locally so a fast detection of the vessels can be performed; (2) the centrelines extraction is fully guided by the confluence of the motion estimation and the contour model; (3) both morphological and kinetic features are provided on a quantitative basis.     

An early vision-based snake model for ultrasound image segmentation

Due to the speckles and the ill-defined edges of the object of interest, the classic image-segmentation techniques are usually ineffective in segmenting ultrasound (US) images. In this paper, we present a new algorithm for segmenting general US images that is composed of two major techniques; namely, the early-vision model and the discrete-snake model. By simulating human early vision, the early-vision model can capture both grey-scale and textural edges while the speckle noise is suppressed. By performing deformation only on the peaks of the distance map, the discrete-snake model promises better noise immunity and more accurate convergence. Moreover, the constraint for most conventional snake models that the initial contour needs to be located very close to the actual boundary has been relaxed substantially. The performance of the proposed snake model has been shown to be comparable to manual delineation and superior to that of the gradient vector flow (GVF) snake model.     

Fetal abdominal contour extraction and measurement in ultrasound images

A novel method is developed for the fetal abdominal contour extraction and measurement in ultrasound images. Fetal abdominal circumference (AC) is one of the standardized measurements in the antepartum ultrasound monitoring. Among several standardized measurements, AC is best correlated with fetal growth but is also the most difficult to be accurately measured. To overcome the difficulties in the abdominal contour extraction, the proposed method is a four-step procedure that integrates several image segmentation techniques. The proposed method is able to make the best use of the strength of different segmentation algorithms, while avoiding their deficiencies. An enhanced instantaneous coefficient of variation (ICOV) edge detector is first developed to detect edges of the abdominal contour and alleviate the effects of most speckle noise. Then, the Fuzzy C-Means clustering is employed to distinguish salient edges attributable to the abdominal contour from weak edges due to the other texture. Subsequently, the iterative Hough transform is applied to determine an elliptical contour and obtain an initial estimation of the AC. Finally, the gradient vector field (GVF) snake adapts the initial ellipse to the real edges of the abdominal contour. Quantitative validation of the proposed method on synthetic images under different imaging conditions achieves satisfactory segmentation accuracy (98.78%+/-0.16%). Experiments on 150 clinical images are carried out in three aspects: comparisons between inter-observer and inter-run variation, the fitness analysis between the automatically detected ellipse and the manual delineation, and the accuracy comparisons between automatic measurements and manual measurements in estimation of fetal weight (EFW). Experimental results show that the proposed method can provide consistent and accurate measurements. The reductions of the mean absolute difference and the standard deviation of EFW based on automatic measurements are about 1.2% and 2.1%, respectively, which indicate its potential in clinical antepartum monitoring application.     

Registration-based segmentation of three-dimensional ultrasound images for quantitative measurement of fetal craniofacial structure

Segmentation of a fetal head from three-dimensional (3-D) ultrasound images is a critical step in the quantitative measurement of fetal craniofacial structure. However, two main issues complicate segmentation, including fuzzy boundaries and large variations in pose and shape among different ultrasound images. In this article, we propose a new registration-based method for automatically segmenting the fetal head from 3-D ultrasound images. The proposed method first detects the eyes based on Gabor features to identify the pose of the fetus image. Then, a reference model, which is constructed from a fetal phantom and contains prior knowledge of head shape, is aligned to the image via feature-based registration. Finally, 3-D snake deformation is utilized to improve the boundary fitness between the model and image. Four clinically useful parameters including inter-orbital diameter (IOD), bilateral orbital diameter (BOD), occipital frontal diameter (OFD) and bilateral parietal diameter (BPD) are measured based on the results of the eye detection and head segmentation. Ultrasound volumes from 11 subjects were used for validation of the method accuracy. Experimental results showed that the proposed method was able to overcome the aforementioned difficulties and achieve good agreement between automatic and manual measurements.     

Active ellipse model and automatic chamber detection in apical views of echocardiography images

In this article, an automatic method for detection of all chambers in apical two- and four-chamber views is proposed. The method is based on four evolving ellipses with their sizes and alignments (centre point) gradually changing through iterations until they reach to the point that approximates the chamber boundaries. The interaction between the internal, external and inter-elliptic forces controls the simultaneous evolution of ellipses. Since no prior assumption of the approximate location is required with our approach, the specialists are not required to locate the centre points of chambers in apical images, making the overall segmentation fully automated. Moreover, the resultant ellipse inside a chamber could be used as the initial contour in segmentation techniques such as active contour models, where the initial contour has a significant role for higher accuracy and faster convergence. The simplicity of equations developed in our approach make for a computationally faster algorithm, compared with former approaches that utilize morphologic operators. Our evolving ellipse does not go beyond the gaps, a problem that normally exists within boundaries in echo images, making our overall segmentation process more robust against the gaps. To evaluate the proposed method, a subset of 80 images is selected and three observers are requested to manually draw best ellipses inside the images and compare them with our results. The obtained dice coefficient results (87.62 ± 4.53% for observer-1, 83.18 ± 6.20% for observer-2, 86.02 ± 5.16% for observer-3) indicate that the proposed method has a useful performance.     

基于梯度向量流snake模型的可视人体图像骨组织分割

为克服传统snake模型不能适应结构复杂的解剖图像、初始轮廓必须充分接近物体边缘的缺点,本研究将基于梯度向量流(GVF)的snake模型用于可视人计划(VHP)图像中骨组织的分割,并修改梯度向量流(GVF)模型,使之适用于彩色图像;针对VHP彩色解剖图像数据量巨大的特点,将多尺度思想应用到snake模型中,以提高处理速度.这种方法提高了计算效率,节省了70%分割时间,得到了理想的精确度,对研究解剖结构、组织定量化测定等具有较高的实用意义.     

一种半自动分割脑部MRI中胼胝体的方法

针对胼胝体的图像特点以及实际应用要求,采用半自动方法对MRI中的胼胝体进行分割。首先采用基于Live-Wire的算法对胼胝体影像的起始层和终止层进行初始分割,然后利用基于距离变换的形状插值算法获取中间层的初始轮廓信息,对插值获得的初始轮廓采用Snake模型进行局部收缩,获得真实的胼胝体边界。对序列MRI脑影像中的胼胝体进行分割、重建、标定。实验结果与临床医师的使用反馈证明,本文提出的算法具有较高的灵活性与可信度,对胼胝体的分割精度与解剖统计信息相符,分割结果可满足临床需求。     

Contour tracking in echocardiographic sequences via sparse representation and dictionary learning

This paper presents a dynamical appearance model based on sparse representation and dictionary learning for tracking both endocardial and epicardial contours of the left ventricle in echocardiographic sequences. Instead of learning offline spatiotemporal priors from databases, we exploit the inherent spatiotemporal coherence of individual data to constraint cardiac contour estimation. The contour tracker is initialized with a manual tracing of the first frame. It employs multiscale sparse representation of local image appearance and learns online multiscale appearance dictionaries in a boosting framework as the image sequence is segmented frame-by-frame sequentially. The weights of multiscale appearance dictionaries are optimized automatically. Our region-based level set segmentation integrates a spectrum of complementary multilevel information including intensity, multiscale local appearance, and dynamical shape prediction. The approach is validated on twenty-six 4D canine echocardiographic images acquired from both healthy and post-infarct canines. The segmentation results agree well with expert manual tracings. The ejection fraction estimates also show good agreement with manual results. Advantages of our approach are demonstrated by comparisons with a conventional pure intensity model, a registration-based contour tracker, and a state-of-the-art database-dependent offline dynamical shape model. We also demonstrate the feasibility of clinical application by applying the method to four 4D human data sets.     

A dual-snake model of high penetrability for ultrasound image boundary extraction

Most deformable models require the initial contour to be placed close to the boundary of the object of interest for boundary extraction of ultrasound (US) images, which is impractical in many clinical applications. To allow a distant initial contour, a new dual-snake model promising high penetrability through the interference of the noises is proposed in this paper. The proposed dual-snake model features a new far-reaching external force, called the discrete gradient flow, a connected component-weighted image force, and an effective stability evaluation of two underlying snakes. The experimental results show that, with a distant initial contour, the mean distance from the derived boundary to the desired boundary is less than 1.4 pixels, and most snake elements are within 2.7 pixels of the desired boundaries for the synthetic images with CNR ≥ 1. For the clinical US images, the mean distance is less than 1.9 pixels, and most snake elements are within 3 pixels of the desired boundaries. (E-mail: chung@lotus.mc.ntu.edu.tw)     

Interactive segmentation of abdominal aortic aneurysms in CTA images

A model-based approach to interactive segmentation of abdominal aortic aneurysms from CTA data is presented. After manual delineation of the aneurysm sac in the first slice, the method automatically detects the contour in subsequent slices, using the result from the previous slice as a reference. If an obtained contour is not sufficiently accurate, the user can intervene and provide an additional manual reference contour. The method is inspired by the active shape model (ASM) segmentation scheme (), in which a statistical shape model, derived from corresponding landmark points in manually labeled training images, is fitted to the image in an iterative manner. In our method, a shape model of the contours in two adjacent image slices is progressively fitted to the entire volume. The contour obtained in one slice thus constrains the possible shapes in the next slice. The optimal fit is determined on the basis of multi-resolution gray level models constructed from gray value patches sampled around each landmark. We propose to use the similarity of adjacent image slices for this gray level model, and compare these to single-slice features that are more generally used with ASM. The performance of various image features is evaluated in leave-one-out experiments on 23 data sets. Features that use the similarity of adjacent image slices outperform measures based on single-slice features in all cases. The average number of slices in our datasets is 51, while on average eight manual initializations are required, which decreases operator segmentation time by a factor of 6.     

Muscles of mastication model-based MR image segmentation

Objective The muscles of mastication play a major role in the orodigestive system as the principal motive force for the mandible. An algorithm for segmenting these muscles from magnetic resonance (MR) images was developed and tested. Materials and methods Anatomical information about the muscles of mastication in MR images is used to obtain the spatial relationships relating the muscle region of interest (ROI) and head ROI. A model-based technique that involves the spatial relationships between head and muscle ROIs as well as muscle templates is developed. In the segmentation stage, the muscle ROI is derived from the model. Within the muscle ROI, anisotropic diffusion is applied to smooth the texture, followed by thresholding to exclude bone and fat. The muscle template and morphological operators are employed to obtain an initial estimate of the muscle boundary, which then serves as the input contour to the gradient vector flow snake that iterates to the final segmentation. Results The method was applied to segmentation of the masseter, lateral pterygoid and medial pterygoid in 75 images. The overlap indices (κ) achieved are 91.4, 92.1 and 91.2%, respectively. Conclusion A model-based method for segmenting the muscles of mastication from MR images was developed and tested. The results show good agreement between manual and automatic segmentations.     

Automatic X-ray landmark detection and shape segmentation via data-driven joint estimation of image displacements

In this paper, we propose a new method for fully-automatic landmark detection and shape segmentation in X-ray images. To detect landmarks, we estimate the displacements from some randomly sampled image patches to the (unknown) landmark positions, and then we integrate these predictions via a voting scheme. Our key contribution is a new algorithm for estimating these displacements. Different from other methods where each image patch independently predicts its displacement, we jointly estimate the displacements from all patches together in a data driven way, by considering not only the training data but also geometric constraints on the test image. The displacements estimation is formulated as a convex optimization problem that can be solved efficiently. Finally, we use the sparse shape composition model as the a priori information to regularize the landmark positions and thus generate the segmented shape contour. We validate our method on X-ray image datasets of three different anatomical structures: complete femur, proximal femur and pelvis. Experiments show that our method is accurate and robust in landmark detection, and, combined with the shape model, gives a better or comparable performance in shape segmentation compared to state-of-the art methods. Finally, a preliminary study using CT data shows the extensibility of our method to 3D data.