Tensor-cut: A tensor-based graph-cut blood vessel segmentation method and its application to renal artery segmentation

Blood vessel segmentation plays a fundamental role in many computer-aided diagnosis (CAD) systems, such as coronary artery stenosis quantification, cerebral aneurysm quantification, and retinal vascular tree analysis. Fine blood vessel segmentation can help build a more accurate computer-aided diagnosis system and help physicians gain a better understanding of vascular structures. The purpose of this article is to develop a blood vessel segmentation method that can improve segmentation accuracy in tiny blood vessels. In this work, we propose a tensor-based graph-cut method for blood vessel segmentation. With our method, each voxel can be modeled by a second-order tensor, allowing the capture of the intensity information and the geometric information for building a more accurate model for blood vessel segmentation. We compared our proposed method’s accuracy to several state-of-the-art blood vessel segmentation algorithms and performed experiments on both simulated and clinical CT datasets. Both experiments showed that our method achieved better state-of-the-art results than the competing techniques. The mean centerline overlap ratio of our proposed method is 84% on clinical CT data. Our proposed blood vessel segmentation method outperformed other state-of-the-art methods by 10% on clinical CT data. Tiny blood vessels in clinical CT data with a 1-mm radius can be extracted using the proposed technique. The experiments on a clinical dataset showed that the proposed method significantly improved the segmentation accuracy in tiny blood vessels.     

Phantom-based performance evaluation: application to brain segmentation from magnetic resonance images

This paper presents a new technique for assessing the accuracy of segmentation algorithms, applied to the performance evaluation of brain editing and brain tissue segmentation algorithms for magnetic resonance images. We propose performance evaluation criteria derived from the use of the realistic digital brain phantom Brainweb. This 'ground truth' allows us to build distance-based discrepancy features between the edited brain or the segmented brain tissues (such as cerebro-spinal fluid, grey matter and white matter) and the phantom model, taken as a reference. Furthermore, segmentation errors can be spatially determined, and ranged in terms of their distance to the reference. The brain editing method used is the combination of two segmentation techniques. The first is based on binary mathematical morphology and a region growing approach. It represents the initialization step, the results of which are then refined with the second method, using an active contour model. The brain tissue segmentation used is based on a Markov random field model. Segmentation results are shown on the phantom for each method, and on real magnetic resonance images for the editing step; performance is evaluated by the new distance-based technique and corroborates the effective refinement of the segmentation using active contours. The criteria described here can supersede biased visual inspection in order to compare, evaluate and validate any segmentation algorithm. Moreover, provided a 'ground truth' is given, we are able to determine quantitatively to what extent a segmentation algorithm is sensitive to internal parameters, noise, artefacts or distortions.     

Diffusion tensor imaging-based tissue segmentation: validation and application to the developing child and adolescent brain

We present and validate a novel diffusion tensor imaging (DTI) approach for segmenting the human whole-brain into partitions representing grey matter (GM), white matter (WM) and cerebrospinal fluid (CSF). The approach utilizes the contrast among tissue types in the DTI anisotropy vs. diffusivity rotational invariant space. The DTI-based whole-brain GM and WM fractions (GMf and WMf) are contrasted with the fractions obtained from conventional magnetic resonance imaging (cMRI) tissue segmentation (or clustering) methods that utilized dual echo (proton density-weighted (PDw)), and spin-spin relaxation-weighted (T2w) contrast, in addition to spin-lattice relaxation weighted (T1w) contrasts acquired in the same imaging session and covering the same volume. In addition to good correspondence with cMRI estimates of brain volume, the DTI-based segmentation approach accurately depicts expected age vs. WM and GM volume-to-total intracranial brain volume percentage trends on the rapidly developing brains of a cohort of 29 children (6-18 years). This approach promises to extend DTI utility to both micro and macrostructural aspects of tissue organization.     

Multiscale 3D shape representation and segmentation with applications to hippocampal/caudate extraction from brain MRI

Extracting structure of interest from medical images is an important yet tedious work. Due to the image quality, the shape knowledge is widely used for assisting and constraining the segmentation process. In many previous works, shape knowledge was incorporated by first constructing a shape space from training cases, and then constraining the segmentation process to be within the learned shape space. However, such an approach has certain limitations due to the number of variations, eigen-shapemodes, that can be captured in the learned shape space. Moreover, small scale shape variances are usually overwhelmed by those in the large scale, and therefore the local shape information is lost. In this work, we present a multiscale representation for shapes with arbitrary topology, and a fully automatic method to segment the target organ/tissue from medical images using such multiscale shape information and local image features. First, we handle the problem of lacking eigen-shapemodes by providing a multiscale shape representation using the wavelet transform. Consequently, the shape variances existing in the training shapes captured by the statistical learning step are also represented at various scales. Note that by doing so, one can greatly enrich the eigen-shapemodes as well as capture small scale shape changes. Furthermore, in order to make full use of the training information, not only the shape but also the grayscale training images are utilized in a multi-atlas initialization procedure. By combining such initialization with the multiscale shape knowledge, we perform segmentation tests for challenging medical data sets where the target objects have low contrast and sharp corner structures, and demonstrate the statistically significant improvement obtained by employing such multiscale representation, in representing shapes as well as the overall shape based segmentation tasks.     

Surface-based multi-template automated hippocampal segmentation: Application to temporal lobe epilepsy

In drug-resistant temporal lobe epilepsy (TLE), detecting hippocampal atrophy on MRI is crucial as it allows defining the surgical target. In addition to atrophy, about 40% of patients present with malrotation, a developmental anomaly characterized by atypical morphologies of the hippocampus and collateral sulcus. We have recently shown that both atrophy and malrotation impact negatively the performance of volume-based techniques. Here, we propose a novel hippocampal segmentation algorithm (SurfMulti) that integrates deformable parametric surfaces, vertex-wise modeling of locoregional texture and shape, and multiple templates in a unified framework. To account for inter-subject variability, including shape variants, we used a library derived from a large database of healthy (n=80) and diseased (n=288) hippocampi. To quantify malrotation, we generated 3D models from manual hippocampal labels and automatically extracted collateral sulci. The accuracy of SurfMulti was evaluated relative to manual labeling and segmentation obtained through a single atlas-based algorithm (FreeSurfer) and a volume-based multi-template approach (Vol-multi) using the Dice similarity index and surface-based shape mapping, for which we computed vertex-wise displacement vectors between automated and manual segmentations. We then correlated segmentation accuracy with malrotation features and atrophy. SurfMulti outperformed FreeSurfer and Vol-multi, and achieved a level of accuracy in TLE patients (Dice=86.9%) virtually identical to healthy controls (Dice=87.5%). Vertex-wise shape mapping showed that SurfMulti had an excellent overlap with manual labels, with sub-millimeter precision. Its performance was not influenced by atrophy or malrotation (|r|<0.20, p>0.2), while FreeSurfer (|r|>0.35, p<0.0001) and Vol-multi (|r|>0.28, p<0.05) were hampered by both anomalies. The magnitude of atrophy detected using SurfMulti was the closest to manual volumetry (Cohen's d: manual=1.71, t=7.6; SurfMulti=1.60, t=7.0; Vol-multi=1.38, t=6.1; FreeSurfer=0.91, t=3.9). The high performance of SurfMulti regardless of cohort, atrophy and shape variants identifies this algorithm as a robust segmentation tool for hippocampal volumetry.     

一种基于形态学方法优化的种子填充算法及其在脑组织CT影像自动分割中的应用

医学图像的自动组织分割技术已经成为一种迫切的需求和发展趋势。本文将图像腐蚀和膨胀应用到基本种子填充算法中，提出了一种优化的种子填充分割算法，并应用于脑组织CT影像自动分割中。在进行种子选取时，利用腐蚀方法去除种子噪声，使种子的选取达到最优化。对分割后的图像借助膨胀方法消除空白点，使图像更平滑、清晰。实验证明了该方法的有效性。     

Robust whole-brain segmentation: Application to traumatic brain injury

We propose a framework for the robust and fully-automatic segmentation of magnetic resonance (MR) brain images called “Multi-Atlas Label Propagation with Expectation–Maximisation based refinement” (MALP-EM). The presented approach is based on a robust registration approach (MAPER), highly performant label fusion (joint label fusion) and intensity-based label refinement using EM. We further adapt this framework to be applicable for the segmentation of brain images with gross changes in anatomy. We propose to account for consistent registration errors by relaxing anatomical priors obtained by multi-atlas propagation and a weighting scheme to locally combine anatomical atlas priors and intensity-refined posterior probabilities. The method is evaluated on a benchmark dataset used in a recent MICCAI segmentation challenge. In this context we show that MALP-EM is competitive for the segmentation of MR brain scans of healthy adults when compared to state-of-the-art automatic labelling techniques. To demonstrate the versatility of the proposed approach, we employed MALP-EM to segment 125 MR brain images into 134 regions from subjects who had sustained traumatic brain injury (TBI). We employ a protocol to assess segmentation quality if no manual reference labels are available. Based on this protocol, three independent, blinded raters confirmed on 13 MR brain scans with pathology that MALP-EM is superior to established label fusion techniques. We visually confirm the robustness of our segmentation approach on the full cohort and investigate the potential of derived symmetry-based imaging biomarkers that correlate with and predict clinically relevant variables in TBI such as the Marshall Classification (MC) or Glasgow Outcome Score (GOS). Specifically, we show that we are able to stratify TBI patients with favourable outcomes from non-favourable outcomes with 64.7% accuracy using acute-phase MR images and 66.8% accuracy using follow-up MR images. Furthermore, we are able to differentiate subjects with the presence of a mass lesion or midline shift from those with diffuse brain injury with 76.0% accuracy. The thalamus, putamen, pallidum and hippocampus are particularly affected. Their involvement predicts TBI disease progression.     

Automated hippocampal segmentation by regional fluid registration of serial MRI: validation and application in Alzheimer's disease

The application of voxel-level three-dimensional registration to serial magnetic resonance imaging (MRI) is described. This fluid registration determines deformation fields modeling brain change, which are consistent with a model describing a viscous fluid. The objective was to validate the measurement of hippocampal volumetric change by fluid registration in Alzheimer's disease (AD) against current methodologies. The hippocampus was chosen for this study because it is difficult to measure reproducibly by manual segmentation and is widely studied; however, the technique is applicable to any structure which can be delineated on a scan. First, suitable values for the viscosity-body-force-ratio, alpha (0.01), and the number of iterations (300), were established and the convergence, repeatability, linearity, and accuracy investigated and compared with expert manual segmentation. A simple model of hippocampal atrophy was used to compare simulated volumetric change against that obtained by fluid registration. Finally the serial segmentation was compared with the current gold standard technique-expert human labeling with a volume repeatability of approximately 4%-in 27 subjects (15 normal controls, 12 clinically diagnosed with Alzheimer's disease). The scan-rescan volumetric consistency of serial segmentation by fluid-registration was shown to be superior to human serial segmentors ( approximately 2%). The mean absolute volume difference between fluid and manual segmentation was 0.7%. Fluid registration has potential importance for tracking longitudinal structural changes in brain particularly in the context of the clinical trial where large numbers of subjects may have multiple MR scans.     

Generalized pixel profiling and comparative segmentation with application to arteriovenous malformation segmentation

Extraction of structural and geometric information from 3-D images of blood vessels is a well known and widely addressed segmentation problem. The segmentation of cerebral blood vessels is of great importance in diagnostic and clinical applications, with a special application in diagnostics and surgery on arteriovenous malformations (AVM). However, the techniques addressing the problem of the AVM inner structure segmentation are rare. In this work we present a novel method of pixel profiling with the application to segmentation of the 3-D angiography AVM images. Our algorithm stands out in situations with low resolution images and high variability of pixel intensity. Another advantage of our method is that the parameters are set automatically, which yields little manual user intervention. The results on phantoms and real data demonstrate its effectiveness and potentials for fine delineation of AVM structure.     

Shape-based acetabular cartilage segmentation: application to CT and MRI datasets

Purpose

A new method for acetabular cartilage segmentation in both computed tomography (CT) arthrography and magnetic resonance imaging (MRI) datasets with leg tension is developed and tested.

Methods

The new segmentation method is based on the combination of shape and intensity information. Shape information is acquired according to the predictable nonlinear relationship between the U-shaped acetabulum region and acetabular cartilage. Intensity information is obtained from the acetabular cartilage region automatically to complete the segmentation procedures. This method is evaluated using 54 CT arthrography datasets with two different radiation doses and 20 MRI datasets. Additionally, the performance of this method in identifying acetabular cartilage is compared with four other acetabular cartilage segmentation methods.

Results

This method performed better than the comparison methods. Indeed, this method maintained good accuracy level for 74 datasets independent of the cartilage modality and with minimum user interaction in the bone segmentation procedures. In addition, this method was efficient in noisy conditions and in detection of the damaged cartilages with zero thickness, which confirmed its potential clinical usefulness.

Conclusions

Our new method proposes acetabular cartilage segmentation in three different datasets based on the combination of the shape and intensity information. This method executes well in situations where there are clear boundaries between the acetabular and femoral cartilages. However, the acetabular cartilage and pelvic bone information should be obtained from one dataset such as CT arthrography or MRI datasets with leg traction.

     

Automated 3D closed surface segmentation: application to vertebral body segmentation in CT images

Purpose

A fully automated segmentation algorithm, progressive surface resolution (PSR), is presented in this paper to determine the closed surface of approximately convex blob-like structures that are common in biomedical imaging. The PSR algorithm was applied to the cortical surface segmentation of 460 vertebral bodies on 46 low-dose chest CT images, which can be potentially used for automated bone mineral density measurement and compression fracture detection.

Methods

The target surface is realized by a closed triangular mesh, which thereby guarantees the enclosure. The surface vertices of the triangular mesh representation are constrained along radial trajectories that are uniformly distributed in 3D angle space. The segmentation is accomplished by determining for each radial trajectory the location of its intersection with the target surface. The surface is first initialized based on an input high confidence boundary image and then resolved progressively based on a dynamic attraction map in an order of decreasing degree of evidence regarding the target surface location.

Results

For the visual evaluation, the algorithm achieved acceptable segmentation for 99.35 % vertebral bodies. Quantitative evaluation was performed on 46 vertebral bodies and achieved overall mean Dice coefficient of 0.939 (with max \(=\) 0.957, min \(=\) 0.906 and standard deviation \(=\) 0.011) using manual annotations as the ground truth.

Conclusions

Both visual and quantitative evaluations demonstrate encouraging performance of the PSR algorithm. This novel surface resolution strategy provides uniform angular resolution for the segmented surface with computation complexity and runtime that are linearly constrained by the total number of vertices of the triangular mesh representation.

     

CAN: Context-assisted full Attention Network for brain tissue segmentation

Brain tissue segmentation is of great value in diagnosing brain disorders. Three-dimensional (3D) and two-dimensional (2D) segmentation methods for brain Magnetic Resonance Imaging (MRI) suffer from high time complexity and low segmentation accuracy, respectively. To address these two issues, we propose a Context-assisted full Attention Network (CAN) for brain MRI segmentation by integrating 2D and 3D data of MRI. Different from the fully symmetric structure U-Net, the CAN takes the current 2D slice, its 3D contextual skull slices and 3D contextual brain slices as the input, which are further encoded by the DenseNet and decoded by our constructed full attention network. We have validated the effectiveness of the CAN on our collected dataset PWML and two public datasets dHCP2017 and MALC2012. Our code is available at https://github.com/nwuAI/CAN.     

Simultaneous segmentation and grading of anatomical structures for patient's classification: application to Alzheimer's disease

In this paper, we propose an innovative approach to robustly and accurately detect Alzheimer's disease (AD) based on the distinction of specific atrophic patterns of anatomical structures such as hippocampus (HC) and entorhinal cortex (EC). The proposed method simultaneously performs segmentation and grading of structures to efficiently capture the anatomical alterations caused by AD. Known as SNIPE (Scoring by Non-local Image Patch Estimator), the novel proposed grading measure is based on a nonlocal patch-based frame-work and estimates the similarity of the patch surrounding the voxel under study with all the patches present in different training populations. In this study, the training library was composed of two populations: 50 cognitively normal subjects (CN) and 50 patients with AD, randomly selected from the ADNI database. During our experiments, the classification accuracy of patients (CN vs. AD) using several biomarkers was compared: HC and EC volumes, the grade of these structures and finally the combination of their volume and their grade. Tests were completed in a leave-one-out framework using discriminant analysis. First, we showed that biomarkers based on HC provide better classification accuracy than biomarkers based on EC. Second, we demonstrated that structure grading is a more powerful measure than structure volume to distinguish both populations with a classification accuracy of 90%. Finally, by adding the ages of subjects in order to better separate age-related structural changes from disease-related anatomical alterations, SNIPE obtained a classification accuracy of 93%.     

Infant brain probability templates for MRI segmentation and normalization

Spatial normalization and segmentation of infant brain MRI data based on adult or pediatric reference data may not be appropriate due to the developmental differences between the infant input data and the reference data. In this study we have constructed infant templates and a priori brain tissue probability maps based on the MR brain image data from 76 infants ranging in age from 9 to 15 months. We employed two processing strategies to construct the infant template and a priori data: one processed with and one without using a priori data in the segmentation step. Using the templates we constructed, comparisons between the adult templates and the new infant templates are presented. Tissue distribution differences are apparent between the infant and adult template, particularly in the gray matter (GM) maps. The infant a priori information classifies brain tissue as GM with higher probability than adult data, at the cost of white matter (WM), which presents with lower probability when compared to adult data. The differences are more pronounced in the frontal regions and in the cingulate gyrus. Similar differences are also observed when the infant data is compared to a pediatric (age 5 to 18) template. The two-pass segmentation approach taken here for infant T1W brain images has provided high quality tissue probability maps for GM, WM, and CSF, in infant brain images. These templates may be used as prior probability distributions for segmentation and normalization; a key to improving the accuracy of these procedures in special populations.     

Joint optimization of segmentation and shape prior from level-set-based statistical shape model,and its application to the automated segmentation of abdominal organs

The goal of this study is to provide a theoretical framework for accurately optimizing the segmentation energy considering all of the possible shapes generated from the level-set-based statistical shape model (SSM). The proposed algorithm solves the well-known open problem, in which a shape prior may not be optimal in terms of an objective functional that needs to be minimized during segmentation. The algorithm allows the selection of an optimal shape prior from among all possible shapes generated from an SSM by conducting a branch-and-bound search over an eigenshape space. The proposed algorithm does not require predefined shape templates or the construction of a hierarchical clustering tree before graph-cut segmentation. It jointly optimizes an objective functional in terms of both the shape prior and segmentation labeling, and finds an optimal solution by considering all possible shapes generated from an SSM. We apply the proposed algorithm to both pancreas and spleen segmentation using multiphase computed tomography volumes, and we compare the results obtained with those produced by a conventional algorithm employing a branch-and-bound search over a search tree of predefined shapes, which were sampled discretely from an SSM. The proposed algorithm significantly improves the segmentation performance in terms of the Jaccard index and Dice similarity index. In addition, we compare the results with the state-of-the-art multiple abdominal organs segmentation algorithm, and confirmed that the performances of both algorithms are comparable to each other. We discuss the high computational efficiency of the proposed algorithm, which was determined experimentally using a normalized number of traversed nodes in a search tree, and the extensibility of the proposed algorithm to other SSMs or energy functionals.     

Improved inference in Bayesian segmentation using Monte Carlo sampling: Application to hippocampal subfield volumetry

Many segmentation algorithms in medical image analysis use Bayesian modeling to augment local image appearance with prior anatomical knowledge. Such methods often contain a large number of free parameters that are first estimated and then kept fixed during the actual segmentation process. However, a faithful Bayesian analysis would marginalize over such parameters, accounting for their uncertainty by considering all possible values they may take. Here we propose to incorporate this uncertainty into Bayesian segmentation methods in order to improve the inference process. In particular, we approximate the required marginalization over model parameters using computationally efficient Markov chain Monte Carlo techniques. We illustrate the proposed approach using a recently developed Bayesian method for the segmentation of hippocampal subfields in brain MRI scans, showing a significant improvement in an Alzheimer’s disease classification task. As an additional benefit, the technique also allows one to compute informative “error bars” on the volume estimates of individual structures.     

Probabilistic vessel axis tracing and its application to vessel segmentation with stream surfaces and minimum cost paths

We propose a novel framework to segment vessels on their cross-sections. It starts with a probabilistic vessel axis tracing in a gray-scale three-dimensional angiogram, followed by vessel boundary delineation on cross-sections derived from the extracted axis. It promotes a more intuitive delineation of vessel boundaries which are mostly round on the cross-sections. The prior probability density function of the axis tracer's formulation permits seamless integration of user guidance to produce continuous traces through regions that contain furcations, diseased portions, kissing vessels (vessels in close proximity to each other) and thin vessels. The contour that outlines the vessel boundary in a 3-D space is determined as the minimum cost path on a weighted directed acyclic graph derived from each cross-section. The user can place anchor points to force the contour to pass through. The contours obtained are tiled to approximate the vessel boundary surface. Since we use stream surfaces generated w.r.t. the traced axis as cross-sections, non-intersecting adjacent cross-sections are guaranteed. Therefore, the tiling can be achieved by joining vertices of adjacent contours. The vessel boundary surface is then deformed under constrained movements on the cross-sections and is voxelized to produce the final vascular segmentation. Experimental results on synthetic and clinical data have shown that the vessel axes extracted by our tracer are continuous and less jittered as compared with the other two trace-based algorithms. Furthermore, the segmentation algorithm with cross-sections are robust to noise and can delineate vessel boundaries that have level of variability similar to those obtained manually.     

An integrated approach to segmentation and nonrigid registration for application in image-guided pelvic radiotherapy

External beam radiotherapy (EBRT) has become the preferred options for nonsurgical treatment of prostate cancer and cervix cancer. In order to deliver higher doses to cancerous regions within these pelvic structures (i.e. prostate or cervix) while maintaining or lowering the doses to surrounding non-cancerous regions, it is critical to account for setup variation, organ motion, anatomical changes due to treatment and intra-fraction motion. In previous work, manual segmentation of the soft tissues is performed and then images are registered based on the manual segmentation. In this paper, we present an integrated automatic approach to multiple organ segmentation and nonrigid constrained registration, which can achieve these two aims simultaneously. The segmentation and registration steps are both formulated using a Bayesian framework, and they constrain each other using an iterative conditional model strategy. We also propose a new strategy to assess cumulative actual dose for this novel integrated algorithm, in order to both determine whether the intended treatment is being delivered and, potentially, whether or not a plan should be adjusted for future treatment fractions. Quantitative results show that the automatic segmentation produced results that have an accuracy comparable to manual segmentation, while the registration part significantly outperforms both rigid and nonrigid registration. Clinical application and evaluation of dose delivery show the superiority of proposed method to the procedure currently used in clinical practice, i.e. manual segmentation followed by rigid registration.     

Multi-shape graph cuts with neighbor prior constraints and its application to lung segmentation from a chest CT volume

This paper presents a novel graph cut algorithm that can take into account multi-shape constraints with neighbor prior constraints, and reports on a lung segmentation process from a three-dimensional computed tomography (CT) image based on this algorithm. The major contribution of this paper is the proposal of a novel segmentation algorithm that improves lung segmentation for cases in which the lung has a unique shape and pathologies such as pleural effusion by incorporating multiple shapes and prior information on neighbor structures in a graph cut framework. We demonstrate the efficacy of the proposed algorithm by comparing it to conventional one using a synthetic image and clinical thoracic CT volumes.     

A robust method for extraction and automatic segmentation of brain images

A new protocol is introduced for brain extraction and automatic tissue segmentation of MR images. For the brain extraction algorithm, proton density and T2-weighted images are used to generate a brain mask encompassing the full intracranial cavity. Segmentation of brain tissues into gray matter (GM), white matter (WM), and cerebral spinal fluid (CSF) is accomplished on a T1-weighted image after applying the brain mask. The fully automatic segmentation algorithm is histogram-based and uses the Expectation Maximization algorithm to model a four-Gaussian mixture for both global and local histograms. The means of the local Gaussians for GM, WM, and CSF are used to set local thresholds for tissue classification. Reproducibility of the extraction procedure was excellent, with average variation in intracranial capacity (TIC) of 0.13 and 0.66% TIC in 12 healthy normal and 33 Alzheimer brains, respectively. Repeatability of the segmentation algorithm, tested on healthy normal images, indicated scan-rescan differences in global tissue volumes of less than 0.30% TIC. Reproducibility at the regional level was established by comparing segmentation results within the 12 major Talairach subdivisions. Accuracy of the algorithm was tested on a digital brain phantom, and errors were less than 1% of the phantom volume. Maximal Type I and Type II classification errors were low, ranging between 2.2 and 4.3% of phantom volume. The algorithm was also insensitive to variation in parameter initialization values. The protocol is robust, fast, and its success in segmenting normal as well as diseased brains makes it an attractive clinical application.