Neuro-Fuzzy Approach Toward Segmentation of Brain MRI Based on Intensity and Spatial Distribution

Segmentation in image processing finds immense application in various areas. Image processing techniques can be used in medical applications for various diagnoses. In this article, we attempt to apply segmentation techniques to the brain images. Segmentation of brain magnetic resonance images (MRI) can be used to identify various neural disorders. We can segment abnormal tissues from the MRI, which and can be used for early detection of brain tumors. The segmentation, when applied to MRI, helps in extracting the different brain tissues such as white matter, gray matter and cerebrospinal fluid. Segmentation of these tissues helps in determining the volume of these tissues in the three-dimensional brain MRI. The study of volume changes helps in analyzing many neural disorders such as epilepsy and Alzheimer disease. We have proposed a hybrid method combining the classical Fuzzy C Means algorithm with neural network for segmentation.     

Automated three-dimensional choroidal vessel segmentation of 3D 1060 nm OCT retinal data

A fully automated, robust vessel segmentation algorithm has been developed for choroidal OCT, employing multiscale 3D edge filtering and projection of “probability cones” to determine the vessel “core”, even in the tomograms with low signal-to-noise ratio (SNR). Based on the ideal vessel response after registration and multiscale filtering, with computed depth related SNR, the vessel core estimate is dilated to quantify the full vessel diameter. As a consequence, various statistics can be computed using the 3D choroidal vessel information, such as ratios of inner (smaller) to outer (larger) choroidal vessels or the absolute/relative volume of choroid vessels. Choroidal vessel quantification can be displayed in various forms, focused and averaged within a special region of interest, or analyzed as the function of image depth. In this way, the proposed algorithm enables unique visualization of choroidal watershed zones, as well as the vessel size reduction when investigating the choroid from the sclera towards the retinal pigment epithelium (RPE). To the best of our knowledge, this is the first time that an automatic choroidal vessel segmentation algorithm is successfully applied to 1060 nm 3D OCT of healthy and diseased eyes.OCIS codes: (170.4500) Optical coherence tomography, (100.0100) Image processing, (100.3008) Image recognition, algorithms and filters, (170.4580) Optical diagnostics for medicine     

Segmentation ability map: Interpret deep features for medical image segmentation

Deep convolutional neural networks (CNNs) have been widely used for medical image segmentation. In most studies, only the output layer is exploited to compute the final segmentation results and the hidden representations of the deep learned features have not been well understood. In this paper, we propose a prototype segmentation (ProtoSeg) method to compute a binary segmentation map based on deep features. We measure the segmentation abilities of the features by computing the Dice between the feature segmentation map and ground-truth, named as the segmentation ability score (SA score for short). The corresponding SA score can quantify the segmentation abilities of deep features in different layers and units to understand the deep neural networks for segmentation. In addition, our method can provide a mean SA score which can give a performance estimation of the output on the test images without ground-truth. Finally, we use the proposed ProtoSeg method to compute the segmentation map directly on input images to further understand the segmentation ability of each input image. Results are presented on segmenting tumors in brain MRI, lesions in skin images, COVID-related abnormality in CT images, prostate segmentation in abdominal MRI, and pancreatic mass segmentation in CT images. Our method can provide new insights for interpreting and explainable AI systems for medical image segmentation. Our code is available on: https://github.com/shengfly/ProtoSeg.     

Tumor Malignancy Detection Using Histopathology Imaging

Image segmentation and classification in the biomedical imaging field has high worth in cancer diagnosis and grading. The proposed method classifies the images based on a combination of handcrafted features and shape features using bag of visual words (BoW). The multistage segmentation technique to localize the nuclei in histopathology images includes the stain decomposition and histogram equalization to highlight the nucleus region, followed by the nuclei key point extraction using fast radial symmetry transform, normalized graph cut based on the nuclei region estimation, and nuclei boundary estimation using modified gradient. Subsequently, features from localized regions termed as handcrafted features and the shape features using BoW are extracted for classification. The experiments are performed using both the handcrafted features and BoW to take the advantages of both local nuclei features and globally spatial features. The simulation is performed on the Bisque and BreakHis data sets (with corresponding average accuracies of 93.87% and 96.96%, respectively) and confirms better diagnosis performance using the proposed method.     

Ore image segmentation method using U-Net and Res_Unet convolutional networks

Image segmentation has been increasingly used to identify the particle size distribution of crushed ore; however, the adhesion of ore particles and dark areas in the images of blast heaps and conveyor belts usually results in lower segmentation accuracy. To overcome this issue, an image segmentation method UR based on deep learning U-Net and Res_Unet networks is proposed in this study. Gray-scale, median filter and adaptive histogram equalization techniques are used to preprocess the original ore images captured from an open pit mine to reduce noise and extract the target region. U-Net and Res_Unet are utilized to generate ore contour detection and optimization models, and the ore image segmentation result is illustrated by OpenCV. The efficiency and accuracy of the newly proposed UR method is demonstrated and validated by comparing with the existing image segmentation methods.

Image segmentation has been increasingly used to identify the particle size of crushed ore. How to accurately identify the ore particles in complex a environment is particularly important.     

Handheld simultaneous scanning laser ophthalmoscopy and optical coherence tomography system

Scanning laser ophthalmoscopy (SLO) and optical coherence tomography (OCT) are widely used retinal imaging modalities that can assist in the diagnosis of retinal pathologies. The combination of SLO and OCT provides a more comprehensive imaging system and a method to register OCT images to produce motion corrected retinal volumes. While high quality, bench-top SLO-OCT systems have been discussed in the literature and are available commercially, there are currently no handheld designs. We describe the first design and fabrication of a handheld SLO/spectral domain OCT probe. SLO and OCT images were acquired simultaneously with a combined power under the ANSI limit. High signal-to-noise ratio SLO and OCT images were acquired simultaneously from a normal subject with visible motion artifacts. Fully automated motion estimation methods were performed in post-processing to correct for the inter- and intra-frame motion in SLO images and their concurrently acquired OCT volumes. The resulting set of reconstructed SLO images and the OCT volume were without visible motion artifacts. At a reduced field of view, the SLO resolved parafoveal cones without adaptive optics at a retinal eccentricity of 11° in subjects with good ocular optics. This system may be especially useful for imaging young children and subjects with less stable fixation.OCIS codes: (170.4460) Ophthalmic optics and devices, (080.3620) Lens system design, (170.0110) Imaging systems, (170.5755) Retina scanning, (170.4470) Ophthalmology, (110.4500) Optical coherence tomography, (110.4153) Motion estimation and optical flow     

Retinal layer segmentation in optical coherence tomography (OCT) using a 3D deep-convolutional regression network for patients with age-related macular degeneration

Introduction – Retinal layer segmentation in optical coherence tomography (OCT) images is an important approach for detecting and prognosing disease. Automating segmentation using robust machine learning techniques lead to computationally efficient solutions and significantly reduces the cost of labor-intensive labeling, which is traditionally performed by trained graders at a reading center, sometimes aided by semi-automated algorithms. Although several algorithms have been proposed since the revival of deep learning, eyes with severe pathological conditions continue to challenge fully automated segmentation approaches. There remains an opportunity to leverage the underlying spatial correlations between the retinal surfaces in the segmentation approach. Methods - Some of these proposed traditional methods can be expanded to utilize the three-dimensional spatial context governing the retinal image volumes by replacing the use of 2D filters with 3D filters. Towards this purpose, we propose a spatial-context, continuity and anatomical relationship preserving semantic segmentation algorithm, which utilizes the 3D spatial context from the image volumes with the use of 3D filters. We propose a 3D deep neural network capable of learning the surface positions of the layers in the retinal volumes. Results - We utilize a dataset of OCT images from patients with Age-related Macular Degeneration (AMD) to assess performance of our model and provide both qualitative (including segmentation maps and thickness maps) and quantitative (including error metric comparisons and volumetric comparisons) results, which demonstrate that our proposed method performs favorably even for eyes with pathological changes caused by severe retinal diseases. The Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) for patients with a wide range of AMD severity scores (0–11) were within 0.84±0.41 and 1.33±0.73 pixels, respectively, which are significantly better than some of the other state-of-the-art algorithms. Conclusion – The results demonstrate the utility of extracting features from the entire OCT volume by treating the volume as a correlated entity and show the benefit of utilizing 3D autoencoder based regression networks for smoothing the approximated retinal layers by inducing shape based regularization constraints.     

Automatic segmentation of the lumen region in intravascular images of the coronary artery

Image assessment of the arterial system plays an important role in the diagnosis of cardiovascular diseases. The segmentation of the lumen and media-adventitia in intravascular (IVUS) images of the coronary artery is the first step towards the evaluation of the morphology of the vessel under analysis and the identification of possible atherosclerotic lesions. In this study, a fully automatic method for the segmentation of the lumen in IVUS images of the coronary artery is presented. The proposed method relies on the K-means algorithm and the mean roundness to identify the region corresponding to the potential lumen. An approach to identify and eliminate side branches on bifurcations is also proposed to delimit the area with the potential lumen regions. Additionally, an active contour model is applied to refine the contour of the lumen region. In order to evaluate the segmentation accuracy, the results of the proposed method were compared against manual delineations made by two experts in 326 IVUS images of the coronary artery. The average values of the Jaccard measure, Hausdorff distance, percentage of area difference and Dice coefficient were 0.88 ± 0.06, 0.29 ± 0.17  mm, 0.09 ± 0.07 and 0.94 ± 0.04, respectively, in 324 IVUS images successfully segmented. Additionally, a comparison with the studies found in the literature showed that the proposed method is slight better than the majority of the related methods that have been proposed. Hence, the new automatic segmentation method is shown to be effective in detecting the lumen in IVUS images without using complex solutions and user interaction.     

Accurate estimation of retinal vessel width using bagged decision trees and an extended multiresolution Hermite model

We present an algorithm estimating the width of retinal vessels in fundus camera images. The algorithm uses a novel parametric surface model of the cross-sectional intensities of vessels, and ensembles of bagged decision trees to estimate the local width from the parameters of the best-fit surface.We report comparative tests with REVIEW, currently the public database of reference for retinal width estimation, containing 16 images with 193 annotated vessel segments and 5066 profile points annotated manually by three independent experts. Comparative tests are reported also with our own set of 378 vessel widths selected sparsely in 38 images from the Tayside Scotland diabetic retinopathy screening programme and annotated manually by two clinicians. We obtain considerably better accuracies compared to leading methods in REVIEW tests and in Tayside tests.An important advantage of our method is its stability (success rate, i.e., meaningful measurement returned, of 100% on all REVIEW data sets and on the Tayside data set) compared to a variety of methods from the literature. We also find that results depend crucially on testing data and conditions, and discuss criteria for selecting a training set yielding optimal accuracy.     

Micro-Net: A unified model for segmentation of various objects in microscopy images

Object segmentation and structure localization are important steps in automated image analysis pipelines for microscopy images. We present a convolution neural network (CNN) based deep learning architecture for segmentation of objects in microscopy images. The proposed network can be used to segment cells, nuclei and glands in fluorescence microscopy and histology images after slight tuning of input parameters. The network trains at multiple resolutions of the input image, connects the intermediate layers for better localization and context and generates the output using multi-resolution deconvolution filters. The extra convolutional layers which bypass the max-pooling operation allow the network to train for variable input intensities and object size and make it robust to noisy data. We compare our results on publicly available data sets and show that the proposed network outperforms recent deep learning algorithms.     

Segmentation of lumen and outer wall of abdominal aortic aneurysms from 3D black-blood MRI with a registration based geodesic active contour model

Segmentation of the geometric morphology of abdominal aortic aneurysm is important for interventional planning. However, the segmentation of both the lumen and the outer wall of aneurysm in magnetic resonance (MR) image remains challenging. This study proposes a registration based segmentation methodology for efficiently segmenting MR images of abdominal aortic aneurysms. The proposed methodology first registers the contrast enhanced MR angiography (CE-MRA) and black-blood MR images, and then uses the Hough transform and geometric active contours to extract the vessel lumen by delineating the inner vessel wall directly from the CE-MRA. The proposed registration based geometric active contour is applied to black-blood MR images to generate the outer wall contour. The inner and outer vessel wall are then fused presenting the complete vessel lumen and wall segmentation. The results obtained from 19 cases showed that the proposed registration based geometric active contour model was efficient and comparable to manual segmentation and provided a high segmentation accuracy with an average Dice value reaching 89.79%.     

Tensor-cut: A tensor-based graph-cut blood vessel segmentation method and its application to renal artery segmentation

Blood vessel segmentation plays a fundamental role in many computer-aided diagnosis (CAD) systems, such as coronary artery stenosis quantification, cerebral aneurysm quantification, and retinal vascular tree analysis. Fine blood vessel segmentation can help build a more accurate computer-aided diagnosis system and help physicians gain a better understanding of vascular structures. The purpose of this article is to develop a blood vessel segmentation method that can improve segmentation accuracy in tiny blood vessels. In this work, we propose a tensor-based graph-cut method for blood vessel segmentation. With our method, each voxel can be modeled by a second-order tensor, allowing the capture of the intensity information and the geometric information for building a more accurate model for blood vessel segmentation. We compared our proposed method’s accuracy to several state-of-the-art blood vessel segmentation algorithms and performed experiments on both simulated and clinical CT datasets. Both experiments showed that our method achieved better state-of-the-art results than the competing techniques. The mean centerline overlap ratio of our proposed method is 84% on clinical CT data. Our proposed blood vessel segmentation method outperformed other state-of-the-art methods by 10% on clinical CT data. Tiny blood vessels in clinical CT data with a 1-mm radius can be extracted using the proposed technique. The experiments on a clinical dataset showed that the proposed method significantly improved the segmentation accuracy in tiny blood vessels.     

Multi-perspective label based deep learning framework for cerebral vasculature segmentation in whole-brain fluorescence images

The popularity of fluorescent labelling and mesoscopic optical imaging techniques enable the acquisition of whole mammalian brain vasculature images at capillary resolution. Segmentation of the cerebrovascular network is essential for analyzing the cerebrovascular structure and revealing the pathogenesis of brain diseases. Existing deep learning methods use a single type of annotated labels with the same pixel weight to train the neural network and segment vessels. Due to the variation in the shape, density and brightness of vessels in whole-brain fluorescence images, it is difficult for a neural network trained with a single type of label to segment all vessels accurately. To address this problem, we proposed a deep learning cerebral vasculature segmentation framework based on multi-perspective labels. First, the pixels in the central region of thick vessels and the skeleton region of vessels were extracted separately using morphological operations based on the binary annotated labels to generate two different labels. Then, we designed a three-stage 3D convolutional neural network containing three sub-networks, namely thick-vessel enhancement network, vessel skeleton enhancement network and multi-channel fusion segmentation network. The first two sub-networks were trained by the two labels generated in the previous step, respectively, and pre-segmented the vessels. The third sub-network was responsible for fusing the pre-segmented results to precisely segment the vessels. We validated our method on two mouse cerebral vascular datasets generated by different fluorescence imaging modalities. The results showed that our method outperforms the state-of-the-art methods, and the proposed method can be applied to segment the vasculature on large-scale volumes.     

Trainable COSFIRE filters for vessel delineation with application to retinal images

Retinal imaging provides a non-invasive opportunity for the diagnosis of several medical pathologies. The automatic segmentation of the vessel tree is an important pre-processing step which facilitates subsequent automatic processes that contribute to such diagnosis.We introduce a novel method for the automatic segmentation of vessel trees in retinal fundus images. We propose a filter that selectively responds to vessels and that we call B-COSFIRE with B standing for bar which is an abstraction for a vessel. It is based on the existing COSFIRE (Combination Of Shifted Filter Responses) approach. A B-COSFIRE filter achieves orientation selectivity by computing the weighted geometric mean of the output of a pool of Difference-of-Gaussians filters, whose supports are aligned in a collinear manner. It achieves rotation invariance efficiently by simple shifting operations. The proposed filter is versatile as its selectivity is determined from any given vessel-like prototype pattern in an automatic configuration process. We configure two B-COSFIRE filters, namely symmetric and asymmetric, that are selective for bars and bar-endings, respectively. We achieve vessel segmentation by summing up the responses of the two rotation-invariant B-COSFIRE filters followed by thresholding.The results that we achieve on three publicly available data sets (DRIVE: Se = 0.7655, Sp = 0.9704; STARE: Se = 0.7716, Sp = 0.9701; CHASE_DB1: Se = 0.7585, Sp = 0.9587) are higher than many of the state-of-the-art methods. The proposed segmentation approach is also very efficient with a time complexity that is significantly lower than existing methods.     

Characterization of changes in blood vessel width and tortuosity in retinopathy of prematurity using image analysis

Many retinal diseases are characterised by changes to retinal vessels. For example, a common condition associated with retinopathy of prematurity (ROP) is so-called plus disease, characterised by increased vascular dilation and tortuosity. This paper presents a general technique for segmenting out vascular structures in retinal images, and characterising the segmented blood vessels. The segmentation technique consists of several steps. Morphological preprocessing is used to emphasise linear structures such as vessels. A second derivative operator is used to further emphasise thin vascular structures, and is followed by a final morphological filtering stage. Thresholding of this image is used to provide a segmented vascular mask. Skeletonisation of this mask allows identification of points in the image where vessels cross (bifurcations and crossing points) and allows the width and tortuosity of vessel segments to be calculated. The accuracy of the segmentation stage is quite dependent on the parameters used, particularly at the thresholding stage. However, reliable measurements of vessel width and tortuosity were shown using test images. Using these tools, a set of images drawn from 23 subjects being screened for the presence of threshold ROP disease is considered. Of these subjects, 11 subsequently required treatment for ROP, 9 had no evidence of ROP, and 3 had spontaneously regressed ROP. The average vessel width and tortuosity for the treated subjects was 96.8 microm and 1.125. The corresponding figures for the non-treated cohort were 86.4 microm and 1.097. These differences were statistically significant at the 99% and 95% significance level, respectively. Subjects who progressed to threshold disease during the course of screening showed an average increase in vessel width of 9.6 microm and in tortuosity of +0.008. Only the change in width was statistically significant. Applying a simple retrospective screening paradigm based solely on vessel width and tortuosity yields a screening test with a sensitivity and specificity of 82% and 75%. Factors confounding a more accurate test include poor image quality, inaccuracies in vessel segmentation, inaccuracies in measurement of vessel width and tortuosity, and limitations inherent in screening based solely on examination of the posterior pole.     

Automatic segmentation of up to ten layer boundaries in SD-OCT images of the mouse retina with and without missing layers due to pathology

Accurate quantification of retinal layer thicknesses in mice as seen on optical coherence tomography (OCT) is crucial for the study of numerous ocular and neurological diseases. However, manual segmentation is time-consuming and subjective. Previous attempts to automate this process were limited to high-quality scans from mice with no missing layers or visible pathology. This paper presents an automatic approach for segmenting retinal layers in spectral domain OCT images using sparsity based denoising, support vector machines, graph theory, and dynamic programming (S-GTDP). Results show that this method accurately segments all present retinal layer boundaries, which can range from seven to ten, in wild-type and rhodopsin knockout mice as compared to manual segmentation and has a more accurate performance as compared to the commercial automated Diver segmentation software.OCIS codes: (100.0100) Image processing, (170.4470) Ophthalmology, (100.2960) Image analysis, (100.5010) Pattern recognition, (110.4500) Optical coherence tomography     

Modelling and extraction of pulsatile radial distension and compression motion for automatic vessel segmentation from video

Identification of vascular structures from medical images is integral to many clinical procedures. Most vessel segmentation techniques ignore the characteristic pulsatile motion of vessels in their formulation. In a recent effort to automatically segment vessels that are hidden under fat, we motivated the use of the magnitude of local pulsatile motion extracted from surgical endoscopic video. In this article we propose a new approach that leverages the local orientation, in addition to magnitude of motion, and demonstrate that the extended computation and utilization of motion vectors can improve the segmentation of vascular structures. We implement our approach using four alternatives to magnitude-only motion estimation by using traditional optical flow and by exploiting the monogenic signal for fast flow estimation. Our evaluations are conducted on both synthetic phantoms as well as two real ultrasound datasets showing improved segmentation results with negligible change in computational performance compared to the previous magnitude only approach.     

Multiple Resolution Bayesian Segmentation of Ultrasound Images

We propose a novel method for obtaining the maximum a posteriori (MAP) probabilistic segmentation of speckle-laden ultrasound images. Our technique is multiple-resolution based, and relies on the conversion of speckle images with Rayleigh statistics to subsampled images with Gaussian statistics. This conversion reduces computation time, as well as allowing accurate parameter estimation for a probabilistic segmentation algorithm. Results appear to provide improvements over previous techniques in terms of low-contrast detail and accuracy.     

Speckles Suppression Techniques for Ultrasound Images

Most medical images have a poorer signal to noise ratio than scenes taken with a digital camera, which often leads to incorrect diagnosis. Speckles suppression from ultrasound images is one of the most important concerns in computer-aided diagnosis. This article proposes two novel, robust and efficient ultrasound images denoising techniques. The first technique is the enhanced ultrasound images denoising (EUID) technique, which estimates automatically the speckle noise amount in the ultrasound images by estimating important input parameters of the filter and then denoising the image using the sigma filter. The second technique is the ultrasound image denoising using neural network (UIDNN) that is based on the second-order difference of pixels with adaptive threshold value in order to identify random valued speckles from images to achieve high efficient image restoration. The performances of the proposed techniques are analyzed and compared with those of other image denoising techniques. The experimental results show that the proposed techniques are valuable tools for speckles suppression, being accurate, less tedious, and preventing typical human errors associated with manual tasks in addition to preserving the edges from the image. The EUID algorithm has nearly the same peak signal to noise ratio (PSNR) as Frost and speckle-reducing anisotropic diffusion 1, whereas it achieves higher gains, on average—0.4 dB higher PSNR—than the Lee, Kuan, and anisotropic diffusion filters. The UIDNN technique outperforms all the other techniques since it can determine the noisy pixels and perform filtering for these pixels only. Generally, when relatively high levels of noise are added, the proposed algorithms show better performances than the other conventional filters.     

Edge-preserving speckle texture removal by interference-based speckle filtering followed by anisotropic diffusion

Ultrasonography has an inherent noise pattern, called speckle, which is known to hamper object recognition for both humans and computers. Speckle noise is produced by the mutual interference of a set of scattered wavefronts. Depending on the phase of the wavefronts, the interference may be constructive or destructive, which results in brighter or darker pixels, respectively. We propose a filter that minimizes noise fluctuation while simultaneously preserving local gray level information. It is based on steps to attenuate the destructive and constructive interference present in ultrasound images. This filter, called interference-based speckle filter followed by anisotropic diffusion (ISFAD), was developed to remove speckle texture from B-mode ultrasound images, while preserving the edges and the gray level of the region. The ISFAD performance was compared with 10 other filters. The evaluation was based on their application to images simulated by Field II (developed by Jensen et al.) and the proposed filter presented the greatest structural similarity, 0.95. Functional improvement of the segmentation task was also measured, comparing rates of true positive, false positive and accuracy. Using three different segmentation techniques, ISFAD also presented the best accuracy rate (greater than 90% for structures with well-defined borders).