Upper airway segmentation and dimensions estimation from cone-beam CT image datasets

Objective To segment and measure the upper airway using cone-beam computed tomography (CBCT). This information may be useful as an imaging biomarker in the diagnostic assessment of patients with obstructive sleep apnea and in the planning of any necessary therapy. Methods With Institutional Review Board Approval, anonymous CBCT datasets from subjects who had been imaged for a variety of conditions unrelated to the airway were evaluated. DICOM images were available. A segmentation algorithm was developed to separate the bounded upper airway and measurements were performed manually to determine the smallest cross-sectional area and the anteriorposterior distance of the retropalatal space (RP-SCA and RP-AP, respectively) and retroglossal space (RG-SCA and RG-AP, respectively). A segmentation algorithm was developed to separate the bounded upper airway and it was applied to determine RP-AP, RG-AP, the smallest transaxial-sectional area (TSCA) and largest sagittal view airway area (LCSA). A second algorithm was created to evaluate the airway volume within this bounded upper airway. Results Measurements of the airway segmented automatically by the developed algorithm agreed with those obtained using manual segmentation. The corresponding volumes showed only very small differences considered clinically insignificant. Conclusion Automatic segmentation of the airway imaged using CBCT is feasible and this method can be used to evaluate airway cross-section and volume comparable to measurements extracted using manual segmentation.     

Automated 3D closed surface segmentation: application to vertebral body segmentation in CT images

Purpose

A fully automated segmentation algorithm, progressive surface resolution (PSR), is presented in this paper to determine the closed surface of approximately convex blob-like structures that are common in biomedical imaging. The PSR algorithm was applied to the cortical surface segmentation of 460 vertebral bodies on 46 low-dose chest CT images, which can be potentially used for automated bone mineral density measurement and compression fracture detection.

Methods

The target surface is realized by a closed triangular mesh, which thereby guarantees the enclosure. The surface vertices of the triangular mesh representation are constrained along radial trajectories that are uniformly distributed in 3D angle space. The segmentation is accomplished by determining for each radial trajectory the location of its intersection with the target surface. The surface is first initialized based on an input high confidence boundary image and then resolved progressively based on a dynamic attraction map in an order of decreasing degree of evidence regarding the target surface location.

Results

For the visual evaluation, the algorithm achieved acceptable segmentation for 99.35 % vertebral bodies. Quantitative evaluation was performed on 46 vertebral bodies and achieved overall mean Dice coefficient of 0.939 (with max \(=\) 0.957, min \(=\) 0.906 and standard deviation \(=\) 0.011) using manual annotations as the ground truth.

Conclusions

Both visual and quantitative evaluations demonstrate encouraging performance of the PSR algorithm. This novel surface resolution strategy provides uniform angular resolution for the segmented surface with computation complexity and runtime that are linearly constrained by the total number of vertices of the triangular mesh representation.

     

Improving cardiac MRI convolutional neural network segmentation on small training datasets and dataset shift: A continuous kernel cut approach

Cardiac magnetic resonance imaging (MRI) provides a wealth of imaging biomarkers for cardiovascular disease care and segmentation of cardiac structures is required as a first step in enumerating these biomarkers. Deep convolutional neural networks (CNNs) have demonstrated remarkable success in image segmentation but typically require large training datasets and provide suboptimal results that require further improvements. Here, we developed a way to enhance cardiac MRI multi-class segmentation by combining the strengths of CNN and interpretable machine learning algorithms. We developed a continuous kernel cut segmentation algorithm by integrating normalized cuts and continuous regularization in a unified framework. The high-order formulation was solved through upper bound relaxation and a continuous max-flow algorithm in an iterative manner using CNN predictions as inputs. We applied our approach to two representative cardiac MRI datasets across a wide range of cardiovascular pathologies. We comprehensively evaluated the performance of our approach for two CNNs trained with various small numbers of training cases, tested on the same and different datasets. Experimental results showed that our approach improved baseline CNN segmentation by a large margin, reduced CNN segmentation variability substantially, and achieved excellent segmentation accuracy with minimal extra computational cost. These results suggest that our approach provides a way to enhance the applicability of CNN by enabling the use of smaller training datasets and improving the segmentation accuracy and reproducibility for cardiac MRI segmentation in research and clinical patient care.     

MASS: Modality-collaborative semi-supervised segmentation by exploiting cross-modal consistency from unpaired CT and MRI images

Training deep segmentation models for medical images often requires a large amount of labeled data. To tackle this issue, semi-supervised segmentation has been employed to produce satisfactory delineation results with affordable labeling cost. However, traditional semi-supervised segmentation methods fail to exploit unpaired multi-modal data, which are widely adopted in today’s clinical routine. In this paper, we address this point by proposing Modality-collAborative Semi-Supervised segmentation (i.e., MASS), which utilizes the modality-independent knowledge learned from unpaired CT and MRI scans. To exploit such knowledge, MASS uses cross-modal consistency to regularize deep segmentation models in aspects of both semantic and anatomical spaces, from which MASS learns intra- and inter-modal correspondences to warp atlases’ labels for making predictions. For better capturing inter-modal correspondence, from a perspective of feature alignment, we propose a contrastive similarity loss to regularize the latent space of both modalities in order to learn generalized and robust modality-independent representations. Compared to semi-supervised and multi-modal segmentation counterparts, the proposed MASS brings nearly 6% improvements under extremely limited supervision.     

Adaptive local window for level set segmentation of CT and MRI liver lesions

We propose a novel method, the adaptive local window, for improving level set segmentation technique. The window is estimated separately for each contour point, over iterations of the segmentation process, and for each individual object. Our method considers the object scale, the spatial texture, and the changes of the energy functional over iterations. Global and local statistics are considered by calculating several gray level co-occurrence matrices. We demonstrate the capabilities of the method in the domain of medical imaging for segmenting 233 images with liver lesions. To illustrate the strength of our method, those lesions were screened by either Computed Tomography or Magnetic Resonance Imaging. Moreover, we analyzed images using three different energy models. We compared our method to a global level set segmentation, to a local framework that uses predefined fixed-size square windows and to a local region-scalable fitting model. The results indicate that our proposed method outperforms the other methods in terms of agreement with the manual marking and dependence on contour initialization or the energy model used. In case of complex lesions, such as low contrast lesions, heterogeneous lesions, or lesions with a noisy background, our method shows significantly better segmentation with an improvement of 0.25 ± 0.13 in Dice similarity coefficient, compared with state of the art fixed-size local windows (Wilcoxon, p  < 0.001).     

Bone and joint enhancement filtering: Application to proximal femur segmentation from uncalibrated computed tomography datasets

Methods for reliable femur segmentation enable the execution of quality retrospective studies and building of robust screening tools for bone and joint disease.An enhance-and-segment pipeline is proposed for proximal femur segmentation from computed tomography datasets. The filter is based on a scale-space model of cortical bone with properties including edge localization, invariance to density calibration, rotation invariance, and stability to noise. The filter is integrated with a graph cut segmentation technique guided through user provided sparse labels for rapid segmentation.Analysis is performed on 20 independent femurs. Rater proximal femur segmentation agreement was 0.21 mm (average surface distance), 0.98 (Dice similarity coefficient), and 2.34 mm (Hausdorff distance). Manual segmentation added considerable variability to measured failure load and volume (CV_RMS > 5%) but not density. The proposed algorithm considerably improved inter-rater reproducibility for all three outcomes (CV_RMS < 0.5%). The algorithm localized the periosteal surface accurately compared to manual segmentation but with a slight bias towards a smaller volume.Hessian-based filtering and graph cut segmentation localizes the periosteal surface of the proximal femur with comparable accuracy and improved precision compared to manual segmentation.     

ClusterSeg: A crowd cluster pinpointed nucleus segmentation framework with cross-modality datasets

The detection and segmentation of individual cells or nuclei is often involved in image analysis across a variety of biology and biomedical applications as an indispensable prerequisite. However, the ubiquitous presence of crowd clusters with morphological variations often hinders successful instance segmentation. In this paper, nuclei cluster focused annotation strategies and frameworks are proposed to overcome this challenging practical problem. Specifically, we design a nucleus segmentation framework, namely ClusterSeg, to tackle nuclei clusters, which consists of a convolutional-transformer hybrid encoder and a 2.5-path decoder for precise predictions of nuclei instance mask, contours, and clustered-edges. Additionally, an annotation-efficient clustered-edge pointed strategy pinpoints the salient and error-prone boundaries, where a partially-supervised PS-ClusterSeg is presented using ClusterSeg as the segmentation backbone. The framework is evaluated with four privately curated image sets and two public sets with characteristic severely clustered nuclei across a variety range of image modalities, e.g., microscope, cytopathology, and histopathology images. The proposed ClusterSeg and PS-ClusterSeg are modality-independent and generalizable, and superior to current state-of-the-art approaches in multiple metrics empirically. Our collected data, the elaborate annotations to both public and private set, as well the source code, are released publicly at https://github.com/lu-yizhou/ClusterSeg.     

Multi-slice low-rank tensor decomposition based multi-atlas segmentation: Application to automatic pathological liver CT segmentation

Liver segmentation from abdominal CT images is an essential step for liver cancer computer-aided diagnosis and surgical planning. However, both the accuracy and robustness of existing liver segmentation methods cannot meet the requirements of clinical applications. In particular, for the common clinical cases where the liver tissue contains major pathology, current segmentation methods show poor performance. In this paper, we propose a novel low-rank tensor decomposition (LRTD) based multi-atlas segmentation (MAS) framework that achieves accurate and robust pathological liver segmentation of CT images. Firstly, we propose a multi-slice LRTD scheme to recover the underlying low-rank structure embedded in 3D medical images. It performs the LRTD on small image segments consisting of multiple consecutive image slices. Then, we present an LRTD-based atlas construction method to generate tumor-free liver atlases that mitigates the performance degradation of liver segmentation due to the presence of tumors. Finally, we introduce an LRTD-based MAS algorithm to derive patient-specific liver atlases for each test image, and to achieve accurate pairwise image registration and label propagation. Extensive experiments on three public databases of pathological liver cases validate the effectiveness of the proposed method. Both qualitative and quantitative results demonstrate that, in the presence of major pathology, the proposed method is more accurate and robust than state-of-the-art methods.     

腹部CT及MRI图像融合配准在临床中的应用

目的：探索在PC平台上实现腹部CT及MRI图像非刚性融合配准，讨论其为临床提供新的诊断信息的应用价值。方法：根据最大互信息原理，对40例患者（男25例，女15例）腹部病变的CT及MRI图像进行融合，再根据图像信息主次性形成两类侧重点不同的融合配准图像。结果：在40例CT和MRI图像（其中有3例CT或MRI图像人为的造成部分缺失）融合中，能够在一幅图像上图像信息相互补充的有37例（人为造成部分缺失的3例顺利融合），比单纯地观察CT或MRI图像更能明确判断病变发展趋势的有30例，手术证实的15例，但有3例图像融合后无明显优越性。结论：微机实现腹部CT及MRI这两种不同来源的多模态图像非刚性融合配准，可为临床医生明确诊断、设计手术、放疗方案提供有利信息；病灶显示更直观，方便了临床医生观察。在融合算法上，最大互信息法几乎可以用在任何不同模式图像的配准，特别是当其中一个图像的数据部分缺损时也能得到很好的配准效果。     

Fully automated lumen and vessel contour segmentation in intravascular ultrasound datasets

Segmentation of lumen and vessel contours in intravascular ultrasound (IVUS) pullbacks is an arduous and time-consuming task, which demands adequately trained human resources. In the present study, we propose a machine learning approach to automatically extract lumen and vessel boundaries from IVUS datasets. The proposed approach relies on the concatenation of a deep neural network to deliver a preliminary segmentation, followed by a Gaussian process (GP) regressor to construct the final lumen and vessel contours. A multi-frame convolutional neural network (MFCNN) exploits adjacency information present in longitudinally neighboring IVUS frames, while the GP regression method filters high-dimensional noise, delivering a consistent representation of the contours. Overall, 160 IVUS pullbacks (63 patients) from the IBIS-4 study (Integrated Biomarkers and Imaging Study-4, Trial NCT00962416), were used in the present work. The MFCNN algorithm was trained with 100 IVUS pullbacks (8427 manually segmented frames), was validated with 30 IVUS pullbacks (2583 manually segmented frames) and was blindly tested with 30 IVUS pullbacks (2425 manually segmented frames). Image and contour metrics were used to characterize model performance by comparing ground truth (GT) and machine learning (ML) contours. Median values (interquartile range, IQR) of the Jaccard index for lumen and vessel were 0.913, [0.882,0.935] and 0.940, [0.917,0.957], respectively. Median values (IQR) of the Hausdorff distance for lumen and vessel were $0.196\text{mm}$, $[0.146,0.275]\text{mm}$ and $0.163\text{mm}$, $[0.122,0.234]\text{mm}$, respectively. Also, the mean value of lumen area predictions, and limits of agreement were $-0.19{\text{mm}}^2$, $[1.1,-1.5]{\text{mm}}^2$, while the mean value and limits of agreement of plaque burden were 0.0022, $[0.082,-0.078]$. The results obtained with the model developed in this work allow us to conclude that the proposed machine learning approach delivers accurate segmentations in terms of image metrics, contour metrics and clinically relevant variables, enabling its use in clinical routine by mitigating the costs involved in the manual management of IVUS datasets.     

Generalized pixel profiling and comparative segmentation with application to arteriovenous malformation segmentation

Extraction of structural and geometric information from 3-D images of blood vessels is a well known and widely addressed segmentation problem. The segmentation of cerebral blood vessels is of great importance in diagnostic and clinical applications, with a special application in diagnostics and surgery on arteriovenous malformations (AVM). However, the techniques addressing the problem of the AVM inner structure segmentation are rare. In this work we present a novel method of pixel profiling with the application to segmentation of the 3-D angiography AVM images. Our algorithm stands out in situations with low resolution images and high variability of pixel intensity. Another advantage of our method is that the parameters are set automatically, which yields little manual user intervention. The results on phantoms and real data demonstrate its effectiveness and potentials for fine delineation of AVM structure.     

Automated hippocampal segmentation by regional fluid registration of serial MRI: validation and application in Alzheimer's disease

The application of voxel-level three-dimensional registration to serial magnetic resonance imaging (MRI) is described. This fluid registration determines deformation fields modeling brain change, which are consistent with a model describing a viscous fluid. The objective was to validate the measurement of hippocampal volumetric change by fluid registration in Alzheimer's disease (AD) against current methodologies. The hippocampus was chosen for this study because it is difficult to measure reproducibly by manual segmentation and is widely studied; however, the technique is applicable to any structure which can be delineated on a scan. First, suitable values for the viscosity-body-force-ratio, alpha (0.01), and the number of iterations (300), were established and the convergence, repeatability, linearity, and accuracy investigated and compared with expert manual segmentation. A simple model of hippocampal atrophy was used to compare simulated volumetric change against that obtained by fluid registration. Finally the serial segmentation was compared with the current gold standard technique-expert human labeling with a volume repeatability of approximately 4%-in 27 subjects (15 normal controls, 12 clinically diagnosed with Alzheimer's disease). The scan-rescan volumetric consistency of serial segmentation by fluid-registration was shown to be superior to human serial segmentors ( approximately 2%). The mean absolute volume difference between fluid and manual segmentation was 0.7%. Fluid registration has potential importance for tracking longitudinal structural changes in brain particularly in the context of the clinical trial where large numbers of subjects may have multiple MR scans.     

Tensor-cut: A tensor-based graph-cut blood vessel segmentation method and its application to renal artery segmentation

Blood vessel segmentation plays a fundamental role in many computer-aided diagnosis (CAD) systems, such as coronary artery stenosis quantification, cerebral aneurysm quantification, and retinal vascular tree analysis. Fine blood vessel segmentation can help build a more accurate computer-aided diagnosis system and help physicians gain a better understanding of vascular structures. The purpose of this article is to develop a blood vessel segmentation method that can improve segmentation accuracy in tiny blood vessels. In this work, we propose a tensor-based graph-cut method for blood vessel segmentation. With our method, each voxel can be modeled by a second-order tensor, allowing the capture of the intensity information and the geometric information for building a more accurate model for blood vessel segmentation. We compared our proposed method’s accuracy to several state-of-the-art blood vessel segmentation algorithms and performed experiments on both simulated and clinical CT datasets. Both experiments showed that our method achieved better state-of-the-art results than the competing techniques. The mean centerline overlap ratio of our proposed method is 84% on clinical CT data. Our proposed blood vessel segmentation method outperformed other state-of-the-art methods by 10% on clinical CT data. Tiny blood vessels in clinical CT data with a 1-mm radius can be extracted using the proposed technique. The experiments on a clinical dataset showed that the proposed method significantly improved the segmentation accuracy in tiny blood vessels.     

Hepatic angiomyoma: CT and MRI findings

Angiomyoma is a benign tumor that arises from soft muscular tissue within the blood vessel wall. This lesion has been found in different organs. The preferential location of these tumors is the lower extremity. We describe the rare case of a hepatic angiomyoma and present the radiologic findings of computed tomography and magnetic resonance imaging.     

Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation

The medical imaging literature has witnessed remarkable progress in high-performing segmentation models based on convolutional neural networks. Despite the new performance highs, the recent advanced segmentation models still require large, representative, and high quality annotated datasets. However, rarely do we have a perfect training dataset, particularly in the field of medical imaging, where data and annotations are both expensive to acquire. Recently, a large body of research has studied the problem of medical image segmentation with imperfect datasets, tackling two major dataset limitations: scarce annotations where only limited annotated data is available for training, and weak annotations where the training data has only sparse annotations, noisy annotations, or image-level annotations. In this article, we provide a detailed review of the solutions above, summarizing both the technical novelties and empirical results. We further compare the benefits and requirements of the surveyed methodologies and provide our recommended solutions. We hope this survey article increases the community awareness of the techniques that are available to handle imperfect medical image segmentation datasets.     

Multi-shape graph cuts with neighbor prior constraints and its application to lung segmentation from a chest CT volume

This paper presents a novel graph cut algorithm that can take into account multi-shape constraints with neighbor prior constraints, and reports on a lung segmentation process from a three-dimensional computed tomography (CT) image based on this algorithm. The major contribution of this paper is the proposal of a novel segmentation algorithm that improves lung segmentation for cases in which the lung has a unique shape and pathologies such as pleural effusion by incorporating multiple shapes and prior information on neighbor structures in a graph cut framework. We demonstrate the efficacy of the proposed algorithm by comparing it to conventional one using a synthetic image and clinical thoracic CT volumes.     

Landmark-guided diffeomorphic demons algorithm and its application to automatic segmentation of the whole spine and pelvis in CT images

Purpose

A fully automatic multiatlas-based method for segmentation of the spine and pelvis in a torso CT volume is proposed. A novel landmark-guided diffeomorphic demons algorithm is used to register a given CT image to multiple atlas volumes. This algorithm can utilize both grayscale image information and given landmark coordinate information optimally.

Methods

The segmentation has four steps. Firstly, 170 bony landmarks are detected in the given volume. Using these landmark positions, an atlas selection procedure is performed to reduce the computational cost of the following registration. Then the chosen atlas volumes are registered to the given CT image. Finally, voxelwise label voting is performed to determine the final segmentation result.

Results

The proposed method was evaluated using 50 torso CT datasets as well as the public SpineWeb dataset. As a result, a mean distance error of \(0.59\pm 0.14\hbox { mm}\) and a mean Dice coefficient of \(0.90\pm 0.02\) were achieved for the whole spine and the pelvic bones, which are competitive with other state-of-the-art methods.

Conclusion

From the experimental results, the usefulness of the proposed segmentation method was validated.

     

鼻咽癌诊断:CT与MRI比较

本文比较76例鼻咽癌病人(治疗前30例、放疗后复发25例和放射性纤维化21例)的同期CT和MRI资料。结果表明,30例初治鼻咽癌病例的CT和MRI所见及其分期结果相同,对25例复发鼻咽癌与21例放疗后纤维化肿块的鉴别诊断。MRI优于CT相似文献   

Real-time sonography to estimate muscle thickness: comparison with MRI and CT

PURPOSE: We investigated the feasibility of using real-time sonography to measure muscle thickness. Clinically, this technique would be used to measure the thickness of human muscles in which intramuscular microstimulators have been implanted to treat or prevent disuse atrophy. METHODS: Porcine muscles were implanted with microstimulators and imaged with sonography, MRI, and CT to assess image artifacts created by the microstimulators and to design protocols for image alignment between methods. Sonography and MRI were then used to image the deltoid and supraspinatus muscles of 6 healthy human subjects. RESULTS: Microstimulators could be imaged with all 3 methods, producing only small imaging artifacts. Muscle-thickness measurements agreed well between methods, particularly when external markers were used to precisely align the imaging planes. The correlation coefficients for sonographic and MRI measurements were 0.96 for the supraspinatus and 0.97 for the deltoid muscle. Repeated sonographic measurements had a low coefficient of variation: 2.3% for the supraspinatus and 3.1% for the deltoid muscle. CONCLUSIONS: Real-time sonography is a relatively simple and inexpensive method of accurately measuring muscle thickness as long as the operator adheres to a strict imaging protocol and avoids excessive pressure with the transducer.