Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema

We present a fully automatic algorithm to identify fluid-filled regions and seven retinal layers on spectral domain optical coherence tomography images of eyes with diabetic macular edema (DME). To achieve this, we developed a kernel regression (KR)-based classification method to estimate fluid and retinal layer positions. We then used these classification estimates as a guide to more accurately segment the retinal layer boundaries using our previously described graph theory and dynamic programming (GTDP) framework. We validated our algorithm on 110 B-scans from ten patients with severe DME pathology, showing an overall mean Dice coefficient of 0.78 when comparing our KR + GTDP algorithm to an expert grader. This is comparable to the inter-observer Dice coefficient of 0.79. The entire data set is available online, including our automatic and manual segmentation results. To the best of our knowledge, this is the first validated, fully-automated, seven-layer and fluid segmentation method which has been applied to real-world images containing severe DME.OCIS codes: (100.0100) Image processing, (170.4500) Optical coherence tomography, (170.4470) Ophthalmology     

Retinal layer segmentation of macular OCT images using boundary classification

Optical coherence tomography (OCT) has proven to be an essential imaging modality for ophthalmology and is proving to be very important in neurology. OCT enables high resolution imaging of the retina, both at the optic nerve head and the macula. Macular retinal layer thicknesses provide useful diagnostic information and have been shown to correlate well with measures of disease severity in several diseases. Since manual segmentation of these layers is time consuming and prone to bias, automatic segmentation methods are critical for full utilization of this technology. In this work, we build a random forest classifier to segment eight retinal layers in macular cube images acquired by OCT. The random forest classifier learns the boundary pixels between layers, producing an accurate probability map for each boundary, which is then processed to finalize the boundaries. Using this algorithm, we can accurately segment the entire retina contained in the macular cube to an accuracy of at least 4.3 microns for any of the nine boundaries. Experiments were carried out on both healthy and multiple sclerosis subjects, with no difference in the accuracy of our algorithm found between the groups.OCIS codes: (100.0100) Image processing, (170.4470) Ophthalmology, (170.4500) Optical coherence tomography     

Retinal layer segmentation in optical coherence tomography (OCT) using a 3D deep-convolutional regression network for patients with age-related macular degeneration

Introduction – Retinal layer segmentation in optical coherence tomography (OCT) images is an important approach for detecting and prognosing disease. Automating segmentation using robust machine learning techniques lead to computationally efficient solutions and significantly reduces the cost of labor-intensive labeling, which is traditionally performed by trained graders at a reading center, sometimes aided by semi-automated algorithms. Although several algorithms have been proposed since the revival of deep learning, eyes with severe pathological conditions continue to challenge fully automated segmentation approaches. There remains an opportunity to leverage the underlying spatial correlations between the retinal surfaces in the segmentation approach. Methods - Some of these proposed traditional methods can be expanded to utilize the three-dimensional spatial context governing the retinal image volumes by replacing the use of 2D filters with 3D filters. Towards this purpose, we propose a spatial-context, continuity and anatomical relationship preserving semantic segmentation algorithm, which utilizes the 3D spatial context from the image volumes with the use of 3D filters. We propose a 3D deep neural network capable of learning the surface positions of the layers in the retinal volumes. Results - We utilize a dataset of OCT images from patients with Age-related Macular Degeneration (AMD) to assess performance of our model and provide both qualitative (including segmentation maps and thickness maps) and quantitative (including error metric comparisons and volumetric comparisons) results, which demonstrate that our proposed method performs favorably even for eyes with pathological changes caused by severe retinal diseases. The Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) for patients with a wide range of AMD severity scores (0–11) were within 0.84±0.41 and 1.33±0.73 pixels, respectively, which are significantly better than some of the other state-of-the-art algorithms. Conclusion – The results demonstrate the utility of extracting features from the entire OCT volume by treating the volume as a correlated entity and show the benefit of utilizing 3D autoencoder based regression networks for smoothing the approximated retinal layers by inducing shape based regularization constraints.     

Automatic segmentation of up to ten layer boundaries in SD-OCT images of the mouse retina with and without missing layers due to pathology

Accurate quantification of retinal layer thicknesses in mice as seen on optical coherence tomography (OCT) is crucial for the study of numerous ocular and neurological diseases. However, manual segmentation is time-consuming and subjective. Previous attempts to automate this process were limited to high-quality scans from mice with no missing layers or visible pathology. This paper presents an automatic approach for segmenting retinal layers in spectral domain OCT images using sparsity based denoising, support vector machines, graph theory, and dynamic programming (S-GTDP). Results show that this method accurately segments all present retinal layer boundaries, which can range from seven to ten, in wild-type and rhodopsin knockout mice as compared to manual segmentation and has a more accurate performance as compared to the commercial automated Diver segmentation software.OCIS codes: (100.0100) Image processing, (170.4470) Ophthalmology, (100.2960) Image analysis, (100.5010) Pattern recognition, (110.4500) Optical coherence tomography     

Automated choroidal segmentation of 1060 nm OCT in healthy and pathologic eyes using a statistical model

A two stage statistical model based on texture and shape for fully automatic choroidal segmentation of normal and pathologic eyes obtained by a 1060 nm optical coherence tomography (OCT) system is developed. A novel dynamic programming approach is implemented to determine location of the retinal pigment epithelium/ Bruch's membrane /choriocapillaris (RBC) boundary. The choroid-sclera interface (CSI) is segmented using a statistical model. The algorithm is robust even in presence of speckle noise, low signal (thick choroid), retinal pigment epithelium (RPE) detachments and atrophy, drusen, shadowing and other artifacts. Evaluation against a set of 871 manually segmented cross-sectional scans from 12 eyes achieves an average error rate of 13%, computed per tomogram as a ratio of incorrectly classified pixels and the total layer surface. For the first time a fully automatic choroidal segmentation algorithm is successfully applied to a wide range of clinical volumetric OCT data.     

Automatic segmentation of the choroid in enhanced depth imaging optical coherence tomography images

Enhanced Depth Imaging (EDI) optical coherence tomography (OCT) provides high-definition cross-sectional images of the choroid in vivo, and hence is used in many clinical studies. However, the quantification of the choroid depends on the manual labelings of two boundaries, Bruch’s membrane and the choroidal-scleral interface. This labeling process is tedious and subjective of inter-observer differences, hence, automatic segmentation of the choroid layer is highly desirable. In this paper, we present a fast and accurate algorithm that could segment the choroid automatically. Bruch’s membrane is detected by searching the pixel with the biggest gradient value above the retinal pigment epithelium (RPE) and the choroidal-scleral interface is delineated by finding the shortest path of the graph formed by valley pixels using Dijkstra’s algorithm. The experiments comparing automatic segmentation results with the manual labelings are conducted on 45 EDI-OCT images and the average of Dice’s Coefficient is 90.5%, which shows good consistency of the algorithm with the manual labelings. The processing time for each image is about 1.25 seconds.OCIS codes: (100.0100) Image processing, (110.4500) Optical coherence tomography, (100.2960) Image analysis, (170.4470) Ophthalmology     

Multiple-object geometric deformable model for segmentation of macular OCT

Optical coherence tomography (OCT) is the de facto standard imaging modality for ophthalmological assessment of retinal eye disease, and is of increasing importance in the study of neurological disorders. Quantification of the thicknesses of various retinal layers within the macular cube provides unique diagnostic insights for many diseases, but the capability for automatic segmentation and quantification remains quite limited. While manual segmentation has been used for many scientific studies, it is extremely time consuming and is subject to intra- and inter-rater variation. This paper presents a new computational domain, referred to as flat space, and a segmentation method for specific retinal layers in the macular cube using a recently developed deformable model approach for multiple objects. The framework maintains object relationships and topology while preventing overlaps and gaps. The algorithm segments eight retinal layers over the whole macular cube, where each boundary is defined with subvoxel precision. Evaluation of the method on single-eye OCT scans from 37 subjects, each with manual ground truth, shows improvement over a state-of-the-art method.OCIS codes: (100.0100) Image processing, (170.4470) Ophthalmology, (170.4500) Optical coherence tomography     

Multi-scale GCN-assisted two-stage network for joint segmentation of retinal layers and discs in peripapillary OCT images

An accurate and automated tissue segmentation algorithm for retinal optical coherence tomography (OCT) images is crucial for the diagnosis of glaucoma. However, due to the presence of the optic disc, the anatomical structure of the peripapillary region of the retina is complicated and is challenging for segmentation. To address this issue, we develop a novel graph convolutional network (GCN)-assisted two-stage framework to simultaneously label the nine retinal layers and the optic disc. Specifically, a multi-scale global reasoning module is inserted between the encoder and decoder of a U-shape neural network to exploit anatomical prior knowledge and perform spatial reasoning. We conduct experiments on human peripapillary retinal OCT images. We also provide public access to the collected dataset, which might contribute to the research in the field of biomedical image processing. The Dice score of the proposed segmentation network is 0.820 ± 0.001 and the pixel accuracy is 0.830 ± 0.002, both of which outperform those from other state-of-the-art techniques.     

Automated segmentation of retinal blood vessels in spectral domain optical coherence tomography scans

The correct segmentation of blood vessels in optical coherence tomography (OCT) images may be an important requirement for the analysis of intra-retinal layer thickness in human retinal diseases. We developed a shape model based procedure for the automatic segmentation of retinal blood vessels in spectral domain (SD)-OCT scans acquired with the Spectralis OCT system. The segmentation procedure is based on a statistical shape model that has been created through manual segmentation of vessels in a training phase. The actual segmentation procedure is performed after the approximate vessel position has been defined by a shadowgraph that assigns the lateral vessel positions. The active shape model method is subsequently used to segment blood vessel contours in axial direction. The automated segmentation results were validated against the manual segmentation of the same vessels by three expert readers. Manual and automated segmentations of 168 blood vessels from 34 B-scans were analyzed with respect to the deviations in the mean Euclidean distance and surface area. The mean Euclidean distance between the automatically and manually segmented contours (on average 4.0 pixels respectively 20 μm against all three experts) was within the range of the manually marked contours among the three readers (approximately 3.8 pixels respectively 18 μm for all experts). The area deviations between the automated and manual segmentation also lie within the range of the area deviations among the 3 clinical experts. Intra reader variability for the experts was between 0.9 and 0.94. We conclude that the automated segmentation approach is able to segment blood vessels with comparable accuracy as expert readers and will provide a useful tool in vessel analysis of whole C-scans, and in particular in multicenter trials.     

Automated segmentation of outer retinal layers in macular OCT images of patients with retinitis pigmentosa

To provide a tool for quantifying the effects of retinitis pigmentosa (RP) seen on spectral domain optical coherence tomography images, an automated layer segmentation algorithm was developed. This algorithm, based on dual-gradient information and a shortest path search strategy, delineates the inner limiting membrane and three outer retinal boundaries in optical coherence tomography images from RP patients. In addition, an automated inner segment (IS)/outer segment (OS) contour detection method based on the segmentation results is proposed to quantify the locus of points at which the OS thickness goes to zero in a 3D volume scan. The segmentation algorithm and the IS/OS contour were validated with manual segmentation data. The segmentation and IS/OS contour results on repeated measures showed good within-day repeatability, while the results on data acquired on average 22.5 months afterward demonstrated a possible means to follow disease progression. In particular, the automatically generated IS/OS contour provided a possible objective structural marker for RP progression.     

Semi-automatic geographic atrophy segmentation for SD-OCT images

Geographic atrophy (GA) is a condition that is associated with retinal thinning and loss of the retinal pigment epithelium (RPE) layer. It appears in advanced stages of non-exudative age-related macular degeneration (AMD) and can lead to vision loss. We present a semi-automated GA segmentation algorithm for spectral-domain optical coherence tomography (SD-OCT) images. The method first identifies and segments a surface between the RPE and the choroid to generate retinal projection images in which the projection region is restricted to a sub-volume of the retina where the presence of GA can be identified. Subsequently, a geometric active contour model is employed to automatically detect and segment the extent of GA in the projection images. Two image data sets, consisting on 55 SD-OCT scans from twelve eyes in eight patients with GA and 56 SD-OCT scans from 56 eyes in 56 patients with GA, respectively, were utilized to qualitatively and quantitatively evaluate the proposed GA segmentation method. Experimental results suggest that the proposed algorithm can achieve high segmentation accuracy. The mean GA overlap ratios between our proposed method and outlines drawn in the SD-OCT scans, our method and outlines drawn in the fundus auto-fluorescence (FAF) images, and the commercial software (Carl Zeiss Meditec proprietary software, Cirrus version 6.0) and outlines drawn in FAF images were 72.60%, 65.88% and 59.83%, respectively.OCIS codes: (100.0100) Image processing, (110.4500) Optical coherence tomography, (170.4470) Ophthalmology     

Advanced image processing for optical coherence tomographic angiography of macular diseases

This article provides an overview of advanced image processing for three dimensional (3D) optical coherence tomographic (OCT) angiography of macular diseases, including age-related macular degeneration (AMD) and diabetic retinopathy (DR). A fast automated retinal layers segmentation algorithm using directional graph search was introduced to separates 3D flow data into different layers in the presence of pathologies. Intelligent manual correction methods are also systematically addressed which can be done rapidly on a single frame and then automatically propagated to full 3D volume with accuracy better than 1 pixel. Methods to visualize and analyze the abnormalities including retinal and choroidal neovascularization, retinal ischemia, and macular edema were presented to facilitate the clinical use of OCT angiography.OCIS codes: (110.4500) Optical coherence tomography, (100.0100) Image processing, (100.2960) Image analysis, (170.4470) Ophthalmology     

Automated drusen segmentation and quantification in SD-OCT images

Spectral domain optical coherence tomography (SD-OCT) is a useful tool for the visualization of drusen, a retinal abnormality seen in patients with age-related macular degeneration (AMD); however, objective assessment of drusen is thwarted by the lack of a method to robustly quantify these lesions on serial OCT images. Here, we describe an automatic drusen segmentation method for SD-OCT retinal images, which leverages a priori knowledge of normal retinal morphology and anatomical features. The highly reflective and locally connected pixels located below the retinal nerve fiber layer (RNFL) are used to generate a segmentation of the retinal pigment epithelium (RPE) layer. The observed and expected contours of the RPE layer are obtained by interpolating and fitting the shape of the segmented RPE layer, respectively. The areas located between the interpolated and fitted RPE shapes (which have nonzero area when drusen occurs) are marked as drusen. To enhance drusen quantification, we also developed a novel method of retinal projection to generate an en face retinal image based on the RPE extraction, which improves the quality of drusen visualization over the current approach to producing retinal projections from SD-OCT images based on a summed-voxel projection (SVP), and it provides a means of obtaining quantitative features of drusen in the en face projection. Visualization of the segmented drusen is refined through several post-processing steps, drusen detection to eliminate false positive detections on consecutive slices, drusen refinement on a projection view of drusen, and drusen smoothing. Experimental evaluation results demonstrate that our method is effective for drusen segmentation. In a preliminary analysis of the potential clinical utility of our methods, quantitative drusen measurements, such as area and volume, can be correlated with the drusen progression in non-exudative AMD, suggesting that our approach may produce useful quantitative imaging biomarkers to follow this disease and predict patient outcome.     

In vivo volumetric imaging of chicken retina with ultrahigh-resolution spectral domain optical coherence tomography

The chicken retina is an established animal model for myopia and light-associated growth studies. It has a unique morphology: it is afoveate and avascular; oxygen and nutrition to the inner retina is delivered by a vascular tissue (pecten) that protrudes into the vitreous. Here we present, to the best of our knowledge, the first in vivo, volumetric high-resolution images of the chicken retina. Images were acquired with an ultrahigh-resolution optical coherence tomography (UHROCT) system with 3.5 μm axial resolution in the retina, at the rate of 47,000 A-scans/s. Spatial variations in the thickness of the nerve fiber and ganglion cell layers were mapped by segmenting and measuring the layer thickness with a semi-automatic segmentation algorithm. Volumetric visualization of the morphology and morphometric analysis of the chicken retina could aid significantly studies with chicken retinal models of ophthalmic diseases.     

An end-to-end network for segmenting the vasculature of three retinal capillary plexuses from OCT angiographic volumes

The segmentation of en face retinal capillary angiograms from volumetric optical coherence tomographic angiography (OCTA) usually relies on retinal layer segmentation, which is time-consuming and error-prone. In this study, we developed a deep-learning-based method to segment vessels in the superficial vascular plexus (SVP), intermediate capillary plexus (ICP), and deep capillary plexus (DCP) directly from volumetric OCTA data. The method contains a three-dimensional convolutional neural network (CNN) for extracting distinct retinal layers, a custom projection module to generate three vascular plexuses from OCTA data, and three parallel CNNs to segment vasculature. Experimental results on OCTA data from rat eyes demonstrated the feasibility of the proposed method. This end-to-end network has the potential to simplify OCTA data processing on retinal vasculature segmentation. The main contribution of this study is that we propose a custom projection module to connect retinal layer segmentation and vasculature segmentation modules and automatically convert data from three to two dimensions, thus establishing an end-to-end method to segment three retinal capillary plexuses from volumetric OCTA without any human intervention.     

In vivo imaging of retinal hemodynamics with OCT angiography and Doppler OCT

Retinal hemodynamics is important for early diagnosis and precise monitoring in retinal vascular diseases. We propose a novel method for measuring absolute retinal blood flow in vivo using the combined techniques of optical coherence tomography (OCT) angiography and Doppler OCT. Doppler values can be corrected by Doppler angles extracted from OCT angiography images. A three-dimensional (3D) segmentation algorithm based on dynamic programming was developed to extract the 3D boundaries of optic disc vessels, and Doppler angles were calculated from 3D vessel geometry. The accuracy of blood flow from the Doppler OCT was validated using a flow phantom. The feasibility of the method was tested on a subject in vivo. The pulsatile retinal blood flow and the parameters for retinal hemodynamics were successfully obtained.OCIS codes: (100.2960) Image analysis, (100.6890) Three-dimensional image processing, (170.4500) Optical coherence tomography, (170.4460) Ophthalmic optics and devices     

Wavefront sensorless adaptive optics optical coherence tomography for in vivo retinal imaging in mice

We present wavefront sensorless adaptive optics (WSAO) Fourier domain optical coherence tomography (FD-OCT) for in vivo small animal retinal imaging. WSAO is attractive especially for mouse retinal imaging because it simplifies optical design and eliminates the need for wavefront sensing, which is difficult in the small animal eye. GPU accelerated processing of the OCT data permitted real-time extraction of image quality metrics (intensity) for arbitrarily selected retinal layers to be optimized. Modal control of a commercially available segmented deformable mirror (IrisAO Inc.) provided rapid convergence using a sequential search algorithm. Image quality improvements with WSAO OCT are presented for both pigmented and albino mouse retinal data, acquired in vivo.OCIS codes: (170.4460) Ophthalmic optics and devices, (110.1080) Active or adaptive optics, (110.4500) Optical coherence tomography     

Volume-based,layer-independent,disease-agnostic detection of abnormal retinal reflectivity,nonperfusion, and neovascularization using structural and angiographic OCT

Optical coherence tomography (OCT) is widely used in ophthalmic practice because it can visualize retinal structure and vasculature in vivo and 3-dimensionally (3D). Even though OCT procedures yield data volumes, clinicians typically interpret the 3D images using two-dimensional (2D) data subsets, such as cross-sectional scans or en face projections. Since a single OCT volume can contain hundreds of cross-sections (each of which must be processed with retinal layer segmentation to produce en face images), a thorough manual analysis of the complete OCT volume can be prohibitively time-consuming. Furthermore, 2D reductions of the full OCT volume may obscure relationships between disease progression and the (volumetric) location of pathology within the retina and can be prone to mis-segmentation artifacts. In this work, we propose a novel framework that can detect several retinal pathologies in three dimensions using structural and angiographic OCT. Our framework operates by detecting deviations in reflectance, angiography, and simulated perfusion from a percent depth normalized standard retina created by merging and averaging scans from healthy subjects. We show that these deviations from the standard retina can highlight multiple key features, while the depth normalization obviates the need to segment several retinal layers. We also construct a composite pathology index that measures average deviation from the standard retina in several categories (hypo- and hyper-reflectance, nonperfusion, presence of choroidal neovascularization, and thickness change) and show that this index correlates with DR severity. Requiring minimal retinal layer segmentation and being fully automated, this 3D framework has a strong potential to be integrated into commercial OCT systems and to benefit ophthalmology research and clinical care.     

Henle fiber layer phase retardation measured with polarization-sensitive optical coherence tomography

Abstract: We developed a method based on polarization-sensitive optical coherence tomography (PS-OCT) to quantify the double pass phase retardation (DPPR) induced by Henle fiber layer in three subjects. Measurements of the retina were performed at a mean wavelength of 840 nm using two polarization states that were perpendicular in a Poincaré sphere representation and phase retardation contributions from tissue layers above and below the Henle fiber layer were excluded using appropriately placed reference and measurement points. These points were semi-automatically segmented from intensity data. Using a new algorithm to determine DPPR, the Henle fiber layer in three healthy subjects aged 50-60 years showed elevated DPPR in a concentric ring about the fovea, with an average maximum DPPR for the three subjects of 22.0° (range: 20.4° to 23.0°) occurring at an average retinal eccentricity of 1.8° (range: 1.5° to 2.25°). Outside the ring, a floor of approximately 6.8° was measured, which we show can mainly be attributed to phase noise that is induced in the polarization states. We also demonstrate the method can determine fast axis orientation of the retardation, which is found consistent with the known radial pattern of Henle fibers.OCIS codes: (110.4500) Optical coherence tomography, (130.5440) Polarization-selective devices, (170.5755) Retina scanning, (170.6935) Tissue characterization