Accurately motion-corrected Lissajous OCT with multi-type image registration

Passive motion correction methods for optical coherence tomography (OCT) use image registration to estimate eye movements. To improve motion correction, a multi-image cross-correlation that employs spatial features in different image types is introduced. Lateral motion correction using en face OCT and OCT-A projections on Lissajous-scanned OCT data is applied. Motion correction using OCT-A projection of whole depth and OCT amplitude, OCT logarithmic intensity, and OCT maximum intensity projections were evaluated in retinal imaging with 76 patients. The proposed method was compared with motion correction using OCT-A projection of whole depth. The comparison shows improvements in the image quality of motion-corrected superficial OCT-A images and image registration.     

Distortion and instability compensation with deep learning for rotational scanning endoscopic optical coherence tomography

Optical Coherence Tomography (OCT) is increasingly used in endoluminal procedures since it provides high-speed and high resolution imaging. Distortion and instability of images obtained with a proximal scanning endoscopic OCT system are significant due to the motor rotation irregularity, the friction between the rotating probe and outer sheath and synchronization issues. On-line compensation of artefacts is essential to ensure image quality suitable for real-time assistance during diagnosis or minimally invasive treatment. In this paper, we propose a new online correction method to tackle both B-scan distortion, video stream shaking and drift problem of endoscopic OCT linked to A-line level image shifting. The proposed computational approach for OCT scanning video correction integrates a Convolutional Neural Network (CNN) to improve the estimation of azimuthal shifting of each A-line. To suppress the accumulative error of integral estimation we also introduce another CNN branch to estimate a dynamic overall orientation angle. We train the network with semi-synthetic OCT videos by intentionally adding rotational distortion into real OCT scanning images. The results show that networks trained on this semi-synthetic data generalize to stabilize real OCT videos, and the algorithm efficacy is demonstrated on both ex vivo and in vivo data, where strong scanning artifacts are successfully corrected.     

Interlaced spectrally encoded confocal scanning laser ophthalmoscopy and spectral domain optical coherence tomography

Scanning laser ophthalmoscopy (SLO) and spectral domain optical coherence tomography (SDOCT) have become essential clinical diagnostic tools in ophthalmology by allowing for video-rate noninvasive en face and depth-resolved visualization of retinal structure. Current generation multimodal imaging systems that combine both SLO and OCT as a means of image tracking remain complex in their hardware implementations. Here, we combine a spectrally encoded confocal scanning laser ophthalmoscope (SECSLO) with an ophthalmic SDOCT system. This novel implementation of an interlaced SECSLO-SDOCT system allows for video-rate SLO fundus images to be acquired alternately with high-resolution SDOCT B-scans as a means of image aiming, guidance, and registration as well as motion tracking. The system shares the illumination source, detection system, and scanning optics between both SLO and OCT as a method of providing a simple multimodal ophthalmic imaging system that can readily be implemented as a table-top or hand-held device.     

Modelling of image-catheter motion for 3-D IVUS

Three-dimensional intravascular ultrasound (IVUS) allows to visualize and obtain volumetric measurements of coronary lesions through an exploration of the cross sections and longitudinal views of arteries. However, the visualization and subsequent morpho-geometric measurements in IVUS longitudinal cuts are subject to distortion caused by periodic image/vessel motion around the IVUS catheter. Usually, to overcome the image motion artifact ECG-gating and image-gated approaches are proposed, leading to slowing the pullback acquisition or disregarding part of IVUS data. In this paper, we argue that the image motion is due to 3-D vessel geometry as well as cardiac dynamics, and propose a dynamic model based on the tracking of an elliptical vessel approximation to recover the rigid transformation and align IVUS images without loosing any IVUS data. We report an extensive validation with synthetic simulated data and in vivo IVUS sequences of 30 patients achieving an average reduction of the image artifact of 97% in synthetic data and 79% in real-data. Our study shows that IVUS alignment improves longitudinal analysis of the IVUS data and is a necessary step towards accurate reconstruction and volumetric measurements of 3-D IVUS.     

Motion correction in optical coherence tomography volumes on a per A-scan basis using orthogonal scan patterns

High speed Optical Coherence Tomography (OCT) has made it possible to rapidly capture densely sampled 3D volume data. One key application is the acquisition of high quality in vivo volumetric data sets of the human retina. Since the volume is acquired in a few seconds, eye movement during the scan process leads to distortion, which limits the accuracy of quantitative measurements using 3D OCT data. In this paper, we present a novel software based method to correct motion artifacts in OCT raster scans. Motion compensation is performed retrospectively using image registration algorithms on the OCT data sets themselves. Multiple, successively acquired volume scans with orthogonal fast scan directions are registered retrospectively in order to estimate and correct eye motion. Registration is performed by optimizing a large scale numerical problem as given by a global objective function using one dense displacement field for each input volume and special regularization based on the time structure of the acquisition process. After optimization, each volume is undistorted and a single merged volume is constructed that has superior signal quality compared to the input volumes. Experiments were performed using 3D OCT data from the macula and optic nerve head acquired with a high-speed ultra-high resolution 850 nm spectral OCT as well as wide field data acquired with a 1050 nm swept source OCT instrument. Evaluation of registration performance and result stability as well as visual inspection shows that the algorithm can correct for motion in all three dimensions and on a per A-scan basis. Corrected volumes do not show visible motion artifacts. In addition, merging multiple motion corrected and registered volumes leads to improved signal quality. These results demonstrate that motion correction and merging improves image quality and should also improve morphometric measurement accuracy from volumetric OCT data.     

Endoscopic en-face optical coherence tomography and fluorescence imaging using correlation-based probe tracking

Forward-viewing endoscopic optical coherence tomography (OCT) provides 3D imaging in vivo, and can be combined with widefield fluorescence imaging by use of a double-clad fiber. However, it is technically challenging to build a high-performance miniaturized 2D scanning system with a large field-of-view. In this paper we demonstrate how a 1D scanning probe, which produces cross-sectional OCT images (B-scans) and 1D fluorescence T-scans, can be transformed into a 2D scanning probe by manual scanning along the second axis. OCT volumes are assembled from the B-scans using speckle decorrelation measurements to estimate the out-of-plane motion along the manual scan direction. Motion within the plane of the B-scans is corrected using image registration by normalized cross correlation. En-face OCT slices and fluorescence images, corrected for probe motion in 3D, can be displayed in real-time during the scan. For a B-scan frame rate of 250 Hz, and an OCT lateral resolution of approximately 20μm , the approach can handle out-of-plane motion at speeds of up to 4 mm/s.     

Heartbeat OCT: in vivo intravascular megahertz-optical coherence tomography

Cardiac motion artifacts, non-uniform rotational distortion and undersampling affect the image quality and the diagnostic impact of intravascular optical coherence tomography (IV-OCT). In this study we demonstrate how these limitations of IV-OCT can be addressed by using an imaging system that we called “Heartbeat OCT”, combining a fast Fourier Domain Mode Locked laser, fast pullback, and a micromotor actuated catheter, designed to examine a coronary vessel in less than one cardiac cycle. We acquired in vivo data sets of two coronary arteries in a porcine heart with both Heartbeat OCT, working at 2.88 MHz A-line rate, 4000 frames/s and 100 mm/s pullback speed, and with a commercial system. The in vivo results show that Heartbeat OCT provides faithfully rendered, motion-artifact free, fully sampled vessel wall architecture, unlike the conventional IV-OCT data. We present the Heartbeat OCT system in full technical detail and discuss the steps needed for clinical translation of the technology.OCIS codes: (170.4500) Optical coherence tomography, (170.3880) Medical and biological imaging, (170.2150) Endoscopic imaging, (110.6880) Three-dimensional image acquisition, (110.2350) Fiber optics imaging, (120.5800) Scanners, (120.3890) Medical optics instrumentation     

Respiratory motion compensation by model-based catheter tracking during EP procedures

In many cases, radio-frequency catheter ablation of the pulmonary veins attached to the left atrium still involves fluoroscopic image guidance. Two-dimensional X-ray navigation may also take advantage of overlay images derived from static pre-operative 3D volumetric data to add anatomical details otherwise not visible under X-ray. Unfortunately, respiratory motion may impair the utility of static overlay images for catheter navigation. We developed a novel approach for image-based 3D motion estimation and compensation as a solution to this problem. It is based on 3D catheter tracking which, in turn, relies on 2D/3D registration. To this end, a bi-plane C-arm system is used to take X-ray images of a special circumferential mapping catheter from two directions. In the first step of the method, a 3D model of the device is reconstructed. Three-dimensional respiratory motion at the site of ablation is then estimated by tracking the reconstructed catheter model in 3D based on bi-plane fluoroscopy. Phantom data and clinical data were used to assess model-based catheter tracking. Our phantom experiments yielded an average 2D tracking error of 1.4 mm and an average 3D tracking error of 1.1 mm. Our evaluation of clinical data sets comprised 469 bi-plane fluoroscopy frames (938 monoplane fluoroscopy frames). We observed an average 2D tracking error of 1.0 ± 0.4 mm and an average 3D tracking error of 0.8 ± 0.5 mm. These results demonstrate that model-based motion-compensation based on 2D/3D registration is both feasible and accurate.     

Correction of image distortions in endoscopic optical coherence tomography based on two-axis scanning MEMS mirrors

A two-axis scanning microelectromechanical (MEMS) mirror enables an optical coherence tomography (OCT) system to perform three-dimensional endoscopic imaging due to its fast scan speed and small size. However, the radial scan from the MEMS mirror causes various distortions in OCT images, namely spherical, fan-shaped and keystone distortions. In this paper, a new method is proposed to correct all of three distortions presented in OCT systems based on two-axis MEMS scanning mirrors. The spherical distortion is corrected first by directly manipulating the original spectral interferograms in the phase domain, followed by Fourier transform and three-dimensional geometrical transformation for correcting the other two types of distortions. OCT imaging experiments on a paper with square ink printed arrays and a glass tube filled with milk have been used to validate the proposed method. Distortions in OCT images of flat or curved surfaces can all be effectively removed.OCIS codes: (110.4500) Optical coherence tomography, (230.4685) Optical microelectromechanical devices, (100.6890) Three-dimensional image processing     

Satellite jitter detection and compensation using multispectral imagery

Satellite jitter is an important factor that affects the geometric accuracy of high-resolution satellite imagery. However, it is often ignored when there are no high frequency and accurate attitude observations. This letter proposes a jitter detection and compensation method using multispectral imagery, which can improve the band-to-band registration accuracy and eliminate image distortion caused by satellite jitter only using image data. In the method, a jitter detection and compensation model is built to estimate the periodic distortion from band-to-band registration error of multispectral imagery. Both simulation data and Ziyuan-3 (ZY-3) satellite multispectral images were used to validate the presented method. In the experiment of ZY-3, the band-to-band registration accuracy of the compensated image is improved to 0.05 pixels in both across and along track directions and the distortions across and along the track are both supressed to less than 0.2 pixels as determined from the known positions of ground control points (GCPs), showing that the distortion caused by satellite jitter can be accurately estimated and corrected by the proposed method.     

Dynamic coronary roadmapping via catheter tip tracking in X-ray fluoroscopy with deep learning based Bayesian filtering

Percutaneous coronary intervention (PCI) is typically performed with image guidance using X-ray angiograms in which coronary arteries are opacified with X-ray opaque contrast agents. Interventional cardiologists typically navigate instruments using non-contrast-enhanced fluoroscopic images, since higher use of contrast agents increases the risk of kidney failure. When using fluoroscopic images, the interventional cardiologist needs to rely on a mental anatomical reconstruction. This paper reports on the development of a novel dynamic coronary roadmapping approach for improving visual feedback and reducing contrast use during PCI. The approach compensates cardiac and respiratory induced vessel motion by ECG alignment and catheter tip tracking in X-ray fluoroscopy, respectively. In particular, for accurate and robust tracking of the catheter tip, we proposed a new deep learning based Bayesian filtering method that integrates the detection outcome of a convolutional neural network and the motion estimation between frames using a particle filtering framework. The proposed roadmapping and tracking approaches were validated on clinical X-ray images, achieving accurate performance on both catheter tip tracking and dynamic coronary roadmapping experiments. In addition, our approach runs in real-time on a computer with a single GPU and has the potential to be integrated into the clinical workflow of PCI procedures, providing cardiologists with visual guidance during interventions without the need of extra use of contrast agent.     

Dual modality fluorescence confocal and spectral-domain optical coherence tomography microendoscope

Optical biopsy facilitates in vivo disease diagnoses by providing a real-time in situ view of tissue in a clinical setting. Fluorescence confocal microendoscopy and optical coherence tomography (OCT) are two methods that have demonstrated significant potential in this context. These techniques provide complementary viewpoints. The high resolution and contrast associated with confocal systems allow en face visualization of sub-cellular details and cellular organization within a thin layer of biological tissue. OCT provides cross-sectional images showing the tissue micro-architecture to a depth beyond the reach of confocal systems. We present a novel design for a bench-top imaging system that incorporates both confocal and OCT modalities in the same optical train allowing the potential for rapid switching between the two imaging techniques. Preliminary results using simple phantoms show that it is possible to realize both confocal microendoscopy and OCT through a fiber bundle based imaging system.     

Complete 360° circumferential gonioscopic optical coherence tomography imaging of the iridocorneal angle

Clinically, gonioscopy is used to provide en face views of the ocular angle. The angle has been imaged with optical coherence tomography (OCT) through the corneoscleral limbus but is currently unable to image the angle from within the ocular anterior chamber. We developed a novel gonioscopic OCT system that images the angle circumferentially from inside the eye through a custom, radially symmetric, gonioscopic contact lens. We present, to our knowledge, the first 360° circumferential volumes (two normal subjects, two subjects with pathology) of peripheral iris and iridocorneal angle structures obtained via an internal approach not typically available in the clinic.OCIS codes: (170.4500) Optical coherence tomography, (170.0110) Imaging systems, (170.4470) Ophthalmology     

Ultrahigh speed endoscopic optical coherence tomography for gastroenterology

We describe an ultrahigh speed endoscopic swept source optical coherence tomography (OCT) system for clinical gastroenterology using a vertical-cavity surface-emitting laser (VCSEL) and micromotor imaging catheter. The system had a 600 kHz axial scan rate and 8 µm axial resolution in tissue. Imaging was performed with a 3.2 mm diameter imaging catheter at 400 frames per second with a 12 µm spot size. Three-dimensional OCT (3D-OCT) imaging was performed in patients with a cross section of pathologies undergoing upper and lower endoscopy. The use of distally actuated imaging catheters enabled OCT imaging with more flexibility, such as volumetric imaging in the small intestine and the assessment of hiatal hernia using retroflex imaging. The high rotational scanning stability of the micromotor enabled 3D volumetric imaging with micron scale volumetric accuracy for both en face OCT and cross-sectional imaging, as well as OCT angiography (OCTA) for 3D visualization of subsurface microvasculature. The ability to perform both structural and functional 3D OCT imaging in the GI tract with microscopic accuracy should enable a wide range of studies and enhance the sensitivity and specificity of OCT for detecting pathology.OCIS codes: (110.2350) Fiber optics imaging, (120.3890) Medical optics instrumentation, (120.5800) Scanners, (110.6880) Three-dimensional image acquisition, (140.7260) Vertical cavity surface emitting lasers, (170.2150) Endoscopic imaging, (170.2680) Gastrointestinal, (170.3880) Medical and biological imaging, (170.4500) Optical coherence tomography     

Handheld simultaneous scanning laser ophthalmoscopy and optical coherence tomography system

Scanning laser ophthalmoscopy (SLO) and optical coherence tomography (OCT) are widely used retinal imaging modalities that can assist in the diagnosis of retinal pathologies. The combination of SLO and OCT provides a more comprehensive imaging system and a method to register OCT images to produce motion corrected retinal volumes. While high quality, bench-top SLO-OCT systems have been discussed in the literature and are available commercially, there are currently no handheld designs. We describe the first design and fabrication of a handheld SLO/spectral domain OCT probe. SLO and OCT images were acquired simultaneously with a combined power under the ANSI limit. High signal-to-noise ratio SLO and OCT images were acquired simultaneously from a normal subject with visible motion artifacts. Fully automated motion estimation methods were performed in post-processing to correct for the inter- and intra-frame motion in SLO images and their concurrently acquired OCT volumes. The resulting set of reconstructed SLO images and the OCT volume were without visible motion artifacts. At a reduced field of view, the SLO resolved parafoveal cones without adaptive optics at a retinal eccentricity of 11° in subjects with good ocular optics. This system may be especially useful for imaging young children and subjects with less stable fixation.OCIS codes: (170.4460) Ophthalmic optics and devices, (080.3620) Lens system design, (170.0110) Imaging systems, (170.5755) Retina scanning, (170.4470) Ophthalmology, (110.4500) Optical coherence tomography, (110.4153) Motion estimation and optical flow     

Estimation of the transverse strain tensor in the arterial wall using IVUS image registration

Intravascular ultrasound (IVUS) elastography is an imaging technique that obtains the local mechanical properties of the artery wall and atherosclerotic plaques through strain measurements using IVUS. Knowledge of these mechanical properties may provide crucial information that can help in estimating plaque composition and its vulnerability. Here, we present a new method to estimate the transverse strain tensor of the arterial wall based on nonrigid image registration using IVUS images. This method registers a pair of images acquired at a vessel site under different levels of luminal pressure. The 2-D displacement field in the vessel cross-section is estimated from image registration; then the displacement field is used to calculate the 2-D local strain tensor. From the strain tensor, the strain in any direction in the cross-section can be obtained; here, the radial and circumferential strain distributions are presented. This strain estimation method has been validated with synthetic motion IVUS images and evaluated using the IVUS images of a polyvinyl alcohol cryogel phantom. The accuracy of the estimated strain and the ability of the method to overcome IVUS system noise are demonstrated.     

Ultrahigh speed en face OCT capsule for endoscopic imaging

Depth resolved and en face OCT visualization in vivo may have important clinical applications in endoscopy. We demonstrate a high speed, two-dimensional (2D) distal scanning capsule with a micromotor for fast rotary scanning and a pneumatic actuator for precision longitudinal scanning. Longitudinal position measurement and image registration were performed by optical tracking of the pneumatic scanner. The 2D scanning device enables high resolution imaging over a small field of view and is suitable for OCT as well as other scanning microscopies. Large field of view imaging for screening or surveillance applications can also be achieved by proximally pulling back or advancing the capsule while scanning the distal high-speed micromotor. Circumferential en face OCT was demonstrated in living swine at 250 Hz frame rate and 1 MHz A-scan rate using a MEMS tunable VCSEL light source at 1300 nm. Cross-sectional and en face OCT views of the upper and lower gastrointestinal tract were generated with precision distal pneumatic longitudinal actuation as well as proximal manual longitudinal actuation. These devices could enable clinical studies either as an adjunct to endoscopy, attached to an endoscope, or as a swallowed tethered capsule for non-endoscopic imaging without sedation. The combination of ultrahigh speed imaging and distal scanning capsule technology could enable both screening and surveillance applications.OCIS codes: (170.4500) Optical coherence tomography, (170.3880) Medical and biological imaging, (170.2150) Endoscopic imaging, (170.2680) Gastrointestinal     

Optical coherence tomography in the gastrointestinal tract

Optical coherence tomography (OCT) is a high-resolution, cross-sectional optical imaging technique that allows in situ imaging of tissue by measuring back-reflected light. OCT provides images in real time with a resolution approaching that of conventional histopathology, but without the need for tissue removal. OCT imaging can be performed endoscopically to visualize gastrointestinal tissue using a fiberoptic catheter passed through the instrument channel of a conventional endoscope. The resolution of OCT allows visualization of the different layers of gastrointestinal epithelium and the differentiation of Barrett's epithelium from normal gastric and squamous mucosa. OCT has also been used to image esophageal adenocarcinoma and colonic polyps. Recent developments include Doppler OCT, spectroscopic OCT, and ultrahigh-resolution OCT, which can visualize nuclei within single cells. Although still in its infancy as a clinical tool, OCT currently provides high-resolution images over the same imaging depth as conventional mucosal biopsy, and may prove to be a useful and minimally invasive technique for evaluating gastrointestinal tissue, particularly for early neoplastic changes.     

High-speed and widefield handheld swept-source OCT angiography with a VCSEL light source

Optical coherence tomography (OCT) and OCT angiography (OCTA) enable noninvasive structural and angiographic imaging of the eye. Portable handheld OCT/OCTA systems are required for imaging patients in the supine position. Examples include infants in the neonatal intensive care unit (NICU) and operating room (OR). The speed of image acquisition plays a pivotal role in acquiring high-quality OCT/OCTA images, particularly with the handheld system, since both the operator hand tremor and subject motion can cause significant motion artifacts. In addition, having a large field of view and the ability of real-time data visualization are critical elements in rapid disease screening, reducing imaging time, and detecting peripheral retinal pathologies. The arrangement of optical components is less flexible in the handheld system due to the limitation of size and weight. In this paper, we introduce a 400-kHz, 55-degree field of view handheld OCT/OCTA system that has overcome many technical challenges as a portable OCT system as well as a high-speed OCTA system. We demonstrate imaging premature infants with retinopathy of prematurity (ROP) in the NICU, a patient with incontinentia pigmenti (IP), and a patient with X-linked retinoschisis (XLRS) in the OR using our handheld OCT system. Our design may have the potential for improving the diagnosis of retinal diseases and help provide a practical guideline for designing a flexible and portable OCT system.     

In vivo feasibility of endovascular Doppler optical coherence tomography

Feasibility of detecting intravascular flow using a catheter based endovascular optical coherence tomography (OCT) system is demonstrated in a porcine carotid model in vivo. The effects of A-line density, radial distance, signal-to-noise ratio, non-uniform rotational distortion (NURD), phase stability of the swept wavelength laser and interferometer system on Doppler shift detection limit were investigated in stationary and flow phantoms. Techniques for NURD induced phase shift artifact removal were developed by tracking the catheter sheath. Detection of high flow velocity (~51 cm/s) present in the porcine carotid artery was obtained by phase unwrapping techniques and compared to numerical simulation, taking into consideration flow profile distortion by the eccentrically positioned imaging catheter. Using diluted blood in saline mixture as clearing agent, simultaneous Doppler OCT imaging of intravascular flow and structural OCT imaging of the carotid artery wall was feasible. To our knowledge, this is the first in vivo demonstration of Doppler imaging and absolute measurement of intravascular flow using a rotating fiber catheter in carotid artery.OCIS codes: (170.4500) Optical coherence tomography, (170.3880) Medical and biological imaging, (280.3340) Laser Doppler velocimetry, (120.5050) Phase measurement