Images of photoreceptors in living primate eyes using adaptive optics two-photon ophthalmoscopy

In vivo two-photon imaging through the pupil of the primate eye has the potential to become a useful tool for functional imaging of the retina. Two-photon excited fluorescence images of the macaque cone mosaic were obtained using a fluorescence adaptive optics scanning laser ophthalmoscope, overcoming the challenges of a low numerical aperture, imperfect optics of the eye, high required light levels, and eye motion. Although the specific fluorophores are as yet unknown, strong in vivo intrinsic fluorescence allowed images of the cone mosaic. Imaging intact ex vivo retina revealed that the strongest two-photon excited fluorescence signal comes from the cone inner segments. The fluorescence response increased following light stimulation, which could provide a functional measure of the effects of light on photoreceptors.OCIS codes: (010.1080) adaptive optics, (330.4460) Ophthalmic optics and devices, (330.5310) Vision – photoreceptors, (330.7327) Visual optics, ophthalmic instrumentation     

Images of photoreceptors in living primate eyes using adaptive optics two-photon ophthalmoscopy

In vivo two-photon imaging through the pupil of the primate eye has the potential to become a useful tool for functional imaging of the retina. Two-photon excited fluorescence images of the macaque cone mosaic were obtained using a fluorescence adaptive optics scanning laser ophthalmoscope, overcoming the challenges of a low numerical aperture, imperfect optics of the eye, high required light levels, and eye motion. Although the specific fluorophores are as yet unknown, strong in vivo intrinsic fluorescence allowed images of the cone mosaic. Imaging intact ex vivo retina revealed that the strongest two-photon excited fluorescence signal comes from the cone inner segments. The fluorescence response increased following light stimulation, which could provide a functional measure of the effects of light on photoreceptors.     

Understanding the changes of cone reflectance in adaptive optics flood illumination retinal images over three years

Although there is increasing interest in the investigation of cone reflectance variability, little is understood about its characteristics over long time scales. Cone detection and its automation is now becoming a fundamental step in the assessment and monitoring of the health of the retina and in the understanding of the photoreceptor physiology. In this work we provide an insight into the cone reflectance variability over time scales ranging from minutes to three years on the same eye, and for large areas of the retina (≥ 2.0 × 2.0 degrees) at two different retinal eccentricities using a commercial adaptive optics (AO) flood illumination retinal camera. We observed that the difference in reflectance observed in the cones increases with the time separation between the data acquisitions and this may have a negative impact on algorithms attempting to track cones over time. In addition, we determined that displacements of the light source within 0.35 mm of the pupil center, which is the farthest location from the pupil center used by operators of the AO camera to acquire high-quality images of the cone mosaic in clinical studies, does not significantly affect the cone detection and density estimation.OCIS codes: (110.1080) Active or adaptive optics, (330.7331) Visual optics, receptor optics, (170.3880) Medical and biological imaging     

Registration of adaptive optics corrected retinal nerve fiber layer (RNFL) images

Glaucoma is the leading cause of preventable blindness in the western world. Investigation of high-resolution retinal nerve fiber layer (RNFL) images in patients may lead to new indicators of its onset. Adaptive optics (AO) can provide diffraction-limited images of the retina, providing new opportunities for earlier detection of neuroretinal pathologies. However, precise processing is required to correct for three effects in sequences of AO-assisted, flood-illumination images: uneven illumination, residual image motion and image rotation. This processing can be challenging for images of the RNFL due to their low contrast and lack of clearly noticeable features. Here we develop specific processing techniques and show that their application leads to improved image quality on the nerve fiber bundles. This in turn improves the reliability of measures of fiber texture such as the correlation of Gray-Level Co-occurrence Matrix (GLCM).OCIS codes: (170.4470) Ophthalmology, (010.1080) Active or adaptive optics, (100.2960) Image analysis     

Adaptive-optics SLO imaging combined with widefield OCT and SLO enables precise 3D localization of fluorescent cells in the mouse retina

Adaptive optics scanning laser ophthalmoscopy (AO-SLO) has recently been used to achieve exquisite subcellular resolution imaging of the mouse retina. Wavefront sensing-based AO typically restricts the field of view to a few degrees of visual angle. As a consequence the relationship between AO-SLO data and larger scale retinal structures and cellular patterns can be difficult to assess. The retinal vasculature affords a large-scale 3D map on which cells and structures can be located during in vivo imaging. Phase-variance OCT (pv-OCT) can efficiently image the vasculature with near-infrared light in a label-free manner, allowing 3D vascular reconstruction with high precision. We combined widefield pv-OCT and SLO imaging with AO-SLO reflection and fluorescence imaging to localize two types of fluorescent cells within the retinal layers: GFP-expressing microglia, the resident macrophages of the retina, and GFP-expressing cone photoreceptor cells. We describe in detail a reflective afocal AO-SLO retinal imaging system designed for high resolution retinal imaging in mice. The optical performance of this instrument is compared to other state-of-the-art AO-based mouse retinal imaging systems. The spatial and temporal resolution of the new AO instrumentation was characterized with angiography of retinal capillaries, including blood-flow velocity analysis. Depth-resolved AO-SLO fluorescent images of microglia and cone photoreceptors are visualized in parallel with 469 nm and 663 nm reflectance images of the microvasculature and other structures. Additional applications of the new instrumentation are discussed.OCIS codes: (170.4460) Ophthalmic optics and devices, (110.4500) Optical coherence tomography, (110.1080) Active or adaptive optics, (170.0110) Imaging systems, (330.7324) Visual optics, comparative animal models, (170.4470) Ophthalmology     

Improving high resolution retinal image quality using speckle illumination HiLo imaging

Retinal image quality from flood illumination adaptive optics (AO) ophthalmoscopes is adversely affected by out-of-focus light scatter due to the lack of confocality. This effect is more pronounced in small eyes, such as that of rodents, because the requisite high optical power confers a large dioptric thickness to the retina. A recently-developed structured illumination microscopy (SIM) technique called HiLo imaging has been shown to reduce the effect of out-of-focus light scatter in flood illumination microscopes and produce pseudo-confocal images with significantly improved image quality. In this work, we adopted the HiLo technique to a flood AO ophthalmoscope and performed AO imaging in both (physical) model and live rat eyes. The improvement in image quality from HiLo imaging is shown both qualitatively and quantitatively by using spatial spectral analysis.OCIS codes: (010.1080) Active or adaptive optics, (170.3880) Medical and biological imaging, (170.4460) Ophthalmic optics and devices, (330.4875) Optics of physiological systems     

Imaging translucent cell bodies in the living mouse retina without contrast agents

The transparency of most retinal cell classes typically precludes imaging them in the living eye; unless invasive methods are used that deploy extrinsic contrast agents. Using an adaptive optics scanning light ophthalmoscope (AOSLO) and capitalizing on the large numerical aperture of the mouse eye, we enhanced the contrast from otherwise transparent cells by subtracting the left from the right half of the light distribution in the detector plane. With this approach, it is possible to image the distal processes of photoreceptors, their more proximal cell bodies and the mosaic of horizontal cells in the living mouse retina.OCIS codes: (170.4460) Ophthalmic optics and devices, (330.4300) Vision system - noninvasive assessment, (110.1080) Active or adaptive optics, (330.7324) Visual optics, comparative animal models     

Influence of sampling window size and orientation on parafoveal cone packing density

We assessed the agreement between sampling windows of different size and orientation on packing density estimates in images of the parafoveal cone mosaic acquired using a flood-illumination adaptive optics retinal camera. Horizontal and vertical oriented sampling windows of different size (320x160 µm, 160x80 µm and 80x40 µm) were selected in two retinal locations along the horizontal meridian in one eye of ten subjects. At each location, cone density tended to decline with decreasing sampling area. Although the differences in cone density estimates were not statistically significant, Bland-Altman plots showed that the agreement between cone density estimated within the different sampling window conditions was moderate. The percentage of the preferred packing arrangements of cones by Voronoi tiles was slightly affected by window size and orientation. The results illustrated the high importance of specifying the size and orientation of the sampling window used to derive cone metric estimates to facilitate comparison of different studies.OCIS codes: (110.1080) Active or adaptive optics, (170.1610) Clinical applications, (110.3925) Metrics     

Spatial and temporal variation of rod photoreceptor reflectance in the human retina

Using adaptive optics imaging tools to image the living retina, numerous investigators have reported temporal fluctuation in the reflectivity of individual cone photoreceptors. In addition, there is cone-to-cone (spatial) variation in reflectivity. As it has only recently become possible to image the complete rod photoreceptor mosaic in the living human retina, we sought to characterize the reflectivity of individual rods and compare their behavior to that of foveal/parafoveal cones. Across two subjects, we were able to successfully track the reflectance behavior of 1,690 rods and 1,980 cones over 12 hours. Rod and cone photoreceptors showed similar regional and temporal variability in their reflectance profiles, suggesting the presence of a common governing physiological process. Within the rod and cone mosaics, there was no sign of spatial clumping of reflectance profile behavior; that is, the arrangement of cells of a given archetypal reflectance profile within the mosaic was indistinguishable from random. These data demonstrate the ability to track the behavior of rod reflectivity over time. Finally, as these and other reflectance changes may be an indicator of photoreceptor function, a future extension of this method will be to analyze this behavior in patients with rod photoreceptor dysfunction (e.g., retinitis pigmentosa, Usher's syndrome, and congenital stationary night blindness).     

Noninvasive imaging of the human rod photoreceptor mosaic using a confocal adaptive optics scanning ophthalmoscope

The rod photoreceptors are implicated in a number of devastating retinal diseases. However, routine imaging of these cells has remained elusive, even with the advent of adaptive optics imaging. Here, we present the first in vivo images of the contiguous rod photoreceptor mosaic in nine healthy human subjects. The images were collected with three different confocal adaptive optics scanning ophthalmoscopes at two different institutions, using 680 and 775 nm superluminescent diodes for illumination. Estimates of photoreceptor density and rod:cone ratios in the 5°-15° retinal eccentricity range are consistent with histological findings, confirming our ability to resolve the rod mosaic by averaging multiple registered images, without the need for additional image processing. In one subject, we were able to identify the emergence of the first rods at approximately 190 μm from the foveal center, in agreement with previous histological studies. The rod and cone photoreceptor mosaics appear in focus at different retinal depths, with the rod mosaic best focus (i.e., brightest and sharpest) being at least 10 μm shallower than the cones at retinal eccentricities larger than 8°. This study represents an important step in bringing high-resolution imaging to bear on the study of rod disorders.     

Variability in parafoveal cone mosaic in normal trichromatic individuals

Parafoveal function is important for daily visual tasks such as reading. Here the variability in cone density along the four cardinal meridians in parafoveal regions of the retina was investigated in vivo using an adaptive optics fundus camera. Ten healthy normal trichromatic individuals were included in the study. There were significant differences in cone density between individuals at all four tested eccentricities (0.5, 1, 2 and 3°) and meridians. Cone density ranged from 34,900 to 63,000 cones/mm(2) at 1° horizontally, and from 31,600 to 60,700 at 1° vertically. The results were consistent with those of Curcio et al. (1990), although between-individual variability is greater than previously reported in the parafovea from 1 to 3.2°.     

Detection and segmentation of drusen deposits on human retina: potential in the diagnosis of age-related macular degeneration

Assessment of the risk for the development of age-related macular degeneration requires reliable detection and quantitative mapping of retinal abnormalities that are considered as precursors of the disease. Typical signs for the latter are the so-called drusen that appear as abnormal white-yellow deposits on the retina. Segmentation of these features using conventional image analysis methods is quite complicated mainly due to the non-uniform illumination and the variability of the pigmentation of the background tissue. This paper presents a novel segmentation algorithm for the automatic detection and mapping of drusen in retina images acquired with the aid of a digital Fundus camera. We employ a modified adaptive histogram equalization, namely the multilevel histogram equalization (MLE) scheme, for enhancing local intensity structures. For the detection of drusen in retina images, we develop a novel segmentation technique, the histogram-based adaptive local thresholding (HALT), which extracts the useful information from an image without being affected by the presence of other structures. We provide experimental results from the application of our technique to real images, where certain abnormalities (drusen) have slightly different characteristics from the background. The performance of the algorithm is established through statistical analysis of the results. This analysis indicates that the proposed drusen detector gives reliable detection accuracy in both position and mass size.     

Wavefront sensorless adaptive optics fluorescence biomicroscope for in vivo retinal imaging in mice

Cellular-resolution in vivo fluorescence imaging is a valuable tool for longitudinal studies of retinal function in vision research. Wavefront sensorless adaptive optics (WSAO) is a developing technology that enables high-resolution imaging of the mouse retina. In place of the conventional method of using a Shack-Hartmann wavefront sensor to measure the aberrations directly, WSAO uses an image quality metric and a search algorithm to drive the shape of the adaptive element (i.e. deformable mirror). WSAO is a robust approach to AO and it is compatible with a compact, low-cost lens-based system. In this report, we demonstrated a hill-climbing algorithm for WSAO with a variable focus lens and deformable mirror for non-invasive in vivo imaging of EGFP (enhanced green fluorescent protein) labelled ganglion cells and microglia cells in the mouse retina.OCIS codes: (170.4460) Ophthalmic optics and devices, (010.1080) Active or adaptive optics, (170.0110) Imaging systems, (170.4470) Ophthalmology     

In vivo adaptive optics microvascular imaging in diabetic patients without clinically severe diabetic retinopathy

We used a confocal adaptive optics scanning laser ophthalmoscope (AOSLO) to image the retina of subjects with non-proliferative diabetic retinopathy (NPDR). To improve visualization of different retinal features, the size and alignment of the confocal aperture were varied. The inner retinal layers contained clearly visualized retinal vessels. In diabetic subjects there was extensive capillary remodeling despite the subjects having only mild or moderate NPDR. Details of the retinal microvasculature were readily imaged with a larger confocal aperture. Hard exudates were observed with the AOSLO in all imaging modes. Photoreceptor layer images showed regions of bright cones and dark areas, corresponding in location to overlying vascular abnormalities and retinal edema. Clinically undetected intraretinal vessel remodeling and varying blood flow patterns were found. Perifoveal capillary diameters were larger in the diabetic subjects (p<0.01), and small arteriolar walls were thickened, based on wall to lumen measurements (p<.05). The results suggest that existing clinical classifications based on lower magnification clinical assessment may not adequately measure key vascular differences among individuals with NPDR.OCIS codes: (170.3880) Medical and biological imaging, (170.4460) Ophthalmic optics and devices, (170.4470) Ophthalmology     

Adaptive optics scanning ophthalmoscopy with annular pupils

Annular apodization of the illumination and/or imaging pupils of an adaptive optics scanning light ophthalmoscope (AOSLO) for improving transverse resolution was evaluated using three different normalized inner radii (0.26, 0.39 and 0.52). In vivo imaging of the human photoreceptor mosaic at 0.5 and 10° from fixation indicates that the use of an annular illumination pupil and a circular imaging pupil provides the most benefit of all configurations when using a one Airy disk diameter pinhole, in agreement with the paraxial confocal microscopy theory. Annular illumination pupils with 0.26 and 0.39 normalized inner radii performed best in terms of the narrowing of the autocorrelation central lobe (between 7 and 12%), and the increase in manual and automated photoreceptor counts (8 to 20% more cones and 11 to 29% more rods). It was observed that the use of annular pupils with large inner radii can result in multi-modal cone photoreceptor intensity profiles. The effect of the annular masks on the average photoreceptor intensity is consistent with the Stiles-Crawford effect (SCE). This indicates that combinations of images of the same photoreceptors with different apodization configurations and/or annular masks can be used to distinguish cones from rods, even when the former have complex multi-modal intensity profiles. In addition to narrowing the point spread function transversally, the use of annular apodizing masks also elongates it axially, a fact that can be used for extending the depth of focus of techniques such as adaptive optics optical coherence tomography (AOOCT). Finally, the positive results from this work suggest that annular pupil apodization could be used in refractive or catadioptric adaptive optics ophthalmoscopes to mitigate undesired back-reflections.     

The use of forward scatter to improve retinal vascular imaging with an adaptive optics scanning laser ophthalmoscope

Retinal vascular diseases are a leading cause of blindness and visual disability. The advent of adaptive optics retinal imaging has enabled us to image the retinal vascular at cellular resolutions, but imaging of the vasculature can be difficult due to the complex nature of the images, including features of many other retinal structures, such as the nerve fiber layer, glial and other cells. In this paper we show that varying the size and centration of the confocal aperture of an adaptive optics scanning laser ophthalmoscope (AOSLO) can increase sensitivity to multiply scattered light, especially light forward scattered from the vasculature and erythrocytes. The resulting technique was tested by imaging regions with different retinal tissue reflectivities as well as within the optic nerve head.OCIS codes: (110.1085) Adaptive imaging, (110.1220) Apertures, (170.4460) Ophthalmic optics and devices, (170.1470) Blood or tissue constituent monitoring     

High-speed, image-based eye tracking with a scanning laser ophthalmoscope

We demonstrate a high-speed, image-based tracking scanning laser ophthalmoscope (TSLO) that can provide high fidelity structural images, real-time eye tracking and targeted stimulus delivery. The system was designed for diffraction-limited performance over an 8° field of view (FOV) and operates with a flexible field of view of 1°–5.5°. Stabilized videos of the retina were generated showing an amplitude of motion after stabilization of 0.2 arcmin or less across all frequencies. In addition, the imaging laser can be modulated to place a stimulus on a targeted retinal location. We show a stimulus placement accuracy with a standard deviation less than 1 arcmin. With a smaller field size of 2°, individual cone photoreceptors were clearly visible at eccentricities outside of the fovea.OCIS codes : (170.4460) Ophthalmic optics and devices, (330.2210) Vision - eye movements, (330.4460) Ophthalmic optics and devices     

Fast detection of the optic disc and fovea in color fundus photographs

A fully automated, fast method to detect the fovea and the optic disc in digital color photographs of the retina is presented. The method makes few assumptions about the location of both structures in the image. We define the problem of localizing structures in a retinal image as a regression problem. A kNN regressor is utilized to predict the distance in pixels in the image to the object of interest at any given location in the image based on a set of features measured at that location. The method combines cues measured directly in the image with cues derived from a segmentation of the retinal vasculature. A distance prediction is made for a limited number of image locations and the point with the lowest predicted distance to the optic disc is selected as the optic disc center. Based on this location the search area for the fovea is defined. The location with the lowest predicted distance to the fovea within the foveal search area is selected as the fovea location. The method is trained with 500 images for which the optic disc and fovea locations are known. An extensive evaluation was done on 500 images from a diabetic retinopathy screening program and 100 specially selected images containing gross abnormalities. The method found the optic disc in 99.4% and the fovea in 96.8% of regular screening images and for the images with abnormalities these numbers were 93.0% and 89.0% respectively.     

Dynamic observation and motion tracking of individual gold atoms with HAADF-STEM imaging

A modern aberration-corrected scanning transmission electron microscope (STEM) is used to study the motion of individual gold atoms on an amorphous carbon film. With a probe size of 0.7 Å, individual gold atoms are clearly resolved. Sequential Z-contrast images are captured with ten frames per second, and moving atoms are tracked frame-by-frame with the feature point tracking algorithm. The tracked trajectories give direct visualization of individual atoms'' movements, and the number of tracked atoms in each frame is quantified. The result indicates that the observed behaviors of atoms are mainly dominated by the beam-induced motion.

The tracked trajectories give direct visualization of individual atoms'' movements, and the number of tracked atoms in each frame is quantified.     

Observation of cone and rod photoreceptors in normal subjects and patients using a new generation adaptive optics scanning laser ophthalmoscope

We demonstrate the capability of a new generation adaptive optics scanning laser ophthalmoscope (AOSLO) to resolve cones and rods in normal subjects, and confirm our findings by comparing cone and rod spacing with published histology measurements. Cone and rod spacing measurements are also performed on AOSLO images from two different diseased eyes, one affected by achromatopsia and the other by acute zonal occult outer retinopathy (AZOOR). The potential of AOSLO technology in the study of these and other retinal diseases is illustrated.