FPscope: a field-portable high-resolution microscope using a cellphone lens

The large consumer market has made cellphone lens modules available at low-cost and in high-quality. In a conventional cellphone camera, the lens module is used to demagnify the scene onto the image plane of the camera, where image sensor is located. In this work, we report a 3D-printed high-resolution Fourier ptychographic microscope, termed FPscope, which uses a cellphone lens in a reverse manner. In our platform, we replace the image sensor with sample specimens, and use the cellphone lens to project the magnified image to the detector. To supersede the diffraction limit of the lens module, we use an LED array to illuminate the sample from different incident angles and synthesize the acquired images using the Fourier ptychographic algorithm. As a demonstration, we use the reported platform to acquire high-resolution images of resolution target and biological specimens, with a maximum synthetic numerical aperture (NA) of 0.5. We also show that, the depth-of-focus of the reported platform is about 0.1 mm, orders of magnitude longer than that of a conventional microscope objective with a similar NA. The reported platform may enable healthcare accesses in low-resource settings. It can also be used to demonstrate the concept of computational optics for educational purposes.OCIS codes: (110.0180) Microscopy, (170.3010) Image reconstruction techniques, (170.3880) Medical and biological imaging     

Resolution doubling with a reduced number of image acquisitions

Structured illumination technique enhances the lateral resolution by projecting non-uniform intensity patterns on a sample. In a typical implementation, three lateral phase shifts (0, 2π/3, 4π/3) are needed for each orientation of the sinusoidal pattern, and 3 different orientations are needed to double the bandwidth isotopically in the Fourier domain. To this end, 9 incoherent images are needed in the acquisition process. In this paper, we discuss an imaging strategy for the structured illumination technique and demonstrate the use of a modified incoherent Fourier ptychographic procedure for reducing the number of acquisitions. In the first implementation, we used complementary sinusoidal patterns for sample illumination. We show that, the number of lateral phase shifts can be reduced from 3 to 2 for each orientation of the sinusoidal pattern and the total number of image acquisitions can be reduced to 6 with 3 orientations. In the second implementation, we further reduce the number of image acquisitions to 4. We also show that, the resolution-doubled image can be recovered even with unknown phases of the sinusoidal patterns. We validate the proposed imaging procedure with non-fluorescence samples. The reported approach may shorten the acquisition time of super-resolution imaging and reduce phototoxicity of biological samples.OCIS codes: (170.3010) Image reconstruction techniques, (170.2945) Illumination design, (170.0180) Microscopy     

Robust Fourier ptychographic microscopy via a physics-based defocusing strategy for calibrating angle-varied LED illumination

Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technique for wide-field, high-resolution microscopy with a high space-bandwidth product. It integrates the concepts of synthetic aperture and phase retrieval to surpass the resolution limit imposed by the employed objective lens. In the FPM framework, the position of each sub-spectrum needs to be accurately known to ensure the success of the phase retrieval process. Different from the conventional methods with mechanical adjustment or data-driven optimization strategies, here we report a physics-based defocusing strategy for correcting large-scale positional deviation of the LED illumination in FPM. Based on a subpixel image registration process with a defocused object, we can directly infer the illumination parameters including the lateral offsets of the light source, the in-plane rotation angle of the LED array, and the distance between the sample and the LED board. The feasibility and effectiveness of our method are validated with both simulations and experiments. We show that the reported strategy can obtain high-quality reconstructions of both the complex object and pupil function even the LED array is randomly placed under the sample with both unknown lateral offsets and rotations. As such, it enables the development of robust FPM systems by reducing the requirements on fine mechanical adjustment and data-driven correction in the construction process.     

Single full-FOV reconstruction Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technique that has high-resolution and wide field-of-view (FOV). FPM bypasses the NA limit of the system by stitching a number of variable-illuminated measured images in Fourier space. On the basis of the wide FOV of the low NA objective, the high-resolution image with a wide FOV can be reconstructed through the phase recovery algorithm. However, the high-resolution reconstruction images are affected by the LED array point light source. The results are: (1) the intensities collected by the sample are severely declined when edge LEDs illuminate the sample; (2) the multiple reconstructions are caused by wavevectors inconsistency for the full FOV images. Here, we propose a new lighting scheme termed full FOV Fourier ptychographic microscopy (F³PM). By combining the LED array and telecentric lens, the method can provide plane waves with different angles while maintaining uniform intensity. Benefiting from the telecentric performance and f‒θ property of the telecentric lens, the system stability is improved and the relationship between the position of LED and its illumination angle is simplified. The excellent plane wave provided by the telecentric lens guarantees the same wavevector in the full FOV, and we use this wavevector to reconstruct the full FOV during one time. The area and diameter of the single reconstruction FOV reached 14.6mm² and 5.4 mm, respectively, and the diameter is very close to the field number (5.5 mm) of the 4× objective. Compared with the traditional FPM, we have increased the diameter of FOV in a single reconstruction by ∼ 10 times, eliminating the complicated steps of computational redundancy and image stitching.     

Wide field-of-view fluorescence image deconvolution with aberration-estimation from Fourier ptychography

This paper presents a method to simultaneously acquire an aberration-corrected, wide field-of-view fluorescence image and a high-resolution coherent bright-field image using a computational microscopy method. First, the procedure applies Fourier ptychographic microscopy (FPM) to retrieve the amplitude and phase of a sample, at a resolution that significantly exceeds the cutoff spatial frequency of the microscope objective lens. At the same time, redundancy within the set of acquired FPM bright-field images offers a means to estimate microscope aberrations. Second, the procedure acquires an aberrated fluorescence image, and computationally improves its resolution through deconvolution with the estimated aberration map. An experimental demonstration successfully improves the bright-field resolution of fixed, stained and fluorescently tagged HeLa cells by a factor of 4.9, and reduces the error caused by aberrations in a fluorescence image by up to 31%, over a field of view of 6.2 mm by 9.3 mm. For optimal deconvolution, we show the fluorescence image needs to have a signal-to-noise ratio of at least ~18.OCIS codes: (180.2520) Fluorescence microscopy, (070.0070) Fourier optics and signal processing     

Theoretical study of multispectral structured illumination for depth resolved imaging of non-stationary objects: focus on retinal imaging

Current implementations of structured illumination microscopy for depth-resolved (three-dimensional) imaging have limitations that restrict its use; specifically, they are not applicable to non-stationary objects imaged with relatively poor condenser optics and in non-fluorescent mode. This includes in-vivo retinal imaging. A novel implementation of structured illumination microscopy is presented that overcomes these issues. A three-wavelength illumination technique is used to obtain the three sub-images required for structured illumination simultaneously rather than sequentially, enabling use on non-stationary objects. An illumination method is presented that produces an incoherent pattern through interference, bypassing the limitations imposed by the aberrations of the condenser lens and thus enabling axial sectioning in non-fluorescent imaging. The application to retinal imaging can lead to a device with similar sectioning capabilities to confocal microscopy without the optical complexity (and cost) required for scanning systems.     

Spectral multiplexing and coherent-state decomposition in Fourier ptychographic imaging

Information multiplexing is important for biomedical imaging and chemical sensing. In this paper, we report a microscopy imaging technique, termed state-multiplexed Fourier ptychography (FP), for information multiplexing and coherent-state decomposition. Similar to a typical Fourier ptychographic setting, we use an array of light sources to illuminate the sample from different incident angles and acquire corresponding low-resolution images using a monochromatic camera. In the reported technique, however, multiple light sources are lit up simultaneously for information multiplexing, and the acquired images thus represent incoherent summations of the sample transmission profiles corresponding to different coherent states. We show that, by using the state-multiplexed FP recovery routine, we can decompose the incoherent mixture of the FP acquisitions to recover a high-resolution sample image. We also show that, color-multiplexed imaging can be performed by simultaneously turning on R/G/B LEDs for data acquisition. The reported technique may provide a solution for handling the partially coherent effect of light sources used in Fourier ptychographic imaging platforms. It can also be used to replace spectral filter, gratings or other optical components for spectral multiplexing and demultiplexing. With the availability of cost-effective broadband LEDs, the reported technique may open up exciting opportunities for computational multispectral imaging.OCIS codes: (170.3010) Image reconstruction techniques, (110.4234) Multispectral and hyperspectral imaging, (100.3190) Inverse problems, (170.0180) Microscopy     

High-resolution light-field microscopy with patterned illumination

Light-field fluorescence microscopy can record large-scale population activity of neurons expressing genetically-encoded fluorescent indicators within volumes of tissue. Conventional light-field microscopy (LFM) suffers from poor lateral resolution when using wide-field illumination. Here, we demonstrate a structured-illumination light-field microscopy (SI-LFM) modality that enhances spatial resolution over the imaging volume. This modality increases resolution by illuminating sample volume with grating patterns that are invariant over the axial direction. The size of the SI-LFM point-spread-function (PSF) was approximately half the size of the conventional LFM PSF when imaging fluorescent beads. SI-LFM also resolved fine spatial features in lens tissue samples and fixed mouse retina samples. Finally, SI-LFM reported neural activity with approximately three times the signal-to-noise ratio of conventional LFM when imaging live zebrafish expressing a genetically encoded calcium sensor.     

Compact plane illumination plugin device to enable light sheet fluorescence imaging of multi-cellular organisms on an inverted wide-field microscope

We developed a compact plane illumination plugin (PIP) device which enabled plane illumination and light sheet fluorescence imaging on a conventional inverted microscope. The PIP device allowed the integration of microscope with tunable laser sheet profile, fast image acquisition, and 3-D scanning. The device is both compact, measuring approximately 15 by 5 by 5 cm, and cost-effective, since we employed consumer electronics and an inexpensive device molding method. We demonstrated that PIP provided significant contrast and resolution enhancement to conventional microscopy through imaging different multi-cellular fluorescent structures, including 3-D branched cells in vitro and live zebrafish embryos. Imaging with the integration of PIP greatly reduced out-of-focus contamination and generated sharper contrast in acquired 2-D plane images when compared with the stand-alone inverted microscope. As a result, the dynamic fluid domain of the beating zebrafish heart was clearly segmented and the functional monitoring of the heart was achieved. Furthermore, the enhanced axial resolution established by thin plane illumination of PIP enabled the 3-D reconstruction of the branched cellular structures, which leads to the improvement on the functionality of the wide field microscopy.OCIS codes: (170.3880) Medical and biological imaging, (170.2520) Fluorescence microscopy, (110.3010) Image reconstruction techniques, (110.2945) Illumination design, (170.6900) Three-dimensional microscopy     

Depth resolved hyperspectral imaging spectrometer based on structured light illumination and Fourier transform interferometry

A depth resolved hyperspectral imaging spectrometer can provide depth resolved imaging both in the spatial and the spectral domain. Images acquired through a standard imaging Fourier transform spectrometer do not have the depth-resolution. By post processing the spectral cubes (x, y, λ) obtained through a Sagnac interferometer under uniform illumination and structured illumination, spectrally resolved images with depth resolution can be recovered using structured light illumination algorithms such as the HiLo method. The proposed scheme is validated with in vitro specimens including fluorescent solution and fluorescent beads with known spectra. The system is further demonstrated in quantifying spectra from 3D resolved features in biological specimens. The system has demonstrated depth resolution of 1.8 μm and spectral resolution of 7 nm respectively.OCIS codes: (170.2520) Fluorescence microscopy, (170.6900) Three-dimensional microscopy, (300.6300) Spectroscopy, Fourier transforms     

Camera array based light field microscopy

This paper proposes a novel approach for high-resolution light field microscopy imaging by using a camera array. In this approach, we apply a two-stage relay system for expanding the aperture plane of the microscope into the size of an imaging lens array, and utilize a sensor array for acquiring different sub-apertures images formed by corresponding imaging lenses. By combining the rectified and synchronized images from 5 × 5 viewpoints with our prototype system, we successfully recovered color light field videos for various fast-moving microscopic specimens with a spatial resolution of 0.79 megapixels at 30 frames per second, corresponding to an unprecedented data throughput of 562.5 MB/s for light field microscopy. We also demonstrated the use of the reported platform for different applications, including post-capture refocusing, phase reconstruction, 3D imaging, and optical metrology.OCIS codes: (180.6900) Three-dimensional microscopy, (110.1758) Computational imaging, (170.0110) Imaging systems, (100.3010) Image reconstruction techniques     

A compact Airy beam light sheet microscope with a tilted cylindrical lens

Light-sheet imaging is rapidly gaining importance for imaging intact biological specimens. Many of the latest innovations rely on the propagation-invariant Bessel or Airy beams to form an extended light sheet to provide high resolution across a large field of view. Shaping light to realize propagation-invariant beams often relies on complex programming of spatial light modulators or specialized, custom made, optical elements. Here we present a straightforward and low-cost modification to the traditional light-sheet setup, based on the open-access light-sheet microscope OpenSPIM, to achieve Airy light-sheet illumination. This brings wide field single-photon light-sheet imaging to a broader range of endusers. Fluorescent microspheres embedded in agarose and a zebrafish larva were imaged to demonstrate how such a microscope can have a minimal footprint and cost without compromising on imaging quality.OCIS codes: (170.0170) Medical optics and biotechnology, (180.6900) Three-dimensional microscopy, (140.3300) Laser beam shaping, (220.1000) Aberration compensation, (070.0070) Fourier optics and signal processing, (110.0180) Microscopy, (110.1758) Computational imaging, (110.4850) Optical transfer functions, (110.7348) Wavefront encoding     

AOTF-based hyperspectral imaging phase microscopy

Phase imaging microscopy with incoherent object illumination is convenient and affordable for biomedical research and clinics since it provides easy integration with a variety of bright-field optical microscopes. We report the design of a new hyperspectral imaging system based on a combination of a spatial light modulator (SLM) and an acousto-optic tunable filter (AOTF) for phase imaging microscopy. Contrast of phase-only objects originates from matched spectral and spatial filtering performed by the SLM and the AOTF located in Fourier-conjugate optical planes in the back-end of the optical system. The system is designed as an add-on to a standard optical microscope with incoherent diascopic sample illumination.     

Optimized approaches for optical sectioning and resolution enhancement in 2D structured illumination microscopy

The use of structured illumination in fluorescence microscopy allows the suppression of out of focus light and an increase in effective spatial resolution. In this paper we consider different approaches for reconstructing 2D structured illumination images in order to combine these two attributes, to allow fast, optically sectioned, superresolution imaging. We present a linear reconstruction method that maximizes the axial frequency extent of the combined 2D structured illumination passband along with an empirically optimized approximation to this scheme. These reconstruction methods are compared to other schemes using structured illumination images of fluorescent samples. For sinusoidal excitation at half the incoherent cutoff frequency we find that removing information in the zero order passband except for a small region close to the excitation frequency, where it replaces the complementary information from the displaced first order passband, enables optimal reconstruction of optically sectioned images with enhanced spatial resolution.OCIS codes: (180.2520) Fluorescence microscopy, (180.6900) Three-dimensional microscopy, (100.6640) Superresolution     

Resolution-enhancement for an orthographic-view image display in an integral imaging microscope system

Due to the limitations of micro lens arrays and camera sensors, images on display devices through the integral imaging microscope systems have been suffering for a low-resolution. In this paper, a resolution-enhanced orthographic-view image display method for integral imaging microscopy is proposed and demonstrated. Iterative intermediate-view reconstructions are performed based on bilinear interpolation using neighborhood elemental image information, and a graphics processing unit parallel processing algorithm is applied for fast image processing. The proposed method is verified experimentally and the effective results are presented in this paper.OCIS codes: (180.6900) Three-dimensional microscopy, (100.6890) Three-dimensional image processing, (120.2040) Displays     

Multilayer fluorescence imaging on a single-pixel detector

A critical challenge for fluorescence imaging is the loss of high frequency components in the detection path. Such a loss can be related to the limited numerical aperture of the detection optics, aberrations of the lens, and tissue turbidity. In this paper, we report an imaging scheme that integrates multilayer sample modeling, ptychography-inspired recovery procedures, and lensless single-pixel detection to tackle this challenge. In the reported scheme, we directly placed a 3D sample on top of a single-pixel detector. We then used a known mask to generate speckle patterns in 3D and scanned this known mask to different positions for sample illumination. The sample was then modeled as multiple layers and the captured 1D fluorescence signals were used to recover multiple sample images along the z axis. The reported scheme may find applications in 3D fluorescence sectioning, time-resolved and spectrum-resolved imaging. It may also find applications in deep-tissue fluorescence imaging using the memory effect.OCIS codes: (180.0180) Microscopy, (170.0110) Imaging systems, (100.3010) Image reconstruction techniques     

Partially coherent phase imaging with simultaneous source recovery

We propose a new method for phase retrieval that uses partially coherent illumination created by any arbitrary source shape in Köhler geometry. Using a stack of defocused intensity images, we recover not only the phase and amplitude of the sample, but also an estimate of the unknown source shape, which describes the spatial coherence of the illumination. Our algorithm uses a Kalman filtering approach which is fast, accurate and robust to noise. The method is experimentally simple and flexible, so should find use in optical, electron, X-ray and other phase imaging systems which employ partially coherent light. We provide an experimental demonstration in an optical microscope with various condenser apertures.OCIS codes: (100.5070) Phase retrieval, (110.3010) Image reconstruction techniques     

Multiplexed coded illumination for Fourier Ptychography with an LED array microscope

Fourier Ptychography is a new computational microscopy technique that achieves gigapixel images with both wide field of view and high resolution in both phase and amplitude. The hardware setup involves a simple replacement of the microscope’s illumination unit with a programmable LED array, allowing one to flexibly pattern illumination angles without any moving parts. In previous work, a series of low-resolution images was taken by sequentially turning on each single LED in the array, and the data were then combined to recover a bandwidth much higher than the one allowed by the original imaging system. Here, we demonstrate a multiplexed illumination strategy in which multiple randomly selected LEDs are turned on for each image. Since each LED corresponds to a different area of Fourier space, the total number of images can be significantly reduced, without sacrificing image quality. We demonstrate this method experimentally in a modified commercial microscope. Compared to sequential scanning, our multiplexed strategy achieves similar results with approximately an order of magnitude reduction in both acquisition time and data capture requirements.OCIS codes: (170.1630) Coded aperture imaging, (170.0180) Microscopy, (110.1758) Computational imaging, (100.5070) Phase retrieval, (110.3010) Image reconstruction techniques     

Fourier phase microscopy with white light

Laser-based Fourier phase microscopy (FPM) works on the principle of decomposition of an image field in two spatial components that can be controllably shifted in phase with respect to each other. However, due to the coherent illumination, the contrast in phase images is degraded by speckles. In this paper we present FPM with spatially coherent white light (wFPM), which offers high spatial phase sensitivity due to the low temporal coherence and high temporal phase stability due to common path geometry. Further, by using a fast spatial light modulator (SLM) and a fast scientific-grade complementary metal oxide semiconductor (sCMOS) camera, we report imaging at a maximum rate of 12.5 quantitative phase frames per second with 5.5 mega pixels image size. We illustrate the utility of wFPM as a contrast enhancement as well as dynamic phase measurement method by imaging section of benign colonic glands and red blood cell membrane fluctuation.OCIS codes: (170.0180) Microscopy, (070.0070) Fourier optics and signal processing, (070.6120) Spatial light modulators, (120.5050) Phase measurement     

Multimodal microscopy for the simultaneous visualization of five different imaging modalities using a single light source

Optical microscopy has been widely used in biomedical research as it provides photophysical and photochemical information of the target in subcellular spatial resolution without requiring physical contact with the specimen. To obtain a deeper understanding of biological phenomena, several efforts have been expended to combine such optical imaging modalities into a single microscope system. However, the use of multiple light sources and detectors through separated beam paths renders previous systems extremely complicated or slow for in vivo imaging. Herein, we propose a novel high-speed multimodal optical microscope system that simultaneously visualizes five different microscopic contrasts, i.e., two-photon excitation, second-harmonic generation, backscattered light, near-infrared fluorescence, and fluorescence lifetime, using a single femtosecond pulsed laser. Our proposed system can visualize five modal images with a frame rate of 3.7 fps in real-time, thereby providing complementary optical information that enhances both structural and functional contrasts. This highly photon-efficient multimodal microscope system enables various properties of biological tissues to be assessed.