Apparatus and method for fast volumetric fluorescence microscopy using temporally multiplexed light sheets
11656447 · 2023-05-23
Assignee
Inventors
- Kevin Kin Man Tsia (Hong Kong, CN)
- Yuxuan Ren (Hong Kong, CN)
- Jianglai Wu (Hong Kong, CN)
- Andy Kam Seng Lau (Hong Kong, CN)
- Queenie Tsz Kwan Lai (Hong Kong, CN)
Cpc classification
G01N21/8851
PHYSICS
G01N21/6486
PHYSICS
G02B21/367
PHYSICS
G02B21/16
PHYSICS
International classification
Abstract
A microscopy device comprises a continuous or pulsed wave laser light source; a pair of parallel mirrors configured to receive light from the light source and reflect an array of incoherent light sheets; a beam encoder (e.g., frequency modulation reticle, Hadamard basis, random modulation pattern) to segment the array of incoherent light sheets and encode each light sheet with a respective frequency in reciprocal space; a lens configured to direct the encoded light sheets towards a biological sample; and an image capturing device configured to receive a fluorescence signal from the biological sample.
Claims
1. A light-sheet based microscopy device comprising: a light source; a pair of mirrors configured to receive light from the light source and generate an array of coherent light sheets, wherein the coherent light sheets are mutually spatially incoherent from each other, and wherein the pair of mirrors is further configured to reconfigure a coherency of the coherent light sheets with respect to each other; an encoder configured to encode the array of incoherent light sheets, the encoder comprising: a frequency modulator configured to segment the array of coherent light sheets and encode each coherent light sheet with a respective frequency; or a temporal modulator configured to segment the array of coherent light sheets by an arbitrary orthogonal encoding basis including a Hadamard basis or a random mask; at least one lens configured to direct the encoded light sheets towards a biological sample, and an image capturing device configured to receive a fluorescence signal from the biological sample.
2. The light-sheet based microscopy device of claim 1, wherein the light source is at least one laser or a combination of multiple lasers at different wavelengths.
3. The light-sheet based microscopy device of claim 1, wherein the pair of mirrors each has a respective reflectivity of greater than 99%.
4. The light-sheet based microscopy device of claim 1, further comprising a beam expander configured to expand or reduce a beam of light from the light source.
5. The light-sheet based microscopy device of claim 1, further comprising an illumination objective configured to transmit light to the biological sample, and a detection objective disposed orthogonally from the illumination objective.
6. The light-sheet based microscopy device of claim 1, further comprising circuitry for demultiplexing an image signal.
7. The light-sheet based microscopy device of claim 1, wherein the image capturing device is a 2D image sensor or a camera, and the image capturing device is configured to capture a video, and wherein an image capturing device objective either is disposed orthogonally from the illumination objective or is in line with the illumination objective.
8. A light-sheet based microscopy device comprising: a light source; an angle-misaligned mirror pair configured to receive light from the light source and generate an array of coherent light sheets, wherein the light sheets are mutually spatially incoherent from each other, wherein a density and a coherency of the coherent light sheets with respect to each other are reconfigurable by tuning a geometry of the angle-misaligned mirror pair; a light sheet encoder configured to encode the array of coherent light sheets to form a parallelized illumination, the light sheet encoder comprising a frequency modulator configured to segment the array of coherent light sheets and encode each light sheet with a respective frequency, the frequency modulator comprising a spinning reticle; at least one lens configured to direct the encoded light sheets towards a biological sample, and an image capturing device configured to receive a fluorescence signal from the biological sample.
9. The light-sheet based microscopy device of claim 8, further comprising a beam shaper to shape the light entered into the angle-misaligned mirror pair to form a line-focused beam with a cone angle.
10. The light-sheet based microscopy device of claim 8, further comprising a relay-lens configured to pass through the projected encoded light sheets to form an array of N light-sheets.
11. The light-sheet based microscopy device of claim 8, wherein a degree coherence among the coherent light sheets in the array with respect to each other is adjustable by tuning a mirror separation S, and the array density of the coherent light sheets is configurable by adjusting a mirror misalignment angle α.
12. The light-sheet based microscopy device of claim 8, further comprising a wavefront coding/shaping component configured to increase the field-of-view (FOV) in both axial and lateral dimensions.
13. The light-sheet based microscopy device of claim 8, the at least one lens comprising exactly one objective lens configured to direct the encoded light sheets towards the biological sample.
14. The light-sheet based microscopy device of claim 8, the at least one lens comprising two objective lenses configured to direct the encoded light sheets towards the biological sample.
15. The light-sheet based microscopy device of claim 8, the encoded light sheets being configured to capture multiple structured images simultaneously.
16. The light-sheet based microscopy device of claim 8, the light sheet encoder further comprising a temporal modulator configured to segment the array of coherent light sheets by an arbitrary orthogonal encoding basis including a Hadamard basis or a random mask.
17. The light-sheet based microscopy device of claim 1, the at least one lens comprising exactly one objective lens configured to direct the encoded light sheets towards the biological sample.
18. The light-sheet based microscopy device of claim 1, the at least one lens comprising two objective lenses configured to direct the encoded light sheets towards the biological sample.
19. The light-sheet based microscopy device of claim 1, the encoded light sheets being configured to capture multiple structured images simultaneously.
20. The light-sheet based microscopy device of claim 1, the encoder comprising the frequency modulator, and the frequency modulator comprising a spinning reticle.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
DETAILED DISCLOSURE OF THE INVENTION
(24) The following disclosure and exemplary embodiments are presented to enable one of ordinary skill in the art to make and use a fast volumetric imaging device according to the subject invention. Various modifications to the embodiments will be readily apparent to those skilled in the art and the generic principles herein may be applied to other embodiments. Thus, the devices and methods related to the fast volumetric imaging device are not intended to be limited to the embodiments shown, but are to be accorded the widest scope consistent with the principles and features described herein.
(25)
(26) The parallelized discrete light-sheet array illumination also provides another degree of freedom to arbitrarily select any subsets of light sheets. One could implement this user-defined selective plane illumination through a predefined mask included in the relay optics 140 (e.g. a static spatially patterned mask illumination by a scanning light beam or an actively controllable mask using spatial light modulator).
(27)
(28) The inventors harness this unique property that transforms the pulsed laser beam into an ultrafast line-scanning beam using an almost-parallel mirror pair to generate either pulsed or continuous-wave (CW) light-sheet array in which the density and coherency of the light sheets can be flexibly reconfigured by tuning the mirror-pair geometry (e.g., mirror separation S, mirror length L and misaligned angle α) as shown in
(29) As shown in
(30) The light sheets can be generated by relay optics 140 towards a light sheet encoder 150. The encoder 150 includes but not limited to a frequency modulator that segments the array of incoherent light sheets and encodes each light sheet with a respective frequency, or a temporal modulator that segments the array of incoherent light sheets by an arbitrary orthogonal encoding basis including a Hadamard basis or a random mask. In one embodiment, the frequency modulator includes but not limited to a beam encoder, which is in the form of a moving or rotating spatial light modulator (e.g. a frequency modulation reticle), or a static spatially patterned mask illumination by a scanning light beam. The light sheets can be sectioned by the light-sheet encoder 150 and encoded with various frequencies or a fundamental basis. The encoded sheets can then be transmitted through the relay optics 140, which could route and select the sub-set of light-sheets to the imaged samples. The sheets can further be transmitted through a wavefront shaping module 145 which augment the imaging performance in terms of resolution and imaging field of view. The light sheets are then focused by an illumination objective 160 onto the biological or non-biological sample 170. The detection objective 180 is placed orthogonally to the illumination objective (not shown). The detected light can be modified by a point-spread-function (PSF) engineering module 185 which could enhance the imaging depth of field. A tube lens in the detection objective 180 can then transmit the fluorescence signal from the sample 170 to a high-speed 2D image sensor or a camera 190 (including but not limited to, a sCMOS camera or an EMCCD camera).
(31)
(32) A collimated beam is focused by a cylindrical lens CL along a horizontal direction to form a 1D light cone. The light cone passes through a polarizing-beam splitter PBS and a quarter wave-plate λ/4 before being split by the misaligned parallel mirror pair 210. The retro-reflected beam passes through the quarter wave-plate λ/4 and becomes polarized vertically. A lens L further focuses the modulated beam and creates a linear virtual source array near the common focal plane CFP.
(33) The resulting beams are sectioned by a custom-designed light-sheet encoder 150 such that each of these beams are encoded with a respective modulation frequency or a fundamental basis for each virtual source. The light-sheet encoder 150 includes but not limited to a frequency modulator that segments the array of incoherent light sheets and encodes each light sheet with a respective frequency, or a temporal modulator that segments the array of incoherent light sheets by an arbitrary orthogonal encoding basis including a Hadamard basis or a random mask. In one embodiment, the frequency modulator includes but not limited to a beam encoder, which is in the form of moving or rotating spatial light modulator (e.g. a frequency modulation reticle), or a static spatially patterned mask illumination by a scanning light beam. The frequency modulated beams are then relayed by a microscopy system and a cylindrical lens CL (see, for example,
(34) In general, the detection and the illumination paths can share the same objective and the excitation light-sheets can enter the objective at an angle such that the emission path can still be orthogonal to the illumination light sheets. This dual-objective-lens configuration is compatible with the working principles of a fast volumetric imaging device. This configuration also decouples the excitation path from the detection path, providing additional degrees of freedom to manipulate image quality.
(35)
(36) The virtual sources are projected through a relay-lens module to form an array of N light-sheets (Boxes a, c in
(37)
(38) The parallelized discrete light-sheet array illumination also provides another degree of freedom to arbitrarily select any subsets of light sheets. One could implement this user-defined selective plane illumination through a predefined mask (e.g. a static spatially patterned mask illumination by a scanning light beam or an actively controllable mask using spatial light modulator). This could be of particular interest in sparse sampling of neuronal activity recording in brain imaging applications.
(39) Furthermore, the degree of coherence among the light sheets can be flexibly adjusted. While each light sheet itself remains coherent, the incoherency between the light-sheets in the array can be achieved by tuning the mirror separation (S) in such a way that the path-length difference (D) between the virtual sources (i.e., D=2S) is longer than the coherence length of the laser source L.sub.c. The inventor's previous work has demonstrated that the path length separation (temporal delay) between adjacent virtual sources can be reconfigured across several orders of magnitude, i.e., millimeters (picoseconds) to meters (nanoseconds). Such controllable incoherency minimizes image artifact and speckle generation, especially in scattered medium.
(40)
(41) In one embodiment, a laser source (center wavelength of 710 nm; L.sub.c˜0.5 mm) and a mirror pair separation of S˜20 mm are employed. This configuration demonstrates uniform intensity profile across the entire light sheet array, as seen in (a),
(42) In another embodiment, the incoherency was further validated in the configuration (L.sub.c˜4.2 mm, and S˜50 mm), which shows a speckle-free light-sheet array illumination distribution through a scattered gel medium. This is in clear contrast to the case of wide-field coherent illumination to the same region, expanded from a single coherent Gaussian laser beam, resulting in the highly speckled patterns as shown in
(43) In contrast to conventional LSFM devices, the fast volumetric imaging device removes the need for beam, objective, specimen scanning, and reduces the physical strain on the samples/system.
(44) The fast volumetric imaging device implements a pair of highly reflective mirrors (R>99%) to create mutually incoherent virtual sources, each of which produces a light sheet. The produced light beams of a light sheet are mutually incoherent with each other. The mutual incoherence makes it possible to image minute structures, even when the structures are embedded in tissues that induce strong scattering effects; and with minimal crosstalk between light beams. The two reflective mirrors split the beam into a series of virtual sources, which are then converted to a light sheet array. In contrast to conventional light sheet microscopy devices, this device does not require scanning optics for illuminating the biological sample in 3D, and thus this device provides higher and longer-term mechanical stability.
(45) The fast volumetric imaging device temporally modulates each light sheet to encode each sheet with a respective frequency. A series of relay optics are used to conjugate the light sheets to a custom modulation mask that provides a series of modulation frequencies. This process encodes each light sheet with a respective modulated frequency.
(46) The fluorescence signal from the biological sample can be demultiplexed off-line. The fluorescence signal can be flexibly manipulated by a time-multiplexing, a frequency-multiplexing scheme, a random basis, or a Hadamard transform scheme to enable high-speed image acquisition. This feature is uniquely leveraged by temporal modulation, which is not found in existing commercial frequency chopper systems.
(47) Another feature of the fast volumetric imaging device is 3D multiplexing, based on either FDM or CDM, as seen in
(48) For CDM, the codes, m.sub.k (t), assigned to each 2D plane can be Walsh Hadamard (WH) codes (or error correcting orthogonal codes, or pseudo-random noise (PN) sequences that are deterministic binary sequences appearing to be random noises). Multiplexing based on both types of codes (i.e., spread-spectrum modulation) are resistant to noise and favorable for high signal fidelity in a communication system.
(49) The fast volumetric imaging device can also be used for 3D volumetric fluorescence light sheet imaging for inspection in biomedical and clinical applications (e.g., developmental biology, cell biology, high-volume manufacturing inspection, industrial applications for high-throughput volumetric quality control, and very-large scale integration (VLSI) semiconductor devices).
(50) A conventional confocal microscopy device illuminates a biological sample with a focused beam with a power density on the order of tens of MW/cm.sup.2. The fast volumetric imaging device has a power density about 6 orders of magnitude smaller than a conventional device. The reduced power density reduces photo-bleaching and cytotoxicity associated with the exogenous fluorescent labels; and reduces photo-damage to a biological sample. Conventional microscopy techniques, (e.g., wide-field, and confocal), also introduce more radiation to the biological sample than the fast volumetric imaging device. The device produces less radiation by only illuminating the imaging plane on the biological sample, which minimizes photo-damage and photo-toxicity.
(51) The fast volumetric imaging device can realize high-speed volumetric imaging without scanning the light sheets due to variable frequency modulation of each light sheet. The temporal modulation of the volumetric fluorescence signal permits the signal to be demultiplexed in the frequency domain. The virtual light sources can be imaged onto a variable frequency modulator controlled by a lock-in drive. The temporally modulated light beams can then be converted to individual light sheets under a microscope objective to illuminate the biological specimen.
(52) Parallelized volumetric detection in CLAM is accomplished by multiplexed light-sheet encoding. This can be implemented by intensity modulation of the light-sheet array projected onto a spatial modulation mask, which could be a spinning patterned reticle/mask, or static patterned mask with a scanning beam; or an actively reconfigurable patterned mask, e.g. a spatial light modulator (SLM) with a scanning line-beam, as seen in
(53) Accordingly, the fluorescence signal from the k-th section I.sub.em(x,y,z−z.sub.0k) is intensity-modulated with a unique temporal code m.sub.k(t)(box c in
(54)
(55) The image, with minimal cross-talk among planes, can faithfully be recovered when the orthogonality of the codes is satisfied. The coding can be, but not limited to frequency-division multiplexing (FDM) and coded-division multiplexing (CDM). The signal is encoded with a unique carrier frequency in FDM whereas a pseudo-random code sequence in CDM. In CDM, the code m.sub.k (t) assigned to each 2D plane can be the Walsh Hadamard (WH) codes, which are error correcting orthogonal codes; or the pseudo-random noise (PN) sequences, which are deterministic binary sequences appearing to be random noises.
(56) Inspired by the orthogonal frequency division multiplexing (OFDM) in wireless communication networks, one embodiment can modulate the light sheets with m.sub.k(t)=cos(ω.sub.k t), where ω.sub.k is the depth-dependent modulation frequency of the k-th light sheet. The frequency carriers satisfy the orthogonality property over a period T, i.e., <m.sub.i(t), m.sub.j(t)>=δ.sub.ij, where δ.sub.ij is a delta function, and <*> refers to the inner product. Therefore, 2D sections at different depths are tagged with distinguishable modulation frequencies and are multiplexed into a single 2D frame sequence registered on the image sensor (
(57)
(58) where Ĩ.sub.cam(x,y,ω) denote the temporal Fourier transforms of I.sub.cam(x,y,t). In contrast to the existing frequency-multiplexed imaging approaches, CLAM multiplexes 2D image stacks to enable parallelized 3D imaging by frequency-chirped intensity modulation across the light-sheet array.
(59) The design rationale of the reticle pattern is generally guided by two key specifications that critically determine the CLAM performance. First, the modulation frequency separation between adjacent light-sheets (Δf) defines the volumetric imaging rate (f.sub.vol), i.e., f.sub.vol=Δf. Furthermore, in order to ensure the best achievable axial resolution, Δf should also be chosen such that the associated spatial separation between encoded frequency channel (i.e., Δd=βΔf, where β is the calibrated conversion factor between depth and frequency), is kept equivalent or smaller than the thickness of each light sheet (w.sub.LS), i.e., Δd<w.sub.LS. Second, governed by both the Nyquist sampling criterion and the camera frame rate, the total modulation frequency range (BW) allowed to encode all light-sheets determines the number of light sheets (i.e., N). Following the Nyquist criterion, the upper limit of the modulation frequency (f.sub.H) should be lower than half of the camera frame rate (f.sub.cam), i.e., f.sub.H<f.sub.cam/2. (At fast mode, set at f.sub.H˜1400 Hz<f.sub.cam/2). On the other hand, the lower limit of the modulation frequency (f.sub.L) should stay above half of the upper frequency limit, i.e., f.sub.L>f.sub.H/2, in order to eliminate cross-talk from the high-order harmonic oscillation. For a given frequency bandwidth, i.e., BW=f.sub.H−f.sub.L (set by the design of the reticle and spinning speed), the number of frequency “channels”, or equivalently the number of light sheets (N) that can be allocated is N=BW/δf=BW/f.sub.vol. Hence, CLAM could faithfully generate N˜20-70 light sheets to achieve a 3D imaging rate of f.sub.vol=1˜20 vol/sec. While such volume rate is comparable to the state-of-the-art scanning-based LSFM platforms and matches the speed required in many biological imaging applications, the multiplexing nature in CLAM further improves the sensitivity as all the voxels in the volume are read out in parallel (i.e., 100% spatial duty cycle)—increasing the effective voxel dwell time by the factor of multiplexing numbers (N), without compromising the volume rate. Given this improvement, CLAM also reduces the illumination power and thus photobleaching and phototoxicity. The inventors note that given a shot-noise limited condition, this sensitivity improvement in principle scales with sparsity of the fluorescent sample because multiplexing inherently distributes the shot noise across all the 2D stacks.
(60) In one embodiment based on FDM encoding scheme, by applying short-time Fourier transform on the temporal signal pixel-by-pixel, a frequency-depth map from the CLAM system is generated, which shows a clear linear relationship (R.sup.2=0.995, a slope of β=0.23 μm/Hz) between the encoded depth and the modulation frequency (N=40), as seen in
(61) Embodiments of the subject invention can be used to produce a volumetric imaging video of the biological sample without mechanical/electrical scanning. Compared with existing light sheet microscopy techniques that scan either the illumination light sheet or the sample stage, the herein described techniques minimize the effect of stage drift and photo-damage. The non-scanning coded light sheet microscopy of the subject device can capture a volumetric image video of a fluorescent sphere in the microfluidic flow at a flow rate of approximately 16 μm/sec. The captured volumetric frame rate can be as high as 25 vol/sec. The volumetric flow rate can be further increased with a higher camera speed. This makes the techniques faster than conventional scanning techniques or structured beam light sheet microscopy. The techniques minimize the use of expensive and complex beam control devices, such as a spatial light modulator, an acousto-optic deflector, and a piezo-stage. Therefore a volumetric image can be produced without additional complex control mechanisms and so the beam distortion can be minimized.
(62) In one embodiment, CLAM can be implemented in either dual-objective-lens or single-objective-lens approach. In the dual-objective-lens configuration, two separate objective lenses, which are orthogonal to each other, are used for illumination and fluorescence detection, respectively. Based upon this scheme, simultaneous multi-view CLAM can also be implemented by delivering the light sheet array from multiple direction—an effective strategy proven to improve the image quality in the presence of light scattering and resolution isotropy; In a single-objective-lens configuration, the same objective lens generates oblique light-sheet array illumination and collect the fluorescence signals, as seen in
(63)
(64) In one embodiment, one can harness the spherical aberration to extend the depth-of-field (DOF). This is essentially the step of PSF engineering, through the wavefront coding (WFC) 145 shown in
(65) In another embodiment, the lateral FOV can be extended by adopting wavefront shaping (See wavefront shaping 145 in
(66) Another feature of the fast volumetric imaging device is the ability to perform digital structured illumination along the axial direction (i.e., improving the resolution isotropy). Using FDM techniques, the frequency-encoded nature of each 2D plane can be leveraged to digitally select a subset of the 3D stack (using the light-sheet encoder 150 or another predefined mask included in the relay optics 140 shown in
(67) The axial modulation period should be slightly smaller or equal to the theoretical resolution limit in order to gain higher resolution. The multiple structured images can be obtained simultaneously instead of sequentially as in typical SIM because the frame rate is not compromised for higher resolution. If desired, the fast volumetric imaging device can be modified to work in SIM-mode to perform resolution isotropy.
(68)
(69) The invention is applicable to multi-color fluorescence imaging which can be realized by using multiple laser (pulsed and continuous wave (CW)) wavelengths, including but not limited to the wavelength range from ultraviolet to near infrared (depending on the excitation spectra of the fluorophores) and one or more 2D image sensors for image detection. The light at different wavelengths can be combined by dichroic filter or an acousto-optic tunable filter (AOTF), and can be delivered to the mirror pair using the same optics. CLAM is also applicable to multiphoton imaging, where the excitation light is short-pulsed laser (typically femtoseconds). This includes, but not limited to two-photon, and three-photon fluorescence volumetric light sheet microscopy.
(70) CLAM can also perform digital structured illumination along the axial direction—improving the resolution isotropy. In one embodiment, based on FDM as an example, one can leverage the frequency-encoded nature of each 2D plane and digitally select a subset of the 3D stack to form an axially-modulated 3D image (e.g. taking every other two planes and form a 3D image with a periodic stripe-pattern along the axial dimension, as shown in
Exemplified Embodiments
(71) The collimated beam from a diode-pumped solid-state laser (CW, wavelength, 532 nm, power, 400 mW) was line-focused by cylindrical lens (f.sub.CL=200 mm) into the angle-misaligned mirror pair (Reflectivity R>99%; separation S=50 mm; length L=200 mm) at the entrance O. The beam breaks into a discrete set of (spatially-chirped) zig-zag paths governed by their incident angles. The number of beamlets N was mainly controlled by the misalignment angle, the light cone angle and a variable slit (N was chosen to range from 30 to 70). This beam was collected by a lens (f=200 mm) and relayed through a telescope T2 (2× magnification) onto the spinning reticle (i.e., the light-sheet-array encoder based on OFDM), followed by another telescope T3 (¼ magnification) to match the FOV. All the virtual sources are imaged on the planes in the proximity of the common focal plane (CFP) of L and T2. This configuration essentially ensures that all the virtual sources are imaged within the DOF of the illumination objectives (
(72)
where ω=2πr is the radius-dependent modulation frequency, and sgn( ) is the sign function (
(73) Without complex computation, the image reconstruction is simply based on pixel-by-pixel short-time Fourier transform of the frequency-multiplexed data followed by standard Richardson-Lucy deconvolution. The 3D point spread function (PSF) of CLAM was evaluated by imaging the fluorescent beads (diameter=100 nm) dispersed on a tilted cover slide. The measured transverse resolution (˜1.2 μm, full width at half-maximum (FWHM)) is close to diffraction limit (NA=0.25) whereas the axial resolution (˜2.7 μm), as seem in
(74) CLAM demonstrates a penetration depth range up to 300 μm, within which the image quality is generally preserved. To verify, fluorescent microbeads (diameter, 1 μm) embedded in a tissue-mimicking phantom were imaged. The fluorescence profiles of the microbeads are consistent for depth up to 300 μm without severe distortion (
(75) The methods and processes described herein can be embodied as code and/or data. The software code and data described herein can be stored on one or more machine-readable media (e.g., computer-readable media), which may include any device or medium that can store code and/or data for use by a computer system. When a computer system and/or processer reads and executes the code and/or data stored on a computer-readable medium, the computer system and/or processer performs the methods and processes embodied as data structures and code stored within the computer-readable storage medium.
(76) It should be appreciated by those skilled in the art that computer-readable media include removable and non-removable structures/devices that can be used for storage of information, such as computer-readable instructions, data structures, program modules, and other data used by a computing system/environment. A computer-readable medium includes, but is not limited to, volatile memory such as random access memories (RAM, DRAM, SRAM); and non-volatile memory such as flash memory, various read-only-memories (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic/ferroelectric memories (MRAM, FeRAM), and magnetic and optical storage devices (hard drives, magnetic tape, CDs, DVDs); network devices; or other media now known or later developed that are capable of storing computer-readable information/data. Computer-readable media should not be construed or interpreted to include any propagating signals. A computer-readable medium of the subject invention can be, for example, a compact disc (CD), digital video disc (DVD), flash memory device, volatile memory, or a hard disk drive (HDD), such as an external HDD or the HDD of a computing device, though embodiments are not limited thereto. A computing device can be, for example, a laptop computer, desktop computer, server, cell phone, or tablet, though embodiments are not limited thereto.
(77) A greater understanding of the present invention and of its many advantages may be had from the following examples, given by way of illustration. The following examples are illustrative of some of the methods, applications, embodiments and variants of the present invention. They are, of course, not to be considered as limiting the invention. Numerous changes and modifications can be made with respect to the invention.
EXAMPLE 1
(78) The fast volumetric imaging device can capture continuous video of dynamic processes occurring in a biological sample. To demonstrate this, 1 μm diameter fluorescent polymer beads were supplied to water and injected by a syringe pump into a square glass pipette. An illumination and a detection objective were positioned orthogonally to the neighboring sides of the glass pipette. This configuration permits the detection objective to capture the dynamic motion of the fluorescent polymer beads in a microfluidic flow.
EXAMPLE 2
(79) The fast volumetric imaging device was used to image the blood vasculature in mouse intestine and the glomeruli in a mouse's kidney. The intestine and the kidney tissues were cleared in an OPTIClear solution for better optical transparency and labeled on the endothelia cell membrane with a DiI (DiIC.sub.18) dye.
EXAMPLE 3
(80) The fast volumetric imaging device can be configured to incorporate extended depth-of-focus (DOF) with wavefront coding (WFC). A predefined phase mask can be placed in the detection path such that it engineers the point spread function (psf) of the system to be less depth-variant. A WFC scheme based on a cubic phase mask (CPM) can be used during deconvolution to achieve an extended DOF in the fast volumetric imaging device. The CPM phase function can be described as φ (u,v)=r (u.sup.3+v.sup.3), where u and v are the spatial frequency coordinates, and r is the free optimizing parameter. The CPM was placed at the back focal plane of the detection objective lens (20×, NA=0.4). The PSF is nearly invariant across the depth >50 μm. This shows a clear extended DOF effect compared to the PSF without CPM (only having a DOF of ˜5 μm). The CPM only modulates the phase and therefore no loss is introduced. The psf simulation study shows the depth invariance (more than 50 μm) of the psf when the CPM is added (see, for example,
(81) To evaluate of the performance of the fast volumetric imaging device, 3 image planes located at different axial positions (Zp=−25, 0, & +25 μm) were simulated. Each position was temporally modulated at 400, 500, & 600 Hz, respectively. The images were sampled at 2 kHz and the 3D frame rate was set as 4 Hz. Image blur and photon noise were also added. Taking the sum of all the 3 image planes at every sample time point, a sequence of 500 multiplexed images with the CPM included were obtained. Demultiplexing the 3 image planes was done by taking the Fourier transform to the image sequence in time. A Richardson-Lucy deconvolution was used with total variation (TV) regularization algorithm (100 iterations, and TV=0.001) to restore the 3 images. The restored images preserved all the major original features and blurring was suppressed.
(82) By using either demultiplexing concept shown in
EXAMPLE 4
(83) The inventor further evaluated the imaging speed of CLAM by imaging the flowing fluorescent beads supplied by a microfluidic pump into a fluidic channel (square glass pipette, inner side length 1 mm). As a proof-of-concept experiment, the CLAM system, configured within the frequency range (BW) from 1100˜1400 Hz and a total N=24 light sheets, is able to capture the microspheres in flow (flow rate of ˜20 μm/s) at the volumetric rate f.sub.vol up to 13 vol/sec, as seen in
EXAMPLE 5
(84) Tissue clearing renders large biological sample, e.g., whole organism, transparent by homogenizing the refractive index through replacing, removing, modifying part of the components without altering its anatomical structure. This allows the analyze of the tissue structure under light microscopy with minimum light scattering, and thus image degradation. CLAM provides an advanced tool for 3D visualization of the tissue structures combined with tissue clearing. Here, a recent method, called OPTIClear, is employ to render the tissue transparent, because of its detergent- and denaturant-free nature with minimal structural and molecular alteration, and use CLAM to image the OPTIClear-treated mouse tissues (ileum and kidneys) perfused with a lipophilic carbocyanine dye (DiI). The specimen was immersed in the medium (n=1.47) in order to achieve spherical-aberration-assisted extended DOF.
(85) The inventor demonstrates that, tubular epithelial structures, as seen in
(86) In
(87) It should be understood that the examples and embodiments described herein are for illustrative purposes only and that various modifications or changes in light thereof will be suggested to persons skilled in the art and are to be included within the spirit and purview of this application.
(88) All patents, patent applications, provisional applications, and publications referred to or cited herein are incorporated by reference in their entirety, including all figures and tables, to the extent they are not inconsistent with the explicit teachings of this specification.