COLLAPSIBLE IMAGING SYSTEM HAVING LENSLET ARRAYS FOR ABERRATION CORRECTION
20170269340 · 2017-09-21
Inventors
Cpc classification
G02B3/0056
PHYSICS
H04N23/55
ELECTRICITY
International classification
G02B13/00
PHYSICS
Abstract
A collapsible imaging system having a compound lens and a lenslet array, which is coupled with an image sensor. The collapsible imaging system can be transitioned between the imaging and storage modes by moving compound lens elements along the optical axis and off the optical axis of the system. In the storage mode, the compound lens elements are tightly packed in a flat volume.
Claims
1. A collapsible imaging system comprising: a plurality of lens elements, an optical axis, an optical image sensor and a lenslet array; wherein the lenslet array formed of multiple single lenslets, and the lenslet array positioned in a proximity to the optical image sensor, and wherein the collapsible imaging system having an imaging mode and a storage mode, wherein the imaging mode has the plurality of lens elements arranged along the optical axis, and the storage mode has the plurality of lens elements arranged within a flat volume.
2. The collapsible imaging system of claim 1, wherein the plurality of lens elements is transitioned between the imaging mode and the storage mode using translation or rotation movements, the movements performed along the optical axis or off the optical axis.
3. The collapsible imaging system of claim 1, wherein a focusing power of the lenslets within the lenslet array is different from each other.
4. The collapsible imaging system of claim 3, wherein the focusing power of each of the lenslet within the lenslet array is a function of the distance from this lenslet to a center of the lenslet array, wherein the center of the lenslet array is a crossing of the optical axis and the lenslet array.
5. The collapsible imaging system of claim 4, wherein the function is characterized by a gradient change of the focusing power, wherein the focusing power has a larger value at the center of the lenslet array.
6. The collapsible imaging system of claim 1, wherein the each lenslet has an arbitrary surface shape and an arbitrary shape of edges.
7. The collapsible imaging system of claim 1, wherein the surface area of each lenslets has refractive, diffractive or both refractive and diffractive properties.
8. The collapsible imaging system of claim 1, wherein the surface area of each lenslets being in order of about 0.5-5 square millimeters.
9. The collapsible imaging system of claim 1, wherein the lenslets within the lenslet array having an aperture of not more than 1 square millimeter.
10. The collapsible imaging system of claim 1, wherein surfaces of the neighboring lenslets are smoothly connected without abrupt edges.
11. The collapsible imaging system of claim 1, wherein the lenslet array is composed of a multiple number of smaller lenslet arrays.
12. The collapsible imaging system of claim 1, wherein the image sensor is composed of a multiple number of smaller image sensors, the smaller image sensors having adjacent boundaries between each other.
13. The collapsible imaging system of claim 12, wherein the lenslets having the gradient change of the focusing power to steer the incident light out of the adjacent boundaries between the smaller image sensors.
14. The collapsible imaging system of claim 1, further comprising a digital filter, wherein the digital filter being predesigned for the imaging system in order to compensate for specific aberrations caused by the imaging system.
15. The collapsible imaging system of claim 14, wherein the digital filter uses an artificial neural network.
16. The collapsible imaging system of claim 1, wherein the plurality of lens elements form a Cooke triplet.
17. A chromatic aberration correction method of executing a correction of chromatic aberration for an image, comprising operating a collapsible imaging system, wherein the collapsible imaging system comprising: a plurality of lens elements, an optical axis, an optical image sensor and a lenslet array; wherein the lenslet array formed of multiple single lenslets, and the lenslet array positioned in a proximity to the optical image sensor, and wherein the collapsible imaging system having an imaging mode and a storage mode, wherein the imaging mode has the plurality of lens elements arranged along the optical axis, and the storage mode has the plurality of lens elements arranged within a flat volume.
18. The chromatic aberration correction method of claim 17, wherein the plurality of lens elements of the collapsible imaging system is transitioned between the imaging mode and the storage mode using translation or rotation movements, and the movements performed along the optical axis or off the optical axis.
19. The chromatic aberration correction method of claim 17, wherein the collapsible imaging system has a focusing power of the lenslets within the said lenslet array is different from each other.
20. The chromatic aberration correction method of claim 17, wherein the collapsible imaging system has the focusing power of the each lenslet within the lenslet array is a function of the distance from this lenslet to a center of this lenslet array, and wherein the center of the lenslet array is a crossing of the said optical axis and the lenslet array.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
[0041] Throughout this disclosure, reference is made to some terms which may or may not be exactly defined in popular dictionaries as they are defined here. To provide a more precise disclosure, the following term definitions are presented to clarify the embodiment of invention. Although every attempt is made to be precise and thorough, it is a necessary condition that not all meanings associated with each term can be completely set forth. Accordingly, each term is intended to also include its common meaning which may be derived from general usage within the pertinent arts or by dictionary meaning.
[0042] For purposes of this disclosure, a ‘lenslet’ is defined as a microlens, being an element of a lenslet arrays or micro lens array. Such lenslet arrays have been used in a variety of compound optical elements and systems due to their unique opto-mechanical characteristics, such as advanced microlithography-based manufacturing technology. Furthermore, spatial variance of lenslet within an array can be designed and controlled, hence providing different optical characteristics at different areas of the array.
[0043] For purposes of this disclosure a ‘lens array’ and/or a ‘microlens arrays’ are optical systems having a two-dimensional distribution of discrete lens elements over a surface of a substrate. Both refractive and diffractive microlens lens arrays can be formed (e.g. carved out, glued, spattered, etc.) at the a surface of optical material with predesigned optical power distribution with regard to incident wavefronts.
[0044] For purposes of this disclosure, a ‘substrate’ or ‘frame’ element is a mechanical structure provided to receive and hold therein an optical lens. The substrate or frame having a mechanical relationship with cooperating coupled frames whereby they operate together to switch between an imaging mode and a storage mode.
[0045] The current disclosure describes the alternative aberration correction method of the image taken by disclosed collapsible systems, where the image correction means are specifically adjusted to compensate for imperfect mechanical lens alignment or placement errors of the optical system. The disclosed opto-mechanical systems have collapsible compound lens located either in imaging mode or in a storage mode, while the storage mode enables very thin configuration of the compound lens optical system.
[0046] Specifically, for the preferred embodiment of the invention, a lens array is located in a close proximity to the image detector. The lens array is comprised of a plurality of lenslet elements distributed over a surface area substantially normal with respect to the system optical axis. These lens arrays have lenslet elements which may have either a refractive or diffractive effect on the incident wave-fronts. Such lens arrays are substantially different in comparison to similar lens array devices used previously in other imaging system due to their different wave-front transformation. Thus, the wave-front transformation is specifically designed to counteract imaging effects related to the lens placement variations and the resulting specific aberrations.
[0047] The disclosed collapsible systems generate certain types of imaging errors (to the captured image) that caused by the lens placement variance. These errors (i.e. aberrations due to imperfect lens alignment) can be characterized, measured and subsequently corrected by the disclosed lenslet design.
[0048] Taking into account the pre-determined aberrations, which are generally caused by a mechanical collapsing lens mount, the lenslet design is substantially different from the previous art related to the image lens arrays.
[0049] For example, in the prior art, the lens arrays were used for improving the light concentration towards the discrete detecting bins, away from the detecting “dead zones” (increasing so-called “fill factor” of the detector). While such arrangements can be useful, they have never been applied to compensate aberration caused by the lens misalignment in collapsible systems.
[0050] An innovative optical system proposed and presented here to facilitate collapsing or folding a camera lens module into a thin planar space, while providing state-of-the-art image resolution.
[0051] For the purpose of the disclosed invention, a so-called multi-scale optics design may be employed, where the optical system is constructed from two parts, including: a ‘collector’ lens group, and a layer of lenslets, (the lenslet arrays or micro lens arrays). This collector group of lenses defines general nature of imaging and sets the optical system parameters like an aperture F# and a focal length. While typical high imaging systems having compound lenses made of about 5-15 elements, for the preferred embodiment of the invention, the lightweight and space conserving collector is proposed. For example, a Cooke triplet arrangement of three lens singlets can form the basis of the collector for the preferred embodiment of the invention.
[0052] Other options may include a doublet system to be used as a collector with arrangement of two discrete integrated lenses paced in contact or close proximity. Such systems may be mounted in a single mechanical frame. Because the nature of a doublet prescribes that there be little or no space between the two elements, there is no or little advantage in collapsing the doublet. Therefore, some arrangements of these collapsible lens mounts have two lenses of a doublet affixed within a single frame element. Thus, compound lenses which are most suitable for the preferred embodiment of the collapsible have about 3-5 lens elements.
[0053] While such simplified compound lenses can, technically, produce more aberrations than their more sophisticated alternatives (with a greater number of lens elements), they do, nevertheless, offer far greater potential for applications with folding and/or collapsible physical mechanisms used to transition between an imaging mode and storage mode. Indeed, where a compound lens has too many lens elements, the mechanism which could achieve a desirable collapsing action tends to be overly complex and prohibitively difficult to manufacture. Too many substrate elements of a folding mechanism impair the ability to operate in a smooth and efficient manner. Furthermore, for the compound lenses of multiple discrete components, the lens positions and orientations of each component must be maintained with a very high precision, essentially, precluding such arrangements from being used in foldable and collapsible camera modules described herein.
[0054] The aberrations can result from mechanical misalignments that especially pronounced in high performance compound lenses with multiple elements. In the proposed schemes, however, the collector lenses are simplified to include fewer elements and high precision positioning (which is virtually impossible with folding mechanics) is not required. The primary function of the second part or the lens array portion of the optical system is to compensate for optical aberrations that are inevitably created within the simplistic collector part.
[0055] A described lens array when carefully used in conjunction with image detectors improves the fill-factor by reducing the inactive portion of a detector surface (the “dead zone”). Such use of lens arrays is well-known by experts in digital imaging. However, the use lens arrays in combination with the collector portion of a compound lens to mitigate aberrations have not been disclosed so far.
[0056] Since the compound lens can be well defined in advance, its respective aberrations can be reduced by application of correction with radial distribution.
[0057] The unique feature of the lens array, is that the individual small lenses distributed over a surface area, can each have a focusing power independent of its neighbor. This feature can be used in connection with the expected imaging error produced by the simplified compound lens, such as, for example, a Cooke triplet.
[0058] In the prior art, the lens arrays with a pixelized detector is merely used to collect light and direct the light to a prescribed bin or light sensitive area. The focus power of each lens is typically identical for all lens array elements regardless their distance from the system optical axis.
[0059] In the current disclosure, however, since the aberrations produced by any particular collector portion of these systems are well known in advance, a lens array can be fine-tuned to operate on the wave front just prior to the imaging plane to ‘undo’ some aberrations caused by the collector.
[0060] The thin lens array in combination with the imaging detector is further suitable for use with folding and collapsing systems described. Such novel use of lens arrays at the proximity if the collapsible lens system imaging plane can produce a very high performance system with additional advantages in terms of light weight and small size. Furthermore, thin lens array in combination with the imaging detect are well suited for collapsible systems that transition compound lens components between the described imaging and storage modes.
[0061] Such disclosed collapsible systems include a lens array and imaging detector combination that can be mounted in a single mechanical frame of the optical system. The lens array and imaging detector (sensor) could be rigidly affixed (e.g. fastened or affixed with adhesives) to each other to form a single (preferably thin) element of the collapsible system. The collapsible system can be adopted to accommodate such combination of image detector and lens array.
[0062] The preferred embodiment of the invention includes sliding or folding means provided for the collector lens elements from which a compound lens may be formed. However, it is possible to arrange elements into subgroups whereby more than one lens or other component of optical system (i.e. filter, lens array, corrector plate, etc.) can be included into the folding/sliding element of the system systems and these subgroups of elements are moved together as a single unit.
[0063] In the preferred embodiment of the invention, lenslets are organized into a hexagonal (“honeycomb”) array to maximize the effective aperture, or area affecting the imaging wave-front rays from which the useful image is formed. While similar hexagonal configuration have been used before (e.g. to improve the fill-factor), such systems haven't been designed specifically to match lenslet array pattern and detector's dot pitch. (Dot pitch is a specification for a pixel-based device that describes the distance between dots, e.g. pixels or sub-pixels).
[0064] In the disclosed invention, the purpose of the lens arrays is not to improve the fill-factor, but rather to reduce aberrations, providing more options for the lenslet arrays geometry and design.
[0065] In some embodiments, the lenslets may be quite large with respect to the detector pixel elements. Because the lenslet is designed to modify the wave-front with respect to image aberrations, its physical nature dependent upon the optical design of the collector, rather than the structure present in the detector device. In some optimal versions, each lenslet has a ‘free-form’ refracting surface, possibly being not symmetric relatively to the optical axis. In other words, generally, the refracting surface of each lenslet may be asymmetrical. In one possible embodiment of the invention, only a single lenslet surface is curved, while other lenslet surface is flat. These kind of lens arrays could simplify manufacturing of the device, while, nevertheless, provide the desirable aberration corrections.
[0066] It is also possible to use lens arrays where both surfaces are free-form. In this case, there are even more degrees of freedom in the lenslet shape, which allows correcting aberrations even better.
[0067]
[0068] Similarly, in the present inventions, the Cooke triplet-based compound lens operates in combination with other corrective means. The ray trace diagram of
[0069] Accordingly, when an imperfect lens is used with a planar image detector, some defocusing (i.e. spreading of the focus point) is observed. In simplest models, the further focus point moves from the optic axis, the larger such spreading of the focus point would be. Thus, the point spreading at photodetector PS1 is larger than the point spreading at PS2 (shown in the
[0070] The point spread-function depends on (radial) distance from the system axis. Thus, for the best focusing, the planar image wave-front should be moved slightly towards the lens in order to minimize the spreading point both in the center and at the periphery of the image.
[0071]
[0072] Such lens array 22 is comprised of a many individual lens elements 23 and can be realized on a thin substrate of the optical material. In the preferred embodiment of the invention, the lens array 22 is placed at the distance from 0.5 millimeters for up to several millimeters from the image field plane 24, where optical rays come to a sharp focus.
[0073] Each of the individual lenses 23 can have its own focus power or strength. Accordingly, it is possible to define (e.g. pre-calculate or design) a radial function that describes the parameters (e.g. optical power/strength) of the lenses 23 within the array 22 as a function of the distance from the optical axis 21. Specifically, in the preferred embodiment of the invention, such function is designed to compensate for the compound lens aberrations. Specifically, the lenses 23 of the lens array 22 that are near the center (axis) have a stronger focus, causing the focus point 27 to be moved toward the left in the
[0074] For the preferred embodiment of invention, it is desirable to avoid negative focus power on individual lenses 23 of a lens array 22. Accordingly, a configuration is preferred whereby the lens array 22 operates most strongly on the rays near the axis 21 of the optical system and with gradually decreasing power of lenses 23, when the (radial) distance from the axis 21 increases. While an opposite effect (e.g. function with negative focus power distribution, lengthening the focus in the
[0075] Since the conventional optical lenses are bulky and cannot be integrated into a mobile smart phone package, the after-market manufacturers have designed extension lenses to be coupled into smartphone cameras via ‘clip-on’ means.
[0076]
[0077] Another prior art alternative solution (for example, the U.S. Pat. No. 5,636,062 to Okuyama et al. and U.S. Pat. No. 5,715,482 to Wakabayashi et al.) is based on a barrel lens that capable to collapse along its axis to utilize (remove) the space between the individual elements of a compound lens in a ‘telescopic’ fashion. As such, a compound lens can only be collapsed to a thickness which is the sum of all thicknesses of its constituent parts—and no less. Thus, a barrel lens still has significant thickness even in its collapsed or storage mode. This thickness generally is too large to be used in compact devices such as smartphones.
[0078] The current disclosure introduces a collapsible lens mounts to accommodate a plurality of lens elements from which a high performance compound lens may be formed. Rather than collapsing on axis, these specialized systems may collapse down into a very thin space or planar volume into which all the lens elements may be positioned in a storage mode. Since the thickness system in its storage mode is approximately only as thick as the thickest single element, a considerable advantage is realized. Compound lens systems of this nature may be integrated into very small packages—for example those associated with very portable systems such as a smartphone.
[0079]
[0080] In the preferred embodiment of the invention, the user can apply a tactile force to the outermost ring, in order to transition the system from aforementioned collapsed storage mode into an active imaging mode. By careful selection of lens singlets and prescribed spacing between these frames in their imaging mode, it is possible to realize preferred compound lenses such as the Cooke triplet arrangement shown in
[0081]
[0082] In connection to
[0083] In the preferred embodiment of the invention, the system has a translational motion (not necessary along the optical axis) with two endpoints or terminal ends. When fully translated in a first direction (expanded), the device is in an imaging mode with compound lens elements aligned along the optic axis. When fully translated (compressed) in an opposing direction to a second endpoint, the frames collapse into themselves, thereby moving the lens elements into a tight thin volume to form a storage mode.
[0084] Accordingly, a collapsible compound lens can be formed in this manner and may be integrated with imagers (optical sensors) with very limited space and strict weight limitations.
[0085] While some prior art telescopically collapsible barrel lens systems provide excellent portability for point and shoot camera systems, they remain far too thick and bulky in comparison with the disclosed system. The main distinctive feature of the preferred embodiment of the invention is that lens elements can be distributed off axis in a storage (i.e. collapsed). This allows a far thinner storage mode compare to the conventional telescopic systems.
[0086] Because the small thickness of a resting device in the storage mode (in some cases close to 10 millimeters, for example), the disclosed system becomes compact and well-suited for integration, providing a great imaging solution (i.e. for cell-phones, etc.).
[0087] While the rotating system illustrated in
[0088] For example, one alternative embodiment of the invention includes a ‘flip’ system arrangement with lever arms and pivots. This arrangement may be characterized as a linear translation system, which moves all lens elements along a single line orthogonal to the imaging axis as illustrated in the
[0089] An optical axis 51 of such linear ‘flip’ type system provides a structure upon which a compound lens of multiple lens elements may be arranged. With the reference to the
[0090] The advantages of system explained in
[0091] Accordingly,
[0092]
[0093] The preferred embodiment of the invention shown in
[0094] In the alternative embodiment of the invention, the lenslet devices may not in fact be axially symmetric. Since lenslets within array are not used for conventional imaging, they can be formed without axial symmetry, unlike to typical imaging lens. For example, some lithographic process techniques allow modification shape and size of the lenslets during manufacturing, including asymmetric lenslet designs.
[0095] The lenslets within the lenslet array can have a polygon or, in general, arbitrary shape.
[0096] In a more general embodiment of the invention, the surface area of each lenslets has different refractive, diffractive characteristic or its (refractive and diffractive) combination. In an alternative embodiment of the invention, the lenslet array can be compound, i.e. composed of a multiple number of smaller lenslet arrays.
[0097] The imaging detector (image sensor) can also be composed of multiple detectors (i.e. any number of smaller single imaging sensors).
[0098] In conventional imaging systems, such ‘dead zones’ will be translated into the missing imaging data (missing pixels) of the image detected by the optical system. In one embodiment of the disclosed invention, however, such ‘dead zones’ can be effectively eliminated by using a respective lenslet configurations within the lenslet array, as is schematically shown in
[0099]
[0100] In addition to using special purpose lens arrays at (or near) the image plane for the purpose of correcting lens aberrations, it is also possible to further improve the image quality by making adjustments in a digital domain. Each element of the imaging system affects the incident wavefront having its own impulse response function that can be measured in advance for a particular imaging system. Accordingly, a post processing or digital filter can be used to further improve the image quality and/or reduce the price of the imaging system.
[0101] For example, an artificial neural-network (ANN) type self-learning algorithm can be used to adjust the algorithm parameters based on the feedback obtained from the digital signal at the image plane. By these means, a custom ‘digital filter’ can be derived that is matched to the optical system, including the collector portion and the lens array portion—i.e. the non-digital portion of the device, as shown, for example in the
[0102] The combination of the (predesigned) lens array and the derived digital filter can be used to achieve even better image quality. It should be noted that such disclosed method does not require any special modification of the collector optics (e.g. aforementioned triplet), and relatively basic collector designs can still be used in the described embodiment of the invention, providing a highest image quality.
[0103] The disclosed invention provides an effective aberration reduction means in a form of and very compact collapsible system (with optionally compound image sensor). As explained above, in the conventional collapsible lens systems, the lens elements collapse along the optic axial in a telescopic translation with minor or negligible off-axis lens placement errors. For the rotating or folding arrangement described herein, however, the lens placement errors are more complex, requiring the non-conventional approach as disclosed. As such, it is particularly beneficial to collapsible lens systems (such as those proposed herein) to deploy a lens array near the image plane, optionally in combination with the disclosed digital filtering technique applied in a digital domain.
[0104] To summarize, the proposed versions of the invention include a collapsible lens system having two modes: a storage mode and an imaging mode, where the storage mode characterized as having a plurality of lens elements that are packed in a thin compact volume. Further, the invention includes aberration mitigation means comprising of a lens array positioned near the image plane (i.e. image sensor).
[0105] The sensor imaging area can be built of smaller sensors, where the boundary ‘dead zones’ are being eliminated by the lenslet design, as explained above. Furthermore, the invention optionally includes a digital filtering aberration correction method of digital (algorithmic) correction that is adjusted (predesigned) to the precise nature of the optical system (e.g. combination of optical elements of the compound lens).
[0106] The invention is not limited to the preferred embodiment described above. The described embodiments illustrate preferred versions of the devices and methods of the invention. Therefore, there other embodiments may exist within the spirit and scope of this disclosure as set forth by appended claims, but do not appear here as specific examples. Although the present invention was described in considerable details, other modifications of the preferred embodiments would be obvious to the person skilled in the art. Therefore, the spirit and scope of the invention should not be limited by the description of the preferred versions contained therein, but rather by the claims appended hereto.