LIGHT FIELD CAMERA
20170324912 · 2017-11-09
Assignee
Inventors
Cpc classification
H04N25/48
ELECTRICITY
G02B3/0056
PHYSICS
International classification
Abstract
A light field camera includes a lens module generating a middle image, a light field sensor having a lens array and an image sensor device, and a position adjuster adjusting a position of the light field sensor. The light field camera is between an object side and an image side. The lens array between the lens module and the image side generates a light field image according to the middle image. The image sensor device is arranged at the image side and senses the light field image. When the light field sensor is at a first or second position, the light field image includes a first or second light field sub-image. A relation of a focal length f.sub.MLA of the lens array and an exit pupil distance P.sub.EXP of the lens module satisfies
Claims
1. A light field camera comprising: a lens module is located between an object side and an image side, and configured to generate a middle image; a light field sensor comprising: a lens array arranged between the lens module and the image side, and generating a light field image according to the middle image; and an image sensor device arranged at the image side and configured to sense the light field image; and a position adjuster configured to adjust a position of the light field sensor, wherein when the light field sensor is at a first position, the light field image comprises a first light field sub-image, and when the light field sensor is at a second position, the light field image comprises a second light field sub-image, wherein a relation between a focal length f.sub.MLA of the lens array and an exit pupil distance P.sub.EXP of the lens module satisfies:
2. The light field camera of claim 1, wherein a ratio of the focal length f.sub.MLA of the lens array to the exit pupil distance P.sub.EXP of the lens module is determined according to a ratio k of a size of the second light field sub-image to a size of the first light field sub-image and a magnification ratio m of the lens array.
3. The light field camera of claim 1, wherein a distance from the middle image to the lens array on an optical axis is p, a distance from the lens array to the image sensor device on the optical axis is q, and a magnification ratio m of the lens array is equal to q/p.
4. The light field camera of claim 1, wherein when the light field sensor is at the first position, the middle image is generated at a position behind the light field sensor, and when the light field sensor is at the second position, the middle image is generated at a position between the lens module and the light field sensor.
5. The light field camera of claim 1, wherein the lens module is selected from one of a fixed-focus lens group and a zooming lens group.
6. The light field camera of claim 5, wherein the lens module is the fixed-focus lens group, and the focal length f.sub.MLA of the lens array satisfies: 0.22 mm≦f.sub.MLA≦1.198
7. The light field camera of claim 6, wherein when the light field sensor is at the first position and at the second position, a proportion of a dead zone in the light field image is 22% and 55%, respectively.
8. The light field camera of claim 5, wherein the lens module the fixed-focus lens group, 0.9≦k≦1.1, and the focal length f.sub.MLA of the lens array satisfies: 0.485 mm≦f.sub.MLA≦0.804 mm.
9. The light field camera of claim 8, wherein when the light field sensor is at the first position and at the second position, a proportion of a dead zone in the light field image is 21.4% and 26.4%, respectively.
10. The light field camera of claim 5, wherein the lens module the zooming lens group, 0.9≦k≦1.1, and the focal length f.sub.MLA of the lens array satisfies: 0.51 mm≦f.sub.MLA≦0.82 mm.
11. The light field camera of claim 10, wherein when the zooming lens group is at a wide-end, the focal length of the lens array is f1.sub.MLA , when the zooming lens group is at a tele-end, the focal length of the lens array is f2.sub.MLA, 0.38 mm≦f1.sub.MLA≦0.82 mm, and 0.51 mm≦f2.sub.MLA≦0.85 mm.
12. The light field camera of claim 10, wherein a focal length of the zooming lens group is f.sub.main, and 0.252 mm≦f.sub.main≦0.367 mm.
13. The light field camera of claim 10, wherein the exit pupil distance P.sub.EXP of the zooming lens group at a wide-end is 15.276 mm and the exit pupil distance P.sub.EXP of the zooming lens group at a tele-end is 16.102 mm.
14. The light field camera of claim 1, wherein when the light field sensor is respectively at the first position and the second position, the pitch between the lens array and the image sensor device on an optical axis varies.
15. The light field camera of claim 1, wherein the relation between the focal length f.sub.MLA of the lens array and the exit pupil distance P.sub.EXP of the lens module satisfies:
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0014] The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate exemplary embodiments of the invention and, together with the description, serve to explain the principles of the invention.
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
DESCRIPTION OF THE EMBODIMENTS
[0025] In the following detailed description of the preferred embodiments, reference is made to the accompanying drawings which form a part hereof, and in which are shown by way of illustration specific embodiments in which the invention may be practiced. In this regard, directional terminology, such as “top,” “bottom,” “front,” “back,” etc., is used with reference to the orientation of the Figure(s) being described. The components of the invention can be positioned in a number of different orientations. As such, the directional terminology is used for purposes of illustration and is in no way limiting. On the other hand, the drawings are only schematic and the sizes of components may be exaggerated for clarity. It is to be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the invention. Also, it is to be understood that the phraseology and terminology used herein are for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless limited otherwise, the terms “connected,” “coupled,” and “mounted” and variations thereof herein are used broadly and encompass direct and indirect connections, couplings, and mountings. Similarly, the terms “facing,” “faces” and variations thereof herein are used broadly and encompass direct and indirect facing, and “adjacent to” and variations thereof herein are used broadly and encompass directly and indirectly “adjacent to”. Therefore, the description of “A” component facing “B” component herein may contain the situations that “A” component directly faces “B” component or one or more additional components are between “A” component and “B” component. Also, the description of “A” component “adjacent to” “B” component herein may contain the situations that “A” component is directly “adjacent to” “B” component or one or more additional components are between “A” component and “B” component. Accordingly, the drawings and descriptions will be regarded as illustrative in nature and not as restrictive.
[0026]
[0027] In the embodiment, the lens array 122 is located between the lens module 110 and an image side IS. The lens array 122 is configured to generate a light field image according to the middle image M1. The lens array 122 is selected from one of a refractive micro-lens array and a diffractive micro-lens array, for instance. The form and the type of the lens array 122 are not limited herein.
[0028] In the embodiment, the image sensor device 124 is arranged at/near the image side IS. The image sensor device 124 is configured to sense the light field image generated by the lens array 122. For instance, the image sensor device 124 includes a charge coupled device (CCD) image sensor, a complementary metal oxide semiconductor (CMOS) image sensor, or any other similar apparatus, which should however not be construed as a limitation to the invention.
[0029] With reference to
[0030]
[0031] Different from
[0032] In the embodiment, the processor circuit 140 includes, for instance, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a programmable controller, a programmable logic device (PLD), any other similar apparatus, or a combination thereof, which should not be construed as limitations to the invention. Besides, in an embodiment of the invention, each operating function of the processor circuit 140 may be implemented in form of programming codes. These programming codes are stored in one memory and executed by the processor circuit 140. Alternatively, in an embodiment of the invention, each operating function of the processor circuit 140 may be implemented in fours of one or more circuits. In the invention, the operating functions of the processor circuits 140 can be implemented by software or hardware, which should however not be construed as a limitation to the invention.
[0033]
[0034] Specifically, in the embodiment, a ratio of the focal length f.sub.MLA of the lens array 122 to the exit pupil distance P.sub.EXP of the lens module 110 is determined according to a formula (1):
[0035] Here, k is a ratio k of the size of the second light field sub-image SM22D or SM22C to a size of the first light field sub-image SM21, i.e., k=Ø2S/Ø1 or k=Ø2L/Ø1, and m is a magnification ratio of the lens array 122. As exemplarily shown in
[0036] As exemplarily shown in
[0037] Hence, in an embodiment of the invention, 0.7≦k≦1.3, so as to achieve favorable effects of switching view angles of the light field image. When the position of the light field sensor 120 is switched back and forth, the effects of changing the view angles of the image output by the image sensor device 124 can accomplished. At the same time, the predetermined range of k contributes to the reduction of the variations in the size of the sub-images during the switching action and the reduction of the proportion of the dead zone or the crosstalk zone in the light field image, so as to enhance the utilization rate of the pixels. Besides, in an embodiment of the invention, the magnification ratio m is determined to be 0.2 while the lens array 122 is at the first position or at the second position, for instance. The determined magnification ratio m is merely exemplary and should not be construed as a limitation to the invention. Accordingly, in an embodiment of the invention, given the known range of m and k as well as the exit pupil distance P.sub.EXP of the lens module, the most appropriate focal length f.sub.MLA can be calculated according to the formula (1). Through the determination of the range of k, the quality of the light field image can stay consistent before and after the location of the light field sensor 120 is switched, and the proportion of the dead zone or the crosstalk zone in the light field image can be reduced. A relation between the focal length f.sub.MLA of the lens array and the exit pupil distance P.sub.EXP of the lens module satisfies:
In another embodiment of the invention, the relation between the focal length f.sub.MLA of the lens array and the exit pupil distance P.sub.EXP of the lens module in another light field camera satisfies:
[0038]
[0039] In
[0040] Therefore, in the embodiment, when the light field sensor 120 is at the first position and at the second position, the proportion of the dead zone in the light field image is 22% and 55%, respectively.
[0041] With reference to
[0042]
[0043] In
[0044] In
[0045] Therefore, in the embodiment, when the light field sensor 120 is at the first position and at the second position, the proportion of the dead zone in the light field image is 21.4% and 26.4%, respectively. In the embodiment, when the light field sensor is at the first position and in the second position, the difference in the utilization rate of the pixels is lessened, and hence the resolution of the light field image obtained when the light field sensor is at the first position is similar to the resolution of the light field image obtained when the light field sensor is at the second position.
[0046] With reference to
[0047] In the embodiment of the invention, the main lens group of the lens module 110 is a zooming lens group, for instance, and the range of the focal length is 2.52 mm≦fmain (wide-end)≦3.67 mm. Besides, in the embodiment, the exit pupil distance P.sub.EXP of the zooming lens group at a wide-end is 15.276 mm, and the exit pupil distance P.sub.EXP of the zooming lens group at a tele-end is 16.102 mm. Given that the zooming lens group of the lens module 110 is at the wide-end, and 0.9≦k≦1.1, i.e., the variation range of the size of the rendered light field image at the first position and the second position is between 0.9-1.1, the range of the focal length f1.sub.MLA of the lens array 122 can be calculated according to the formula (1) as 0.38 mm≦f1.sub.MLA≦0.82 mm. Given that the zooming lens group of the lens module 110 is at the tele-end, and 0.9≦k≦1.1, i.e , the variation range of the size of the rendered light field image at the first position and the second position is 0.9-1.1, the range of the focal length f2.sub.MLA of the lens array 122 can be calculated according to the formula (1) as 0.51 mm≦f2.sub.MLA≦0.852 mm. Accordingly, given either f1.sub.MLA or f2.sub.MLA, favorable quality of the light field image before and after the position of the light field sensor 120 is switched can be guaranteed, and the proportion of the dead zone or the crosstalk zone in the light field image can be lowered down.
[0048] In the embodiment, the combination of the zooming lens group may be implemented in form of any appropriate combination of lenses in the pertinent field, which should not be considered as a limitation to the invention. Teachings and suggestions of the detailed structure of the lens combination and the way to implement the lens combination should be known to people in the pertinent field and hence may not be further provided.
[0049] In the embodiments of the invention, optical parameters or structural parameters of each light field camera are exemplary, and the invention is not limited thereto.
[0050] To sum up, the light field camera provided herein may achieve at least one of advantages or effects as listed below. In an embodiment of the invention, when the light field sensor is at the first position or the second position, the conjugate plane relation between the light field sensor and the imaging plane of the lens module is satisfied. Before and after the position of the light field sensor is switched, the effects of changing the view angles of the output image can be achieved, the variations in the size of the light field sub-images during the switching operation can be reduced, the proportion of the invalid dead zone or crosstalk zone can be lowered down, and the utilization rate of the pixels can be enhanced.
[0051] The foregoing description of the preferred embodiments of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form or to exemplary embodiments disclosed. Accordingly, the foregoing description should be regarded as illustrative rather than restrictive. Obviously, many modifications and variations will be apparent to practitioners skilled in this art. The embodiments are chosen and described in order to best explain the principles of the invention and its best mode practical application, thereby to enable persons skilled in the art to understand the invention for various embodiments and with various modifications as are suited to the particular use or implementation contemplated. It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents in which all terms are meant in their broadest reasonable sense unless otherwise indicated. Therefore, the term “the invention”, “the invention” or the like does not necessarily limit the claim scope to a specific embodiment, and the reference to particularly preferred exemplary embodiments of the invention does not imply a limitation on the invention, and no such limitation is to be inferred. The invention is limited only by the spirit and scope of the appended claims. The abstract of the disclosure is provided to comply with the rules requiring an abstract, which will allow a searcher to quickly ascertain the subject matter of the technical disclosure of any patent issued from this disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. Any advantages and benefits described may not apply to all embodiments of the invention. It should be appreciated that variations may be made in the embodiments described by persons skilled in the art without departing from the scope of the invention as defined by the following claims. These claims may refer to use “first”, “second”, etc. following with noun or element. Such terms should be understood as a nomenclature and should not be construed as giving the limitation on the number of the elements modified by such nomenclature unless specific number has been given. Moreover, no element and component in the disclosure is intended to be dedicated to the public regardless of whether the element or component is explicitly recited in the following claims.