A MULTI-DIRECTIONAL DIGITAL CAMERA
20240007731 ยท 2024-01-04
Inventors
- Yohan Yehouda COHEN (Tsufim, IL)
- Yuval INBAR (Ein Shemer, IL)
- Elad LEVY (Nir Tzvi, IL)
- Amit LEVY (Matan, IL)
Cpc classification
H04N23/55
ELECTRICITY
H04N13/282
ELECTRICITY
H04N13/254
ELECTRICITY
H04N23/58
ELECTRICITY
International classification
H04N23/58
ELECTRICITY
H04N23/55
ELECTRICITY
H04N13/254
ELECTRICITY
Abstract
A multi-directional digital camera comprising: a light sensor capable of converting incoming light beams into an electrical signal output representing an imaged scene; one or more multi-mode optical path controlling elements, each having at least two operation modes including (a) a first operation mode in which the multi-mode optical path controlling element reflects the light beams directed thereon, and (b) a second operation mode in which the multi-mode optical path controlling element enables passage of the light beams directed thereon; a controller configured to selectively change the imaged scene by selectively changing an optical path of the light beams, wherein changing the optical path is made by changing the operation modes of one or more of the multi-mode optical path controlling elements.
Claims
1. A multi-directional digital camera comprising: a light sensor capable of converting incoming light beams into an electrical signal output representing an imaged scene; one or more multi-mode optical path controlling elements, each having at least two operation modes including (a) a first operation mode in which the multi-mode optical path controlling element reflects the light beams directed thereon, and (b) a second operation mode in which the multi-mode optical path controlling element enables passage of the light beams directed thereon; a controller configured to selectively change the imaged scene by selectively changing an optical path of the light beams, wherein changing the optical path is made by changing the operation modes of one or more of the multi-mode optical path controlling elements.
2. The multi-directional camera of claim 1, wherein at least one of the multi-mode optical path controlling elements is a switchable mirror element.
3. The multi-directional camera of claim 1, further comprising one or more optical elements.
4. The multi-directional camera of claim 3, wherein the optical elements are one or more lenses, each positioned on an optical path of a respective light beam.
5. The multi-directional camera of claim 1, further comprising one or more reflective elements, each positioned on the optical path of a respective light beam redirecting the respective light beam into a respective optical element or into the light sensor.
6. The multi-directional camera of claim 3, wherein the controller is further configured to cause movement of the optical elements.
7. The multi-directional camera of claim 6, wherein the controller is further configured to cause movement of the optical elements in synchronicity with a desired setup of the operational modes of the multi-mode optical path controlling elements.
8. The multi-directional camera of claim 3, wherein the controller is further configured to analyze incoming light beams that incident the optical elements.
9. The multi-directional camera of claim 1, wherein the light sensor is a CMOS sensor.
10. The multi-directional camera of claim 1, further comprising one or more prisms, designed to redirect the light beam perpendicularly to a respective optical element.
11. A method of operating a multi-directional digital camera comprising (A) a light sensor capable of converting incoming light beams into an electrical signal output representing an imaged scene; and (B) one or more multi-mode optical path controlling elements, each having at least two operation modes including (a) a first operation mode in which the multi-mode optical path controlling element reflects the light beams directed thereon, and (b) a second operation mode in which the multi-mode optical path controlling element enables passage of the light beams directed thereon, the method comprising selectively changing the imaged scene by selectively changing, by a controller, an optical path of the light beams, wherein changing the optical path is made by changing the operation modes of one or more of the multi-mode optical path controlling elements.
12. The method of claim 11, wherein at least one of the multi-mode optical path controlling elements is a switchable mirror element.
13. The method of claim 11, further comprising one or more optical elements.
14. The method of claim 13, wherein the optical elements are one or more lenses, each positioned on an optical path of a respective light beam.
15. The method of claim 11, further comprising one or more reflective elements, each positioned on the optical path of a respective light beam redirecting the respective light beam into a respective optical element or into the light sensor.
16. The method of claim 13, wherein the controller is further configured to cause movement of the optical elements.
17. The method of claim 16, wherein the controller is further configured to cause movement of the optical elements in synchronicity with a desired setup of the operational modes of the multi-mode optical path controlling elements.
18. The method of claim 13, wherein the controller is further configured to analyze incoming light beams that incident the optical elements.
19. (canceled)
20. The method of claim 11, further comprising one or more prisms, designed to redirect the light beam perpendicularly to a respective optical element.
21. A non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code, executable by at least one controller to perform a method of operating a multi-directional digital camera comprising: (A) a light sensor capable of converting incoming light beams into an electrical signal output representing an imaged scene; and (B) one or more multi-mode optical path controlling elements, each having at least two operation modes including (a) a first operation mode in which the multi-mode optical path controlling element reflects the light beams directed thereon, and (b) a second operation mode in which the multi-mode optical path controlling element enables passage of the light beams directed thereon, the method comprising selectively changing the imaged scene by selectively changing, by the controller, an optical path of the light beams, wherein changing the optical path is made by changing the operation modes of one or more of the multi-mode optical path controlling elements.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0079] In order to understand the presently disclosed subject matter and to see how it may be carried out in practice, the subject matter will now be described, by way of non-limiting examples only, with reference to the accompanying drawings, in which:
[0080]
[0081]
[0082]
[0083]
[0084]
[0085]
[0086]
[0087]
[0088]
[0089]
DETAILED DESCRIPTION
[0090] In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the presently disclosed subject matter. However, it will be understood by those skilled in the art that the presently disclosed subject matter may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the presently disclosed subject matter.
[0091] In the drawings and descriptions set forth, identical reference numerals indicate those components that are common to different embodiments or configurations.
[0092] Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions utilizing terms such as analyzing, changing, activating, reactivating, generating, determining, causing, projecting or the like, include action and/or processes of a computer that manipulate and/or transform data into other data, said data represented as physical quantities, e.g. such as electronic quantities, and/or said data representing the physical objects. The terms computer, processor, processing resource, processing circuitry and controller should be expansively construed to cover any kind of electronic device with data processing capabilities, including, by way of non-limiting example, a personal desktop/laptop computer, a server, a computing system, a communication device, a smartphone, a tablet computer, a smart television, a processor (e.g. digital signal processor (DSP), a microcontroller, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.), a group of multiple physical machines sharing performance of various tasks, virtual servers co-residing on a single physical machine, any other electronic computing device, and/or any combination thereof.
[0093] The operations in accordance with the teachings herein may be performed by a computer specially constructed for the desired purposes or by a general-purpose computer specially configured for the desired purpose by a computer program stored in a non-transitory computer readable storage medium. The term non-transitory is used herein to exclude transitory, propagating signals, but to otherwise include any volatile or non-volatile computer memory technology suitable to the application.
[0094] As used herein, the phrase for example, such as, for instance and variants thereof describe non-limiting embodiments of the presently disclosed subject matter. Reference in the specification to one case, some cases, other cases or variants thereof means that a particular feature, structure or characteristic described in connection with the embodiment(s) is included in at least one embodiment of the presently disclosed subject matter. Thus, the appearance of the phrase one case. some cases, other cases or variants thereof does not necessarily refer to the same embodiment(s).
[0095] It is appreciated that, unless specifically stated otherwise, certain features of the presently disclosed subject matter, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the presently disclosed subject matter, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable sub-combination.
[0096] Any reference in the specification to a method should be applied mutatis mutandis to a system capable of executing the method and should be applied mutatis mutandis to a non-transitory computer readable medium that stores instructions that once executed by a computer result in the execution of the method.
[0097] Any reference in the specification to a system should be applied mutatis mutandis to a method that may be executed by the system and should be applied mutatis mutandis to a non-transitory computer readable medium that stores instructions that may be executed by the system.
[0098] Any reference in the specification to a non-transitory computer readable medium should be applied mutatis mutandis to a system capable of executing the instructions stored in the non-transitory computer readable medium and should be applied mutatis mutandis to method that may be executed by a computer that reads the instructions stored in the non-transitory computer readable medium.
[0099] Bearing this in mind, attention is drawn to
[0100] The multi-directional projector 100 includes a laser source 110, a reflective surface 112, a movement mechanism (not shown in the figures) and a plurality of optical elements 118.
[0101] As shown in
[0102] In some cases, the multi-directional projector 100 can further comprise a repositioning component (e.g. a spring, a rubber element, etc.) that is configured to cause the reflective surface 112 to return to a known position upon deactivation of the movement mechanism (e.g. a starting position as depicted in
[0103] The reflective surface 112 can be any surface (e.g. electromagnetically driven mirror) capable of reflecting the laser beams 114 emitted by the laser source 110 once it was moved and/or tilted, by the movement mechanism, to a predetermined position with respect to the laser 110. Such configuration enables the reflective surface 112 to reflect the incident laser beams 114 to a plurality of directions i.e. optical paths 116(1), 116(2), 116(3), . . . , 116(i) as depicted in
[0104] The optical elements 118 can be phase elements that can be configured to manipulate an input laser beam to various output profiles and shapes (e.g. form a periodic projection pattern), such as but not limited to, pattern Diffractive Optical Elements (DOEs) and/or diffusers and/or Micro Lens Arrays (MLAs), etc. Each optical element 118 depicted in
[0105] It is to be noted that at least two of the optical elements 118 can be configured to direct the respective incoming laser beams in different projection directions so that at least part of a field of illumination of one of the given optical elements 118 covers an area located more than 90 degrees with respect to a projection direction of a center of projection of one of the given optical elements 118. For example, one DOE is configured to project along a positive Z axis so that the center of projection thereof is aligned with the positive Z axis whereas a second DOE is positioned so that its center of projection has an angle of 45 degrees with respect to the positive Z axis which yields field of illumination of the second DOE that part of it covers area that is located more than 90 degrees with respect to the center of projection of the first DOE (i.e. positive Z axis).
[0106] In some cases, at least two of the optical elements 118 can be configured to direct the respective incoming laser beams in different projection directions having a 180 degrees difference between the centers of the projection directions (as can be seen in
[0107] The optical elements 118 can be configured to project a periodic light pattern onto a scene, i.e. structured lighting known in the art. The periodic light pattern can be a dot pattern, a line pattern, a custom grid design pattern, a polygonal pattern or any other pattern that can be designed pursuant to specific requirements and/or needs.
[0108] In some cases, the multi-directional projector 100 can further comprise one or more prisms 120, designed to redirect/realign the laser beams, traveled through a respective optical paths 116(1), 116(2), 116(3), . . . , 116(i), perpendicularly to a respective optical element 118, as shown in
[0109] In some cases, the multi-directional projector 100 can further comprise one or more lenses (not shown in the figures) each optionally positioned on an optical path 116(1), 116(2), 116(3), . . . , 116(i) of a respective laser beam directed at a respective optical element 118. The lenses can be for example collimating lenses, diversion lenses, etc.
[0110] In other cases, the multi-directional projector 100 can further comprise one or more lenses (not shown in the figures) that may be positioned merely on the optical path of the laser beams 114 emitted by the laser source 110 towards the reflective surface 112. The lenses can be for example collimating lenses, so that collimated laser beams can then be reflected by the reflective surface 112 and travel optical paths 116(1), 116(2), 116(3), . . . , 116(i) as detailed hereinabove.
[0111] In some cases, the multi-directional projector 100 can further comprise one or more reflective elements 122 (e.g. static mirrors), each optionally positioned on an optical path, e.g. 116(1), 116(i) of a respective laser beam redirecting the respective laser beam at a respective optical element 118. In some cases, the reflective elements 122 can be moved by an additional movement mechanism in a three-dimensional space (i.e. lateral translations along and/or rotation about X, Y, Z axes and/or mechanical tilt) in order to expand optical scanning angles of the multi-directional projector 100. In some cases, the reflective elements 122 can be reflective surfaces, mutatis mutandis, as reflective surface 112.
[0112] In some cases, the multi-directional projector 100 can further comprise a controller (not shown in the figures) configured to cause activation of the laser source 110 in synchronicity with positions (as described herein above) of the reflective surface 112 so that the laser beams 114 generated by the laser source 110 are reflected by the reflective surface 112 in a direction of the respective optical elements 118.
[0113] In some cases, the multi-directional projector 100 can further comprise a position sensor capable of determining the positions of the reflective surface 112 (e.g. a rotation angle degree about the X and/or Y and/or the Z axis). The laser source 110 can be activated in synchronicity based on these positions. For example, the laser source 110 can be activated once the position sensor indicates that the reflective surface 112 arrived at a required position.
[0114] It is to be noted that
[0115] Turning to
[0116] The multi-directional projector 200 includes a laser source 210, one or more multi-mode optical path controlling elements 212, a controller 222 and a plurality of optical elements 218.
[0117] As shown in
[0120] At least one of the multi-mode optical path controlling elements 212 can be an electrically switchable transflective mirror (i.e. electro-optically switchable mirror element known in the art) that can be based on a Liquid-crystal (LC), polymer dispersed liquid-crystal (PDLC) or formed of a thin layer of magnesium-titanium alloy film for example encapsulated between two layers of glass or can be based on any other (e.g. gasochromic) technology that can perform functions described herein.
[0121] In some cases, at least one of the multi-mode optical path controlling elements 212 can have a third operation mode in which the multi-mode optical path controlling element 212 enables passage of a first subset of the laser beams and reflection of a second subset of the laser beams, other than the first subset. This is in fact a semi-transparent operation mode wherein one portion of the incident laser beams passes through the multi-mode optical path controlling elements 212 while a second portion of the incident laser beams is reflected by the multi-mode optical path controlling elements 212.
[0122] In some cases, the third operation mode can be a selective mode enabling selectively determining a proportion between the first subset and the second subset. That is, the passage/reflectance degree of the laser beams through/by the multi-mode optical path controlling elements 212 can be modulated giving rise to varying portions of laser beams that can pass through the multi-mode optical path controlling elements 212 and laser beams that can be reflected by the multi-mode optical path controlling elements 212. For multi-mode optical path controlling elements 212 that are based on PDLC for example, liquid crystal droplets comprised therein are capable of changing their arrangement in response to a change in a level of voltage applied to the PDLC, so that the multi-mode optical path controlling element 212 becomes more transparent as the voltage increases, thereby enabling larger portion of laser beams to pass therethrough.
[0123] Referring back to in
[0126] For example, laser beams traveled via optical path 214 towards multi-mode optical path controlling element 212(1) can pass therethrough, if it is operating in the second operation mode, towards optical element 218(1). If the multi-mode optical path controlling element 212(1) is operating in the first operation mode, the laser beams traveled via optical path 214 will be reflected therefrom towards multi-mode optical path controlling element 212(2). The reflected laser beams traveled via optical path 216(1) towards multi-mode optical path controlling element 212(2) can pass therethrough, if it is operating in the second operation mode, towards optical element 218(2). If the multi-mode optical path controlling element 212(2) is operating in the first operation mode, the laser beams traveled via optical path 216(1) will be reflected therefrom towards multi-mode optical path controlling element 212(3). The reflected laser beams traveled via optical path 216(2) towards multi-mode optical path controlling element 212(3) can pass therethrough, if it is operating in the second operation mode, towards optical element 218(3). If the multi-mode optical path controlling element 212(3) is operating in the first operation mode, the laser beams traveled via optical path 216(2) will be reflected therefrom towards optical element 218(4).
[0127] Each multi-mode optical path controlling element 212 can be controlled by the controller 222 that is capable of selectively changing an optical path of the laser beams over time by changing the operation modes thereof.
[0128] In some cases, one or more of the multi-mode optical path controlling elements 212 can be divided into two or more independent sections, wherein each section can be configured to operate independently from the other section(s). That is, each section can be controlled independently by the controller 222 and thereby set to a different operation mode. For example, for a multi-mode optical path controlling element that is divided into two independent sections, one section can be set by the controller 222 in the first operation mode while the second section can be set by the controller 222 in the second operation mode. This way, one optical path of laser beams can be splitted into two different optical paths simultaneously, wherein one optical path will be of laser beams that are being reflected by the first section of the multi-mode optical path controlling element and second optical path will be of laser beams that are being passed by the second section of the multi-mode optical path controlling element. Such configuration of the multi-mode optical path controlling elements enables projection of laser beams in more than one direction at once utilizing merely one laser source. In some cases, the controller 222 can be further configured to cause activation of the laser source 210 in synchronicity with a desired setup of the operational modes of the multi-mode optical path controlling elements 218. For example, the laser source 210 can be activated once all the multi-mode optical path controlling elements 212 are operating in the first operation mode.
[0129] The optical elements 218 can be phase elements that can be configured to manipulate an input laser beam to various output profiles and shapes (e.g. form a periodic projection pattern), such as but not limited to, pattern Diffractive Optical Elements (DOEs) and/or diffusers and/or Micro Lens Arrays (MLAs), etc. Each optical element 218 depicted in
[0130] In some cases, each of the optical elements 218 can be configured to cause scattering of the respective incoming laser beams, so that the scattering caused by a first optical element of the optical elements 218 at least partially overlaps the scattering caused by a second optical element of the optical elements 218. In such cases, the projector 200 can safely project a powerful laser beam into an overlapping Field of view (FOV) while meeting laser safety requirements that mandate maximum permissible exposure values.
[0131] The optical elements 218 can be configured to project a periodic light pattern onto a scene, i.e. structured lighting known in the art. The light pattern can be a dot pattern, a line pattern, a custom grid design pattern, a polygonal pattern or any other pattern that can be designed pursuant to specific requirements and/or needs.
[0132] In some cases, the multi-directional projector 200 can further comprise one or more prisms 220, designed to redirect/realign the laser beams, passed through and/or reflected from multi-mode optical path controlling element 212, perpendicularly to a respective optical element 218, as shown in
[0133] In some cases, the multi-directional projector 200 can further comprise one or more lenses (not shown in the figures) each optionally positioned on an optical path 214, 216(1), 216(2), 216(3) of a respective laser beam directed at a respective optical element 118. The lenses can be positioned before the multi-mode optical path controlling element 212 or after (e.g. between the multi-mode optical path controlling element 212 and a respective prism 220 or between the prism 220 and a respective optical element 218). The lenses can be for example collimating lenses, diversion lenses, etc.
[0134] In other cases, the multi-directional projector 200 can further comprise one or more lenses (not shown in the figures) that may be positioned merely on the optical path of the laser beams 214 emitted by the laser source 210 towards the first multi-mode optical path controlling element 212(1). The lenses can be for example collimating lenses, so that collimated laser beams can then be reflected by the multi-mode optical path controlling element 212(1) or passed therethrough as detailed hereinabove.
[0135] In some cases, the multi-directional projector 200 can further comprise one or reflective elements (not shown in the figures), e.g. static mirrors, each optionally positioned on an optical path, e.g. 214, 216(1), 216(2), 216(3), of a respective laser beam redirecting the respective laser beam at a respective optical element 218. For example, reflective element can be positioned on optical path 216(3) to redirect laser beams reflected by multi-mode optical path controlling element 212(3) optionally towards additional multi-mode optical path controlling element or optical element 218 (not shown in the figures). In some cases, the reflective elements can be moved by a movement mechanism in a three-dimensional space (i.e. lateral translations along and/or rotation about X, Y, Z axes and/or mechanical tilt) in order to expand optical scanning angles of the multi-directional projector 200. The movement mechanism can be any mechanism that is capable of performing high precision movements, such as but not limited to, a Microelectromechanical system (MEMS) (e.g. a quasi-static MEMS or a resonant MEMS, a single-axis MEMS or a dual-axis MEMS, etc.), a piezo-electric actuator, an electro-mechanical actuator, a linear voice coil actuator, etc.
[0136] It is to be noted that
[0137] Turning to
[0138] The hyper-resolution pattern projector 300 includes a laser source 310, a movement mechanism 312, a collimating lens 316, a Diffractive Optical Element (DOE) 318 and a controller 322.
[0139] As shown in
[0140] In some cases, instead of DOE a Micro Lens Array (MLA) can be used.
[0141] According to currently disclosed subject matter, the movement mechanism 312 can be configured to rotate the DOE about Z axis and/or tilt the DOE in order to provide additional optical scanning angles of the scene. The movement mechanism 312 can be any mechanism that is capable of performing high precision movements, such as but not limited to, a Microelectromechanical system (MEMS) (e.g. a quasi-static MEMS or a resonant MEMS, a single-axis MEMS or a dual-axis MEMS, etc.), a piezo-electric actuator, an electro-mechanical actuator, a linear voice coil actuator, etc.
[0142] The hyper-resolution pattern projector 300 can also include a controller 322 that can be configured to activate the laser source 310 to emit a first set of the laser beams and thereby project a first pattern that can be the fixed pattern onto first locations on the scene. Upon projection of the first fixed pattern, the controller 322 can activate the movement mechanism 312 to rotate and/or tilt the DOE 318 and reactivate the laser source 310 to emit a second set of the laser beams and thereby project a second pattern that can be the fixed pattern onto second locations on the scene, wherein the first pattern and the second pattern are identical. It is to be noted that in some cases more than two patterns can be projected by the hyper-resolution pattern projector 300 onto more than two locations on the scene thereby providing a hyper-resolution pattern as presently disclosed herein. In some cases, a portion of each of the projected patterns can overlap with another projected patterns.
[0143] In some cases, the hyper-resolution pattern projector 300 can further comprise a repositioning component (e.g. a spring, a rubber element, etc.) that is configured to cause the DOE 318 to return to a known position upon deactivation of the movement mechanism 312 (e.g. a starting position as depicted in
[0144] In some cases, the hyper-resolution pattern projector 300 can further comprise a position sensor capable of determining the positions of the DOE 318 (e.g. a rotation angle degree about the X and/or Y axis and/or the Z axis). The reactivation of the laser source 310 can be performed based on a position reading of the DOE 318 obtained from the position sensor. For example, the laser source 310 can be reactivated once the position sensor indicates that the DOE 318 arrived at a required position.
[0145] In some cases, the hyper-resolution pattern projector 300 can further comprise one or more lenses (not shown in the figures) each optionally positioned on an optical path of the laser beams 314 directed at the DOE 318. The lenses can be positioned before the DOE 318 or after. The lenses can be for example collimating lenses, diversion lenses, etc.
[0146] It is to be noted that
[0147] According to currently disclosed subject matter, a system can include the hyper-resolution pattern projector 300, an image acquisition device and a processing circuitry.
[0148] The image acquisition device can be at least one two-dimensional or stereo camera that can be configured to acquire images of the scene, i.e. images of the fixed one or more patterns projected by the hyper-resolution pattern projector 300 onto the scene, as described hereinabove with respect to
[0149] Reference is currently made to
[0150]
[0151]
[0152]
[0153] The processing circuitry can be configured to activate the image acquisition device to acquire images of the first pattern and the second pattern (e.g. patterns illustrated in
[0154] The hyper resolution pattern image can be attained by projecting the fixed pattern onto second locations on the scene, once the DOE 318 is rotated and/or tilted by the movement mechanism 312, thereby providing additional light dots for example (in case where a dot pattern is utilized) in the scene that can be captured by the image acquisition device. The tilt movement of the DOE 318 is advantageous as it can shift of a group of light dots in the scene (e.g. dots that are located at the center of the projected pattern) that otherwise were not be moved to shifted locations, during projection of the fixed pattern onto second locations on the scene, if the DOE 318 was merely rotated about Z axis.
[0155] Although the foregoing disclosed subject matter exemplifies projection of fixed pattern onto two locations in the scene, it is to be noted that the hyper-resolution pattern projector 300 can be configured to project the fixed pattern onto any number of locations as needed.
[0156] Turning to
[0157] The hyper-resolution pattern projector 500 includes a laser source 510, a movement mechanism 512, a collimating lens 516, an optical element 518, a mask 520 and a controller 522.
[0158] As shown in
[0159] In some cases, the optical element 518 can be a Micro Lens Array (MLA).
[0160] The fixed pattern 524 emitted by the optical element 518 incidents the mask 520 that can be configured to block at least part of the pattern 524 and thereby allow a portion thereof 526 to be projected onto the scene (i.e. the mask 520 can project a sub-pattern 526 of the fixed pattern onto a scene). The mask 520 can be any optical element that can be configured to allow light to selectively pass therethrough (e.g. the mask can be made of a Polymer plastic material having physical barriers to block selectively portions of light passing therethrough).
[0161] The movement mechanism 512 can be configured to move the mask 520 in at least one degree of freedom (e.g. tilting, rotating, translating, or any combination thereof). The movement mechanism 312 can be any mechanism that is capable of performing high precision movements, such as but not limited to, a Microelectromechanical system (MEMS) (e.g. a quasi-static MEMS or a resonant MEMS, a single-axis MEMS or a dual-axis MEMS, etc.), a piezo-electric actuator, an electro-mechanical actuator, a linear voice coil actuator, etc.
[0162] The hyper-resolution pattern projector 500 can also include a controller 522 that can be configured to activate the laser source 510 to emit a first set of the laser beams and thereby project a first sub-pattern of the fixed pattern onto the scene. Upon projection of the first sub-pattern, the controller 522 can activate the movement mechanism 512 to move the mask 520 and reactivate the laser source 510 to emit a second set of the laser beams and thereby project a second sub-pattern of the fixed pattern onto the scene, wherein the first sub-pattern and the second sub-pattern are not identical. The fixed pattern emitted by the optical element 518 can be homogeneous (i.e. having a non-arbitrary illumination pattern) while the first sub-pattern and the second sub-pattern emitted by the mask 520 can be non-homogeneous (i.e. having arbitrary illumination patterns).
[0163] In some cases, the mask 520 can be designed to redirect the laser beams directed at the blocked part of the pattern to a non-blocked part of the pattern thereby optimize utilization of the laser beams generated by the laser 510.
[0164] In some cases, the hyper-resolution pattern projector 500 can further comprise a repositioning component (e.g. a spring, a rubber element, etc.) that is configured to cause the mask 520 to return to a known position upon deactivation of the movement mechanism 512 (e.g. a starting position as depicted in
[0165] In some cases, the hyper-resolution pattern projector 500 can further comprise a position sensor capable of determining the positions of the mask 520 (e.g. lateral translations in X-Y plane). The reactivation of the laser source 310 can be performed based on a position reading of the mask 520 obtained from the position sensor. For example, the laser source 510 can be activated once the position sensor indicates that the mask 520 arrived at a required position.
[0166] In some cases, the hyper-resolution pattern projector 500 can further comprise one or more lenses (not shown in the figures) each optionally positioned on an optical path of the laser beams 514 directed at the optical element 518. The lenses can be positioned before the optical element 518 or after. The lenses can be for example collimating lenses, diversion lenses, etc.
[0167] In some cases, the mask 520 of the hyper-resolution pattern projector 500 can be positioned before the optical element 518, mutatis mutandis.
[0168] It is to be noted that
[0169] According to currently disclosed subject matter, a system can include the hyper-resolution pattern projector 500, an image acquisition device and a processing circuitry.
[0170] The image acquisition device can be at least one two-dimensional or stereo camera that can be configured to acquire images of the scene, i.e. images of the one or more sub-patterns projected by the hyper-resolution pattern projector 500 onto the scene, as described hereinabove with respect to
[0171] Reference is currently made to
[0172]
[0173]
[0174]
[0175]
[0176] The processing circuitry can be configured to activate the image acquisition device to acquire images of the first sub-pattern and the second sub-pattern (e.g. patterns illustrated in
[0177] The hyper resolution pattern image can be attained by projecting the first sub-pattern onto the scene while the mask 520 is blocking first portion of the fixed pattern 524 generated by the optical element 518. Next, the mask 520 is mechanically translated in the X-Y plane and/or rotated about the Z axis by the movement mechanism 512, then the second sub-pattern is projected onto the scene while the mask 520 is blocking second portion of the fixed pattern 524 generated by the optical element 518. This way, the hyper-resolution pattern projector 500 can provide maximum energy per dot (in case where a dot pattern is utilized) while meeting laser safety requirements that mandate maximum permissible exposure values.
[0178] Although the foregoing disclosed subject matter exemplifies projection of merely first sub-pattern and second sub-pattern onto the scene, it is to be noted that the hyper-resolution pattern projector 500 can be configured to project any number of sub-patterns as needed onto the scene.
[0179] Turning to
[0180] The multi-directional digital camera 700 includes a light sensor 702, one or more multi-mode optical path controlling elements 704, a controller 706 and one or more lenses 708.
[0181] The light sensor 702 can be a photoresistor (i.e. a light-dependent resistor), a photodiode, a phototransistor or any other type of light sensor that can perform functions describes herein. For example, the light sensor 702 can be based, inter alia, on one of the following technologies: CMOS (e.g. CMOS active-pixel image sensor), Quanta Image Sensor (QIS), Single-Photon Avalanche Diode (SPAD) array, short-wave infrared (SWIR) light range imaging featuring Indium gallium arsenide (InGaAs) sensor technology, etc.
[0182] The multi-directional digital camera 700 can be configured to operate in the electromagnetic radiation spectrum, specifically in the infrared (IR) and/or visible light wavelengths.
[0183] In some cases, the multi-directional digital camera 700 can further comprise one or more optical elements. The optical elements can be one or more lenses, each positioned on an optical path of a respective light beam (e.g. lenses 708 depicted in
[0184] In some cases, lenses that are located at the entrance pupil of the multi-directional digital camera 700 can be tilted and/or rotated in different angles in order to change the Field of View (FOV) of the camera and thereby enable different effects or capturing different angles of the imaged scene.
[0185] As shown in
[0186] In some cases, the multi-directional digital camera 700 can further include an optical prism 710 that can be located between the lens and the multi-mode optical path controlling elements (e.g.
[0187] Each multi-mode optical path controlling element 704 can have at least two operation modes including: [0188] (a) a first operation mode in which the multi-mode optical path controlling element 704 reflects the light beams directed thereon; and [0189] (b) a second operation mode in which the multi-mode optical path controlling element 704 enables passage of the light beams directed thereon.
[0190] Each multi-mode optical path controlling element 704 can be controlled by the controller 706 that is capable of selectively changing an optical path of the light beams over lime by changing the operation modes of one or more of the multi-mode optical path controlling elements, thereby selectively changing the imaged scene. For example, the controller 706 can set the multi-mode optical path controlling element 704(1) in the first operation mode and the multi-mode optical path controlling element 704(2) in the second operation mode. In such configuration, the light sensor 702, that is capable of converting incoming light beams into an electrical signal output representing an imaged scene, will receive light merely from one scene located at a first direction (e.g. a negative x-axis direction as illustrated in
[0191] The light that enters the multi-directional digital camera 700 through lens 708(2) can be, for example, absorbed by a special coating surface in order to reduce distortions associated with undesired reflections thereof towards the light sensor 702. The special coating can be any electromagnetic radiation absorption coating known in the art that can absorb any wavelengths in the visible spectrum and/or the infrared spectrum. Such coating can be applied onto internal walls of the multi-directional digital camera 700 or may be applied to a surface that can be located in a predetermined location (e.g. located between the multi-mode optical path controlling element 704(2) and the controller 706 in the exemplary configuration depicted in
[0192] Alternatively, the controller 706 can set the multi-mode optical path controlling element 704(1) in the second operation mode and the multi-mode optical path controlling element 704(2) in the first operation mode. In such configuration, the light that will pass through the multi-mode optical path controlling element 704(1) can be absorbed (e.g. partially or completely) by the special coating as described herein above and the light sensor 702 will receive light merely from one scene located at a second direction (e.g. a positive x-axis direction as illustrated in
[0193] It is to be noted that other combinations between the operation mods of multi-mode optical path controlling elements 704(1) and 704(2) are possible (e.g. both can be set by the controller 706 in the first operation mode or the second operation mode).
[0194] In some cases, one or more of the multi-mode optical path controlling elements 704 can be divided into two or more independent sections, wherein each section can be configured to operate independently from the other section(s). That is, each section can be controlled independently by the controller 706 and thereby set to a different operation mode. For example, for a multi-mode optical path controlling element that is divided into two independent sections, one section can be set by the controller 706 in the first operation mode while the second section can be set by the controller 706 in the second operation mode. This way, the light sensor 702 can receive light from two scenes simultaneously, wherein the scenes can be located at different locations.
[0195] At least one of the multi-mode optical path controlling elements 704 can be an electrically switchable transflective mirror (i.e. electro-optically switchable mirror element known in the art) that can be based on a Liquid-crystal (LC), polymer dispersed liquid-crystal (PDLC) or formed of a thin layer of magnesium-titanium alloy film for example encapsulated between two layers of glass or can be based on any other (e.g. gasochromic) technology that can perform functions described herein.
[0196] In some cases, the multi-directional digital camera 700 can further comprise one or more reflective elements (e.g. static mirrors), each positioned on the optical path of a respective light beam redirecting the respective light beam into a respective optical element or into the light sensor. For example, in the configuration depicted in
[0197] In some cases, the controller 706 can be further configured to cause movement of the optical elements. For example, the controller 706 can selectively cause movement of one or more lenses 708, e.g. for active zoom and/or focus purposes. The movement can be performed by employing any focus motor known in the art, such as but not limited to, linear voice-coil motors, Micro Electro-Mechanical System (MEMS) focusing units, stepper motors, etc.
[0198] In some cases, the controller 706 can be further configured to cause movement of the optical elements 708 in synchronicity with a desired setup of the operational modes of the multi-mode optical path controlling elements 704. For example, the controller 706 can set the multi-mode optical path controlling element 704(1) in the first operation mode and the multi-mode optical path controlling element 704(2) in the second operation mode. In such configuration, the light sensor 702 will receive light merely from one scene located at a first direction (e.g. a negative x-axis direction as illustrated in
[0199] In some cases, the controller 706 can be configured to adjust the position of one or more lens 708 in accordance with a desired zoom and/or focus based on the light that passes through the lenses (e.g. autofocus). For example, the controller 706 can be configured to analyze incoming light beams that incident the optical elements. For example, in a phase-detection auto-focus method the controller 706 can analyze the light (e.g. light intensity profiles) as it travels through the optical elements 708 in order to determine focus adjustment needs.
[0200] Turning to
[0201] The multi-directional digital camera 800 depicted in
[0202] Such arrangement enables capturing images (e.g. simultaneously, in cases where one or more of the multi-mode optical path controlling elements is divided into two or more independent sections as described herein above, or sequentially) from opposite directions (e.g. negative and positive z-axis directions as illustrated in
[0203] It is to be noted that other combinations between the operation mods of multi-mode optical path controlling elements 704(1) and 708(2) are possible (e.g. multi-mode optical path controlling element 704(1) can be set by the controller 706 in the first operation mode while the multi-mode optical path controlling element 704(2) can be set by the controller 706 in the second operation mode, and vice versa).
[0204] Turning to
[0205] The multi-directional digital camera 900 depicted in
[0206] Such arrangement enables capturing images (e.g. simultaneously, in cases where one or more of the multi-mode optical path controlling elements are divided into two or more independent sections as described herein above, or sequentially) from substantially perpendicular directions (e.g. positive x-axis direction and positive z-axis direction as illustrated in
[0207] Turning to
[0208] The combined configuration depicted in
[0209] As described hereinabove with respect to
[0210] It is to be noted that other combinations between the operation mods of multi-mode optical path controlling elements 704(1) and 704(2) are possible (e.g. both can be set by the controller 706 in the first operation mode or the second operation mode).
[0211] In some cases, the multi-mode optical path controlling element 704(1) can be a reflective mirror (e.g. a static mirror), instead of a multi-mode optical path controlling element described hereinabove, so that light passed through lens 708(1) is constantly redirected towards lens 708(3).
[0212] Additionally, the multi-directional projector 200 can operate simultaneously or subsequently to the multi-directional digital camera 700. As described hereinabove with respect to
[0213] It is to be noted that controller 706 can be further configured to correlate between the operations of the multi-directional projector 200 and the multi-directional digital camera 700. For example, the controller 706 can synchronize both systems to operate simultaneously and optionally cause movement of the optical elements (e.g. lenses 708) in synchronicity with a desired setup of the operational modes of the multi-mode optical path controlling elements 704.
[0214] It is to be understood that the presently disclosed subject matter is not limited in its application to the details set forth in the description contained herein or illustrated in the drawings. The presently disclosed subject matter is capable of other embodiments and of being practiced and carried out in various ways. Hence, it is to be understood that the phraseology and terminology employed herein are for the purpose of description and should not be regarded as limiting. As such, those skilled in the art will appreciate that the conception upon which this disclosure is based may readily be utilized as a basis for designing other structures, methods, and systems for carrying out the several purposes of the present presently disclosed subject matter.
[0215] It will also be understood that the system according to the presently disclosed subject matter can be implemented, at least partly, as a suitably programmed computer. Likewise, the presently disclosed subject matter contemplates a computer program being readable by a computer for executing the disclosed method. The presently disclosed subject matter further contemplates a machine-readable memory tangibly embodying a program of instructions executable by the machine for executing the disclosed method.
[0216] Examples of the presently disclosed subject matter may be provided as a computer program product, or software, that may include a machine-readable medium having stored thereon instructions, which may be used to program a computer system (or other electronic devices) to perform a process according to the presently disclosed subject matter. A machine-readable medium includes any mechanism for storing or transmitting information in a form readable by a machine (e.g. a computer). For example, a machine-readable (e.g. computer readable) medium includes a machine (e.g. a computer) readable storage medium (e.g. read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.), a machine (e.g. computer) readable transmission medium (electrical, optical, acoustical or other form of propagated signals (e.g., infrared signals, digital signals, etc.)), etc.
[0217]
[0218] In the foregoing specification, the presently disclosed subject matter has been described with reference to specific examples of embodiments of the presently disclosed subject matter. It will, however, be evident that various modifications and changes may be made therein without departing from the broader spirit and scope of the presently disclosed subject matter as set forth in the appended claims.
[0219] Also, the presently disclosed subject matter is not limited to physical devices or units implemented in nonprogrammable hardware but can also be applied in programmable devices or units able to perform the desired device functions by operating in accordance with suitable program code, such as mainframes, minicomputers, servers, workstations, personal computers, notepads, personal digital assistants, electronic games, and other embedded systems, cell phones and various other wireless devices, commonly denoted in this application as computer systems.
[0220] However, other modifications, variations and alternatives are also possible. The specifications and drawings are, accordingly, to be regarded in an illustrative rather than in a restrictive sense.
[0221] While certain features of the presently disclosed subject matter have been illustrated and described herein, many modifications, substitutions, changes, and equivalents will now occur to those of ordinary skill in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the presently disclosed subject matter.