OPTICS FOR VEHICLE OCCUPANT MONITORING SYSTEMS
20210056341 · 2021-02-25
Inventors
- Björn Alexander Jubner (Spånga, SE)
- Lars Bertil Sparf (Vällingby, SE)
- Robert Sven Pettersson (Huddinge, SE)
- Hans Anders Jansson (Älta, SE)
Cpc classification
H04N23/54
ELECTRICITY
G06F3/038
PHYSICS
B60R21/01552
PERFORMING OPERATIONS; TRANSPORTING
G06F3/0421
PHYSICS
G06F3/017
PHYSICS
G01B11/26
PHYSICS
G06V20/58
PHYSICS
G06V20/597
PHYSICS
B60R21/013
PERFORMING OPERATIONS; TRANSPORTING
G02B17/0631
PHYSICS
B60R21/01538
PERFORMING OPERATIONS; TRANSPORTING
G02B17/006
PHYSICS
H04N23/55
ELECTRICITY
G01S17/48
PHYSICS
G01S17/42
PHYSICS
G02B27/0093
PHYSICS
International classification
B60R21/013
PERFORMING OPERATIONS; TRANSPORTING
B60R21/015
PERFORMING OPERATIONS; TRANSPORTING
G01S17/42
PHYSICS
G01S7/481
PHYSICS
G02B27/00
PHYSICS
Abstract
A focusing optical part, including a plastic body, suitable for being delivered on a tape and reel and mounted on a PCB by an automated mounting machine, the plastic body including a concave mirror including a center aperture input surface through which light enters the plastic body, a convex mirror opposite the center aperture, wherein the concave mirror and the convex mirror form a reflective objective that reflects and focuses the light inside the plastic body, and an exit surface surrounding the convex mirror, through which focused light exits the plastic body.
Claims
1. A focusing optical part, comprising a plastic body, suitable for being delivered on a tape and reel and mounted on a PCB by an automated mounting machine, the plastic body comprising: a concave mirror comprising a center aperture input surface through which light enters said plastic body; a convex mirror opposite the center aperture, wherein said concave mirror and the convex mirror form a reflective objective that reflects and focuses the light inside said plastic body; and an exit surface surrounding said convex mirror, through which focused light exits said plastic body.
2. The focusing optical part of claim 1, wherein said exit surface is concave and formed to minimize refraction of the focused light.
3. The focusing optical part of claim 1, wherein a portion of the light that enters the focusing optical part is reflected by said convex mirror out of the focusing optical part through said center aperture input surface, and wherein said center aperture input surface is concave and formed to refract incoming light in a manner that minimizes the amount of light that exits through said center aperture input surface.
4. The focusing optical part of claim 1, having an f-number less than 1.
5. The focusing optical part of claim 1, having an f-number less than 0.8.
6. The focusing optical part of claim 1, having a field of view of +/20 degrees.
7. A spherical coordinate sensor comprising: a circuit board; at least one light emitter mounted on said circuit board, each light emitter operable when activated to project light across a detection zone; a focusing optical part mounted on said circuit board and receiving light from the detection zone, comprising; a concave mirror comprising a center aperture input surface through which light enters the focusing optical part; a convex mirror opposite the center aperture, wherein said concave mirror and the convex mirror form a reflective objective that reflects and focuses the light inside the focusing optical part; and an exit surface surrounding said convex mirror, through which focused light exits the focusing optical part; a camera comprising a plurality of pixel sensors, mounted on said circuit board beneath said focusing optical part such that when the received light enters said focusing optical part at a three-dimensional angle of incidence, comprising a polar angle and an azimuth angle, denoted (.sub.i, .sub.j), more light arrives at a respective camera pixel sensor than at any of the other camera pixel sensors; and a processor connected to said at least one light emitter and to said camera, the processor being configured to determine a polar angle, , and an azimuth angle, , of a reflective object within the detection zone relative to said focusing optical part, based on the camera pixel sensor that detects the greatest amount of the object's reflection.
8. The spherical coordinate sensor of claim 7, wherein said processor is configured to determine the angles , of the reflective object within the detection zone relative to said focusing optical part, by interpolating the outputs of a neighborhood of the camera pixel sensors that detects the greatest amount of the object's reflection.
9. The spherical coordinate sensor of claim 7, wherein said processor: measures elapsed time of flight for photons reflected by the object and detected by said camera, calculates a distance between said camera and the object based on the measured time, and determines a location of the reflective object within the detection zone based on the angles , and the calculated distance.
10. Use of the spherical coordinate sensor according to claim 7 to detect movement inside a vehicle, by mounting the spherical coordinate sensor in the vehicle in a manner that an occupant of the vehicle is at least partially inside the spherical coordinate sensor detection zone.
11-36. (canceled)
37. The spherical coordinate sensor of claim 7, wherein said focusing optical part comprises a plastic body and is suitable for being delivered on a tape and reel and mounted on a PCB by an automated mounting machine.
38. The spherical coordinate sensor of claim 7, wherein said focusing optical part exit surface is concave and formed to minimize refraction of the focused light.
39. The spherical coordinate sensor of claim 7, wherein a portion of the light that enters said focusing optical part is reflected by said convex mirror out of said focusing optical part through said center aperture input surface, and wherein said center aperture input surface is concave and formed to refract incoming light in a manner that minimizes the amount of light that exits through said center aperture input surface.
40. The spherical coordinate sensor of claim 7, wherein said focusing optical part has an f-number less than 0.8.
41. The spherical coordinate sensor of claim 7, wherein said focusing optical part has a field of view of +/20 degrees.
42. Use of the spherical coordinate sensor according to claim 7 in a vehicle cabin to detect an orientation of the vehicle driver's head.
43. Use of the spherical coordinate sensor according to claim 7 in a vehicle cabin to detect positions of the vehicle driver's hand and arm.
44. Use of the spherical coordinate sensor according to claim 7 in a vehicle cabin to detect where the vehicle driver's feet are placed.
45. Use of the spherical coordinate sensor according to claim 7 in a vehicle cabin to detect a baby in the rear portion of the vehicle cabin.
46. Use of the spherical coordinate sensor according to claim 7 in a vehicle door to detect imminent collisions between the door and objects outside the vehicle.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0041] The present invention will be more fully understood and appreciated from the following detailed description, taken in conjunction with the drawings in which:
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055] The following table catalogs the numbered elements and lists the figures in which each numbered element appears. Similarly numbered elements represent elements of the same type, but they need not be identical elements.
TABLE-US-00001 Numbered Elements Element Description FIGS. 102, 104, 105, 106, 107, object reflection 1, 2, 3, 4, 5, 16, 109-128, 150-153 17, 19-25 103 optical axis 1 140-148 illuminated portion 26, 27 160-163 light image 17 201-203, 206 PD array 1, 2, 3, 5, 6, 7, 10 204, 205 PD 3, 4 301-304 lens 1-10 311 entry cavity 11, 12, 14, 15 312 entry surface 11, 14, 15 313 exit surface 13, 14, 15 314 convex mirror 13, 14, 15 315 concave mirror 14, 15, 16 401-403 object 1, 2, 3, 19-23, 25 501-506 polar coordinate sensor 19-27 510 focusing optical part 11-16 featuring a reflective objective 511 camera sensor 13-17 601 display 19-23 602 shape of touch 24 sensitive surface 603 detection zone 25, 27 604 detection zone perimeter 25, 27 606 calculating unit 2, 19-23 607, 608 arrows (indicate movement) 20 609 PCB 5, 7 610, 611 processor 1-3
DETAILED DESCRIPTION
[0056] The present invention relates to reflection-based sensors having a 2D detection zone shaped as a wedge or circle, or a 3D detection zone shaped as a cone or sphere. The sensor is situated at a vertex of the wedge or cone and at the center of the circle or sphere. Sensors having a 2D detection zone detect the polar angle of an object within the detection zone and are referred to as polar coordinate sensors, and sensors having a 3D detection zone detect the polar angle and azimuth angle of the object in the detection zone and are referred to as spherical coordinate sensors. In some embodiments of the invention, two or more sensors are arranged to have overlapping detection zones and the location of detected objects is obtained by triangulating the polar angles and azimuth angles returned by different sensors. In other embodiments of the invention, each sensor includes apparatus for determining time of flight for photons reflected by the object. Therefore, in addition to determining the polar and azimuth angles, the polar and spherical coordinate sensors also calculate a radial distance between the object and the sensor based on the time of flight. The polar angle together with the radial distance calculated by one polar coordinate sensor is sufficient to determine the object location within a 2D detection zone, and polar and azimuth angles together with the radial distance calculated by one spherical coordinate sensor is sufficient to determine the object location within a 3D detection zone.
[0057] In some embodiments of the invention, a polar or spherical coordinate sensor includes an array of light detectors, which is a term that includes, inter alia, CMOS and CCD camera sensors and arrays of photodiodes. In some embodiments of the invention, the sensor further includes a lens that directs object reflections onto the array of light detectors. In some embodiments of the invention, the sensor also includes light emitters that illuminate the detection zone in order to generate object reflections.
[0058] Reference is made to
[0059] Reference is made to
[0060] Reference is made to
[0061] Reference is made to
[0062]
[0063] Reference is made to
[0064] Reference is made to
[0065] Reference is made to
[0066]
[0067]
[0068] Reference is made to
[0069] In the prior art, reflective objectives are known to have an advantage over refracting lenses in terms of chromatic aberrations. Namely, whereas a refractive lens causes chromatic aberrations due to refraction, a reflective objective uses only mirrors. This enables creating an optical system without any refraction, and thus, without any chromatic aberrations, as long as the light reflected by the mirrors travels only through air. It would be counter-intuitive to design a reflective objective that passes light through multiple air-to-plastic interfaces, as these interfaces would refract the light causing chromatic aberrations which the reflective objective is typically designed to eliminate. However, it is difficult to build a reflective objective in a manner that the two mirrors will be suspended in air, yet characterized in that the part is suitable for being delivered on a tape and reel and mounted on a PCB by an automated mounting machine. Therefore, the present invention teaches a reflective objective formed as a single, solid optical part that can be delivered on a tape and reel and mounted on a PCB using automated mounting machinery.
[0070]
[0071]
[0072]
[0073] Reference is made to
[0074]
[0075] Focusing optical part 510 is designed to be used with a 0.3 mm0.3 mm, 88 pixel, camera sensor 511. Thus, the sensor has 44 pixels in each quadrant.
[0076] The light entering optical part 510 in
F-number=focal_length/diameter_of_entrance_pupil
entrance pupil area=*0.3.sup.2*0.1.sup.2
entrance pupil radius=0.08.sup.1/2
entrance pupil diameter=2*0.08.sup.1/2=0.5657 mm
The focal length of optical part 510 is 0.4 mm, and thus, the f-number is 0.707.
[0077] Exit surface 313 is designed to cause almost zero refraction to the focused light exiting optical part 510.
[0078] Some of the salient features of focusing optical part 510 are its low f-number (less than 1; even less than 0.8), which is much lower than any comparable refractive lens, and its wide field of view)(+20 that requires a very short focal length, particularly when the image height is short (0.15 mmhalf the width of sensor 511).
[0079] Reference is made to
[0080] As explained hereinabove, camera sensor 511 mounted beneath focusing optical part 510 is used to identify the polar angle and azimuth angle in 3D space at which light from the object enters optical part 510. In order to identify the location in 3D space at which the object is located, two units, each including a camera sensor 511 and a focusing optical part 510, are used and the polar and azimuth angles reported by the two units are triangulated. Additional units can be added, as discussed below, to add precision and to cover additional areas. In some embodiments of the invention, camera sensor 511 is a time-of-flight camera and a light emitter is added to the system, whereby the camera reports the time of flight from activation of the emitter until the light is detected at sensor 511. This information indicates the radial distance of the object from the sensor. Thus, a single unit is operable to identify the location of the object in 3D space using spherical coordinates, namely, the object's polar angle, azimuth angle and radial distance. In such embodiments too, additional units can be added, as discussed below, to add precision and to cover additional areas.
[0081] Reference is made to
[0082]
[0083] One approach to resolving the problem illustrated by object 401 in
[0084]
[0085]
[0086] Another approach to resolving the location of object 401 in
[0087] Yet another approach to resolving the ambiguities discussed in relation to
[0088] The examples of
[0089]
[0090] Reference is made to
[0091] In one embodiment, sensor 506 detects only the polar angle of a detected reflection. Nonetheless, it is used alone to detect radial movements in detection zone 603, e.g., to report clockwise and counter clockwise gestures. For such applications, it is not necessary that the sensor identify the radial distance of a detected object, only its clockwise or counterclockwise movement. One example for such an application is the iPod click wheel used to navigate several iPod models. IPOD is a trademark of Apple Inc. registered in the United States and other countries.
[0092] In a second embodiment, sensor 506 provides time of flight detection and is therefore operable to determine both polar angle and radial distance of a reflective object.
[0093] In a third embodiment, multiple sensors are placed at different locations such that their detection zones 603 partially overlap, whereby objects detected by more than one sensor are triangulated.
[0094] As discussed hereinabove, an illuminator, inter alia one or more LEDs, VCSELs or lasers, is provided for each polar coordinate sensor and spherical coordinate sensor to create detected reflections. Reference is made to
[0095] The sensor components according to the present invention are suitable for numerous applications beyond touch screens and touch control panels, inter alia, for various environmental mapping applications. One application in semi-autonomous vehicles is identifying whether the person in the driver's seat has his feet placed near the gas and brake pedals so as to quickly resume driving the vehicle if required. Additional sensor components are also placed around the driver to identify head orientation and hand and arm positions to determine whether the driver is alert, facing the road and prepared to take control of the vehicle. In some embodiments, the spherical coordinate sensor featuring focusing optical part 510 and a camera sensor is used to map the body of a vehicle occupant and identify the occupant's behavior, e.g., to determine if a driver is prepared to take over control of a semi-autonomous vehicle. Yet another use for this sensor is to mount it in the rear of a vehicle cabin to detect a baby left in the back seat of a parked car and alert the person leaving the car. Yet another use for this sensor is to mount it in the cargo section of a vehicle, such as a car trunk or an enclosed cargo space in a truck, to determine if a person is inside that section and avoid locking that section with the person inside.
[0096] In some embodiments of the invention, image processing of a camera image of the occupant is combined with the proximity sensor information to precisely locate a vehicle occupant's limbs and track their movements. In some cases, the image is taken from the same camera used to obtain the polar coordinates based on reflections.
[0097] Another application is car door collision detection, whereby polar or spherical coordinate sensors are mounted along the bottom edge of a car door facing outward to detect if the door will scrape the curb, hit a tree or stone, or scratch a neighboring parked car as the door opens. In some embodiments, a sensor is mounted such that its detection zone extends between the car and the car door when the door is open, enabling the sensor to detect if a finger or clothing will be caught when the door closes.
[0098] In yet another application, polar or spherical coordinate sensors are mounted facing outward of a moving vehicle, inter alia, cars, trucks and drones, and generate a proximity map surrounding the vehicle as it moves, like a scanner passing across a document.
[0099] In yet another application, a polar or spherical coordinate sensor is mounted on the top or bottom of a done propeller to detect approaching obstacles and prevent drone collision.
[0100] In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made to the specific exemplary embodiments without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.