SYSTEMS AND METHODS FOR OBJECT DETECTION IN THE INTERIOR OF A MOTOR VEHICLE

Abstract

An object detection device for detecting at least one object (e.g. moving), in form of a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, includes a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system, and a control or regulating device which is designed to receive one or more of the electrical signals from the camera system or data from at least one sensor, at least one further device or at least one device of the motor vehicle, to generate control commands and to transmit them to the camera system, the at least one further device or the at least one device of the motor vehicle.

Claims

1. An object detection device for detecting at least one moving object, in form of a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, comprising: a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system; and a control or regulating device which is designed to receive the electrical signals from the camera system to generate control commands and to transmit them to the camera system and/or a further device, wherein the lighting device is suited to illuminate specific areas, including a near field (N) and a far field (F), in the motor vehicle using at least one optical element of the optic system, positioned in the vicinity of the object, in such a way that at least one distance information contained in the electrical signals can be detected via the camera system for a plurality of object points in the areas, wherein the object detection is determined by a state of the motor vehicle, and/or by a state of the environment of the motor vehicle.

2. The object detecting device of claim 1, wherein the control or regulating device is designed to further receive data from at least one further sensor, the at least one further device and/or at least one device of the motor vehicle.

3. The object detecting device of claim 2, wherein the control or regulating device is designed to transmit control commands to the device of the motor vehicle.

4. The object detecting device of claim 1, wherein the lighting device is suited to illuminate further using at least one additional lighting device and/or an additional camera system.

5. The object detecting device of claim 4, wherein further the illumination, the object localization and/or the activation of at least one of the lighting devices and/or camera systems is/are determined by a state of the motor vehicle.

6. The object detecting device of claim 1, wherein the state of the motor vehicle is determined by speed, acceleration, vehicle seat occupancy, vehicle seat position, vehicle seat orientation and/or lighting including the lighting of the vehicle interior.

7. The object detecting device of claim 1, wherein the state of the environment of the motor vehicle is determined by weather, day, night, roadway, traffic sign and/or a traffic situation.

8. The object detection device according to claim 2, wherein the lighting device of the camera system, the additional lighting device and/or the lighting device of the additional camera system comprises or comprise more than one light source, wherein each light source can be activated independently from each another depending on the state of the object, the motor vehicle and/or the surroundings of the motor vehicle and/or the distance of the object to the camera system including the sensor of the camera system, and/or to the additional camera system including the sensor of the additional camera system.

9. The object detection device according to claim 1, wherein the control or regulating device changes the illumination of different areas in the interior of the motor vehicle based on the state of the object, the motor vehicle and/or the environment of the motor vehicle and/or the distance of the object to the camera system including the sensor of the camera system, and/or to the additional camera system including the sensor of the additional camera system.

10. The object detection device according to claim 1, wherein the illumination, the object localization and/or the object detection and/or the activation of at least one of the lighting devices and/or camera systems is determined by the state of the object, determined by the size, weight, breathing, heartbeat, temperature, acceleration, movement and/or physical fitness of the vehicle occupant.

11. The object detection device according to claim 1, wherein the lighting device of the camera system, the lighting device of the additional camera system, the additional lighting device, the camera system and/or the additional camera system is located in a dashboard, a center console including a retractable or movable center console, a windshield, a roof, a headliner, a handle, an A-pillar, a B-pillar, a C-pillar, a door component, above a door, a housing including a dome-shaped housing in the region of the vehicle center on the roof or headliner, a display device, a vehicle occupant seat including a head part, a foot part and/or an armrest of the vehicle occupant seat, a restraint system for the vehicle occupant, a positioning mechanism including a motor-driven positioning mechanism, a trim and/or the device including in a form of a mobile device of the object, is attached or integrated therein.

12. The object detection device according to claim 11, wherein the light device being integrated in the display device comprises light sources distributed over a display area of the display device, wherein the light sources of the display device comprise groups of emitters and/or regions with different spectral emission areas, which are designed to be able to provide light in at least a part of a spectral range used for object detection, and/or additionally comprise spectral emitters for the spectral range of object detection.

13. The object detection device according to claim 1, wherein the optic system comprises guides and/or rotating wheels for exchanging and/or displacing the optical element and/or actuator means for inducing movements, and/or the optical element of the optic system comprises lenses, filters, adaptive optics, active optical elements and/or mirrors

14. The object detection apparatus according to claim 1, further comprising a computer or control unit designed to evaluate the electrical signals and/or the data by an object localization algorithm and/or an object detection algorithm.

15. The object detection device according to claim 1, wherein the control or regulating device is designed to control and/or coordinate the camera system, the additional camera system, the lighting device of the camera system, the additional lighting device, the lighting device of the additional camera system, at least one further sensor, the device and/or the apparatus comprising the mobile device.

16. The object detection device according to claim 1, wherein the illumination can be determined via the spectral frequency, amplitude, duration including determined by pulse frequency and/or pulse length, polarization and/or intensity of the illumination, and wherein the spectral frequency lies above and/or below the visible light.

17. An object detection device for detecting at least one object behind a first seat row of a vehicle in the interior of the motor vehicle, comprising: a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system; and a control or regulating device which is designed to receive the electrical signals from the camera system to generate control commands and to transmit them to the camera system and/or a further device, wherein the lighting device is suited to illuminate specific areas, including a near field and a far field, in the motor vehicle using at least one optical element of the optic system, positioned in the vicinity of the object, in such a way that at least one information about objects or occupants contained in the electrical signals can be detected via the camera system for a plurality of object points in the areas, wherein the optic system comprises at least one optical element reflecting infrared light from at least one second or more seat row and/or at least one foot well area of the vehicle to the sensor.

18. The object detection device of claim 17, wherein the control or regulating device is designed to further receive data from at least one further sensor, the at least one further device and/or at least one device of the motor vehicle.

19. The object detection device of claim 18, wherein the control or regulating device is designed to transmit control commands to the device of the motor vehicle.

20. The object detecting device of claim 17, wherein the lighting device is suited to illuminate further using at least one additional lighting device and/or an additional camera system.

21. The object detection device according to claim 17, wherein the at least one optical element is hide behind a cover layer transparent to infrared light.

22. The object detection device according to claim 17, wherein the cover layer is adapted to absorb, reflect or scatter visible light.

23. The object detection device according to claim 17, wherein the at least one optical element has an elliptical or free form shaped mirror element and/or the optical element directs the infrared light from the light source to the at least one second or more seat row and/or the at least one foot well area, optionally a foot well area of the second or more seat row, and/or to the sensor, optionally from the at least one second or more seat row and/or from the at least one foot well area, especially a foot well area of the second or more seat row.

24. The object detection device according to claim 17, wherein the at least one optical element is integrated into a C-pillar or a roof of the vehicle.

25. The object detection device according to claim 24, wherein the optic system comprises a plurality of optical elements, preferably at least three optical elements, where preferably two optical elements, like mirrors, are integrated into the C-pillars of each side of the vehicle and/or the third optical element, like a third mirror, is integrated into the roof of the vehicle extending from the C-pillar of one side of the vehicle to the C-pillar of the other side of the vehicle.

26. The object detection device according to claim 17, wherein the sensor is located in a center rearview mirror of the vehicle.

27. The object detection device according to claim 17, wherein the object is an occupant.

28. The object detection device according to claim 17, wherein illumination, the object localization and/or the object detection and/or the activation of at least one of the lighting devices and/or camera systems is determined by a vehicle seat occupancy, vehicle seat position, vehicle seat orientation and/or lighting including the lighting of the vehicle interior, and/or by a state of the environment of the motor vehicle determined by weather, day, night, roadway, traffic sign and/or a traffic situation.

29. An object detection device for detecting at least one object, in form of a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, comprising: a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system; and a control or regulating device which is designed to receive the electrical signals from the camera system to generate control commands and to transmit them to the camera system and/or a further device, wherein the lighting device is suited to illuminate specific areas, including a near field and a far field, in the motor vehicle using at least one optical element of the optic system, positioned in the vicinity of the object, in such a way that at least one distance information contained in the electrical signals can be detected via the camera system for a plurality of object points in the areas, wherein the lighting device in integrated into a central rearview mirror and comprises an extended light emitting area larger than light emitting components of the lighting device.

30. The object detection device according to claim 29, wherein the light emitting area surrounds the rearview mirror.

31. The object detection device according to claim 29, wherein a light pipe guiding light from the light emitting component through the light pipe, where the light pipe is adapted to extract a certain proportion of light per length of the light pipe from the light pipe and emit it through the light emitting area.

32. The object detection device according to claim 31, wherein the light emitting component, the light emitting area and/or the light pipe is/are at least partly arranged behind a, preferably for visible light opaque and/or reflective and/or for light in the infrared area at least partly transparent, mirror element of the rearview mirror and/or the mirror element emits light vertically to the mirror element towards the light pipe.

33. The object detection device according to claim 29, wherein at least the sensor of the camera system is integrated into the rearview mirror for receiving electromagnetic radiation through a mirror element of the rearview mirror.

34. The object detection device according to claim 29, wherein the illumination, the object localization and/or the object detection and/or the activation of at least one of the lighting devices and/or camera systems is determined by a state of the motor vehicle, determined by speed, acceleration, vehicle seat occupancy, vehicle seat position, vehicle seat orientation and/or lighting including the lighting of the vehicle interior, and/or by a state of the environment of the motor vehicle determined by weather, day, night, roadway, traffic sign and/or a traffic situation.

35. A method for operating an object detection device, the method comprising: acquiring a signal and/or data; localizing an object; adapting the illumination of the object; and detecting the object and/or generating a control command.

36. The method according to claim 35, wherein prior to signal and/or data acquisition, background data acquisition and/or connection to the device, sensor and/or device is performed.

37. A motor vehicle, including an autonomous driving motor vehicle, that includes an object detection device which is configured to perform a method comprising: acquiring a signal and/or data; localizing an object; adapting the illumination of the object; and detecting the object and/or generating a control command.

38. The motor vehicle according to claim 37, wherein the object detection device is designed for autonomous driving, and/or the control or regulating device is designed for adjusting the position of the vehicle occupant in the vehicle interior, including via the vehicle occupant seat, the display device, the dashboard, the center console including a retractable or movable center console, a vehicle opening, a warning device, a heating device, an air conditioning device, a navigation system, an audio system, a telephone system, a video system, a hologram system and/or the positioning mechanism.

39. The motor vehicle according to claim 37, wherein the positioning mechanism is or is configured to be brought into operative connection with the vehicle occupant seat, the display device, the dashboard, the center console, the vehicle opening, the warning device, the heating device, the air conditioning device, the navigation system, the audio system, the telephone system, the video system and/or the hologram system.

40. An object detection device for detecting at least one moving object, in form of a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, comprising: a camera system comprising at least one sensor for converting electromagnetic radiation into electrical signals and a lighting device with at least one light source and an optic system; a control or regulating device which is designed to receive the electrical signals from the camera system to generate control commands and to transmit them to the camera system and/or a further device; and a computer or control unit designed to evaluate the electrical signals and/or the data, in particular by an object localization algorithm and/or an object detection algorithm, wherein the lighting device is suited to illuminate specific areas, including a near field (N) and a far field (F), in the motor vehicle using at least one optical element of the optic system positioned in the vicinity of the object, in such a way that at least one distance information contained in the electrical signals can be detected via the camera system for a plurality of object points in the areas, wherein the object detection is determined by a state of the motor vehicle, and/or by a state of the environment of the motor vehicle.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0075] In the following, embodiments of the present invention are explained in more detail with reference to schematic drawings, in which

[0076] FIG. 1a, 1b exploded view and a side view of an exemplary lighting device;

[0077] FIG. 2 shows a partial side section view of a motor vehicle with a first design example of a device and vehicle occupants according to the invention;

[0078] FIG. 3 shows a partial side section view of a motor vehicle with a second design example of a device and vehicle occupants according to the invention;

[0079] FIG. 4 shows a partial side section view of a motor vehicle with a third example of a device and vehicle occupants according to the invention;

[0080] FIG. 5 shows a partial side section view of a motor vehicle with a fourth design example of a device and vehicle occupants according to the invention;

[0081] FIG. 6a-d shows a top view of a motor vehicle with a fifth to eighth example of the device according to the invention;

[0082] FIG. 7 shows a partial side section view of a motor vehicle with a ninth design example of a device according to the invention and vehicle occupants;

[0083] FIG. 8 shows a partial side section view of a motor vehicle with a tenth example of a device and vehicle occupants according to the invention;

[0084] FIG. 9 shows a representation of a motor vehicle with an eleventh example of the device according to the invention;

[0085] FIG. 10 shows a representation of a motor vehicle with a twelfth example of the device according to the invention;

[0086] FIG. 11a-d each shows a plan view of a vehicle occupant seat of a motor vehicle with a thirteenth example of the device according to the invention;

[0087] FIG. 12a-c each shows a representation of a vehicle occupant seat of a motor vehicle with a fourteenth example of the device according to the invention; and

[0088] FIG. 13 show a block diagram of a process according to the invention.

[0089] FIG. 14 shows an optical element in form of a mirror or mirror system 60 of the optic system 4 arranged in the rear part of the vehicle 10 to receive light from the area 11 behind the first seats row and foot well.

[0090] FIG. 15 shows a central rearview mirror with integrated lighting device (a) in a rear view (b) in a side view.

DETAILED DESCRIPTION

[0091] A lighting device 2 suitable for use in an object detection device is shown in FIGS. 1a and 1b, namely with a matrix of light-emitting diodes (LED) 3′ to 3″″ and thus with a matrix optics, such as in a lens array. The lighting device 2 comprises the light sources 3′ to 3″″ shown in the exploded view in FIG. 1a with the optical elements 5′ to 5″″ of an optic system 4, each of which is connected downstream of the light sources 3′ to 3″. Thus, for example, a near field can be illuminated by activating the light source 3′ and a far field by activating the light source 3′″. As indicated in the side view in FIG. 1b, the light beams widen with increasing distance from the light source 2. The area illuminated by light source 3′ is here limited to the area between two illumination limits A and A′, while the area illuminated by light source 3′″ is limited to the area between illumination limits B and B′. Because the available light intensity is distributed over a larger spatial field, the depth illumination decreases at the expense of the illumination field size. Thus, although a large spatial field perpendicular to the light propagation direction in the near field N can be illuminated with the light source 3′, the light intensity is no longer sufficient to illuminate the depth range in the far field F in order to be able to perform object detection. On the other hand, the 3′″ light source can be used to illuminate the depth range in the far field F, but the illuminated range in the near field N is smaller than with the 3″ light source, so that a near object may not be completely detected. The light sources 3″ and 3″″ can be used at medium distances to achieve increased illumination. Alternatively, at least one of the light sources 3″, 3″″ can also be used to illuminate the area or a partial area outside the illumination range of the light source 3′″ in far field F. By using several light sources, the required spatial illumination can be composed of several light sources.

[0092] It goes without saying that light propagation always takes place in three-dimensional space and not, as shown here as an example, in a two-dimensional plane.

[0093] Even if the arrangement of light sources 3′ to 3″″ in FIGS. 1a and 1b is shown in a flat plane and a regular pattern, a curved or otherwise shaped surface may also be provided to accommodate light sources 3′ to 3″″. Thus, the direction of the light emission and the distance of the respective light source 3′ to 3″″ to the respective optical element 5′ to 5′″ can be preset. The number of light sources can also be increased or decreased, depending on the area to be illuminated and the available installation space.

[0094] The optical elements 5′ to 5′″ of the optic system 4 can also be arranged on a curved or otherwise shaped surface in order to optimally illuminate the area to be illuminated.

[0095] Advantageously, a base plate for holding the light sources and/or the optical elements can be produced in an injection molding process, in particular in a multi-component injection molding process, at least in a 2K injection molding process.

[0096] A motor vehicle shown in FIG. 2 and designated as 10 in its entirety, according to one or more embodiments, comprises a camera system 12, which is arranged in a dashboard 14, for example.

[0097] If a vehicle occupant 26 is in a normal sitting position, as for example shown in FIG. 2 by the driver of the vehicle 10, then an object detection can be performed with the camera system 12. In this way, both the position and movement of a hand 32 of the vehicle occupant 26 and the position and movement of a head 24 of a vehicle occupant 26 can be observed. For example, the camera system 12 detects the eyes 28 of the vehicle occupant 26 as well as his entire head 24. The position of the eyes 28 can be monitored by object detection of the eyes 28 as a whole. However, a finer analysis can also be performed, in which the position of pupils or iris of eye 28 is observed. To determine the position and orientation of the head 24, the camera system can observe 12 particularly easily detectable parts of the head, such as the nose 30 of the vehicle occupant 26.

[0098] The combination of the detection of head position, eye position, facial expressions and gestures of the vehicle occupant 26 enables a particularly precise non-contact control of the vehicle 10 and its functions.

[0099] However, especially with large vehicle occupants, but also with rearwardly inclined seating positions, the distance between the vehicle occupant and the camera system 12 may become so large that reliable gesture and/or head detection is no longer guaranteed. Especially with TOF cameras, where the lighting device is often housed in the housing with a camera or in the immediate vicinity of the camera, this is often due to the lack of light output from the lighting device.

[0100] FIG. 3 shows a camera system 12 with a lighting device that can illuminate different areas analogous to the lighting device shown in FIG. 1b. As an example, three different areas are shown here, each of which is limited by the illumination limits A and A′, B and B′ as well as C and C′. Either different light sources with a fixed optic system can be used as in the example shown in FIG. 1b, but a single light source with adaptive optics and/or movable optical elements, or a combination of both systems is possible.

[0101] FIG. 4 shows a camera system 12 with a lighting device, which again can illuminate different areas analogous to the lighting device shown in FIG. 1b, whereby here the illumination of the depth range in the far field is additively combined by different light sources and/or realized by movable light sources and/or optical elements. As an example, four different areas are shown here, each of which is limited by the illumination limits A and A′, B and B′, C and C′ and D and D′.

[0102] As shown in FIG. 5, a lighting device 16 installed, for example, at the transition between a windshield 17 and the roof 20 of the motor vehicle 10 can be used to illuminate the area which is no longer sufficiently illuminated by the lighting device of the camera system 12. Camera system 12 and lighting device 16 are advantageously controlled by a common control or regulating device in order to coordinate the activation of the lighting devices and the signal and/or data recording. By the light of the lighting device 16 the object detection in a larger spatial environment becomes possible. Alternatively, the lighting device 16 can also be integrated into an interior rear-view mirror (not shown) of the motor vehicle 10.

[0103] A different design of the lighting device 16 is shown in FIGS. 6a to 6d. In this case a lighting device 16 illuminates the vehicle occupant 26 in the vehicle occupant seat 18 at least partially from the side. For example, it may be intended that the lighting device 16 is installed in a handle 34, for example above the driver's door, as shown in FIG. 6a. Such a lighting device may also be provided in the other grab handles 34′ on the passenger side. In addition, it may be intended to install additional grab handles 34″ in a vehicle interior in order to facilitate the movement and/or securing of vehicle occupants in an at least partially autonomous motor vehicle, which can then of course also be equipped with corresponding lighting devices 16.

[0104] In FIG. 6b it is shown that the lighting device 16 can also be integrated in a part of the A-pillar 36, the B-pillar 38 and/or the C-pillar 40 of the motor vehicle 10.

[0105] In FIG. 6c it is shown that the lighting device 16 can also be integrated in the area of the door, door frames, windows, window frames and the corresponding covers, especially the cladding, here collectively referred to as door components 42.

[0106] Finally, FIG. 6d shows a lighting device 16, which is located in the center of the vehicle on the ceiling, i.e. roof 20 or headliner 22. This positioning makes it possible to illuminate the central area of the vehicle interior particularly well. Advantageously, the lighting device 16 is located inside a dome-shaped housing 44, from where the lighting device 16 can illuminate up to 360° in a vertical plane and up to 180° in a horizontal plane. This can be done via several permanently installed lighting units, or the installed lighting unit can move to change the direction of light propagation.

[0107] In FIGS. 7 to 10, the lighting device 16 is integrated in the headliner 22. On the one hand, this can be done by means of lighting devices that are distributed over the area of the headliner 22, on the other hand, the entire headliner 22 itself can be designed as lighting device. The integration of the lighting device 16 into the headlining 22 allows to illuminate the seating and lying positions shown in FIGS. 8 to 10, which can be assumed by vehicle occupants 26 and in connection with autonomous and/or non self-controlled vehicles. In particular, however, sitting and/or lying positions not shown can also be assumed. For example, the vehicle occupants can also orient themselves at right angles to the direction of travel of the motor vehicle and/or lie on their side or stomach in the vehicle occupant seat. In the prone position, the vehicle occupant seat, in particular the head restraint of the vehicle occupant seat, may have an area, in particular a recess or hole, to accommodate the head of the vehicle occupant without covering his or her face. In such a position, the vehicle occupant shall be able to put his or her head down without his or her breathing and/or vision being impeded by the vehicle occupant seat. Lighting device, camera systems, devices such as loudspeakers and/or microphones and/or sensors can also be fitted and/or integrated in the recess or hole.

[0108] It can also be provided that the headliner 22 has a cover that is at least partially transparent for the spectral range of the light 16, so that the light 16 itself is not visible, while the light of the light 16 can still illuminate the room. Advantageously, the cover is essentially completely transparent for the spectral range of the lighting device, while it is essentially not transparent in the visible spectral range.

[0109] By using several of the above lighting devices at different positions, a particularly good illumination of the vehicle interior can be achieved.

[0110] Lighting devices that can be used in accordance with embodiments of the present disclosure are integrated in or in the form of display devices 46 are shown in FIGS. 11 to 12. FIGS. 11a to 11d show four different variants of indicator devices 46 which can be positioned near or in front of the head 24 of a vehicle occupant 26. In this case, the display device 46 is advantageously mounted in or at the head section 48 of the vehicle occupant seat 18 and can be brought manually or automatically into a position via a positioning mechanism 52 in order to provide the vehicle occupant 26 with information and/or to support the object detection by the lighting device and/or by the camera system. Rotation and/or rotation of the display device 46 or the positioning mechanism 52 to adapt to the angle and field of vision of the vehicle occupant 26 is also possible.

[0111] In addition or alternatively, it may also be provided that a lighting device without display device is positioned by a positioning mechanism 52 in such a way that it can support object detection. For this purpose, the lighting device may also be positioned on a side facing away from the display device, for example to illuminate gestures of vehicle occupants.

[0112] In FIG. 12a, an indicator 46 is positioned on the vehicle occupant seat 18, for example, next to or on an armrest 50, allowing the vehicle occupant 26 to manually remove the indicator 46 from a holder and hold it in their hands, as shown in FIG. 10b. Alternatively or additionally, the display device 46, as shown in FIG. 10c, can also be positioned in the field of vision of the vehicle occupant 26 via a positioning mechanism 52 in such a way that the vehicle occupant 26 does not need any hands to hold the display device 46. The positioning of the display device 46 can be done manually and/or motor-driven. The indicator 46 may also be formed in, or attached to, a part of the vehicle occupant seat 18, for example an armrest 50, a head restraint 48, a foot restraint and/or a restraint system, such as part of a seat belt system (not shown). The vehicle occupant restraint system is also designed to be able to secure the occupant in all sitting or reclining positions. It may also be provided that a lamp without indicator is positioned by a positioning mechanism 52 in such a way that it can support object detection.

[0113] A positioning mechanism 52 may include at least one joint to enable and/or perform a rotation about a pivot point. Alternatively or additionally, a positioning mechanism 52 may also enable and/or perform a linear movement, for example in the form of a rail or an extendable rod. In particular, a positioning mechanism 52 may enable and/or perform a combination of different movements and/or forms of movement. The positioning mechanism 52 thereby has at least a first end position and a second end position, and can be transferred by at least one movement between the first and the second end position. A first end position may be, for example, a folded state in which, for example, the device, light source, camera system, display device and/or device is positioned in a storage space or initial position, for example on the vehicle occupant seat, center console or headlining. If necessary, the device, light source, camera system, display device and/or device can then be moved to a second end position by performing a movement with the positioning mechanism 52. This may then result, for example, in the device, light source, camera system, display device and/or device being positioned in the field of vision of a vehicle occupant and remaining there when no further movement is made or required. In particular, the positioning mechanism 52 may be, or may be capable of being, operatively connected to the vehicle occupant seat, the display device, the dashboard, the center console, the vehicle opening, the warning device, the heating device, the air conditioning device, the navigation system, the audio system, the telephone system, the video system and/or the hologram system.

[0114] It may also be particularly advantageous to design the display device and/or lighting device as part of a foot section of the vehicle occupant seat. If the vehicle occupant occupies a reclining position, the display device and/or lighting device designed into or attached to the footrest of the vehicle occupant seat can improve and/or perform object detection.

[0115] In addition, the motor vehicle 10 may include a number of indicators not shown in the figures, which may, for example, be integrated in the dashboard 14, may be a head-up display on the windscreen 18, or may be installed in a headlining 22 or other interior trim parts of the motor vehicle 10, in particular around the vehicle doors. Furthermore, the windows of the motor vehicle 10 may also be designed as a display device and/or lighting device. In this context, it is advantageous to use a display device and/or lighting device which, when switched off, is essentially transparent at least in some areas, whereas when switched on it provides information and/or light. For example, organic light emitting diodes (OLED) can be used for this purpose. However, display devices can also be used which completely replace the windows of the motor vehicle and on which, for example, the image of the surroundings captured by camera systems can be shown. Other display devices include a projection surface, a head-up display, a flexible OLED display, a liquid crystal display, photometric fabric and/or photometric films, in particular in the form of a headliner monitor, interior trim monitor, left door monitor, left main monitor, right main monitor and/or right door monitor, which can be arranged in a dashboard, on a windscreen, in a headliner and/or in the center console.

[0116] Instead of or in addition to the lighting devices mentioned in all versions, a camera and/or camera system can also be used at the respective positions to perform and/or improve object detection. This is particularly advantageous if the object is no longer in the original detection range of the camera system due to a change in the seat position and seat orientation as well as masking.

[0117] Furthermore, it may be intended that the control or regulating device for object detection accesses data, sensors, cameras and/or lighting device from other devices, such as external devices and/or other vehicle device. For example, the control system may access a mobile terminal device belonging to and carried by a vehicle occupant to obtain additional data, such as control commands, profile data or sensor data, and/or use cameras and/or lighting device of the mobile terminal device. It is also possible to obtain data from vehicle device or to control vehicle device to support and/or perform object detection. Examples of such in-vehicle device can be sensors, for example integrated in the vehicle occupant seat, which measure the orientation, position, acceleration, temperature, the state of the vehicle occupant seat and/or data from the vehicle passenger, such as weight, respiration, heartbeat, temperature, acceleration and/or movement. Other beneficial vehicle devices may be memory devices, data transmission and/or information interfaces that provide a profile with the data, such as physical data, in particular facial characteristics and/or preferred settings of the vehicle occupant, and may be used for object detection.

[0118] A method for operating an object detection device according to one or more embodiments is shown as an example in the block diagram in FIG. 13. The method comprises at least the steps of signal and/or data acquisition, object localization and object detection. Based on the object localization, the illumination of the vehicle interior can then be optimized, if necessary, in order to perform the object detection. The commands detected by the object detection can then be executed. The object localization and the object detection are realized by appropriate algorithms from the provided data. The optimization and/or variation of the illumination can also take place additionally or alternatively before the object localization. This is especially important, if without such a change of illumination not enough data for a first object localization can be obtained.

[0119] In embodiments, background data is recorded before or during vehicle activation to facilitate object localization and object detection. This can happen, for example, before or during the unlocking of the vehicle and when a passenger enters the vehicle, especially when he or she gives an unlock command to the vehicle, for example via an external control such as a remote control, smartphone and/or other device. By comparing the previous state with the current state, object detection can better detect the differences that are subsequently caused by the vehicle occupant.

[0120] The object detecting device can also be used as a general occupant monitoring systems as shown in FIGS. 14a and 14b. The monitoring of forgotten children is an important feature that this device may also provide as a safety function. In the state of the art, the forgotten objects and child presence detection (CPD) everywhere in the car by a single sensor is an unresolved challenge. The use of a single camera 12 (not shown here) located in the front part of the vehicle 10 as at rear mirror position cannot see behind the first seats row and foot well forcing to use a second sensor. Therefore, the optic system 4 of object detecting device may further comprise an optical element comprising a mirror or mirror system 60 arranged in the rear part of the vehicle 10 to receive light from the area 11 behind the first seats row and foot well to enable occupant detection by the detecting device. The lighting device 16 (not shown here) of the object detecting device emits infrared light 71 in order not to disturb the driver and occupants of the vehicle. An optical element in form of a mirror 60 integrated into the C-pillar 40 or the roof 20 of the vehicle 10 reflects the infrared light 71 from the second or more seat rows and foot well areas 11 to a camera sensor 12 located e.g. in the center rearview mirror. A cover layer 62 is arranged in front of the mirror 60 reflecting infrared light 71 to cover the mirror 60. The cover layer 62 absorbs, reflects or scatters (as shown in FIG. 14a) the visible light 70 but is transparent to infrared light 71. As shown in FIG. 14b the optic system may comprises three optical elements in form of mirrors 60, where two mirrors 60 are integrated into the C-pillars 40 of each side of the vehicle 10 and the third mirror 60 is integrated into the roof 20 of the vehicle 10 extending from the C-pillar 40 of one side of the vehicle to the C-pillar 40 of the other side of the vehicle 10.

[0121] The object detecting device can also be used as an object detection device for detecting at least one object, provided by a vehicle occupant or in form of at least a part of the vehicle occupant, in the interior of a motor vehicle, wherein the lighting device 2 in integrated into a central rearview mirror 19 and comprises an extended light emitting area 2a larger than light emitting components 2b (e.g. an IR-LED) of the lighting device 2, as shown in FIG. 15a in a rear view onto the rearview mirror and FIG. 15b in a side view of the rearview mirror. Here, the light emitting area 2a surrounds the central rearview mirror 19 and a light pipe 2c guides light 71 from the light emitting component 2b through the light pipe 2c, where the light pipe 2c is adapted to extract a certain proportion of light 71 per length of the light pipe 2c from the light pipe 2c and emit it through the light emitting area 2a as illuminating infrared light 71. The light emitting component 2b is arranged behind a mirror element 19a of the central rearview mirror 19 emitting light 71 parallel to the mirror element 19a towards the light pipe 2c. Due to the opaqueness of the mirror element 19a for visible light the light emitting component 2b cannot be seen from the front side of the mirror element 19a. It is also possible that the mirror element 19a is translucent for light in the IR spectrum so that also the light pipe 2c can transmit light in the IR spectrum through the mirror element 19a without being visible from the front side of the mirror element 19a. Furthermore, the sensor of the camera system 12 is integrated into the rearview mirror 19 for receiving electromagnetic radiation 71 through a mirror element 19a of the central rearview mirror 19 arranged in the middle of the mirror element 19a surrounded by the light emitting area 2a.

[0122] Alternatively or additionally, the object detection device can search for other devices, preferably active devices, vehicle device and sensors that can perform and/or support object detection. For this purpose, a control signal can be sent regularly, but at least during and after activation of the vehicle, which searches for modified sensor data, vehicle device and/or additional devices. This control signal can be sent either wired or wireless. The devices, vehicle device and/or sensors found are then included in the object detection procedure by the control or regulating device of the object detection device in order to obtain data and/or send data. These steps can also be carried out before the recording of background data is executed or completed. In this way, as many devices, vehicle device and/or sensors as possible can provide background data that lead to an improvement in object detection.

[0123] While the disclosure has been described in detail and with reference to specific embodiments thereof, it will be apparent to one skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the embodiments. Thus, it is intended that the present disclosure cover the modifications and variations of this disclosure provided they come within the scope of the appended claims and their equivalents.

TABLE-US-00001 REFERENCE CHARACTER LIST A, A′, B, C, C′, D, D′ Illumination limits N Near field F far field  2 Lighting device   2a light emitting area   2b light emitting component   2c light pipe 3, 3′, 3″, 3′ ″, 3″ ″ Light source  4 Optic system 5, 5′, 5″, 5′ ″, 5″ ″ Optical element 10 Motor vehicle 11 Area behind the first seats row and foot well 12 Camera system 14 Dashboard 16 Lighting device 17 Windshield 18 Vehicle occupant seat 19 central rearview mirror  19a rearview mirror element 20 Roof 22 Headliner 24 Head 26 Vehicle occupant 28 Eye 30 Nose 32 Hand 34, 34′, 34″ Handle 36 A-pillar 38 B-pillar 40 C-pillar 42 Door components 44 Housing 46 Display device 48 Header 50 Armrest 52 Positioning mechanism 60 mirror or mirror system 62 cover layer 64 mirror element 70 visible light 71 infrared light