DETECTION SYSTEM AND A VEHICLE THEREWITH

Abstract

A detection system for vehicles adapted to record objects within a scenery at least in problematic viewing conditions includes a camera system establishing an optical path from a light entrance aperture via a lens system to an image recording unit with the image recording unit being adapted to record visible and IR light one or more of reflected or emitted from the scenery comprising at least one object, an IR filter arranged within the optical path to block at least a first part of the IR light not being the at least one object related from reaching the image recording unit, and a conversion filter arranged within the optical path to convert at least a second part of the IR light being the at least one object related to visible light of an image enhancing wavelength range.

Claims

1. A detection system for vehicles adapted to record objects within a scenery at least in problematic viewing conditions, comprising: a camera system establishing an optical path from a light entrance aperture via a lens system to an image recording unit with the image recording unit being adapted to record visible and IR light one or more of reflected or emitted from the scenery comprising at least one object; an IR filter arranged within the optical path to block at least a first part of the IR light not being the at least one object related from reaching the image recording unit; and a conversion filter arranged within the optical path to convert at least a second part of the IR light being the at least one object related to visible light of an image enhancing wavelength range, wherein the lens system comprises at least one lens arranged in front of the image recording unit to guide the light from the scenery through the IR and conversion filters to the image recording unit.

2. The detection system according to claim 1, wherein the conversion filter is an up conversion layer structure converting the IR light into visible light of a certain wavelength comprising an IR absorbing layer followed by a stack of layers arranged between electrodes, with the conversion filter being adapted to be operated by a suitable operating voltage to enable the up conversion.

3. The detection system according to claim 1, wherein the conversion filter is a switchable filter in order to transmit the IR light to the image recording unit in an off state and to convert the IR light to the image enhancing wavelength range in an on state.

4. The detection system according to claim 3, wherein the conversion filter is switched on and off with a ratio between the on and off durations varying between 1:1 and 1:4, the ratio of 1:1 being applied in twilight conditions, and the ratio increasing when viewing conditions improve.

5. The detection system according to claim 1, wherein the IR filter is arranged on top of the image recording unit and the conversion filter is arranged on top of the IR filter, and the lens system is arranged in front of the set of image recording unit, the IR filter, and the conversion filter.

6. The detection system according to claim 1, wherein the conversion filter is arranged on top of the image recording unit, and the IR filter is arranged within the optical path in front of the conversion filter, with the IR filter having a transmission window of a certain widths outside the first part of the IR light in order to transmit the second part of the IR light to the conversion filter.

7. The detection system according to claim 6, wherein the IR filter is applied on top of at least one lens of the lens system or is arranged between the image recording unit and one lens of the lens system or between two lenses of the lens system.

8. The detection system according to claim 1, wherein the conversion filter and the IR filter are arranged in the optical path with the conversion filter being arranged in front of the IR filter along the optical path.

9. The detection system according to claim 8, wherein at least one of the IR filter or the conversion filter is applied on top of at least one lens of the lens system, or at least one of the IR filter or the conversion filter is arranged between two lenses of the lens system or between the image recording unit and one lens of the lens system.

10. The detection system according to claim 1, wherein the second part of the IR light comprises 1050 nm.

11. The detection system according to claim 1, wherein the visible light is divided into a first, a second and a third wavelength range, and the image recording unit comprises at least three segments, with a first segment being adapted to record only the first wavelength range of the visible light, a second segment being adapted to record only the second wavelength range of the visible light, and the third segment being adapted to record all wavelength ranges of the visible light, with the image enhancing wavelength range being within the third wavelength range.

12. The detection system according to claim 11, wherein at least one of: the different segments of the image recording unit have same sizes, the image recording unit comprises four rectangular segments arranged in a 22 array, or the first and second segments as well as the third segment and a fourth segment are diagonally arranged, and the third and fourth segments are identical segments.

13. The detection system according to claim 11, wherein the image recording unit is adapted to record the first wavelength range of the visible light of the first segment and the second wavelength range of the visible light with the second segment, and a sum of the wavelength ranges including the first and second wavelength ranges and additionally the third wavelength range with at least the third segment, with a difference between the intensities of the third segment minus the intensities of the first and second segment resulting in intensity of visible light in the third wavelength range in the off-state of the conversion filter or in the sum of the intensities of the third wavelength range provided by the object and provided by the conversion filter.

14. The detection system according to claim 1, further comprising an image matching unit adapted to compare the images recorded in an on state of the conversion filter with images recorded in an off state of the conversion filter, with critical objects being distinguished from non-critical objects or identified by comparing a contrast between both images, with objects moving relative to a moving direction of the vehicle showing less contrast in the image with the off state of the conversion filter when being compared.

15. The detection system according to claim 14, wherein the image matching unit transfers the identified objects to the visible image in order to at least one of tag the critical objects or to inform a viewer about present critical objects.

16. The detection system according to claim 15, wherein the image matching unit further displays a frame around each of the tagged objects to enhance the present critical object in the visible image.

17. A vehicle, comprising a detection system adapted to record objects within a scenery at least in problematic viewing conditions, comprising: a camera system establishing an optical path from a light entrance aperture via a lens system to an image recording unit with the image recording unit being adapted to record visible and IR light one or more of reflected or emitted from the scenery comprising at least one object; an IR filter arranged within the optical path to block at least a first part of the IR light not being the at least one object related from reaching the image recording unit; and a conversion filter arranged within the optical path to convert at least a second part of the IR light being the at least one object related to visible light of an image enhancing wavelength range, wherein the lens system comprises at least one lens arranged in front of the image recording unit to guide the light from the scenery through the IR and conversion filters to the image recording unit.

18. The vehicle according to claim 17, further comprising an IR light source to illuminate a scenery, at least in problematic viewing conditions, with the IR light source emitting light of at least 1050 nm.

19. The vehicle according to claim 18, wherein at least one of: the IR light source is switched on and off with a frequency correlating to a switching frequency of the conversion filter, and the IR light source is integrated into a front light assembly of the vehicle.

20. The vehicle according to claim 17, further comprising a display unit for viewing the image provided by the camera system.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The above listed embodiments can be used individually or in any combination to provide the device and the process in accordance with the invention. These and other aspects of the invention are shown in detail in the schematic illustrations as follows:

[0038] FIG. 1 depicts a camera system of a detection system according to the invention, with three different arrangements of in particular an IR filter;

[0039] FIG. 2 shows an LED structure with IR absorbing layer to establish a conversion filter;

[0040] FIG. 3 shows an image recording unit as a schematic RCCB chip with corresponding segments; and

[0041] FIG. 4 shows a vehicle according to the invention.

DETAILED DESCRIPTION

[0042] FIG. 1 shows a camera system 10 of a detection system 1 for vehicles 40 adapted to record objects within a scenery at least in problematic viewing conditions is provided. The camera system 10 establishes an optical path 16 from a light entrance aperture 15 via a lens system 14 to an image recording unit 11, whereby the image recording unit 11 is adapted to record visible and IR light reflected and/or emitted from the scenery comprising at least one object 50 (see FIG. 4). The detection system 1 further comprises an IR (infrared) filter 13 arranged within the optical path 16 to block at least a first part of the IR light not being an object 50 related from reaching the image recording unit 11, and a conversion filter 12 is arranged within the optical path 16 to convert at least a second part of the IR light being object related to visible light of an image enhancing wavelength range. The lens system 14 comprises at least one lens 17 arranged in front of the image recording unit 11 to guide the light from the scenery through the IR and conversion filter 12 to the image recording unit.

[0043] In the top of FIG. 1, the IR filter 13 is arranged on top of the image recording unit 11 and the conversion filter 12 is arranged on top of the IR filter 13 and the lens system is arranged in front of the set of image recording unit, IR filter 13 and conversion filter. The infrared filter or cut-off filter is a conventional filter that simply filters out/cuts infrared light. This filter is used to avoid color falsifications in the camera image. In state of the art, the IR filter 13 is normally arranged on the lens. However, according to state of art arrangements, no IR light would arrive on the conversion filter 12 of the invention and the filter is ineffective.

[0044] Therefore, the IR filter 13 is placed behind the conversion layer, i.e. closer to the chip than the conversion layer. Then the following effect occurs: If the layer is switched on, it converts the IR light into a different wavelength range (e.g. green light), and the IR filter 13 lets the additional light pass through. If the conversion layer is switched off, all the light comes through, including IR, and is then filtered in the IR filter 13 so that no color falsifications occur, as with the conventional method.

[0045] In the middle of FIG. 1, the conversion filter 12 is arranged on top of the image recording unit 11 and the IR filter 13 is arranged within the optical path in front of the conversion filter 12 whereby the IR filter 13 has a transmission window of a certain widths outside the first part of the IR light in order to transmit the second part of the IR light to the conversion filter. For example, the IR filter 13 may be applied on top of at least one lens of the lens system or may be arranged between the image recording unit 11 and one lens of the lens system or between two lenses of the lens system. Another way to make an IR filter 13 permeable again is for a very narrow IR band. So far only IR filter 13 that cuts everything from 750 nm are mentioned. This embodiment relates to an IR filter 13 that cuts everything from 750 nm but lets a small band pass at 1050 nm. This small band doesn't falsify the colors so much, and can be corrected with software. In this case the conversion layer (filter) has to be designed exactly for the wavelength (e.g. 1050 nm) that the IR filter 13 lets through. Now the IR filter 13 can be again arranged in the lens, because of the band on the conversion filter.

[0046] In the bottom of FIG. 1, the conversion filter 12 and the IR filter 13 are arranged in the optical path where the conversion filter 12 is arranged in front of the IR filter 13 along the optical path. Further, at least one IR filter 13 or conversion filter 12 are applied on top of at least one lens 17 of the lens system 14 or at least one of IR filter 13 or conversion filter 12 is arranged between two lenses 17 of the lens system 14 or between the image recording unit 11 and one lens 17 of the lens system 14. The second part of the IR light may comprise 1050 nm.

[0047] The conversion filter 12 can be an up conversion layer structure converting the IR light into visible light of a certain wavelength comprising an IR absorbing layer followed by a stack of layers 21-27 arranged between electrodes where the conversion filter 12 is adapted to be operated by a suitable operating voltage to enable the up conversion.

[0048] FIG. 2 shows that the conversion filter 12 can be a LED or organic LED 20 with state of the art layer stacks (anode layer 21, hole blocking layer (HBL) 22, hole transport layer (HTL) 24, light emission layer (EML) 25, electron transport layer (ETL) 26 and cathode layer 27), whereby an additional IR absorbing layer 23 is arranged between the hole blocking layer 22 and the hole transfer layer 24. Said IR absorbing layer 23 can be a PbS QD IR absorbing layer. The IR absorbing layer 23 is activated when an operating voltage (uneven zero) is applied. The conversion filter 12 may therefore be a switchable filter in order to transmit the IR light to the image recording unit 11 in an off state and to convert the IR light to the image enhancing wavelength range in an on state.

[0049] In another embodiment of the first aspect of the invention, the visible light is divided into a first, a second and a third wavelength range and the image recording unit 11 comprises at least three segments 31, 32, 33 where a first segment 31 is adapted to record only the first wavelength range of the visible light, where a second segment 32 is adapted to record only the second wavelength range of the visible light and the third segment 33 is adapted to record all wavelength ranges of the visible light. In order to match the IR and visible images a problem arises: the IR image should only be inserted into the optical image for relevant parts. To make such a matching the object has to be evaluated before it can be inserted. Otherwise the driver has a pure IR image in front of him. In a solution provided by the present invention, the IR image is evaluated so that only objects moving relative to the road are fixed and the matching is included. Standing creatures or objects running away are not considered. In the second step, the object made visible is transferred into the visible image. The filter used may have a preferred color, which can be green.

[0050] FIG. 3 shows a RCCB chip where the different segments of the image recording unit 11 have identical sizes. The image recording unit 11 may also comprise four rectangular segments 31, 32, 33, 34 arranged in a 2x2 array where the first and second segment 31, 32 as well as the third segment 33 and a fourth segment 34 are diagonally arranged, where the third and fourth segment 33, 34 are identical segments. Further, the image enhancing wavelength range may be within the third wavelength range. The first segment 31 may comprise a red filter to only pass red light for being detected by this segment 31 of the RCCB chip, while the second segment 32 may comprise a blue filter to only pass blue light for being detected by this segment 32 of the RCCB chip.

[0051] In another embodiment of the first aspect of the invention, the image recording unit 11 is adapted to record the first wavelength range of the visible light of the first segment 31 and the second wavelength range of the visible light with the second segment 32 and a sum of the wavelength ranges including the first and second wavelength ranges and additionally the third wavelength range with at least the third segment 33 (and also fourth segment 34), where a difference between the intensities of the third segment 33 minus the intensities of the first and second segment 31, 32 result in intensity of visible light in the third wavelength range in the off-state of the conversion filter 12 or in the sum of the intensities of the third wavelength range provided by the object 50 and provided by the conversion filter 12.

[0052] In the aforementioned embodiment, further light improvement by transparent pixel e.g. a RCCB chip 12 is provided. Hereby C=transparent pixel green is omitted and can be calculated. In the transparent pixel falls now with switched on filter the light intensity of IR converted into green still with pure. Thus this pixel gets about 4 times the light as if it were only green. The contents can be reverse calculated again.

[0053] Filter is on: C(t1)=G+IR+R+B+(RB)=G+IR

[0054] C(t1) as transparent pixel at time t1: here the data can be subtracted from the red and blue pixel and only green and the infrared light converted to green light remains.

[0055] Filter is off: C(t2)=G+R+B+(RB)=G

[0056] C(t2) as transparent pixel at time t2: Here the green parts of the visible light can be distinguished from the converted infrared light, which also appears as green.

[0057] Since the filter is switched off and on x times per second, with x element of the natural numbers the information of C at the position tl and at the position t2 are known and can thus distinguished from additional information in the green, whether it is IR light or real green. Thus, the image can be processed in such a way that it is appealing to the human eye and only the IR information that could be a danger at night are display 42ed.

[0058] The filter technology switches the IR image alternately on and off with a defined repetition rate. This allows the IR and visible images to be transmitted alternately in a ratio of 1:1. In twilight conditions, the ratio of the refresh rate can be changed from 1:1. In light darkness, the ratio IR to visible could be e.g. 1:4 and then, depending on the twilight, revert in the direction of 1:1. The filter frequency (or switching ratio) for switching must be at least the image repetition frequency of the chip (image recording unit). In addition, an external light source 41, e.g. in the front headlight, can emit an IR light source 41 with e.g. 1050 nm. Both the front area and the front/side area should be illuminated. With this, better results with the IR filter 13 in the NIR range can be achieved. A synchronization with the frequency of the conversion filter 12 is also possible, so that the IR illuminator only emits light when the IR conversion filter 12 is active (e.g. 30 Hz or 60 Hz etc.).

[0059] The detection system 1 according to one above mentioned embodiments can further comprise an image matching unit 43 adapted to compare the images recorded in an on state of the conversion filter 12 with images recorded in an off state of the conversion filter, where critical objects 50 are distinguished from non-critical objects and are therefore identified by comparing a contrast between both images, where objects 50 moving relative to a moving direction of the vehicle 40 show less contrast in the image with the off state of the conversion filter 12 when being compared. How can one tell if an object is difficult or impossible to see with the naked eye? If one compares the IR image with the visible image, the object moving towards the relevant roadway must be significantly less in number of pixels (contrast) than that of the IR image. If such an object can be detected, it is faded in from the IR image into the visual image. The advantage herein lies: only objects in the IR range are made visible which also represent a latent danger and no arbitrary wild animals in the forest which simply only graze near the road. Also, a square can be drawn around the object made visible by IR to identify the object that is difficult or impossible to see with the naked eye Therefore, the image matching unit may transfer the identified objects to the visible image in order to tag the critical objects informing a viewer about present critical objects or even have the image matching unit further display 42ing a frame around each of the tagged objects to enhance the present critical object in the visible image.

[0060] FIG. 4 shows a vehicle 40 comprising the detection system 1 according to the invention to inform the driver 60 of the vehicle 40 about critical objects 50. Said vehicle 40 comprises an IR light source 41 to illuminate a scenery, at least in problematic viewing conditions. Alternative to active lighting residual heat detection can also be used. The IR light source 41 may be switched on and off with a frequency correlating to a switching frequency of the conversion filter. FIG. 4 further shows that the IR light source 41 is integrated into a front light assembly of the vehicle 40. The vehicle 40 further comprises a matching unit 43 and a display unit 42 for processing and viewing the image provided by the camera system 10.

[0061] The embodiments shown here are only examples of the present invention and must therefore not be understood as restrictive. Alternative embodiments considered by the skilled person are equally covered by the scope of protection of the present invention.

REFERENCE SIGNS

[0062] 1 Detection system according to the present invention [0063] 10 Camera system [0064] 11 Image recording unit [0065] 12 Conversion filter [0066] 13 IR filter [0067] 14 Lens system [0068] 15 Aperture [0069] 16 Optical path [0070] 17 Lens [0071] 20 LED with IR filter [0072] 21 Anode layer [0073] 22 HBL [0074] 23 IR absorbing layer [0075] 24 HTL [0076] 25 EML [0077] 26 ETL [0078] 27 Cathode layer [0079] 30 RCCB [0080] 31 First segment [0081] 32 Second segment [0082] 33 Third segment [0083] 34 Fourth segment [0084] 40 Vehicle according to the present invention [0085] 41 Light source [0086] 42 Display [0087] 43 Image matching unit [0088] 50 Object [0089] 60 Driver