System for a vehicle
10081370 ยท 2018-09-25
Assignee
Inventors
- Hans Roth (Karlsruhe, DE)
- Olaf Preissner (Kirchheim unter Teck, DE)
- Michael Reuss (Bretten, DE)
- Stephan Bergmann (Muggensturm, DE)
Cpc classification
B60K2360/182
PERFORMING OPERATIONS; TRANSPORTING
B60R11/0229
PERFORMING OPERATIONS; TRANSPORTING
G01C21/365
PHYSICS
B60K35/29
PERFORMING OPERATIONS; TRANSPORTING
G02B2027/0141
PHYSICS
H04W4/16
ELECTRICITY
B60K2360/27
PERFORMING OPERATIONS; TRANSPORTING
H04N9/31
ELECTRICITY
H04N13/282
ELECTRICITY
H04N13/279
ELECTRICITY
G06F2203/04804
PHYSICS
B60K35/28
PERFORMING OPERATIONS; TRANSPORTING
H04W4/80
ELECTRICITY
B60K2360/146
PERFORMING OPERATIONS; TRANSPORTING
G06F3/017
PHYSICS
G08G1/09623
PHYSICS
B60W50/10
PERFORMING OPERATIONS; TRANSPORTING
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
H04N13/243
ELECTRICITY
G06F3/0481
PHYSICS
International classification
H04W4/80
ELECTRICITY
B60W50/10
PERFORMING OPERATIONS; TRANSPORTING
G08G1/0962
PHYSICS
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
G06F3/0481
PHYSICS
B60Q9/00
PERFORMING OPERATIONS; TRANSPORTING
H04W4/16
ELECTRICITY
H04M3/54
ELECTRICITY
B60R11/02
PERFORMING OPERATIONS; TRANSPORTING
Abstract
Embodiments are disclosed for systems for a vehicle. An example system for a vehicle includes a head-up display, a central unit having a circuit, connected to the head-up display, and a recording means for recording first image data of surroundings of the vehicle, wherein the circuit is configured to recognize an object in the surroundings based on the recorded first image data, wherein the head-up display is configured to project an image onto a windshield or onto a combiner of the vehicle, and wherein the circuit is configured to generate second image data for outputting the image and to send the image to the head-up display, to generate a virtual barrier in the second image data, and to position the virtual barrier within the image based on a determined position of the recognized object.
Claims
1. A system for a vehicle, comprising: a head-up display, a central unit having a circuit, connected to the head-up display wherein the central unit is configured to recognize a position of a driver's eyes, and a recording means for recording first image data of surroundings of the vehicle, whereby the recording means is connected to the circuit, wherein the circuit is configured to recognize an object in the surroundings based on the recorded first image data, wherein the head-up display is configured to project an image onto a windshield or onto a combiner of the vehicle in a field of view of a driver, wherein the circuit is configured to generate second image data for outputting the image and to send the image to the head-up display, wherein the circuit is configured to generate a three-dimensional virtual barrier in the second image data wherein the three-dimensional virtual barrier comprises a virtual wall or a row of traffic cones, wherein the circuit is configured to position the three-dimensional virtual barrier within the image based on a determined position of the recognized object, whereby the positioned three-dimensional virtual barrier in a view direction (VD) of the driver to the recognized object overlaps the recognized object at least partially, wherein the recognized object is a road marking or constructional boundary of a road, wherein the circuit is configured to align a plurality of points of the three-dimensional virtual barrier with a plurality of virtual points of the recognized object so that a shape of the three-dimensional virtual barrier is adapted to a course of the recognized object, wherein the three-dimensional virtual barrier is semi-transparent, and wherein a degree of transparency of the three-dimensional virtual barrier is changed depending on a determined distance of the vehicle to the recognized object.
2. The system according to claim 1, wherein the three-dimensional virtual barrier is a virtual wall.
3. The system according to claim 1, wherein the circuit is configured to generate the three-dimensional virtual barrier when a warning signal (S3) exceeds a threshold.
4. The system according to claim 3, wherein the circuit is configured to generate the warning signal (S3) based on a determined distance of the vehicle to the object.
5. The system according to claim 3, wherein the circuit is configured to generate the warning signal (S3) based on traffic rules.
6. The system according to claim 1, wherein the circuit is configured to recognize a road user, wherein the circuit is configured to generate a warning signal (S3) depending on recognition of the road user in a blind spot, and wherein the circuit is configured to generate the three-dimensional virtual barrier based on the warning signal (S3).
7. The system according to claim 1, wherein the circuit is further configured to generate an animated arrow in the second image data, the animated arrow showing a direction for correct driving.
8. The system according to claim 1, wherein the three-dimensional virtual barrier is generated with at least one of a color and a brightness, and wherein the at least one of the color and the brightness depends on a determined distance of the vehicle to the object.
9. The system of claim 1, wherein the circuit is configured to align the plurality of points of the three-dimensional virtual barrier with the plurality of virtual points of the recognized object based on a point of view of a user in the vehicle.
10. A system for a vehicle, comprising: a head-up display; a central unit having a circuit, connected to the head-up display, wherein the central unit is configured to recognize eyes of a driver; and a camera for recording first image data of surroundings of the vehicle, whereby the camera is connected to the circuit, wherein the circuit is configured to recognize an object in the surroundings based on the recorded first image data, wherein the head-up display is configured to project an image onto a windshield or onto a combiner of the vehicle in a field of view of the driver, wherein the circuit is configured to generate second image data for outputting the image and to send the image to the head-up display, wherein the circuit is configured to generate a virtual barrier in the second image data, wherein the circuit is configured to position the virtual barrier within the image based on a determined position of the recognized object, whereby the positioned virtual barrier in a view direction (VD) of the driver to the recognized object overlaps the recognized object at least partially, wherein the circuit is configured to recognize a road user, wherein the circuit is configured to generate a warning signal (S3) depending on recognition of the road user in a blind spot of the vehicle, wherein the circuit is configured to generate the virtual barrier based on the warning signal (S3), wherein the recognized object is a road marking, wherein the circuit is configured to position the virtual barrier so that a bottom area of the virtual barrier overlaps the recognized object, wherein the virtual barrier is semi-transparent, and wherein a degree of transparency of the virtual barrier is changed depending on a determined distance of the vehicle to the recognized object.
11. A system for a vehicle, comprising: a head-up display; a central unit having a circuit, connected to the head-up display, wherein the central unit is configured to recognize a position of eyes of a driver; and a recording means for recording first image data of surroundings of the vehicle, whereby the recording means is connected to the circuit, wherein the circuit is configured to recognize an object in the surroundings based on the recorded first image data, wherein the head-up display is configured to project an image onto a windshield or onto a combiner of the vehicle in a field of view of the driver, wherein the circuit is configured to generate second image data for outputting the image and to send the image to the head-up display, wherein the circuit is configured to generate a three-dimensional virtual barrier in the second image data, wherein the three-dimensional virtual barrier comprises a virtual wall or a row of traffic cones, wherein the circuit is configured to position the three-dimensional virtual barrier within the image based on a determined position of the recognized object, whereby the positioned three-dimensional virtual barrier in a view direction of the driver to the recognized object overlaps the recognized object at least partially, wherein the recognized object is a traffic sign, and wherein the traffic sign represents a no entry sign and is placed at an exit end of a one-way street, and wherein the three-dimensional virtual barrier is positioned to overlap the traffic sign and to virtually close the exit end of the one-way street to virtually hinder the driver from entering and driving in a wrong direction on the one-way street.
Description
BRIEF DESCRIPTION OF FIGURES
(1) The invention will be described in greater detail hereinafter by exemplary embodiments using graphic illustrations.
(2) Shown are:
(3)
(4)
(5)
(6)
(7)
(8)
DETAILED DESCRIPTION
(9)
(10) The infotainment system may have a central unit 500 providing a user interface. The infotainment system may have, or be in communication with, an instrument cluster display 520. According to one embodiment, the instrument cluster display 520 may be arranged inline with the position of steering wheel 130, so that the user may see the displayed information content through the openings in steering wheel 130. The instrument cluster display 520 may be a color screen.
(11) The infotainment system may have a head-up display 200. The head-up display may also be referred to as head unit display 200. The head-up display 200 may be configured to project an image 201 onto a front windshield 110. A surface of front windshield 110 may reflect the projected image 201 towards the user, in the case of one embodiment of
(12) The infotainment system may have adjustment means for adjusting the position of the projected image 201 within the plane the of front windshield 110. The adjustment means may comprise an actuating drive controlling the position of an optical element of the head-up display 200 and/or the head-up display 200 itself. The position and/or size of the reflection area 299 within the front windshield 110 may be controlled by means of parameters. The central unit 500 may be configured to ascertain the position of the user's eyes based on parameters of the adjustment of the projected image 201.
(13) According to one embodiment of
(14) The infotainment system may have an input device 603 in the central console. The input device 603 may be part of the user interface, and may have one or more push-buttons, input wheels, and so forth. The system may have an input device 604 integrated in steering wheel 130, having one or more push-buttons, switches, and so forth. The infotainment system may have an internal camera 510 recording an image of the user.
(15) The system may have recording means 611 for recording first image data of the surroundings of vehicle 100. The recording means in one embodiment of
(16)
(17) According to one embodiment of
(18) The system may have a recording means 611 for recording first image data S611 of the surroundings of vehicle 100. The recording means 611 is connected to the central unit 500. According to one embodiment the system may have one or more cameras 611, 612, 613, 614 positioned to record the image of the surroundings 400 of the vehicle 100. According to one embodiment, the central unit 500 may be connected to a front camera 611 capturing image data S611 of the road and traffic in front of the vehicle 100.
(19) Additionally the central unit 500 may be connected to a back camera 612 capturing image data S612 of the road and traffic behind the vehicle 100. The central unit 500 may be connected to a left camera 613 and/or to a right camera 614 recording an image correspondingly. The one or more cameras 611, 612, 613, 614 may be used to record the entire surroundings of the vehicle 100 concurrently.
(20) According to one embodiment, central unit 500 is configured to recognize an object of the surroundings based on the recorded first image data S611. The circuit 540 of the central unit 500 may be configured to run an object recognition program to recognize objects in the recorded image data S611, S612. The recognized object may be road markings or a road user like a vehicle.
(21) According to one embodiment, central unit 500 may be configured to generate second image data S200 for outputting image 201. The second image data S200 may be sent from central unit 500 to head-up display 200 via a connection, for example, a cable. Function block 542 of the circuit 540 may be configured to generate second image data S200 output to the head up display 200. Additionally the function block 542 of the circuit 540 may be configured to generate image data S530 output to the central display 530 of the central unit 500 and image data S520 output to the display 520.
(22) According to one embodiment, central unit 500 may be configured to generate a virtual barrier in the second image data S200. A virtual barrier may be a virtual wall or a row of traffic cones or the like, which may be computer generated by rendering as a vector graphic. According to one embodiment, central unit 500 may be configured to position the virtual barrier within the image based on a determined position of the recognized object, so that the positioned virtual barrier in the driver's view direction to the recognized object overlaps the recognized object at least partially.
(23) According to one embodiment in
(24) According to one embodiment, first function block 541 of circuit 540 of central unit 500 may be configured to generate a warning signal S3. Central unit 500 may be configured to generate the virtual barrier when warning signal S3 exceeds a threshold. According to one embodiment, central unit 500 may be configured to generate the warning signal S3 based on a determined distance of vehicle 100 to the object. Alternatively or in addition, warning signal S3 can be based, moreover, on other data, such as position data S609 of a position determining system 609 or signals from radar sensors 615, 616, 617, 619.
(25) Warning signal S3 may include data such as a value, a vector, or a matrix, which represents a risk of collision for vehicle 100. Warning signal S3 may be output to an input of control function block 542. The function block 542 may be configured to generate the second image data S200, S530, S520 based on the warning signal S3. In particular, virtual barrier 210 can be generated based on warning signal S3.
(26) According to one embodiment of
(27) A head-up display 200 and/or an instrument cluster display 520 and/or a central information display 530 of the central unit 500 and/or a first sensor 601 and/or a second sensor 602 and/or a first near field connection device 606 for connection with a mobile device 791 and/or a second near field connection device 607 for connection with a mobile device 792 and/or an input device 603, 604 may be connected to or in communication with circuit 540. The sensor 601, 602 may be of a contactless type. The sensor 601, 602 may be an infrared sensor.
(28) According to one embodiment, an infotainment system of a vehicle 100 may include an imaging system. The infotainment system may have a head-up display 200. The infotainment system may have a circuit 540 of a central unit 500 connectable to head-up display 200 and to central information display 530. The central unit 500 may be configured to send second image data S200 to the head-up display 200 to be displayed. The head-up display 200 may be configured to project an image 201 onto the front windshield 110, as shown in
(29) The central unit 500 may be configured to ascertain a user's point of view, the user's point of view being the position of the user's eyes. To ascertain the position of the user's eyes, the central unit 500 may be configured to evaluate image data S510 of an internal camera 510, recognizing the user's eyes and their position within the captured image.
(30) The image 201 may be projected within an area 299. The projected image 201 may be predefined, and may be adjustable by the user. The area 299 may be positioned to the driver's view. The position of the area 299 may be adjusted to steering wheel 130, so that the image 201 is viewable by the driver who is also able to observe the traffic in front of the vehicle 100. The image 201 may be at least partially transparent, for example, semitransparent. At least parts of the area 299 may be transparent during driving, so that the driver's view is not disturbed significantly.
(31) The infotainment system may have an interface 608 to a bus of the vehicle, e.g., a CAN bus, to retrieve vehicle data, e.g., the current speed, vehicle rain sensor data, and so forth. The infotainment system may have a satellite receiver 609 to receive position data S609 of the current position of the vehicle, such as GPS data or GLONASS data. The system may have a transceiver 610 for communicating with a wireless network such as, for example, a UMTS network, a LTE network, or a WLAN network.
(32) The infotainment system may have one or more distance sensors 615, 616, 617, 619. The distance sensors 615, 616, 617, 619 may be ultrasonic sensors or radar sensors, or any other device or system for measuring a distance to an object in the surroundings of the vehicle 100. The one or more distance sensors 615, 616, 617, 619 may be connectable to central unit 500.
(33) According to one embodiment of
(34)
(35) Additionally shown in
(36) According to one embodiment, the system may have as recording means a front camera 611 for recording first image data of surroundings 400 in front of vehicle 100. The front camera 611 may be connected to central unit 500. The central unit 500 may be configured to run a program with several method steps. The functions explained below can be executed by the steps of the program.
(37) An object 457 of surroundings 400 may be recognized by central unit 500 based on the recorded first image data of front camera 611. In one embodiment shown in
(38) Second image data may be generated by means of the central unit 500 for outputting the image 201 and sent to the head-up display (200), whereby a virtual barrier 210 may be generated by the central unit 500 in the second image data. It is shown in
(39) According to one embodiment the virtual barrier 210 is to be aligned to the recognized object 457 in the surroundings 400. In the view of the user 700 a virtual barrier 210 within the image 201 may be projected onto the windshield 110 of the vehicle. The virtual barrier 210 may be output as a part of the image data S200 by means of the central unit 500. A user's point of view 301 may be ascertained by means of the central unit 500. The user's point of view is the position 301 of the user's eyes.
(40) A view of driver 700 through windshield 110 of vehicle 100 according to
(41) According to one embodiment of
(42)
(43) According to one embodiment of
(44) The central unit 500 may be configured to send image data S200 to the head-up display 200 to be displayed. The head-up display 200 may be configured to project an image 201 onto the front windshield 110 visible to the user 700 (such as the driver) in the vehicle 100. The image 201 may be based on the image data S200.
(45) The central unit 500 may be configured to output a virtual barrier 210, when an estimated distance between the vehicle 100 and the recognized limitation 459 is below a threshold. The central unit 500 may be configured to include the virtual barrier 210 in the image data S200 so that a position of the virtual barrier 210 and the position of the limitation 459 overlap in a view of the user 700 of the vehicle 100. A virtual point 411 of the limitation 459 in the surrounding 400 of the vehicle 100 may be ascertained based on the recorded image. In the view of the user 700 at least one point 211 of the virtual barrier 210 may be aligned to the virtual point 411 by means of the central unit 500, wherein the alignment is based on the user's point of view 301. Additionally a plurality of points of the virtual barrier 210 may be aligned to a plurality of virtual points of the recognized limitation, so that the shape of the virtual barrier 210 may be adapted to the course of the limitation.
(46) According to one embodiment of
(47)
(48) According to one embodiment, central unit 500 may be configured to recognize a road user located in the blind spot or approaching the blind spot. According to one embodiment, central unit 500 may be configured to generate a warning signal S3 depending on the recognition of the road user in the blind spot. Warning signal S3 may be evaluated by central unit 500 and virtual barrier 210 in image 201 may be output based on warning signal S3.
(49) According to one embodiment of
(50) The central unit 500 may be configured to send image data S200 to the head-up display 200 to be displayed. The head-up display 200 may be configured to project an image 201 onto the front windshield 110 visible to the user 700 (such as the driver) in the vehicle 100. The image 201 may be based on the image data S200.
(51) The central unit 500 is configured to output a virtual barrier 210 as a symbol 210, when a road user is detected on the other side of the marking 458. The road user may not be visible to the user of the vehicle 100, if the road user is currently in the blind spot. The road user may be detected by evaluating the signals of distance sensors or image data.
(52) The central unit 500 may be configured to include the virtual barrier 210 in the image data S200 so that a position of the virtual barrier 210 and the position of the marking 458 overlap in a view of the user 700 of the vehicle 100. A virtual point 411 of the marking 458 in the surrounding 400 of the vehicle 100 may be ascertained based on the recorded image. In the view of the user 700 at least one point 211 of the virtual barrier 210 may be aligned to the virtual point 411 by means of the central unit 500, wherein the alignment is based on the user's point of view 301.
(53) According to one embodiment of
(54) The invention is not limited to the shown embodiments in
LIST OF REFERENCE CHARACTERS
(55) 100 Vehicle 110 Windshield 120 Dashboard 130 Steering wheel 140, 150 Seat 170 Gearshift 200 Head-up display 201 Image 205 Symbol 210 Virtual barrier 211 Point 299 Area 400 Surroundings 411 Point 457, 458, 459 Object 500 Central unit 510 Internal camera 520, 530 Display 540 Circuit 541, 542 Function block 601, 602 Gesture sensor 603, 604 Input Device 605 Microphone 606, 607 Near Field Communication Device 609 Satellite receiver, GPS 608 Bus interface 610 Transceiver 611, 612, 613, 614 Camera 615, 616, 617, 619 Radar sensor 791, 792 Mobile phone, smartphone VD View direction S3 Warning signal S200, S201, S510, S520, S530, S609, S611, S612 Data