System for a vehicle
10071747 ยท 2018-09-11
Assignee
Inventors
- Hans Roth (Karlsruhe, DE)
- Olaf Preissner (Kirchheim unter Teck, DE)
- Christoph Reifenrath (Erftstadt, DE)
Cpc classification
B60K2360/182
PERFORMING OPERATIONS; TRANSPORTING
G01C21/365
PHYSICS
B60R11/0229
PERFORMING OPERATIONS; TRANSPORTING
B60K35/29
PERFORMING OPERATIONS; TRANSPORTING
G02B2027/0141
PHYSICS
H04W4/16
ELECTRICITY
B60K2360/27
PERFORMING OPERATIONS; TRANSPORTING
H04N9/31
ELECTRICITY
H04N13/282
ELECTRICITY
H04N13/279
ELECTRICITY
G06F2203/04804
PHYSICS
B60K35/28
PERFORMING OPERATIONS; TRANSPORTING
H04W4/80
ELECTRICITY
B60K2360/146
PERFORMING OPERATIONS; TRANSPORTING
G06F3/017
PHYSICS
G08G1/09623
PHYSICS
B60W50/10
PERFORMING OPERATIONS; TRANSPORTING
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
H04N13/243
ELECTRICITY
G06F3/0481
PHYSICS
International classification
H04N9/31
ELECTRICITY
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
B60Q9/00
PERFORMING OPERATIONS; TRANSPORTING
H04M3/54
ELECTRICITY
B60R11/02
PERFORMING OPERATIONS; TRANSPORTING
G06F3/0481
PHYSICS
G08G1/0962
PHYSICS
H04W4/16
ELECTRICITY
B60W50/10
PERFORMING OPERATIONS; TRANSPORTING
H04N13/282
ELECTRICITY
H04N13/279
ELECTRICITY
H04N13/243
ELECTRICITY
H04W4/80
ELECTRICITY
Abstract
Embodiments are disclosed for systems for a vehicle. An example system for a vehicle includes a head-up display and a circuit, which is connected to the head-up display, wherein the head-up display is configured to project an image onto a front windshield of the vehicle or onto a separate combiner, wherein the circuit is configured to output image data to the head-up display, whereby the image data have a set of objects which include messages for the user, to determine a user's workload level, based on a set of driving conditions, to switch between at least one first workload mode and a second workload mode based on the level, whereby the second workload mode is assigned a higher level than the first workload mode, and in the second workload mode to reduce at least one object, which is output in the first workload mode.
Claims
1. A system for a vehicle, comprising: a head-up display; and a circuit, which is connected to the head-up display, wherein the head-up display is configured to project an image onto a front windshield of the vehicle or onto a separate combiner, wherein the circuit is configured to output image data to the head-up display in order to generate the image, whereby the image data has a set of objects which includes messages for a user, wherein the circuit is configured to determine a user's workload level for operating the vehicle, based on a set of driving conditions, the set of driving conditions including at least a road situation, wherein the circuit is configured, based on the user's workload level, to switch between at least one first workload mode and a second workload mode, whereby the second workload mode is assigned a higher user's workload level than the first workload mode, wherein the circuit is configured, in the second workload mode, to reduce at least one object, which is output in the first workload mode such that a combined user's workload comprising the user's workload level for operating the vehicle and a user's workload for comprehending a content of the image is reduced in the second workload mode as compared to the first workload mode, and wherein, to reduce the at least one object, the circuit is configured to make the object in the image smaller, or to increase a transparency of the object and fade out the object.
2. The system according to claim 1, wherein, to reduce the at least one object, the circuit is further configured to move the object within the image away from a central position into a predetermined area.
3. The system according to claim 1, wherein the circuit is configured, during or after the reduction, to output a message associated with the object by means of another object in another display apart from the front windshield or combiner.
4. The system according to claim 1, wherein the circuit is configured to determine an input by the user, and the circuit is configured, based on the input, to start an application program, whereby the object is associated with the application program.
5. The system according to claim 1, wherein the circuit is configured to prioritize the objects of the set, and the circuit is configured to reduce first the object with a lowest priority in the second workload mode.
6. The system according to claim 1, wherein the circuit is configured to switch to a warning mode, and the circuit is configured, in the warning mode, to reduce at least one of the objects of the set and to output at least one warning object at least temporarily in the image data.
7. A method for controlling a head-up display for a vehicle, comprising: projecting an image onto a front windshield of the vehicle or onto a separate combiner by means of the head-up display, outputting image data from a circuit, connected to the head-up display, to the head-up display to generate the image, whereby the image data has a set of objects that includes messages for a user, determining a level of a user's workload for operating the vehicle based on a set of driving conditions by means of the circuit, the set of driving conditions including at least a road situation, switching between at least a first workload mode and a second workload mode based on the user's workload level, whereby the second workload mode is assigned a higher user's workload level than the first workload mode, and reducing at least one object of the set, output in the first workload mode, in the second workload mode, such that a combined user's workload comprising the user's workload level for operating the vehicle and a user's workload for comprehending a content of the image is reduced in the second workload mode as compared to the first workload mode, wherein reducing the at least one object includes moving the object within the image away from a central position into a predetermined area, and fading out the object.
8. The system according to claim 1, wherein the circuit is configured to determine the user's workload level based on a traffic density.
9. The system according to claim 1, wherein, to reduce the at least one object, the circuit is configured to move the object within the image away from a central position to an edge area of the image.
10. The system according to claim 1, wherein the at least one object comprises a video object, wherein the circuit is configured to determine the user's workload level based on a remaining time of a red phase of a traffic light, and wherein the circuit is configured, in the second workload mode, to stop and fade out the video object.
11. The system according to claim 1, wherein the at least one object comprises a text object, wherein the circuit is configured to determine the user's workload level based on a transition of the vehicle from standing still to moving, and wherein the circuit is configured, in the second workload mode, to move the text object within the image from a central position to a lower edge of the image.
12. A system for a vehicle, the system comprising: a head-up display; and a circuit, which is connected to the head-up display, wherein the head-up display is configured to project an image onto a front windshield of the vehicle or onto a separate combiner, wherein the circuit is configured to output image data to the head-up display in order to generate the image, whereby the image data has a set of objects that include messages for a user, wherein the circuit is configured to determine a user's workload level based on a set of driving conditions, wherein the circuit is configured, based on the user's workload level, to switch between at least one first workload mode and a second workload mode, whereby the second workload mode is assigned a higher user's workload level than the first workload mode, wherein the circuit is configured, in the second workload mode, to reduce at least one object, which is output in the first workload mode, wherein the at least one object comprises a video object, wherein the circuit is configured to determine the user's workload level based on a remaining time of a red phase of a traffic light, and wherein the circuit is configured, in the second workload mode, to stop and fade out the video object.
13. The method of claim 7, further comprising prioritizing the objects of the set, and wherein reducing the at least one object includes reducing first the object with a lowest priority in the second workload mode.
14. The method of claim 7, further comprising determining the user's workload level based on a traffic density.
15. The method of claim 7, wherein the at least one object comprises a text object, the method further comprising determining the user's workload level based on a transition of the vehicle from standing still to moving, and, in the second workload mode, moving the text object within the image from a central position to a lower edge of the image.
Description
BRIEF DESCRIPTION OF FIGURES
(1) The invention will be described in greater detail hereinafter by exemplary embodiments using graphic illustrations.
(2) In the drawing:
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
DETAILED DESCRIPTION
(12) A view of a vehicle interior is shown schematically in
(13) In one embodiment of
(14) The driver can rapidly receive information via image 201 of head-up display 200 without having to look away from traffic. In principle, it is therefore desirable to make as much information as possible available to the driver via head-up display 200. A too high information density, in contrast, can overload the driver or distract him from traffic, when the information needed in the current situation, e.g., navigation symbol 212, is hidden between other objects 312, 211, 210 in image 201.
(15) To optimize the provision of information in image 201, an adaptive workload management system may be implemented in an infotainment system of vehicle 100. Accordingly, the system may have a head-up display 200 and a circuit 540. Circuit 540 is shown schematically in
(16) The circuit 540 may be configured to output image data S200 to the head-up display 200 in order to generate the image 201. The image data S200 here may include objects 210, 211, 212, 213 illustrated in the embodiment of
(17) The circuit 540 may be configured to determine a level L of a user's workload based on a set of driving conditions. In one embodiment of
(18) The circuit may be configured, based on the level L, to switch between at least a first workload mode M1 and a second workload mode M2. The first workload mode M1 and the second workload mode M2 may be controlled in a second function block 542 of circuit 540. The level L may be evaluated to determine the specific workload mode M1, M2. The level L may be evaluated by means of an algorithm. In the simplest case, the level L may be compared with a threshold.
(19) To the second workload mode M2 a higher level L is assigned than to the first workload mode M1. If level L exceeds a threshold in one especially simple embodiment, the second workload mode M2 is active. If, in contrast, level L falls below the threshold, the first workload mode M1 is active.
(20) The output of image 201 in head-up display 200 may be controlled in such a way with first workload mode M1 and second workload mode M2 that the workload is adaptively adjusted to the driving situation. For example, the arrival time and the current speed are not required in an upcoming lane change. To change a lane, the driver rather should be able to concentrate completely on the traffic. A mere delay in information output is not helpful here. Rather, the goal in the second workload mode M2, which belongs to a higher workload level L, is to reduce the information in the image of head-up display 200 in order to increase the transparency. Accordingly, circuit 540 may be configured in the second workload mode M2 to reduce at least one object 210, 213 of the set, output in the first workload mode M1. To reduce the object 210, 213, the object 210, 213 can be faded out or the object 210, 213 may be output smaller or transparent. By means of this reduction of the object 210, 213, the visibility of the traffic in front of vehicle 100 is increased and at the same time the driver's attention to the remaining objects 212 is increased.
(21) In one embodiment, circuit 540 may be configured after the reduction to output the message associated with object 212, 213 by means of another object 513 in another display 520 apart from front windshield 110. If message image 213 in
(22) In one embodiment an imaging system may be provided in connection with an infotainment system of a motor vehicle 100.
(23) The infotainment system may have a first sensor 601 and a second sensor 602. The first sensor 601 and a second sensor 602 may be infrared-sensor. The first sensor 601 and a second sensor 602 can be positioned in predetermined locations, such as to sense a movement of a hand of a user of the vehicle 100. The infotainment system may have an input device 603. The input device 603 may be part of the user interface, and may have one or more push buttons, input wheels, and so forth.
(24)
(25) According to one embodiment, an infotainment system of a vehicle 100 may include an imaging system. The infotainment system may have a head-up display 200 and a central information display 530 and a sensor 601, 602 for detecting a user's gestures. The infotainment system may have a circuit 540 of a central unit 500 connectable to the head-up display 200 and to the central information display 530 and to the sensor 601, 602.
(26) The circuit 540 of the central unit 500 may be configured to send first image data S200 to the head-up display 200 and second image data S530 to the central information display 530 to be displayed. The head-up display 200 may be configured to project an image 201 onto the front windshield 110 as shown in
(27) The central information display 530 may have a screen configured to display an image based on the second image data S530. The central unit 500 may be configured to add content information to the first image data S200 for the head-up display 200 and to reduce content information from the first image data S200 for the head-up display 200, when a corresponding gesture of the user is detectable by means of the sensor 601, 602.
(28) The first image data S200 and second image data S530 may be different. Reducing information included in the first image data S200 reduces strain on the driver. Driver's workload in comprehending the content of the image 201 is therefore reduced.
(29) The image 201 may be projected within an area 299. The projected image 201 may be predefined, and may be adjustable by the user. The area 299 may be positioned within the driver's view. The position of the area 299 may be adjusted to the steering wheel 110, so that the image 201 is viewable by the driver while also being able to observe the traffic in front of the vehicle 100. The image 201 may be at least partially transparent, such as semitransparent. At least parts of the area 299 may be transparent during driving, so that the driver's view is not obstructed significantly.
(30) According to one embodiment, an infotainment system of a vehicle 100 that includes the imaging system is provided. The infotainment system may have a display 200, 520, 530. The infotainment system may have a sensor 601 for detecting gestures of a user. The infotainment system may have a circuit 540 of a central unit 500 connectable to the display 200, 520, 530 and to the sensor 601, 602. The sensor 601, 602 may be of a contactless type. The sensor 601, 602 may be an infrared sensor.
(31) An interior camera 510 may be connected to circuit 540 of the central unit 500. The interior camera 510 may be aligned to record a user's face, especially the face of the driver of the vehicle 100, to determine eye movements. The infotainment system may have a microphone 605 to record the voice of the user. The infotainment system may be configured to run a voice recognition program. The infotainment system may have an interface 608 to a CAN bus of the vehicle 100 to retrieve data of the vehicle 100, e.g. the current speed, vehicle rain sensor data, and so forth. The infotainment system may have a satellite receiver 609 to receive position data S609 of the current position of the vehicle 100, such as GPS data or GLONASS data.
(32) The infotainment system may have one or more cameras 611, 612, 613, 614 positioned to record an image of the surroundings 400 of the vehicle 100. According to one example, circuit 540 of the central unit 500 may be connected to a front camera 611 capturing image data S611 of the road and traffic in front of the vehicle 100. The circuit 540 of the central unit 500 may be connected to a back camera 612 capturing image data S612 of the road and traffic behind the vehicle 100. The circuit 540 of the central unit 500 may be connected to a left camera 613 and/or to a right camera 614 recording an image correspondingly. The one or more cameras 611, 612, 613, 614 may be used to record a complete surroundings of the vehicle 100 concurrently. The central unit 500 may be configured to run an object recognition program to recognize objects, such as road users like vehicles, in the recorded image data S611, S612.
(33) The infotainment system may have one or more distance sensors 615, 616, 617, 619. The distance sensors 615, 616, 617, 619 may be ultrasonic sensors or radar sensors, or any other device or system for measuring distance that is connectable to the circuit 540 of the central unit 500.
(34) According to one embodiment, circuit 540 may be configured to switch to a warning mode W. Warning mode W in
(35) According to one embodiment of
(36) The user may input by making a gesture at a sensor 601, 602 to reduce information displayed. The central unit 500 may be configured to display one or more route guidance symbols 212 for a predefined time frame. The central unit 500 may be configured to display the route guidance symbols 212 depending on the current position of the vehicle 100 and a next maneuver point on a previously calculated route.
(37) One embodiment in
(38) In one embodiment of
(39) Warning mode W can be determined in different ways. In one embodiment, circuit 540 may be configured to control warning mode W based on received traffic data, whereby the traffic data can be transmitted, for example, via the radio or a wireless network (UMTS, LTE, etc.). In one further embodiment, the circuit 540 may be configured to determine warning mode W based on measured data for the surroundings 400 of vehicle 100. The warning mode W may be determined based on a density of vehicles in the surroundings 400. The density of the vehicles may be determined by means of object recognition or distance measurement (radar).
(40) According to one example of
(41) According to one embodiment of
(42) The circuit 540 of the central unit 500 may be configured to send image data S200 to the head-up display 200 to be displayed. The head-up display 200 may be configured to project an image 201 onto the front windshield 110. The image 201 may be based on the image data S200.
(43) The central unit 500 may be configured to output a first information item 218 and a second information item 212. The first information item 218 may have a higher priority than the second information item 212. The central unit 500 may be configured to replace the second information item 212 by the first information item 218, when an alert signal is estimated based on measured traffic-related data and/or received traffic-related data.
(44) The average speed of road users in front of vehicle 100 may be compared with a threshold. If the average speed of the road users is below the threshold a warning symbol 218 as the first information 218 may be displayed. Traffic congestion data may be received wirelessly, such as from a radio station. As the vehicle 100 approaches the traffic congestion a warning symbol 218 may be shown as the first information 218. The second information 212 of lower priority is, for example, a route guidance symbol 212, as shown in
(45) According to one embodiment, a first workload mode M1 may be controlled in
(46) In contrast, in one embodiment of
(47) According to one embodiment, an infotainment system of a vehicle 100 that includes an imaging system is provided. The infotainment system may have a head-up display 200. The infotainment system may have a central unit 500 having a circuit 540 connectable to the head-up display 200. The central unit 500 may be configured to send image data S200 to the head-up display 200 to be displayed. The head-up display 200 may be configured to project an image 201 onto the front windshield 110 or onto a separate combiner. The image 201 may be based on the image data S200. The central unit 500 may be configured to output a graphic 213 (picture, text). The central unit 500 may be configured to size the graphic within the image data S200, so that the size of the graphic 213 is smaller when the vehicle 100 is in motion, such as during driving of the vehicle 100, in comparison with the size of the graphic 213 when the vehicle 100 is not in motion.
(48) The central unit 500 may be configured to move the graphic 213 within the image data S200, so that graphic 213 is moved from a central position to an edge area in the image data S200.
(49) According to one embodiment of
(50) One further embodiment with a change from a first workload mode M1 to a second workload mode M2 is shown schematically in
(51) According to one embodiment of
(52) The driving condition may be defined in one embodiment of
(53) One further embodiment with a change from a first workload mode M1 to a second workload mode M2 is shown schematically in
(54) According to one embodiment of
(55) The aforementioned embodiments provide an imaging system of a motor vehicle 100. The imaging system may have an image capture device 611 which is configured to record an image of the surroundings of the motor vehicle 100 in the form of image data S611, as shown also in
(56) A central unit 500 of the imaging system may include or be in communication with a circuit 540, which may have an processor 540. The processor 540 may be configured to determine a virtual space from the image data S611. The processor 540 may be configured to detect a real object in the image data S611. The processor 540 may be configured to add a virtual element to the virtual space.
(57) The imaging system may be a part of an infotainment system of the motor vehicle 100, the infotainment system being connected to the image capture device 611, for example, via cables or a communication bus.
(58) The image capture device 611 may be an optical system for recording image data S611. The image capture device 611 may have a plurality of cameras, for example, CMOS or CCD cameras. The cameras may be situated for stereoscopic recording. The processor 540 may be a central processing unit (CPU) or a digital signal processor (DSP).
(59) The virtual space may be determined in three dimensions based on the geometry of a road of the surroundings 400. For example, a distance may be ascertained based on the geometry of a road, and the detected object may be situated in the ascertained distance within the virtual space.
(60) While various embodiments of the invention have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the invention. Accordingly, the invention is not limited to the aforementioned embodiments.