Sign display apparatus and method for vehicle
10300853 ยท 2019-05-28
Assignee
Inventors
Cpc classification
B60K35/215
PERFORMING OPERATIONS; TRANSPORTING
B60R11/04
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/80
PERFORMING OPERATIONS; TRANSPORTING
B60K35/29
PERFORMING OPERATIONS; TRANSPORTING
G08G1/0967
PHYSICS
G06V20/588
PHYSICS
B60K2360/5915
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/27
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/308
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/184
PERFORMING OPERATIONS; TRANSPORTING
B60K35/28
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/186
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/307
PERFORMING OPERATIONS; TRANSPORTING
B60K35/60
PERFORMING OPERATIONS; TRANSPORTING
B60K35/85
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/302
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/103
PERFORMING OPERATIONS; TRANSPORTING
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/592
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
H04N7/18
ELECTRICITY
B60R11/04
PERFORMING OPERATIONS; TRANSPORTING
B60R1/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
Sign information of a traffic sign or a road marking ahead of a vehicle is detected. When two or more kinds of sign information having overlapping effective sections are detected or when the sign information contains textural information including a predetermined or more number of characters, simplified information obtained by simplifying the sign information is displayed on an MID in the vehicle.
Claims
1. A sign display apparatus for a vehicle comprising: a sign information detector that detects sign information of a traffic sign existing on a road or on a road marking ahead of the vehicle; a display device that displays the sign information detected by the sign information detector; a control circuit configured to: (i) control the display device; (ii) detect an effective section of the detected traffic sign in which the traffic sign is considered to be effective; and (iii) determine whether or not the detected sign information contains textural information including a predetermined or more number of characters; and a memory which stores therein simplified textural information in association with the textural information of a corresponding traffic sign, the simplified textural information being composed of a reduced number of the characters representing the corresponding traffic sign, wherein when it is determined that the detected sign information contains the textural information including the predetermined or more number of characters, the display device is controlled to display the simplified textural information composed of the reduced number of the characters representing the corresponding traffic sign.
2. The sign display apparatus for the vehicle according to claim 1, wherein, when the sign information detected by the sign information detector contains maximum speed limit information and the textural information or symbolic information other than the maximum speed limit information, the display device is controlled to display the maximum speed limit information and additionally display the simplified information of the simplified textural information or symbolic information.
3. The sign display apparatus for the vehicle according to claim 1, wherein the control circuit is further configured to determine whether or not the sign information detector detects a plurality of traffic signs having effective sections which overlap each other, and when it is determined that the detected sign information contains the plurality of traffic signs having the overlapping effective sections, the display device is controlled to alternately display first simplified information of at least one traffic sign and second simplified information of a traffic sign other than said at least one traffic sign while switching the first and second simplified information in predetermined time intervals.
4. The sign display apparatus for the vehicle according to claim 1, wherein the sign display apparatus comprises a plurality of different sign information detectors, and the display device displays the simplified information in a form that varies depending on the sign information detector that detects the sign information.
5. The sign display apparatus for the vehicle according to claim 1, wherein the display device displays a passage information indicator beside the simplified information, the passage information indicator being configured to change in its amount to be displayed according to a traveling distance of the vehicle or an elapsed time after the simplified information is displayed, and when the amount of the passage information indicator exceeds a predetermined amount, the display device hides the simplified information.
6. A sign display apparatus for a vehicle, comprising: a sign information detector that detects sign information of a traffic sign existing on a road or on a road marking ahead of the vehicle; a display device that displays the sign information detected by the sign information detector; a control circuit configured to: (i) control the display device; (ii) detect an effective section of the detected traffic sign in which the traffic sign is considered to be effective; (iii) determine whether or not the sign information detector detects a plurality of traffic signs having effective sections which overlap each other; and (iv) determine whether or not the detected sign information contains textural information including a predetermined or more number of characters; and a memory which stores therein simplified information a corresponding traffic sign, wherein when it is determined that the sign information detector detects the plurality of traffic signs having the overlapping effective sections or when it is determined that the detected sign information contains the textural information including the predetermined or more number of characters, the display device is controlled to display the simplified information of at least one of the traffic signs or of the traffic sign containing the textural information, the display device has a sign display region in which the simplified information is displayed and a selective display region which has a display area larger than a display area of the sign display region and in which either of the sign information or information other than the sign information is selectively displayed, the display device displays the simplified information in the sign display region, and when the sign information is selected to be displayed in the selective display region, the display device displays in the selective display region the sign information which contains an information amount larger than an information amount of the simplified information.
7. The sign display apparatus for the vehicle according to claim 6, wherein the display device hides the simplified information in the sign display region while displaying the sign information in the selective display region, and when a traveling distance of the vehicle or an elapsed time becomes equal to or larger than a threshold after the sign information is displayed in the selective indication region, the display device hides the sign information in the selective display region and displays the simplified information in the sign display region.
8. A sign display method for a vehicle comprising: detecting sign information of a traffic sign existing on a road or a road marking ahead of the vehicle; detecting an effective section of the detected traffic sign in which the traffic sign is considered to be effective; determining whether or not the detected sign information contains textural information including a predetermined number or more of characters; providing simplified textural information of a corresponding traffic sign, the simplified textural information being composed of a reduced number of the characters representing the corresponding traffic sign; and when the detected sign information contains the textural information including the predetermined or more number of characters, displaying the simplified textural information composed of the reduced number of the characters representing the corresponding traffic sign on a display device of the vehicle.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
DESCRIPTION OF THE PREFERRED EMBODIMENTS
(14) A sign display apparatus for a vehicle and a sign display method for a vehicle according to preferred embodiments are explained in detail below with reference to the accompanying drawings.
1. Interior of a Vehicle 10
(15) An interior of a vehicle 10 is explained with reference to
(16) As shown in
(17) A camera 36 is provided on the inner side of a windshield 32 and near a rearview mirror 34. The camera 36 is attached to face the front of the vehicle 10. As the camera 36, various cameras (a monocular camera, a stereo camera, an infrared camera, etc.) can be used. The camera 36 captures images of the front of the vehicle 10 always or in predetermined time intervals, and also captures images of a traffic sign 40 and/or a road marking 42 indicating sign information at this point.
(18) A wireless receiver 44 for performing road-to-vehicle communication is provided on the left side in the vehicle width direction of the dashboard 14. The wireless receiver 44 may be incorporated in the car navigation device 16. The wireless receiver 44 receives a signal transmitted from the outside of the vehicle 10. When the traveling road 38 is a main road (including an expressway), a plurality of wireless transmitters 46, for example, optical beacons that transmit traffic information (including sign information) with light and radio wave beacons that transmit traffic information (including sign information) with a radio wave are set along the traveling road 38. The wireless transmitters 46 are managed by a not-shown information managing unit. A sign information providing system is constructed by the information managing unit and the wireless transmitters 46. As such a system, there is, for example, a vehicle information and communication system (VICS) (registered trademark). When the wireless transmitters 46 are the optical beacons, a signal receiving area is several meters in front of or behind a part right under the beacon. When the wireless transmitters 46 are the radio wave beacons, a signal receiving area is several ten meters in front of or behind a part right under the beacon. The wireless receiver 44 receives signals of traffic information transmitted from the wireless transmitters 46 in the receiving area. Note that the sign display apparatus for a vehicle may include a wireless receiver 44 that performs vehicle-to-vehicle communication instead of or in addition to the road-to-vehicle communication.
(19) The information terminal 48 is a smartphone, a tablet terminal, or the like installed with application software for car navigation. As shown in
2. Configuration of a Sign Display Apparatus for a Vehicle 60
(20) The configuration of a sign display apparatus for a vehicle 60 according to the this embodiment is explained with reference to
(21) The car navigation device 16, the camera 36, the wireless receiver 44, and the information terminal 48 detect sign information and output signals including the sign information to the ECU 64. A traveling distance sensor 62 detects a traveling distance of the vehicle 10.
(22) The ECU 64 is a control circuit that controls the display device (the MID 28) on the basis of sign information. The ECU 64 is a computer including a microcomputer and includes a CPU (central processing unit), a ROM (including an EEPROM), a RAM (random access memory), and input and output devices such as an A/D converter and a D/A converter. The CPU reads out and executes computer programs recorded in the ROM, whereby the ECU 64 functions as various function realizing units. In this embodiment, the ECU 64 executes the computer programs to thereby function as a recognizing unit 66, an effective-section judging unit 78, a display processing unit 80, and an instructing unit 82. The ECU 64 includes a storage 86 and a timer 88. The ECU 64 may be divided into a plurality of units or may be integrated with other ECUs. Note that the ECU 64 can also be realized by other hardware.
(23) The recognizing unit 66 is configured to recognize sign information from an input signal. The recognizing unit 66 includes an image information recognizer 68, a wireless information recognizer 70, a navigation information recognizer 72, and a network information recognizer 74.
(24) The image information recognizer 68 is configured to process an image ahead of the vehicle 10 captured by the camera 36 and recognize sign information indicated by the traffic sign 40 and the road marking 42. The image information recognizer 68 is capable of performing publicly-known traffic sign recognition processing such as pattern matching. For example, the image information recognizer 68 is configured to recognize signs (the traffic sign 40 and the road marking 42) out of the image ahead of the vehicle 10 captured by the camera 36, remove noise of recognized images (images of the traffic sign 40 and the road marking 42), and recognize a type of the sign information.
(25) The wireless information recognizer 70 is configured to recognize sign information and effective section information indicating an effective section of the sign information from a signal received by the wireless receiver 44. The wireless transmitters 46 transmit various kinds of traffic information. The wireless information recognizer 70 recognizes the sign information and the effective sign information out of the traffic information.
(26) The navigation information recognizer 72 is configured to recognize sign information and effective section information included in map information around the vehicle 10 detected by the navigation device 16. Similarly, the network information recognizer 74 is configured to recognize sign information and effective section information included in map information around the vehicle 10 detected by the information terminal 48.
(27) The effective-section judging unit 78 is configured to judge whether the vehicle 10 is traveling in an effective section of sign information detected by the recognizing unit 66. For example, the traffic sign 40 (see
(28) The display processing unit 80 is configured to perform processing concerning display of the MID 28. Specifically, the display processing unit 80 changes sign information recognized by the recognizing unit 66 to simplified information. The simplified information is simplified sign information. Simplification in this specification means reducing the number of characters of the sign information or converting a mark of the sign information into characters. A display area of the simplified information is smaller than a display area of the sign information. The display processing unit 80 determines, according to an information source of the sign information, a display mode of the simplified information, for example, a display color, an image shape, and a symbol to be added. In this embodiment, the information source is an image of the traffic sign 40 or the road marking 42 captured by the camera 36, traffic information received by the wireless receiver 44, map information stored by the car navigation device 16, and map information stored by the information terminal 48. The display processing unit 80 determines in which of the sign indication region 28a and the selective indication region 28b of the MID 28 the simplified information should be displayed. The instructing unit 82 is configured to receive a processing result of the display processing unit 80 and output a display instruction to the MID 28.
(29) The storage 86 stores the sign information and the simplified information in association with each other. The timer 88 measures various times.
(30) Note that the ECU 64 is capable of selecting, according to a signal output from the selection switch 90, a sign information detector (the camera 36, the wireless receiver 44, the car navigation device 16, or the information terminal 48) to be used. The selection switch 90 is operated by the occupant as appropriate.
3. Sign Display Processing
(31) Basic processing (sign display processing 1) and additional processing (sign display processing 2 to 4) performed in the sign display apparatus for a vehicle 60 are explained below.
(32) [3-1. Sign Display Processing 1]
(33) Various regulations, warnings, and the like are set on the traveling road 38. For example, one or a plurality of traffic signs 40 or road markings 42 are set on the traveling road 38. One or more kinds of sign information are transmitted from the wireless transmitters 46. The sign display apparatus for a vehicle 60 detects sign information indicating one or a plurality of regulations, warnings, and the like set on the traveling road 38, simplifies the sign information, and displays the sign information on the display device. In the following explanation, processing executed in the sign display apparatus for a vehicle 60 is explained with reference to
(34) In step S1, sign information is detected. The camera 36 images the front of the vehicle 10 at a predetermined time interval. An image captured by the camera 36 is captured into the image information recognizer 68. The image information recognizer 68 performs a series of sign recognition processing. At this point, when images of the traffic signs 40 and the road markings 42 are included, the image information recognizer 68 recognizes sign information indicated by all of the traffic signs 40 and the road markings 42 included in the images. When the vehicle 10 is located in a reception area of signals transmitted by the wireless transmitters 46, the wireless receiver 44 receives the signals transmitted from the wireless transmitters 46. The wireless information recognizer 70 recognizes the sign information from the signal received by the wireless receiver 44. The car navigation device 16 measures the position of the vehicle 10. The navigation information recognizer 72 recognizes sign information of the position of the vehicle 10 from the map information of the car navigation device 16. The information terminal 48 measures the position of the vehicle 10. The network information recognizer 74 recognizes the sign information of the position of the vehicle 10 from the map information of the information terminal 48.
(35) In step S2, it is judged whether maximum speed information is present. The maximum speed information is sign information indicating maximum speed of the traveling road 38. It is judged whether maximum speed information effective at that point in time is present in the latest sign information detected in step S1 and sign information detected in the previous processing. When the effective maximum speed information is present (YES in step S2), the processing shifts to processing in step S3. On the other hand, when the effective maximum speed information is absent (NO in step S2), the processing shifts to processing in step S8.
(36) Note that, when kinds of maximum speed information of a plurality of information sources are effective, it is possible to select any kind of maximum speed information. For example, it is possible to set priority order of the information sources in advance and select the maximum speed information detected from the information source having high priority order. It is also possible to change the priority order according to a situation.
(37) In step S3, it is judged whether symbolic information is present in the sign information. The symbolic information is sign information such as a regulation, a warning, or the like indicated by a visual mark (a pictograph). It is judged whether symbolic information effective at that point in time is present in the latest sign information detected in step S1 and the sign information detected in the previous processing. When the effective symbolic information is present (YES in step S3), the processing shifts to processing in step S5. On the other hand when the effective sign information is absent (NO in step S3), the processing shifts to processing in step S4.
(38) In step S4, it is judged whether textural information including a predetermined or more number of characters is present in the sign information. The textural information is sign information indicating content of a regulation using characters and is sign information incidental to the maximum speed information. When the textural information including the predetermined or more number of characters is present (YES in step S4), the processing shifts to processing in step S5. On the other hand, when the textural information including the predetermined or more number of characters is absent (NO in step S4), processing shifts to processing in step S8.
(39) In step S5, the sign information is changed to simplified information. The display processing unit 80 changes the sign information recognized by the recognizing unit 66 to simplified information that should be displayed on the MID 28. The processing performed in step S5 is explained with reference to specific examples shown in
(40) First, processing performed when symbolic information is present other than maximum speed information is explained with reference to
(41) As shown in
(42) As shown in
(43) Processing performed when textural information including a predetermined or more number of characters is present in addition to maximum speed information is explained with reference to
(44) As shown in
(45) In step S6, a display mode is judged. In this embodiment, information sources are the image of the traffic sign 40 or the road marking 42 captured by the camera 36, traffic information received by the wireless receiver 44, the map information stored by the car navigation device 16, and the map information stored by the information terminal 48. The display processing unit 80 judges an information source of maximum speed information and judges a display mode, that is, a display color corresponding to the information source. It is also possible to judge, instead of the display color, a display shape or a symbol to be added.
(46) In step S7, the simplified information is displayed. The instructing unit 82 receives a processing result of the display processing unit 80 and outputs a display instruction for the simplified information to the MID 28. The MID 28 displays the simplified information according to the instruction of the instructing unit 82. For example, when the image of the traffic sign 120 (see
(47) When the maximum speed information is absent in step S2 (NO in step S2) or when the symbolic information is absent in step S3 (NO in step S3) and the textural information including the predetermined or more number of characters is absent in step S4 (NO in step S4), processing in step S8 is performed. In step S8, sign information is displayed. Since sign information to be simplified is absent, the MID 28 displays a normal traffic sign (e.g., the traffic sign 102 shown in
(48) [3-2. Sign Display Processing 2]
(49) It is also possible to perform processing explained below when the sign display processing 1 explained in 3-1 is performed. For example, as shown in
(50) Like the display processing for the simplified sign 122, display processing for the bar 132 is also performed mainly by the display processing unit 80. Processing executed in the sign display apparatus for a vehicle 60 is explained with reference to
(51) During the start of the processing, the MID 28 displays the simplified sign 122 and the bar 132 in the sign indication region 28a. At this point, in step S11, the timer 88 is reset. In step S12, clocking by the timer 88 is started. In step S13, it is judged whether time of the timer 88 has exceeded a predetermined time. When the time has not exceeded the predetermined time (NO in step S13), the processing shifts to processing in step S14. In step S14, the MID 28 reduces the indication amount of the bar 132. The processing returns to step S13. On the other hand, when the time has exceeded the predetermined time in step S13 (YES in step S13), the processing shifts to processing in step S15. In step S15, the MID 28 hides the bar 132 and changes the simplified sign 122 to the simplified sign 134.
(52) In the processing shown in
(53) In the form explained above, the indication amount of the bar 132 decreases as the elapsed time or the traveling distance of the vehicle 10 increases. However, the indication amount of the bar 132 may increase as the elapsed time or the traveling distance of the vehicle 10 increases. The elapsed time and the traveling distance of the vehicle 10 may be indicated by the luminance of display rather than the bar 132.
(54) [3-3. Sign Display Processing 3]
(55) It is also possible to perform processing explained below when the sign display processing 1 explained in 3-1 is performed. The occupant can select sign information as a display object in the selective indication region 28b by operating the changeover switch SW (see
(56) As shown in
(57) Processing executed in the sign display apparatus for a vehicle 60 is explained with reference to
(58) [3-4. Sign Display Processing 4]
(59) It is also possible to perform processing explained bellow after the sign display processing 1 explained in 3-1. When sign information is simplified, information is sometimes omitted. For example, in the simplified sign 126 shown in
(60) Processing executed in the sign display apparatus for a vehicle 60 is explained with reference to
(61) Note that the simplified sign 108 and the simplified sign 118 shown in
4. Summary of this Embodiment
(62) The sign display apparatus for a vehicle 60 according to this embodiment includes the camera 36 that detects sign information on the traffic sign 40 or the road marking 42 ahead of the vehicle 10, the wireless receiver 44, the car navigation device 16, the sign information detectors (hereinafter referred to as sign information detectors 16, 36, 44, and 48) such as the information terminal 48, the MID 28 (the display device) that displays the sign information detected by the sign information detectors 16, 36, 44, and 48, and the ECU 64 (the control circuit) that controls the MID 28. When two or more kinds of sign information having overlapping effective sections are detected by the sign information detectors 16, 36, 44, and 48 or when textural information including a predetermined or more number of characters is included in the sign information detected by the sign information detectors 16, 36, 44, and 48, the MID 28 displays, according to an instruction of the ECU 64, simplified information obtained by simplifying the sign information detected by the sign information detectors 16, 36, 44, and 48.
(63) That is, when the plurality of kinds of sign information having the overlapping effective sections are detected by the sign information detectors 16, 36, 44, and 48 or when the textural information including the predetermined or more number of characters is contained in the sign information detected by the sign information detectors 16, 36, 44, and 48, the display processing unit 80 of the ECU 64 changes the sign information detected by the sign information detectors 16, 36, 44, and 48 to simplified information obtained by simplifying the sign information. The instructing unit 82 receives a judgment result of the display processing unit 80 and outputs a display instruction to the MID 28.
(64) According to this embodiment, even when the plurality of kinds of sign information or the sign information including the predetermined or more number of characters is detected, it is possible to appropriately display content indicated by the sign information to the occupant in a limited indication region of the MID 28.
(65) As explained with reference to
(66) According to this embodiment, it is possible to appropriately display the maximum speed information and the textural information and the symbolic information other than the maximum speed information to the occupant in the limited indication region of the MID 28.
(67) As shown in
(68) According to this embodiment, it is possible to adjust a detail level of the simplified information according to an indication region and it is possible to appropriately display necessary information to the occupant. That is, the selective indication region 28b has the display area larger than the display area of the sign indication region 28a. Therefore, in the selective indication region 28b, it is possible to display another version of the sign information with the content closer to an actual sign than the simplified information displayed in the sign indication region 28a. Consequently, the occupant can easily and intuitively recognize the display content.
(69) As explained with reference to
(70) According to this embodiment, when the sign information is displayed in the selective indication region 28b, the occupant can easily recognize information. As the traveling distance of the vehicle 10 increases or time elapses, the indication region for displaying the sign information is shifted from the selective indication region 28b to the sign indication region 28a. Consequently, it is possible to enable the occupant to view the information when necessary while keeping the occupant from gazing the information more than necessary.
(71) As explained with reference to
(72) When two or more kinds of sign information are displayed in a limited indication region, information that can be displayed is limited. According to this embodiment, it is possible to notify the two or more kinds of simplified information even if there is only one indication part.
(73) The sign display apparatus for a vehicle 60 includes the plurality of types of sign information detectors 16, 36, 44, and 48. As explained with reference to
(74) According to this embodiment, it is possible to inform the occupant which of the sign information detectors 16, 36, 44, and 48 detects the information displayed. Therefore, when the simplified information displayed on the MID 28 does not match the traffic sign actually installed on the traveling road 38, the occupant can recognize which of the sign information detectors 16, 36, 44, and 48 makes the mismatch. For example, the occupant can switch, using the selection switch 90, the sign information detectors 16, 36, 44, and 48 to be used. The occupant can recognize a failure.
(75) As explained with reference to
(76) According to this embodiment, it is possible to easily recognize freshness of displayed sign information.
(77) In the sign display method for a vehicle according to this embodiment, sign information on the traffic sign 40 or the road marking 42 ahead of the vehicle 10 is detected. When two or more kinds of sign information having overlapping effective sections are detected or when textural information including a predetermined or more number of characters is contained in the sign information, simplified information obtained by simplifying the sign information is displayed on the MID 28 in the vehicle 10.
(78) According to this embodiment, even when two or more kinds of sign information or sign information including a predetermined or more number of characters is detected, it is possible to appropriately display content indicated by the sign information to the occupant in a limited indication region of the MID 28.
(79) Note that, in this embodiment, the camera 36, the wireless receiver 44, the car navigation device 16, and the information terminal 48 are used as the sign information detector. However, one or more sign information detectors only have to be provided.