Imaging and display device for vehicle and recording medium thereof for switching an angle of view of a captured image
10897572 ยท 2021-01-19
Assignee
Inventors
Cpc classification
B60R2300/306
PERFORMING OPERATIONS; TRANSPORTING
B60R1/12
PERFORMING OPERATIONS; TRANSPORTING
B60R2001/1253
PERFORMING OPERATIONS; TRANSPORTING
B60R1/00
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/8066
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/301
PERFORMING OPERATIONS; TRANSPORTING
G06V20/56
PHYSICS
B60R99/00
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/70
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60R1/12
PERFORMING OPERATIONS; TRANSPORTING
B60R1/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
An imaging and display device for a vehicle includes: a display unit configured to display a captured image which is obtained through image capturing by an imaging unit that images a rear side of the vehicle; and a control unit configured to perform view angle switching control of switching an angle of view of the captured image displayed on the display unit to a wider angle than a current angle of view when a predetermined wide-angle condition is satisfied as a distance between an object on the rear side of the vehicle and the vehicle decreases and switching the angle of view to an original angle of view when a predetermined return condition for returning to the original angle of view is satisfied.
Claims
1. An imaging and display device for a vehicle, comprising: a display disposed in a front part of a vehicle interior and configured to display a captured image which is obtained through image capturing by a camera that images a rear side of the vehicle; and a processor programmed to: switch an angle of view of the captured image displayed on the display to a wider angle than a current angle of view when a predetermined wide-angle threshold is satisfied as a distance between an object on the rear side of the vehicle and the vehicle decreases; and switch the angle of view to an original angle of view when a predetermined return threshold for returning to the original angle of view is satisfied, wherein the angle of view of the captured image is switched by changing and displaying a partial area of an image that is clipped from the captured image, the predetermined wide-angle threshold and the predetermined return threshold are defined by threshold values, and a threshold value defined for the predetermined wide-angle threshold is a ratio of an object in the captured image to a display area of the display, and a threshold value defined for the predetermined return threshold is a ratio of an object in the captured image to a display area of the display.
2. The imaging and display device according to claim 1, wherein the processor is further programmed to receive a signal indicating rearward movement of the vehicle and switch the angle of view of the captured image to a wider angle than the current angle of view when the wide-angle threshold is satisfied.
3. The imaging and display device according to claim 1, wherein the wide-angle threshold is satisfied in at least one of a case in which a distance less than a predetermined distance is detected by a sensor that detects a distance to an object on the rear side of the vehicle and a case in which an area of the object in the captured image is larger than a predetermined area.
4. The imaging and display device according to claim 1, wherein the processor is further programmed to switch the angle of view of the captured image to a wider angle than the current angle of view when another vehicle is detected as the object and the wide-angle threshold is satisfied.
5. The imaging and display device according to claim 4, wherein the processor is further programmed to switch the angle of view to an angle of view in a range in which a lateral width of the vehicle as the object is displayed or an angle of view in a range in which at least a part of an outline of the vehicle as the object is displayed on the display when switching the angle of view to a wide angle.
6. The imaging and display device according to claim 1, wherein the processor is further programmed to switch the angle of view such that the angle of view becomes a wider angle gradually as a distance to the object decreases or as the size of the object in the captured image increases when performing the view angle switching control.
7. The imaging and display device according to claim 1, wherein the processor is further programmed to additionally perform notification control of notifying that the angle of view is being switched when the angle of view is switched to a wider angle.
8. A non-transitory recording medium having a program stored, wherein the program is an imaging and display program that causes a computer to execute: switching an angle of view of a captured image displayed on a display to a wider angle than a current angle of view when a predetermined wide-angle threshold is satisfied as a distance between an object on a rear side of the vehicle and the vehicle decreases, the display being disposed in a front part of a vehicle interior and being configured to display the captured image, which is obtained through image capturing by a camera that images a rear side of the vehicle, and switching the angle of view to an original angle of view when a predetermined return threshold for returning to the original angle of view is satisfied, wherein the angle of view of the captured image is switched by changing and displaying a partial area of an image that is clipped from the captured image, the predetermined wide-angle threshold and the predetermined return threshold are defined by threshold values, and a threshold value defined for the predetermined wide-angle threshold is a ratio of an object in the captured image to a display area of the display, and a threshold value defined for the predetermined return threshold is a ratio of an object in the captured image to a display area of the display.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Features, advantages, and technical and industrial significance of exemplary embodiments of the disclosure will be described below with reference to the accompanying drawings, in which like numerals denote like elements, and wherein:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
DETAILED DESCRIPTION OF EMBODIMENTS
(17) Hereinafter, an example of an embodiment of the disclosure will be described in detail with reference to the accompanying drawings.
(18) The imaging and display device for a vehicle according to this embodiment performs an image capturing operation using a camera 12 as an example of an imaging unit disposed in a rear part of the vehicle and a captured image obtained through the image capturing operation of the camera 12 is displayed on a monitor 14 as an example of a display unit disposed at a position of an interior mirror of a vehicle interior. By disposing the monitor 14 at the position of the interior mirror, it is possible to cause the monitor 14 to function as an interior mirror.
(19) In this embodiment, a half mirror is disposed on a display surface side of the monitor 14. In a display state in which the monitor 14 is turned on, a displayed image is transmitted by the half mirror and a rear field of view can be checked using the monitor 14. On the other hand, in a non-display state in which the monitor 14 is turned off, the rear field of view can be checked using an optical reflected image of the half mirror.
(20) A bumper in the rear part of the vehicle is provided with a distance sensor 16 as an example of a detection unit and distance information on a distance to an object on the rear side is detected. In
(21) A control device 18 that controls the camera 12 and the monitor 14 is disposed in a trunk. The control device 18 is disposed in the trunk in the above-mentioned example, but the position thereof is not limited thereto, and the control device may be disposed in another place in the vehicle interior.
(22)
(23) The imaging and display device for a vehicle 10 according to this embodiment includes a camera 12, a monitor 14, a distance sensor 16, a switch 20, and a control device 18 as an example of a control unit.
(24) The camera 12 images the rear side of the vehicle and outputs an imaging result to the control device 18. The camera 12 is, for example, disposed outside the vehicle (for example, on the trunk as illustrated in
(25) The monitor 14 is disposed at a position at which an interior mirror is generally disposed, and is connected to the control device 18. Examples of the position at which the interior mirror is generally disposed include a position on the front side of the vehicle at the center in the vehicle width direction of the ceiling or the vicinity of an upper part at the center of a front glass windshield. In this embodiment, the monitor 14 is disposed at the position of the interior mirror, but the disclosure is not limited thereto and the monitor has only to be disposed in a front part of the vehicle interior such as an upper part of an instrument panel. A captured image which is captured by the camera 12 is displayed on the monitor 14 under the control of the control device 18.
(26) The distance sensor 16 is a sensor that detects a distance to an object such as a rear-side vehicle and outputs distance information on the distance to an object on the rear side to the control device. The distance sensor 16 detects the distance information by outputting a signal such as ultrasonic waves or infrared rays and receiving a signal reflected from an object. A plurality of distance sensors 16 are illustrated in
(27) The switch 20 is a switch for turning on/off display of the monitor 14, an operation result of the switch 20 is input to the control device 18, and the monitor 14 is turned on and off by the operation of the switch 20. The switch 20 may be disposed, for example, in a part corresponding to a lever that switches on antidazzle for the interior mirror.
(28) The control device 18 is constituted by a microcomputer in which a CPU 18A, a ROM 18B, a RAM 18C, and an I/O (input/output interface) 18D are connected to a bus 18E.
(29) Various programs such as a program for performing display control of displaying a captured image captured by the camera 12 on the monitor 14 are stored in the ROM 18B. By loading the program stored in the ROM 18B into the RAM 18C and causing the CPU 18A to execute the loaded program, display control of a captured image on the monitor 14 or the like is performed.
(30) The I/O 18D is connected to the camera 12, the monitor 14, the distance sensor 16, and the switch 20. The control device 18 acquires an imaging result of the camera 12, performs processing (such as mirror image change of inverting the right and left sides of the captured image) for displaying the imaging result on the monitor 14 on the captured image, and displays the captured image on the monitor 14. In this embodiment, processing of clipping an image in an area of a predetermined reference angle of view from a captured image of the camera 12 is performed and the clipped image is displayed on the monitor 14. The predetermined reference angle of view employs a predetermined angle of view in a range in which regulations are satisfied. For example, an angle of view when the same area as an area which appears on the optical interior mirror is displayed on the monitor 14 may be employed as the predetermined reference angle of view.
(31) In a conventional optical interior mirror, an occupant does not have a feeling of oppression even when a rear-side vehicle approaches, but in the imaging and display device for a vehicle 10 according to this embodiment, the camera 12 may be disposed in the rear part of the vehicle and a close object may appear larger than in the conventional interior mirror. Accordingly, when an object such as a rear-side vehicle approaches the rear part of the vehicle, an occupant may have a feeling of oppression.
(32) Therefore, in the imaging and display device for a vehicle 10 according to this embodiment, view angle switching control of switching the angle of view to a wider angle of view than a current angle of view when a distance between an object on the rear side of the vehicle and the vehicle decreases and a predetermined wide-angle condition in which an occupant has a feeling of oppression due to an object displayed on the monitor 14 is satisfied and switching the angle of view to an original angle of view when a predetermined return condition for returning the angle of view to the original angle of view is satisfied is performed. Specifically, when a distance to an object on the rear side becomes less than a predetermined distance (for example, 2 m), the angle of view is switched to a wider angle than the predetermined reference angle of view (which may be hereinafter referred to as an increase in the angle of view). When the distance to the object on the rear side becomes equal to or greater than the predetermined distance, the angle of view is switched to the original reference angle of view. In this embodiment, since a partial area is clipped and displayed instead of displaying an overall captured image of the camera 12 on the monitor 14 and the angle of view is switched by changing the clipping area, display control of changing and displaying a clipping area of the captured image is performed as the view angle switching control. In the display control of switching the angle of view, specifically, an area corresponding to an angle of view to be changed to is clipped from the captured image, mirror image change or image processing of matching the number of pixels of a display area of the monitor 14 (image processing such as reduction, compression, pixel thinning, or interpolation) is performed on the clipped image, and then the resultant image is displayed. However, in the following description, for the purpose of simplification of explanation, the mirror image change, the image processing of matching the display area of the monitor 14, or the like will be skipped.
(33) Specifically, as illustrated in
(34) As indicated in a dotted line in
(35) As the method of switching the angle of view to a wider angle, a method of switching the angle of view by changing and displaying an area which is clipped from the overall captured image of the camera 12 is employed as described above in this embodiment, but a zoom lens or the like may be driven to optically switch the angle of view when a lens of the camera 12 can be driven. Alternatively, a plurality of lenses having different angles of view and a camera may be provided and the lenses may be switched between. Alternatively, a plurality of cameras including lenses having different angles of view may be prepared and the cameras may be switched between. Alternatively, the above-mentioned methods may be combined to switch the angle of view.
(36) When the angle of view is switched to a wider angle, the angle of view may be switched to a wider angle of an area in which the lateral width of the rear-side vehicle X is displayed or a wider angle of an area in which at least a part of an outline of the rear-side vehicle X is displayed on the monitor 14 as illustrated in
(37) Subsequently, specific display control which is performed by the control device 18 of the imaging and display device for a vehicle 10 according to this embodiment having the above-mentioned configuration will be described below.
(38) In Step 100, the CPU 18A acquires a captured image of the camera 12, starts displaying of the captured image on the monitor 14, and performs the process of Step 102. In this embodiment, an area corresponding to the predetermined reference angle of view from the captured image of the camera 12 is clipped and is displayed on the monitor 14. Accordingly, the captured image of the rear side of the vehicle is displayed on the monitor 14 and the rear side can be checked.
(39) In Step 102, the CPU 18A detects a distance to an object on the rear side based on the detection result of the distance sensor 16 and then performs the process of Step 104.
(40) In Step 104, the CPU 18A determines whether the distance to the object is less than a predetermined threshold value. The process of Step 106 is performed when the determination result is positive, and the process of Step 113 is performed when the determination result is negative.
(41) In Step 106, the CPU 18A determines whether Step 108 to be described later has already been performed and the angle of view has been switched to a wider angle. The process of Step 108 is performed when the determination result is negative, and the process of Step 110 is performed when the determination result is positive.
(42) In Step 108, the CPU 18A switches the angle of view of the displayed image to a wider angle and then performs the process of Step 110. Specifically, by enlarging the area which is clipped from the captured image acquired through image capturing of the camera 12, the angle of view is switched to a wider angle than that of the captured image which is currently displayed. Accordingly, when an object such as a rear-side vehicle X approaches the vehicle, the angle of view is switched to a wider angle and thus displaying of a captured image causing an occupant to have a feeling of oppression is prevented.
(43) In Step 110, the CPU 18A detects a distance to an object again and determines whether the distance to the object is equal to or greater than a predetermined threshold value. The process of Step 112 is performed when the determination result is positive, and the process of Step 114 is performed when the determination result is negative.
(44) In Step 112, the CPU 18A returns the angle of view to the original angle of view and then performs the process of Step 114.
(45) On the other hand, in Step 113, the CPU 18A determines whether Step 108 has already been performed and the angle of view has been switched to a wider angle. The process of Step 112 is performed when the determination result is positive, and the process of Step 114 is performed when the determination result is negative.
(46) In Step 114, the CPU 18A determines whether the switch 20 has been operated to instruct turning the display off. A series of processes are ended when the determination result is positive, and the above-mentioned processes are repeated from Step 102 when the determination result is negative.
(47) Since the angle of view of a captured image is switched to a wider angle when a distance to an object on the rear side is less than a predetermined distance and the angle of view is returned to the original angle of view when the distance to the object is equal to or greater than the predetermined distance, it is possible to minimize a feeling of oppression given to an occupant without displaying a close object to look larger than in the conventional art.
(48) The predetermined distance in the wide-angle condition for switching the angle of view to a wider angle and the predetermined distance in the return condition for returning the angle of view to the original angle of view may be set to the same distance, but it is preferable that both the predetermined distances be set to different distances to provide a hysteresis to processing in order to prevent chattering in which switching of the angle of view is repeated.
(49) In the above-mentioned embodiment, regardless of the types of an object on the rear side, the angle of view is switched to a wider angle when the distance to an object on the rear side is less than a predetermined distance, but the object on the rear side may be limited to a vehicle. For example, as illustrated in
(50) That is, in Step 100, the CPU 18A acquires a captured image of the camera 12, starts displaying of the captured image on the monitor 14, and performs the process of Step 101.
(51) In Step 101, the CPU 18A determines whether there is a rear-side vehicle X. This determination is performed, for example, by detecting a rear-side vehicle X by performing image processing such as pattern matching based on the captured image of the camera 12. The process of Step 102 is performed when the determination result is positive, and the process of Step 116 is performed when the determination result is negative.
(52) In Step 116, the CPU 18A determines whether Step 108 has been already performed and the angle of view is switched to a wider angle. The process of Step 112 is performed when the determination result is positive, and the process of Step 114 is performed when the determination result is negative.
(53) In this way, by adding Steps 101 and 116, the angle of view can be switched when the distance to a rear-side vehicle X is less than the predetermined distance and the angle of view can be returned to the original angle of view when the distance to a rear-side vehicle X is equal to or greater than the predetermined distance. Accordingly, since the angle of view is switched to a wider angle even when a rear-side vehicle X approaches, it is possible to minimize a feeling of oppression given to an occupant without displaying the rear-side vehicle X to be large on the monitor 14.
(54) In the above-mentioned embodiment, the angle of view is switched to a wider angle when the distance to an object on the rear side is less than a predetermined distance, but when the angle of view is rapidly switched to a wider angle, it is conceivable that the object on the rear side displayed on the monitor 14 is suddenly decreased in size due to the switching of the angle of view to give discomfort to an occupant. Therefore, when a distance to an object on the rear side is less than a predetermined distance, the angle of view may be gradually switched to a wider angle.
(55) For example, an image displayed on the monitor 14 when the angle of view is not switched is illustrated in
(56) In the above-mentioned embodiment, as the predetermined wide-angle condition in which an occupant has a feeling of oppression due to an object displayed on the monitor 14, the angle of view is switched when the distance to an object on the rear side is less than a predetermined distance, but the predetermined wide-angle condition is not limited thereto. For example, the angle of view may be switched to a wider angle when a ratio at which the screen is occupied by the object displayed on the monitor 14 is equal to or greater than a predetermined ratio. Alternatively, the angle of view may be switched to a wider angle when the size of the object on the rear side in the captured image is greater than a predetermined size. In this case, for example, the area of the object in the captured image can be calculated and the angle of view can be switched to a wider angle when the calculated area is greater than a predetermined area. As specific processing, Step 103 is performed instead of Steps 102 and 104 in
(57) Alternatively, it is known from results of sensor tests and the like that when the display area of the monitor 14 is not full of the object at a distance less than a predetermined distance (for example, 2 m), a feeling of oppression is reduced. Accordingly, when the distance to the object is less than a predetermined distance and the size of the object on the rear side in the captured image is greater than a predetermined size, the angle of view may be switched to a wider angle. In this case, the return condition for returning the angle of view to the original angle of view may be satisfied when the distance to the object is equal to or greater than a predetermined distance or when the size of the object on the rear side in the captured image is equal to or less than a predetermined size. Alternatively, the case in which the distance to the object is equal to or greater than a predetermined distance or the case in which the size of the object on the rear side in the captured image is equal to or less than a predetermined size may be applied to the return condition. As a specific example of the processing, for example, as illustrated in
(58) Alternatively, when the distance to the object is less than the predetermined distance or when the size of the object on the rear side in the captured image is greater than the predetermined size, the angle of view may be switched to a wider angle.
(59) As described above with reference to
(60) In the above-mentioned embodiment, regardless of a traveling direction of the vehicle, the angle of view may be switched to a wider angle when the wide-angle condition for switching the angle of view is satisfied, but the traveling direction of the vehicle when switching the angle of view may be limited to a rearward direction.
(61) For example, as illustrated in
(62) That is, in the processing example illustrated in
(63) In Step 101A, the CPU 18A determines whether the vehicle moves rearward. Whether the vehicle moves rearward is performed, for example, by determining whether a signal indicating rearward movement of the vehicle is received from a shift position sensor or a back switch. The process of Step 101 is performed when the determination result is positive, and the process of Step 116 is performed when the determination result is negative.
(64) By adding Step 101A in this way, the angle of view can be switched when the distance to the rear-side vehicle X is less than the predetermined distance at the time of rearward movement and the angle of view can be returned to the original angle of view when the distance is equal to or greater than the predetermined distance. Accordingly, even when a distance to a stopped rear-side vehicle becomes less at the time of parking, it is possible to minimize a feeling of oppression given to an occupant.
(65) In the above-mentioned embodiment, an example in which the distance to an object on the rear side is detected using the distance sensor 16 has been described, but the method of detecting the distance to an object is not limited to the distance sensor 16. For example, position information of a rear-side vehicle X may be acquired by vehicle-to-vehicle communication or road-to-vehicle communication and the distance to the rear-side vehicle may be detected. Alternatively, the distance to an object may be detected from a captured image of a monocular camera using image processing such as a projection difference or an optical flow. Alternatively, the distance to an object on the rear side may be detected from a captured image obtained using a stereoscopic camera.
(66) The display control illustrated in
(67) The disclosure is not limited to the above description, but can be modified in various forms without departing from the gist of the disclosure.