The invention relates to a device (100) as well as a method for displaying vehicle surroundings in a vehicle (1) during an instantaneous second time point (t). The method comprises the steps: providing (S1) a first blind area image (I_B[t]), which contains an image synthesis of a blind area (B) of the vehicle surroundings, which blind area is arranged outside of a field of view (141F, 141R, 141LL, 141LR) of a vehicle camera (140F, 140R, 140LL, 140LR), at a first time point (t−1) preceding the second time point (t), arranging (S2) each first blind area pixel (IB_SP[t−1]) of the blind area (B) in a new position estimated for the second time point (t), determining (S3) whether the new position of each first blind area pixel (IB_SP[t−1]) at the second time point (t) still lies within the blind area (B), and producing (S4) a respective second blind area pixel (IB_SP[t]) for the second time point (t) by synthesizing (S5A) each first blind area pixel (IB_SP[t−1]) on the basis of motion data (v_x, v_y) of the vehicle (1) if the new position is determined to lie within the blind area (B).

An image processing device includes a hardware processor configured to: acquire items of image information; determine lateral image information as a particular state of luminance when a first region of interest exhibits luminance of a first given value or more and a difference in luminance between the first region of interest and a second region of interest is a second given value or more, the first region of interest and the second region of interest being included in a vehicular front region and a vehicular rear region of the lateral image information, respectively; set, in the particular state of luminance, a first correction value in accordance with luminance of the vehicular front region and set a second correction value in accordance with luminance of rear image information; and set, according to the first second correction values, an individual correction value for correcting luminance of a region between the first and second regions of interest.

A bird's-eye view video generation device includes a video data acquisition unit configured to acquire video data from multiple cameras configured to capture videos of surroundings of a vehicle, a bird's-eye view video generator configured to generate a bird's-eye view video from a virtual viewpoint above the vehicle by performing viewpoint conversion processing on the acquired video data to synthesize the viewpoint-converted videos, an obstacle information acquisition unit configured to acquire information from at least one detector configured to detect at least one obstacle around the vehicle and to specify a position thereof, and a display controller configured to display the bird's-eye view video in a display, wherein, when the position of the obstacle overlaps a synthesis boundary between the videos, the bird's-eye view video generator is further configured to generate a bird's-eye view video obtained by changing the position of the virtual viewpoint of the bird's-eye view video.

A vehicular trailer guidance system includes an electronic control unit (ECU), a plurality of vehicle cameras and at least one trailer camera including a rear trailer camera disposed at a rear portion of a trailer hitched to the vehicle. A display screen is disposed in the vehicle and viewable by a driver of the vehicle. The display screen displays video images derived from captured image data, with the displayed video images including bird's-eye view images of a region at least partially surrounding the vehicle and trailer including an area rearward of the trailer hitched to the vehicle. During a reversing maneuver, and via processing of captured image data, an instruction for maneuvering the vehicle and trailer in reverse toward a target location is generated by the ECU. The generated instruction includes at least an instruction pertaining to steering of the vehicle during the reversing maneuver.

A trailer hitching assist system for a vehicle includes a camera disposed at a rear portion of a vehicle and having a field of view rearward of the vehicle. A control includes an image processor operable to process image data captured by the camera. The image processor, via image processing of image data captured by the camera, detects a trailer and trailer hitch rearward of the vehicle and determines a first path of travel for the vehicle to follow so as to maneuver the vehicle so as to have its tow ball aligned with the trailer hitch. The control maneuvers the vehicle along the determined first path of travel. Responsive to detection of an object entering the first path of travel, the control determines a second path of travel and maneuvers the vehicle along the second path of travel to avoid the detected object entering the determined path of travel.

A bird's-eye view video generation device includes a video data acquisition unit that acquires surrounding video data of a vehicle captured by imagers, a surrounding information acquisition unit that acquires surrounding information around the vehicle, a vehicle information acquisition unit that acquires vehicle information, a bird's-eye view video generation unit that generates a bird's-eye view video of the vehicle based on the acquired surrounding video data, and a display controller that causes a display to display the bird's-eye view video in at least one of a case in which a surrounding vehicle turns on a direction indicator, and a case in which an entrance/exit into/from which the vehicle can enter/exit or a starting point of a branch lane is located at the side of the vehicle based on the vehicle and/or surrounding information.

An overhead image generation device includes: an image acquisition unit that acquires a peripheral image by capturing an image of a periphery of a vehicle; an approach information acquisition unit that acquires approach information indicating an approach state of an obstacle detected in the periphery of the vehicle to the vehicle; an overhead image generation unit that generates an overhead image A from the peripheral image by performing viewpoint conversion processing so as to look down on the vehicle from above in a vertical direction; an approach state image generation unit that generates an approach state image B showing an approach state of the obstacle to the vehicle for each position of the vehicle in the vertical direction, based on the approach information; and a display control unit that superimposes the overhead image A and the approach state image B and causes a display unit to display the superimposed image.

A method of operating an Around View Monitoring (AVM) system according to the present invention includes: obtaining image data from image sensors disposed at different locations of a vehicle; performing image processing on the image data for improving an image; performing lens distortion correction on the processed image data; detecting an overlapping region from the corrected image data; selecting an image display method so as to prevent the detected overlapping region from overlapping when the image is synthesized, and synthesizing the image data according to the selected image display method; and outputting the synthesized image data.

A system for processing images includes a receiving module configured to receive a plurality of images generated by one or more imaging devices, the plurality of images including a first image taken from a first location and orientation, and a second image taken from a second location and orientation. The system also includes an image analysis module configured to generate a composite image on a target image surface based on at least the first image and the second image. The image analysis module is configured to perform steps that include selecting a planar intermediate image surface, projecting the first image and the second image onto the intermediate image surface, combining the projected first image and the projected second image at the intermediate image surface to generate an intermediate image, and projecting the intermediate image onto the target image surface to generate the composite image.

A method and system identifies an unobservable region using a surround view system of a vehicle. The vehicle has a trailer attached thereto. The surround view system includes cameras to provide a view of an area surrounding the vehicle, an ECU receives image data from the cameras, and a display. A legacy observable image of the area obtained from the cameras as the vehicle passes through the area is stored in the ECU. A model representing a geometry of the trailer is created. Live images of the area, while the vehicle is reversing the trailer in the area, are obtained by the cameras. The trailer defines an obstruction in the area that occludes camera views defining an unobservable region. Based on the legacy observable image, the geometry of the trailer, and the live images, the unobservable region in the area is calculated and displayed on the display.