When a to-be-monitored image exists in an image lacking from a bird's-eye image for surroundings monitoring though the to-be-monitored image is imaged by a camera for monitoring, the to-be-monitored image is securely displayed on a display. Cameras 6F, 6B, 6L, 6R are provided in a longitudinal direction and in a lateral direction of a dump truck 1, in playing bird's-eye images 10F, 10B, 10L, 10R acquired by converting view points of a through image imaged by each camera, so as to display a to-be-monitored image in a to-be-monitored image undisplayable area, each through image imaged by each camera is aggregated on one screen by an image aggregating unit 21, this aggregated screen is scanned by a to-be-monitored image detector 20 to detect the to-be-monitored image, and the to-be-monitored image is superimposed on a synthetic bird's-eye image 10 displayed on the display 9 and is displayed.

A surrounding monitoring device for a work machine including a work device on an upper swing body includes: a plurality of cameras configured to acquire a surrounding condition of the work machine; an image processor configured to generate a bird's-eye image based on images imaged by the plurality of cameras; a display configured to display at least one of: a single camera image imaged by one of the plurality of cameras; and the bird's-eye image; and a display controller configured to display, on the at least one of the single camera image and the bird's-eye image, direction guide information arranged from a reference position of the upper swing body to surroundings of the upper swing body.

A plurality of images captured by a plurality of cameras respectively to create a plurality of upper viewpoint images. Display images are extracted from the upper viewpoint images, and the extracted display images are synthesized to create an overhead image or bird's eye view image of surroundings, which has an image corresponding to an operating machine at a center of the bird's eye view image. When extracting each of the display images, a region of the display image extracted from the upper viewpoint image is expanded beyond the size of a standard extraction region on the basis of the set height of a mating face. Each of the extracted display images is adjusted to the size of the standard extraction region, and synthesized. Thus, any three-dimensional object (obstacle) present near the boundary between display images constituting the bird's eye view image is displayed.

A method of generating images for display includes equipping a vehicle with a vehicular vision system that includes a rearward viewing camera, an ECU and a display. The camera captures image data as the vehicle moves forward or rearward. The ECU includes an image processor that processes multiple frames of captured image data. The ECU generates, for each frame of image data captured by the camera, a left side image portion and a right side image portion. The ECU combines the left side image portions of multiple frames of captured image data and the right side image portions of multiple frames of captured image data. The combined left side image portions and the combined right side image portions are displayed at the display for viewing by the vehicle driver during a parking maneuver of the vehicle.

A vehicular display system includes an electronic control unit (ECU), a plurality of bird's eye surround view cameras and a plurality of camera monitoring system (CMS) cameras disposed at the vehicle. The cameras capture image data and provide captured image data to the ECU. The system includes a video display screen and a video mirror display screen that are operable to display video images derived from video images provided by the ECU. When the vehicle is traveling forward at a speed below a threshold speed, the ECU generates rearward view video images derived from image data captured by the CMS cameras and provides the rearward view video images to the video display screen. When the vehicle is traveling forward at a speed at or above the threshold speed, the ECU generates rearward view video images and provides the rearward view video images to the video mirror display screen.

A three-dimensional object detection device can enhance the accuracy in detecting a three-dimensional object regardless of the brightness in the detection environment. The device has an image capture means that captures an image of a predetermined area and an image conversion means that converts the image through a viewpoint conversion into birds-eye view image. A first three-dimensional object detection means aligns positions of bird's-eye view images at different times obtained by the image conversion means, counts the number of pixels that exhibit a predetermined difference on a differential image of the aligned bird's-eye view images to generate a frequency distribution thereby creating differential waveform information, and detects a three-dimensional object on the basis of the differential waveform information. A second three-dimensional object detection means detects edge information from the bird's-eye view image obtained by the image conversion means and detects a three-dimensional object on the basis of the edge information.

A vehicular multi-camera surround view system includes a front camera, a driver-side camera, a passenger-side camera and a rear backup camera. Image data captured by the cameras is conveyed to an electronic control unit. The electronic control unit is operable to combine image data conveyed from the front camera, the driver-side camera, the passenger-side camera and the rear backup camera to form composite video images, which are output for display at a display device. Rear backup video images are displayed no later than two seconds after the driver of the vehicle first changes propulsion of the vehicle during a new ignition cycle to reverse mode. Upon changing propulsion of the vehicle during the new ignition cycle to reverse mode to commence a backup event subsequent to the first backup event, the video display screen displays video images derived, at least in part, from image data captured by the rear backup camera.

The present application relates to a system for generating a surround view and a method of operating the system. A synthesizer module synthesizes an output frame from input frames in accordance with predefined calibration data. The input frames have an overlapping region imaging an overlapping field of view captured by two adjacent cameras. An adjustment module receives height level information representative of a height level in the overlapping region; selects a data record out of a set of predefined calibration data records in accordance with the height level information; and updates the predefined a part of the calibration data with the selected data record.

An on-vehicle image processing device is provided. The on-vehicle image processing unit includes a signal conversion circuit arranged to convert an image signal acquired from an imaging unit into image data of a predetermined standard responding to an external command, and a control circuit arranged to acquire the image data, display an image of the imaging unit on a display unit through starting multiple modules in order, and perform data processing to the image. Upon a user performing a reversing operation, the control circuit starts a first module to display the image data acquired from the signal conversion circuit on the display unit as it is, and subsequently starts a second module to perform predetermined data processing to the image data.

Vehicle visual systems are disclosed to produce seamless and uniform surround-view images of the vehicle using a number of Ultra Wide-Angle (UWA) lens cameras and optionally HUD systems. A distributive system architecture wherein individual cameras are capable of performing various image transformations allows a flexible and resource efficient image processing scheme.