Systems and method are provided for a towing vehicle towing a trailer having at least one imaging device. A method includes: receiving, from a first imaging device coupled to the trailer, a first image stream having a plurality of first images; receiving, from a second imaging device coupled to the vehicle, a second image stream having a plurality of second images; determining, at least one common feature between a first image of the first images and a second image of the second images; determining a first distance from the first imaging device to the at least one common feature and a second distance from the second imaging device to the at least one common feature; and determining, a position of the first imaging device relative to the vehicle based on the first distance, the second distance and a known position and pose of the second imaging device.

Arrangements herein relate to a method and system for selectively displaying surroundings of an autonomous vehicle. The system can include a display to display a plurality of images in which some of the images are images of an environment external to the autonomous vehicle and are images unrelated to the environment external. The system can include cameras to capture the images of the environment external. The system can further include a processor that can be configured to detect a handover event associated with the operation of the vehicle. In response to the detection of the handover event and if the display is displaying images unrelated to the environment external, the processor can also cause the display to display images of the environment external in the place of the images unrelated to the environment external.

An image generation device for referencing a correspondence relationship and generating a line-of-sight-converted image from a captured image of an in-vehicle camera mounted to a vehicle is provided. The image generation device includes a first region updating unit that, upon sensing deviation of at least one of the mounting position and the mounting angle of the in-vehicle camera and calculating a new mounting position and mounting angle, updates a correspondence relationship of a predetermined first region in the line-of-sight-converted image in accordance with the new mounting position and mounting angle, and a second region updating unit that, upon satisfaction of a predetermined updating condition after updating the correspondence relationship of the first region, updates the correspondence relationship for a second region in the line-of-sight-converted image in accordance with the new mounting position and mounting angle.

Techniques for road scene primitive detection using a vehicle camera system are disclosed. In one example implementation, a computer-implemented method includes receiving, by a processing device having at least two parallel processing cores, at least one image from a camera associated with a vehicle on a road. The processing device generates a plurality of views from the at least one image that include a feature primitive. The feature primitive is indicative of a vehicle or other road scene entities of interest. Using each of the parallel processing cores, a set of primitives are identified from one or more of the plurality of views. The feature primitives are identified using one or more of machine learning and classic computer vision techniques. The processing device outputs, based on the plurality of views, result primitives based on the plurality of identified primitives from multiple views based on the plurality of identified entities.

Embodiments include a vehicle comprising a plurality of cameras for capturing images within a field of view surrounding the vehicle; a processor for generating a real-time view of an area within the field of view using currently-captured images, and a time-delayed view of a region outside the field of view using previously-captured images stored in a memory; and a display for displaying a hybrid view comprising the real-time view and time-delayed view. Embodiments also include a vehicle camera system comprising a plurality of cameras configured to capture images within a field of view surrounding the vehicle, and a processor configured to generate a real-time view of an area within the field of view using currently-captured images, a time-delayed view of a region outside the field of view using previously-captured images stored in a memory, and a hybrid view of the vehicle by integrating the time-delayed view into the real-time view.

The invention provides an autonomous vehicle with a video camera that merges images taken a different light levels by replacing saturated parts of an image with corresponding parts of a lower-light image to stream a video with a dynamic range that extends to include very low-light and very intensely lit parts of a scene. The high dynamic range (HDR) camera streams the HDR video to a HDR system in real time—as the vehicle operates. As pixel values are provided by the camera's image sensors, those values are streamed directly through a pipeline processing operation and on to the HDR system without any requirement to wait and collect entire images, or frames, before using the video information.

Vehicle visual systems are disclosed to produce seamless and uniform surround-view images of the vehicle using a number of Ultra Wide-Angle (UWA) lens cameras and optionally HUD systems. A distributive system architecture wherein individual cameras are capable of performing various image transformations allows a flexible and resource efficient image processing scheme.

A method for detecting an arrangement of cameras of a multi-camera system of a mobile carrier platform with respect to one another. The method includes reading in first and second image signals, the first image signals representing an image of a marker pattern and a first camera parameter from a first camera and the second image signals representing an image of a marker pattern and a second camera parameter from a second camera, the first and second cameras being oriented in different viewing directions, the viewing areas of the first and second camera at least partially overlapping. The method further includes extracting a first arrangement parameter of the first camera using the read-in first image signal and/or extracting a second arrangement parameter of the second camera using the read-in second image signal, and also calculating a differential arrangement parameter of the second camera in relation to the first camera.

This invention relates to an Extended Perception System that extends the perception of an object's surroundings. Three closely related primary sets of embodiments of this invention include: one set of embodiments is mounted on a set of one or more vehicles; a second set of embodiments is worn by a set of one or more persons and/or animals; and a third set of embodiments which can be in a location fixed with respect to terrestrial and/or other features. Improvements to head-mounted displays are disclosed.

A method and an apparatus for processing surrounding images of a vehicle are provided. In the method, plural cameras disposed on the vehicle are used to capture images of plural perspective views surrounding the vehicle. The images of the perspective views are transformed into images of a top view. An interval consisted of at least a preset number of consecutive empty pixels is found from one column of pixels in each image of the top view, and the images of the perspective views and the top view are divided into floor side images and wall side images according to the height of the interval in the image. The divided floor side images and wall side images are stitched to generate a synthetic image surrounding the vehicle.