A periphery monitoring device according to an embodiment includes: an acquisition unit configured to acquire captured image data from an image-capturing unit that captures a region including a road surface in a traveling direction of a vehicle and a region above the road surface; a storage unit configured to store the captured image data; and an image processing unit configured to display, in a case of displaying a peripheral image in the traveling direction of the vehicle on a display unit, a first region including a road surface on a under-floor portion of the vehicle or a road surface on a vicinity of the under-floor portion by using a corresponding image in past captured image data stored in the storage unit, and display a second region including the region above the road surface by using a corresponding image in current captured image data acquired by the acquisition unit.

An image output device outputs a periphery image of a vehicle to a display; acquires a capture image of the periphery; acquires detection information of the periphery; determines an accuracy factor of detection of each object; calculates a position of the object in the capture image; determines whether objects overlap with each other in the capture image; and sets an image transmission region to at least a part of a region displaying a first object disposed on a near side among the objects determined to overlap with each other in the capture image, generates the periphery image for visually confirming a second object disposed on a far side of the first object, and changes a transmittance defined in the image transmission region higher as the accuracy factor of the detection of the second object is higher.

Disclosed is a method of providing driving information of a vehicle, including tracking and recognizing driver gaze of the vehicle, checking whether the driver gaze is directed toward a display of the vehicle, upon checking that the driver gaze is directed toward the display of the vehicle, checking coordinates of an actual position corresponding to a point on the display, toward which the driver gaze is directed, acquiring an image corresponding to the checked coordinates, and displaying the acquired image using an augmented reality provision unit included in the vehicle.

A periphery monitoring device according to an embodiment includes, as an example, a processor that generates a display image obtained by viewing, from a virtual viewpoint, a point of gaze in a virtual space including a model obtained by pasting a captured image obtained by imaging a surrounding area of a vehicle using an imaging unit provided on the vehicle to a three-dimensional plane around the vehicle, and including a three-dimensional vehicle image; outputs the display image to a display. The processor moves the point of gaze in conjunction with a movement of the virtual viewpoint in a vehicle width direction of the vehicle image when an instruction is made through an operation input unit to move the virtual viewpoint in the vehicle width direction of the vehicle image.

A vehicle device includes a video acquisition unit configured to acquire videos captured by cameras configured to capture surroundings of a vehicle; a light emission controller configured to control light emission of a light beam pattern which is emitted by light emitting devices and with which the ground is irradiated at certain positions with respect to the vehicle; an image processing unit 24 configured to generate, using the videos acquired, a bird's-eye view video including the light beam pattern; a superimposing image generation unit configured to generate a superimposing image at a position corresponding to the light beam pattern included in the bird's-eye view video; and an image determination processing unit 27 configured to detect, in the bird's-eye view video, an overlapping portion of the superimposing image and an image of the light beam pattern and determine whether camera parameters for generating the bird's-eye view video are accurately calibrated.

In one embodiment, in accordance with the present invention, a method, computer program product, and system for an in-vehicle content display using augmented reality. The method includes detecting a traffic signal. The method further includes, in response to detecting the traffic signal, calculating a safety degree of a vehicle. The method further includes calculating based on a position of the traffic signal, a display area for projecting content, in accordance with the safety degree onto a front glass of the vehicle. The method further includes determining whether to project content in the display area in accordance with the safety degree.

A periphery monitoring device includes: an acquisition unit configured to acquire a captured image from an imaging unit that captures an image of a periphery of a vehicle; a generation unit configured to generate a vehicle surrounding image indicating a situation around the vehicle in a virtual space based on the captured image; and a processing unit configured to display, on a display device, an image in which an own vehicle image is overlapped on the vehicle surrounding image, the own vehicle image indicating the vehicle in which a transmissive state of a constituent plane representing a plane constituting the vehicle is determined according to a direction of the constituent plane, and the vehicle surrounding image being represented based on a virtual viewpoint facing the vehicle in the virtual space.

Methods, apparatuses, and computer-readable media are disclosed for providing a mixed-reality scene. In response to a pedestrian detection event at a first vehicle, a sequence of mixed-reality images is presented to a driver of a second vehicle. At least one image in the sequence of mixed-reality images results from merging (a) an image captured by a camera aboard the first vehicle and (b) an image captured by a camera aboard the second vehicle. The merging may comprise de-emphasizing an occluded portion of the image captured by the camera aboard the second vehicle and emphasizing an unoccluded portion of the image captured by the camera aboard the first vehicle. The unoccluded portion of the image captured by the camera aboard the first vehicle may provide, in the merged image, visibility of a pedestrian at least partially blocked from a view of the driver of the second vehicle.

A driver-assistance device includes: a memory; and a processor including hardware. The processor is configured to: acquire both line-of-sight information on a line of sight of a driver and image data resulting from imaging surroundings of a vehicle; set a display position and display contents of an image generated from the image data based on the line-of-sight information; and output the display position and the display contents together with the image.

A backward driving assist apparatus for a vehicle may include: a vehicle speed sensor configured to measure a vehicle speed by counting a wheel pulse of a wheel; a steering angle sensor configured to measure a steering angle of a steering wheel; a yaw rate sensor configured to measure a yaw rate of the vehicle during driving; a driving trace storage configured to store driving trace data generated during forward driving; and a controller configured to estimate the position of the ego vehicle, interpolate the driving trace data generated at each preset distance, store the driving trace data in the driving trace storage, read the driving trace data from the driving trace storage during backward driving, generate a target steering angle by compensating for a direction angle error from the ego vehicle position, and output the target steering angle to an MDPS controller.