G06T3/073

Image display device and image display method
10674133 · 2020-06-02 · ·

Disclosed is an image display device or an image signal output device. The image display device or the image signal output device according to an exemplary embodiment of the present disclosure includes: a receiver for receiving an image; an input unit for receiving a user input to select a display mode or an image signal output mode; a determiner for determining the selected display mode; a depth map generator for generating a depth map for the received image having depth information corresponding to a predefined curvature if the result of determination indicates that the selected display mode is a 3D curved image mode; a 3D image frame generator for generating a left-eye image frame and a right-eye image frame from the received image on the basis of the generated depth map; and an output unit for outputting the generated left-eye image and right-eye image frames.

Conversion and pre-processing of spherical video for streaming and rendering
10672102 · 2020-06-02 · ·

In one embodiment, a method receives spherical content for video and generates face images from the spherical content to represent an image in the video. A two dimensional sheet for the face images is generated. A size of the face images is reduced and a pixel frame around each of the plurality of face images is added on the sheet. Also, a plurality of gaps are added on the sheet in between edges of the face images that are neighboring. The method then adds gap content in the plurality of gaps where the gap content is based on content in an area proximate to the plurality of gaps. The method encodes the face images, the pixel frame, and gap content on the sheet and sends the encoded sheet to a decoder. The face images are decoded for placement on an object structure to display the spherical content.

MAPPING OF SPHERICAL IMAGE DATA INTO RECTANGULAR FACES FOR TRANSPORT AND DECODING ACROSS NETWORKS
20200162720 · 2020-05-21 ·

A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.

Image generating apparatus and image display control apparatus

An image generating apparatus generates a panoramic image by transforming at least one divided area including a range onto which a scene viewed from an observation point is projected, out of eight divided areas obtained by dividing the surface of a sphere having at least a partial range onto which the scene is projected, with three planes that pass through the center of the sphere and are orthogonal to each other, into such an area that the number of pixels corresponding to mutually equal latitudes is progressively reduced toward higher latitudes, and placing the transformed area on a plane, and outputs the generated panoramic image.

Equatorial stitching of hemispherical images in a spherical image capture system
10650487 · 2020-05-12 · ·

Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

Information processing apparatus, information processing method, and recording medium
10643315 · 2020-05-05 · ·

A position determination unit determines, in a fisheye image, a position of a clipping portion clipped from the fisheye image. Based on the position of the clipping portion determined by the position determination unit, a determination unit determines a moving amount of the clipping portion for moving the clipping portion.

Systems and methods for providing a cubic transport format for multi-lens spherical imaging
10602124 · 2020-03-24 · ·

Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 43, 32, 42, 24 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.

Method and Apparatus for Mapping Virtual-Reality Image to a Segmented Sphere Projection Format
20200074587 · 2020-03-05 ·

Methods and apparatus of processing spherical images related to segmented sphere projection (SSP) are disclosed. According to one method, a North Pole region of the spherical image is projected to a first circular image and a South Pole region of the spherical image is projected to a second circular image using a mapping process selected from a mapping group comprising equal-area mapping, non-uniform mapping and cubemap mapping. Methods and apparatus of processing spherical images related to rotated sphere projection (RSP) are also disclosed. According to this method, the spherical image is projected into a first part of rotated sphere projection corresponding to a region of the spherical image and a second part of rotated sphere projection corresponding to a remaining part of the spherical image using equal-area mapping.

IMAGE CAPTURE APPARATUS FOR PANORAMIC PHOTOGRAPHY, METHOD OF CONTROLLING SAME, AND STORAGE MEDIUM
20200074586 · 2020-03-05 ·

An image capture apparatus capable of eliminating wasteful photographing in predetermined panoramic photography. Predetermined panoramic photography combines images acquired by repeating still image capturing with long time-exposure and panning. A first angle of view in panning direction indicates an angle from a start to an end point in the photography. A photographing condition is calculated based on the first angle and a focal length of a photographic lens, and displayed changeable by a user. When combining the images, geometric deformation processing is performed thereon for changing a second angle of view indicative of an angle of view in a direction orthogonal to the panning direction according to the focal length. The second angle changed by the processing is calculated according to the set first angle and the displayed photographing condition. The second angle is displayed before and after the change.

METHOD AND APPARATUS FOR PROCESSING OMNI-DIRECTIONAL IMAGE
20200065937 · 2020-02-27 ·

A method for processing information regarding omni-directional images is provided. The method includes generating a first two-dimensional (2D) image projected from a first omni-directional image, generating a second 2D image projected from the second omni-directional image, generating a third 2D image corresponding to a 2D image projected from a third omni-directional image, generating a fourth 2D image projected from a fourth omni-directional image, generating a fifth 2D image corresponding to a 2D image projected from a fifth omni-directional image generating a sixth 2D image corresponding to a 2D image projected from a sixth omni-directional image, and generating a seventh 2D image corresponding to a 2D image projected from a seventh omni-directional image, a weight for the first omni-directional image, a weight for the second omni-directional image, and a weight for the fourth omni-directional image.