H04N13/282

ENCLOSED MULTI-VIEW VISUAL MEDIA REPRESENTATION

Images may be captured at an image capture device mounted on an image capture device gimbal capable of rotating the image capture device around a nodal point in one or more dimensions. Each of the plurality of images may be captured from a respective rotational position. The images may be captured by a designated camera that is not located at the nodal point in one or more of the respective rotational positions. A designated three-dimensional point cloud may be determined based on the plurality of images. The designated three-dimensional point cloud may include a plurality of points each having a respective position in a virtual three-dimensional space.

ENCLOSED MULTI-VIEW VISUAL MEDIA REPRESENTATION

Images may be captured at an image capture device mounted on an image capture device gimbal capable of rotating the image capture device around a nodal point in one or more dimensions. Each of the plurality of images may be captured from a respective rotational position. The images may be captured by a designated camera that is not located at the nodal point in one or more of the respective rotational positions. A designated three-dimensional point cloud may be determined based on the plurality of images. The designated three-dimensional point cloud may include a plurality of points each having a respective position in a virtual three-dimensional space.

MATCHING SEGMENTS OF VIDEO FOR VIRTUAL DISPLAY OF A SPACE
20220394228 · 2022-12-08 ·

Systems, methods, and non-transitory computer-readable medium storing instructions that, when executed, causes a processor to perform operations to display a three-dimensional (3D) space. The methods may include, with an imaging device, capturing a first series of frames as the imaging device travels from a first location to a second location within a space, and capturing a second series of frames as the imaging device travels from the second location to the first location. The method may also include determining a first segment in the first series of frames that matches a second segment in the second series of frames to create a segmentation dataset, generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips, and displaying the series of video clips.

MATCHING SEGMENTS OF VIDEO FOR VIRTUAL DISPLAY OF A SPACE
20220394228 · 2022-12-08 ·

Systems, methods, and non-transitory computer-readable medium storing instructions that, when executed, causes a processor to perform operations to display a three-dimensional (3D) space. The methods may include, with an imaging device, capturing a first series of frames as the imaging device travels from a first location to a second location within a space, and capturing a second series of frames as the imaging device travels from the second location to the first location. The method may also include determining a first segment in the first series of frames that matches a second segment in the second series of frames to create a segmentation dataset, generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips, and displaying the series of video clips.

IMAGE PROCESSING APPARATUS, CONTROL METHOD THEREOF, AND STORAGE MEDIUM
20220385876 · 2022-12-01 ·

An image processing apparatus obtains information that on a first video and a second video at least one of which is a captured video obtained by an image capturing apparatus, the information related to the first and second videos includes information on first and second viewpoints corresponding to the first and second videos of a same timing. The image processing apparatus, in a case where switching a video to be outputted from the first video to the second video, generates information on a virtual viewpoint corresponding to a period from an end of output of the first video until a start of output of the second video, based on the obtained information on the first viewpoint corresponding to the period and the obtained information on the second viewpoint corresponding to the period.

IMAGE PROCESSING APPARATUS, CONTROL METHOD THEREOF, AND STORAGE MEDIUM
20220385876 · 2022-12-01 ·

An image processing apparatus obtains information that on a first video and a second video at least one of which is a captured video obtained by an image capturing apparatus, the information related to the first and second videos includes information on first and second viewpoints corresponding to the first and second videos of a same timing. The image processing apparatus, in a case where switching a video to be outputted from the first video to the second video, generates information on a virtual viewpoint corresponding to a period from an end of output of the first video until a start of output of the second video, based on the obtained information on the first viewpoint corresponding to the period and the obtained information on the second viewpoint corresponding to the period.

Method and device for transmitting information on three-dimensional content including multiple view points

Provided is a method for transmitting metadata for omnidirectional content including a plurality of viewpoints. The method comprises identifying the metadata for the omnidirectional content including the plurality of viewpoints; and transmitting the identified metadata, wherein the metadata includes information about an identifier (ID) of a viewpoint group including at least one viewpoint of the plurality of viewpoints, and wherein the at least one viewpoint in the viewpoint group shares a common reference coordinate system.

Method and device for transmitting information on three-dimensional content including multiple view points

Provided is a method for transmitting metadata for omnidirectional content including a plurality of viewpoints. The method comprises identifying the metadata for the omnidirectional content including the plurality of viewpoints; and transmitting the identified metadata, wherein the metadata includes information about an identifier (ID) of a viewpoint group including at least one viewpoint of the plurality of viewpoints, and wherein the at least one viewpoint in the viewpoint group shares a common reference coordinate system.

LIGHT FIELD SYNTHESIS METHOD AND LIGHT FIELD SYNTHESIS SYSTEM
20220377301 · 2022-11-24 ·

A light field synthesis method and a light field synthesis system are provided. The light field synthesis method includes inputting light field information corresponding to a scene into a trained learning model. The light field information is a light field having a plurality of views. The light field synthesis method further includes configuring the trained learning model to generate a synthesized light field according to the input light field information. The synthesized light field has a plurality of new views other than the plurality of views. The trained learning model is obtained by performing a training process on a learning model, and the training process includes optimizing the learning model in a refocused image domain, so as to minimize refocused image errors.

LIGHT FIELD SYNTHESIS METHOD AND LIGHT FIELD SYNTHESIS SYSTEM
20220377301 · 2022-11-24 ·

A light field synthesis method and a light field synthesis system are provided. The light field synthesis method includes inputting light field information corresponding to a scene into a trained learning model. The light field information is a light field having a plurality of views. The light field synthesis method further includes configuring the trained learning model to generate a synthesized light field according to the input light field information. The synthesized light field has a plurality of new views other than the plurality of views. The trained learning model is obtained by performing a training process on a learning model, and the training process includes optimizing the learning model in a refocused image domain, so as to minimize refocused image errors.