H04N13/279

Stereoscopic rendering of non-flat, reflective or refractive surfaces
11600043 · 2023-03-07 · ·

A computer program product may cause one or more processors to generate stereoscopic images of one or more 3D models within a 3D model space. As part of the generation of the stereoscopic images, special case surfaces that are non-flat and specularly reflective or refractive are rendered in a special manner. The special manner involves rendering a texture for the special case surface based on a third projection corresponding to a third viewpoint that is spaced from both a first viewpoint (i.e., a left eye viewpoint) and a second viewpoint (i.e., a right eye viewpoint). Accordingly, when rendering first and second images (i.e., images corresponding respectively to the first and second viewpoints), the texture corresponding to the third viewpoint may be applied to the special case surface in both the first and second images. As a result, the disparity between the stereoscopic images may be low enough that the special case surface may be readily fused by the human viewer and not become a visual problem or an area of unwanted visual focus for the viewer.

DISPLAY METHOD, ELECTRONIC DEVICE AND STORAGE MEDIUM

A display method, an electronic device and a storage medium. A particular implementation of the method includes: determining eye position information of an object in an image; determining camera position information of naked eye 3D according to the eye position information; creating an eye space according to the camera position information; obtaining, according to object position information of a target object in the eye space, projection position information of the target object on a projection plane based on projection information; and displaying the target object according to the projection position information.

INFORMATION PROCESSING APPARATUS, VIDEO GENERATION METHOD AND PROGRAM
20220329770 · 2022-10-13 · ·

A score map generation unit (83) (image quality prediction unit) included in an information processing apparatus (10a) predicts, for a 3D model (90M) (3D object), a relationship between a position of a virtual viewpoint (V) from which the 3D model (90M) is viewed and image quality of a virtual image (J) obtained when the 3D model (90M) is viewed from the position of the virtual viewpoint (V).

INFORMATION PROCESSING APPARATUS, VIDEO GENERATION METHOD AND PROGRAM
20220329770 · 2022-10-13 · ·

A score map generation unit (83) (image quality prediction unit) included in an information processing apparatus (10a) predicts, for a 3D model (90M) (3D object), a relationship between a position of a virtual viewpoint (V) from which the 3D model (90M) is viewed and image quality of a virtual image (J) obtained when the 3D model (90M) is viewed from the position of the virtual viewpoint (V).

System and method for rendering free viewpoint video for studio applications

Systems and methods for foreground/background separation and for studio production of a FVV. A method includes projecting, onto objects in a filming area within a studio, a predefined pattern including a large set of features; generating, based on signals reflected off of the objects and captured by a plurality of depth cameras deployed in proximity to the filming area, a local point cloud for each depth camera; separating, based on the local point clouds, between a background and a foreground of the filming area; creating, based on the local point clouds, a unified point cloud; meshing points in the unified point cloud to generate a 3D model of the objects; texturing the 3D model based on the separation and images captured by the depth cameras; and rendering the textured 3D model as a FVV including a series of video frames with respect to at least one viewpoint.

System and method for rendering free viewpoint video for studio applications

Systems and methods for foreground/background separation and for studio production of a FVV. A method includes projecting, onto objects in a filming area within a studio, a predefined pattern including a large set of features; generating, based on signals reflected off of the objects and captured by a plurality of depth cameras deployed in proximity to the filming area, a local point cloud for each depth camera; separating, based on the local point clouds, between a background and a foreground of the filming area; creating, based on the local point clouds, a unified point cloud; meshing points in the unified point cloud to generate a 3D model of the objects; texturing the 3D model based on the separation and images captured by the depth cameras; and rendering the textured 3D model as a FVV including a series of video frames with respect to at least one viewpoint.

System and method for generating combined embedded multi-view interactive digital media representations

Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view.

System and method for generating combined embedded multi-view interactive digital media representations

Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view.

Object display in virtual and augmented reality

An apparatus comprising means for: causing display of at least one world-locked volumetric object having at least one non-viewable region; determining a change in a user's viewing position relative to the at least one world-locked volumetric object; determining if the change in the user's viewing position relative to the at least one world-locked volumetric object will cause display of at least a portion of the at least one non-viewable region of the at least one world-locked volumetric object; and if it is determined that the change in the user's viewing position will cause display of at least a portion of the at least one non-viewable region, cause the at least one world-locked volumetric object to be user-locked.

Object display in virtual and augmented reality

An apparatus comprising means for: causing display of at least one world-locked volumetric object having at least one non-viewable region; determining a change in a user's viewing position relative to the at least one world-locked volumetric object; determining if the change in the user's viewing position relative to the at least one world-locked volumetric object will cause display of at least a portion of the at least one non-viewable region of the at least one world-locked volumetric object; and if it is determined that the change in the user's viewing position will cause display of at least a portion of the at least one non-viewable region, cause the at least one world-locked volumetric object to be user-locked.