Patent classifications
H04N13/279
Methods and apparatus for efficient multi-view rasterization
The present disclosure relates to methods and apparatus for graphics processing. Aspects of the present disclosure can determine at least one scene including one or more viewpoints. Also, aspects of the present disclosure can divide the at least one scene into a plurality of zones based on each of the one or more viewpoints. Further, aspects of the present disclosure can determine whether a zone based on one viewpoint of the one or more viewpoints is substantially similar to a zone based on another viewpoint of the one or more viewpoints. Aspects of the present disclosure can also generate a geometry buffer for each of the plurality of zones based on the one or more viewpoints. Moreover, aspects of the present disclosure can combine the geometry buffers for each of the plurality of zones based on the one or more viewpoints.
System and method for rendering free viewpoint video for sport applications
Methods and systems for generating free viewpoint videos (FVVs) based on images captured in a sports arena. A method includes projecting, onto objects within a filming area within the sports arena, a predefined pattern including a large set of features; generating, based on signals captured by each of a plurality of depth cameras, a point cloud for each depth camera, wherein the plurality of depth cameras is deployed in proximity to the filming area, wherein the captured signals are reflected off of the objects within the filming area; creating, based on the plurality of point clouds, a unified point cloud; meshing points in the unified point cloud to generate a three-dimensional (3D) model of the objects; texturing the 3D model based on images captured by the plurality of depth cameras; and rendering the textured 3D model as a FVV including a series of video frames with respect to a viewpoint.
System and method for rendering free viewpoint video for sport applications
Methods and systems for generating free viewpoint videos (FVVs) based on images captured in a sports arena. A method includes projecting, onto objects within a filming area within the sports arena, a predefined pattern including a large set of features; generating, based on signals captured by each of a plurality of depth cameras, a point cloud for each depth camera, wherein the plurality of depth cameras is deployed in proximity to the filming area, wherein the captured signals are reflected off of the objects within the filming area; creating, based on the plurality of point clouds, a unified point cloud; meshing points in the unified point cloud to generate a three-dimensional (3D) model of the objects; texturing the 3D model based on images captured by the plurality of depth cameras; and rendering the textured 3D model as a FVV including a series of video frames with respect to a viewpoint.
Geometry modeling of eyewear devices with flexible frames
An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
IMAGE PROCESSING DEVICE, CALIBRATION BOARD, AND METHOD FOR GENERATING 3D MODEL DATA
The present technique relates to an image processing device, a calibration board, and a method for generating 3D model data, which can easily achieve synchronization among devices. An image processing device including; an image synchronization unit that performs time synchronization on a plurality of images of a board on a basis of lighting conditions of a plurality of light-emitting parts included in the plurality of images captured by a plurality of imaging devices, the board including the plurality of light-emitting parts and a predetermined image pattern; and a calibration unit that calculates camera parameters of the plurality of imaging devices by using the plurality of images having been subjected to the time synchronization. The present technique can be applied to, for example, an image processing system that captures images to generate a 3D model.
IMAGE PROCESSING DEVICE, CALIBRATION BOARD, AND METHOD FOR GENERATING 3D MODEL DATA
The present technique relates to an image processing device, a calibration board, and a method for generating 3D model data, which can easily achieve synchronization among devices. An image processing device including; an image synchronization unit that performs time synchronization on a plurality of images of a board on a basis of lighting conditions of a plurality of light-emitting parts included in the plurality of images captured by a plurality of imaging devices, the board including the plurality of light-emitting parts and a predetermined image pattern; and a calibration unit that calculates camera parameters of the plurality of imaging devices by using the plurality of images having been subjected to the time synchronization. The present technique can be applied to, for example, an image processing system that captures images to generate a 3D model.
Methods and systems for tailoring an extended reality overlay object
An exemplary extended reality presentation system determines that a depiction of an augmentable object within a field of view takes up a first portion of the field of view, and, in response to this determination, presents a first form of an overlay object within the field of view. The first form of the overlay object is graphically associated with the augmentable object. During the presenting of the first form of the overlay object within the field of view, the system determines that the depiction of the augmentable object has come to take up a second portion of the field of view, and, in response to this determination, replaces the first form of the overlay object with a second form of the overlay object within the field of view. The second form of the overlay object is distinct from the first form. Corresponding methods and systems are also disclosed.
Methods and systems for tailoring an extended reality overlay object
An exemplary extended reality presentation system determines that a depiction of an augmentable object within a field of view takes up a first portion of the field of view, and, in response to this determination, presents a first form of an overlay object within the field of view. The first form of the overlay object is graphically associated with the augmentable object. During the presenting of the first form of the overlay object within the field of view, the system determines that the depiction of the augmentable object has come to take up a second portion of the field of view, and, in response to this determination, replaces the first form of the overlay object with a second form of the overlay object within the field of view. The second form of the overlay object is distinct from the first form. Corresponding methods and systems are also disclosed.
CONTENT GENERATION SYSTEM AND METHOD
A system for improving a discovery process for a virtual environment, the system comprising an environment discovery unit operable to perform a discovery process comprising navigation of the virtual environment and identification of one or more aspects of the virtual environment, a performance analysis unit operable to evaluate the effectiveness of the discovery process, and a discovery update unit operable to modify future operation of the environment discovery unit in dependence upon the evaluation.
CONTENT GENERATION SYSTEM AND METHOD
A system for improving a discovery process for a virtual environment, the system comprising an environment discovery unit operable to perform a discovery process comprising navigation of the virtual environment and identification of one or more aspects of the virtual environment, a performance analysis unit operable to evaluate the effectiveness of the discovery process, and a discovery update unit operable to modify future operation of the environment discovery unit in dependence upon the evaluation.