G06T15/08

VOLUMETRIC VIDEO WITH AUXILIARY PATCHES
20230042874 · 2023-02-09 ·

Methods and devices for encoding and decoding data representative of a 3D scene are disclosed. A set of first patches is generated from a first MVD content acquired from a first region of the 3D scene. A patch is a part of one of the views of the MVD content. A set of second patches is generated from a second MVD content acquired from a second region of the 3D scene. An atlas packing first and second patches is generated and associated with metadata indicating, for a patch of the atlas, whether the patch is a first or a second patch At the decoding side, first patches are used for rendering the viewport image and second patches are used for pre-processing or post-processing the viewport image.

VOLUMETRIC VIDEO WITH AUXILIARY PATCHES
20230042874 · 2023-02-09 ·

Methods and devices for encoding and decoding data representative of a 3D scene are disclosed. A set of first patches is generated from a first MVD content acquired from a first region of the 3D scene. A patch is a part of one of the views of the MVD content. A set of second patches is generated from a second MVD content acquired from a second region of the 3D scene. An atlas packing first and second patches is generated and associated with metadata indicating, for a patch of the atlas, whether the patch is a first or a second patch At the decoding side, first patches are used for rendering the viewport image and second patches are used for pre-processing or post-processing the viewport image.

METHOD, APPARATUS, SYSTEM, AND STORAGE MEDIUM FOR 3D RECONSTRUCTION
20230040550 · 2023-02-09 · ·

A method, device, computer system and computer readable storage medium for 3D reconstruction are provided. The method comprises: performing a 3D reconstruction of an original 2D image of a target object to generate an original 3D object corresponding to the original 2D image; selecting a complementary view of the target object from candidate views based on a reconstruction quality of the original 3D object at the candidate views; obtaining a complementary 2D image of the target object based on the complementary view; performing a 3D reconstruction of the complementary 2D image to generate a complementary 3D object corresponding to the complementary 2D image; and fusing the original 3D object and the complementary 3D object to obtain a 3D reconstruction result of the target object.

METHOD, APPARATUS, SYSTEM, AND STORAGE MEDIUM FOR 3D RECONSTRUCTION
20230040550 · 2023-02-09 · ·

A method, device, computer system and computer readable storage medium for 3D reconstruction are provided. The method comprises: performing a 3D reconstruction of an original 2D image of a target object to generate an original 3D object corresponding to the original 2D image; selecting a complementary view of the target object from candidate views based on a reconstruction quality of the original 3D object at the candidate views; obtaining a complementary 2D image of the target object based on the complementary view; performing a 3D reconstruction of the complementary 2D image to generate a complementary 3D object corresponding to the complementary 2D image; and fusing the original 3D object and the complementary 3D object to obtain a 3D reconstruction result of the target object.

SYSTEM AND METHOD FOR GENERATING THREE DIMENSIONAL GEOMETRIC MODELS OF ANATOMICAL REGIONS

A three-dimensional geometric image of an anatomical region is generated from a plurality of two-dimensional echographic image slices of the region. The image slices are filtered using a reaction-diffusion partial differential equation model before being arranged into a voxel space. Each voxel is then assigned a voxel value to create a volumetric data set from which the volumetric image can be rendered. The image is rendered from far to near, relative to a preset viewing direction, by an alpha-blending process. The alpha value at any given voxel can be determined using the magnitude of the density gradient vector at that voxel. Similarly, the direction of the density gradient vector at a given voxel can be used as a surface normal vector for shading purposes at that voxel.

SYSTEM AND METHOD FOR GENERATING THREE DIMENSIONAL GEOMETRIC MODELS OF ANATOMICAL REGIONS

A three-dimensional geometric image of an anatomical region is generated from a plurality of two-dimensional echographic image slices of the region. The image slices are filtered using a reaction-diffusion partial differential equation model before being arranged into a voxel space. Each voxel is then assigned a voxel value to create a volumetric data set from which the volumetric image can be rendered. The image is rendered from far to near, relative to a preset viewing direction, by an alpha-blending process. The alpha value at any given voxel can be determined using the magnitude of the density gradient vector at that voxel. Similarly, the direction of the density gradient vector at a given voxel can be used as a surface normal vector for shading purposes at that voxel.

VOLUMETRIC DYNAMIC DEPTH DELINEATION

A method for visualizing two-dimensional data with three-dimensional volume enables the end user to easily view abnormalities in sequential data. The two-dimensional data can be in the form of a tiled texture with the images in a set row and column, a media file with the images displayed at certain images in time, or any other way to depict a set of two-dimensional images. The disclosed method takes in each pixel of the images and evaluates the density, usually represented by color, of the pixel. The disclosed method evaluates and renders the opacity and color of each of the pixels within the volume. The disclosed method also calculates and creates dynamic shadows within the volume in real time. This evaluation allows the user to set threshold values and return exact representations of the data presented.

VOLUMETRIC DYNAMIC DEPTH DELINEATION

A method for visualizing two-dimensional data with three-dimensional volume enables the end user to easily view abnormalities in sequential data. The two-dimensional data can be in the form of a tiled texture with the images in a set row and column, a media file with the images displayed at certain images in time, or any other way to depict a set of two-dimensional images. The disclosed method takes in each pixel of the images and evaluates the density, usually represented by color, of the pixel. The disclosed method evaluates and renders the opacity and color of each of the pixels within the volume. The disclosed method also calculates and creates dynamic shadows within the volume in real time. This evaluation allows the user to set threshold values and return exact representations of the data presented.

SYSTEM AND METHOD FOR FLOW-RESOLVED, THREE-DIMENSIONAL IMAGING
20230042953 · 2023-02-09 ·

A system and method are provided for creating an image including quantified flow within vessels of a subject. The method includes providing a single-sweep, three-dimensional (3D) image volume acquired from a subject during a single pass of a computed tomography (CT) imaging system as the subject receives a dose of a contrast agent and determining a phase shift corresponding to pulsatile contrast in vessels within the single-sweep, 3D image volume. The method further includes quantifying a flow through the vessels within the single-sweep, 3D image volume using the phase shift and generating a report including indicating flow through the vessels within the 3D image volume.

AUGMENTING A VIEW OF A REAL-WORLD ENVIRONMENT WITH A VIEW OF A VOLUMETRIC VIDEO OBJECT

The A method of augmenting a view of a real-world environment with a view of a volumetric video object on a user device is disclosed . The method includes determining a current pose information (CPI) indicating a current pose of the view of the real-world environment and a desired pose of the volumetric video object in the real-world environment. The method further includes sending the CPI to a remote server. The method further includes receiving a rendered view of the volumetric video object that has been rendered in accordance with the CPI from the remote server. The method also includes augmenting the view of the real-world environment by at least mapping the rendered view of the volumetric video object onto a planar mapping surface arranged according to the desired position of the volumetric video object.