G06T17/00

Spatial construction using guided surface detection
11580658 · 2023-02-14 · ·

Described herein are a system and methods for efficiently using depth and image information for a space to generate a 3D representation of that space. In some embodiments, an indication of one or more points is received with respect to image information, which is then mapped to corresponding points within depth information. A boundary may then be calculated to be associated with each of the points based on the depth information at, and surrounding, each point. Each of the boundaries are extended outward until junctions are identified as bounding the boundaries in a direction. The system may determine whether the process is complete or not based on whether any of the calculated boundaries are currently unlimited in extent in any direction. Once the system determines that each of the boundaries is limited in extent, a 3D representation of the space may be generated based on the identified junctions and/or boundaries.

Spatial construction using guided surface detection
11580658 · 2023-02-14 · ·

Described herein are a system and methods for efficiently using depth and image information for a space to generate a 3D representation of that space. In some embodiments, an indication of one or more points is received with respect to image information, which is then mapped to corresponding points within depth information. A boundary may then be calculated to be associated with each of the points based on the depth information at, and surrounding, each point. Each of the boundaries are extended outward until junctions are identified as bounding the boundaries in a direction. The system may determine whether the process is complete or not based on whether any of the calculated boundaries are currently unlimited in extent in any direction. Once the system determines that each of the boundaries is limited in extent, a 3D representation of the space may be generated based on the identified junctions and/or boundaries.

INTERACTION PERIPHERAL, DETECTION METHOD, VIRTUAL REALITY HEADSET, METHOD FOR REPRODUCING A REAL POINT IN VIRTUAL SPACE, DEVICE AND METHOD FOR VIRTUALISING A REAL SPACE
20230042781 · 2023-02-09 ·

An interaction peripheral, a method for detecting a real point, a virtual reality headset, a method for reproducing a real point in virtual space, a device and a method for virtualising a real space, particularly allowing a plane to be obtained in two, three or n dimensions of a real space which may be reproducible in virtual reality. An interaction peripheral which can be connected to a virtual reality headset, includes a range finder which can supply, to the headset, a measurement signal including a relative position measurement of a real point of a real space, the real point being sighted by the range finder. The measurement signal enables reproduction of the real point measured in a virtual space generated by the headset. Thus, the real point can be reproduced in real space while reducing risks of errors because the measurement tools are simple interaction peripherals handled by a user.

INTERACTION PERIPHERAL, DETECTION METHOD, VIRTUAL REALITY HEADSET, METHOD FOR REPRODUCING A REAL POINT IN VIRTUAL SPACE, DEVICE AND METHOD FOR VIRTUALISING A REAL SPACE
20230042781 · 2023-02-09 ·

An interaction peripheral, a method for detecting a real point, a virtual reality headset, a method for reproducing a real point in virtual space, a device and a method for virtualising a real space, particularly allowing a plane to be obtained in two, three or n dimensions of a real space which may be reproducible in virtual reality. An interaction peripheral which can be connected to a virtual reality headset, includes a range finder which can supply, to the headset, a measurement signal including a relative position measurement of a real point of a real space, the real point being sighted by the range finder. The measurement signal enables reproduction of the real point measured in a virtual space generated by the headset. Thus, the real point can be reproduced in real space while reducing risks of errors because the measurement tools are simple interaction peripherals handled by a user.

METHOD, APPARATUS, SYSTEM, AND STORAGE MEDIUM FOR 3D RECONSTRUCTION
20230040550 · 2023-02-09 · ·

A method, device, computer system and computer readable storage medium for 3D reconstruction are provided. The method comprises: performing a 3D reconstruction of an original 2D image of a target object to generate an original 3D object corresponding to the original 2D image; selecting a complementary view of the target object from candidate views based on a reconstruction quality of the original 3D object at the candidate views; obtaining a complementary 2D image of the target object based on the complementary view; performing a 3D reconstruction of the complementary 2D image to generate a complementary 3D object corresponding to the complementary 2D image; and fusing the original 3D object and the complementary 3D object to obtain a 3D reconstruction result of the target object.

METHOD, APPARATUS, SYSTEM, AND STORAGE MEDIUM FOR 3D RECONSTRUCTION
20230040550 · 2023-02-09 · ·

A method, device, computer system and computer readable storage medium for 3D reconstruction are provided. The method comprises: performing a 3D reconstruction of an original 2D image of a target object to generate an original 3D object corresponding to the original 2D image; selecting a complementary view of the target object from candidate views based on a reconstruction quality of the original 3D object at the candidate views; obtaining a complementary 2D image of the target object based on the complementary view; performing a 3D reconstruction of the complementary 2D image to generate a complementary 3D object corresponding to the complementary 2D image; and fusing the original 3D object and the complementary 3D object to obtain a 3D reconstruction result of the target object.

METHOD AND APPARATUS FOR PROCESSING HUMAN BODY MODEL DATA, ELECTRONIC DEVICE AND STORAGE MEDIUM
20230041874 · 2023-02-09 ·

A method and apparatus for processing human body model data, an electronic device and a storage medium are provided. The method includes: obtaining 3D human body model data, and classifying the 3D human body model data into multiple data sets according to a predetermined classification condition, wherein the predetermined classification condition includes medical anatomy category information and art resource category information; determining, according to each of the data sets, a duplicate resource in the data set, and reorganized data sets where the duplicate resource is removed; and packing each of the duplicate resource and the reorganized data sets into a respective data package, and storing all of the data packages.

METHOD AND APPARATUS FOR PROCESSING HUMAN BODY MODEL DATA, ELECTRONIC DEVICE AND STORAGE MEDIUM
20230041874 · 2023-02-09 ·

A method and apparatus for processing human body model data, an electronic device and a storage medium are provided. The method includes: obtaining 3D human body model data, and classifying the 3D human body model data into multiple data sets according to a predetermined classification condition, wherein the predetermined classification condition includes medical anatomy category information and art resource category information; determining, according to each of the data sets, a duplicate resource in the data set, and reorganized data sets where the duplicate resource is removed; and packing each of the duplicate resource and the reorganized data sets into a respective data package, and storing all of the data packages.

SYSTEM AND METHOD FOR GENERATING THREE DIMENSIONAL GEOMETRIC MODELS OF ANATOMICAL REGIONS

A three-dimensional geometric image of an anatomical region is generated from a plurality of two-dimensional echographic image slices of the region. The image slices are filtered using a reaction-diffusion partial differential equation model before being arranged into a voxel space. Each voxel is then assigned a voxel value to create a volumetric data set from which the volumetric image can be rendered. The image is rendered from far to near, relative to a preset viewing direction, by an alpha-blending process. The alpha value at any given voxel can be determined using the magnitude of the density gradient vector at that voxel. Similarly, the direction of the density gradient vector at a given voxel can be used as a surface normal vector for shading purposes at that voxel.

SKILL CASTING METHOD AND APPARATUS OF VIRTUAL OBJECT, DEVICE, AND STORAGE MEDIUM
20230043121 · 2023-02-09 ·

The present disclosure provides a skill casting method and apparatus of a virtual object, a device, and a storage medium. The method includes displaying a first virtual object in a virtual environment, the virtual environment further comprising a second virtual object, the first virtual object facing a first direction, and the second virtual object being located at a second direction of the first virtual object; displaying a casting preparation process of the first virtual object casting a target skill when the target skill is triggered on the first virtual object; and controlling the first virtual object to cast the target skill toward the second direction when the casting preparation process ends.