Patent classifications
H04N13/15
Methods, systems, and media for generating an immersive light field video with a layered mesh representation
Mechanisms for generating compressed images are provided. More particularly, methods, systems, and media for capturing, reconstructing, compressing, and rendering view-dependent immersive light field video with a layered mesh representation are provided.
Methods, systems, and media for generating an immersive light field video with a layered mesh representation
Mechanisms for generating compressed images are provided. More particularly, methods, systems, and media for capturing, reconstructing, compressing, and rendering view-dependent immersive light field video with a layered mesh representation are provided.
MODIFYING FEATURES IN AN ARTIFICIAL REALITY SYSTEM FOR THE DIFFERENTLY ABLED
Methods, systems, and storage media for changing user representations in an artificial reality environment are disclosed. Exemplary implementations may: receive an indication of a user representation in a virtual area of the artificial reality environment; receive an indication of a user impairment; determine a characteristic of the user representation that corresponds to the user impairment; determine a plurality of alternative user representations corresponding to the characteristic of the user representation; select an alternative user representation of the plurality of alternative user representations based on determining an impairment level of the user impairment; and output the alternative user representation in the artificial reality environment.
MODIFYING FEATURES IN AN ARTIFICIAL REALITY SYSTEM FOR THE DIFFERENTLY ABLED
Methods, systems, and storage media for changing user representations in an artificial reality environment are disclosed. Exemplary implementations may: receive an indication of a user representation in a virtual area of the artificial reality environment; receive an indication of a user impairment; determine a characteristic of the user representation that corresponds to the user impairment; determine a plurality of alternative user representations corresponding to the characteristic of the user representation; select an alternative user representation of the plurality of alternative user representations based on determining an impairment level of the user impairment; and output the alternative user representation in the artificial reality environment.
THREE-DIMENSIONAL DISPLAYS USING ELECTROMAGNETIC FIELD COMPUTATIONS
Methods, apparatus, devices, and systems for three-dimensional (3D) displaying objects are provided. In one aspect, a method includes obtaining data including respective primitive data for primitives corresponding to an object, determining an electromagnetic (EM) field contribution to each element of a display for each of the primitives by calculating an EM field propagation from the primitive to the element, generating a sum of the EM field contributions from the primitives for each of the elements, transmitting to each of the elements a respective control signal for modulating at least one property of the element based on the sum of the EM field contributions, and transmitting a timing control signal to an illuminator to activate the illuminator to illuminate light on the display, such that the light is caused by the modulated elements of the display to form a volumetric light field corresponding to the object.
THREE-DIMENSIONAL DISPLAYS USING ELECTROMAGNETIC FIELD COMPUTATIONS
Methods, apparatus, devices, and systems for three-dimensional (3D) displaying objects are provided. In one aspect, a method includes obtaining data including respective primitive data for primitives corresponding to an object, determining an electromagnetic (EM) field contribution to each element of a display for each of the primitives by calculating an EM field propagation from the primitive to the element, generating a sum of the EM field contributions from the primitives for each of the elements, transmitting to each of the elements a respective control signal for modulating at least one property of the element based on the sum of the EM field contributions, and transmitting a timing control signal to an illuminator to activate the illuminator to illuminate light on the display, such that the light is caused by the modulated elements of the display to form a volumetric light field corresponding to the object.
THREE-DIMENSIONALIZATION METHOD AND APPARATUS FOR TWO-DIMENSIONAL IMAGE, DEVICE AND COMPUTER-READABLE STORAGE MEDIUM
This application provides a three-dimensionalization method and apparatus for a two-dimensional image, an electronic device, and a computer-readable storage medium. The method includes performing depth perception processing on a two-dimensional image, to obtain a depth value of each pixel in the two-dimensional image; performing migration processing on the two-dimensional image from multiple perspectives, to obtain a migration result of the two-dimensional image corresponding to each perspective; determining a color value of each pixel in a migration image corresponding to each perspective, based on the depth value of each pixel in the two-dimensional image and the migration result of the two-dimensional image corresponding to each perspective; generating, based on the color value of each pixel in the migration image of each perspective, the migration image corresponding to the perspective; and encapsulating the migration images of the multiple perspectives in an order, to obtain a three-dimensional video.
THREE-DIMENSIONALIZATION METHOD AND APPARATUS FOR TWO-DIMENSIONAL IMAGE, DEVICE AND COMPUTER-READABLE STORAGE MEDIUM
This application provides a three-dimensionalization method and apparatus for a two-dimensional image, an electronic device, and a computer-readable storage medium. The method includes performing depth perception processing on a two-dimensional image, to obtain a depth value of each pixel in the two-dimensional image; performing migration processing on the two-dimensional image from multiple perspectives, to obtain a migration result of the two-dimensional image corresponding to each perspective; determining a color value of each pixel in a migration image corresponding to each perspective, based on the depth value of each pixel in the two-dimensional image and the migration result of the two-dimensional image corresponding to each perspective; generating, based on the color value of each pixel in the migration image of each perspective, the migration image corresponding to the perspective; and encapsulating the migration images of the multiple perspectives in an order, to obtain a three-dimensional video.
APPARATUS AND METHOD FOR ELIMINATING DUPLICATE DATA BETWEEN MULTI-VIEW VIDEOS
Disclosed herein are an apparatus and method for removing redundant data between multi-view videos. The method includes generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images, and revalidating the pruning mask using color information of the basic view image and the additional view image. Revalidating the pruning mask may include defining a color relationship between the basic view image and the additional view image by extracting predetermined sample values from corresponding pixels between the basic view image and the additional view image, which are included in the pruning candidate group of the pruning mask, and detecting pixels that do not match the defined color relationship, among the pixels in the pruning mask, as outliers.
APPARATUS AND METHOD FOR ELIMINATING DUPLICATE DATA BETWEEN MULTI-VIEW VIDEOS
Disclosed herein are an apparatus and method for removing redundant data between multi-view videos. The method includes generating a pruning mask of an additional view image by mapping a basic view image to the additional view image, among multi-view images, and revalidating the pruning mask using color information of the basic view image and the additional view image. Revalidating the pruning mask may include defining a color relationship between the basic view image and the additional view image by extracting predetermined sample values from corresponding pixels between the basic view image and the additional view image, which are included in the pruning candidate group of the pruning mask, and detecting pixels that do not match the defined color relationship, among the pixels in the pruning mask, as outliers.