A multi-characteristic remeshing system that generates remeshed 3D graphical surfaces can include a compact geometric descriptive language (“CGDL”) conversion module, one or more geometric characteristic parsing modules, and a geometric computation module. The CGDL conversion module receives an input mesh for a 3D graphical object and CGDL source text that describes target characteristics of an output mesh of the 3D graphical object. Each geometric characteristic parsing module identifies inherent geometric characteristics of the input mesh, and generates a geometric characteristic map. The geometric characteristic map includes instructions to generate the output mesh with respective target characteristics. The instruction describes a relationship of the one or more inherent geometric characteristics with the respective target characteristic. The geometric computation module generates the output mesh with the target characteristics, based on the geometric characteristic maps from the geometric characteristic parsing modules.

A multi-characteristic remeshing system that generates remeshed 3D graphical surfaces can include a compact geometric descriptive language (“CGDL”) conversion module, one or more geometric characteristic parsing modules, and a geometric computation module. The CGDL conversion module receives an input mesh for a 3D graphical object and CGDL source text that describes target characteristics of an output mesh of the 3D graphical object. Each geometric characteristic parsing module identifies inherent geometric characteristics of the input mesh, and generates a geometric characteristic map. The geometric characteristic map includes instructions to generate the output mesh with respective target characteristics. The instruction describes a relationship of the one or more inherent geometric characteristics with the respective target characteristic. The geometric computation module generates the output mesh with the target characteristics, based on the geometric characteristic maps from the geometric characteristic parsing modules.

Systems and methods are described for generating a plurality of three-dimensional (3D) proxy geometries of an object, generating, based on the plurality of 3D proxy geometries, a plurality of neural textures of the object, the neural textures defining a plurality of different shapes and appearances representing the object, providing the plurality of neural textures to a neural renderer, receiving, from the neural renderer and based on the plurality of neural textures, a color image and an alpha mask representing an opacity of at least a portion of the object, and generating a composite image based on the pose, the color image, and the alpha mask.

A graphics processing unit (GPU) processes graphics data using a rendering space which is sub-divided into a plurality of tiles. The GPU comprises cost indication logic configured to obtain a cost indication for each of a plurality of sets of one or more tiles of the rendering space. The cost indication for a set of tile(s) is suggestive of a cost of processing the set of one or more tiles. The GPU controls a rendering complexity with which primitives are rendered in tiles based on the cost indication for those tiles. This allows tiles to be rendered in a manner that is suitable based on the complexity of the graphics data within the tiles. In turn, this allows the rendering to satisfy constraints such as timing constraints even when the complexity of different tiles may vary significantly within an image.

A graphics processing unit (GPU) processes graphics data using a rendering space which is sub-divided into a plurality of tiles. The GPU comprises cost indication logic configured to obtain a cost indication for each of a plurality of sets of one or more tiles of the rendering space. The cost indication for a set of tile(s) is suggestive of a cost of processing the set of one or more tiles. The GPU controls a rendering complexity with which primitives are rendered in tiles based on the cost indication for those tiles. This allows tiles to be rendered in a manner that is suitable based on the complexity of the graphics data within the tiles. In turn, this allows the rendering to satisfy constraints such as timing constraints even when the complexity of different tiles may vary significantly within an image.

Systems and techniques for reconstructing one or more eyes using a parametric eye model are provided. The systems and techniques may include obtaining one or more input images that include at least one eye. The systems and techniques may further include obtaining a parametric eye model including an eyeball model and an iris model. The systems and techniques may further include determining parameters of the parametric eye model from the one or more input images. The parameters can be determined to fit the parametric eye model to the at least one eye in the one or more input images. The parameters include a control map used by the iris model to synthesize an iris of the at least one eye. The systems and techniques may further include reconstructing the at least one eye using the parametric eye model with the determined parameters.

An image processing system includes a computing platform having processing hardware, a display, and a system memory storing a software code. The processing hardware executes the software code to receive a digital object, surround the digital object with virtual cameras oriented toward the digital object, render, using each one of the virtual cameras, a depth map identifying a distance of that one of the virtual cameras from the digital object, and generate, using the depth map, a volumetric perspective of the digital object from a perspective of that one of the virtual cameras, resulting in multiple volumetric perspectives of the digital object. The processing hardware further executes the software code to merge the multiple volumetric perspectives of the digital object to form a volumetric representation of the digital object, and to convert the volumetric representation of the digital object to a renderable form.

An image processing system includes a computing platform having processing hardware, a display, and a system memory storing a software code. The processing hardware executes the software code to receive a digital object, surround the digital object with virtual cameras oriented toward the digital object, render, using each one of the virtual cameras, a depth map identifying a distance of that one of the virtual cameras from the digital object, and generate, using the depth map, a volumetric perspective of the digital object from a perspective of that one of the virtual cameras, resulting in multiple volumetric perspectives of the digital object. The processing hardware further executes the software code to merge the multiple volumetric perspectives of the digital object to form a volumetric representation of the digital object, and to convert the volumetric representation of the digital object to a renderable form.

A computer-implemented method for visualizing the appearances of at least two materials includes obtaining a first set of appearance attributes, the appearance attributes of the first set being associated with a first material, the first set of appearance attributes comprising measured appearance attributes, obtaining a second set of appearance attributes, the appearance attributes of the second set being associated with a second material; and obtaining a geometric model of at least one virtual object, the geometric model defining a three-dimensional macroscopic surface geometry of the virtual object. The invention is characterized by synthesizing a third set of appearance attributes from the first set of appearance attributes and the second set of appearance attributes and visualizing, using a display device, a scene comprising the at least one virtual object, using the third set of appearance attributes, a comparison set of appearance attributes and the geometric model, a first portion of the at least one virtual object being visualized using the third set of appearance attributes, and a second portion of the at least one virtual object being visualized using the comparison set of appearance attributes, to allow a direct a visual comparison of the first set of appearance attributes as modified by the second set of appearance attributes with the comparison set of appearance attributes.

A computer-implemented method for visualizing the appearances of at least two materials includes obtaining a first set of appearance attributes, the appearance attributes of the first set being associated with a first material, the first set of appearance attributes comprising measured appearance attributes, obtaining a second set of appearance attributes, the appearance attributes of the second set being associated with a second material; and obtaining a geometric model of at least one virtual object, the geometric model defining a three-dimensional macroscopic surface geometry of the virtual object. The invention is characterized by synthesizing a third set of appearance attributes from the first set of appearance attributes and the second set of appearance attributes and visualizing, using a display device, a scene comprising the at least one virtual object, using the third set of appearance attributes, a comparison set of appearance attributes and the geometric model, a first portion of the at least one virtual object being visualized using the third set of appearance attributes, and a second portion of the at least one virtual object being visualized using the comparison set of appearance attributes, to allow a direct a visual comparison of the first set of appearance attributes as modified by the second set of appearance attributes with the comparison set of appearance attributes.