G06T15/00

Methods and systems for graphics rendering assistance by a multi-access server

An illustrative multi-access server receives a request from a client system, the request indicating a requested rendering operation. The multi-access server also accesses input data from an asset data source. The multi-access server performs a rendering pass on the input data, the rendering pass performed in accordance with the requested rendering operation to generate a render pass output dataset. The render pass output dataset is representative of a renderable image depicting image content in a first form having limited quality or detail. The render pass output dataset is also configured for use in generating fully-rendered image data that depicts the image content in a second form having additional quality or detail beyond the limited quality or detail of the first form. Corresponding methods and systems are also disclosed.

Multi-thread graphics processing system

A graphics processing system comprises at least one memory device storing a plurality of pixel command threads and a plurality of vertex command threads. An arbiter coupled to the at least one memory device is provided that selects a pixel command thread from the plurality of pixel command threads and a vertex command thread from the plurality of vertex command threads. The arbiter further selects a command thread from the previously selected pixel command thread and the vertex command thread, which command thread is provided to a command processing engine capable of processing pixel command threads and vertex command threads.

Generative latent textured proxies for object category modeling

Systems and methods are described for generating a plurality of three-dimensional (3D) proxy geometries of an object, generating, based on the plurality of 3D proxy geometries, a plurality of neural textures of the object, the neural textures defining a plurality of different shapes and appearances representing the object, providing the plurality of neural textures to a neural renderer, receiving, from the neural renderer and based on the plurality of neural textures, a color image and an alpha mask representing an opacity of at least a portion of the object, and generating a composite image based on the pose, the color image, and the alpha mask.

Graphics processing units and methods for controlling rendering complexity using cost indications for sets of tiles of a rendering space

A graphics processing unit (GPU) processes graphics data using a rendering space which is sub-divided into a plurality of tiles. The GPU comprises cost indication logic configured to obtain a cost indication for each of a plurality of sets of one or more tiles of the rendering space. The cost indication for a set of tile(s) is suggestive of a cost of processing the set of one or more tiles. The GPU controls a rendering complexity with which primitives are rendered in tiles based on the cost indication for those tiles. This allows tiles to be rendered in a manner that is suitable based on the complexity of the graphics data within the tiles. In turn, this allows the rendering to satisfy constraints such as timing constraints even when the complexity of different tiles may vary significantly within an image.

Depth based foveated rendering for display systems

Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include determining a fixation point of a user's eyes. Location information associated with a first virtual object to be presented to the user via a display device is obtained. A resolution-modifying parameter of the first virtual object is obtained. A particular resolution at which to render the first virtual object is identified based on the location information and the resolution-modifying parameter of the first virtual object. The particular resolution is based on a resolution distribution specifying resolutions for corresponding distances from the fixation point. The first virtual object rendered at the identified resolution is presented to the user via the display system.

Method for scattering points in a uniform arbitrary distribution across a target mesh for a computer animated creature
11710270 · 2023-07-25 · ·

A programmatic arbitrary distribution of items in a modeling system may be provided. To perform the distribution, a surface may be received, and a point count of application points associated with locations on the surface may be determined. A density map may be applied over the surface to assign a density to portions of the surface for the point count. Application points are then assigned to locations on the surface according to the density map and a scattering function of the point count, where the scattering function is based on one or more repulsion forces between neighboring points. The one or more repulsion forces are treated as pushing each of the neighboring point apart. Thereafter, the surface may be provided having the application points scattered across the surface based on the one or more repulsion forces.

Topology Preservation in a Graphics Pipeline by Analyzing a Geometry Shader
20230005208 · 2023-01-05 ·

A graphics processing engine has a geometry shading stage having two modes of operation. In the first mode of operation, each primitive output by the geometry shading stage is independent, whereas in the second mode of operation, connectivity between input primitives is maintained by the geometry shading stage. The mode of operation of the geometry shading stage can be determined based on the value of control state data which may be generated at compile-time for a geometry shader based on analysis of that geometry shader.

SATELLITE SAR ARTIFACT SUPPRESSION FOR ENHANCED THREE-DIMENSIONAL FEATURE EXTRACTION, CHANGE DETECTION, AND VISUALIZATIONS

Systems and methods for satellite Synthetic Aperture Radar (SAR) artifact suppression for enhanced three-dimensional feature extraction, change detection, and/or visualizations are described. In some aspects, the described systems and methods include a method for suppressing artifacts from complex SAR data associated with a scene. In some aspects, the described systems and methods include a method for creating a photo-realistic 3D model of a scene based on complex SAR data associated with a scene. In some aspects, the described systems and methods include a method for identifying three-dimensional (3D) features and changes in SAR imagery.

METHODS FOR OPTICAL TRACKING AND SURFACE ACQUISITION IN SURGICAL ENVIRONMENTS AND DEVICES THEREOF

A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

METHODS FOR OPTICAL TRACKING AND SURFACE ACQUISITION IN SURGICAL ENVIRONMENTS AND DEVICES THEREOF

A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.