G06T2210/08

Rendering operations using sparse volumetric data

A ray is cast into a volume described by a volumetric data structure, which describes the volume at a plurality of levels of detail. A first entry in the volumetric data structure includes a first set of bits representing voxels at a lowest one of the plurality of levels of detail, and values of the first set of bits indicate whether a corresponding one of the voxels is at least partially occupied by respective geometry. A set of second entries in the volumetric data structure describe voxels at a second level of detail, which represent subvolumes of the voxels at the first lowest level of detail. The ray is determined to pass through a particular subset of the voxels at the first level of detail and at least a particular one of the particular subset of voxels is determined to be occupied by geometry.

Systems and methods for prioritized rendering and streaming based on risk maps that predict change in a three-dimensional environment
11676328 · 2023-06-13 · ·

A system prioritizes the rendering and streaming of image data based on risk maps that predict change in a three-dimensional (“3D”) environment. The system receives primitives that are distributed across a 3D space to represent the 3D environment. The system generates a first image based on primitives that fall within a first view frustum, and generates a risk map with a risk value for each particular pixel of the first image. Each risk value quantifies a probability that a pixel of the first image associated with that risk value changes as a result of changing the first view frustum to a second view frustum. The system then performs an out-of-order rendering of primitives that fall within the second view frustum based on the risk value for each first image pixel that is replaced in a second image with a rendered primitive from the second view frustum.

Optimization of resource usage in cross-reality sessions

Concepts and technologies are disclosed herein for optimization of resource usage in cross-reality sessions. A computer can receive a request for a cross-reality session, determine entities to be included in the cross-reality session, and optimize resource usage during the cross-reality session. Optimized cross-reality session data can be provided to a device to generate a cross-reality environment that can include the one entity of the entities rendered in the first level of detail. Attention data that can describe interactions in the cross-reality environment can be obtained. The resource usage can be re-optimized based on the attention data. Re-optimizing the resource usage can include determining that the one entity of the entities is to be rendered in a second level of detail that is greater than the first level of detail. An update can be delivered to the device, which can use the update to update the cross-reality environment.

Method for Adapting the Rendering of a Scene
20230177763 · 2023-06-08 · ·

A method for adapting the rendering of a virtual environment based on the performance of a computer system in which the method is run modifies graphic parameters of generated images. The method enables the highest possible graphic quality to be dynamically maintained in a virtual reality or augmented reality simulation, depending on availability of the computer system's hardware resources.

Real-time potentially visible set for streaming rendering

The invention relates to a method for transmitting 3D model data, the 3D model data comprising polygons, from a server to a client for rendering, the method comprising: obtaining the 3D model data by the server; and transmitting the 3D model data from the server to the client. According to the invention, the 3D model data is obtained by the server, based on a given multitude of possible views.

SYSTEM AND METHOD FOR RENDERING OBJECTS IN AN EXTENDED REALITY

A system and method for rendering objects in a virtual/augmented reality environment. The system includes a processor and a memory including a set of instructions. An execution of the set of instructions may cause the processor to render a user environment representative of a 3-Dimensional (3D) map and 3D space position data. The user environment may be rendered on a display device of a user by using a rendering engine of the system. The processor may configure a responsive extended reality (XR) zone within the rendered user environment through a zone engine. The XR zone may be adapted to provision contextually aware information pertaining to one or more virtual features, data, and objects that are dynamically calibrated based on real-time changes in parameters associated with the user environment.

Prediction System for Texture Streaming

A prediction system for determining a set of subregions can be used for rendering a virtual world of a computer graphics application. The subregions belong to streamable objects to be used for rendering the virtual world. The streamable objects each comprise a plurality of subregions. The prediction system comprises a plurality of predictor units arranged for receiving from a computer graphics application information on the virtual world and each arranged for obtaining a predicted set of subregions for rendering a virtual world using streamable objects. Each predicted set can be obtained by applying a different prediction scheme. A streaming manager is arranged for receiving the predicted sets of subregions, for deriving from the predicted sets a working set of subregions to be used for rendering and for outputting, based on the working set of subregions, steering instructions concerning the set of subregions to be actually used.

LIGHT FIELD DISPLAYS HAVING SYNERGISTIC DATA FORMATTING, RE-PROJECTION, FOVEATION, TILE BINNING AND IMAGE WARPING TECHNOLOGY

Systems, methods and apparatuses may provide for technology to reduce rendering overhead associated with light field displays. The technology may conduct data formatting, re-projection, foveation, tile binning and/or image warping operations with respect to a plurality of display planes in a light field display.

METHOD AND SYSTEM FOR DISPLAYING A LARGE 3D MODEL ON A REMOTE DEVICE
20220058823 · 2022-02-24 ·

A method of displaying a digital object on a device is disclosed. A set of unique identifiers and associated is downloaded for a set of digital objects within a 3D model. A position and an orientation of a virtual camera is determined relative to the positions of the set of digital objects. A visibility score for each digital object of the set of digital objects is computed based on a position of the digital object relative to the position and the orientation of the virtual camera. A polygon mesh associated with a digital object with a highest visibility score is downloaded based on the polygon mesh being absent. The downloading uses a unique identifier of the set of unique identifiers associated with the polygon mesh. The polygon mesh of the digital object with the highest score is rendered and displayed on a display device.

AUTOMATIC TRANSLATION OF USER INTERFACE ELEMENTS FROM WIREFRAME TOOLS TO PRODUCTION AUGMENTED REALITY FRAMEWORK
20220365660 · 2022-11-17 ·

Systems and methods for generating an extended reality (XR) user interface are disclosed. A two-dimensional data set is imported. The two-dimensional data set defines a two-dimensional user interface design layout. The two-dimensional data set includes a transition data set corresponding to a user interface element included in the design layout. The two-dimensional data set is converted into a three-dimensional data set. The three-dimensional data set defines a three-dimensional user interface design layout corresponding to the two-dimensional design layout. The converting includes identifying three-dimensional art for each of a plurality of phases corresponding to the transition data set. An XR representation of the three-dimensional data set is provided for editing using an editing application associated with one or more XR devices. Based on the editing, the three-dimensional data set is exported as one or more files that are compatible with an XR development environment.