Patent classifications
G06T15/503
Image generation apparatus, image generation method, and program
Provided is an image generation technology capable of suppressing unpleasantness associated with fluctuation in image quality caused by the viewer's viewpoint movement. A synthesis ratio determination unit of an image generation apparatus includes: an image quality evaluation index calculation unit that generates a synthesis image J.sub.1 from an observation viewpoint image I.sub.1 and an intermediate viewpoint image I.sub.2, and a synthesis image J.sub.3 from an observation viewpoint image I.sub.3 and an intermediate viewpoint image I.sub.2, for a plurality of synthesis ratios, calculates an image quality evaluation index in an observation viewpoint V.sub.1, an image quality evaluation index in an intermediate viewpoint V.sub.2, and an image quality evaluation index in an observation viewpoint V.sub.3 by using the synthesis images J.sub.1 and J.sub.3, and calculates a variation v of an image quality evaluation index by using the image quality evaluation index in the observation viewpoint V.sub.1, the image quality evaluation index in the intermediate viewpoint V.sub.2, and the image quality evaluation index in the observation viewpoint V.sub.3; and an image quality evaluation index comparison unit that determines a synthesis ratio A based on the variation v of the image quality evaluation index.
Interpolation optimizations for a display engine for post-rendering processing
In one embodiment, a method includes, by a computing system, accessing a first and second texture associated with an output position, determining a color-blending operation, determining a first color and a first transparency level based on the first texture, determining a second color and a second transparency level based on the second texture, and identifying a color-blending optimization based on the color-blending operation and a comparison of the colors and transparency levels. The method includes determining an output color and an output transparency level by performing the color-blending operation using the colors and transparency levels. The output color is determined by copying the first or second color or the output transparency level is determined by copying the first or second transparency level without additional calculation. The method includes providing the output color and the output transparency level for display at the output position.
METHOD AND APPARATUS FOR COMPUTER MODEL RASTERIZATION
There is described a method of rasterizing a computer model. One or more non-linear expressions of code are identified in a fragment shader. The one or more non-linear expressions of code are transformed into one or more linear expressions of code. The one or more linear expressions of code are transferred from the fragment shader to a vertex shader. The computer model is then rasterized by executing, on the computer model, code comprised in the vertex shader, including the transferred one or more linear expressions of code.
IMAGE FRAME DISPLAY METHOD, APPARATUS, DEVICE, STORAGE MEDIUM, AND PROGRAM PRODUCT
Embodiments of this application disclose an image frame display method performed by a computer device. The method includes: receiving a first rendering instruction transmitted by a server, and rendering at least one first image element based on the first rendering instruction; receiving at least one second image element transmitted by the server, the at least one second image element being rendered by the server; receiving an interactive instruction transmitted by the server; and displaying an image frame based on the at least one first image element, the at least one second image element, and the interactive instruction.
Apparatus and method for optimized tile-based rendering
A virtual reality apparatus and method are described for tile-based rendering. For example, one embodiment of an apparatus comprises: a set of on-chip geometry buffers including a first buffer to store geometry data, and a set of pointer buffers to store pointers to the geometry data; a tile-based immediate mode rendering (TBIMR) module to perform tile-based immediate mode rendering using geometry data and pointers stored within the set of on-chip geometry buffers; spill circuitry to determine when the on-chip geometry buffers are over-subscribed and responsively spill additional geometry data and/or pointers to an off-chip memory; and a prefetcher to start prefetching the geometry data from the off-chip memory as space becomes available within the on-chip geometry buffers, the TBIMR module to perform tile-based immediate mode rendering using the geometry data prefetched from the off-chip memory.
Systems and methods for animation generation
Systems and methods for animating from audio in accordance with embodiments of the invention are illustrated. One embodiment includes a method for generating animation from audio. The method includes steps for receiving input audio data, generating an embedding for the input audio data, and generating several predictions for several tasks from the generated embedding. The several predictions includes at least one of blendshape weights, event detection, and/or voice activity detection. The method includes steps for generating a final prediction from the several predictions, where the final prediction includes a set of blendshape weights, and generating an output based on the generated final prediction.
Surround view generation
Methods and systems for rendering an output image from a plurality of input images. The plurality of input images is received, and each input image is taken from a different first location. A view specification for rendering the output image is received, and the view specification includes at least a second location. The second location is different from each of the first locations. An output image is rendered based at least in part on the plurality of input images and the view specification, and the output image includes an image of a region as seen from the second location. The output image is displayed on a display.
DYNAMIC DEPENDENCY SCOREBOARD FOR OVERLAPPING PIXELS OF PRIMITIVES
Methods, systems and apparatuses may provide for technology that identifies that a first thread group of a pixel location is associated with a first shading rate, identifies that a second thread group of the pixel location is associated with a second shading rate, wherein the first shading rate is different from the second shading rate. The technology marks a dependency of the first thread group on the second thread group.
COMPRESSION AND INTERLEAVING OF SPATIALLY PROXIMATE DATA
Methods, systems and apparatuses may provide for technology that identifies first graphics data that is associated with spatially proximate positions. The technology identifies second graphics data that is associated with spatially proximate positions, and interleaves the first and the second graphics data across a plurality of storage tiles.
Systems and methods for three-dimensional visualization of deviation of volumetric structures with colored surface structures
Embodiments of the present disclosure are directed to methods and computer systems for converting datasets into three-dimensional (“3D”) mesh surface visualization, displaying the mesh surface on a computer display, comparing two three-dimensional mesh surface structures by blending two primary different primary colors to create a secondary color, and computing the distance between two three-dimensional mesh surface structures converted from two closely-matched datasets. For qualitative analysis, the system includes a three-dimensional structure comparison control engine that is configured to convert dataset with three-dimensional structure into three-dimensional surfaces with mesh surface visualization. The control engine is also configured to assign color and translucency value to the three-dimensional surface for the user to do qualitative comparison analysis. For quantitative analysis, the control engine is configured to compute the distance field between two closely-matched datasets.