The present invention relates to a prediction system for determining a set of subregions to be used for rendering a virtual world of a computer graphics application, said subregions belonging to streamable objects to be used for rendering said virtual world, said streamable objects each comprising a plurality of subregions. The prediction system comprises a plurality of predictor units arranged for receiving from a computer graphics application information on the virtual world and each arranged for obtaining a predicted set of subregions for rendering a virtual world using streamable objects, each predicted set being obtained by applying a different prediction scheme, a streaming manager arranged for receiving the predicted sets of subregions, for deriving from the predicted sets a working set of subregions to be used for rendering and for outputting, based on the working set of subregions, steering instructions concerning the set of subregions to be actually used.

A view of geometry captured in image data generated by an imaging sensor is compared with a description of the geometry in a volumetric data structure. The volumetric data structure describes the volume at a plurality of levels of detail and includes entries describing voxels defining subvolumes of the volume at multiple levels of detail. The volumetric data structure includes a first entry to describe voxels at a lowest one of the levels of detail and further includes a number of second entries to describe voxels at a higher, second level of detail, the voxels at the second level of detail representing subvolumes of the voxels at the first level of detail. Each of these entries include bits to indicate whether a corresponding one of the voxels is at least partially occupied with the geometry. One or more of these entries are used in the comparison with the image data.

Various embodiments of predicting human actions are disclosed. In one aspect, a human action prediction system first receives a sequence of video images including at least a first person. Next, for each image in the sequence of video image, the human action prediction system detects the first person in the video image; and subsequently extracts a skeleton figure of the detected first person from the detected image of the first person, wherein the skeleton figure is composed of a set of human keypoints of the detected first person. Next, human action prediction system combines a sequence of extracted skeleton figures of the detected first person from the sequence of video images to form a first skeleton sequence of the detected first person which depicts a continuous motion of the detected first person. The human action prediction system subsequently transmits the first skeleton sequence of the detected first person to a server, wherein transmitting the first skeleton sequence of the detected first person in place of the detected images of the first person to the server preserves the privacy of the detected first person

A method (20, 40) for reducing undesirable visual effects, such as judder, in a video image having one or more frames is disclosed. A server node (16) generates graphics layers from 3D objects, and augments the layers with the Z-layer information and motion information for the objects. The server node then groups (28, 30, 32) the graphics layers, encodes (34) the groups into a video stream such that every video frame of the stream is a composite video frame of the graphics layers, adds (36) the motion information to the composite video frame, and sends (38) the stream to a client device (18). Upon receipt, the client device extracts (44) the motion information, compensates the positions of the graphics layers using the Z-layer information and the motion information, and applies a selected positional time-warp algorithm to compensate for the translational and rotational movement of the user’s head (50). The resultant layers are then combined into a video image and rendered (52) for the user.

Systems and methods of the present disclosure relate to fine grained interleaved rendering applications in path tracing for cloud computing environments. For example, a renderer and a rendering process may be employed for ray or path tracing and image-space filtering that interleaves the pixels of a frame into partial image fields and corresponding reduced-resolution images that are individually processed in parallel. Parallelization techniques described herein may allow for high quality rendered frames in less time, thereby reducing latency (or lag, in gaming applications) in high performance applications.

In one embodiment, a method includes the steps of generating, for a virtual object defined by a geometric representation, multiple viewpoints surrounding the virtual object, generating, for each of the multiple viewpoints, a simplified geometric representation of the virtual object based on the viewpoint, wherein the simplified geometric representation has a lower resolution than the geometric representation of the virtual object, receiving, from a client device, a desired viewpoint from which to view the virtual object, selecting one or more viewpoints from the multiple viewpoints based on the desired viewpoint, and sending, to the client device, rendering data including the simplified geometric representation and an associated view-dependent texture that are associated with each of the selected one or more viewpoints, the rendering data being configured for rendering an image of the virtual object from the desired viewpoint.

A system for processing a plurality of graphical programs on a centralized computer system whereby the images produced by the programs are compressed and transmitted to a plurality of remote processing devices where they are decompressed. Compression assistance data (CAD) is produced by intercepting instructions outputted by the programs and the CAD is then used in the compression step.

A medical imaging communication system processes medical images for being transmitted to a client device. The system receives a set of images, each image corresponding to a slice of a three-dimensional object. The system combines a first subset of the images into a first combined image and combines a second subset of the images into a second combined image. The first and second combined image are compressed using a lossless compression algorithm and transmitted to the client device.

A method for adjusting complexity of content rendered by a graphical processing unit (GPU) is described. The method includes processing, by the GPU, an image frame for a scene of a game. The method further includes tracking one or more metrics regarding the processing of the image frame during the processing of the image frame. During the processing of the image frame, the method includes sending a quality adjuster signal (QAS) to a shader associated with a game engine. The QAS is generated based on the one or more metrics associated with the processing by the GPU. During the processing of the image frame, the method includes adjusting, by the shader, one or more shader parameters upon receipt of the QAS, wherein said adjusting the one or more shader parameters changes a level of complexity of the image frame being processed by the GPU.

The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine an eye-buffer including one or more bounding boxes associated with rendered content in a frame. The apparatus can also generate an atlas based on the eye-buffer, the atlas including one or more patches associated with the one or more bounding boxes. Additionally, the apparatus can communicate the atlas including the one or more patches. The apparatus can also calculate an amount of user motion associated with the rendered content in the frame. Further, the apparatus can determine a size of each of the one or more bounding boxes based on the calculated amount of user motion. The apparatus can also determine a size and location of each of the one or more patches in the atlas.