G06T2200/16

Orchestrated Control for Displaying Media
20220350565 · 2022-11-03 ·

A computing device receives a modified first image frame from a client device, wherein the client device stores the first image frame. The computing device generates a second image frame that corresponds to the modified first image frame with a watermark. The computing device transmits, to a third-party application executing at the computing device, the second image frame and generates an instruction for modifying the first image frame, the instruction based on an altered version of the second image frame that is identified by the watermark, the second image frame altered by the third-party application. The computing device transmits, to the client device, the instruction for modifying the first image frame.

DIGITAL MODEL OPTIMIZATION RESPONSIVE TO ORIENTATION SENSOR DATA

A system server includes a database of two-dimensional images and a processor coupled to a hardware memory with instructions that in response to execution by the processor direct performance of operations. The operations include generating a digital model from the images in the database and communicating a first portion of the digital model as an enhanced view to a user device. The first portion corresponds to a first line of sight orientation of the user device as measured by an orientation sensor. The operations include receiving a signal based on sensor data measured by the orientation sensor. The signal indicates movement of the user device from the first line of sight orientation to a second line of sight orientation. In response, the method includes communicating a second portion of the digital model to the user device that corresponds to the second line of sight orientation of the user device.

SYSTEM AND METHOD TO REDUCE BANDWIDTH REQUIREMENT FOR VISIBILITY EVENT PACKET STREAMING USING A PREDICTED MAXIMAL VIEW FRUSTUM AND PREDICTED MAXIMAL VIEWPOINT EXTENT, EACH COMPUTED AT RUNTIME
20170295222 · 2017-10-12 · ·

There is provided a method of predictive prefetching and transmitting from a server to a client device at least one partial visibility event packet and/or deferred visibility event packet including renderable graphics information occluded from a first viewcell and not occluded from a second viewcell, including otherwise renderable graphics information in a client view frustum not previously transmitted to the client device; determining an estimated maximal client view frustum; calculating a subset comprising renderable graphics information that is included in the estimated maximal client view frustum; determining whether the calculated subset has previously been transmitted to the client device by comparing the calculated subset to the stored renderable graphics information previously transmitted, and transmitting the at least one partial visibility event packet and/or deferred visibility event packet to the client device if said packet has not been previously transmitted to the client device.

LOW LATENCY SIMULATION APPARATUS AND METHOD USING DIRECTION PREDICTION, AND COMPUTER PROGRAM THEREFOR
20170294022 · 2017-10-12 ·

A simulation apparatus may comprise: a sensor unit configured to acquire movement information of an object using one or more sensors; a direction calculation unit configured to calculate direction information of the object using the movement information; and a simulation unit configured to simulate a physical object and render an image of the physical object on the basis of the direction information received from the direction calculation unit. The direction calculation unit may include a time delay correction unit configured to correct the direction information using a time difference between the time of acquiring the movement information and the time of rendering the image.

Predictive, multi-layer caching architectures

Predictive, multi-layer caching architectures may be used to predict which elements a user is most likely to navigate to within a collection of elements associated with a predefined layout and, in response, to increase the accessibility of these elements to a client device of the user. For instance, the techniques may utilize a predictive, multi-layer caching architecture for storing these predicted elements to decrease the latency to render these images if the user navigates within the collection of elements in the predicted manner. The collection of elements may comprise images (e.g., a 3D model, a map, etc.), video files, audio files, text files, or any other type of file that is consumable on a client device.

Accelerated frame rate advertising-prioritized video frame alignment

In response to detection of a selection of an accelerated frame rate operation associated with a video advertisement, a quantity of individual prioritized video frames of the video advertisement to render based upon a selected accelerated frame rate is determined. Accelerated frame rate rendering priority values assigned to the individual prioritized video frames of the video advertisement are identified. Based upon differences among the identified accelerated frame rate rendering priority values assigned to the individual prioritized video frames, a prioritized video frame subset of the individual prioritized video frames is determined. The prioritized video frame subset of the individual prioritized video frames is equal in number to the determined quantity of individual prioritized video frames of the video advertisement and is determined to yield a maximized cumulative set of the identified accelerated frame rate rendering priority values.

Predictive bi-adaptive streaming of real-time interactive computer graphics content
09786027 · 2017-10-10 · ·

A method including playing a first interactive 3D simulation for a first 3D location of a computer graphics (CG) content clip for at least a first predetermined length of time. The method also includes, while playing the first interactive 3D simulation and within the first predetermined length of time, determining a first subset of the plurality of 3D assets to be downloaded for rendering two or more second 3D locations of the plurality of 3D locations; adapting the level of detail for one or more first 3D assets of the first subset of the plurality of 3D assets based at least in part on (a) a bandwidth for downloading the first subset of the plurality of 3D assets through the network, and (b) a processing power of the player device; and downloading the first subset of the plurality of 3D assets at the level of detail as adapted for the bandwidth and the processing power. The method additionally includes, after the first predetermined length of time, receiving a selection for a selected 3D location of the two or more second 3D locations. The method further includes playing a second interactive 3D simulation for the selected 3D location using at least a second subset of the first subset of the plurality of 3D assets, the second interactive 3D simulation being played devoid of delays for downloading and rendering the second interactive 3D simulation. Other embodiments are provided.

INTERACTIVE GRAPHIC RENDERING METHOD AND APPARATUS, AND COMPUTER STORAGE MEDIUM

An apparatus may obtain, by a processor, target object data formatted based on a first format. The target object data may include a plurality of element resources for a three dimensional model. The first format comprising a file format for transmission of three-dimensional model data. The apparatus may obtain, by the processor, configuration information associated with the target object data. The apparatus may generate, by the processor, a data packet of a second format based on the target object data and the configuration information. The apparatus may provide, by the processor, the data packet to a terminal device.

Prediction-Based Methods and Systems for Efficient Distribution of Virtual Reality Media Content

An exemplary device renders, within a field of view of an immersive virtual reality world (“world”) presented on a display screen, content of the world based on a stream of a first content file comprising a first content sector of the world. The device predicts that a user will provide user input representative of a request to shift additional content included in a second content sector of the world but not the first content sector into the field of view. Based on the prediction, the device requests and begins receiving a stream of a second content file comprising the second content sector. The device then detects the predicted user input from the user and, in response, switches from rendering the content included in the first content sector based on the first content file to rendering the additional content included in the second content sector based on the second content file.

DIGITAL MODEL OPTIMIZATION RESPONSIVE TO ORIENTATION SENSOR DATA

A system server includes a database of two-dimensional images and a processor coupled to a hardware memory with instructions that in response to execution by the processor direct performance of operations. The operations include generating a digital model from the images in the database and communicating a first portion of the digital model as an enhanced view to a user device. The first portion corresponds to a first line of sight orientation of the user device as measured by an orientation sensor. The operations include receiving a signal based on sensor data measured by the orientation sensor. The signal indicates movement of the user device from the first line of sight orientation to a second line of sight orientation. In response, the method includes communicating a second portion of the digital model to the user device that corresponds to the second line of sight orientation of the user device.