The present specification discloses systems and methods of creating a point cloud around a portion of a virtual landscape of a video game. A mesh is generated based on the point cloud, and then the mesh is simplified to create a series of proxy meshes that are dynamically used to render level of detail (LOD) visual assets.

A method of tracking a target includes classifying a pixel having a pixel address with one or more pixel cases. The pixel is classified based on one or more observed or synthesized values. An example of an observed value for a pixel address includes an observed depth value obtained from a depth camera. Examples of synthesized values for a pixel address include a synthesized depth value calculated by rasterizing a model of the target; one or more body-part indices estimating a body part corresponding to that pixel address; and one or more player indices estimating a target corresponding to that pixel address. One or more force vectors are calculated for the pixel based on the pixel case, and the force vector is mapped to one or more force-receiving locations of the model representing the target to adjust the model representing the target into an adjusted pose.

A providing apparatus configured to provide three-dimensional geometric data to be used to generate a virtual viewpoint image receives a data request from a communication apparatus, decides which of a plurality of pieces of three-dimensional geometric data including first three-dimensional geometric data and second three-dimensional geometric data with a different quality than the first three-dimensional geometric data is to be provided to the communication apparatus from which the received data request was transmitted, and provides the three-dimensional geometric data decided on from among the plurality of pieces of three-dimensional geometric data, to the communication apparatus as a response to the received data request.

A providing apparatus configured to provide three-dimensional geometric data to be used to generate a virtual viewpoint image receives a data request from a communication apparatus, decides which of a plurality of pieces of three-dimensional geometric data including first three-dimensional geometric data and second three-dimensional geometric data with a different quality than the first three-dimensional geometric data is to be provided to the communication apparatus from which the received data request was transmitted, and provides the three-dimensional geometric data decided on from among the plurality of pieces of three-dimensional geometric data, to the communication apparatus as a response to the received data request.

A method is provided, including: tracking a location of a head-mounted display (HMD); tracking a gaze of a user of the HMD; generating video depicting a view of a virtual environment for the HMD based on the gaze of the user of the HMD; initiating wireless transmission of the video to the HMD for display on the HMD to the user, wherein initiating the wireless transmission includes setting a beamforming of a wireless transceiver towards the location of the head-mounted display; processing signal quality feedback received from the HMD to determine a quality of the wireless transmission; responsive to a loss in the quality of the wireless transmission, then adjusting the beamforming of the wireless transceiver.

A method is provided, including the following operations: executing a video game by a cloud game machine, the execution of the video game includes rendering gameplay video; processing the gameplay video by a streaming server for streaming over a network to a client device; monitoring connection quality over the network between the streaming server and the client device; responsive to detecting a change in the connection quality between the streaming server and the client device, then adjusting the rendering of the gameplay video by the cloud game machine.

In a process for selecting a LOD visual asset from a set of pre-generated LOD visual assets for rendering during gameplay, data representative of the set of pre-generated LOD visual assets and associated switch distances is accessed. One or more variables related to the client devices and/or the gameplay being rendered on the client devices is monitored. Thereafter, either a first action of applying at least one corrective factor to the associated switch distance in order to generate modulated switch distances and then selecting a LOD from the set of pre-generated generated LOD visual assets based on one of the modulated switch distances or a second action of selecting a LOD visual asset from the set of pre-generated LOD visual assets based on the associated switch distances corresponding to the selected LOD visual asset is performed.

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering an avatar. A first avatar having a first level of detail is stored in a database, the first avatar including a first plurality of components. A level of detail of each of the first plurality of components is reduced separately from each other. A second plurality of components comprising the reduced level of detail of each of the first plurality of components is stored. A request is received for the first avatar in a second level of detail that comprises a lower level of detail than the first level of detail. In response to receiving the request, the second plurality of components is assembled to generate a second avatar having the second level of detail.

A method for adjusting complexity of content rendered by a graphical processing unit (GPU) is described. The method includes processing, by the GPU, an image frame for a scene of a game. The method further includes tracking one or more metrics regarding the processing of the image frame during the processing of the image frame. During the processing of the image frame, the method includes sending a quality adjuster signal (QAS) to a shader associated with a game engine. The QAS is generated based on the one or more metrics associated with the processing by the GPU. During the processing of the image frame, the method includes adjusting, by the shader, one or more shader parameters upon receipt of the QAS, wherein said adjusting the one or more shader parameters changes a level of complexity of the image frame being processed by the GPU.

A method is provided, including: tracking a location of a head-mounted display (HMD); tracking a gaze of a user of the HMD; generating video depicting a view of a virtual environment for the HMD based on the gaze of the user of the HMD; initiating wireless transmission of the video to the HMD for display on the HMD to the user, wherein initiating the wireless transmission includes setting a beamforming of a wireless transceiver towards the location of the head-mounted display; processing signal quality feedback received from the HMD to determine a quality of the wireless transmission; responsive to a loss in the quality of the wireless transmission, then adjusting the beamforming of the wireless transceiver.