A computing system may include a client device and a server. The client device may be configured to access a stream of image frames that depict an environment, determine, from the stream of image frames, environment images that satisfy selection criteria, and transmit the environment images to the server. The server may be configured to receive the environment images from the client device, construct a spatial view of the environment based on position data included with the environment images, and navigate the spatial view, including by receiving a movement direction and progressing from a current environment image depicted for the spatial view to a next environment image based on the movement direction.

The A method of augmenting a view of a real-world environment with a view of a volumetric video object on a user device is disclosed . The method includes determining a current pose information (CPI) indicating a current pose of the view of the real-world environment and a desired pose of the volumetric video object in the real-world environment. The method further includes sending the CPI to a remote server. The method further includes receiving a rendered view of the volumetric video object that has been rendered in accordance with the CPI from the remote server. The method also includes augmenting the view of the real-world environment by at least mapping the rendered view of the volumetric video object onto a planar mapping surface arranged according to the desired position of the volumetric video object.

A three-dimensional data encoding method includes: extracting, from first three-dimensional data, second three-dimensional data having an amount of a feature greater than or equal to a threshold; and encoding the second three-dimensional data to generate first encoded three-dimensional data. For example, the three-dimensional data encoding method may further include encoding the first three-dimensional data to generate the second encoded three-dimensional data.

A three-dimensional data creation method includes: creating first three-dimensional data from information detected by a sensor; receiving encoded three-dimensional data that is obtained by encoding second three-dimensional data; decoding the received encoded three-dimensional data to obtain the second three-dimensional data; and merging the first three-dimensional data with the second three-dimensional data to create third three-dimensional data.

An apparatus and method to execute ray tracing instructions. For example, one embodiment of an apparatus comprises execution circuitry to execute a dequantize instruction to convert a plurality of quantized data values to a plurality of dequantized data values, the dequantize instruction including a first source operand to identify a plurality of packed quantized data values in a source register and a destination operand to identify a destination register in which to store a plurality of packed dequantized data values, wherein the execution circuitry is to convert each packed quantized data value in the source register to a floating point value, to multiply the floating point value by a first value to generate a first product and to add the first product to a second value to generate a dequantized data value, and to store the dequantized data value in a packed data element location in the destination register.

A distribution device for delivering a selected viewport stream of virtual reality (VR) data to each of a plurality of client devices, comprising a processor configured for receiving a plurality of extended viewport streams of a VR video file each comprising a sequence of extended field of view (EFOV) frames created for a respective one of a plurality of overlapping segments constituting a sphere defined in the VR video file and delivering a selected one of the plurality of extended viewport streams to each of a plurality of client devices by performing the following for each of the client devices in each of a plurality of iterations: (1) receiving a current orientation data of the respective client device; (2) selecting one of the plurality of extended viewport streams according to the current orientation data; and (3) transmitting the selected extended viewport stream to the respective client device.

A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

Systems, methods, and non-transitory computer-readable media are disclosed for variably rendering graphical representations of co-users in VR environments based on social graph information between the co-users and a VR user. For example, the disclosed systems can identify a co-user within a VR environment. Furthermore, the disclosed systems can determine a social relevancy (e.g., a social relationship type) between the co-user and a VR user within the VR environment based on social graph information. Then, the disclosed systems can select and/or determine a graphical representation and/or other capabilities of the co-user within the VR environment based on the social relevancy. Additionally, the disclosed systems can display the co-user within the VR environment using the determined graphical representation type (e.g., from the perspective of the VR user).

An apparatus for delivering virtual reality data portions to a client device, including a processing unit configured to perform the following in each one of a plurality of iterations: (1) receive from a network a current orientation data indicating a current orientation of a client device, (2) apply a rotation to a segment of a sphere defined in a virtual reality (VR) video file according to the current orientation, (3) crop from the rotated segment of the sphere in an equirectangular projection format an extended field of view (EFOV) frame in the equirectangular projection format according to the current orientation, and (4) instruct the network to transmit the EFOV frame to the client device.

A system that employs a third-party accessible application programming interface (API) to generate symbology for a three-dimensional view is disclosed. In embodiments, the third-party accessible API is running on or configured to communicate with at least one controller for an aircraft display system. The third-party accessible API is configured to receive a set of parameters for generating three-dimensional symbology. The controller is configured to receive the three-dimensional symbology from the third-party accessible API. The controller is further configured to generate a three-dimensional view that includes proprietary symbology and the three-dimensional symbology from the third-party accessible API at a display of the aircraft display system.