H04N21/42653

Methods and Apparatus for Mesh Networking Using Wireless Devices
20220179612 · 2022-06-09 · ·

A wireless peripheral mode is provided by a host system that communicates to a WiFi infrastructure and, utilizing the same WiFi RF subsystem, also communicates to peripherals. The host system may employ additional RF channels for communicating with high bandwidth peripherals, such as display devices, where high levels of QoS may be managed locally. The host system may be a conventional desktop computer system, a notebook computer system, a multi-media access point, a cell phone, a game machine, a portable game machine, a Personal Digital Assistant (PDA), a smart phone or any other type of device that benefits from accessing both a WiFi infrastructure and local peripherals.

Augmented Reality Effect Resource Sharing

An augmented reality (AR) effect system can improve application of AR effects by sharing resources between AR effects. The AR effect system can employ manifests for AR effects that define which resources are required to render each AR effect. The AR effect system can organize rendering operations used by selected AR effects into a pipeline and can use the manifests of the AR effects to determine when each resource will be needed. Based on this pipeline, the AR effect system can create a cache order defining a resource schedule which specifies, when a resource is freed, conditions for whether to save the resource to a local cache or unload the resource. As rendering of the video with the AR effects progresses, the resource schedule can control whether resources not currently being used to render an AR effect should be unloaded or cached for fast access for future render operations.

Regrouping of video data in host memory
20220095007 · 2022-03-24 ·

Apparatus for data communications includes a host interface, which is configured to be connected to a bus of a host computer having a processor and a memory. Processing circuitry, which is coupled to the host interface, is configured to receive video data with respect to a sequence of pixels, the video data including data words of more than eight bits per pixel for at least one pixel component of the pixels, and to write the video data, via the host interface, to at least one buffer in the memory while justifying the video data in the memory so that the successive pixels in the sequence are byte-aligned in the at least one buffer.

Integrating overlaid digital content into displayed data via graphics processing circuitry
11277658 · 2022-03-15 · ·

An apparatus, method, and computer readable medium that include accessing a frame buffer of a graphics processing unit (GPU), analyzing, in the frame buffer of the GPU, a frame representing a section of a stream of displayed data that is being displayed by an apparatus, identifying a reference patch that includes a unique identifier associated with an available area in which secondary digital content is insertable in the displayed data that is being displayed by the apparatus, decoding the encoded data of the unique identifier, retrieving the secondary digital content from the remote device based on the unique identifier, and overlaying the secondary digital content into the displayed data in accordance with the available area, the screen position, and the size identified by the unique identifier.

Augmented reality effect resource sharing

An augmented reality (AR) effect system can improve application of AR effects by sharing resources between AR effects. The AR effect system can employ manifests for AR effects that define which resources are required to render each AR effect. The AR effect system can organize rendering operations used by selected AR effects into a pipeline and can use the manifests of the AR effects to determine when each resource will be needed. Based on this pipeline, the AR effect system can create a cache order defining a resource schedule which specifies, when a resource is freed, conditions for whether to save the resource to a local cache or unload the resource. As rendering of the video with the AR effects progresses, the resource schedule can control whether resources not currently being used to render an AR effect should be unloaded or cached for fast access for future render operations.

Hybrid streaming

A method and system are provided for hybrid streaming of media content such as video for a computer-based game. In some implementations, a background media content stream includes a background video rendered on a server. The background media content stream is received at a client device. The client device renders one or more three-dimensional objects and forms a composite media stream by combining the background media content stream and the one or more three-dimensional objects. The composite media stream can be output to a display or other external system.

Changing resource utilization associated with a media object based on an engagement score

In accordance with some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a representation of a first portion of a media object, wherein the first portion of the media object is associated with a first resource utilization value. The first resource utilization value characterizes a utilization of a respective resource by the electronic device. The method includes determining an engagement score that characterizes a level of user engagement with respect to the representation of the first portion of the media object. The method includes changing the utilization of the respective resource from the first resource utilization value to a second resource utilization value based on a function of the engagement score. The second resource utilization value is associated with a second portion of the media object.

Cloud platform capable of providing real-time streaming services for heterogeneous applications including AR, VR, XR, and MR irrespective of specifications of hardware of user
11272261 · 2022-03-08 · ·

Proposed is a cloud platform for realizing all 5G services including high-quality heterogeneous applications including augmented reality (AR), virtual reality (VR), extended reality (XR), and mixed reality (MR) or mobile content based on the cloud and providing real-time streaming of these services irrespective of specifications of hardware of users.

ARTIFICIAL REALITY SYSTEM USING SUPERFRAMES TO COMMUNICATE SURFACE DATA

This disclosure describes efficient communication of surface texture data between system on a chip (SOC) integrated circuits. An example system includes a first integrated circuit and a second integrated circuit communicatively coupled to the first integrated circuit by a video communication interface. The first integrated generates a superframe in a video frame of the video communication interface for transmission to the second integrated circuit. The superframe includes multiple subframe payloads that carry surface texture data to be updated in the frame and corresponding subframe headers that include parameters of the subframe payloads. The second integrated circuit includes a direct access memory (DMA) controller. The DMA upon receipt of the superframe, writes the surface texture data within each of the subframe payloads directly to an allocated location in memory based on the parameters included in the corresponding one of the subframe headers.

VIDEO CONTENT MEDIUM AND VIDEO REPRODUCTION APPARATUS

In a format in which a graphic is transmitted to a display apparatus after being combined with a content video, luminance of the graphic is fluctuated by dynamic metadata control. A video content medium relating to technology disclosed in the description of the present application is a video content medium on which one or more video streams, control information, and graphic information including a menu or a subtitle are recorded, wherein at least one of the video streams is a video having a wide luminance range, and graphic transition time information indicating a transition time to switch between luminance range adjustment functions when a graphic is combined is stored together.