Systems, apparatuses, and methods for utilizing different modulation coding schemes (MCSs) for different components of a video stream are disclosed. A system includes a transmitter sending a video stream over a wireless link to a receiver. The transmitter splits the video stream into low, medium, and high quality components, and then the transmitter modulates the different components using different MCS's. For example, the transmitter modulates the low quality component using a lower, robust MCS level to increase the likelihood that this component is received. Also, the medium quality component is modulated using a medium MCS level and the high frequency component is modulated using a higher MCS level. If only the low quality component is received by the receiver, then the receiver reconstructs and displays a low quality video frame from this component, which avoids a glitch in the display of the video stream.

A method for developing an enhancement model for low-quality visual data, the method comprising the steps of receiving one or more sections of higher-quality visual data; and training a hierarchical algorithm. The hierarchical algorithm is operable to increase the quality of one or more sections of lower-quality visual data so as to substantially reproduce the one or more sections of higher-quality visual data. The hierarchical algorithm is then outputted.

A method for developing an enhancement model for low-quality visual data, the method comprising the steps of receiving one or more sections of higher-quality visual data; and training a hierarchical algorithm. The hierarchical algorithm is operable to increase the quality of one or more sections of lower-quality visual data so as to substantially reproduce the one or more sections of higher-quality visual data. The hierarchical algorithm is then outputted.

Described herein are video streaming techniques for applications and workloads executed in the cloud. In one example, the cloud server device encodes display frames using low-delay encoding techniques for transmission to a client device. The cloud server device receives an overlay bitstream from a client device, combines the overlay data with the display frames, and encodes the frames for the viewers using statistics from the display frames encoded for the client device and/or from the overlay data. The cloud server device can then transmit the bitstream to a third device for viewing (e.g., to a viewer device or a streaming server device).

Described herein are video streaming techniques for applications and workloads executed in the cloud. In one example, the cloud server device encodes display frames using low-delay encoding techniques for transmission to a client device. The cloud server device receives an overlay bitstream from a client device, combines the overlay data with the display frames, and encodes the frames for the viewers using statistics from the display frames encoded for the client device and/or from the overlay data. The cloud server device can then transmit the bitstream to a third device for viewing (e.g., to a viewer device or a streaming server device).

Provided is a scalable video-decoding method based on multiple layers. The scalable video-decoding method according to the present invention comprises: a step of predicting first filter information of a video to be filtered using the information contained in an object layer and/or information contained in another layer, and generating second filter information in accordance with the prediction; and a step of filtering the video to be filtered using the second filter information. According to the present invention, the amount of information being transmitted is reduced, and video compression performance is improved.

Provided is a scalable video-decoding method based on multiple layers. The scalable video-decoding method according to the present invention comprises: a step of predicting first filter information of a video to be filtered using the information contained in an object layer and/or information contained in another layer, and generating second filter information in accordance with the prediction; and a step of filtering the video to be filtered using the second filter information. According to the present invention, the amount of information being transmitted is reduced, and video compression performance is improved.

The present embodiments obtain chroma components representative of the chroma components of an output image from color components representative of an input image, and if a value of a pixel in at least one of said chroma components exceeds a given value, modify the value of said pixel in at least one of said color components in such a way that the value of said pixel in said at least one of said chroma components is lower than or equals to said given value.

A method for obtaining video chunks of a video sphere for display on a head-mounted display connected to a video server is described, the video chunks being spatially split into a plurality of tiles that can be encoded on at least two different quality levels, including a high quality level and a low quality level, and a display window includes a video sphere portion that is to be displayed at a particular display time. Prior to the display time, the display window is predicted, tiles covering the estimated display window are estimated, and assigned a high quality level, and tiles adjoining those tiles are estimated and assigned a low quality level. A request is sent to a video server to obtain an encoded tile at the associated quality level. The tiles are received from the video server, the display window is determined, and the tiles corresponding to the determined display window are decoded and displayed.

Embodiments of this application provide a video transmission method, apparatus, and system, to reduce an end-to-end transmission delay of video data. The method includes: A transmit end obtains a first frame of image of the video data, where the first frame of image includes a plurality of sub-images, and the plurality sub-images include a first sub-image and a second sub-image; the transmit end performs layered encoding on the first sub-image to obtain a plurality of layers of bitstreams of the first sub-image; the transmit end sends the plurality of layers of bitstreams of the first sub-image to a receive end; the receive end decodes the plurality of layers of bitstreams of the first sub-image to obtain the first sub-image.