A system for non-reference video-quality prediction includes a video-processing block to receive an input bitstream and to generate a first vector, and a neural network to provide a predicted-quality vector after being trained using training data. The training data includes the first vector and a second vector, and elements of the first vector include high-level features extracted from a high-level syntax processing of the input bitstream.

Techniques are disclosed for the creation of multi-codec encoding profiles (or encoding ladders), which define quality and bitrate for each of the streams made available to clients for streaming a video. In particular, optimization techniques may take into account a quality rate function of each of the codecs when determining the encoding ladder. Additional considerations may include a network bandwidth distribution and/or a distribution of client types.

This disclosure describes systems, methods, and devices related to bit-rate-based variable accuracy level encoding. A device may generate a list of encodes based on pairs of resolutions and quantization parameters (QP) associated with one or more video segments received from a source. The device may generate an estimated bit rate associated with the one or more video segments based on an analysis of the one or more video segments. The device may utilize an accuracy level of encoding for an encoder based on the estimated bit rate. The device may encode the one or more video segments based on the accuracy level of encoding.

This disclosure describes systems, methods, and devices related to bit-rate-based variable accuracy level encoding. A device may generate a list of encodes based on pairs of resolutions and quantization parameters (QP) associated with one or more video segments received from a source. The device may generate an estimated bit rate associated with the one or more video segments based on an analysis of the one or more video segments. The device may utilize an accuracy level of encoding for an encoder based on the estimated bit rate. The device may encode the one or more video segments based on the accuracy level of encoding.

An improved split rendering process of the present disclosure mitigates the impact of delay variation in XR application with remote rendering applications. A visual scene is split rendered to generate graphic layers from 3D objects in the visual scene. The server node groups and sorts the graphic layers based on QoE importance to create graphic layer groups, encodes each graphic layer group into a composite video frame and appends metadata to the composite video frame. The encoded video frame is then transmitted in sorted order based on quality rank to a client device (e.g., an HMD worn by a user) where the video frame is decoded and displayed. The client device further sends feedback to the server indicating the graphic layer groups that were timely received.

An improved split rendering process of the present disclosure mitigates the impact of delay variation in XR application with remote rendering applications. A visual scene is split rendered to generate graphic layers from 3D objects in the visual scene. The server node groups and sorts the graphic layers based on QoE importance to create graphic layer groups, encodes each graphic layer group into a composite video frame and appends metadata to the composite video frame. The encoded video frame is then transmitted in sorted order based on quality rank to a client device (e.g., an HMD worn by a user) where the video frame is decoded and displayed. The client device further sends feedback to the server indicating the graphic layer groups that were timely received.

An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

A video encoding method includes (i) determining a current bit rate of a communication channel between a destination device and a source device that stores an input video frame, and (ii) generating a current reconstructed frame and an encoded bitstream at least in part via inter-frame coding of a current input video frame of a sequence of input video frames using a previously-generated reconstructed frame generated at least in part via inter-frame coding of a previous input video frame. The current reconstructed frame is a compressed version of the current input video frame. When both (i) a subsequent bit rate, determined after said inter-frame coding, is less than a threshold and (ii) the current bit rate exceeds the threshold, the method includes: (a) generating a downscaled reconstructed frame at least in part by downscaling the current reconstructed frame; and (b) appending the encoded bitstream with a bit sequence representing the downscaled reconstructed frame.

In a method for image transmitting executed in a transmitting device, three data transmitting channels are established, the three data transmitting channels are a first channel, a second channel and a third channel. An image of a video is obtained, and the image is divided into a region of interest and a background region. A first data of the region of interest and a second data of the background region are obtained, and the first data is encoded through fountain coding to obtain a third data. The first data, the second data, and the third data are respectively transmitted through the first channel, the second channel, and the third channel to a receiving device. A network condition is received, and whether the network condition matches a preset condition is determined. When the network condition matches the preset condition, the first data is compensated according to a first preset algorithm.

An example apparatus for adaptively encoding video frames includes a network analyzer to predict an instant bitrate based on channel throughput feedback received from a network. The apparatus also includes a content analyzer to generate ladder info based on a received frame. The apparatus further includes an adaptive decision executer to determine a frame rate, a video resolution, and a target frame size based on the predicted instant bitrate and the ladder outputs. The apparatus further includes an encoder to encode the frame based on the frame rate, the video resolution, and the target frame size.