A computer-implemented method for processing a multimedia resource, an electronic device and a storage medium are provided. The method includes: sequentially performing decoding processing on a plurality of pictures in a multimedia resource, for each of the plurality of pictures to be decoded, the decoding processing includes: decoding the picture to be decoded to generate a picture to be rendered; placing the picture to be rendered to a rear of a buffer queue; performing rendering processing on one or more pictures to be rendered in the buffer queue, the rendering processing includes: taking out a picture to be rendered at a front of the buffer queue; rendering the picture to be rendered; and the sequentially performing decoding processing on a plurality of pictures to be decoded in the multimedia resource and the performing rendering processing on one or more pictures to be rendered in the buffer queue are executed concurrently.

This application relates to the image processing field, and provides an encoding method and an encoder. The method includes: when a forcible bit rate control condition is satisfied, performing bit truncation of a spatial-domain branch and coefficient discarding of a frequency domain branch on a to-be-encoded block at the same time, calculating cost values respectively corresponding to the bit truncation and the coefficient discarding, and determining a final encoded bit based on the two cost values, so as to improve image decoding quality as much as possible while preventing bitstream buffer overflow.

A video audio transmission system, transmission method, sending device, and reception device capable of avoiding buffer overflow and buffer depletion in a decoding device and realizing Group of Pictures (GOP) synchronization in encoding devices by eliminating clock deviation among devices. In the video audio transmission system, the sending devices supply clocks generated from common time point information to cameras as genlock signals. The reception devices supply clocks generated from the common time point information to the decoding devices as genlock signals. Therefore, clock deviation between the devices can be eliminated, and the buffer overflow and the buffer depletion in the decoding device can be avoided. Frame periods of video signals output by a plurality of dispersed cameras can be aligned, and reliable GOP synchronization can be realized by the encoding devices on a latter stage with respect to the cameras.

Methods, systems and devices for implementing constraints used in video encoding and video decoding are described. An example method of video processing includes performing a conversion between a video comprising one or more pictures comprising one or more slices and a bitstream of the video. The conversion conforms to a rule, and the bitstream is organized into one or more access units. The rule specifies a constraint on a number of decoded pictures stored in a decoded picture buffer (DPB). Each decoded picture of the decoded pictures is (i) marked as used for reference, (ii) has a flag indicative of the decoded picture being output, and (iii) has an output time later than a decoding time of a current picture.

Methods, systems and devices for implementing constraints used in video encoding and video decoding are described. An example method of video processing includes performing a conversion between a video comprising one or more pictures comprising one or more slices and a bitstream of the video. The conversion conforms to a rule, and the bitstream is organized into one or more access units. The rule specifies a constraint on a number of decoded pictures stored in a decoded picture buffer (DPB). Each decoded picture of the decoded pictures is (i) marked as used for reference, (ii) has a flag indicative of the decoded picture being output, and (iii) has an output time later than a decoding time of a current picture.

Innovations in allocation of bit rate between video streams using machine learning are described. For example, a controller of a video encoder system receives first feedback values that indicate results of encoding part of a first video sequence (e.g., screen content). The controller also receives second feedback values that indicate results of encoding part of a second video sequence (e.g., camera video content). A machine learning model accepts, as inputs, the first feedback values and second feedback values. The machine learning model produces, as output, a reallocation parameter. The controller determines a first target bit rate and a second target bit rate using the reallocation parameter. A first video encoder encodes one or more pictures of the first video sequence at the first target bit rate, and a second video encoder encodes one or more pictures of the second video sequence at the second target bit rate.

Innovations in allocation of bit rate between video streams using machine learning are described. For example, a controller of a video encoder system receives first feedback values that indicate results of encoding part of a first video sequence (e.g., screen content). The controller also receives second feedback values that indicate results of encoding part of a second video sequence (e.g., camera video content). A machine learning model accepts, as inputs, the first feedback values and second feedback values. The machine learning model produces, as output, a reallocation parameter. The controller determines a first target bit rate and a second target bit rate using the reallocation parameter. A first video encoder encodes one or more pictures of the first video sequence at the first target bit rate, and a second video encoder encodes one or more pictures of the second video sequence at the second target bit rate.

A bit rate control system includes: a memory; and a processor coupled to the memory and configured to: perform an image recognition process on a frame to be processed in video while changing image quality to specify the image quality at which recognition accuracy of an object included in the frame to be processed reaches an allowable limit; calculate a first quantization step that corresponds to the specified image quality; determine whether or not overflow occurs in a virtual buffer when encoding processing is performed on the frame to be processed by using the calculated first quantization step; and exercise control to perform the encoding processing on the frame to be processed by using the calculated first quantization step when the overflow is determined not to occur.

A bit rate control system includes: a memory; and a processor coupled to the memory and configured to: perform an image recognition process on a frame to be processed in video while changing image quality to specify the image quality at which recognition accuracy of an object included in the frame to be processed reaches an allowable limit; calculate a first quantization step that corresponds to the specified image quality; determine whether or not overflow occurs in a virtual buffer when encoding processing is performed on the frame to be processed by using the calculated first quantization step; and exercise control to perform the encoding processing on the frame to be processed by using the calculated first quantization step when the overflow is determined not to occur.

A method of decoding an enhanced video stream composed of base layer video access units and enhancement layer video access units, each access unit comprising a plurality of syntax structures, includes passing the syntax structures of the base layer access units to a base layer buffer, passing syntax structures of the enhancement layer access units to an enhancement layer buffer, outputting the syntax structures passed to the base layer buffer in a predetermined sequence, outputting the syntax structures passed to the enhancement layer buffer in a predetermined sequence, and recombining the sequences of syntax structures output by the base layer buffer and the enhancement layer buffer respectively to form a complete enhanced access unit, composed of base layer syntax structures and enhancement layer syntax structures in a predetermined sequence.