Provided are a video stream processing method and apparatus, an electronic device and a computer-readable medium, which relate to the field of Internet technology. An exemplary method includes: storing a video frame in an original video stream in a first buffer area by calling a video stream processing interface of a video stream processing tool; processing the video frame in the first buffer area by means of a video frame processing model to obtain a processed video frame; and on the basis of the processed video frame, generating a standard video stream corresponding to the original video stream. By means of the embodiments of the this application, the software complexity of video stream processing is effectively reduced, and the speed of video stream processing is effectively improved.

A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.

A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.

To transmit image frame data appropriately according to the utilization rate of a receiving buffer and prevent the overflow of the receiving buffer, a communication control system transmits image frame data from a first communication device-to a second communication device. The second communication device includes a receiving buffer that receives image frame data from the first communication device, and a return unit that returns an ACK frame to the first communication device at timing reflecting a utilization rate of the receiving buffer. The first communication device includes an estimation unit that receives the ACK frame from the return unit of the second communication device and estimates the utilization rate of the receiving buffer from receiving time of the ACK frame, and a modification unit that modifies an image compression algorithm of the image frame data based on the estimated utilization rate of the receiving buffer.

To transmit image frame data appropriately according to the utilization rate of a receiving buffer and prevent the overflow of the receiving buffer, a communication control system transmits image frame data from a first communication device-to a second communication device. The second communication device includes a receiving buffer that receives image frame data from the first communication device, and a return unit that returns an ACK frame to the first communication device at timing reflecting a utilization rate of the receiving buffer. The first communication device includes an estimation unit that receives the ACK frame from the return unit of the second communication device and estimates the utilization rate of the receiving buffer from receiving time of the ACK frame, and a modification unit that modifies an image compression algorithm of the image frame data based on the estimated utilization rate of the receiving buffer.

A multimedia file and methods of generating, distributing and using the multimedia file are described. Multimedia files in accordance with embodiments of the present invention can contain multiple video tracks, multiple audio tracks, multiple subtitle tracks, a complete index that can be used to locate each data chunk in each of these tracks and an abridged index that can enable the location of a subset of the data chunks in each track, data that can be used to generate a menu interface to access the contents of the file and ‘meta data’ concerning the contents of the file. Multimedia files in accordance with several embodiments of the present invention also include references to video tracks, audio tracks, subtitle tracks and ‘meta data’ external to the file. One embodiment of a multimedia file in accordance with the present invention includes a series of encoded video frames, a first index that includes information indicative of the location within the file and characteristics of each encoded video frame and a separate second index that includes information indicative of the location within the file of a subset of the encoded video frames.

A multimedia file and methods of generating, distributing and using the multimedia file are described. Multimedia files in accordance with embodiments of the present invention can contain multiple video tracks, multiple audio tracks, multiple subtitle tracks, a complete index that can be used to locate each data chunk in each of these tracks and an abridged index that can enable the location of a subset of the data chunks in each track, data that can be used to generate a menu interface to access the contents of the file and ‘meta data’ concerning the contents of the file. Multimedia files in accordance with several embodiments of the present invention also include references to video tracks, audio tracks, subtitle tracks and ‘meta data’ external to the file. One embodiment of a multimedia file in accordance with the present invention includes a series of encoded video frames, a first index that includes information indicative of the location within the file and characteristics of each encoded video frame and a separate second index that includes information indicative of the location within the file of a subset of the encoded video frames.

Overlapped block disparity estimation and compensation is described. Compensating for images with overlapped block disparity compensation (OBDC) involves determining if OBDC is enabled in a video bit stream, and determining if OBDC is enabled for one or more macroblocks that neighbor a first macroblock within the video bit stream. The neighboring macroblocks may be transform coded. If OBDC is enabled in the video bit stream and for the one or more neighboring macroblocks, predictions may be made for a region of the first macroblock that has an edge adjacent with the neighboring macroblocks. OBDC can be causally applied. Disparity compensation parameters or modes may be shared amongst views or layers. A variety of predictions may be used with causally-applied OBDC.

Overlapped block disparity estimation and compensation is described. Compensating for images with overlapped block disparity compensation (OBDC) involves determining if OBDC is enabled in a video bit stream, and determining if OBDC is enabled for one or more macroblocks that neighbor a first macroblock within the video bit stream. The neighboring macroblocks may be transform coded. If OBDC is enabled in the video bit stream and for the one or more neighboring macroblocks, predictions may be made for a region of the first macroblock that has an edge adjacent with the neighboring macroblocks. OBDC can be causally applied. Disparity compensation parameters or modes may be shared amongst views or layers. A variety of predictions may be used with causally-applied OBDC.

A computer-implemented method for processing a multimedia resource, an electronic device and a storage medium are provided. The method includes: sequentially performing decoding processing on a plurality of pictures in a multimedia resource, for each of the plurality of pictures to be decoded, the decoding processing includes: decoding the picture to be decoded to generate a picture to be rendered; placing the picture to be rendered to a rear of a buffer queue; performing rendering processing on one or more pictures to be rendered in the buffer queue, the rendering processing includes: taking out a picture to be rendered at a front of the buffer queue; rendering the picture to be rendered; and the sequentially performing decoding processing on a plurality of pictures to be decoded in the multimedia resource and the performing rendering processing on one or more pictures to be rendered in the buffer queue are executed concurrently.