H04N19/65

MACHINE LEARNING OF ENCODING PARAMETERS FOR A NETWORK USING A VIDEO ENCODER

In various examples, machine learning of encoding parameter values for a network is performed using a video encoder. Feedback associated with streaming video encoded by a video encoder over a network may be applied to an MLM(s). Using such feedback, the MLM(s) may predict a value(s) of an encoding parameter(s). The video encoder may then use the value to encode subsequent video data for the streaming. By using the video encoder in training, the MLM(s) may learn based on actual encoded parameter values of the video encoder. The MLM(s) may be trained via reinforcement learning based on video encoded by the video encoder. A rewards metric(s) may be used to train the MLM(s) using data generated or applied to the physical network in which the MLM(s) is to be deployed and/or a simulation thereof. Penalty metric(s) (e.g., the quantity of dropped frames) may also be used to train the MLM(s).

MACHINE LEARNING OF ENCODING PARAMETERS FOR A NETWORK USING A VIDEO ENCODER

In various examples, machine learning of encoding parameter values for a network is performed using a video encoder. Feedback associated with streaming video encoded by a video encoder over a network may be applied to an MLM(s). Using such feedback, the MLM(s) may predict a value(s) of an encoding parameter(s). The video encoder may then use the value to encode subsequent video data for the streaming. By using the video encoder in training, the MLM(s) may learn based on actual encoded parameter values of the video encoder. The MLM(s) may be trained via reinforcement learning based on video encoded by the video encoder. A rewards metric(s) may be used to train the MLM(s) using data generated or applied to the physical network in which the MLM(s) is to be deployed and/or a simulation thereof. Penalty metric(s) (e.g., the quantity of dropped frames) may also be used to train the MLM(s).

Video encoding device, video decoding device, video encoding method, video decoding method, and program restricts inter-prediction unit partitions based on coding unit depth

A video encoding device for encoding video using inter prediction includes encoding control means 11 for controlling an inter-PU partition type of a CU to be encoded, based on a minimum inter-PU size (PA) and a CU size (PB) of the CU to be encoded. A video decoding device includes decoding control means for controlling an inter-PU partition of a CU to be decoded, based on the minimum inter-PU size (PA) and the size (PB) of the CU to be decoded.

Method and apparatus for encoding motion information and method and apparatus for decoding same
11595684 · 2023-02-28 · ·

Provided are methods and apparatus for encoding and decoding motion information. The method of encoding motion information includes: obtaining a motion information candidate by using motion information of prediction units that are temporally or spatially related to a current prediction unit; adding, when the number of motion information included in the motion information candidate is smaller than a predetermined number n, alternative motion information to the motion information candidate so that the number of motion information included in the motion information candidate reaches the predetermined number n; determining motion information with respect to the current prediction unit from among the n motion information candidates; and encoding index information indicating the determined motion information as motion information of the current prediction unit.

Method and apparatus for encoding motion information and method and apparatus for decoding same
11595684 · 2023-02-28 · ·

Provided are methods and apparatus for encoding and decoding motion information. The method of encoding motion information includes: obtaining a motion information candidate by using motion information of prediction units that are temporally or spatially related to a current prediction unit; adding, when the number of motion information included in the motion information candidate is smaller than a predetermined number n, alternative motion information to the motion information candidate so that the number of motion information included in the motion information candidate reaches the predetermined number n; determining motion information with respect to the current prediction unit from among the n motion information candidates; and encoding index information indicating the determined motion information as motion information of the current prediction unit.

VIDEO PROCESSING METHOD WITH PARTIAL PICTURE REPLACEMENT
20230239464 · 2023-07-27 · ·

A method is provided for processing a video bitstream which includes a first picture and a sequence parameter set containing information indicating a mode is enabled in which a first area of a picture can be extracted and replaced by a second area of another picture. Using the mode, the first picture is modified by extracting the first area and replacing the extracted area with the second area from the other picture. The modified first picture is stored and a predictor is formed using the modified first picture as a reference picture. A block of a subsequent picture is decoded using the predictor.

METHODS AND APPARATUS TO IDENTIFY A VIDEO DECODING ERROR
20230239508 · 2023-07-27 ·

Methods, apparatus, systems and articles of manufacture to identify a video decoding error are disclosed. An example apparatus includes an atlas generator to generate atlas data for one or more atlases generated from input views of video; a hash generator to: perform a hash operation on the atlas data to generate a hash value; and include the hash value in a message; and a multiplexer to combine the one or more atlases, coded atlas data corresponding to the atlas data, and the message to generate a video bitstream.

METHODS AND APPARATUS TO IDENTIFY A VIDEO DECODING ERROR
20230239508 · 2023-07-27 ·

Methods, apparatus, systems and articles of manufacture to identify a video decoding error are disclosed. An example apparatus includes an atlas generator to generate atlas data for one or more atlases generated from input views of video; a hash generator to: perform a hash operation on the atlas data to generate a hash value; and include the hash value in a message; and a multiplexer to combine the one or more atlases, coded atlas data corresponding to the atlas data, and the message to generate a video bitstream.

IMAGE PROCESSING DEVICE AND METHOD
20230007255 · 2023-01-05 · ·

The present disclosure relates to an image processing device and method for enabling control of a value of a quantization parameter within a desired range.

A quantization parameter is corrected on the basis of a parameter regarding adaptive color transform and further correcting the quantization parameter on the basis of a parameter regarding transform skip, and coefficient data of an image to be encoded is quantized using a corrected quantization parameter that is the quantization parameter that has been corrected. The present disclosure can be applied to, for example, an image processing device, an image encoding device, an image decoding device, a transmission device, a reception device, a transmission/reception device, an information processing device, an imaging device, a reproduction device, an electronic device, an image processing method, an information processing method, or the like.

IMAGE PROCESSING DEVICE AND METHOD
20230007255 · 2023-01-05 · ·

The present disclosure relates to an image processing device and method for enabling control of a value of a quantization parameter within a desired range.

A quantization parameter is corrected on the basis of a parameter regarding adaptive color transform and further correcting the quantization parameter on the basis of a parameter regarding transform skip, and coefficient data of an image to be encoded is quantized using a corrected quantization parameter that is the quantization parameter that has been corrected. The present disclosure can be applied to, for example, an image processing device, an image encoding device, an image decoding device, a transmission device, a reception device, a transmission/reception device, an information processing device, an imaging device, a reproduction device, an electronic device, an image processing method, an information processing method, or the like.