A video processing method is provided, including obtaining an original video sequence, the original video sequence comprising P video frames obtained through rendering, P being an integer greater than or equal to 2; obtaining a target video sequence according to the original video sequence, the target video sequence comprising the P video frames and Q unrendered video frames interpolated based on at least two video frames of the P video frames, Q being an integer greater than or equal to 1; encoding the target video sequence to obtain a video encoding sequence; and transmitting the video encoding sequence to a terminal device, the terminal device decoding the video encoding sequence to obtain a video sequence that needs to be rendered.

Embodiments of the present invention relate to an encoding method, an image encoder and image transmission system. The encoding method includes: processing raw image data to obtain at least two channels of different output images; and performing multi-stream encoding on the at least two channels of output images, to form at least two corresponding channels of encoded data to support at least two types of service requirements. A multi-stream encoding manner is used in the encoding method, to adopt different encoding strategies for different service requirements thereby implementing services smoother while meeting the different service requirements.

Systems, methods and computer readable mediums are presented for encoding a stream of input video frames, in which the input video frames are down sampled and the down sampled frames are encoded in a first encoding pass to generate a set of first pass coded frames forming a single first pass I frame and a plurality of first pass P frames formed into first pass sub-groups of pictures (SUB-GOPs). First pass encoding statistics are generated for individual first pass SUB-GOPs, and the statistics are used to encode the input video frames in a second encoding pass to generate a set of second pass coded frames.

Systems, methods and computer readable mediums are presented for encoding a stream of input video frames, in which the input video frames are down sampled and the down sampled frames are encoded in a first encoding pass to generate a set of first pass coded frames forming a single first pass I frame and a plurality of first pass P frames formed into first pass sub-groups of pictures (SUB-GOPs). First pass encoding statistics are generated for individual first pass SUB-GOPs, and the statistics are used to encode the input video frames in a second encoding pass to generate a set of second pass coded frames.

A method of encoding a video bitstream implemented by a video encoder is disclosed. The method includes storing, in a memory of the video encoder, a set of less than five network abstraction layer (NAL) unit types available for video data; selecting, by a processor of the video encoder, a NAL unit type from the set of less than five NAL unit types for a picture from the video data; generating, by the processor of the video encoder, a video bitstream containing a NAL unit corresponding to the NAL unit type selected and containing an identifier identifying the NAL unit type selected; and transmitting, by a transmitter of the video encoder, the video bitstream toward a video decoder. A corresponding method of decoding the video bitstream is also disclosed.

A video data encoding method is provided for an encoding device. The method includes obtaining first video data, and encoding the first video data to generate a plurality of sequentially arranged groups-of-pictures. A frame type of a first frame of an initial group-of-pictures in the plurality of groups-of-pictures is an I frame, frame types of first frames of the other groups-of-pictures are GF frames, and each GF frame is configured to record change information of a current frame of a corresponding group-of-pictures relative to an I frame or a GF frame in a previous group-of-pictures. The method also includes successively outputting the plurality of groups-of-pictures according to a sequence of the plurality of groups-of-pictures, to obtain second video data.

A video data encoding method is provided for an encoding device. The method includes obtaining first video data, and encoding the first video data to generate a plurality of sequentially arranged groups-of-pictures. A frame type of a first frame of an initial group-of-pictures in the plurality of groups-of-pictures is an I frame, frame types of first frames of the other groups-of-pictures are GF frames, and each GF frame is configured to record change information of a current frame of a corresponding group-of-pictures relative to an I frame or a GF frame in a previous group-of-pictures. The method also includes successively outputting the plurality of groups-of-pictures according to a sequence of the plurality of groups-of-pictures, to obtain second video data.

There is provided an image processing apparatus and method allowing suppression of a decrease in coding efficiency. Coded data obtained by coding a captured image captured by a moving body with an image capturing section is transcoded on the basis of positional information indicating a position where the captured image has been generated. For example, the positional information includes at least one of GPS information indicating the position of the moving body or IMU information indicating movement of the moving body, and captured images are coded in frame images of a moving image on the basis of the information. For example, the present disclosure can be applied to an image processing apparatus, an image coding apparatus, a communication apparatus, an information processing apparatus, an image capturing apparatus, or the like.

There is provided an image processing apparatus and method allowing suppression of a decrease in coding efficiency. Coded data obtained by coding a captured image captured by a moving body with an image capturing section is transcoded on the basis of positional information indicating a position where the captured image has been generated. For example, the positional information includes at least one of GPS information indicating the position of the moving body or IMU information indicating movement of the moving body, and captured images are coded in frame images of a moving image on the basis of the information. For example, the present disclosure can be applied to an image processing apparatus, an image coding apparatus, a communication apparatus, an information processing apparatus, an image capturing apparatus, or the like.

Methods, systems, and devices for improved video throughput using deep learning video coding are described. A device may receive a bitstream including a set of video frames. The device may batch the set of video frames into a first subset of video frames and a second subset of video frames based on a change in a reference scene associated with the set of video frames. The device may select a mode of operation for a neural processing unit of the device based on the batching. The device may generate a set of video packets including the first subset of video frames, the second subset of video frames, or both, based on the neural processing unit and the selected mode of operation