Initial value is selected when motion estimation is performed using predicted motion vector in video codec in which multiple references are allowed, and coding amount of motion vectors is reduced using predicted motion vector. Motion vector encoding apparatus includes predicted motion vector generator that generates adjacent motion vectors of current block with respect to each of reference pictures and generates each predicted motion vector of the current block from the generated adjacent motion vectors, motion estimator that determines final motion vector of the current block and final reference picture corresponding to the final motion vector with regard to search regions of the reference pictures, differential unit that obtains difference between the final motion vector of the current block and final predicted motion vector corresponding to the determined final reference picture among the predicted motion vectors, and unit for encoding information about the final reference picture and the difference.

A method and an apparatus for determining a small-object region in a video frame. The method includes dividing a current video frame into at least two regions, and determining a global motion vector corresponding to each region; determining an interframe motion vector of each group of adjacent frames in multiple video frames that include the current video frame and a reference frame of the current video frame; determining a candidate small-object region in the current video frame according to the interframe motion vector of the each group of adjacent frames and the determined global motion vector corresponding to each region; and performing filtering on the candidate small-object region in the current video frame, and determining a region obtained after the filtering as a small-object region in the current video frame.

A method and an apparatus for determining a small-object region in a video frame. The method includes dividing a current video frame into at least two regions, and determining a global motion vector corresponding to each region; determining an interframe motion vector of each group of adjacent frames in multiple video frames that include the current video frame and a reference frame of the current video frame; determining a candidate small-object region in the current video frame according to the interframe motion vector of the each group of adjacent frames and the determined global motion vector corresponding to each region; and performing filtering on the candidate small-object region in the current video frame, and determining a region obtained after the filtering as a small-object region in the current video frame.

A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.

A method of determining a bitstream is described, including: determining a motion vector of a current block of a video frame of a sequence of video frames comprising video data captured by a video capturing device, the motion vector defining an offset of the current block relative to a prediction block of an already encoded first reference video frame, part of the offset being associated with global motion in the video data if the video capturing device is moving relative to a scene; determining a motion vector predictor selected by the processor from motion vectors of already encoded blocks of the current video frame; and, a motion compensation vector for the motion vector of the current block, for providing an estimate of the part of the motion vector that is associated with global motion; determining a global motion compensated motion vector based on a difference between the motion vector and motion compensation vector, and, a motion vector difference based on the motion vector predictor and the compensated motion vector; and, the processor using an entropy coding algorithm to code the motion vector difference; and, conversion information for converting the compensated motion vector into the motion vector, into a bitstream.

According to the disclosure of the present document, when the inter-prediction type of the current block indicates biprediction, weight index information for a candidate in a merge candidate list or sub-block merge candidate list can be derived, and coding efficiency can be raised.

A non-transitory computer-readable storage medium storing an encoding processing program that causes a computer to execute a process, the process including acquiring image feature information of each of a plurality of image regions obtained by partitioning first image data and image feature information of each of the plurality of image regions obtained by partitioning second image data, determining, for each of the plurality of image regions, whether image feature information of the first image data and image feature information of the second image data have a correlation greater than or equal to a certain value, and coding a specified image region of the second image data which has the correlation, the coding being performed by using coding unit used for coding of an image region of the first image data whose position corresponds to the specified image region of the second image data.

A non-transitory computer-readable storage medium storing an encoding processing program that causes a computer to execute a process, the process including acquiring image feature information of each of a plurality of image regions obtained by partitioning first image data and image feature information of each of the plurality of image regions obtained by partitioning second image data, determining, for each of the plurality of image regions, whether image feature information of the first image data and image feature information of the second image data have a correlation greater than or equal to a certain value, and coding a specified image region of the second image data which has the correlation, the coding being performed by using coding unit used for coding of an image region of the first image data whose position corresponds to the specified image region of the second image data.

An image processing apparatus and an image processing method thereof are provided. A shared storage unit of a motion estimation and motion compensation apparatus captures frame data of a storage unit through a bus. A motion vector estimation unit and a motion compensation unit capture image data for executing a motion vector estimation operation and a motion compensation operation from the sharing storage unit.

An image processing apparatus and an image processing method thereof are provided. A shared storage unit of a motion estimation and motion compensation apparatus captures frame data of a storage unit through a bus. A motion vector estimation unit and a motion compensation unit capture image data for executing a motion vector estimation operation and a motion compensation operation from the sharing storage unit.