A frame interpolation method for generating a third image frame interpolated between a first image frame and a second image frame includes: performing motion estimation upon a first input image frame and a second input image frame, to obtain a single-directional motion, wherein the first input image frame is derived from the first image frame, and the second input image frame is derived from the second image frame; scaling the single-directional motion according to a time point of the third image frame, to generate a scaled motion; deriving a forward-warped result from a result of performing a forward warping operation and a first inverse operation upon the scaled motion; performing a second inverse operation upon the forward-warped result, to generate an inversed result; and generating the third image frame according to the first image frame, the second image frame, the forward-warped result, and the inversed result.

An electronic apparatus includes a memory configured to store an input image and at least one processor configured to obtain two consecutive frames of the input image as input frames; obtain a first interpolation frame of the input frames and a first confidence corresponding to the first interpolation frame based on a first interpolation method; obtain a second interpolation frame of the input frames and a second confidence corresponding to the second interpolation frame based on a second interpolation method that is different from the first interpolation method; obtain weights corresponding to the first interpolation frame and the second interpolation frame, based on the first confidence and the second confidence, respectively; and obtain an output image based on the weights.

A mechanism for processing video data is disclosed. Video decoder initialization information is signaled between an encoder to a decoder. The video decoder initialization information contains a range of initialization parameters for a plurality of video units when the plurality of video units are coded according to a same video codec and a same profile. A conversion is performed between a visual media data and a visual media data file based on the range of initialization parameters.

Embodiments of the disclosure provide systems and methods for performing frame rate up-conversion of video data including a sequence of image frames. The method may include determining a set of motion vectors of a target frame relative to a plurality of reference frames. The target frame is to be generated and interpolated into the sequence of image frames. The method may further include performing a motion vector classification on the set of motion vectors to generate a target object map for the target frame. The method may additionally include projecting the target object map onto the plurality of reference frames to generate a plurality of reference object maps based on the set of motion vectors. The method may additionally include detecting an occlusion area in the target frame based on the set of motion vectors, the target object map, and the plurality of reference object maps.

A motion estimation technique finds first and second candidate bi-directional motion vectors for a first region of an interpolated frame of video content by performing double ended vector motion estimation on the first region. One of these candidate bi-directional motion vectors is selected, and used to identify a remote region of the interpolated frame. This remote region is located at an off-set location from the first region, and is found based on an endpoint of the selected candidate bi-directional motion vector. A remote motion vector for the remote region of the interpolated frame is obtained, and one or more properties of this remote motion vector are used to bias a selection between the first and second candidate vectors.

A method for decoding image frames at a client is described. The method includes generating an estimated image frame after receiving an encoded image frame of a stream of encoded image frames. The method further includes decoding the encoded image frame when the encoded image frame is received at a decode interval set for a frame rate of presentation. The method includes using the estimated image frame when a corresponding encoded image frame fails to arrive within the stream for presentation at the frame rate.

A method includes obtaining multiple video frames. The method also includes determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency. The method further includes identifying a non-linear curve based on pixel coordinate values from at least two of the video frames. The at least two video frames include first and second video frames. The method also includes generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve. In addition, the method includes outputting the interpolated video frames for presentation.

An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.

Embodiments of the disclosure provide systems and methods for performing occlusion detection in frame rate up-conversion of video data including a sequence of image frames. The method includes determining, by a video processor, whether a target block of a target frame is a potential occlusion block based on at least one of motion vector information or distortion metric information associated with the target block. The target frame is to be generated and interpolated into the sequence of image frames. Responsive to the target block being the potential occlusion block, the method further includes detecting, by the video processor, an occlusion type of the target block. The method additionally includes generating, by the video processor, the target block by performing a motion compensation method adaptively selected based on the occlusion type of the target block.

A video-image-interpolation apparatus is provided, which includes at least three image-layering circuits, at least three motion-estimation circuits, a motion-estimation-filtering circuit, a motion-compensated frame-interpolation circuit, and a display-control circuit. Each motion-estimation circuit performs motion estimation on a reference image-layer sequence and a reference subtitle-layer sequence that are generated from an input video signal by each image-layering circuit. The motion-estimation-filtering circuit adaptively determines the motion-estimation circuit having the smallest motion error. The motion-compensated frame-interpolation circuit performs motion compensation to generate one or more interpolated image-layer images and one or more interpolated subtitle-layer images according to the motion vectors calculated by the motion-estimation circuit having the smallest motion error, and superimposes the one or more interpolated image-layer images and the one or more interpolated subtitle-layer images to generate interpolated images. The display-control circuit performs frame-rate conversion on the reference images and the interpolated images to obtain an output video signal.