The described technology is directed towards generating a new video image sequence (e.g., for playback at 30 frames per second) based on an existing video image sequence (e.g., originated for playback at 24 frames per second). The technology is based on processing frames, e.g., adjacent pairs of frames in a four-frame sequence, to obtain candidate frames for selecting a similar candidate frame to insert into the original sequence to create the new sequence (e.g., a five-frame sequence). Aspects include selecting a repeated frame to insert or creating a new frame from existing frames to insert, to generate the new sequence based on a difference/scoring comparison.

The present disclosure relates to a video repair method and apparatus, an electronic device, and a storage medium. The method includes: acquiring first forward optical flows and first reverse optical flows between adjacent images among continuous multiple frames of images; respectively performing optical flow optimization processing on the first forward optical flows and the first reverse optical flows to obtain second forward optical flows corresponding to the first forward optical flows and second reverse optical flows corresponding to the first reverse optical flows; performing forward and reverse conduction optimization on the continuous multiple frames of images by utilizing the second forward and the second reverse optical flows, respectively, until all the images in the optimized continuous multiple frames of images satisfy repair requirements; and obtaining repaired images of the continuous multiple frames of images according to the optimized images obtained by the forward conduction optimization and the reverse conduction optimization.

The present invention provides a video decoding method and a camera. Said method comprises: loading a video, and decoding each frame from the video; calculating, for any two adjacent frames, a first optical flow field; calculating, according to the first optical flow field, a second optical flow field of a position where a frame is to be inserted, the position being located between two adjacent frames; using the second optical flow field to calculate a corresponding pixel position, in a previous frame of two adjacent frames, of each pixel of the frame to be inserted, and assigning the pixel value of the previous frame to the pixel of the frame to be inserted; and placing the inserted frame and the decoded original frame together according to a time sequence, so as to reconstitute a video having a high frame rate. The present invention eliminates or improves discrete motion, providing a more fluent viewing experience.

A method for forming an image sequence that is an output sequence, from an input image sequence, is provided. The input image sequence has an input spatial resolution and an input temporal resolution. The output sequence has an output temporal resolution equal to the input temporal resolution and an output spatial resolution equal to a predetermined fraction 1/N of the input spatial resolution by an integer number N higher than or equal to 2. The method, implemented for a sub-sequence of the input frame sequence that is a current input sub-sequence and including a preset number of images, includes: obtaining a temporal frequency that is an image frequency, associated with the current input sub-sequence; processing the current input sub-sequence to obtain an output sub-sequence; and inserting the output sub-sequence and the associated image frequency into an output container.

The disclosure provides a method and an apparatus for interpolating a frame to a video. A first deep-level feature of a first frame is obtained and a second deep-level feature of a second frame is obtained. Forward optical flow information and inverse optical flow information between the first frame and the second frame are obtained based on first deep-level feature and the second deep-level feature. An interpolated frame between the first frame and the second frame is generated based on the forward optical flow information and the inverse optical flow information, and the interpolated frame is inserted between the first frame and the second frame.

A method and apparatus for video frame interpolation, and a device and a storage medium for the same are provided. The method may include: acquiring a target video, and acquiring a (t−1).sup.th frame of image and a t.sup.th frame of image in the target video; acquiring motion level information of pixel points of the (t−1).sup.th frame of image and the t.sup.th frame of image; acquiring deep frame interpolation features of the (t−1).sup.th frame of image and the t.sup.th frame of image, respectively; and performing a frame interpolation operation layer by layer based on the deep frame interpolation features and the motion level information of the (t−1).sup.th frame of image and the t.sup.th frame of image to generate an intermediate frame between the (t−1).sup.th frame of image and the t.sup.th frame of image, and interpolating the intermediate frame between the (t−1).sup.th frame of image and the t.sup.th frame of image.

Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.) In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

A device includes one or more processors configured to execute instructions to obtain motion data indicating estimated motion between a first frame and a second frame of an input sequence of image frames, and to identify, based on the motion data, any frame regions of the first frame that indicate motion greater than a motion threshold. The one or more processors are also configured to determine, based on the motion data, a motion metric associated with the identified frame regions, and to perform a determination, based on the motion metric and a size metric associated with the identified frame regions, whether to use motion-compensated frame interpolation to generate an intermediate frame. The one or more processors are further configured to generate the intermediate frame based on the determination, and to generate an output sequence of image frames that includes the intermediate frame between the first frame and the second frame.

Method for displaying super-resolution video of at least one moving object without image artifacts using a plurality of microscanned images, including the procedures of acquiring microscanned images of at least one moving object, a first and second subset of the images respectively forming a first and second data set, for each data set, analyzing at least a portion of the subset of the images for spatial and temporal information, determining a respective movement indication of the moving object according to the spatial and temporal information, in parallel to the procedure of analyzing, forming a respective super-resolution image from each data set and designating a respective bounded area surrounding the moving object, and repeatedly displaying each super-resolution image outside the bounded area a plurality of times at a video frame rate and displaying during those times within the respective bounded area, a plurality of consecutive microscanned images of the moving object at the video frame rate.

A method, medium and system for generating a high-rate video for displaying to a user on a display device. The method, medium and system may generate and display the high-rate video by: capturing images for a video at a first frame rate, capturing movement of a display device via a motion sensor, estimating a motion of the camera based on images of the video captured at the first frame rate and the movement of the display device captured via the motion sensor, generating the high-rate video at a second frame rate by up-sampling the video captured at the first frame rate, and displaying the high-rate video to the user.