Provided are an image data output device, an image data output method, an image display device, and an integrated circuit that are possible to eliminate stutter by selecting a frame rate from a plurality of frame rate candidates. The image data output device that switches a frame rate of a generated image for each frame and outputs the image to an image display device includes an image generation unit that, on a basis of image generation time required to generate the image, changes the frame rate to one of a plurality of frame rates which are predetermined.

A video stream processing method, a device, a terminal device, and a computer-readable storage medium are provided, including steps for acquiring a first video stream through a first camera and acquiring a second video stream through a second camera in response to receiving a slow-motion shooting instruction, the slow-motion shooting instruction carrying a frame rate of a slow-motion video stream; encoding the first video stream and the second video stream into a third video stream with a third frame rate, the third frame rate being greater than the first frame rate, and the third frame rate being greater than the second frame rate; and acquiring a fourth video stream with a fourth frame rate through performing a frame interpolation algorithm on the third video stream, the fourth frame rate being the same as the frame rate of the slow-motion video stream.

An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

The described technology is directed towards generating a new video image sequence (e.g., for playback at 30 frames per second) based on an existing video image sequence (e.g., originated for playback at 24 frames per second). The technology is based on processing frames, e.g., adjacent pairs of frames in a four-frame sequence, to obtain candidate frames for selecting a similar candidate frame to insert into the original sequence to create the new sequence (e.g., a five-frame sequence). Aspects include selecting a repeated frame to insert or creating a new frame from existing frames to insert, to generate the new sequence based on a difference/scoring comparison.

An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

An information processing apparatus that functions as a non-limiting example image processing apparatus includes a processor. When an original image drawn with horizontally-long first pixels is to be drawn by square second pixels, the processor generates two intermediate image data in each of which the number of second pixels is 1.2 times the number of first pixels of the original image data, by generating a second area formed with six (6) second pixels arranged in a horizontal direction for each of first areas that are formed dividing the original image by every five (5) first pixels arranged in the horizontal direction, and outputs the two intermediate image data to a display control device. The display control device generates output image data by synthesizing the two intermediate image data, and outputs the generated output image data to a display. The output image data is generated in each of the second areas with colors that include colors of the second pixels at both ends, which are in agreement with colors of the first pixels at both ends in each corresponding first area and colors of the second pixels other than the both ends, each of which is generated based on colors of adjacent two first pixels in corresponding first area.

Systems and methods for generating interpolated images are disclosed. In examples, image features are extracted from a first image and a second image; such image features may be warped using first and second plurality of parameters. A first candidate intermediate frame may be generated based on the warped first features and the warped second features. Multi-scale features associated with the image features extracted from the first image and the second image may be obtained and warped using the first and second plurality of parameters. A second candidate intermediate frame may be generated based on the warped first multi-scale features and the warped second multi-scale features. By blending the first candidate intermedia frame with the second candidate intermediate frame, an interpolated image may be generated.

A system and method for processing an input video while maintaining temporal consistency across video frames is provided. The method includes converting the input video from a first frame rate to a second frame rate, wherein the second frame rate is a faster frame rate than the first frame rate; generating processed frames of the input video at the second frame rate; and aggregating the processed frames using temporal sliding window aggregation to yield a processed output video at a third frame rate.

A system and method for learning human activities from video demonstrations using video augmentation is disclosed. The method includes receiving original videos from one or more data sources. The method includes processing the received original videos using one or more video augmentation techniques to generate a set of augmented videos. Further, the method includes generating a set of training videos by combining the received original videos with the generated set of augmented videos. Also, the method includes generating a deep learning model for the received original videos based on the generated set of training videos. Further, the method includes learning the one or more human activities performed in the received original videos by deploying the generated deep learning model. The method includes outputting the learnt one or more human activities performed in the original videos.

A method of motion estimation and motion compensation for a video processor includes steps of: detecting an input frame rate of a series of input frames; calculating a frame counting value, wherein the frame counting value represents the number of output frame periods between a current input frame and a previous input frame among the series of input frames; calculating a phase step, which is configured to generate a phase coefficient for generating an interpolated frame as an output frame of each of the output frame periods, according to the frame counting value; and generating the interpolated frame based on the current input frame and the previous input frame by using the phase coefficient. Wherein, the step of calculating the frame counting value, the step of calculating the phase step and the step of generating the interpolated frame are consistently performed until the input frame rate is successfully detected.