Methods for encoding and decoding high-dynamic range signals are presented. The signals are encoded in a high frame rate and are accompanied by frame-rate conversion metadata defining a preferred set of frame-rate down-conversion parameters, which are determined according to the maximum luminance of a target display, display playback priority modes, or judder control modes. A decoder uses the frame-rate conversion metadata to apply frame-rate down-conversion to the input high-frame-rate signal according to at least the maximum luminance of the target display and/or the characteristics of the signal itself. Frame-based and pixel-based frame-rate conversions, and judder models for judder control via metadata are also discussed.

An image processing apparatus includes: a signal receiver configured to receive an input image; an image processor configured to process the input image and generate an output image; a storage configured to store a first patch corresponding to a first pixel of the input image; and a controller configured to control the image processor to generate the output image by applying the first patch stored in the storage to the first pixel.

An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

Provided are an image data output device, an image data output method, an image display device, and an integrated circuit that are possible to eliminate stutter by selecting a frame rate from a plurality of frame rate candidates. The image data output device that switches a frame rate of a generated image for each frame and outputs the image to an image display device includes an image generation unit that, on a basis of image generation time required to generate the image, changes the frame rate to one of a plurality of frame rates which are predetermined.

Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.

Disclosed herein is a camera system including, a camera apparatus having, an image sensor, a correction section, a first transmission processing section, and a synchronization processing section, and a video processing apparatus having a second transmission processing section and a conversion section, wherein the video processing apparatus outputs the video data obtained by the conversion by the conversion section.

There is disclosed in one example a video processor, including: an input buffer to receive an input image; a slicer circuit to divide the input image into a plurality of N vertical slices; N parallel input buffers for de-rasterization; N parallel image scalers, wherein each scaler is hardware configured to scale in a raster form, one of the N vertical slices according to an image scaling algorithm; N parallel output buffers for rerasteriztion; and an output multiplexer to combine the scaled vertical slices into a combined scaled output image.

An image processing apparatus includes: a signal receiver configured to receive an input image; an image processor configured to process the input image and generate an output image; a storage configured to store a first patch corresponding to a first pixel of the input image; and a controller configured to control the image processor to generate the output image by applying the first patch stored in the storage to the first pixel.

An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

A remote vehicle control system includes a vehicle mounted sensor system including a video camera system for producing video data. A data handling system is connected to a network to transmit data to and receive data from a remote teleoperation site. A virtual control system is configured to receive the video, provide a user with a live video stream supported by machine intelligence directed frame synthesis, and transmit control instructions to the remote vehicle over the network. The frame synthesis is supported by a convolutional neural network. The frame synthesis may be used to interpolate frames to increase effective frames per second. The frame synthesis may be used to extrapolate frames to replace missing or damaged video frames.