Patent classifications
H04N19/40
Video encoding and decoding acceleration utilizing IMU sensor data for cloud virtual reality
An encoding acceleration method of cloud VR (virtual reality) video, the method comprising: constructing a reference frame candidate for encoding of a current frame; selecting a specific reference frame among the reference frame candidate based on a sensor data of IMU (Inertial Measurement Unit); selecting a prediction mode for encoding the current frame based on information included in the specific reference frame; and encoding the current frame based on the selected prediction mode.
Reset of historical motion vector prediction
In some embodiments, a method maintains a first list that stores motion vectors from one or more blocks that have been previously processed in a frame. When a current block is in the first set of positions in the frame, the method resets and uses a motion vector from a second list to transcode the current block due to the resetting of the first list. When the current block is not in the first set of positions, the method uses a motion vector from the first list to transcode the current block.
Reset of historical motion vector prediction
In some embodiments, a method maintains a first list that stores motion vectors from one or more blocks that have been previously processed in a frame. When a current block is in the first set of positions in the frame, the method resets and uses a motion vector from a second list to transcode the current block due to the resetting of the first list. When the current block is not in the first set of positions, the method uses a motion vector from the first list to transcode the current block.
Video interface conversion device and method
The present disclosure discloses a video interface conversion device that includes a first and a second interface transmission circuit, a color conversion circuit and an image compression circuit. The first and the second interface transmission circuit are respectively electrically coupled to an image source and a display terminal. The second interface transmission circuit negotiates a maximum output bandwidth with the display terminal such that the first interface transmission circuit compares an input data bandwidth of a data signal received from the image source and the maximum output bandwidth. When the maximum output bandwidth is smaller than the input data bandwidth, an image compression and/or a color coding conversion is performed on the data signal, and the data signal having the processed input data bandwidth being smaller than or equal to the maximum output bandwidth is further transmitted by the second interface transmission circuit to the display terminal.
Video interface conversion device and method
The present disclosure discloses a video interface conversion device that includes a first and a second interface transmission circuit, a color conversion circuit and an image compression circuit. The first and the second interface transmission circuit are respectively electrically coupled to an image source and a display terminal. The second interface transmission circuit negotiates a maximum output bandwidth with the display terminal such that the first interface transmission circuit compares an input data bandwidth of a data signal received from the image source and the maximum output bandwidth. When the maximum output bandwidth is smaller than the input data bandwidth, an image compression and/or a color coding conversion is performed on the data signal, and the data signal having the processed input data bandwidth being smaller than or equal to the maximum output bandwidth is further transmitted by the second interface transmission circuit to the display terminal.
METHOD FOR AUDIO AND VIDEO JUST-IN-TIME TRANSCODING WITH COMMAND FRAMES
A method includes: ingesting a video; initializing a timed command stream synchronized to the video; emulating transcoding of the video to derive a sequence of video characteristics of the video; populating the timed command stream with the sequence of video characteristics; segmenting the video into a series of mezzanine segments. The method further includes: for each mezzanine segment, in the series of mezzanine segments: retrieving instream video characteristics, in the sequence of video characteristics, contained within a first segment of the timed command stream corresponding to the mezzanine segment; retrieving upstream video characteristics, in the sequence of video characteristics, preceding the first segment of the timed command stream and informing transcoding of the mezzanine segment; transforming the instream video characteristics and the upstream video characteristics into a set of transcode commands; storing the set of transcode commands in command frames; and inserting the command frames into the mezzanine segment.
METHOD FOR AUDIO AND VIDEO JUST-IN-TIME TRANSCODING WITH COMMAND FRAMES
A method includes: ingesting a video; initializing a timed command stream synchronized to the video; emulating transcoding of the video to derive a sequence of video characteristics of the video; populating the timed command stream with the sequence of video characteristics; segmenting the video into a series of mezzanine segments. The method further includes: for each mezzanine segment, in the series of mezzanine segments: retrieving instream video characteristics, in the sequence of video characteristics, contained within a first segment of the timed command stream corresponding to the mezzanine segment; retrieving upstream video characteristics, in the sequence of video characteristics, preceding the first segment of the timed command stream and informing transcoding of the mezzanine segment; transforming the instream video characteristics and the upstream video characteristics into a set of transcode commands; storing the set of transcode commands in command frames; and inserting the command frames into the mezzanine segment.
Directed interpolation and data post-processing
An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
Directed interpolation and data post-processing
An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
CLOUD GAMING ADAPTIVE SYNCHRONIZATION MECHANISM
An apparatus to facilitate processing of cloud gaming data is disclosed. The apparatus includes one or more processors to receive a plurality of frames of game video data, render the plurality of frames to have a variable frame rate, encode the plurality of frames as encoded game data and transmit the encoded game data to a client computing device.