EFFICIENT JUST-IN-TIME TRANSCODING BY PARAMETER EXTRACTION

Abstract

A method of video encoding is provided to reduce the cost of network DVR storage by building on a concept of Just-In Time (JIT) transcoding which eliminates storing all formats of content in a DVR. A super-encoding procedure is provided that encodes a high resolution format, such as HEVC, while metadata is provided for lower resolution formats, such as MPEG4. The metadata can include items like motion vectors to reduce the computational costs during JIT transcoding. The super-encoded data is stored in memory of the DVR. High resolution encoded data is read directly out of the DVR memory, while lower resolutions are transcoded from the DVR memory data using the metadata to increase efficiency.

Claims

1. A method for performing video encoding for storage comprising: providing super-encoding to compute an efficient compressed stream for storage for a single layer first resolution video; and computing metadata that reduces the computational load for subsequent Just In Time (JIT) transcoding the stored first resolution video as part of the super-encoding to a single layer second resolution video and storing the metadata with the compressed stream, wherein the metadata targets the largest computational load of transcoding.

2. The method of claim 1, wherein the metadata comprises motion vectors.

3. The method of claim 1, wherein the metadata comprises mode decisions on intra versus inter prediction blocks.

4. The method of claim 1, wherein the first resolution video is HEVC and the second resolution video is MPEG4.

5. The method of claim 4, wherein the metadata comprises motion vectors needed for MPEG4 which are not provided by HEVC when HEVC uses very large or very small block sizes relative to MPEG4.

6. A system for encoding video encoding for storage, the system comprising: an encoding processor having an input for receiving input video data and providing an encoded video output; a digital video recorder (DVR) having a first memory for receiving and storing the encoded video output from the processor; a second memory connected to the encoding processor, the second memory storing code data to enable the encoding processor to perform the following steps: providing super-encoding on the input video to compute an efficient compressed stream for storage for a single layer first high resolution video; and computing metadata that reduces the computational load for subsequent Just In Time (JIT) transcoding the stored first high resolution video as part of the super-encoding to a single layer second resolution video and storing the metadata with the compressed stream, wherein the metadata targets the largest computational load of transcoding.

7. The system of claim 6, wherein the metadata comprises motion vectors.

8. The system of claim 6, wherein the metadata comprises mode decisions on intra versus inter prediction blocks.

9. The system of claim 6, wherein the first resolution video is HEVC and the second resolution video is MPEG4.

10. The method of claim 9, wherein the metadata comprises motion vectors needed for MPEG4 which are not provided by HEVC when HEVC uses very large or very small block sizes relative to MPEG4.

11-12. (canceled)

13. The method of claim 1, wherein subsequent just in time transcoding is performed for the second resolution video for providing to a first video display with a different resolution than a second video display capable of displaying the first resolution video.

14. The system of claim 6, wherein subsequent just in time transcoding is performed for the second resolution video for providing to a first video display with a different resolution than a second video display capable of displaying the first resolution video.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Further details of the present invention are explained with the help of the attached drawings in which:

[0010] FIG. 1 is a block diagram of components of a system that provides super-encoding according to embodiments of the present invention to create encoded data in a high resolution format with metadata to enable JIT transcoding of lower resolution formats, the encoded data with metadata for storage in a DVR memory, and the JIT transcoder generating the lower resolution video;

[0011] FIG. 2 is a flowchart showing steps according to the present invention for super-encoding, storage of data in a DVR, and JIT transcoding; and

[0012] FIG. 3 is a flowchart showing steps according to the present invention for providing metadata during super-encoding.

DETAILED DESCRIPTION

[0013] FIG. 1 is a block diagram of components of a system that provides super-encoding according to embodiments of the present invention. The system includes a super-encoder 100 that is shown receiving an input video to be encoded. The super-encoder 100 performs encoding in a single high resolution format, such as HEVC. Metadata is then generated and placed with the encoded data in the super-encoder to enable transcoding of lower resolution formats, such as MPEG2 or MPEG4. The super-encoded data is then stored in the memory 102 of a network DVR 104.

[0014] The encoded data in the DVR 104 can then be provided directly to a video viewing device from the DVR memory 102 when HEVC is the desired resolution format. When other formats are desired, the encoded data along with metadata is provided from the DVR memory 104 to a JIT transcoder 106. The JIT transcoder 106 uses the metadata to perform transcoding, with the metadata reducing the computational requirements for the transcoding.

[0015] FIG. 2 is a flowchart showing the steps according to the present invention for super-encoding, storage of data in a DVR, and JIT transcoding using the system of FIG. 1. Initially in step 200 unencoded video is received at a super-encoder. In step 202 the video is encoded in a high resolution format, such as HEVC. In step 204 metadata is added to the encoded video to reduce the computational load during transcoding of the lower resolution video, such as MPEG2 or MPEG4. Next in step 206 the encoded data and metadata are stored in the memory of a network DVR.

[0016] The next phase of the flowchart of FIG. 2 illustrates the process when video is requested from the DVR memory. In step 208 a determination is made if the high resolution encoded video is requested from the DVR memory. If the high resolution video, such as HEVC, is requested, in step 210 the encoded video is provided directly from the DVR memory to the requesting player device from the DVR. A determination is further made in step 212 if a lower resolution video is requested. When the lower resolution video is desired, in step 214, the metadata and encoded data from the DVR memory are provided to a JIT transcoder to respond to the request and created the requested lower resolution video. The system can continue to check for requests for either high resolution or lower resolution video and provided the appropriate data in response to hundreds of thousands of requests.

[0017] FIG. 3 is a flowchart showing steps according to the present invention for providing metadata during super-encoding. Initially in the first step 300 the video data is received and encoded in a high resolution format and in step 302 space for metadata is created as part of the encoded video. The metadata is then generated that helps reduce the computational steps during transcoding. For instance, in step 304 the metadata created can be motion vectors. In particular, as step 304 indicates, the motion vectors can be provided when the block size is much smaller or much larger than that provided in the higher resolution mode. In another instance, in step 306, the metadata is generated to provide mode decisions on intra versus inter prediction blocks. Although steps 304 and 306 are illustrative of information that can be provided in metadata to reduce computational steps during transcoding, other information can likewise be provided in the metadata.

[0018] Although a DVR system is described as having a memory for storing the super-encoded data, other memory systems might also be used. For example, another application according to the present invention is in satellite video networks where HEVC can be compressed to minimize bandwidth over the expensive satellite link, and then transcoding provided to MPEG4 or MPEG2 in satellite receivers to be compatible with installed set top boxes. So, like the DVR application, there is a single uplink with encoding and thousands of downlink sites provided from the satellite link. Computational savings we can achieved by doing additional processing at the satellite uplink to reduce the overall cost of the network.

[0019] For each of the components shown, like the super-encoder 100, the DVR 104 and the transcoder 106 of FIG. 1, each component according to embodiments of the present invention can include a processor and memory to enable operation. The memory of each device stores code that is executable by the processor to enable the processor to perform the processes described herein. Further the memory can be used to provide data storage with the data accessible by the processor to store or retrieve when performing operations.

[0020] Although the present invention has been described above with particularity, this was merely to teach one of ordinary skill in the art how to make and use the invention. Many additional modifications will fall within the scope of the invention as that scope is defined by the following claims.