VIDEO DECODER WITH ENHANCED CABAC DECODING

Abstract

A decoder receives a bitstream containing quantized coefficients representative of blocks of video representative of a plurality of pixels and decodes the bitstream using context adaptive binary arithmetic coding. The context adaptive binary arithmetic coding decodes the current syntax element using the first mode if the current syntax element is intra-coded and selecting between a first set of probable modes and a second set of probable modes, where the first set of probable modes are more likely than the second set of probable modes. The context adaptive binary arithmetic coding decodes the current syntax element using the second mode if the current syntax element is intra-coded and if selecting among one of the second set of probable modes.

Claims

1. An encoder for encoding a prediction mode of a current block, wherein the encoder comprises a regular coding engine and a bypass coding engine, the regular coding engine is configured for arithmetic coding using a context, the bypass coding engine is configured for arithmetic encoding with a bypass coding process, and wherein the encoder is configured to: derive the prediction mode of the current block; encode a first indicator using the regular coding engine; encode a second indicator using the bypass coding engine , wherein the prediction mode of the current block is in a set of most probable modes when a value of the first indicator is equal to a first value, wherein the set of most probable modes comprises one or more candidate prediction modes generated according to prediction modes of one or more adjacent blocks of the current block.

2. The encoder of claim 1, wherein the encoder is configured to: encode a third indicator using the bypass coding engine, wherein the prediction mode of the current block is not in a set of most probable modes when a value of the first indicator is equal to a second value, the second value is different from the first value.

3. The encoder of claim 1, wherein the first value is 1.

4. The encoder of claim 2, wherein the second value is 0.

5. A video encoding method for encoding a prediction mode of a current block, wherein the method comprises: deriving the prediction mode of the current block; encoding a first indicator using a regular coding engine; encoding a second indicator using a bypass coding engine, wherein the prediction mode of the current block is in a set of most probable modes, a value of the first indicator is equal to a first value in response to the prediction mode being in the set of most probably modes, and the set of most probable modes comprises one or more candidate prediction modes generated according to prediction modes of one or more adjacent blocks of the current block.

6. A video encoding method for encoding a prediction mode of a current block, wherein the method comprises: deriving the prediction mode of the current block; encoding a first indicator using a regular coding engine; encoding a third indicator using the bypass coding engine, wherein the prediction mode of the current block is not in a set of most probable modes, and a value of the first indicator is equal to a second value in response to the prediction mode of the current block not being in a set of most probable modes.

7. The method of claim 5, wherein the first value is 1.

8. The method of claim 6, wherein the second value is 0.

9. A computer program product, comprising computer executable instructions stored on a non-transitory computer-readable medium, wherein execution of the instructions by a processor causes the processor to: derive the prediction mode of the current block; encode a first indicator using a regular coding engine; encode a second indicator using a bypass coding engine, wherein the prediction mode of the current block is in a set of most probable modes when a value of the first indicator is equal to a first value, wherein the set of most probable modes comprises one or more candidate prediction modes generated according to prediction modes of one or more adjacent blocks of the current block.

10. The computer program product of claim 9, wherein execution of the instructions by a processor causes the processor to: encode a third indicator using the bypass coding engine, wherein the prediction mode of the current block is not in a set of most probable modes when a value of the first indicator is equal to a second value, the second value is different from the first value.

11. The computer program product of claim 9, wherein the first value is 1.

12. The computer program product of claim 10, wherein the second value is 0.

Description

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

[0015] FIG. 1 illustrates an encoder and a decoder.

[0016] FIG. 2 illustrates an encoder.

[0017] FIG. 3 illustrates a decoder.

[0018] FIG. 4 illustrates context decoding for CABAC.

[0019] FIG. 5 illustrates bypass decoding for CABAC.

[0020] FIG. 6 illustrates a bitstream with a subset of symbols coded using a bypass coding mode and another subset of symbols coded using regular coding mode.

[0021] FIG. 7 illustrates a decoding technique with a bypass decoding mode and a regular decoding mode.

[0022] FIG. 8 illustrates a decoding technique for symbols of a block having a syntax element type corresponding to being intra encoded.

[0023] FIG. 9 illustrates a CABAC based encoder.

[0024] FIG. 10 illustrates a CABAC based decoder.

DETAILED DESCRIPTION

[0025] Referring to FIG. 2, an exemplary encoder 200 includes an entropy coding block 260, which may include a CABAC, receives inputs from several different other aspects of the encoder 200. One of the inputs to the entropy coding block 260 is SAO information from a sample adaptive offset (SAO) block 235. Another of the inputs to the entropy coding block 260 is ALF information from an adaptive loop filter 245. Another of the inputs to the entropy coding block 260 is inter mode information from a motion estimation/motion compensation (ME/MC) block 230. Another of the inputs to the entropy coding block 260 is intra mode information from an intra prediction block 270. Another of the inputs to the entropy coding block 260 are residues from a quantization block 310. The entropy coding block 260 provides an encoded bitstream. This information provided to the entropy coding block 260 may be encoded in the bitstream. The SAO block 235 provide samples to the adaptive loop filter 245 which provides restored samples 225 to a reference frame buffer 220 which provides data to the motion estimation/motion compensation (ME/MC) block 230. Deblocked samples 240 from a deblocking filter 250 are provided to the SAO block 235. As with many encoders, the encoder may further include the intra-prediction block 270 where predicted samples 280 are selected between the intra prediction block 270 and the ME/MC block 230. A subtractor 290 subtracts the predicted samples 280 from the input. The encoder 200 also may include a transform block 300, an inverse quantization block 320, an inverse transform block 330, and a reconstruction block 340.

[0026] Referring to FIG. 3, an associated decoder 400 for the encoder of FIG. 2 may include an entropy decoding block 450, which may include a CABAC. The entropy decoding block 450 receives an encoded bitstream 440 and provides data to different aspects of the decoder 400. The entropy decoding block 450 may provide intra mode information 455 to an intra prediction block 460. The entropy decoding block 450 may provide inter mode information 465 to the MC block 430. The entropy decoding block 450 may provide ALF information 495 to the adaptive loop filter 415. The entropy decoding block 450 may provide SAO information 475 to the SAO block 410. The entropy decoding block 450 may provide coded residues 485 to an inverse quantization block 470, which provides data to an inverse transform block 480, which provides data to a reconstruction block 490, which provides data to the intra prediction block 460 and/or a deblocking filter 500. The sample adaptive offset (SAO) block 410 that provides samples to an adaptive loop filter 415 which provides restored samples 445 to a reference frame buffer 420 which provides data to the motion compensation (MC) block 430. The deblocking filter 500 provides deblocked samples 510 to the SAO block 410.

[0027] Referring to FIG. 4, a graphical illustration is shown of selecting a probability model when using a CABAC regular decoding engine to decode a bin 570 and using neighboring contexts. The context is determined as a function of the decoded symbol CtxtA 572 and decoded symbol CtxtB 574, where CtxtA was stored in a line buffer 576. The context determines the probability model used to decode 570. In contrast, referring to FIG. 5, a graphical illustration is shown of selecting a probability mode when using a CABAC bypass decoding engine to decode a symbol 580. The selected probability mode does not depend on context information. Referring to FIG. 6, a bitstream 590 includes a set of binarized syntax elements 592 coded using the bypass coding engine, and a set of binarized syntax elements 594 coded using the regular coding engine and therefore requiring probability model updates in the CABAC. As it may be observed, the requirement for a line buffer is eliminated when using the bypass coding mode, the amount of memory required is reduced, the probability model update is not performed, and the throughput of the CABAC is increased.

[0028] The CABAC decodes the video based upon a complex set of potential encoding configurations. For example, the coding configurations may include motion compensated blocks and intra-prediction blocks. The encoding and decoding of motion compensated blocks of video tend to be relatively complicated and tend to generally benefit from the added complexity afforded by the CABAC regular coding engine. Part of the complexity, in addition to the decoding technique, is the storing of information on which the symbols depends and the need for updating the probability model mechanism each time a symbol is encoded and/or decoded. The encoding and decoding of intra predicted blocks of video tend to be relatively less complicated and tend to generally benefit to a lesser degree from the added complexity afforded by the CABAC regular coding engine. In this case, the bypass coding mode tends to reduce the need for additional storage, determining the context, and the updating of the probability model, without meaningfully impacting compression efficiency. In particular, some symbols in the bitstream are generally equally likely to contain bins with values of 0 or 1 after binarization. Moreover, at the same time such symbols do not result in meaningful compression benefits due to the context adaptation of the CABAC regular coding engine. It is speculated that this lack of meaningful compression benefits is likely due to rapid fluctuations in their probability distribution.

[0029] Referring to FIG. 7, in one embodiment the CABAC, which may be included as part of the entropy decoding 450 of the decoder 400, receives bits originating in the bitstream 600. For those syntax elements, or symbols, belonging to a block which was intra coded 610, it may be determined, whether the particular symbol is suitable to use the bypass decoding engine 620, if the impact on coding efficiency does not justify the additional computational complexity. If the syntax element, or symbol, belonging to an intra coded block 610 is suitable for using the bypass decoding engine, then the binarized symbol is decoded using the bypass decoding mode 630. If the syntax element, or symbol, belonging to an intra coded block 610 is not suitable for using the bypass decoding engine, then the binarized symbol is decoded using the regular decoding mode 640.

[0030] Referring to FIG. 8, the CABAC may receive a symbol 570 to be decoded from the bitstream. A symbol 574 belonging to a block to the left of the current block has previously been decoded and the prediction mode for the left block has been determined as Mleft 650, where prediction mode identifies a method for predicting the pixel values within a block using previously decoded data. Similarly, a symbol 572 belonging to a block above the current block has previously been decoded and the prediction mode for the above block has been determined as Mabove 652. In most situations, the prediction mode for the current block is not expressly transmitted in the bitstream, but is instead determined based upon a likelihood of previously determined prediction modes, such as Mleft and Mabove, as previously described. Accordingly, a function generates a list of probable modes using ƒ (Mleft, Mabove) 654 based upon the Mleft 650 and the Mabove 652, which may be referred to as Mlist=ƒ(Mleft, Mabove). The result is a list of probable modes Mlist 656.

[0031] In one embodiment, the list of probable modes Mlist 656 generated by the function generate list of most probable modes using ƒ (Mleft, Mabove) 654 may include two lists of prediction modes (or otherwise combined in a single list), a first list including the “most probable modes” and a second list including the “not most probable modes”. From the bitstream the system may select MPM_FLAG bits 655, which indicate a suitability for using the regular decoding engine 657, and therefore a syntax element, such as MPM_FLAG 660, indicating whether the prediction mode for the current block is in the “most probable mode list” (typically signaled with a “1”) or is in the “not most probable mode list” (typically signaled with a “0”). A comparison 658 with the MPM_FLAG 660 for the current block may be used to determine whether the suitable prediction mode is in the “most probable mode list” 662 or in the “not most probable mode list” 664. In the event that the MPM_FLAG 660 for the current block indicates that the prediction mode is in the “most probable mode list” 662, and in the event that there exists only a single prediction mode in the “most probable mode list”, then that is a selected prediction mode 674 for the current block. The results of the selected prediction mode 674 is provide as a selected mode 675 as the output. In the event that the MPM_FLAG 660 for the current block indicates that the prediction mode is in the “most probable mode list” 662, and in the event that there exists only two prediction modes in a “most probable mode list” index, then a MPM_INDEX index 670 may be used to signal the selected prediction mode 674 to select between the two prediction modes and provide the selected mode 675 as an output. The MPM_INDEX index 670 may be determined by the system from the bitstream by selecting MPM_INDEX bits 671, which indicate a suitability for using the bypass decoding engine 673, and therefore provide the MPM_Index index 670. This process of selecting among the entries of the “most probable mode list” 662 may be expanded with additional bit allocation to MPM_INDEX index 670 to distinguish between additional different modes.

[0032] As noted, based upon the past bins in the bitstream, the CABAC may determine the probability that the current bin will be a “1” or a “0”. The selection between the “within the most probable list” and “not within the most probable list”, is a decision that has a meaningful impact on the coding efficiency of the CABAC, and accordingly having an updated probability is beneficial.

[0033] In the event that the MPM_FLAG 660 for the current block indicates that the prediction mode is in the “not most probable mode list” 664, and in the event that there exists only a single prediction mode in the “not most probable mode list” 664, then that is a selected prediction mode 680 for the current block. In the event that the MPM_FLAG 660 for the current block indicates that the prediction mode is in the “not most probable mode list” 664, and in the event that there exists only two prediction modes in a “not most probable mode list” index, then a REM_INTRA_PRED_MODE index 690 may be used to signal to the selected prediction mode 680 to select between the two prediction modes and provide the selected prediction mode 675 as an output. The REM_INTRA_PRED_MODE index 690 may be determined by the system from the bitstream by selecting REM_INTRA_PRED_MODE bits 691, which indicate a suitability for using the bypass decoding engine 693, and therefore provide the REM_INTRA_PRED_MODE index 690. In the event that the MPM_FLAG 660 for the current block indicates that the prediction mode is in the “not most probable mode list” 664, and in the event that there exists only four prediction modes in a “not most probable mode list” index, then a 2-bit REM_INTRA_PRED_MODE index 690 may be used to signal to the selected prediction mode 680 to select between the four prediction modes and provide the selected mode 675 as an output. In the event that the MPM_FLAG 660 for the current block indicates that the prediction mode is in the “not most probable mode list”, and in the event that there exists only eight prediction modes in the “not most probable mode list” index, then a 3-bit REM_INTRA_PRED_MODE index 690 may be used to signal to the selected prediction mode 680 to select between the eight prediction modes and provide the selected mode 675 as an output. This process of selecting modes from the not most probable mode list may be expanded with additional bit allocation to REM_INTRA_PRED_MODE index to distinguish between the different prediction modes.

[0034] As noted, based upon the past bins in the bitstream, the CABAC may determine the probability that the current bin will be a “1” or a “0”. As previously noted, the selection between the “most probable mode list” and the “not within the most probable mode list”, is a decision that has a meaningful impact on the coding efficiency of the CABAC, and accordingly having an updated probability is beneficial. However, the selection among the possibilities within the “not most probable mode list” 664 has limited impact on the coding efficiency of the CABAC, and accordingly the probabilities should not be updated, thus reducing the computational complexity of the system. In most cases, the probability assigned to a particular binarized symbol that is not updated is 50%.

[0035] Referring to FIG. 9, an exemplary CABAC based encoder receives syntax elements values 700 that are normally non-binary. A binarizer 710 receives the syntax elements values 700 and based upon the syntax element type 720 generates a binary string 730. The syntax element type 720 may signal, for example, the input value corresponding to an index term derived for the current block's intra prediction mode; or the input value corresponds to a flag derived for the current block's intra prediction mode. A selector 740 selects whether to use a bypass encoding engine 750 or a regular encoding engine 760 based upon one or more inputs. One of the inputs to the selector 740 may include the syntax element type 720. Another of the inputs to the selector 740 may include a slice type 770. The slice type 770 may include, for example, an I-slice (intra-predicted slice), a P-slice (forward predicted slice), and/or a B-slice (a bi-directional predicted slice). Another of the inputs to the selector 740 may be a quantization parameter 780. For example, the statistical behavior of the binarized syntax element value may change based upon the quantization parameter, which is often related to the bit rate of the bitstream. Another one of the inputs to the selector 740 may be collected statistics 790 from the resulting bitstream 800. The collected statistics 790 facilitates the modification of the manner of encoding based upon the bitstream to further improve the encoding efficiency. If the selector 740 selects the bypass encoding mode 810, based upon one or more of the inputs, then the binary string 730 is encoded using the bypass encoding engine 750 to generate the bitstream 800. If the selector 740 selects the regular encoding mode 820, based upon one or more of the inputs, then the binary string 730 is provided to the regular encoding engine 760, this engine is the arithmetic encoder. Additionally the current probability estimate 850 is provided as input to the regular encoding engine by a context modeler 830 based upon spatially and/or temporally adjacent syntax elements 840 and binary symbols encoded in the past. The regular encoding engine 760 generates the bitstream 800. The output of the regular encoding engine 760 is used to update the probability of the context modeler 830. The selector 740 may also be used to indicate which coded bits should be included in the bitstream 800.

[0036] Referring to FIG. 10, the bitstream 800 may be received by a CABAC based decoder. A selector 810 selects whether to use a bypass decoding engine 820 or a regular decoding engine 830 based upon one or more inputs from the bitstream 800. One of the inputs to the selector 810 may include the syntax element type 720. Another one of the inputs to the selector 810 may include the slice type 770. Another one of the inputs to the selector 810 may be the quantization parameter 780. Another one of the inputs to the selector 810 may be the collected statistics 790. If the selector 810 selects the bypass decoding mode 840, based upon one or more of the inputs, then the bitstream 800 is decoded using the bypass decoding engine 820 to generate binary decoded bits 850. If the selector 810 selects the regular decoding mode 860, based upon one or more of the inputs, then the bitstream 800 is provided to the regular decoding engine 830, this engine is the arithmetic decoder. Additionally the current probability estimate 875 is provided as input to the regular decoding engine by a context modeler 870 based upon spatially and/or temporally adjacent syntax element values 880. The regular decoding engine 830 generates binary decoded bits 890. The output of the regular decoding engine 830 is used to update the probability of the context modeler 870. The selector 810 may also be used to indicate which binary decoded bits 850, 890 should be provided to a debinarizer 900. The debinarizer 900 receives the binary decoded input, together with the syntax element type 720, and provides non-binary syntax element values 910.

[0037] The terms and expressions which have been employed in the foregoing specification are used therein as terms of description and not of limitation, and there is no intention, in the use of such terms and expressions, of excluding equivalents of the features shown and described or portions thereof, it being recognized that the scope of the invention is defined and limited only by the claims which follow.