Video encoding device, video decoding device, video encoding method, video decoding method, and program restricts inter-prediction unit partitions based on coding unit depth

Abstract

A video encoding device for encoding video using inter prediction includes encoding control means 11 for controlling an inter-PU partition type of a CU to be encoded, based on a minimum inter-PU size (PA) and a CU size (PB) of the CU to be encoded. A video decoding device includes decoding control means for controlling an inter-PU partition of a CU to be decoded, based on the minimum inter-PU size (PA) and the size (PB) of the CU to be decoded.

Claims

1. A video encoding device for encoding video using inter prediction, comprising: at least one memory storing instructions; and at least one processor configured to process the instructions to: set a PU (Prediction Unit) partition type indicating a splitting pattern of a CU (Coding Unit) to be encoded to an inter-PU partition type whose size is greater than N×N corresponding to a half of a size of the CU, the size being a length of one side of the CU, based on the size of the CU to be encoded being equal to a minimum inter-PU size; and set the PU partition type to an intra-PU partition type, based on the size of the CU to be encoded being less than the minimum inter-PU size.

2. A video encoding method for encoding video using inter prediction, comprising: controlling to set a PU (Prediction Unit) partition type indicating a splitting pattern of a CU (Coding Unit) to be encoded to an inter-PU partition type whose size is greater than N×N corresponding to a half of a size of the CU, the size being a length of one side of the CU, based on the size of the CU to be encoded being equal to a minimum inter-PU size; and setting the PU partition type to an intra-PU partition type, based on the size of the CU to be encoded being less than the minimum inter-PU size.

3. A non-transitory computer readable information recording medium storing a video encoding program for encoding video using inter prediction, when executed by a processor, performs a method for: controlling to set a PU (Prediction Unit) partition type indicating a splitting pattern of a CU (Coding Unit) to be encoded to an inter-PU partition type whose size is greater than N×N corresponding to a half of a size of the CU, the size being a length of one side of the CU, based on the size of the CU to be encoded being equal to a minimum inter-PU size; and setting the PU partition type to an intra-PU partition type, based on the size of the CU to be encoded being less than the minimum inter-PU size.

4. A video decoding device for decoding video using inter prediction, comprising: at least one memory storing instructions; and at least one processor configured to process the instructions to: set a PU (Prediction Unit) partition type indicating a splitting pattern of a CU (Coding Unit) to be decoded to an inter-PU partition type whose size is greater than N×N corresponding to a half of a size of the CU, the size being a length of one side of the CU, based on the size of the CU to be decoded being equal to a minimum inter-PU size; and set the PU partition type to an intra-PU partition type, based on the size of the CU to be encoded being less than the minimum inter-PU size.

5. A video decoding method for decoding video using inter prediction, comprising: controlling to set a PU (Prediction Unit) partition type indicating a splitting pattern of a CU (Coding Unit) to be decoded to an inter-PU partition type whose size is greater than N×N corresponding to a half of a size of the CU, the size being a length of one side of the CU, based on the size of the CU to be decoded being equal to a minimum inter-PU size; and controlling to set the PU partition type to an intra-PU partition type, based on the size of the CU to be encoded being less than the minimum inter-PU size.

6. A non-transitory computer readable information recording medium storing a video decoding program for decoding video using inter prediction, when executed by a processor, performs a method for: controlling to set a PU (Prediction Unit) partition type indicating a splitting pattern of a CU (Coding Unit) to be decoded to an inter-PU partition type whose size is greater than N×N corresponding to a half of a size of the CU, the size being a length of one side of the CU, based on the size of the CU to be decoded being equal to a minimum inter-PU size; and controlling to set the PU partition type to an intra-PU partition type, based on the size of the CU to be encoded being less than the minimum inter-PU size.

7. The video encoding device of claim 1, wherein the at least one processor is further configured to process the instructions to: entropy encode the CU.

8. The video encoding device of claim 1, wherein the at least one processor is further configured to process the instructions to: entropy encode the CU; and generate a bitstream comprising the encoded CU.

9. The video encoding device of claim 1, wherein the at least one processor is further configured to process the instructions to: entropy encode the CU; and generate a bitstream comprising the encoded CU and information indicating the minimum inter-PU size.

10. The video encoding device of claim 1, wherein the at least one processor is further configured to process the instructions to: select the inter-PU partition type from among candidate inter-PU partition types, the candidate inter-PU partition types comprising an N×N size candidate, based on the size of the CU to be encoded being greater than the minimum inter-PU size.

11. The video encoding device of claim 1, wherein the at least one processor is further configured to process the instructions to: set the inter-PU partition type to the inter-PU partition type whose size is greater than N×N corresponding to a half of a size of the CU based on a determination that the size of the CU to be encoded is equal to a minimum inter-PU size.

12. The video decoding device of claim 4, wherein the at least one processor is further configured to process the instructions to: decode the CU.

13. The video decoding device of claim 4, wherein the at least one processor is further configured to process the instructions to: obtain a bitstream comprising the CU to be decoded.

14. The video decoding device of claim 4, wherein the at least one processor is further configured to process the instructions to: obtain a bitstream comprising the CU to be decoded and information indicating the minimum inter-PU size; and decode the CU.

15. The video decoding device of claim 4, wherein the at least one processor is further configured to process the instructions to: select the inter-PU partition type from among candidate inter-PU partition types, the candidate inter-PU partition types comprising an N×N size candidate, based on the size of the CU to be encoded being greater than the minimum inter-PU size.

16. The video decoding device of claim 4, wherein the at least one processor is further configured to process the instructions to: set the inter-PU partition type to the inter-PU partition type whose size is greater than N×N corresponding to a half of a size of the CU based on a determination that the size of the CU to be encoded is equal to a minimum inter-PU size.

Description

BRIEF DESCRIPTION OF DRAWINGS

(1) FIG. 1 is a block diagram of a video encoding device in Exemplary Embodiment 1.

(2) FIG. 2 is a flowchart showing a process of determining PU partition type candidates.

(3) FIG. 3 is an explanatory diagram of a list indicative of information on the minimum inter-PU size in a sequence parameter set.

(4) FIG. 4 is a flowchart showing a PU header writing operation.

(5) FIG. 5 is an explanatory diagram of a list indicative of information on inter_partitioning_idc syntax in a PU syntax.

(6) FIG. 6 is a block diagram of a video decoding device in Exemplary Embodiment 2.

(7) FIG. 7 is a flowchart showing a PU header parsing operation.

(8) FIG. 8 is an explanatory diagram of a list indicative of information on the minimum inter-PU size in a picture parameter set.

(9) FIG. 9 is an explanatory diagram of a list indicative of information on the minimum inter-PU size in a slice header.

(10) FIG. 10 is a block diagram of a video decoding device in Exemplary Embodiment 4.

(11) FIG. 11 is a flowchart showing an error detection operation.

(12) FIG. 12 is a block diagram showing a configuration example of an information processing system capable of implementing the functions of a video encoding device and a video decoding device according to the present invention.

(13) FIG. 13 is a block diagram showing a main part of a video encoding device according to the present invention.

(14) FIG. 14 is a block diagram showing a main part of a video decoding device according to the present invention.

(15) FIG. 15 is a block diagram of a typical video encoding device.

(16) FIG. 16 is an explanatory diagram showing an example of block division.

(17) FIG. 17 is an explanatory diagram for describing intra prediction of Intra_4×4 and Intra_8×8.

(18) FIG. 18 is an explanatory diagram for describing intra prediction of Intra_16×16.

(19) FIG. 19 is an explanatory diagram showing an example of inter prediction.

(20) FIG. 20 is an explanatory diagram showing interpolation processing for luminance signals in motion-compensated prediction.

(21) FIG. 21 is a block diagram of a typical video decoding device.

(22) FIG. 22 is an explanatory diagram for describing a CTB.

(23) FIG. 23 is an explanatory diagram for describing a PU.

(24) FIG. 24 is an explanatory diagram for describing decimal pixel positions.

(25) FIG. 25 is an explanatory diagram for describing a decimal pixel generation method using a twelve-tap filter in a TMuC scheme.

(26) FIG. 26 is an explanatory diagram for describing a memory access range when a decimal pixel is generated using the twelve-tap filter.

DESCRIPTION OF EMBODIMENTS

(27) In order to solve the technical problems of the above-mentioned typical techniques, the present invention restricts inter-PU partitions based on the CU depth (i.e. CU size) in video encoding using hierarchical coding units to solve the problems. In an example of the present invention, the CU size capable of using inter-PU partitions other than 2N×2N is restricted to solve the problems. In another example of the present invention, transmission of an inter-PU partition type syntax in a PU header is restricted to solve the problems. In the above example of the present invention, the ratio of the number of bits of the inter-PU partition type syntax included in a bitstream can be kept low to suppress the memory bandwidth while improving the quality of compressed video.

Exemplary Embodiment 1

(28) Exemplary Embodiment 1 shows a video encoding device including: encoding control means for controlling an inter-PU partition type based on a predetermined minimum inter-PU size set from the outside; and means for embedding, in a bitstream, information on the minimum inter-PU size to signal the information on the minimum inter-PU size to a video decoding device.

(29) In this exemplary embodiment, it is assumed that available CU sizes are 128, 64, 32, 16, and 8 (i.e., the LCU size is 128 and the SCU size is 8), and the minimum inter-PU size (minInterPredUnitSize) is 8.

(30) It is further assumed in the exemplary embodiment that the information on the minimum inter-PU size (min_inter_pred_unit_hierarchy_depth) is base-2 log (logarithm) of a value obtained by dividing the minimum inter-PU size (8) by the SCU size (8). Thus, in the exemplary embodiment, the value of min_inter_pred_unit_hierarchy_depth multiplexed into the bitstream is 0 (=log.sub.2(8/8)).

(31) As shown in FIG. 1, the video encoding device in the exemplary embodiment includes a transformer/quantizer 101, an entropy encoder 102, an inverse transformer/inverse quantizer 103, a buffer 104, a predictor 105, a multiplexer 106, and an encoding controller 107, like the typical video encoding device shown in FIG. 15.

(32) The video encoding device in the exemplary embodiment shown in FIG. 1 differs from the video encoding device shown in FIG. 15 in that minInterPredUnitSize is supplied to the encoding controller 107 to transmit an inter-PU partition type syntax in a CU size greater than minInterPredUnitSize, and minInterPredUnitSize is also supplied to the multiplexer 106 to signal minInterPredUnitSize to the video decoding device.

(33) The encoding controller 107 has the predictor 105 calculate a cost (Rate-Distortion cost: R-D cost) calculated from a coding distortion (the energy of an error image between an input signal and a reconstructed picture) and a generated bit count. The encoding controller 107 determines a CU splitting pattern in which the R-D cost is minimized (the splitting pattern determined by split_coding_unit_flag as shown in FIG. 22), and prediction parameters of each CU. The encoding controller 107 supplies determined split_coding_unit_flag and the prediction parameters of each CU to the predictor 105 and the entropy encoder 102. The prediction parameters are information associated with prediction of a CU to be encoded, such as prediction mode (pred_mode), intra-PU partition type (intra_split_flag), intra prediction direction, inter-PU partition type (inter_partitioning_idc), and motion vector.

(34) As an example, the encoding controller 107 in the exemplary embodiment selects the optimum PU partition type as a prediction parameter for a CU whose size is greater than minInterPredUnitSize from a total of ten types of intra prediction {2N×2N, N×N}, and inter prediction {2N×2N, 2N×N, N×2N, N×N, 2N×nU, 2N×nD, nL×2N, nR×2N}. For a CU whose size is equal to minInterPredUnitSize, the encoding controller 107 selects the optimum PU partition type as a prediction parameter from a total of three types of intra prediction {2N×2N, N×N} and inter prediction {2N×2N}. For a CU whose size is less than minInterPredUnitSize, the encoding controller 107 selects the optimum PU partition type as a prediction parameter from two types of intra prediction {2N×2N, N×N}.

(35) FIG. 2 is a flowchart showing the operation of the encoding controller 107 in the exemplary embodiment to determine PU partition type candidates.

(36) As shown in FIG. 2, when determining in step S101 that the CU size of a CU to be encoded is greater than minInterPredUnitSize, the encoding controller 107 sets PU partition type candidates in step S102 to a total of ten types of intra prediction {2N×2N, N×N} and inter prediction {2N×2N, 2N×N, N×2N, N×N, 2N×nU, 2N×nD, nL×2N, nR×2N}, and determines in step S106 a prediction parameter based on the R-D cost.

(37) When determining in step S101 that the CU size of the CU to be encoded is less than or equal to minInterPredUnitSize, the encoding controller 107 proceeds to step S103.

(38) When determining in step S103 that the CU size of the CU to be encoded is equal to minInterPredUnitSize, the encoding controller 107 sets PU partition type candidates in step S104 to a total of three types of intra prediction {2N×2N, N×N} and inter prediction {2N×2N}, and determines in step S106 a prediction parameter based on the R-D cost.

(39) When determining in step S103 that the CU size of the CU to be encoded is less than minInterPredUnitSize, the encoding controller 107 sets PU partition type candidates in step S105 to two types of intra prediction {2N×2N, N×N}, and determines in step S106 the optimum PU partition type as a prediction parameter based on the R-D cost.

(40) The predictor 105 selects a prediction signal corresponding to the prediction parameters of each CU determined by the encoding controller 107.

(41) The prediction signal supplied from the predictor 105 is subtracted from input video of each CU in a shape determined by the encoding controller 107 to generate a prediction error image, and the prediction error image is input to the transformer/quantizer 101.

(42) The transformer/quantizer 101 frequency-transforms the prediction error image to obtain a frequency transform coefficient.

(43) The transformer/quantizer 101 further quantizes the frequency transform coefficient with a predetermined quantization step width Qs to obtain a transform quantization value.

(44) The entropy encoder 102 entropy-encodes split_coding_unit_flag (see FIG. 22) supplied from the encoding controller 107, the prediction parameters, and the transform quantization value supplied from the transformer/quantizer 101.

(45) The inverse transformer/inverse quantizer 103 inverse-quantizes the transform quantization value with the predetermined quantization step width Qs. The inverse transformer/inverse quantizer 103 further performs inverse frequency transform of the frequency transform coefficient obtained by the inverse quantization. The prediction signal is added to the reconstructed prediction error image obtained by the inverse frequency transform, and the result is supplied to the buffer 104.

(46) The multiplexer 106 multiplexes and outputs the information on the minimum inter-PU size (min_inter_pred_unit_hierarchy_depth) and output data of the entropy encoder 102. According to 4.1.2 Sequence parameter set RBSP syntax in NPL 2, the multiplexer 106 multiplexes log 2_min_coding_unit_size_minus3 syntax and min_inter_pred_unit_hierarchy_depth syntax after max_coding_unit_hierarchy_depth syntax in a sequence parameter set as listed in FIG. 3 (base-2 log (logarithm) of a value obtained by dividing minInterPredUnitSize by the SCU size, i.e. 0 in the exemplary embodiment). The log 2_min_coding_unit_size_minus3 syntax and the max_coding_unit_hierarchy_depth syntax are information for determining an SCU size (minCodingUnitSize) and an LCU size (maxCodingUnitSize), respectively. MinCodingUnitSize and maxCodingUnitSize are respectively calculated as follows.
minCodingUnitSize=1<<(log 2_min_coding_unit_size_minus3+3)
maxCodingUnitSize=1<<(log 2_min_coding_unit_size_minus3+3+max_coding_unit_hierarchy_depth)

(47) The min_inter_pred_unit_hierarchy_depth syntax and minCodingUnitSize have the following relation.
min_inter_pred_unit_hierarchy_depth=log.sub.2(minInterPredUnitSize/minCodingUnitSize)

(48) Based on the operation described above, the video encoding device according to this invention generates a bitstream.

(49) Based on a predetermined minimum inter-PU size and a CU size of a CU to be encoded, the video encoding device in the exemplary embodiment controls the inter-PU partition of the CU to be encoded so that no inter PU the size of which is less than the minimum inter-PU size will not come into existence.

(50) The memory bandwidth is reduced by preventing any inter PU the size of which is less than the minimum inter-PU size from coming into existence. Further, since the number of inter-PU partition type syntaxes to be signaled is reduced by preventing any inter PU the size of which is less than the minimum inter-PU size from coming into existence, the percentage of the amount of code of a PU header in the bitstream is reduced, and hence the quality of video is improved.

(51) The encoding control means in the video encoding device of the exemplary embodiment controls inter-PU partitions based on the predetermined minimum inter-PU size set from the outside. As an example, the encoding control means controls inter-PU partition types other than 2N×2N to be used only in CUs of CU sizes greater than a predetermined size. Therefore, since the probability of occurrence of the 2N×2N inter-PU partition increases to reduce entropy, the efficiency of entropy-encoding is improved. Thus, the quality of compressed video can be maintained while reducing the memory bandwidth.

(52) Likewise, for video decoding, the video encoding device in the exemplary embodiment includes means for embedding, in a bitstream, information on the predetermined minimum inter-PU size set from the outside so that the inter-PU partition type syntax can be parsed from the bitstream. Thus, since the predetermined size is signaled to the video decoding device, the interoperability of the video encoding device and the video decoding device can be enhanced.

Exemplary Embodiment 2

(53) A video encoding device in Exemplary Embodiment 2 includes: encoding control means for controlling an inter-PU partition type based on a predetermined minimum inter-PU size set from the outside and for controlling entropy-encoding of an inter-PU partition type syntax based on the above predetermined minimum inter-PU size; and means for embedding, in a bitstream, information on the minimum inter-PU size to signal the information on the above minimum inter-PU size to a video decoding device.

(54) In this exemplary embodiment, it is assumed that the CU size of a CU to transmit the inter-PU partition type syntax is greater than the above minimum inter-PU size (minInterPredUnitSize). It is also assumed in the exemplary embodiment that available CU sizes are 128, 64, 32, 16, and 8 (i.e., the LCU size is 128 and the SCU size is 8), and minInterPredUnitSize is 8. Thus, in the exemplary embodiment, the CU sizes for embedding the inter-PU partition type syntax in the bitstream are 128, 64, 32, and 16.

(55) It is further assumed in the exemplary embodiment that information on the minimum inter-PU size (min_inter_pred_unit_hierarchy_depth) is base-2 log (logarithm) of a value obtained by dividing the minimum inter-PU size (8) by the SCU size (8). Thus, in the exemplary embodiment, the value of min_inter_pred_unit_hierarchy_depth multiplexed into the bitstream is 0(=log.sub.2(8/8)).

(56) The structure of the video encoding device in the exemplary embodiment is the same as the structure of the video encoding device in Exemplary Embodiment 1 shown in FIG. 1.

(57) As shown in FIG. 1, the video encoding device in this exemplary embodiment differs from the video encoding device shown in FIG. 15 in that minInterPredUnitSize is supplied to the encoding controller 107 to transmit an inter-PU partition type syntax in a CU size greater than minInterPredUnitSize, and minInterPredUnitSize is also supplied to the multiplexer 106 to signal minInterPredUnitSize to the video decoding device.

(58) The encoding controller 107 has the predictor 105 calculate the R-D cost calculated from a coding distortion (the energy of an error image between an input signal and a reconstructed picture) and a generated bit count. The encoding controller 107 determines a CU splitting pattern in which the R-D cost is minimized (the splitting pattern determined by split_coding_unit_flag as shown in FIG. 22), and prediction parameters of each CU. The encoding controller 107 supplies the determined split_coding_unit_flag and prediction parameters of each CU to the predictor 105 and the entropy encoder 102. The prediction parameters are information associated with prediction of a CU to be encoded, such as prediction mode (pred_mode), intra-PU partition type (intra_split_flag), intra prediction direction, inter-PU partition type (inter_partitioning_idc), and motion vector.

(59) Like in Exemplary Embodiment 1, the encoding controller 107 in the exemplary embodiment selects the optimum PU partition type as a prediction parameter for a CU whose size is greater than minInterPredUnitSize from a total of ten types of intra prediction {2N×2N, N×N} and inter prediction {2N×2N, 2N×N, N×2N, N×N, 2N×nU, 2N×nD, nL×2N, nR×2N}. For a CU whose size is equal to minInterPredUnitSize, the encoding controller 107 selects the optimum PU partition type as a prediction parameter from a total of three types of intra prediction {2N×2N, N×N} and inter prediction {2N×2N}. For a CU whose size is less than minInterPredUnitSize, the encoding controller 107 selects the optimum PU partition type as a prediction parameter from intra prediction {2N×2N, N×N}.

(60) When the prediction mode of a CU to be entropy-encoded is inter prediction and the CU size is less than or equal to minInterPredUnitSize, the encoding controller 107 in the exemplary embodiment controls the entropy encoder 102 not to entropy-encode inter_partitioning_idc.

(61) The predictor 105 selects a prediction signal corresponding to the prediction parameters of each CU determined by the encoding controller 107.

(62) The prediction signal supplied from the predictor 105 is subtracted from input video of each CU in a shape determined by the encoding controller 107 to generate a prediction error image, and the prediction error image is input to the transformer/quantizer 101.

(63) The transformer/quantizer 101 frequency-transforms the prediction error image to obtain a frequency transform coefficient.

(64) The transformer/quantizer 101 further quantizes the frequency transform coefficient with a predetermined quantization step width Qs to obtain a transform quantization value.

(65) The entropy encoder 102 entropy-encodes split_coding_unit_flag (see FIG. 22) supplied from the encoding controller 107, the prediction parameters, and the transform quantization value supplied from the transformer/quantizer 101. As mentioned above, when the prediction mode of a CU to be entropy-encoded is inter prediction and the CU size is less than or equal to minInterPredUnitSize, the entropy encoder 102 in the exemplary embodiment does not entropy-encode inter_partitioning_idc.

(66) The inverse transformer/inverse quantizer 103 inverse-quantizes the transform quantization value with the predetermined quantization step width Qs. The inverse transformer/inverse quantizer 103 further performs inverse frequency transform of the frequency transform coefficient obtained by the inverse quantization. The prediction signal is added to the reconstructed prediction error image obtained by the inverse frequency transform, and the result is supplied to the buffer 104.

(67) The multiplexer 106 multiplexes and outputs the information on the minimum inter-PU size (min_inter_pred_unit_hierarchy_depth) and output data of the entropy encoder 102. According to 4.1.2 Sequence parameter set RBSP syntax in NPL 2, the multiplexer 106 multiplexes log 2 min_coding_unit_size_minus3 syntax and min_inter_pred_unit_hierarchy_depth syntax after max_coding_unit_hierarchy_depth syntax in a sequence parameter set as listed in FIG. 3 (base-2 log (logarithm) of a value obtained by dividing minInterPredUnitSize by the SCU size, i.e. 0 in the exemplary embodiment). The log 2 min_coding_unit_size_minus3 syntax and the max_coding_unit_hierarchy_depth syntax are information for determining an SCU size (minCodingUnitSize) and an LCU size (maxCodingUnitSize), respectively. MinCodingUnitSize and maxCodingUnitSize are respectively calculated as follows.
minCodingUnitSize=1<<(log 2_min_coding_unit_size_minus3+3)
maxCodingUnitSize=1<<(log 2_min_coding_unit_size_minus3+3+max_coding_unit_hierarchy_depth)

(68) The min_inter_pred_unit_hierarchy_depth syntax and minCodingUnitSize have the following relation.
min_inter_pred_unit_hierarchy_depth=log.sub.2(minInterPredUnitSize/minCodingUnitSize)

(69) Based on the operation described above, the video encoding device in the exemplary embodiment generates a bitstream.

(70) Referring next to a flowchart of FIG. 4, description is made of an operation of writing the inter-PU partition type syntax that is a feature of the exemplary embodiment.

(71) As shown in FIG. 4, the entropy encoder 102 entropy-encodes split_coding_unit_flag in step S201. The entropy encoder 102 further entropy-encodes the prediction mode in step S202, i.e., the entropy encoder 102 entropy-encodes pred_mode syntax. When determining in step S203 that the prediction mode of a CU to be encoded is inter prediction and determining in step S204 that the CU size is less than or equal to minInterPredUnitSize, the encoding controller 107 controls the entropy encoder 102 to skip entropy-encoding of inter_partitioning_idc syntax. When determining in step S203 that the prediction mode of the CU to be encoded is intra prediction, or when determining in step S204 that the CU size is greater than minInterPredUnitSize, the encoding controller 107 controls the entropy encoder 102 to entropy-encode, in step S205, PU partition type information on the CU to be encoded.

(72) According to 4.1.10 Prediction unit syntax in NPL 2, the above-mentioned pred_mode syntax and inter_partitioning_idc syntax are signaled as represented in a list shown in FIG. 5. The exemplary embodiment features that the inter_partitioning_idc syntax is signaled only in PU headers of CUs greater in size than minInterPredUnitSize under the following condition: “if(currPredUnitSize>minInterPredUnitSize).”

(73) When the CU size of the CU to be encoded is less than or equal to the predetermined minimum inter-PU size, the video encoding device in the exemplary embodiment does not entropy-encode the inter-PU partition type syntax in the PU header layer of the CU to be encoded to reduce the number of inter-PU partition type syntaxes to be signaled. Since the reduction in the number of inter-PU partition type syntaxes to be signaled reduces the percentage of the amount of code of a PU header in the bitstream, the quality of video is further improved.

(74) When the CU size of the CU to be encoded exceeds the predetermined minimum inter-PU size, the video encoding device in the exemplary embodiment sets, in a predetermined inter-PU partition type, the inter-PU partition type syntax in the PU header layer of the CU to be encoded, and entropy-encodes the inter-PU partition type so that no inter PU the size of which is less than the minimum inter-PU size will not come into existence. The memory bandwidth is reduced by preventing any inter PU the size of which is less than the minimum inter-PU size from coming into existence.

Exemplary Embodiment 3

(75) A video decoding device in Exemplary Embodiment 3 decodes a bitstream generated by the video encoding device in Exemplary Embodiment 2.

(76) The video decoding device in this exemplary embodiment includes: means for de-multiplexing minimum inter-PU size information multiplexed into a bitstream; CU size determination means for determining a predetermined CU size, from which an inter-PU partition type is parsed, based on the de-multiplexed minimum inter-PU size information; and parsing means for parsing the inter-PU partition type from the bitstream in the CU size determined by the CU size determination means.

(77) As shown in FIG. 6, the video decoding device in the exemplary embodiment includes a de-multiplexer 201, an entropy decoder 202, an inverse transformer/inverse quantizer 203, a predictor 204, a buffer 205, and a decoding controller 206.

(78) The de-multiplexer 201 de-multiplexes an input bitstream and extracts minimum inter-PU size information and an entropy-encoded video bitstream. The de-multiplexer 201 de-multiplexes log 2 min_coding_unit_size_minus3 syntax and min_inter_pred_unit_hierarchy_depth syntax after max_coding_unit_hierarchy_depth syntax in sequence parameters as listed in FIG. 3. The de-multiplexer 201 further uses the de-multiplexed syntax values to determine a minimum inter-PU size (minInterPredUnitSize), in which the inter-PU partition type syntax (inter_partitioning_idc syntax) is transmitted, as follows.
minInterPredUnitSize=1<<(log 2_min_coding_unit_size_minus3+3+min_inter_pred_unit_hierarchy_depth)

(79) In other words, the de-multiplexer 201 in the exemplary embodiment also plays a role in determining the CU size, in which the inter-PU partition type syntax is parsed, based on the de-multiplexed minimum inter-PU size information.

(80) The de-multiplexer 201 further supplies the minimum inter-PU size to the decoding controller 206.

(81) The entropy decoder 202 entropy-decodes the video bitstream. The entropy decoder 202 supplies an entropy-decoded transform quantization value to the inverse transformer/inverse quantizer 203. The entropy decoder 202 supplies entropy-decoded split_coding_unit_flag and prediction parameters to the decoding controller 206.

(82) When the prediction mode of a CU to be decoded is inter prediction and the CU size is minInterPredUnitSize, the decoding controller 206 in the exemplary embodiment controls the entropy decoder 202 to skip entropy-decoding of the inter-PU partition type syntax of the CU to be decoded. The decoding controller 206 further sets, to 2N×2N, the inter-PU partition type of the CU to be decoded. When the CU size of the CU to be decoded is less than minInterPredUnitSize, the prediction mode of the CU is only intra prediction.

(83) The inverse transformer/inverse quantizer 203 inverse-quantizes transform quantization values of luminance and color difference with a predetermined quantization step width. The inverse transformer/inverse quantizer 203 further performs inverse frequency transform of a frequency transform coefficient obtained by the inverse quantization.

(84) After the inverse frequency transform, the predictor 204 generates a prediction signal using an image of a reconstructed picture stored in the buffer 205 based on the prediction parameters supplied from the decoding controller 206.

(85) The prediction signal supplied from the predictor 204 is added to a reconstructed prediction error image obtained by the inverse frequency transform performed by the inverse transformer/inverse quantizer 203, and the result is supplied to the buffer 205 as a reconstructed picture.

(86) The reconstructed picture stored in the buffer 205 is then output as a decoded image.

(87) Based on the operation described above, the video decoding device in the exemplary embodiment generates a decoded image.

(88) Referring next to a flowchart of FIG. 7, description is made of an operation of parsing the inter-PU partition type syntax that is a feature of the exemplary embodiment.

(89) As shown in FIG. 7, the entropy decoder 202 entropy-decodes split_coding_unit_flag to decide the CU size in step S301. In step S302, the entropy decoder 202 entropy-decodes the prediction mode. In other words, the entropy decoder 202 entropy-decodes pred_mode syntax. When determining in step S303 that the prediction mode is inter prediction and determining in step S304 that the decided CU size is less than or equal to minInterPredUnitSize, the decoding controller 206 controls the entropy decoder 202 in step S305 to skip entropy-decoding of the inter-PU partition type and to set the PU partition type of the CU to 2N×2N (inter_partitioning_idc=0).

(90) When determining in step S303 that the prediction mode is intra prediction, or when determining in step S304 that the decided CU size is greater than minInterPredUnitSize, the decoding controller 206 controls the entropy decoder 202 in step S306 not to skip entropy-decoding of the PU partition type of the CU to be decoded and to set the PU partition type of the CU to a PU partition type obtained as a result of the entropy-decoding.

(91) The video encoding device in Exemplary Embodiment 1 and Exemplary Embodiment 2 can multiplex the minimum inter-PU size information (min_inter_pred_unit_hierarchy_depth) used in Exemplary Embodiment 1 into a picture parameter set or a slice header as represented in a list shown in FIG. 8 or a list shown in FIG. 9. Similarly, the video decoding device in this exemplary embodiment can de-multiplex the min_inter_pred_unit_hierarchy_depth syntax from the picture parameter set or the slice header.

(92) The video encoding device in Exemplary Embodiment 1 and Exemplary Embodiment 2 may set the min_inter_pred_unit_hierarchy_depth syntax as base-2 log (logarithm) of a value obtained by dividing the LCU size (maxCodingUnitSize) by the minimum inter-PU size (minInterPredUnitSize), i.e., the following equation may be used.
min_inter_pred_unit_hierarchy_depth=log 2(maxCodingUnitSize/minInterPredUnitSize)

(93) In this case, the video decoding device in this exemplary embodiment can calculate the minimum inter-PU size based on the min_inter_pred_unit_hierarchy_depth syntax as follows.
minInterPredUnitSize=1<<(log 2_min_coding_unit_size_minus3+3+max_coding_unit_hierarchy_depth-min_inter_pred_unit_hierarchy_depth)

(94) In the video decoding device in this exemplary embodiment, since no inter PU the size of which is less than the minimum inter-PU size does not come into existence, the memory bandwidth is reduced.

Exemplary Embodiment 4

(95) A video decoding device in Exemplary Embodiment 4 decodes a bitstream generated by the video encoding device in Exemplary Embodiment 1.

(96) The video decoding device in this exemplary embodiment includes: means for de-multiplexing minimum inter-PU size information multiplexed into a bitstream; and error detection means for detecting, based on the de-multiplexed minimum inter-PU size information, an error in an access unit accessing the bitstream including a CU to be decoded. As defined in 3.1 access unit of NPL 1, the access unit is the unit of storing coded data for one picture. The error means violation of restrictions based on the number of motion vectors allowed per predetermined area.

(97) As shown in FIG. 10, the video decoding device in the exemplary embodiment includes a de-multiplexer 201, an entropy decoder 202, an inverse transformer/inverse quantizer 203, a predictor 204, a buffer 205, and an error detector 207.

(98) The de-multiplexer 201 operates the same way as the de-multiplexer 201 in Exemplary Embodiment 3 to de-multiplex an input bitstream and extract minimum inter-PU size information and an entropy-encoded video bitstream. The de-multiplexer 201 further determines the minimum inter-PU size and supplies the minimum inter-PU size to the error detector 207.

(99) The entropy decoder 202 entropy-decodes the video bitstream. The entropy decoder 202 supplies an entropy-decoded transform quantization value to the inverse transformer/inverse quantizer 203. The entropy decoder 202 then supplies entropy-decoded split_coding_unit_flag and prediction parameters to the error detector 207.

(100) The error detector 207 performs error detection on the prediction parameters supplied from the entropy decoder 202 based on the minimum inter-PU size supplied from the de-multiplexer 201, and supplies the result to the predictor 204. The error detection operation will be described later. The error detector 207 also plays a role as the decoding controller 206 in Exemplary Embodiment 3.

(101) The inverse transformer/inverse quantizer 203 operates the same way as the inverse transformer/inverse quantizer 203 in Exemplary Embodiment 3.

(102) The predictor 204 generates a prediction signal using an image of a reconstructed picture stored in the buffer 205 based on the prediction parameters supplied from the error detector 207.

(103) The buffer 205 operates the same way as the buffer 205 in Exemplary Embodiment 3.

(104) Based on the operation described above, the video decoding device in the exemplary embodiment generates a decoded image.

(105) Referring to a flowchart of FIG. 11, description is made of the error detection operation of the video decoding device in the exemplary embodiment to detect an error in an access unit accessing a bitstream including a CU to be decoded.

(106) In step S401, the error detector 207 decides the CU size, the prediction mode, and the PU partition type.

(107) In step S402, the error detector 207 determines the prediction mode of a PU of the CU to be decoded. When the prediction mode is intra prediction, the process is ended. When the prediction mode is inter prediction, the procedure proceeds to step S403.

(108) In step S403, the error detector 207 compares the PU size of the CU to be decoded with the minimum inter-PU size. When the PU size of the CU to be decoded is greater than or equal to the minimum inter-PU size, the process is ended. When the PU size of the CU to be decoded is less than the minimum inter-PU size, the procedure proceeds to step S404.

(109) In step S404, the error detector 207 determines that there is an error and notifies the outside of the error. For example, the error detector 207 outputs the address of the CU to be decoded and in which the error has occurred.

(110) According to the above operation, the error detector 207 detects the error in an access unit accessing the bitstream including the CU to be decoded.

(111) Each of the aforementioned exemplary embodiments can be implemented in hardware or in a computer program.

(112) An information processing system shown in FIG. 12 includes a processor 1001, a program memory 1002, a storage medium 1003 for storing video data, and a storage medium 1004 for storing a bitstream. The storage medium 1003 and the storage medium 1004 may be different storage media, or storage areas on the same storage medium. A magnetic medium such as a hard disk can be used as the storage medium.

(113) In the information processing system shown in FIG. 12, a program for carrying out the function of each block (except the buffer block) shown in each of FIG. 1, FIG. 6, and FIG. 10 is stored in the program memory 1002. The processor 1001 performs processing according to the program stored in the program memory 1002 to carry out the functions of the video encoding device or the video decoding device shown in FIG. 1, FIG. 6, or FIG. 10, respectively.

(114) FIG. 13 is a block diagram showing a main part of a video encoding device according to the present invention. As shown in FIG. 13, the video decoding device according to the present invention is a video encoding device for encoding video using inter prediction, including encoding control means 11 (the encoding controller 107 shown in FIG. 1 as an example) for controlling an inter-PU partition type of a CU to be encoded, based on a predetermined minimum inter-PU size (PA) and a CU size (PB) of the CU to be encoded.

(115) FIG. 14 is a block diagram showing a main part of a video decoding device according to the present invention. As shown in FIG. 14, the video decoding device according to the present invention is a video decoding device for decoding video using inter prediction, including decoding control means 21 (the decoding controller 207 shown in FIG. 6 and FIG. 10 as an example) for controlling an inter-PU partition of a CU to be decoded, based on a predetermined minimum inter-PU size (PA) and a size (PB) of the CU to be decoded.

(116) While the present invention has been described with reference to the exemplary embodiments and examples, the present invention is not limited to the aforementioned exemplary embodiments and examples. Various changes understandable to those skilled in the art within the scope of the present invention can be made to the structures and details of the present invention.

(117) This application claims priority based on Japanese Patent Application No. 2011-4964, filed on Jan. 13, 2011, the disclosures of which are incorporated herein in their entirety.

REFERENCE SIGNS LIST

(118) 11 encoding control means 21 decoding control means 101 transformer/quantizer 102 entropy encoder 103 inverse transformer/inverse quantizer 104 buffer 105 predictor 106 multiplexer 107, 108 encoding controller 201 de-multiplexer 202 entropy decoder 203 inverse transformer/inverse quantizer 204 predictor 205 buffer 206 decoding controller 207 error detector 1001 processor 1002 program memory 1003 storage medium 1004 storage medium