METHODS AND APPARATUS FOR DECODING A COMPRESSED HOA SIGNAL

Abstract

Methods and apparatus for decoding a compressed Higher Order Ambisonics (HOA) representation of a sound or soundfield. The method may include receiving a bit stream containing the compressed HOA representation and decoding, based on a determination that there are multiple layers, the compressed HOA representation from the bitstream to obtain a sequence of decoded HOA representations. A first subset of the sequence of decoded HOA representations is determined based only on corresponding ambient HOA components. A second subset of the sequence of decoded HOA representations is determined based on corresponding ambient HOA components and corresponding predominant sound components. For a frame k, the sequence of decoded HOA representations are represented at least in part by

[00001]${\widehat{c}}_n\left(k-1\right)=\left\{\begin{array}{l}{\widehat{c}}_{\text{AMB},n}\left(k-1\right)\hfill \\ {\widehat{c}}_n\left(k-1\right)={\widehat{c}}_{\text{PS},n}\left(k-1\right)+{\widehat{c}}_{\text{AMB},n}\left(k-1\right),\hfill \end{array}\begin{array}{c}\text{for n in the first subset}\\ \text{for n in the second subset}\end{array}\right)$

where

[00002]${\widehat{c}}_{\text{AMB,}n}\left(k-1\right)$

corresponds to the corresponding ambient HOA components and

[00003]${\widehat{c}}_{\text{PS},n}\left(k-1\right)$

corresponds to the corresponding predominant sound components.

Claims

1. A method of decoding a compressed Higher Order Ambisonics (HOA) representation of a sound or soundfield, the method comprising: receiving a bit stream containing the compressed HOA representation; determining that the bitstream comprises only a single layer; and decoding the compressed HOA representation from the layered bitstream to obtain a sequence of decoded HOA representations. wherein, for a frame k, the single layer is decoded based on an addition of a corresponding predominant HOA sound component $\left({\stackrel{⌢}{C}}_{PS}\left(k-1\right)\right)$ and a corresponding ambient HOA component $\left({\stackrel{⌢}{\tilde{C}}}_{AMB}\left(k-1\right)\right)$ .

2. (canceled)

3. An apparatus for decoding a compressed Higher Order Ambisonics (HOA) representation of a sound or a soundfield, the apparatus comprising: a receiver for receiving a bit stream containing the compressed HOA representation; a processor for determining that the layered bitstream comprises only a single layer; and a decoder for decoding the compressed HOA representation from the layered bitstream to obtain a sequence of decoded HOA representations. wherein, for a frame k, the single layer is decoded based on an addition of a corresponding predominant HOA sound component $\left({\stackrel{⌢}{C}}_{PS}\left(k-1\right)\right)$ and a corresponding ambient HOA component $\left({\stackrel{⌢}{\tilde{C}}}_{AMB}\left(k-1\right)\right)$ .

4. (canceled)

5. A non-transitory computer readable storage medium containing instructions that when executed by a processor perform a method according to claim 1.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Exemplary embodiments of the invention are described with reference to the accompanying drawings as follows:

[0025] FIGS. 1A and 1B illustrate an exemplary structure of a conventional architecture of a HOA compressor;

[0026] FIGS. 2A and 2B illustrate an exemplary structure of a conventional architecture of a HOA decompressor;

[0027] FIG. 3 illustrates an exemplary structure of an architecture of a spatial HOA encoding and perceptual encoding portion of a HOA compressor according to one embodiment of the invention;

[0028] FIG. 4 illustrates an exemplary structure of an architecture of a source coder portion of a HOA compressor according to one embodiment of the invention;

[0029] FIG. 5 illustrates an exemplary structure of an architecture of a perceptual decoding and source decoding portion of a HOA decompressor according to one embodiment of the invention;

[0030] FIG. 6 illustrates an exemplary structure of an architecture of a spatial HOA decoding portion of a HOA decompressor according to one embodiment of the invention;

[0031] FIG. 7 illustrates an exemplary transformation of frames from ambient HOA signals to modified ambient HOA signals;

[0032] FIG. 8 illustrates a flow-chart of a method for compressing a HOA signal;

[0033] FIG. 9 illustrates a flow-chart of a method for decompressing a compressed HOA signal; and

[0034] FIG. 10 details of parts of an exemplary architecture of a spatial HOA decoding portion of a HOA decompressor according to one embodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

[0035] For easier understanding, prior art solutions in FIGS. 1A, 1B and FIGS. 2A and 2B are recapitulated in the following.

[0036] FIGS. 1A and 1B show the structure of a conventional architecture of a HOA compressor. In a method described in [4], the directional component is extended to a so-called predominant sound component. As the directional component, the predominant sound component is assumed to be partly represented by directional signals, meaning monaural signals with a corresponding direction from which they are assumed to impinge on the listener, together with some prediction parameters to predict portions of the original HOA representation from the directional signals. Additionally, the predominant sound component is supposed to be represented by so-called vector based signals, meaning monaural signals with a corresponding vector which defines the directional distribution of the vector based signals. The overall architecture of the HOA compressor proposed in [4] is illustrated in FIGS. 1A and B. It can be subdivided into a spatial HOA encoding part depicted in FIG. 1A and a perceptual and source encoding part depicted in FIG. 1B. The spatial HOA encoder provides a first compressed HOA representation consisting of I signals together with side information describing how to create an HOA representation thereof. In the perceptual and side info source coder the mentioned I signals are perceptually encoded and the side information is subjected to source encoding, before multiplexing the two coded representations.

[0037] Conventionally, the spatial encoding works as follows.

[0038] In a first step, the k-th frame C(k) of the original HOA representation is input to a Direction and Vector Estimation processing block, which provides the tuple sets M.sub.DIR(k) and M.sub.VEC(k). The tuple set M.sub.DIR(k) consists of tuples of which the first element denotes the index of a directional signal and of which the second element denotes the respective quantized direction. The tuple set M.sub.VEC(k) consists of tuples of which the first element indicates the index of a vector based signal and of which the second element denotes the vector defining the directional distribution of the signals, i.e. how the HOA representation of the vector based signal is computed.

[0039] Using both tuple sets M.sub.DIR(k) and M.sub.VEC(k), the initial HOA frame C(k) is decomposed in the HOA Decomposition into the frame X.sub.PS(k - 1) of all predominant sound (i.e. directional and vector based) signals and the frame C.sub.AMB(k - 1) of the ambient HOA component. Note the delay 102 of one frame, respectively, which is due to overlap add processing in order to avoid blocking artifacts. Furthermore, the HOA Decomposition is assumed to output some prediction parameters ζ(k - 1) describing how to predict portions of the original HOA representation from the directional signals in order to enrich the predominant sound HOA component. Additionally, a target assignment vector v.sub.A,T(k - 1) containing information about the assignment of predominant sound signals, which were determined in the HOA Decomposition processing block, to the I available channels is provided. The affected channels can be assumed to be occupied, meaning they are not available to transport any coefficient sequences of the ambient HOA component in the respective time frame.

[0040] In the Ambient Component Modification processing block, the frame C.sub.AMB(k - 1) of the ambient HOA component is modified according to the information provided by the tagret assignment vector v.sub.A,.sub.T(k - 1). In particular, it is determined which coefficient sequences of the ambient HOA component are to be transmitted in the given I channels, depending, amongst other aspects, on the information (contained in the target assignment vector v.sub.A,T(k - 1)) about which channels are available and not already occupied by predominant sound signals. Additionally, a fade in and out of coefficient sequences is performed if the indices of the chosen coefficient sequences vary between successive frames.

[0041] Furthermore, it is assumed that the first O.sub.MIN coefficient sequences of the ambient HOA component C.sub.AMB(k - 2) are always chosen to be perceptually coded and to be transmitted, where O.sub.MIN = (N.sub.MIN + 1).sup.2 with N.sub.MIN ≤ N being typically a smaller order than that of the original HOA representation. In order to de-correlate these HOA coefficient sequences, it is proposed to transform them to directional signals (i.e. general plane wave functions) impinging from some predefined directions Ω.sub.MIN,d, d = 1, ..., O.sub.MIN. Along with the modified ambient HOA component C.sub.M,.sub.A(k - 1), a temporally predicted modified ambient HOA component C.sub.P,.sub.M,.sub.A(k - 1) is computed to be later used in the Gain Control processing block in order to allow a reasonable look ahead.

[0042] The information about the modification of the ambient HOA component is directly related to the assignment of all possible types of signals to the available channels. The final information about the assignment is contained in the final assignment vector v.sub.A(k - 2). In order to compute this vector, information contained in the target assignment vector v.sub.A,.sub.T(k - 1) is exploited.

[0043] The Channel Assignment assigns with the information provided by the assignment vector v.sub.A(k - 2) the appropriate signals contained in X.sub.PS(k - 2) and that contained in C.sub.M,.sub.A(k - 2) to the I available channels, yielding the signals y.sub.i(k - 2), i = 1, ...,I. Further, appropriate signals contained in X.sub.PS(k - 1) and that in C.sub.P,AMB(k - 1) are also assigned to the I available channels, yielding the predicted signals y.sub.P,.sub.i(k - 2), i = 1, ...,I. Each of the signals y.sub.i(k - 2), i = 1, ...,I, is finally processed by a Gain Control, where the signal gain is smoothly modified to achieve a value range that is suitable for the perceptual encoders. The predicted signal frames y.sub.P,.sub.i(k - 2), i = 1, ...,I, allow a kind of look ahead in order to avoid severe gain changes between successive blocks. The gain modifications are assumed to be reverted in the spatial decoder with the gain control side information, consisting of the exponents e.sub.i(k - 2) and the exception flags β.sub.i(k - 2), i = 1, ...,I.

[0044] FIGS. 2A and 2B show the structure of a conventional architecture of a HOA decompressor, as proposed in [4]. Conventionally, HOA decompression consists of the counterparts of the HOA compressor components, which are obviously arranged in reverse order. It can be subdivided into a perceptual and source decoding part depicted in FIG. 2A and a spatial HOA decoding part depicted in FIG. 2B.

[0045] In the perceptual and side info source decoder, the bit stream is first de-multiplexed into the perceptually coded representation of the I signals and into the coded side information describing how to create an HOA representation thereof. Successively, a perceptual decoding of the I signals and a decoding of the side information is performed. Then, the spatial HOA decoder creates from the I signals and the side information the reconstructed HOA representation.

[0046] Conventionally, spatial HOA decoding works as follows.

[0047] In the spatial HOA decoder, each of the perceptually decoded signals

[00033]${\widehat{\text{z}}}_i\left(k\right),i\in \left\{1,\mathrm{...},I\right\}$

, is first input to an Inverse Gain Control processing block together with the associated gain correction exponent e.sub.i(k) and gain correction exception flag β.sub.i(k). The i-th Inverse Gain Control processing provides a gain corrected signal frame

[00034]${\stackrel{⌢}{\text{y}}}_i\left(k\right)$

.

[0048] All of the I gain corrected signal frames

[00035]$\stackrel{⌢}{\text{y}}\left(k\right),i\in \left\{1,\mathrm{...},I\right\}$

, are passed together with the assignment vector v.sub.AMB,ASSIGN(k) and the tuple sets M.sub.DIR(k + 1) and M.sub.VEC(k + 1) to the Channel Reassignment. The tuple sets M.sub.DIR(k + 1) and M.sub.VEC(k + 1) are defined above (for spatial HOA encoding), and the assignment vector v.sub.AMB,ASSIGN(k) consists of I components, which indicate for each transmission channel if and which coefficient sequence of the ambient HOA component it contains. In the Channel Reassignment the gain corrected signal frames

[00036]${\stackrel{⌢}{\text{y}}}_i\left(k\right)$

are redistributed to reconstruct the frame

[00037]${\stackrel{⌢}{\text{X}}}_{\text{PS}}\left(k\right)$

of all predominant sound signals (i.e., all directional and vector based signals) and the frame C.sub.I,AMB(k) of an intermediate representation of the ambient HOA component. Additionally, the set I.sub.AMB,ACT(k) of indices of coefficient sequences of the ambient HOA component, which are active in the k-th frame, and the sets

[00038]$J_{\text{E}}\left(k-1\right),J_{\text{D}}\left(k-1\right),\text{and}{J}_{\text{U}}\left(k-1\right)$

of coefficient indices of the ambient HOA component, which have to be enabled, disabled and to remain active in the (k - 1)-th frame, are provided.

[0049] In the Predominant Sound Synthesis the HOA representation of the predominant sound component

[00039]${\stackrel{⌢}{\text{C}}}_{\text{PS}}\left(k-1\right)$

is computed from the frame

[00040]${\stackrel{⌢}{\text{X}}}_{\text{PS}}\left(k\right)$

.sub.PS(k) of all predominant sound signals using the tuple set M.sub.DIR(k + 1) and the set ζ(k + 1) of prediction parameters, the tuple set M.sub.VEC(k + 1) and the sets

[00041]$J_{\text{E}}\left(k-1\right),J_{\text{D}}\left(k-1\right),\text{and}{J}_{\text{U}}\left(k-1\right)$

.

[0050] In the Ambience Synthesis, the ambient HOA component frame

[00042]${\stackrel{⌢}{\text{C}}}_{\text{AMB}}\left(k-1\right)$

is created from the frame C.sub.I,AMB(k) of the intermediate representation of the ambient HOA component, using the set

[00043]$J_{\text{AMB,}\text{ACT}}\left(k\right)$

of indices of coefficient sequences of the ambient HOA component which are active in the k-th frame. Note the delay of one frame, which is introduced due to the synchronization with the predominant sound HOA component.

[0051] Finally, in the HOA Composition the ambient HOA component frame

[00044]${\stackrel{⌢}{\text{C}}}_{\text{AMB}}\left(k-1\right)$

and the frame

[00045]${\stackrel{⌢}{C}}_{\text{PS}}\left(k-1\right)$

of the predominant sound HOA component are superposed to provide the decoded HOA frame

[00046]$\stackrel{⌢}{\text{C}}\left(k-1\right)$

.

[0052] As has become clear from the coarse description of the HOA compression and decompression method above, the compressed representation consists of I quantized monaural signals and some additional side information. A fixed number O.sub.MIN out of these I quantized monaural signals represent a spatially transformed version of the first O.sub.MIN coefficient sequences of the ambient HOA component C.sub.AMB(k - 2). The type of the remaining I - O.sub.MIN signals can vary between successive frame, being either directional, vector based, empty or representing an additional coefficient sequence of the ambient HOA component C.sub.AMB(k - 2). Taken as it is, the compressed HOA representation is meant to be monolithic. In particular, one problem is how to split the described representation into a low quality base layer and an enhancement layer.

[0053] According to the disclosed invention, a candidate for a low quality base layer are the O.sub.MIN channels that contain a spatially transformed version of the first O.sub.MIN coefficient sequences of the ambient HOA component C.sub.AMB(k - 2). What makes these (without loss of generality: first) O.sub.MIN channels a good choice to form a low quality base layer is their time-invariant type. However, the respective signals lack any predominant sound components, which are essential for the sound scene. This can also be seen in the computation of the ambient HOA component C.sub.AMB(k - 1), which is carried out by subtraction of the predominant sound HOA representation C.sub.PS(k - 1) from the original HOA representation C(k - 1) according to

[00047]${\text{C}}_{\text{AMB}}\left(k-1\right)=\text{C}\left(k-1\right)-{\text{C}}_{\text{PS}}\left(k-1\right)$

A solution to this problem is to include the predominant sound components at a low spatial resolution into the base layer.

[0054] Proposed amendments to the HOA compression are described in the following.

[0055] FIG. 3 shows the structure of an architecture of a spatial HOA encoding and perceptual encoding portion of a HOA compressor according to one embodiment of the invention.

[0056] To include also the predominant sound components at a low spatial resolution into the base layer, the ambient HOA component C.sub.AMB(k - 1), which is output by the HOA Decomposition processing in the spatial HOA encoder (see FIG. 1A), is replaced by a modified version

[00048]${\tilde{\text{C}}}_{\text{AMB}}\left(k-1\right)=\left[\begin{array}{c}{\tilde{\text{c}}}_{\text{AMB,1}}\left(k-1\right)\\ {\tilde{\text{c}}}_{\text{AMB,2}}\left(k-1\right)\\ .Math.\\ {\tilde{\text{c}}}_{\text{AMB,}O}\left(k-1\right)\end{array}\right]$

whose elements are given by

[00049]${\tilde{\text{c}}}_{\text{AMB,}n}\left(k-1\right)=\left\{\begin{array}{ll}{\text{c}}_n\left(k-1\right)\hfill & \text{for 1}\le n\le O_{\text{MIN}}\hfill \\ {\text{c}}_{\text{AMB,}n}\left(k-1\right)\hfill & \text{for}{O}_{\text{MIN}}+1\le n\le O\hfill \end{array}\right)$

[0057] In other words, the first O.sub.MIN coefficient sequences of the ambient HOA component which are supposed to be always transmitted in a spatially transformed form, are replaced by the coefficient sequences of the original HOA component. The other processing blocks of the spatial HOA encoder can remain unchanged.

[0058] It is important to note that this change of the HOA Decomposition processing can be seen as an initial operation making the HOA compression work in a so-called “dual layer” or “two layer” mode. This mode provides a bit stream that can be split up into a low quality Base Layer and an Enhancement Layer. Using or not this mode can be signalized by a single bit in access units of the total bit stream.

[0059] A possible consequent modification of the bit stream multiplexing to provide bit streams for a base layer and an enhancement layer is illustrated in FIGS. 3 and 4, as described further below.

[0060] The base layer bit stream

[00050]${\stackrel{⌣}{\text{B}}}_{\text{BASE}}\left(k-2\right)$

only includes the perceptually encoded signals

[00051]${\stackrel{⌣}{\text{z}}}_i\left(k-2\right),i=1,\mathrm{...},O_{\text{MIN}}$

, and the corresponding coded gain control side information, consisting of the exponents e.sub.i(k - 2) and the exception flags β.sub.i(k - 2), i = 1, ..., O.sub.MIN. The remaining perceptually encoded signals

[00052]${\stackrel{⌣}{\text{z}}}_i\left(k-2\right),i=O_{\text{MIN}}+1,\mathrm{...},O$

and the encoded remaining side information are included into the enhancement layer bit stream. The base layer and enhancement layer bit streams

[00053]${\stackrel{⌣}{\text{B}}}_{\text{BASE}}\left(k-2\right)\text{and}{\stackrel{⌣}{\text{B}}}_{\text{ENH}}\left(k-2\right)$

are then jointly transmitted instead of the former total bit stream

[00054]$\stackrel{⌣}{\text{B}}\left(k-2\right)$

.

[0061] In FIG. 3 and FIG. 4, an apparatus for compressing a HOA signal being an input HOA representation with input time frames (C(k)) of HOA coefficient sequences is shown. Said apparatus comprises a spatial HOA encoding and perceptual encoding portion for spatial HOA encoding of the input time frames and subsequent perceptual encoding, which is shown in FIG. 3, and a source coder portion for source encoding, which is shown in FIG. 4.

[0062] The spatial HOA encoding and perceptual encoding portion 300 comprises a Direction and Vector Estimation block 301, delay 302, a HOA Decomposition block 303, an Ambient Component Modification block 304, a Channel Assignment block 305, and a plurality of Gain Control blocks 306.

[0063] The Direction and Vector Estimation block 301 is adapted for performing Direction and Vector Estimation processing of the HOA signal, wherein data comprising first tuple sets M.sub.DIR(k) for directional signals and second tuple sets M.sub.VEC(k) for vector based signals are obtained, each of the first tuple sets M.sub.DIR(k) comprising an index of a directional signal and a respective quantized direction, and each of the second tuple sets M.sub.VEC(k) comprising an index of a vector based signal and a vector defining the directional distribution of the signals.

[0064] The HOA Decomposition block 303 is adapted for decomposing each input time frame of the HOA coefficient sequences into a frame of a plurality of predominant sound signals X.sub.PS(k-1) and a frame of an ambient HOA component

[00055]${\tilde{\text{C}}}_{\text{AMB}}\left(k-1\right)$

, wherein the predominant sound signals X.sub.PS(k-1) comprise said directional sound signals and said vector based sound signals, and wherein the ambient HOA component

[00056]${\tilde{\text{C}}}_{\text{AMB}}\left(k-1\right)$

comprises HOA coefficient sequences representing a residual between the input HOA representation and the HOA representation of the predominant sound signals, and wherein the decomposing further provides prediction parameters ξ(k-1) and a target assignment vector v.sub.A,.sub.T(k - 1). The prediction parameters ξ(k-1) describe how to predict portions of the HOA signal representation from the directional signals within the predominant sound signals X.sub.PS (k-1) so as to enrich predominant sound HOA components, and the target assignment vector v.sub.A,.sub.T(k - 1) contains information about how to assign the predominant sound signals to a given number I of channels.

[0065] The Ambient Component Modification block 304 is adapted for modifying the ambient HOA component C.sub.AMB(k - 1) according to the information provided by the target assignment vector v.sub.A,.sub.T(k - 1), wherein it is determined which coefficient sequences of the ambient HOA component C.sub.AMB(k - 1) are to be transmitted in the given number I of channels, depending on how many channels are occupied by predominant sound signals, and wherein a modified ambient HOA component C.sub.M,.sub.A(k - 2) and a temporally predicted modified ambient HOA component C.sub.P,.sub.M,.sub.A(k - 1) are obtained, and wherein a final assignment vector v.sub.A(k - 2) is obtained from information in the target assignment vector v.sub.A,.sub.T(k - 1).

[0066] The Channel Assignment block 305 is adapted for assigning the predominant sound signals X.sub.PS(k-1) obtained from the decomposing, the determined coefficient sequences of the modified ambient HOA component C.sub.M,.sub.A(k - 2) and of the temporally predicted modified ambient HOA component C.sub.P,.sub.M,.sub.A(k - 1) to the given number I of channels using the information provided by the final assignment vector v.sub.A(k - 2), wherein transport signals y.sub.i(k - 2), i = 1, ...,I and predicted transport signals y.sub.P,.sub.i(k - 2), i = 1, ...,I are obtained.

[0067] The plurality of Gain Control blocks 306 is adapted for performing gain control (805) to the transport signals y.sub.i(k - 2) and the predicted transport signals y.sub.P,.sub.i(k - 2), wherein gain modified transport signals z.sub.i(k - 2), exponents e.sub.i(k - 2) and exception flags β.sub.i(k - 2) are obtained.

[0068] FIG. 4 shows the structure of an architecture of a source coder portion of a HOA compressor according to one embodiment of the invention. The source coder portion as shown in FIG. 4 comprises a Perceptual Coder 310, a Side Information Source Coder block with two coders 320,330, namely a Base Layer Side Information Source Coder 320 and an Enhancement Layer Side Information Encoder 330, and two multiplexers 340,350, namely a Base Layer Bitstream Multiplexer 340 and an Enhancement Layer Bitstream Multiplexer 350. The Side Information Source Coders may be in a single Side Information Source Coder block.

[0069] The Perceptual Coder 310 is adapted for perceptually coding 806 said gain modified transport signals z.sub.i(k - 2), wherein perceptually encoded transport signals

[00057]${\stackrel{⌣}{\text{z}}}_i\left(k-2\right),i=1,\mathrm{...},I$

are obtained.

[0070] The Side Information Source Coders 320,330 are adapted for encoding side information comprising said exponents e.sub.i(k - 2) and exception flags β.sub.i(k - 2), said first tuple sets M.sub.DIR(k) and second tuple sets M.sub.VEC(k), said prediction parameters ξ(k-1) and said final assignment vector v.sub.A(k - 2), wherein encoded side information

[00058]$\stackrel{⌣}{\text{Γ}}\left(k-2\right)$

is obtained.

[0071] The multiplexers 340,350 are adapted for multiplexing the perceptually encoded transport signals

[00059]${\stackrel{⌣}{\text{z}}}_i\left(k-2\right)$

and the encoded side information

[00060]$\stackrel{⌣}{\text{Γ}}\left(k-2\right)$

into a multiplexed data stream , wherein the ambient HOA component

[00061]${\tilde{\text{C}}}_{\text{AMB}}\left(k-1\right)$

obtained in the decomposing comprises first HOA coefficient sequences of the input HOA representation c.sub.n(k - 1) in O.sub.MIN lowest positions (ie. those with lowest indices) and second HOA coefficient sequences c.sub.AMB,n(k - 1) in remaining higher positions. As explained below with respect to eq.(4)-(6), the second HOA coefficient sequences are part of an HOA representation of a residual between the input HOA representation and the HOA representation of the predominant sound signals. Further, the first O.sub.MIN exponents e.sub.i(k - 2), i = 1, ..., O.sub.MIN and exception flags β.sub.i(k - 2), i = 1, ..., O.sub.MIN are encoded in a Base Layer Side Information Source Coder 320, wherein encoded Base Layer side information

[00062]${\stackrel{⌣}{\text{Γ}}}_{\text{BASE}}\left(k-2\right)$

is obtained, and wherein O.sub.MIN = (N.sub.MIN + 1).sup.2 and O=(N+1).sup.2, with N.sub.MIN ≤ N and O.sub.MIN ≤ I and N.sub.MIN is a predefined integer value. The first O.sub.MIN perceptually encoded transport signals

[00063]${\stackrel{⌣}{\text{z}}}_i\left(k-2\right),i=1,\mathrm{...},O_{MIN}$

and the encoded Base Layer side information

[00064]${\stackrel{⌣}{\text{Γ}}}_{\text{BASE}}\left(k-2\right)$

are multiplexed in a Base Layer Bitstream Multiplexer 340 (which is one of said multiplexers), wherein a Base Layer bitstream

[00065]${\stackrel{⌣}{\text{B}}}_{BASE}\left(k-2\right)$

is obtained. The Base Layer Side Information Source Coder 320 is one of the Side Information Source Coders, or it is within a Side Information Source Coder block.

[0072] The remaining I - O.sub.MIN exponents e.sub.i(k - 2), i = O.sub.MIN + 1, ..., I and exception flags β.sub.i(k - 2), i = O.sub.MIN + 1, ...,I, said first tuple sets M.sub.DIR(k - 1) and second tuple sets M.sub.VEC(k - 1), said prediction parameters ξ(k-1) and said final assignment vector v.sub.A(k - 2) are encoded in an Enhancement Layer Side Information Encoder 330, wherein encoded enhancement layer side information

[00066]${\stackrel{⌣}{\text{Γ}}}_{ENH}\left(k-2\right)$

is obtained. The Enhancement Layer Side Information Source Coder 330 is one of the Side Information Source Coders, or is within a Side Information Source Coder block.

[0073] The remaining I - O.sub.MIN perceptually encoded transport signals

[00067]${\stackrel{⌣}{z}}_i\left(k-2\right),i=O_{MIN}+1,\mathrm{...},I$

and the encoded enhancement layer side information

[00068]${\stackrel{⌣}{\text{Γ}}}_{ENH}\left(k-2\right)$

are multiplexed in an Enhancement Layer Bitstream Multiplexer 350 (which is also one of said multiplexers), wherein an Enhancement Layer bitstream

[00069]${\stackrel{⌣}{B}}_{ENH}\left(k-2\right)$

is obtained. Further, a mode indication LMF.sub.E is added in a multiplexer or an indication insertion block. The mode indication LMF.sub.E signalizes usage of a layered mode, which is used for correct decompression of the compressed signal.

[0074] In one embodiment, the apparatus for encoding further comprises a mode selector adapted for selecting a mode, the mode being indicated by the mode indication LMF.sub.E and being one of a layered mode and a non-layered mode. In the non-layered mode, the ambient HOA component

[00070]${\tilde{C}}_{\text{AMB}}\left(k-1\right)$

comprises only HOA coefficient sequences representing a residual between the input HOA representation and the HOA representation of the predominant sound signals (ie., no coefficient sequences of the input HOA representation).

[0075] Proposed amendments of the HOA decompression are described in the following.

[0076] In the layered mode, the modification of the ambient HOA component C.sub.AMB(k - 1) in the HOA compression is considered at the HOA decompression by appropriately modifying the HOA composition.

[0077] In the HOA decompressor, the demultiplexing and decoding of the base layer and enhancement layer bit streams are performed according to FIG. 5. The base layer bit stream

[00071]${\stackrel{⌣}{B}}_{BASE}\left(k\right)$

is de-multiplexed into the coded representation of the base layer side information and the perceptually encoded signals. Subsequently, the coded representation of the base layer side information and the perceptually encoded signals are decoded to provide the exponents e.sub.i (k) and the exception flags on the one hand, and the perceptually decoded signals on the other hand. Similarly, the enhancement layer bit stream is de-multiplexed and decoded to provide the perceptually decoded signals and the remaining side information (see FIG. 5). With this layered mode, the spatial HOA decoding part also has to be modified to consider the modification of the ambient HOA component C.sub.AMB (k - 1) in the spatial HOA encoding. The modification is accomplished in the HOA composition.

[0078] In particular, the reconstructed HOA representation

[00072]$\widehat{C}\left(k-1\right)={\widehat{C}}_{\text{PS}}\left(k-1\right)+{\widehat{C}}_{\text{AMB}}\left(k-1\right)$

is replaced by its modified version

[00073]$\tilde{\widehat{C}}\left(k-1\right)=\left[\begin{array}{c}{\widetilde{\widehat{\text{c}}}}_1\left(k-1\right)\\ {\widetilde{\widehat{\text{c}}}}_2\left(k-1\right)\\ .Math.\\ {\widetilde{\widehat{\text{c}}}}_O\left(k-1\right)\end{array}\right]$

whose elements are given by

[00074]${\widetilde{\widehat{\text{c}}}}_n\left(k-1\right)=\left\{\begin{array}{ll}{\widehat{\text{c}}}_{\text{AMB,}n}\left(k-1\right)\hfill & \text{for 1}\le n\le O_{\text{MIN}}\hfill \\ {\widehat{\text{c}}}_n\left(k-1\right)\hfill & \text{for}{O}_{\text{MIN}}+1\le n\le O\hfill \end{array}\right)$

[0079] That means that the predominant sound HOA component is not added to the ambient HOA component for the first O.sub.MIN coefficient sequences, since it is already included therein. All other processing blocks of the HOA spatial decoder remain unchanged.

[0080] In the following, the HOA decompression in the pure presence of a low quality base layer bit stream

[00075]${\stackrel{⌣}{B}}_{\text{BASE}}\left(k\right)$

is briefly considered.

[0081] The bit stream is first de-multiplexed and decoded to provide the reconstructed signals

[00076]${\widehat{z}}_i\left(k\right)$

and the corresponding gain control side information, consisting of the exponents e.sub.i(k) and the exception flags β.sub.i(k), i = 1, ..., O.sub.MIN. Note that in absence of the enhancement layer, the perceptually coded signals

[00077]${\stackrel{⌣}{z}}_i\left(k-2\right),i=O_{\text{MIN}}+1,\mathrm{...},O$

, are not available. A possible way of addressing this situation is to set the signals

[00078]${\widehat{z}}_i\left(k\right),i=O_{\text{MIN}}+1,\mathrm{...},O$

, to zero, which automatically causes the reconstructed predominant sound component C.sub.PS(k - 1) to be zero.

[0082] In a next step, in the spatial HOA decoder, the first O.sub.MIN Inverse Gain Control processing blocks provide gain corrected signal frames

[00079]${\widehat{y}}_i\left(k\right),i=1,\mathrm{...},O_{\text{MIN}}$

, which are used to construct the frame C.sub.I,AMB(k) of an intermediate representation of the ambient HOA component by the Channel Reassignment. Note that the set

[00080]$J_{\text{AMB,}\text{ACT}}\left(k\right)$

of indices of coefficient sequences of the ambient HOA component, which are active in the k-th frame, contains only the indices 1,2, ..., O.sub.MIN. In the Ambience Synthesis, the spatial transform of the first O.sub.MIN coefficient sequences is reverted to provide the ambient HOA component frame C.sub.AMB(k - 1). Finally, the reconstructed HOA representation is computed according to eq.(6).

[0083] FIG. 5 and FIG. 6 show the structure of an architecture of a HOA decompressor according to one embodiment of the invention. The apparatus comprises a perceptual decoding and source decoding portion as shown in FIG. 5, a spatial HOA decoding portion as shown in FIG. 6, and a mode detector adapted for detecting a layered mode indication LMF.sub.D indicating that the compressed HOA signal comprises a compressed base layer bitstream

[00081]${\stackrel{⌣}{B}}_{BASE}\left(k\right)$

and a compressed enhancement layer bitstream.

[0084] FIG. 5 shows the structure of an architecture of a perceptual decoding and source decoding portion of a HOA decompressor according to one embodiment of the invention. The perceptual decoding and source decoding portion comprises a first demultiplexer 510, a second demultiplexer 520, a Base Layer Perceptual Decoder 540 and an Enhancement Layer Perceptual Decoder 550, a Base Layer Side Information Source Decoder 530 and an Enhancement Layer Side Information Source Decoder 560.

[0085] The first demultiplexer 510 is adapted for demultiplexing the compressed base layer bitstream

[00082]${\stackrel{⌣}{B}}_{BASE}\left(k\right)$

, wherein first perceptually encoded transport signals

[00083]${\stackrel{⌣}{z}}_i\left(k\right),i=1,\mathrm{...},O_{\text{MIN}}$

and first encoded side information

[00084]${\stackrel{⌣}{\text{Γ}}}_{BASE}\left(k\right)$

are obtained. The second demultiplexer 520 is adapted for demultiplexing the compressed enhancement layer bitstream

[00085]${\stackrel{⌣}{B}}_{ENH}\left(k\right)$

, wherein second perceptually encoded transport signals

[00086]${\stackrel{⌣}{z}}_i\left(k\right),i=O_{\text{MIN}}+1,\mathrm{...},I$

and second encoded side information

[00087]${\stackrel{⌣}{\text{Γ}}}_{ENH}\left(k\right)$

are obtained.

[0086] The Base Layer Perceptual Decoder 540 and the Enhancement Layer Perceptual Decoder 550 are adapted for perceptually decoding 904 the perceptually encoded transport signals

[00088]${\stackrel{⌣}{z}}_i\left(k\right),i=1,\mathrm{...},I$

, wherein perceptually decoded transport signals

[00089]${\widehat{z}}_i\left(k\right)$

are obtained, and wherein in the Base Layer Perceptual Decoder 540 said first perceptually encoded transport signals

[00090]${\stackrel{⌣}{z}}_i\left(k\right),i=1,\mathrm{...},O_{\text{MIN}}$

of the base layer are decoded and first perceptually decoded transport signals

[00091]${\widehat{z}}_i\left(k\right),i=1,\mathrm{...},O_{\text{MIN}}$

are obtained. In the Enhancement Layer Perceptual Decoder 550, said second perceptually encoded transport signals

[00092]${\stackrel{⌣}{z}}_i\left(k\right),i=O_{\text{MIN}}+1,\mathrm{...},I$

of the enhancement layer are decoded and second perceptually decoded transport signals

[00093]${\widehat{z}}_i\left(k\right),i=O_{\text{MIN}}+1,\mathrm{...},I$

are obtained.

[0087] The Base Layer Side Information Source Decoder 530 is adapted for decoding 905 the first encoded side information

[00094]${\stackrel{⌣}{\text{Γ}}}_{BASE}\left(k\right)$

, wherein first exponents e.sub.i(k), i = 1, ..., O.sub.MIN and first exception flags β.sub.i(k), i = 1, ..., O.sub.MIN are obtained.

[0088] The Enhancement Layer Side Information Source Decoder 560 is adapted for decoding 906 the second encoded side information

[00095]${\stackrel{⌣}{\text{Γ}}}_{ENH}\left(k\right)$

, wherein second exponents e.sub.i(k), i = O.sub.MIN + 1, ..., I and second exception flags β.sub.i(k), i = O.sub.MIN + 1, ..., I are obtained, and wherein further data are obtained. The further data comprise a first tuple set M.sub.DIR(k + 1) for directional signals and a second tuple set M.sub.VEC(k + 1) for vector based signals. Each tuple of the first tuple set M.sub.DIR(k + 1) comprises an index of a directional signal and a respective quantized direction, and each tuple of the second tuple set M.sub.VEC(k + 1) comprises an index of a vector based signal and a vector defining the directional distribution of the vector based signal. Further, prediction parameters ξ(k+1) and an ambient assignment vector ν.sub.AMB,ASSIGN(k) are obtained, wherein the ambient assignment vector ν.sub.AMB,ASSIGN(k) comprises components that indicate for each transmission channel if and which coefficient sequence of the ambient HOA component it contains.

[0089] FIG. 6 shows the structure of an architecture of a spatial HOA decoding portion of a HOA decompressor according to one embodiment of the invention. The spatial HOA decoding portion comprises a plurality of inverse gain control units 604, a Channel Reassignment block 605, a Predominant Sound Synthesis block 606, and an Ambient Synthesis block 607, a HOA Composition block 608.

[0090] The plurality of inverse gain control units 604 are adapted for performing inverse gain control, wherein said first perceptually decoded transport signals

[00096]${\stackrel{⌢}{z}}_i\left(k\right),i=1,\mathrm{...},O_{\text{MIN}}$

are transformed into first gain corrected signal frames

[00097]${\stackrel{⌢}{y}}_i\left(k\right),i=1,\mathrm{...},O_{\text{MIN}}$

according to the first exponents e.sub.i(k), i = 1, ..., O.sub.MIN and the first exception flags β.sub.i(k), i = 1, ..., O.sub.MIN , and wherein the second perceptually decoded transport signals

[00098]${\stackrel{⌢}{z}}_i\left(k\right),i=O_{MIN}+1,\mathrm{...},I$

are transformed into second gain corrected signal frames

[00099]${\stackrel{⌢}{y}}_i\left(k\right),i=O_{\text{MIN}}+1,\mathrm{...},I$

according to the second exponents e.sub.i(k), i = O.sub.MIN + 1, ..., I and the second exception flags β.sub.i(k), i = O.sub.MIN + 1, ..., I.

[0091] The Channel Reassignment block 605 is adapted for redistributing 911 the first and second gain corrected signal frames

[00100]${\stackrel{⌢}{y}}_i\left(k\right),i=1,\mathrm{...},I$

to l channels, wherein frames of predominant sound signals

[00101]${\stackrel{⌢}{X}}_{PS}\left(k\right)$

are reconstructed, the predominant sound signals comprising directional signals and vector based signals, and wherein a modified ambient HOA component

[00102]${\tilde{C}}_{I,AMB}\left(k\right)$

is obtained, and wherein the assigning is made according to said ambient assignment vector ν.sub.AMB,ASSIGN(k) and to information in said first and second tuple sets M.sub.DIR(k + 1), M.sub.VEC(k + 1). Further, the Channel Reassignment block 605 is adapted for generating a first set of indices

[00103]$J_{\text{AMB,ACT}}\left(k\right)$

of coefficient sequences of the modified ambient HOA component that are active in a k.sup.th frame, and a second set of indices

[00104]$J_{\text{E}}\left(k-1\right),J_{\text{D}}\left(k-1\right),J_{\text{U}}\left(k-1\right)$

of coefficient sequences of the modified ambient HOA component that have to be enabled, disabled and to remain active in the (k-1).sup.th frame.

[0092] The Predominant Sound Synthesis block 606 is adapted for synthesizing 912 a HOA representation of the predominant HOA sound components

[00105]${\stackrel{⌢}{C}}_{PS}\left(k-1\right)$

from said predominant sound signals

[00106]${\stackrel{⌢}{X}}_{PS}\left(k\right)$

, wherein the first and second tuple sets M.sub.DIR(k + 1), M.sub.VEC(k + 1), the prediction parameters ξ(k+1) and the second set of indices

[00107]$J_{\text{E}}\left(k-1\right),J_{\text{D}}\left(k-1\right),J_{\text{U}}\left(k-1\right)$

are used.

[0093] The Ambient Synthesis block 607 is adapted for synthesizing 913 an ambient HOA component

[00108]${\stackrel{⌢}{\tilde{C}}}_{\text{AMB,ACT}}\left(k\right)$

from the modified ambient HOA component

[00109]${\tilde{C}}_{\text{I,AMB}}\left(k\right)$

, wherein an inverse spatial transform for the first O.sub.MIN channels is made and wherein the first set of indices

[00110]$J_{\text{AMB,ACT}}\left(k\right)$

is used, the first set of indices being indices of coefficient sequences of the ambient HOA component that are active in the k.sup.th frame.

[0094] If the layered mode indication LMF.sub.D indicates a layered mode with at least two layers, the ambient HOA component comprises in its O.sub.MIN lowest positions (ie. those with lowest indices) HOA coefficient sequences of the decompressed HOA signal

[00111]$\stackrel{⌢}{C}\left(k-1\right)$

, and in remaining higher positions coefficient sequences that are part of an HOA representation of a residual. This residual is a residual between the decompressed HOA signal

[00112]$\stackrel{⌢}{C}\left(k-1\right)$

and 914 the HOA representation of the predominant HOA sound components

[00113]${\stackrel{⌢}{C}}_{PS}\left(k-1\right)$

.

[0095] On the other hand, if the layered mode indication LMF.sub.D indicates a single-layer mode, there are no HOA coefficient sequences of the decompressed HOA signal

[00114]$\stackrel{⌢}{C}\left(k-1\right)$

comprised, and the ambient HOA component is a residual between the decompressed HOA signal

[00115]$\stackrel{⌢}{C}\left(k-1\right)$

and the HOA representation of the predominant sound components

[00116]${\stackrel{⌢}{C}}_{PS}\left(k-1\right)$

.

[0096] The HOA Composition block 608 is adapted for adding the HOA representation of the predominant sound components to the ambient HOA component

[00117]${\stackrel{⌢}{C}}_{PS}\left(k-1\right){\stackrel{⌢}{\tilde{C}}}_{AMB}\left(k-1\right)$

, wherein coefficients of the HOA representation of the predominant sound signals and corresponding coefficients of the ambient HOA component are added, and wherein the decompressed HOA signal

[00118]$\stackrel{⌢}{C}\text{'}\left(k-1\right)$

is obtained, and wherein,

[0097] if the layered mode indication LMF.sub.D indicates a layered mode with at least two layers, only the highest I-O.sub.MIN coefficient channels are obtained by addition of the predominant HOA sound components

[00119]${\stackrel{⌢}{C}}_{PS}\left(k-1\right)$

and the ambient HOA component

[00120]${\stackrel{⌢}{\tilde{C}}}_{AMB}\left(k-1\right)$

, and the lowest O.sub.MIN coefficient channels of the decompressed HOA signal

[00121]$\stackrel{⌢}{C}\text{'}\left(k-1\right)$

are copied from the ambient HOA component

[00122]${\stackrel{⌢}{\tilde{C}}}_{AMB}\left(k-1\right)$

. On the other hand, if the layered mode indication LMF.sub.D indicates a single-layer mode, all coefficient channels of the decompressed HOA signal

[00123]$\stackrel{⌢}{C}\text{'}\left(k-1\right)$

are obtained by addition of the predominant HOA sound components

[00124]${\stackrel{⌢}{C}}_{PS}\left(k-1\right)$

and the ambient HOA component

[00125]${\stackrel{⌢}{\tilde{C}}}_{AMB}\left(k-1\right)$

.

[0098] FIG. 7 shows transformation of frames from ambient HOA signals to modified ambient HOA signals.

[0099] FIG. 8 shows a flow-chart of a method for compressing a HOA signal.

[0100] The method 800 for compressing a Higher Order Ambisonics (HOA) signal being an input HOA representation of an order N with input time frames C(k) of HOA coefficient sequences comprises spatial HOA encoding of the input time frames and subsequent perceptual encoding and source encoding.

[0101] The spatial HOA encoding comprises steps of: [0102] performing Direction and Vector Estimation processing 801 of the HOA signal in a Direction and Vector Estimation block 301, wherein data comprising first tuple sets M.sub.DIR(k) for directional signals and second tuple sets M.sub.VEC(k) for vector based signals are obtained, each of the first tuple sets M.sub.DIR(k) comprising an index of a directional signal and a respective quantized direction, and each of the second tuple sets M.sub.VEC(k) comprising an index of a vector based signal and a vector defining the directional distribution of the signals; [0103] decomposing 802 in a HOA Decomposition block 303 each input time frame of the HOA coefficient sequences into a frame of a plurality of predominant sound signals X.sub.PS (k-1) and a frame of an ambient HOA component , wherein the predominant sound signals X.sub.PS (k-1) comprise said directional sound signals and said vector based sound signals, and wherein the ambient HOA component comprises HOA coefficient sequences representing a residual between the input HOA representation and the HOA representation of the predominant sound signals, and wherein the decomposing 702 further provides prediction parameters ξ(k-1) and a target assignment vector ν.sub.A,T(k - 1), the prediction parameters ξ(k-1) describing how to predict portions of the HOA signal representation from the directional signals within the predominant sound signals X.sub.PS (k-1) so as to enrich predominant sound HOA components, and the target assignment vector ν.sub.A,T(k - 1) containing information about how to assign the predominant sound signals to a given number l of channels; [0104] modifying 803 in an Ambient Component Modification block 304 the ambient HOA component C.sub.AMB(k - 1) according to the information provided by the target assignment vector ν.sub.A,T(k - 1), wherein it is determined which coefficient sequences of the ambient HOA component C.sub.AMB(k - 1) are to be transmitted in the given number l of channels, depending on how many channels are occupied by predominant sound signals, and wherein a modified ambient HOA component C.sub.M,A(k - 2) and a temporally predicted modified ambient HOA component C.sub.P,M,A(k - 1) are obtained, and wherein a final assignment vector ν.sub.A(k - 2) is obtained from information in the target assignment vector ν.sub.A,T(k - 1); [0105] assigning 804 in a Channel Assignment block 105 the predominant sound signals X.sub.PS(k-1) obtained from the decomposing, and the determined coefficient sequences of the modified ambient HOA component C.sub.M,A(k - 2) and of the temporally predicted modified ambient HOA component C.sub.P,M,A(k - 1) to the given number l of channels using the information provided by the final assignment vector ν.sub.A(k - 2), wherein transport signals y.sub.i(k - 2), i = 1, ..., I and predicted transport signals y.sub.P,i(k - 2), i = 1, ..., I are obtained, and performing gain control 805 to the transport signals y.sub.i(k - 2) and the predicted transport signals y.sub.P,i(k - 2) in a plurality of Gain Control blocks 306, wherein gain modified transport signals z.sub.i(k - 2), exponents e.sub.i(k - 2) and exception flags β.sub.i(k - 2) are obtained.

[0106] The perceptual encoding and source encoding comprises steps of: [0107] perceptually coding 806 in a Perceptual Coder 310 said gain modified transport signals z.sub.i(k - 2), wherein perceptually encoded transport signals are obtained; [0108] encoding 807 in one or more Side Information Source Coders 320,330 side information comprising said exponents e.sub.i(k - 2) and exception flags β.sub.i(k - 2), said first tuple sets M.sub.DIR(k) and second tuple sets M.sub.VEC(k), said prediction parameters ξ(k-1) and said final assignment vector ν.sub.A(k - 2), wherein encoded side information is obtained; and [0109] multiplexing 808 the perceptually encoded transport signals and the encoded side information , wherein a multiplexed data stream is obtained.

[0110] The ambient HOA component

[00133]${\tilde{C}}_{\text{AMB}}\left(k-1\right)$

obtained in the decomposing step 802 comprises first HOA coefficient sequences of the input HOA representation c.sub.n(k - 1) in O.sub.MIN lowest positions (ie. those with lowest indices) and second HOA coefficient sequences c.sub.AMB,n(k - 1) in remaining higher positions. The second coefficient sequences are part of an HOA representation of a residual between the input HOA representation and the HOA representation of the predominant sound signals.

[0111] The first O.sub.MIN exponents e.sub.i(k - 2), i = 1, ..., O.sub.MIN and exception flags β.sub.i(k - 2), i = 1, ..., O.sub.MIN are encoded in a Base Layer Side Information Source Coder 320, wherein encoded Base Layer side information

[00134]${\stackrel{⌣}{\text{Γ}}}_{BASE}\left(k-2\right)$

is obtained, and wherein O.sub.MIN = (N.sub.MIN + 1).sup.2 and O=(N+1).sup.2, with N.sub.MIN ≤ N and O.sub.MIN ≤ I and N.sub.MIN is a predefined integer value.

[0112] The first O.sub.MIN perceptually encoded transport signals

[00135]${\stackrel{⌣}{z}}_i\left(k-2\right),i=1,\mathrm{...},O_{MIN}$

and the encoded Base Layer side information

[00136]${\stackrel{⌣}{\text{Γ}}}_{BASE}\left(k-2\right)$

are multiplexed 809 in a Base Layer Bitstream Multiplexer 340, wherein a Base Layer bitstream

[00137]${\stackrel{⌣}{B}}_{BASE}\left(k-2\right)$

is obtained.

[0113] The remaining I - O.sub.MIN exponents e.sub.i(k - 2), i = O.sub.MIN + 1, ..., I and exception flags β.sub.i(k - 2), i = O.sub.MIN + 1, ..., I, said first tuple sets M.sub.DIR(k - 1) and second tuple sets M.sub.VEC(k - 1), said prediction parameters ξ(k-1) and said final assignment vector ν.sub.A(k - 2) (also shown as ν.sub.AMB,ASSIGN(k) in the Figures) are encoded in an Enhancement Layer Side Information Encoder 330, wherein encoded enhancement layer side information

[00138]${\stackrel{⌣}{\text{Γ}}}_{ENH}\left(k-2\right)$

is obtained.

[0114] The remaining I - O.sub.MIN perceptually encoded transport signals

[00139]${\stackrel{⌣}{z}}_i\left(k-2\right),i=O_{MIN}+1,\mathrm{...},I$

and the encoded enhancement layer side information

[00140]${\stackrel{⌣}{\text{Γ}}}_{ENH}\left(k-2\right)$

are multiplexed 810 in an Enhancement Layer Bitstream Multiplexer 350, wherein an Enhancement Layer bitstream

[00141]${\stackrel{⌣}{B}}_{ENH}\left(k-2\right)$

is obtained.

[0115] A mode indication is added 811 that signalizes usage of a layered mode, as described above. The mode indication is added by an indication insertion block or a multiplexer.

[0116] In one embodiment, the method further comprises a final step of multiplexing the Base Layer bitstream

[00142]${\stackrel{⌣}{B}}_{BASE}\left(k-2\right)$

, Enhancement Layer bitstream

[00143]${\stackrel{⌣}{B}}_{ENH}\left(k-2\right)$

and mode indication into a single bitstream.

[0117] In one embodiment, said dominant direction estimation is dependent on a directional power distribution of the energetically dominant HOA components.

[0118] In one embodiment, in modifying the ambient HOA component, a fade in and fade out of coefficient sequences is performed if the HOA sequence indices of the chosen HOA coefficient sequences vary between successive frames.

[0119] In one embodiment, in modifying the ambient HOA component, a partial decorrelation of the ambient HOA component C.sub.AMB(k - 1) is performed.

[0120] In one embodiment, quantized direction comprised in the first tuple sets M.sub.DIR(k) is a dominant direction.

[0121] FIG. 9 shows a flow-chart of a method for decompressing a compressed HOA signal.

[0122] In this embodiment of the invention, the method 900 for decompressing a compressed HOA signal comprises perceptual decoding and source decoding and subsequent spatial HOA decoding to obtain output time frames

[00144]$\stackrel{⌢}{C}\left(k-1\right)$

of HOA coefficient sequences, and the method comprises a step of detecting 901 a layered mode indication LMF.sub.D indicating that the compressed Higher Order Ambisonics (HOA) signal comprises a compressed base layer bitstream

[00145]${\stackrel{⌣}{B}}_{BASE}\left(k\right)$

and a compressed enhancement layer bitstream

[00146]${\stackrel{⌣}{B}}_{ENH}\left(k\right)$

.

[0123] The perceptual decoding and source decoding comprises steps of: [0124] demultiplexing 902 the compressed base layer bitstream , wherein first perceptually encoded transport signals and first encoded side information are obtained; [0125] demultiplexing 903 the compressed enhancement layer bitstream , wherein second perceptually encoded transport signals and second encoded side information are obtained; [0126] perceptually decoding 904 the perceptually encoded transport signals , wherein perceptually decoded transport signals are obtained, and wherein in a Base Layer Perceptual Decoder 540 said first perceptually encoded transport signals of the base layer are decoded and first perceptually decoded transport signals are obtained, and wherein in an Enhancement Layer Perceptual Decoder 550 said second perceptually encoded transport signals of the enhancement layer are decoded and second perceptually decoded transport signals are obtained; [0127] decoding 905 the first encoded side information in a Base Layer Side Information Source Decoder 530, wherein first exponents e.sub.i(k), i = 1, ..., O.sub.MIN and first exception flags β.sub.i(k), i = 1, ..., O.sub.MIN are obtained; and [0128] decoding 906 the second encoded side information in an Enhancement Layer Side Information Source Decoder 560, wherein second exponents e.sub.i(k), i = O.sub.MIN + 1, ...,I and second exception flags β.sub.i(k), i = O.sub.MIN + 1, ..., I are obtained, and wherein further data are obtained 907, the further data comprising a first tuple set M.sub.DIR(k + 1) for directional signals and a second tuple set M.sub.VEC(k + 1) for vector based signals, each tuple of the first tuple set M.sub.DIR(k + 1) comprising an index of a directional signal and a respective quantized direction, and each tuple of the second tuple set M.sub.VEC(k + 1) comprising an index of a vector based signal and a vector defining the directional distribution of the vector based signal, and further wherein prediction parameters ξ(k+1) 908 and an ambient assignment vector ν.sub.AMB,ASSIGN(k) 909 are obtained. The ambient assignment vector ν.sub.AMB,ASSIGN(k) comprises components that indicate for each transmission channel if and which coefficient sequence of the ambient HOA component it contains.

[0129] The spatial HOA decoding comprises steps of: [0130] performing 910 inverse gain control, wherein said first perceptually decoded transport signals are transformed into first gain corrected signal frames , according to said first exponents e.sub.i(k), i = 1, ..., O.sub.MIN and said first exception flags β.sub.i(k), i = 1, ..., O.sub.MIN, and wherein said second perceptually decoded transport signals are transformed into second gain corrected signal frames according to said second exponents e.sub.i(k), i = O.sub.MIN + 1, ..., I and said second exception flags (β.sub.i(k), i = O.sub.MIN + 1, ..., I; [0131] redistributing 911 in a Channel Reassignment block 605 the first and second gain corrected signal frames to l channels, wherein frames of predominant sound signals are reconstructed, the predominant sound signals comprising directional signals and vector based signals, and wherein a modified ambient HOA component is obtained, and wherein the assigning is made according to said ambient assignment vector ν.sub.AMB,ASSIGN(k) and to information in said first and second tuple sets M.sub.DIR(k + 1), M.sub.VEC(k + 1); [0132] generating 911b in the Channel Reassignment block 605 a first set of indices of coefficient sequences of the modified ambient HOA component that are active in the k.sup.th frame, and a second set of indices of coefficient sequences of the modified ambient HOA component that have to be enabled, disabled and to remain active in the (k-1).sup.th frame; [0133] synthesizing 912 in the Predominant Sound Synthesis block 606 a HOA representation of the predominant HOA sound components from said predominant sound signals , wherein the first and second tuple sets M.sub.DIR(k + 1), M.sub.VEC(k + 1)), the prediction parameters ξ(k+1) and the second set of indices are used; [0134] synthesizing 913 in the Ambient Synthesis block 607 an ambient HOA component from the modified ambient HOA component , wherein an inverse spatial transform for the first O.sub.MIN channels is made and wherein the first set of indices is used, the first set of indices being indices of coefficient sequences of the ambient HOA component that are active in the k.sup.th frame, wherein the ambient HOA component has one of at least two different configurations, depending on the layered mode indication LMF.sub.D; and [0135] adding 914 the HOA representation of the predominant HOA sound components and the ambient HOA component in a HOA Composition block 608, wherein coefficients of the HOA representation of the predominant sound signals and corresponding coefficients of the ambient HOA component are added, and wherein the decompressed HOA signal is obtained, and wherein the following conditions apply: [0136] if the layered mode indication LMF.sub.D indicates a layered mode with at least two layers, only the highest l-O.sub.MIN coefficient channels are obtained by addition of the predominant HOA sound components and the ambient HOA component , and the lowest O.sub.MIN coefficient channels of the decompressed HOA signal are copied from the ambient HOA component . Otherwise, if the layered mode indication LMF.sub.D indicates a single-layer mode, all coefficient channels of the decompressed HOA signal are obtained by addition of the predominant HOA sound components and the ambient HOA component .

[0137] The configuration of the ambient HOA component in dependence of the layered mode indication LMF.sub.D is as follows:

[0138] If the layered mode indication LMF.sub.D indicates a layered mode with at least two layers, the ambient HOA component comprises in its O.sub.MIN lowest positions HOA coefficient sequences of the decompressed HOA signal

[00186]$\stackrel{⌢}{C}\left(k-1\right)$

, and in remaining higher positions coefficient sequences being part of an HOA representation of a residual between the decompressed HOA signal

[00187]$\stackrel{⌢}{C}\left(k-1\right)$

and the HOA representation of the predominant HOA sound components

[00188]${\stackrel{⌢}{C}}_{PS}\left(k-1\right)$

.

[0139] On the other hand, if the layered mode indication LMF.sub.D indicates a single-layer mode, the ambient HOA component is a residual between the decompressed HOA signal

[00189]$\stackrel{⌢}{C}\left(k-1\right)$

and the HOA representation of the predominant HOA sound components

[00190]${\stackrel{⌢}{C}}_{PS}\left(k-1\right)$

.

[0140] In one embodiment, the compressed HOA signal representation is in a multiplexed bitstream, and the method for decompressing the compressed HOA signal further comprises an initial step of demultiplexing the compressed HOA signal representation, wherein said compressed base layer bitstream

[00191]${\stackrel{⌣}{B}}_{BASE}\left(k\right)$

, said compressed enhancement layer bitstream

[00192]${\stackrel{⌣}{B}}_{ENH}\left(k\right)$

and said layered mode indication LMF.sub.D are obtained.

[0141] FIG. 10 shows details of parts of an architecture of a spatial HOA decoding portion of a HOA decompressor according to one embodiment of the invention.

[0142] Advantageously, it is possible to decode only the BL, e.g. if no EL is received or if the BL quality is sufficient. For this case, signals of the EL can be set to zero at the decoder. Then, the redistributing 911 the first and second gain corrected signal frames

[00193]${\stackrel{⌢}{y}}_i\left(k\right),i=1,\mathrm{...},I$

to l channels in the Channel Reassignment block 605 is very simple, since the frames of predominant sound signals

[00194]${\stackrel{⌢}{X}}_{PS}(k)$

are empty. The second set of indices

[00195]$J_{\text{E}}\left(k-1\right),J_{\text{D}}\left(k-1\right),J_{\text{U}}\left(k-1\right)$

of coefficient sequences of the modified ambient HOA component that have to be enabled, disabled and to remain active in the (k-1).sup.th frame are set to zero. The synthesizing 912 the HOA representation of the predominant HOA sound components

[00196]${\stackrel{⌢}{C}}_{PS}\left(k-1\right)$

from the predominant sound signals

[00197]${\stackrel{⌢}{X}}_{PS}\left(k\right)$

in the Predominant Sound Synthesis block 606 can therefore be skipped, and the synthesizing 913 an ambient HOA component

[00198]${\stackrel{⌢}{\tilde{C}}}_{AMB}\left(k-1\right)$

from the modified ambient HOA component

[00199]$\tilde{C}{}_{I,AMB}\left(k\right)$

in the Ambient Synthesis block 607 corresponds to a conventional HOA synthesis.

[0143] The original (ie. monolithic, non-scalable, non-layered) mode for the HOA compression may still be useful for applications where a low quality base layer bit stream is not required, e.g. for file based compression. A major advantage of perceptually coding the spatially transformed first O.sub.MIN coefficient sequences of the ambient HOA component C.sub.AMB, which is a difference between the original and the directional HOA representation, instead of the spatially transformed coefficient sequences of the original HOA component C, is that in the former case the cross correlations between all signals to be perceptually coded are reduced. Any cross correlations between the signals z.sub.i, i = 1, ..., I may cause a constructive superposition of the perceptual coding noise during the spatial decoding process, while at the same time the noise-free HOA coefficient sequences are canceled at superposition. This phenomenon is known as perceptual noise unmasking.

[0144] In the layered mode, there are high cross correlations between each of the signals z.sub.i, i = 1, ..., O.sub.MIN and also between the signals z.sub.i, i = 1, ..., O.sub.MIN and z.sub.i, i = O.sub.MIN + 1, ..., I, because the modified coefficient sequences of the ambient HOA component

[00200]${\tilde{c}}_{\text{AMB,}n},n=1,\mathrm{...},O_{\text{MIN}}$

include signals of the directional HOA component (see eq.(3)). To the contrary, this is not the case for the original, non-layered mode. It can therefore be concluded that the transmission robustness introduced by the layered mode may come at the expense of compression quality. However, the reduction in compression quality is low compared to the increase in transmission robustness. As has been shown above, the proposed layered mode is advantageous in at least the situations described above.

[0145] While there has been shown, described, and pointed out fundamental novel features of the present invention as applied to preferred embodiments thereof, it will be understood that various omissions and substitutions and changes in the apparatus and method described, in the form and details of the devices disclosed, and in their operation, may be made by those skilled in the art without departing from the spirit of the present invention.. It is expressly intended that all combinations of those elements that perform substantially the same function in substantially the same way to achieve the same results are within the scope of the invention. Substitutions of elements from one described embodiment to another are also fully intended and contemplated.

[0146] It will be understood that the present invention has been described purely by way of example, and modifications of detail can be made without departing from the scope of the invention.

[0147] Each feature disclosed in the description and (where appropriate) the claims and drawings may be provided independently or in any appropriate combination. Features may, where appropriate be implemented in hardware, software, or a combination of the two. Connections may, where applicable, be implemented as wireless connections or wired, not necessarily direct or dedicated, connections.

[0148] Reference numerals appearing in the claims are by way of illustration only and shall have no limiting effect on the scope of the claims.

Cited References

[0149] [1] EP12306569.0 [0150] [2] EP12305537.8 (published as EP2665208A) [0151] [3] EP133005558.2 [0152] [4] ISO/IEC JTC1/SC29/WG11 N14264. Working draft 1-HOA text of MPEG-H 3D audio, January 2014