Audio encoding device and method

Abstract

A method and a device encode N audio signals, from N microphones where N≥3. For each pair of the N audio signals an angle of incidence of direct sound is estimated. A-format direct sound signals are derived from the estimated angles of incidence by deriving from each estimated angle an A-format direct sound signal. Each A-format direct sound signal is a first-order virtual microphone signal, for example, a cardioids signal.

Claims

1. An audio encoding device, for encoding N audio signals, from N microphones where N≥3, the audio encoding device comprising: a delay estimator configured to estimate angles of incidence of direct sound by estimating, for each pair of the N audio signals, an angle of incidence of the direct sound, and a beam deriver configured to derive A-format direct sound signals from the estimated angles of incidence by deriving, from each of the estimated angles of incidence, a respective one of the A-format direct sound signals, each of the A-format direct sound signals being a first-order virtual microphone signal; and an encoder configured to encode the A-format direct sound signals in first-order ambisonic B-format direct sound signals by applying a transformation matrix to the A-format direct sound signals, wherein N=3, wherein the audio encoding device comprises a short time Fourier transformer configured to perform a short time Fourier transformation on each of the N audio signals x.sub.1, x.sub.2, x.sub.3, resulting in N short time Fourier transformed audio signals X.sub.1[k,i], X.sub.2[k,i], X.sub.3[k,i], wherein the delay estimator is configured to: determine cross spectra of each pair of the short time Fourier transformed audio signals according to:
X.sub.12[k,i]=α.sub.XX.sub.1[k,i]X*.sub.2[k,i]+(1−α.sub.X)X.sub.12[k−1,i],
X.sub.13[k,i]=α.sub.XX.sub.1[k,i]X*.sub.3[k,i]+(1−α.sub.X)X.sub.13[k−1,i], and
X.sub.23[k,i]=α.sub.XX.sub.2[k,i]X*.sub.3[k,i]+(1−α.sub.X)X.sub.23[k−1,i], determine an angle of the complex cross spectrum of each pair of the short time Fourier transformed audio signals according to: ${\tilde{\psi }}_{12}\left[k,i\right]=\arctan j\frac{X_{12}\left[k,i\right]X_{12}^{*}\left[k,i\right]}{X_{12}\left[k,i\right]+X_{12}^{*}\left[k,i\right]},{\tilde{\psi }}_{13}\left[k,i\right]=\arctan j\frac{X_{13}\left[k,i\right]X_{13}^{*}\left[k,i\right]}{X_{13}\left[k,i\right]+X_{13}^{*}\left[k,i\right]},\mathrm{and}$ ${\tilde{\psi }}_{23}\left[k,i\right]=\arctan j\frac{X_{23}\left[k,i\right]X_{23}^{*}\left[k,i\right]}{X_{23}\left[k,i\right]+X_{23}^{*}\left[k,i\right]},$ perform a phase unwrapping to {tilde over (ψ)} .sub.12 , {tilde over (ψ)} .sub.13 , {tilde over (ψ)} .sub.23 , resulting in ψ.sub.12 , ψ.sub.13 , ψ.sub.23 , estimate the delay in number of samples according to:
δ.sub.12[k,i]=(N.sub.STFT/2+1)/(iπ)ψ.sub.12[k,i],
δ.sub.13[k,i]=(N.sub.STFT/2+1)/(iπ)ψ.sub.13[k,i], and
δ.sub.23[k,i]=(N.sub.STFT/2+1)/(iπ)ψ.sub.23[k,i], if i≤i.sub.alias or
δ.sub.12[k,i]=(N.sub.STFT/2+1)/(iπ)Ψ.sub.12[k,i],
δ.sub.13[k,i]=(N.sub.STFT/2+1)/(iπ)Ψ.sub.13[k,i], and
δ.sub.23[k,i]=(N.sub.STFT/2+1)/(iπ)Ψ.sub.23[k,i], if i>i.sub.alias estimate the delay in seconds according to: ${\tau }_{12}\left[k,i\right]=\frac{{\delta }_{12}\left[k,i\right]}{f_s},{\tau }_{13}\left[k,i\right]=\frac{{\delta }_{13}\left[k,i\right]}{f_s},\mathrm{and}$ ${\tau }_{23}\left[k,i\right]=\frac{{\delta }_{23}\left[k,i\right]}{f_s},$ and estimate the angles of incidence according to: ${\theta }_{12}\left[k,i\right]=\arcsin \left(\frac{c{\tau }_{12}\left[k,i\right]}{d_{\mathrm{mic}}}\right),{\theta }_{13}\left[k,i\right]=\arcsin \left(\frac{c{\tau }_{13}\left[k,i\right]}{d_{\mathrm{mic}}}\right),\mathrm{and}$ ${\theta }_{23}\left[k,i\right]=\arcsin \left(\frac{c{\tau }_{23}\left[k,i\right]}{d_{\mathrm{mic}}}\right),$ and wherein: x.sub.1 is a first audio signal of the N audio signals, x.sub.2 is a second audio signal of the N audio signals, x.sub.3 is a third audio signal of the N audio signals, X.sub.1 is a first short time Fourier transformed audio signal of the short time Fourier transformed audio signals, X.sub.2 is a second short time Fourier transformed audio signal of the short time Fourier transformed audio signals, X.sub.3 is a third short time Fourier transformed audio signal of the short time Fourer transformed audio signals, k is a frame of the short time Fourier transformed audio signals, and i is a frequency bin of the short time Fourier transformed audio signals, X.sub.12 is a cross spectrum of a pair of X.sub.1 and X.sub.2, X.sub.13 is a cross spectrum of a pair of X.sub.1 and X.sub.3, X.sub.23 is a cross spectrum of a pair of X.sub.2 and X.sub.3, α.sub.X is a forgetting factor, X* is a conjugate complex of X, j is the imaginary unit, {tilde over (ψ)} .sub.12 is an angle of the complex cross spectrum of X.sub.12, {tilde over (ψ)} .sub.13 is an angle of the complex cross spectrum of X.sub.13, {tilde over (ψ)} .sub.23 is an angle of the complex cross spectrum of X.sub.23, i.sub.alias is a frequency bin corresponding to an aliasing frequency, f.sub.s is a sampling frequency, d.sub.mic is a distance of the microphones, and c is the speed of sound.

2. The audio encoding device according to claim 1, wherein the beam deriver is configured to: determine cardioid directional responses according to: $D_{12}\left[k,i\right]=\frac{1}{2}\left(1+\cos \left({\theta }_{12}\left[k,i\right]-\frac{\pi }{2}\right)\right),D_{13}\left[k,i\right]=\frac{1}{2}\left(1+\cos \left({\theta }_{13}\left[k,i\right]-\frac{\pi }{2}\right)\right),\mathrm{and}$ $D_{13}\left[k,i\right]=\frac{1}{2}\left(1+\cos \left({\theta }_{23}\left[k,i\right]-\frac{\pi }{2}\right)\right),$ and derive the A-format direct sound signals according to:
A.sub.12[k,i]=D.sub.12[k,i]X.sub.1[k,i],
A.sub.13[k,i]=D.sub.13[k,i]X.sub.1[k,i], and
A.sub.23[k,i]=D.sub.23[k,i]X.sub.1[k,i], wherein: D is a cardioid directional response, and A is an A-format direct sound signal of the A-format direct sound signals.

3. The audio encoding device according to claim 2, wherein the encoder is configured to encode the A-format direct sound signals to the first-order ambisonic B-format direct sound signals according to: $\left[\begin{array}{c}{R}_W\\ R_X\\ R_Y\end{array}\right]={\Gamma }^{-1}\left[\begin{array}{c}{A}_{12}\\ A_{13}\\ A_{23}\end{array}\right],$ wherein: R.sub.w is a first, zero-order ambisonic B-format direct sound signal, R.sub.x is a first, first-order ambisonic B-format direct sound signal among the first-order ambisonic B-format direct sound signals, R.sub.y is a second, first-order ambisonic B-format direct sound signal among the first-order ambisonic B-format direct sound signals, and Γ.sup.−1 is the transformation matrix.

4. The audio encoding device according to claim 1, comprising a direction of arrival estimator configured to estimate a direction of arrival from the first-order ambisonic B-format direct sound signals, and a higher order ambisonic encoder configured to encode higher order ambisonic B-format direct sound signals using the first-order ambisonic B-format direct sound signals and the estimated direction of arrival, wherein higher order ambisonic B-format direct sound signals have an order higher than one.

5. The audio encoding device according to claim 4, wherein the direction of arrival estimator is configured to estimate the direction of arrival according to: ${\theta }_{\mathrm{XY}}\left[k,i\right]=\arctan \frac{R_Y\left[k,i\right]}{R_X\left[k,i\right]},$ and wherein θ.sub.XY [k,i] is the direction of arrival of the direct sound of frame k and frequency bin i.

6. The audio encoding device according to claim 5, wherein the higher order ambisonic B-format direct sound signals comprise second order ambisonic B-format direct sound signals limited to two dimensions, wherein the higher order ambisonic encoder is configured to encode the second order ambisonic B-format direct sound signals according to: $R_R\underset{=}{\Delta }\left(3{\sin }^2\varphi -1\right)/2=-1/2,$ $R_S\underset{=}{\Delta }\sqrt{3}/2\cos \mathrm{\theta sin}2\varphi =0,$ $R_T\underset{=}{\Delta }\sqrt{3}/2\sin \theta \sin 2\varphi =0,$ $R_U\underset{=}{\Delta }\sqrt{3}/2\cos 2\theta {\cos }^2\varphi =\sqrt{3}/2\cos 2{\theta }_{XY},\mathrm{and}$ $R_V\underset{=}{\Delta }\sqrt{3}/2\sin 2\theta {\cos }^2\varphi =\sqrt{3}/2\sin 2{\theta }_{XY},$ and wherein: R.sub.R is a first, second-order ambisonic B-format direct sound signal among the second order ambisonic B-format direct signals, R.sub.S is a second, second-order ambisonic B-format direct sound signal among the second order ambisonic B-format direct signals, R.sub.T is a third, second-order ambisonic B-format direct sound signal among the second order ambisonic B-format direct signals, R.sub.U is a fourth, second-order ambisonic B-format direct sound signal among the second order ambisonic B-format direct signals, R.sub.V is a fifth, second-order ambisonic B-format direct sound signal among the second order ambisonic B-format direct signals, denotes “defined as”, Φ is an elevation angle, and θ is an azimuth angle.

7. The audio encoding device according to claim 1, comprising a microphone matcher configured to perform a matching of the N frequency domain audio signals, resulting in N matched frequency domain audio signals.

8. The audio encoding device according to claim 7, comprising a diffuse sound estimator configured to estimate a diffuse sound power, and a de-correlation filter bank configured to perform a de-correlation of the diffuse sound power by generating three orthogonal diffuse sound components from the diffuse sound estimate power.

9. The audio encoding device according to claim 8, wherein the diffuse sound estimator is configured to estimate the diffuse sound power according to: $A=1-{\Phi }_{\mathrm{diff}}^2,B=2{\Phi }_{\mathrm{diff}}E\left\{X_1{X}_2^{*}\right\}-E\left\{X_1{X}_1^{*}\right\}-E\left\{X_2{X}_2^{*}\right\},C=E\left\{X_1{X}_1^{*}\right\}E\left\{X_2{X}_2^{*}\right\}-E{\left\{X_1{X}_2^{*}\right\}}^2,\mathrm{and}$ $P_{\mathrm{diff}}\left[k,i\right]=\frac{-B-\sqrt{B^2-4\mathrm{AC}}}{2A},$ wherein: P.sub.diff is the diffuse sound power, E{ } is an expectation value, Φ.sup.2.sub.diff is a normalized cross-correlation coefficient between N.sub.1 and N.sub.2, N.sub.1 is diffuse sound in a first channel, and N.sub.2 is diffuse sound in a second channel.

10. The audio encoding device according to claim 9, wherein the de-correlation filter bank is configured to perform the de-correlation of the diffuse sound power by generating three orthogonal diffuse sound components from the diffuse sound estimate power:
{tilde over (D)}.sub.W[k,i]=DFR.sub.Ww.sub.uU.sub.1P.sub.2D-diff[k,i],
{tilde over (D)}.sub.X[k,i]=DFR.sub.Xw.sub.uU.sub.2P.sub.2D-diff[k,i], and
{tilde over (D)}.sub.Y[k,i]=DFR.sub.Yw.sub.uU.sub.3P.sub.2D-diff[k,i], wherein: ${\mathrm{DFR}}_a\stackrel{\Delta }{=}\frac{1}{4\pi }\underset{-\frac{\pi }{2}}{\overset{\frac{\pi }{2}}{\int }}\underset{-\pi }{\overset{\pi }{\int }}{.Math.R_a\left(\theta ,\varphi \right).Math.}^2\cos \varphi d\theta d\varphi ,R_X\left(\theta ,\varphi \right)=\cos \varphi \cos \theta ,R_Y\left(\theta ,\varphi \right)=\cos \varphi \sin \theta ,R_W\left(\theta ,\varphi \right)=1,\mathrm{and}$ $w_u\left[n\right]=\exp \left(-\frac{0.5\ln 1e6.Math.n.Math.}{f_s{\mathrm{RT}}_{60}}\right)\mathrm{with}-l_u<n<l_u,$ wherein {tilde over (D)}.sub.W[k,i] is a first channel diffuse sound component, wherein {tilde over (D)}.sub.X[k,i] is second channel diffuse sound component, wherein {tilde over (D)}.sub.Y[k,i] is third channel diffuse sound component, DFR.sub.W is a diffuse-field response of the first channel, DFR.sub.X is a diffuse-field response of the second channel, DFR.sub.Y is a diffuse-field response of the third channel, w.sub.u is an exponential window, RT.sub.60 is a reverberation time, U.sub.1,U.sub.2,U.sub.3 is the de-correlation filter bank, u is a Gaussian noise sequence, l.sub.u is a given length of the Gaussian noise sequence, and P.sub.2D-diff is the diffuse noise power.

11. The audio encoding device according to claim 1, comprising an adder, which is configured to add channel-wise, the first-order ambisonic B-format direct sound signals and the higher order ambisonic B-format direct sound signals, and/or the diffuse sound signals, resulting in complete ambisonic B-format signals.

12. The audio encoding device according to claim 1, wherein delay estimator configured to estimate the angle of incidence for each pair of the N audio signal based on a travelling time delay between the pair of audio signals.

13. The audio encoding device according to claim 1, wherein delay estimator configured to estimate the angle of incidence for each pair of the N audio signal based on a delay in second and a delay in samples between the pair of audio signals.

14. An audio recording device comprising the N microphones configured to record the N audio signals, and the audio encoding device according to claim 1.

15. A method for encoding N audio signals, from N microphones where N≤3, the method comprising: estimating angles of incidence of direct sound by estimating for each pair of the N audio signals an angle of incidence of the direct sound, deriving A-format direct sound signals from the estimated angles of incidence by deriving, from each of the estimated angles of incidence, a respective one of the A-format direct sound signals, each of the A-format direct sound signals being a first-order virtual microphone signal, and encoding the A-format direct sound signals in first-order ambisonic B-format direct sound signals by applying a transformation matrix to the A-format direct sound signals, wherein N=3, wherein the encoding further comprises performing a short time Fourier transformation on each of the N audio signals x.sub.1, x.sub.2, x.sub.3, resulting in N short time Fourier transformed audio signals X.sub.1[k,j], X.sub.2[k,j], X.sub.3[k,j], wherein the method further comprises: determining cross spectra of each pair of the short time Fourier transformed audio signals according to:
X.sub.12[k,i]=α.sub.XX.sub.1[k,i]X.sub.2.sup.*[k,i]+(1−α.sub.X)X.sub.12[k−1,i],
X.sub.13[k,i]=α.sub.XX.sub.1[k,i]X.sub.3.sup.*[k,i]+(1−α.sub.X)X.sub.13[k−1,i], and
X.sub.23[k,i]=α.sub.XX.sub.2[k,i]X.sub.3.sup.*[k,i]+(1−α.sub.X)X.sub.23[k−1,i], determining an angle of the complex cross spectrum of each pair of the short time Fourier transformed audio signals according to: ${\tilde{\psi }}_{12}\left[k,i\right]=\arctan j\frac{X_{12}\left[k,i\right]X_{12}^{*}\left[k,i\right]}{X_{12}\left[k,i\right]+X_{12}^{*}\left[k,i\right]},{\tilde{\psi }}_{13}\left[k,i\right]=\arctan j\frac{X_{13}\left[k,i\right]X_{13}^{*}\left[k,i\right]}{X_{13}\left[k,i\right]+X_{13}^{*}\left[k,i\right]},\mathrm{and}{\tilde{\psi }}_{23}\left[k,i\right]=\arctan j\frac{X_{23}\left[k,i\right]X_{23}^{*}\left[k,i\right]}{X_{23}\left[k,i\right]+X_{23}^{*}\left[k,i\right]},$ performing a phase unwrapping to {tilde over (ψ)} .sub.12 {tilde over (ψ)} .sub.13 {tilde over (ψ)} .sub.23 , resulting in ψ.sub.12 ψ.sub.13 ψ.sub.23 estimating the delay in number of samples according to:
δ.sub.12[k,i]=(N.sub.STFT/2+1)/(iπ)ψ.sub.12[k,i],
δ.sub.13[k,i]=(N.sub.STFT/2+1)/(iπ)ψ.sub.13[k,i],
δ.sub.23[k,i]=(N.sub.STFT/2+1)/(iπ)ψ.sub.23[k,i], if i≤i.sub.alias
or
δ.sub.12[k,i]=(N.sub.STFT/2+1)/(iπ)Ψ.sub.12[k,i],
δ.sub.13[k,i]=(N.sub.STFT/2+1)/(iπ)Ψ.sub.13[k,i],
δ.sub.23[k,i]=(N.sub.STFT/2+1)/(iπ)Ψ.sub.23[k,i], if i>i.sub.alias estimating the delay in seconds according to: ${\tau }_{12}\left[k,i\right]=\frac{{\delta }_{12}\left[k,i\right]}{f_s},$ ${\tau }_{13}\left[k,i\right]=\frac{{\delta }_{13}\left[k,i\right]}{f_s},\mathrm{and}$ ${\tau }_{23}\left[k,i\right]=\frac{{\delta }_{23}\left[k,i\right]}{f_s}$ and estimating the angles of incidence according to: ${\theta }_{12}\left[k,i\right]=\arcsin \left(\frac{c{\tau }_{12}\left[k,i\right]}{d_{mic}}\right),$ ${\theta }_{13}\left[k,i\right]=\arcsin \left(\frac{c{\tau }_{13}\left[k,i\right]}{d_{mic}}\right),\mathrm{and}$ ${\theta }_{23}\left[k,i\right]=\arcsin \left(\frac{c{\tau }_{23}\left[k,i\right]}{d_{mic}}\right),$ and wherein: x.sub.1 is a first audio signal of the N audio signals, x.sub.2 is a second audio signal of the N audio signals, x.sub.3 is a third audio signal of the N audio signals, X.sub.1 is a first short time Fourier transformed audio signal of the short time Fourier transformed audio signals, X.sub.2 is a second short time Fourier transformed audio signal of the short time Fourier transformed audio signals, X.sub.3 is a third short time Fourier transformed audio signal of the short time Fourer transformed audio signals, k is a frame of the short time Fourier transformed audio signals, and i is a frequency bin of the short time Fourier transformed audio signals, X.sub.12 is a cross spectrum of a pair of X.sub.1 and X.sub.2, X.sub.13 is a cross spectrum of a pair of X.sub.1 and X.sub.3, X.sub.23 is a cross spectrum of a pair of X.sub.2 and X.sub.3, α.sub.x is a forgetting factor, X* is a conjugate complex of X, j is the imaginary unit, ψ.sub.12 is an angle of the complex cross spectrum of X.sub.12, ψ.sub.13 is an angle of the complex cross spectrum of X.sub.13, ψ.sub.23 is an angle of the complex cross spectrum of X.sub.23, i.sub.alias is a frequency bin corresponding to an aliasing frequency, f.sub.s is a sampling frequency, d.sub.mic is a distance of the microphones, and c is the speed of sound.

16. A non-transitory computer readable storage medium comprising a computer program with a program code, which is configured to be executed by a computer to cause the computer to perform the method according to claim 15.

Description

BRIEF DESCRIPTION OF DRAWINGS

(1) The present disclosure is in the following explained in detail in relation to embodiments of the present disclosure in reference to the enclosed drawings, in which:

(2) FIG. 1 shows a first embodiment of the audio encoding device according to the first aspect of the present disclosure and the audio recording device according to the second aspect of the present disclosure;

(3) FIG. 2 shows a second embodiment of the audio encoding device according to the first aspect of the present disclosure and the audio recording device according to the second aspect of the present disclosure;

(4) FIG. 3 shows a pair of microphones in a diagram depicting the determining of an angle of incidence of a sound event;

(5) FIG. 4 shows a third embodiment of the audio recording device according to the second aspect of the present disclosure;

(6) FIG. 5 shows A-format direct sound signals in a two-dimensional diagram;

(7) FIG. 6 shows B-format direct sound signals in a two-dimensional diagram;

(8) FIG. 7 shows diffuse sound received by two microphones;

(9) FIG. 8 shows direct sound and diffuse sound in a two-dimensional diagram;

(10) FIG. 9 shows an example of a de-correlation filter, as used by an audio encoding device according to a fourth embodiment of the first aspect; and

(11) FIG. 10 shows an embodiment of the third aspect of the present disclosure in a flow diagram.

DETAILED DESCRIPTION

(12) First, we demonstrate the construction and general function of an embodiment of the first aspect and second aspect of the present disclosure along FIG. 1. With regard to FIG. 2-FIG. 9, further details of the construction and function of the first embodiment and the second embodiment are shown. With regard to FIG. 10, finally the function of an embodiment of the third aspect of the present disclosure is described in detail.

(13) In FIG. 1, a first embodiment of the audio encoding device 3 is shown. Moreover, a first embodiment of the audio recording device 1 according to the second aspect of the present disclosure is shown.

(14) The audio recording device 1 comprises a number of N≥3 microphones 2, which are connected to the audio encoding device 3. The audio encoding device 3 comprises a delay estimator 11, which is connected to the microphones 2. The audio encoding device 3 moreover comprises a beam deriver 12, which is connected to the delay estimator. Furthermore, the audio encoding device 3 comprises an encoder 13, which is connected to the beam deriver 12. Note that the encoder 13 is an optional feature with regard to the first aspect of the present disclosure.

(15) In order to determine ambisonic B-format direct sound signals, the microphones 2 record N≥3 audio signals. These audio signals are preprocessed by components integrated into the microphones 2, in this diagram. For example, a transformation into the frequency domain is performed. This will be shown in more detail along FIG. 2. The preprocessed audio signals are handed to the delay estimator 11, which estimates angles of incidence of direct sound by estimating for each pair of the N audio signals and angle of incidence of direct sound. These angles of incidence of direct sound are handed to the beam deriver 12, which derives A-format direct sound signals therefrom. Each A-format direct sound signal is a first-order virtual microphone signal, especially a cardioid signal. These signals are handed on to the encoder 13, which encodes the A-format direct sound signals to first-order ambisonic B-format direct sound signals by applying a transformation matrix to the A-format direct sound signals. The encoder outputs the first-order ambisonic B-format direct sound signals.

(16) In FIG. 2, a second embodiment of the audio encoding device 3 and the audio recording device 1 are shown. Here, the individual microphones 2a, 2b, 2c, which correspond to the microphones 2 of FIG. 1, are shown. Each of the microphones 2a, 2b, 2c is connected to a short-time Fourier transformer 10a, 10b, 10c, which each performs a short-time Fourier transformation of the N audio signals resulting in N short-time Fourier transformed audio signals. These are handed on to the delay estimator 11, which performs the delay estimation and hands the angles of incidence to the beam deriver 12. The beam deriver 12 determines the A-format direct sound signals and hands them to the encoder 13, which performs the encoding to B-format direct sound signals. In FIG. 2, further components of the audio encoding device 3 are shown. Here, the audio encoding device 3 moreover comprises a direction-of-arrival estimator 20, which is connected to the encoder 13. Moreover, it comprises a higher order ambisonic encoder 21, which is connected to the direction-of-arrival estimator 20.

(17) The direction-of-arrival estimator 20 estimates a direction of arrival from the first-order ambisonic B-format direct sound signals and hands it to the higher order ambisonic encoder 21. The higher order ambisonic encoder 21 encodes higher order ambisonic B-format direct sound signals, using the first-order ambisonic B-format direct sound signals and the estimated direction of arrival as an input. The higher order ambisonic B-format direct sound signals have a higher order than 1.

(18) Moreover, the audio encoding device 3 comprises a microphone matcher 30, which performs a matching of the N frequency domain audio signals output by the short-time Fourier transformers 10a, 10b, 10c resulting in N match frequency domain audio signals. Connected to the microphone matcher 30, the audio encoding device 3 moreover comprises a diffuse sound estimator 31, which is configured to estimate a diffuse sound power based upon the N match frequency domain audio signals. Furthermore, the audio encoding device 3 comprises a de-correlation filter bank 32, which is connected to the diffuse sound estimator 31 and configured to perform a de-correlation of the diffuse sound power by generating three orthogonal diffuse sound components from the diffuse sound estimate power.

(19) Finally, the audio encoding device 3 comprises an adder 40, which adds the first-order B-format direct sound signals provided by the encoder 13, the higher order ambisonic B-format signals provided by the higher order encoder 21 and the diffuse sound components provided by the de-correlation filter bank 32. The sum signal is handed to an inverse short-time Fourier transformer 41, which performs an inverse short-time Fourier transformation to achieve the final ambisonic B-format signals in the time domain.

(20) In the following, along FIG. 3-9, further details regarding the function of the individual components, shown in FIG. 2 are described.

(21) In FIG. 3, an angle of incidence, as it is determined by the delay estimator 11 is shown.

(22) Especially, the propagation of direct sound following a ray from a sound source to a pair of microphones in the free-field is considered in FIG. 3.

(23) In FIG. 4, an example of an audio recording device 1 is shown in a two-dimensional diagram. The three microphones 2a, 2b, 2c are depicted in their actual physical location.

(24) The following algorithm aims at estimating the angle of incidence of direct sound based on cross-correlation between both recorded microphone signals x.sub.1 and x.sub.2, and derives parametrically gain filters to generate beams focusing in specific directions.

(25) A phase estimation, between both recording microphones, is carried out at each time-frequency tile. The microphone time-frequency representations, X.sub.1 and X.sub.2, of the microphone signals, are obtained using a N.sub.STFT points short-time Fourier transform (STFT). The delay relation between the two microphones can be derived from the cross-spectrum:
X.sub.12[k,i]=α.sub.XX.sub.1[k,i]X*.sub.2[k,i]+(1−α.sub.X)X.sub.12[k−1,i],  (2)
where * denotes the complex conjugate operator. And a.sub.x is determined by:

(26) $\begin{array}{cc}{\alpha }_X=\frac{N_{\mathrm{STFT}}}{T_X{f}_s},& \left(3\right)\end{array}$
where T.sub.X is an time-constant in seconds and f.sub.s is the sampling frequency. The phase response is defined as the angle of the complex cross-spectrum X.sub.12, derived as the ratio between the imaginary and the real part of it:

(27) $\begin{array}{cc}{\tilde{\psi }}_{12}\left[k,i\right]=\arctan j\frac{X_{12}\left[k,i\right]X_{12}^{*}\left[k,i\right]}{X_{12}\left[k,i\right]+X_{12}^{*}\left[k,i\right]},& \left(4\right)\end{array}$
where j is the imaginary unit, that satisfies j.sup.2=−1.

(28) Unfortunately, analogous to the Nyquist frequency in temporal sampling, a microphone array has a restriction on the minimum spatial sampling rate. Using two microphones, the smallest wavelength of interest is given by:
λ.sub.alias=2d.sub.mic  (5)
corresponding to a maximum frequency,

(29) $\begin{array}{cc}{f}_{\mathrm{alias}}=\frac{c}{{\lambda }_{\mathrm{alias}}},& \left(6\right)\end{array}$
up to which the phase estimation is unambiguous. Above this frequency, the measured phase is still obtained following (4) but with an uncertainty term related to an integer l modulo of 2π:
{tilde over (ψ)}.sub.12[k,i]=ψ.sub.12[k,i]+2π.Math.l[i].  (7)

(30) Because the maximum travelling time between the two microphones of the array is given by d.sub.mic/c, the bounds of integer l is defined by:

(31) $\begin{array}{cc}l\left[i\right]\le L\left[i\right]=\frac{{\mathrm{id}}_{\mathrm{mic}}{f}_s}{c\left(\frac{N_{\mathrm{STFT}}}{2}+1\right)},& \left(8\right)\end{array}$

(32) A high frequency extension is provided based in equation (8) to constrain an unwrapping algorithm. The unwrapping aims at correcting the phase angle {tilde over (ψ)}.sub.12[k,i] by adding a multiple l[k,i] of 2π when absolute jump between the two consecutive elements, |{tilde over (ψ)}.sub.12[k,i]−{tilde over (ψ)}.sub.12[k,i−1]|, are greater than or equal to the jump tolerance of π. The estimated unwrapped phase ψ.sub.12 is obtained by limiting the multiples l to their physical possible values. Eventually, even if the phase is aliased at high-frequency, its slope still follows the same principles as the delay estimation at low frequency. For the purpose of delay estimation, it is then sufficient to integrate the unwrapped phase ψ.sub.12 over a number of frequency bins in order to derive its slope for later delay

(33) $\begin{array}{cc}{\Psi }_{12}\left[k,i\right]=\frac{1}{2N_{\mathrm{hf}}}\underset{j=-N_{\mathrm{hf}}}{\overset{N_{\mathrm{hf}}}{.Math.}}{\psi }_{12}\left[k,i+j\right],& \left(9\right)\end{array}$
where N.sub.hf stands for the frequency bandwidth on which the phase is integrated.

(34) For each frequency bin i, dividing by the corresponding physical frequency, the delay δ.sub.12[k,i], expressed in number of samples, is obtained from the previously derived phase:
δ.sub.12[k,i]=(N.sub.STFT/2+1)/(iπ)ψ.sub.12[k,i] if i≤i.sub.alias

(35) otherwise:
δ.sub.12[k,i]=(N.sub.STFT/2+1)/(iπ)Ψ.sub.12[k,i],  (10)
where i.sub.alias is the frequency bin corresponding to the aliasing frequency (1). The delay in second is:

(36) $\begin{array}{cc}{\tau }_{12}\left[k,i\right]=\frac{{\delta }_{12}\left[k,i\right]}{f_s}.& \left(11\right)\end{array}$

(37) The derived delay relates directly to the angle of incidence of sound emitted by a sound source, as illustrated in FIG. 2. Given the travelling time delay between both microphones, the resulting angle of incidence θ.sub.12[k,i] is:

(38) $\begin{array}{cc}{\theta }_{12}\left[k,i\right]=\arcsin \left(\frac{c{\tau }_{12}\left[k,i\right]}{d_{\mathrm{mic}}}\right),& \left(12\right)\end{array}$
with d.sub.mic the distance between both microphones and c the celerity of sound in the air.

(39) In free-field, for direct sound, the directional response of a cardioid microphone pointing on the side of the array, is built as a function of the estimated angle of incidence:

(40) $\begin{array}{cc}D\left[k,i\right]=\frac{1}{2}\left(1+\cos \left({\theta }_{12}\left[k,i\right]-\frac{\pi }{2}\right)\right).& \left(13\right)\end{array}$

(41) By applying the gain D to the input spectrum X.sub.1, a virtual cardioid signal can be retrieved from the direct sound of the input microphone signals. This corresponds to the function of the beam estimator 12.

(42) In FIG. 5, three cardioid signals based upon three microphone pairs are depicted in a two-dimensional diagram, showing the respective gains.

(43) In FIG. 6, the gains of B-format ambisonic direct sound signals are shown in a two-dimensional diagram.

(44) In the following, the conversion from A-format direct sound signals to B-format direct sound signals is shown. This corresponds to the function of the encoder 13.

(45) In the following Table are listed the Ambisonic B-format channels and their spherical representation D(θ,ϕ) up to third-order, normalized with the Schmidt semi-normalization (SN3D), where θ and ϕ are, respectively, the azimuth and elevation angles:

(46) TABLE-US-00001 Order Channel SN3D Definition: D(θ, ϕ) = 0 W 1 1 X cos θcos ϕ Y sin θcos ϕ Z sin ϕ 2 R (3sin.sup.2 ϕ − 1)/2 S {square root over (3/2)} cosθsin2ϕ T {square root over (3/2)} sinθsin2ϕ U {square root over (3/2)} cos2θcos.sup.2 ϕ V {square root over (3/2)} sin2θcos.sup.2 ϕ 3 K sinϕ(5sin.sup.2 ϕ − 3)/2 L {square root over (3/8)} cosθcosϕ(5sin.sup.2 ϕ − 1) M {square root over (3/8)} sinθcosϕ(5sin.sup.2 ϕ − 1) N {square root over (15/2)} cos2θsinϕcos.sup.2 ϕ O {square root over (15/2)} sin2θsinϕcos.sup.2 ϕ P {square root over (5/8)} cos3θcos.sup.3 ϕ Q {square root over (5/8)} sin3θcos.sup.3 ϕ

(47) These spherical harmonics form a set of orthogonal basis functions and can be used to describe any function on the surface of a sphere.

(48) Without loss of generality, three, the minimum number of, microphones are considered and placed in the horizontal XY-plane, for instance disposed at the edges of a mobile device as illustrated in FIG. 3, having the coordinates (x.sub.m.sub.1, y.sub.m.sub.1), (x.sub.m.sub.2, y.sub.m.sub.2), and (x.sub.m.sub.3, y.sub.m.sub.3).

(49) The three possible unordered microphone pairs are defined as:
pair 1Δ=mic2.fwdarw.mic1
pair 2Δ=mic3.fwdarw.mic2
pair 3Δ=mic1.fwdarw.mic3

(50) The look direction (Θ=0) being defined by the X-axis, their direction vectors are:

(51) $\begin{array}{cc}{v}_{p_1}=\left(\begin{array}{c}{x}_{m_1}\\ y_{m_1}\end{array}\right)-\left(\begin{array}{c}{x}_{m_2}\\ y_{m_2}\end{array}\right),v_{p_2}=\left(x_{m_2},y_{m_2}\right)-\left(\begin{array}{c}{x}_{m_3}\\ y_{m_3}\end{array}\right),\mathrm{and}{v}_{p_3}=\left(\begin{array}{c}{x}_{m_3}\\ y_{m_3}\end{array}\right)-\left(x_{m_1},y_{m_1}\right).& \left(14\right)\end{array}$

(52) The direction for each of the pair in the horizontal plane are:

(53) 0$\begin{array}{cc}\forall n\in \left[1.\mathrm{.3}\right],{\theta }_{p_n}=\arctan \left(\frac{y_{v_{p_n}}}{x_{v_{p_n}}}\right).& \left(15\right)\end{array}$

(54) And the microphone spacing:

(55) $\begin{array}{cc}\forall n\in \left[1.\mathrm{.3}\right],{\partial }_{p_n}=\sqrt{x_{v_{p_n}}^2+y_{v_{p_n}}^2}.& \left(16\right)\end{array}$

(56) The gain (13) resulting from the angle of incidence estimation is applied to each pair leading to cardioid directional responses:
∀n∈[1 . . . 3],A.sub.p.sub.n[k,i]=D.sub.p.sub.n[k,i]X.sub.1[k,i].  (17)

(57) The three resulting cardioids are pointing in the three directions θ.sub.p.sub.1, θ.sub.p.sub.2, and θ.sub.p.sub.3, defining the corresponding A-format representation, as illustrated in FIG. 4.

(58) Assuming that the obtained cardioids are coincident, the corresponding first order Ambisonic B-format signals can be computed by means of linear combination of the spectra A.sub.p.sub.n, The conversion from Ambisonic B-format to A-format is implemented as:

(59) $\begin{array}{cc}\left[\begin{array}{c}{A}_{p_1}\\ A_{p_2}\\ A_{p_3}\end{array}\right]=\Gamma \left[\begin{array}{c}{R}_W\\ R_X\\ R_Y\end{array}\right]=\frac{1}{2}\left[\begin{array}{ccc}1& \cos {\theta }_{p_1}& \sin {\theta }_{p_1}\\ 1& \cos {\theta }_{p_2}& \sin {\theta }_{p_2}\\ 1& \cos {\theta }_{p_3}& \sin {\theta }_{p_3}\end{array}\right]\left[\begin{array}{c}{R}_W\\ R_X\\ R_Y\end{array}\right]& \left(18\right)\end{array}$

(60) The inverse matrix of (18) enables to convert the cardioids to Ambisonic B-format,

(61) $\begin{array}{cc}\left[\begin{array}{c}{R}_W\\ R_X\\ R_Y\end{array}\right]={\Gamma }^{-1}\left[\begin{array}{c}{A}_{p_1}\\ A_{p_2}\\ A_{p_3}\end{array}\right]& \left(19\right)\end{array}$

(62) The first order Ambisonic B-format normalized directional responses R.sub.W, R.sub.X, and R.sub.Y, are shown in FIG. 5, where R.sub.W corresponds to a monopole. while the signals R.sub.X and R.sub.Y correspond to two orthogonal dipoles.

(63) In the following, the determining of higher order ambisonic B-format signals is shown. This corresponds to the function of the direction-of-arrival estimator 20 and the higher order ambisonic encoder 21.

(64) Deriving previously, the first order ambisonic B-format signals R.sub.W, R.sub.X, and R.sub.Y for the direct sound, no explicit direction of arrival (DOA) of sound was computed. Instead the directional responses of the three signals R.sub.W, R.sub.X, and R.sub.Y have been obtained from the A-format cardioid signals A.sub.p.sub.n in (17).

(65) In order to obtain the higher order (e.g. second and third) ambisonic B-format signals, an explicit DOA is derived based on the two first order ambisonic B-format signals R.sub.X and R.sub.Y as:

(66) $\begin{array}{cc}{\theta }_{\mathrm{XY}}\left[k,i\right]=\arctan \frac{R_Y\left[k,i\right]}{R_X\left[k,i\right]}.& \left(20\right)\end{array}$

(67) Again, assuming three omnidirectional microphones in the horizontal plane (φ=0), the channels of interest as defined in the ambisonic definition in the Table are limited to: order 0: W order 1: X, Y order 2: R, U, V order 3: L, M, P, Q

(68) The other channels are null since they are modulated by sinφ, with φ=0. For each of the above listed channels the directional responses are thus derived by substituting the azimuth angle Θ by the estimated DOA Θ.sub.XY. For instance, considering second order (assuming no elevation, i.e. φ=0):

(69) $\begin{array}{cc}{R}_R\stackrel{\Delta }{=}\left(3{\sin }^2\varphi -1\right)\text{/}2=-1\text{/}2R_S\stackrel{\Delta }{=}\sqrt{3}\text{/}2\cos \theta \sin 2\varphi =0R_T\stackrel{\Delta }{=}\sqrt{3}\text{/}2\sin \theta \sin 2\varphi =0R_U\stackrel{\Delta }{=}\sqrt{3}\text{/}2\cos 2{\mathrm{\theta cos}}^2\varphi =\sqrt{3}\text{/}2\cos 2{\theta }_{\mathrm{XY}}{R}_V\stackrel{\Delta }{=}\sqrt{3}\text{/}2\sin 2{\mathrm{\theta cos}}^2\varphi =\sqrt{3}\text{/}2\sin 2{\theta }_{\mathrm{XY}}& \left(21\right)\end{array}$

(70) The resulting ambisonic channels, R.sub.R, R.sub.U, R.sub.V, R.sub.L, R.sub.M, R.sub.P, and R.sub.Q, contain only the direct sound components of the sound field.

(71) Now, the handling of diffuse sound is shown. This corresponds to the diffuse sound estimator 31 and the de-correlation filter bank 32 of FIG. 2.

(72) In FIG. 7, the occurrence of direct sound from a sound source and omnidirectional diffuse sound is shown in a diagram depicting the locations of two microphones.

(73) In FIG. 8, the directional responses to a sound source of direct sound is shown. Additionally, omnidirectional diffuse sound is depicted.

(74) The previous derivation of the ambisonic B-format signals is only valid under the assumption of direct sound. It does not hold for diffuse sound. In the following a method for obtaining an equivalent diffuse sound for Ambisonic B-format signals is given. Considering enough time after the direct sound and a number of early reflections, numerous reflections are themselves reflected in the space creating a diffuse sound field. By diffuse sound field is mathematically understood as independent sounds having the same energy and coming from all directions, as illustrated in FIG. 7.

(75) It is assumed that X.sub.1 and X.sub.2 can be modelled as:
X.sub.1[k,i]=S[k,i]+N.sub.1[k,i],
X.sub.2[k,i]=a[k,i]S[k,i]+N.sub.2[k,i],  (22)
where a[k,i] is a gain factor, S[k,i] is the direct sound in the left channel, and N.sub.1[k,i] and N.sub.2[k,i] represent diffuse sound. From (22) it follows that:
E{X.sub.1X*.sub.1}=E{SS*}+E{N.sub.1N*.sub.1}
E{X.sub.2X*.sub.2}=a.sup.2E{SS*}+E{N.sub.2N*.sub.2}
E{X.sub.1X*.sub.2}=aE{SS*}+E{N.sub.1N*.sub.2}.  (23)

(76) It is reasonable to assume that the amount of diffuse sound in both microphone signals is the same, i.e. E{N.sub.1N*.sub.1}=E{N.sub.2N*.sub.2}=E{NN*}. Furthermore, the normalized cross-correlation coefficient between N.sub.1 and N.sub.2 is denoted Φ.sub.diff and can be obtained from the Cook's,

(77) $\begin{array}{cc}{\Phi }_{\mathrm{diff}}\left[i\right]=\frac{\sin D}{D}\mathrm{with}D=\frac{2\pi {\mathrm{if}}_s{d}_{\mathrm{mic}}}{{\mathrm{cN}}_{\mathrm{STFT}}}.& \left(24\right)\end{array}$
Eventually (23) can be re-written as
E{X.sub.1X*.sub.1}=E{SS*}+E{NN*}
E{X.sub.2X*.sub.2}=a.sup.2E{SS*}+E{NN*}
E{X.sub.1X*.sub.2}=aE{SS*}+Φ.sub.diffE{NN*}.  (25)

(78) Elimination of E{SS*} and a in (25) yields the quadratic equation:
AE{NN*}.sup.2+BE{NN*}+C=0  (26)
with
A=1−Φ.sub.diff.sup.2,
B=2Φ.sub.diffE{X.sub.1X*.sub.2}−E{X.sub.1X*.sub.1}−E{X.sub.2X*.sub.2},
C=E{X.sub.1X*.sub.1}E{X.sub.2X*.sub.2}−E{X.sub.1X*.sub.2}.sup.2.  (27)

(79) The power estimate of diffuse sound, denoted P.sub.diff, is then one of the two solutions of (26), the physically possible one (the other solution of (26), yielding a diffuse sound power larger than the microphone signal power, is discarded, as it is physically impossible), i.e.:

(80) $\begin{array}{cc}{P}_{\mathrm{diff}}\left[k,i\right]=E\left\{{\mathrm{NN}}^{*}\right\}=\frac{-B-\sqrt{B^2-4\mathrm{AC}}}{2A}.& \left(28\right)\end{array}$

(81) Note that straightforwardly the contribution of the direct sound can be computed as:
P.sub.dir[k,i]=P.sub.X.sub.1[k,i]−P.sub.diff[k,i].  (29)

(82) This corresponds to the function of the diffuse sound estimator 31.

(83) By definition the Ambisonic B-format signals are obtained by projecting the sound field unto the spherical harmonics basis defined in the previous table. Mathematically, the projection corresponds to the integration of the sound field signal over the spherical harmonics.

(84) As illustrated in FIG. 7, due to the orthogonality property of the spherical harmonics basis: projecting mathematically independent sounds from all directions unto this basis will result in three orthogonal components:
D.sub.W⊥D.sub.X⊥D.sub.Y.  (30)

(85) Note that this property does not hold anymore for direct sound, since a sound source emitting from only ne direction projected unto the same basis will result in a single gain equal to the directional responses at the incidence angle of the sound source, leading to non-orthogonal, or in other terms, correlated components R.sub.W, R.sub.X, and R.sub.Y.

(86) However, here, considering a distribution of three omnidirectional microphones, the single diffuse sound estimate (28) is equivalent for all three microphones (or all three microphone pairs). Therefore there is no possibility to retrieve the native diffuse sound components of the Ambisonic B-format signals, i.e. D.sub.W, D.sub.X, and D.sub.Y as they would be obtained separately by projection of the diffuse sound field unto the spherical harmonics basis.

(87) Instead of getting the exact diffuse sound Ambisonic B-format signals, an alternative is to generate three orthogonal diffuse sound components from the single known diffuse sound estimate P.sub.diff. This way, even if the diffuse sound components do not correspond to the native Ambisonic B-format obtained by projection, the most perceptually important property of orthogonality (enabling localization and spatialization) is preserved. This can be achieved by using de-correlation filters.

(88) The de-correlation filters are derived from a Gaussian noise sequence u of given length l.sub.u. A Gram-Schmidt process applied to this sequence leads to N.sub.u orthogonal sequences U.sub.1, U.sub.2, Λ, U.sub.N.sub.u which serve as filters to generate N.sub.u orthogonal diffuse sounds. In the three microphones case described previously (N.sub.u=3):

(89) Given the length l.sub.u of the noise Gaussian noise sequence u, the de-correlation filters are shaped such that they have an exponential decay over time, similarly as reverberation is a room. To do so, the sequences U.sub.1, U.sub.2, Λ, U.sub.N are multiplied with an exponential window w.sub.u with a time constant corresponding to the reverberation time RT.sub.60:

(90) $\begin{array}{cc}{w}_u\left[n\right]=\exp \left(-\frac{0.5\ln 1e6.Math.n.Math.}{f_s{\mathrm{RT}}_{60}}\right)\mathrm{with}-l_u<n<l_u.& \left(31\right)\end{array}$

(91) In FIG. 9, the filter response of a filter of the de-correlation filter bank 32 of FIG. 2 is shown. Especially the time constant of such a filter is depicted.

(92) The exponential decay of the de-correlation filters, illustrated in FIG. 9, will directly have an influence on the diffuse sound components in the B-format signals. A long decay will over emphasize the diffuse sound contribution in the final B-format but will ensure better separation between the three diffuse sound components.

(93) Eventually, the resulting de-correlation filters are modulated by the diffuse-field responses of the ambisonic B-format channels they correspond to. This way the amount of diffuse sound in each ambisonic B-format channel matches the amount of diffuse sound of a natural B-format recording. The diffuse-field response DFR is the average of the corresponding spherical harmonic directional-response-squared contributions considering all directions, i.e.:

(94) $\begin{array}{cc}\mathrm{DFR}=\frac{1}{4\pi }\underset{-\frac{\pi }{2}}{\overset{\frac{\pi }{2}}{\int }}\underset{-\pi }{\overset{\pi }{\int }}{.Math.D\left(\theta ,\varphi \right).Math.}^2\cos \varphi d\theta d\varphi .& \left(32\right)\end{array}$

(95) In the three microphones case (N.sub.u=3), the resulting de-correlations filters are:
{tilde over (D)}.sub.W[k,i]=DFR.sub.Ww.sub.uU.sub.1P.sub.2D-diff[k,i],
{tilde over (D)}.sub.X[k,i]=DFR.sub.Xw.sub.uU.sub.2P.sub.2D-diff[k,i],
{tilde over (D)}.sub.Y[k,i]=DFR.sub.Yw.sub.uU.sub.3P.sub.2D-diff[k,i].  (33)

(96) This way, the orthogonality property between all three diffuse sounds being preserved any further processing using the generated B-format will work on diffuse sound too, i.e., using conventional ambisonic decoding.

(97) Eventually both direct and diffuse sound contributions have to be mixed together in order to generate the full Ambisonic B-format. Given the assumed signal model, the direct and diffuse sounds are, by definition, orthogonal, too. Thus the complete Ambisonic B-format signal are obtained using a straightforward addition:
B.sub.W[k,i]=R.sub.W[k,i]+{tilde over (D)}.sub.W[k,i],
B.sub.X[k,i]=R.sub.X[k,i]+{tilde over (D)}.sub.X[k,i],
B.sub.Y[k,i]=R.sub.Y[k,i]+{tilde over (D)}.sub.Y[k,i].  (34)
This addition is performed by the adder 40 of FIG. 2.

(98) After this addition, only the inverse short-time Fourier transformation by the inverse short-time Fourier transformer 41 is performed in order to achieve the output B-format ambisonic signals.

(99) Finally, in FIG. 10, an embodiment of the audio encoding method according to the third aspect of the present disclosure is shown. In a first optional step 100 at least 3 audio signals are recorded. In a second step 101, angles of incidence of direct sound are estimated, by estimating for each pair of the N audio signals an angle of incidence of direct sound. In a third step 102, A-format direct sound signals are derived from the estimated angles of incidence, by deriving from each estimated angle of incidence an A-format direct sound signal, each A-format direct sound signal being a first-order virtual microphone signal. In a fourth step 103, the ambisonic A-format direct sound signals are encoded to first-order ambisonic B-format direct sound signals by applying at least one transformation matrix to the A-format direct sound signals. Note that the fourth step of performing the encoding is an optional step with regard to the third aspect of the present disclosure. In a further optional fifth step 104, a higher order ambisonic B-Format signal is generated based on direction of arrival derived from first order B-Format.

(100) Note that the audio encoding device according to the first aspect of the present disclosure as well as the audio recording device according to the second aspect of the present disclosure relate very closely to the audio encoding method according to the third aspect of the present disclosure. Therefore, the elaborations along FIG. 1-9 are also valid with regard to the audio encoding method shown in FIG. 10.

(101) These encoded signals are fully compatible with conventional Ambisonic B-format signals, and thus, can be used as input for Ambisonic B-format decoding or any other processing. The same principle can be applied to retrieve full higher order Ambisonic B-format signals with both direct and diffuse sounds contributions.

(102) Abbreviations and Notations

(103) TABLE-US-00002 Abbreviation Definition VR Virtual Reality DirAc Directional Audio Coding DOA Direction Of Arrival STFT short-Time Fourier Transform SN3D Schmidt semi-Normalization 3D DFR Diffuse-Field Response SNR Signal to Noise Ratio HOA High Order Ambisonic

(104) TABLE-US-00003 Notation Definition x.sub.1, x2 Both recorded microphone signals X.sub.1[k, i] STFT of x.sub.1 in frame k and frequency bin i S[k, i] STFT of source signal N.sub.1[k, i] Diffuse noise in microphone 1 α.sub.X Forgeting factor T.sub.X averaging time-constant X.sub.12 [k, i] cross-spectrum two microphone signal 1 and 2 f.sub.s sampling frequency f.sub.alias Frequency aliasing d.sub.mic Distance between both microphones E { } Expectation oparator θ and ϕ azimuth and elevation angles P.sub.diff power estimate of diffuse noise R.sub.W, R.sub.X, R.sub.Y First order Ambisonic components R.sub.R, R.sub.U, R.sub.V, R.sub.L, R.sub.M, Higher order Ambisonic components R.sub.P, and R.sub.Q P.sub.2D-diff power estimate of diffuse noise in 2D U.sub.1, U.sub.2, Λ, U.sub.N.sub.u Orthogonal sequences {tilde over (ψ)}.sub.12 Angle of the complex cross-spectrum X.sub.12 Ψ.sub.12 The mean of unwrapped phase ψ.sub.12 over frequency aliasing l[i] An uncertainty integer which depends on frequency i L[i] Upper bound function for l[i] which depends on frequency i D(θ, ϕ) Spherical representation of the Ambisonic channels A.sub.p.sub.1, A.sub.p.sub.2, A.sub.p.sub.3, . . . , A.sub.p.sub.n The cardioids that each of them generated with pair of microphones RT.sub.60 Reverberation time l.sub.u Length of Gaussian noise sequence u w.sub.u Exponential window DFR.sub.W, DFR.sub.X, DFR.sub.Y Diffuse-Field Responses for W, X, Y components

(105) The present disclosure is not limited to the examples and especially not to a specific number of microphones. The characteristics of the exemplary embodiments can be used in any advantageous combination.

(106) The present disclosure has been described in conjunction with various embodiments herein. However, other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps and the indefinite article “a” or “an” does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in usually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless communication systems.