Perceptually-Transparent Estimation of Two-Channel Room Transfer Function for Sound Calibration

20210219090 ยท 2021-07-15

    Inventors

    Cpc classification

    International classification

    Abstract

    A system and method for performing perceptually-transparent RTF estimation for a two-channel system with low estimation errors. The system includes two loudspeakers for the left and right channels positioned in a room and a single microphone, positioned in the vicinity of a listener in the room. The system performs spectral splitting using a filter bank and a complementary filter bank, to obtain separation in frequency between the two channels. Calibration signals being uncorrelated across the two channels are , generated using the original audio signals and the constructed filters. Then, the calibration signals are played back by the loudspeakers, instead of playback of the original audio signals. At the end, the system records the playback of the calibration signals by the microphone and simultaneously estimates the two-channel RTF using the recorded played back calibration signals.

    Claims

    1. A method for performing perceptually-transparent RTF estimation for a two-channel system with low estimation errors, comprising: a) providing two loudspeakers for the left and right channels positioned in a room and a single microphone, positioned in the vicinity of a listener in said room; b) performing spectral splitting using a filter bank and a complementary filter bank, to obtain separation in frequency between said two channels, by: b.1) selecting I center frequencies, f.sub.i, i=0, . . . I1, having values restricted to the range between zero and half of the sampling frequency, f.sub.s/2; b.2) for each center frequency, defining a corresponding frequency band, O.sub.i. b.3) for each center frequency and frequency band, constructing a corresponding filter, B.sub.i(f); b.4) constructing a filter for the left loudspeaker as a summation of filters for even center frequencies; b.5) constructing a filter for the right loudspeaker as a summation of filters for odd center frequencies; c) generating calibration signals being uncorrelated across the two channels using the original audio signals and the constructed filters; d) playing back said calibration signals by said loudspeakers, instead of playback of the original audio signals; e) recording the playback of said calibration signals by said microphone; and f) simultaneously estimating the two-channel RTF using the recorded played back calibration signals.

    2. A method according to claim 1, wherein the two filter banks are employed at different operating times.

    3. A method according to claim 1, wherein the center frequencies of a complementary set are shifted in frequency, compared to the center frequencies of a set.

    4. A method according to claim 1, wherein estimated RTFs are constructed by merging the estimates from each set.

    5. A method according to claim 4 , wherein merging RTF estimates of multiple sets is performed by fixed mapping.

    6. A method according to claim 4 , wherein merging RTF estimates of multiple sets is performed by using the pointwise minimum of |G.sub.L*(f)G.sub.R(f)|.

    7. A method according to claim 3, wherein the shift in frequency is octave.

    8. A method according to claim 1, wherein RTF estimates are performed peroidically every predetermined time, for automatically compensating changes in the acoustic environment.

    9. A method for performing transparent RTF estimation for a multiple-channel system with low estimation errors, comprising: a) providing a plurality of loudspeakers for the L channels positioned in a room and a single microphone, positioned in the vicinity of a listener in said room; b) performing spectral splitting using a filter bank and L1 complementary filter banks, to obtain separation in frequency between said multiple channels, by: b. 1) selecting I center frequencies, f.sub.i, i=0, . . . I1, having values restricted to the range between zero and half of the sampling frequency, f.sub.s/2; b.2) for each center frequency, defining a corresponding frequency band, O.sub.i. b.3) for each center frequency and frequency band, constructing a corresponding filter, B.sub.i(f); b.4) constructing a filter for eack loudspeaker as a summation of filters for predetermined center frequencies; c) generating calibration signals being uncorrelated across the multiple channels using the original audio signals and the constructed filters; d) playing back said calibration signals by said loudspeakers, instead of playback of the original audio signals; e) recording the playback of said calibration signals by said microphone; and f) simultaneously estimating the multiple-channel RTF using the recorded played back calibration signals.

    10. A system for performing transparent RTF estimation for a multiple-channel system with low estimation errors, comprising: a) a plurality of loudspeakers for the L channels positioned in a room and a single microphone, positioned in the vicinity of a listener in said room; b) a filter bank and complementary filter banks, for performing spectral splitting; c) a processor for separating in frequency between said multiple channels, which is adapted to: c.1) select I center frequencies, f.sub.i, i=0, . . . I1, having values restricted to the range between zero and half of the sampling frequency, f.sub.s/2; c.2) for each center frequency, define a corresponding frequency band, O.sub.i. c.3) for each center frequency and frequency band, construct a corresponding filter, B.sub.i(f); c.4) construct a filter for eack loudspeaker as a summation of filters for predetermined center frequencies; c.5) generate calibration signals being uncorrelated across the multiple channels using the original audio signals and the constructed filters; d) a player for playing back said calibration signals by said loudspeakers, instead of playback of the original audio signals; e) a recorder for recording the playback of said calibration signals by said microphone; and f) at least one processor for simultaneously estimating the multiple-channel RTF using the recorded played back calibration signals.

    Description

    BRIEF DESCRIPTION OF THE DRAWINGS

    [0062] The above and other characteristics and advantages of the invention will be better understood through the following illustrative and non-limitative detailed description of preferred embodiments thereof, with reference to the appended drawings, wherein:

    [0063] FIG. 1 illustrates the system block diagram, in which the processing of the left and right input signals before playback is controlled by a single switch;

    [0064] FIG. 2 is an illustrative example of filter B.sub.4(f) from set 1 for -octave filters for a DFT-based implementation of length 5N, to obtain improved frequency resolution;

    [0065] FIG. 3 is an illustrative example of filters G.sub.L (f) and G.sub.R (f) from set 1 for -octave filters for a DFT-based implementation of length 5N;

    [0066] FIG. 4 illustrates |G.sub.L*(f)G.sub.R(f)for -octave filters with DFT-based implementation for both sets of filters with prederermined center frequencies;

    [0067] FIG. 5 presents the pointwise minimum of G.sub.L*(f)G.sub.R(f) between both sets;

    [0068] FIG. 6 shows measured RIR h.sub.L, [n] for left channel;

    [0069] FIG. 7 shows measured RTF for left channel (H.sub.L(f));

    [0070] FIG. 8 illustrates the frequency dependent error H.sub.L(f).sub.L (f) for the left channel, estimated using set 1 only;

    [0071] FIG. 9 shows the difference between the measured RTF and the estimated RTF using both sets;

    [0072] FIG. 10 shows the normalized error averaged in octaves for all the input signals, used in the listening test;

    [0073] FIG. 11 shows the average success rate of Test and Anchor systems for jazz music, following the listening test;

    [0074] FIG. 12 shows the average success rate of Test and Anchor systems for pop music, following the listening test;

    [0075] FIG. 13 shows the average success rate of Test and Anchor systems for speech, following the listening test; and

    [0076] FIG. 14 shows the overall success rate, which is the average for all signal types following the listening test.

    DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

    [0077] The present invention proposes a perceptually-transparent RTF estimation method for a two-channel system (that may be extended to a multiple-channel system) with low estimation errors. The proposed method employs calibration signals generated using the original audio signals and complementary filters. These calibration signals are uncorrelated across the two channels, which facilitates the estimation of both channels (or multiple channels in the case of a multiple-channel system) using a single microphone. In this embodiment, the microphone is positioned in the vicinity of a listener.

    [0078] The proposed method is based on spectral splitting with complementary filter banks and is applied to produce signals for two channels, as described for example in [17, 18]. The proposed method employs complementary filter banks to produce estimation signals (referred to as calibration signals) for the two loudspeakers. These calibration signals are shown to be perceptually similar to the original, unprocessed audio signals, which could be explained by the phenomenon of spectral fusion [19]. By using complementary filter banks, the processed calibration signals become uncorrelated across the two channels and can be used for simultaneous estimation of the two-channel RTF.

    [0079] Looking again at Eq. (1), if s.sub.L(f) and s.sub.R(f) are uncorrelated, S.sub.s.sub.L.sub.s.sub.R(f) from Eq. (6) is zero, and the RTF could be estimated using the single output signal, y(f). This is the main principle behind the proposed method presented in the following description, where decorrelation is achieved by separation in frequency, which is perceptually transparent to listeners. The basic processing operation is to transmit part of the frequencies to one loudspeaker and the remaining frequencies to another loudspeaker. The ear of the listener integrates these different components. The advantage is that calibration is performed during normal listening of the desired audio content. Another advantage of the proposed method is the fact that calibration may be peroidically done every predetermined time, such that any change in the acoustic environment will be automatically compensated.

    [0080] Calibration Signals

    [0081] According to the present invention, given a two-channel input signal, two uncorrelated signals are produced by employing a filter bank and a complementary filter bank. In this embodiment, the filter banks are presented in a generic manner, even though various sets of center frequencies, filter bandwidths, number of bands, and filter implementations can be used.

    [0082] To construct the filter banks, I center frequencies, f.sub.i, i=0, . . . I1, are initially selected, with their values restricted to the range between zero and half of the sampling frequency, f.sub.s/2. For each center frequency, a corresponding frequency band, O.sub.i, is defined. For each center frequency and frequency band, a corresponding filter, B.sub.i(f), is constructed.

    [0083] Filters for the left and right loudspeakers are then constructed. The filter for the left loudspeaker is constructed as a summation of filters for even center frequency indices:


    G.sub.L(f)=.sub.i=0,2,4, . . . , I2 B.sub.i(f). (Eq. 7)

    [0084] Similarly, a filter for the right loudspeaker is comprised of a summation of filters for odd indices:


    G.sub.R(f)=.sub.i=1,3,5, . . . ,I1 B.sub.i(f), (Eq. 8)

    [0085] while assuming (for simplicity) that I is even.

    [0086] Next, two signals are generated as loudspeaker input signals given the two-channel input signal and G.sub.L(f) and G.sub.R(f):


    l(f)=G.sub.L(f)s.sub.L(f), and (Eq. 9)


    r(f)=G.sub.R(f)s.sub.R(f), (Eq. 10)

    [0087] for left and right loudspeakers, respectively. The cross-spectrum between the two signals is given by:


    E[l*(f)r(f)]=G.sub.L*(f)G.sub.R(f)E[s.sub.L*(f)s.sub.R(f)]. (Eq. 11)

    [0088] Since s.sub.L (f) and s.sub.R (f) cannot be assumed to be uncorrelated, as they could be identical for a mono signal, or highly correlated for a stereo signal, achieving decorrelation between these signals requires that:


    G.sub.L*(f)G.sub.R(f)=0, f [,f.sub.s/2]. (Eq. 12)

    [0089] Substituting Eqs. (7) and (8) in Eq. (12), the condition in Eq. (12) can be reformulated as:


    B.sub.i*(f)B.sub.j(f)=0, i evn and j odd. (Eq. 13)

    [0090] This is a sufficient condition to ensure zero correlation if the filters are equal to zero outside their bandwidth, or to ensure low correlation if they have a small gain outside their bandwidth. The proposed de-correlated calibration signals form the basis for RTF estimation.

    [0091] RTF Estimation with Proposed Calibration Signals and Ideal Filters

    [0092] RTF estimation is described below for the case of ideal filters, with the following assumptions:

    [0093] Filters B.sub.i (f) used for generating the calibration signals are ideal, with:

    [00003] B i ( f ) = { 1 , f O i ( f ) 0 , f .Math. O i ( f ) . ( Eq . 14 ) [0094] The frequency bands used for defining these filters do not overlap, i.e.:


    O.sub.i0.sub.j=0, ij. (Eq. 15) [0095] The union of all frequency bands covers the entire frequency range, i.e.:

    [0096] From Eqs. (14) and (15) (i.e., ideal filter with non-overlapping bands), it is clear that Eq. (13) is satisfied, and the correlation of the calibration signals as in Eq. (11) becomes zero. Then, RTF estimation is developed by defining two sets of calibration signals:


    l.sub.1(f)=G.sub.L(f)s.sub.L(f), r.sub.1(f)=G.sub.R(f)s.sub.R(f), (Eq. 17) [0097] and


    l.sub.2(f)=G.sub.R(f)s.sub.L(f), r.sub.2(f)=G.sub.L(f)s.sub.R(f). (Eq. 18)

    [0098] Set 1 is defined as in Eqs. (9) and (10). Set 2 (Eq. (18)) is defined as in Eqs. (9) and (10) but with interchanged filters between left and right channels.

    [0099] Due to the ideal filters which satisfy Eq. (12), the correlation of the calibration signals as in Eq. (11) is zero, i.e. E[l.sub.1*(f)r.sub.1(f)]=E[l.sub.2*(f)r.sub.2(f)]=0.

    [0100] The calibration signals are played back by the loudspeakers, instead of playback of the original audio signals, as in Eq. (1), and are recorded by the microphone. The new system model in this case becomes:


    y.sub.1(f)=H.sub.L(f)l.sub.1(f)+H.sub.R(f)r.sub.1(f), (Eq. 19)


    y.sub.2(f)=H.sub.L(f)l.sub.2(f)+H.sub.R(f)r.sub.2(f). (Eq. 20)

    [0101] FIG. 1 illustrates the system block diagram, in which the processing of the left and right input signals before playback is controlled by a single switch with three different states:

    [0102] (1) normal playback with no calibration, according to Eq. (1);

    [0103] (2) calibration signals set 1 with with y(f)=y.sub.1(f), according to Eq. (19);

    [0104] (3) calibration signals set 2 with y(f)=y.sub.2(f), according to Eq. (20).

    [0105] RTFs are estimated using the measured signals in Eqs. (19) and (20). Initially, RTFs between these measured signals and the calibration signals from Eqs. (17) and (18) are estimated. For y.sub.1(f), for example, H.sub.L.sup.1(f) is defined similarly to Eq. (5), using:

    [00004] H L 1 ( f ) = s l 1 y 1 s l 1 l 1 = E [ l 1 * ( f ) y 1 ( f ) ] E [ l 1 * ( f ) l 1 ( f ) ] ( Eq . 21 ) = H L ( f ) E [ .Math. l 1 ( f ) .Math. 2 ] + H R ( f ) E [ l 1 * ( f ) r 1 ( f ) ] E [ .Math. l 1 ( f ) .Math. 2 ] = H L ( f ) , f O i , for even i , ( Eq . 22 )

    [0106] where the last line was derived using Eq. (11) and the conclusion derived above that the correlation is zero for the case of ideal filters.

    [0107] In order to avoid a zero denominator due to the construction of r.sub.1(f) in Eq. (17), only frequency bands of even indices are considered. Repeating the same estimation process for y.sub.2(f) and l.sub.2(f), y.sub.2(f) and r.sub.2(f), and y.sub.1(f) and r.sub.1(f), will lead to estimation of the two RTFs for the entire frequency range, due to Eq. (16):

    [00005] H ^ L ( f ) = { H L 1 ( f ) , f { O i ( f ) } i = 0 , 2 , 4 , .Math. , I - 2 H L 2 ( f ) , f { O i ( f ) } i = 1 , 3 , 5 , .Math. , I - 1 , and ( Eq . 23 ) H ^ R ( f ) = { H R 2 ( f ) , f { O i ( f ) } i = 0 , 2 , 4 , .Math. , I - 2 H R 1 ( f ) , f { O i ( f ) } i = 1 , 3 , 5 , .Math. , I - 1 . ( Eq . 24 )

    [0108] While the estimation process with ideal filters presented above lead to an estimation process with zero error, filters in practice are never ideal. Therefore, a solution with practical filters is presented hereinbelow.

    [0109] RTF Estimation with the Proposed Calibration Signals and Practical (Non-Ideal) Filters

    [0110] RTF estimation is described below for the case of practical (non-ideal) filters, with the following assumptions:

    [0111] Filters B.sub.i (f) used for generating the calibration signals include a pass band, O.sub.i.sup.pass (f), and a stop band, O.sub.i.sup.stop(f), and are defined in a generic manner as:


    B.sub.i(f)1, f O.sub.i.sup.pass(f),


    |B.sub.i(f)<, f O.sub.i.sup.stop(f), (Eq. 25)

    [0112] where is a predefined threshold. O.sub.i.sup.pass(f) and O.sub.i.sup.stop(f) do not cover the entire frequency range, as there are frequencies in the transition between these two frequency bands. [0113] The pass bands used for defining these filters do not overlap, i.e.:


    O.sub.i.sup.pass O.sub.j.sup.pass=0, ij. (Eq. 26) [0114] The union of all pass bands covers the entire frequency range, i.e.:


    .sub.i=0.sup.I1O.sub.i.sup.pass=[0, f.sub.s/2]. (Eq. 27)

    [0115] Under these assumptions, the derivation of the estimation method for ideal filters is repeated with the following differences. B.sub.i*(f), B.sub.j(f)=0 from Eq. (13) is now replaced by |B.sub.i*(f)B.sub.j(f)| at i, j, S , where S is a subset of bands which are sufficiently distant from one another such that any one pass band overlaps only with stop bands from the other bands. Therefore, Eq. (12) is replaced by |G.sub.L*(f)G.sub.R(f)|<, and Eq. (11) is replaced by E[l*(f)r(f)]<E[s.sub.L(f)s.sub.R(f)] for frequency bands in S.

    [0116] This leads to a small correlation between signals l(f) and r(f). RTF estimation is repeated for more band subsets, until the entire frequency range is covered. This process is described below for a specific filter implementation and two sets of calibration signals, and can be extended in a similar manner to various filter implementations and multiple sets of calibration signals.

    [0117] Implementation using -octave FIR filters

    [0118] A design example of filter banks for the proposed estimation method is presented below, based on -octave filters with Discrete-Fourier-transform (DFT) based implementation. Here, two sets of filter banks are employed, following the general framework presented for practical filters in the previous section. I=16 center frequencies are selected for the first set of filter banks, and I=15 center frequencies are selected for the second set of filter banks, with the sampling frequency, f.sub.s, set to 44100 Hz. The center frequencies are presented in Table 1 for both sets.

    TABLE-US-00001 TABLE 1 Octave index Set 1 (f.sub.i) [Hz] Set 2 ({tilde over (f)}.sub.i) [Hz] 0 75 89 1 106 126 2 150 178 3 211 251 4 300 355 5 422 501 6 596 708 7 841 1001 8 1189 1413 9 1679 1996 10 2371 2820 11 3350 3983 12 4732 5627 13 6683 7948 14 9441 11227 15 13335

    [0119] The center frequencies of set 2 are shifted by a octave compared to those in set 1. For both sets, and for each center frequency, a corresponding frequency band, 0.sub.i, is defined as follows:


    O.sub.i:=[2.sup.1/4f.sub.i, 2.sup.1/4f.sub.i), i=0,1, . . . , I1, (Eq. 28)

    [0120] where 0.sub.0 is modified to start at 0 Hz and is modified to end at f.sub.s/2. For both sets, and for each frequency band, a corresponding filter, b.sub.i[n], i=0, . . . I1, where n is the discrete time index, is constructed using a DFT-based implementation as [24]:


    b.sub.i[n]=.sub.q:=f.sub.s.sub.q/NEO.sub.ie.sup.j2qn/N, n=0, . . . , N1, (Eq. 29)

    [0121] where N=7055 is the DFT length used for constructing these filters, which, when combined with f.sub.s, yield a time duration of 160-ms, and q=0, . . . , N1 is the DFT frequency index. In particular, DFT frequency indices that correspond to negative frequencies are also included in the summation in Eq. (29), so that the filters are real in the time domain. The filters in the frequency domain, B.sub.i(f), are calculated by applying a DFT on b.sub.i[n]. Then, G.sub.L(f) and G.sub.R(f) are constructed as in Eqs. (7) and (8), respectively, using filters B.sub.i(f).

    [0122] FIG. 2 is an illustrative example of filter B.sub.4(f) from set 1 for -octave filters for a DFT-based implementation of length SN, to obtain improved frequency resolution. A magnitude close to unity is observed at the corresponding octave band, while a relatively high attenuation is observed away from the pass band. The remaining filters, B.sub.i(f), show similar behavior.

    [0123] FIG. 3 is an illustrative example of filters G.sub.L(f) and G.sub.R (f) from set 1 for -octave filters for a DFT-based implementation of length SN. Due to the construction using filters from Eq. (29), G.sub.L(f) and G.sub.R(f) sum to unity at the original DFT frequencies, and the inverse DFT of the summation of these functions gives an impulse function, which was a consideration for this specific implementation. Filters from set 2 are not presented as they are similar in behavior.

    [0124] FIG. 4 illustrates |G.sub.L*(f)G.sub.R(f)| for -octave filters with DFT-based implementation for both sets of filters with center frequencies given in Table 1. |G.sub.L*(f)G.sub.R(f)| is proportional to the correlation (see Eq. (11)). High values of |G.sub.L*(f)G.sub.R(f) are obtained for both sets at frequencies in the transition between the frequency bands. At these frequencies, correlation is expected to be higher, and this may degrade RTF estimation in Eq. (21). However, at frequencies where |G.sub.L*(f)G.sub.R(f)| is high for set 1, it is low for set 2 and vice versa.

    [0125] FIG. 5 presents the pointwise minimum of |G.sub.L*(f)G.sub.R(f)| between both sets, which can be considered as the effective |G.sub.l*(f)G.sub.R(f)| for both sets. The pointwise minimum of |G.sub.L*(f)G.sub.R(f) | for both sets is lower than approximately 20 dB at all frequencies, which can facilitate improved estimation using two sets compared to estimation using a single set. This is the reason that the filters are divided into two sets in the manner described in Table 1 (i.e., using a -octave shift between the two sets).

    [0126] At the next stage, the mapping of frequencies that have minimum |G.sub.L*(f)G.sub.R(f)| for each set can be used for constructing estimated RTFs by merging the estimates from each set. At frequencies where |G.sub.L*(f)G.sub.R(f)| of set 1 is minimal, RTFs can be estimated (as described above with respect to RTF estimation with proposed calibration signals and ideal filters) for signals corresponding to set 1. Similarly, at frequencies where |G.sub.L*(f)G.sub.R(f)| of set 2 is minimal RTFs can be estimated using signals corresponding to set 2. Other methods for merging RTF estimates of multiple sets, such as a fixed mapping, can be implemented using the center frequencies of each set.

    [0127] Analysis of RTF estimation using the proposed method is described below for an experimental system comprising a stereo loudspeaker system and a single microphone positioned in a room. The analysis includes an investigation of the frequency-dependent error between estimated and measured RTFs and the total error.

    [0128] Setup

    [0129] A set of RTFs was measured using a system comprised of two KRK ROKIT 6 loudspeakers and a Bruel & Kjaer -inch diffuse-field microphone, which were connected via an ESI U24XL soundcard to a laptop. The room where the experiment took place is a meeting room at Ben-Gurion University of the Negev, with dimensions of (7.2, 6.4, 3.1) m, an approximate volume of 143 m.sup.3, and a reverberation time of about 0.5 s. The reverberation time was calculated from measured Room Impulse Responses (RIRs) using the Schroeder backward integration [25]. The left and right loudspeakers were positioned at (0.3, 1.6, 0.7) m and (0.3, 0.8, 0.7) m, with a distance of 0.8 m between the loudspeakers. The microphone was positioned at (2.8, 1.2, 1.05) m, which is 2.5 m away from the middle point connecting the loudspeakers. The system was placed slightly towards the room corner due to a large meeting table positioned in the room.

    [0130] Input signals

    [0131] An analysis is provided for various stereo input signals that include white noise, speech, and music, and for the -octave filters presented in the previous section. Three different 20-second duration stereo audio signals were used as input signals: [0132] 1. white (uniform) noise, [0133] 2. jazz music (taken from [26]), [0134] 3. pop music (taken from [27]), and [0135] 4. speech (taken from [28]).

    [0136] Methods

    [0137] The RTFs of the two channels were measured as follows. Each loudspeaker (separately) played back a 20-second white-noise signal. The signal recorded by the microphone along with the input signal of the loudspeakers were recorded by the computer. RTFs from the two loudspeakers to the microphone position were then computed using these signals and MATLAB's tfestimate function, with a 1-second duration window and an overlap factor of 2. For each transfer function, a corresponding RIR was calculated using an inverse DFT, and these are denoted h.sub.L, [n] and h.sub.R[n] for the left and right channels, respectively. The system buffer, or time delay, due to all hardware components including the sound card was compensated for.

    [0138] To investigate estimation using the proposed method, signals y.sub.1(f) and y.sub.2 (f) as in Eqs. (19) and (20), respectively, were generated in a computer simulation using the measured RTFs and calibration signals generated using the filters presented in the previous section. Noise was generated using a zero-mean Gaussian distribution and added to the output signals to model measurement noise. The variance of the noise was set equal over frequency to produce a 40 dB average Signal-to-Noise Ratio (SNR). H.sub.L.sup.1(f), H.sub.L.sup.2(f), H.sub.R.sup.1(f), and H.sub.R.sup.2(f) were calculated for both sets as in Eq. (21) using MATLAB's tfestimate function with a 1-second duration window and an overlap factor of 2. Estimated left and right RTFs, .sub.L (f) and .sub.R(f), respectively, were then estimated twice. First, .sub.L(f) and .sub.R(f) were estimated for set 1 only, as in Eqs. (23) and (24). Then, .sub.L(f) and .sub.R(f) were estimated for both sets, using the implementation using -octave FIR filters that employs the pointwise minimum of |G.sub.L*(f)G.sub.R(f) of both sets (see FIG. 5).

    [0139] A frequency dependent error has been defined as |H.sub.L(f).sub.L(f)| and |H.sub.R(f).sub.R(f)|, for the left and right channels, respectively. A normalized error has been calculated as |H.sub.L(f).sub.L(f)|/|H.sub.L(f)| for the two channels, respectively, and was averaged in octaves so as to avoid ill-conditioning at frequencies at which the RTFs magnitudes are low. The total error has been calculated as H.sub.L(f).sub.L(f)/H.sub.L(f).sub.R(f)/H.sub.R(F) for the left and right loudspeakers, respectively, where .Math. denotes the 2-norm.

    [0140] Results

    [0141] FIG. 6 shows measured RIR h.sub.L, [n] for left channel. FIG. 7 shows measured RTF for left channel (F.sub.L(f)).

    [0142] FIG. 8 illustrates the frequency dependent error |H.sub.L(f).sub.L(f)| for the left channel, estimated using set 1 only, which represents the difference between the measured RTF and the estimated RTF. The difference signal shows large errors at frequencies near the transition between the pass and stop bands of the filters used to construct G.sub.L (f) and G.sub.R(f). Similar results are obtained for the right channel RTF and for calibration signals generated for the remaining input signals.

    [0143] FIG. 9 shows the difference between the measured RTF and the estimated RTF using both sets. The difference signal in this case is 20 dB lower than the measured RTF at most frequencies, including the transitions between the frequency bands.

    [0144] FIG. 10 shows the normalized error averaged in octaves for all the input signals used in the listening test. Here, the maximum error for these examples is less than 15 dB, but is typically significantly lower.

    [0145] The total estimation error for the left channel is presented in Table 2 for all input signals.

    TABLE-US-00002 TABLE 2 Total error Input signal [dB] White noise 29.8 Jazz music 26.7 Pop music 28.7 Speech 27.7

    [0146] It can be seen that the frequency dependent errors and total errors obtained using the method proposed by the present invention are reasonably low.

    [0147] Listening Test

    [0148] Several listening test have been performed for evaluating the perceptual-transparency of the calibration signals when played back using the system loudspeakers with speech and music input signals. The listening tests were conducted in the same room described earlier, but with the left and right loudspeakers positioned at (3.2, 6.1, 0.7) m and (4, 6.1, 0.7) m (keeping the same distance of 0.8 m between the loudspeakers), and the listeners were positioned at (3.6, 3.93, 0.7) m, which is 2.17 m on the axis of the loudspeaker middle point.

    [0149] The listening tests were designed for evaluating the perceptual-transparency of the proposed method, and for comparing performance with that of the baseline solution of signal playback from a single loudspeaker. For this purpose, three systems are considered:

    [0150] Reference [0151] playback of the original stereo audio signals,

    [0152] Test [0153] playback of the signals after applying the developed method, i.e. playback for the calibration signals, and

    [0154] Anchor [0155] playback from the left loudspeaker only.

    [0156] An ABX comparison-based test was conducted [29] that employs three audio signals with a 5-sec duration, played back with pauses of 1.5-sec between the signals, as presented in Table 3.

    TABLE-US-00003 TABLE 3 A B X 1 Reference Test Reference/Test 2 Test Reference Reference/Test 3 Reference Anchor Reference/Anchor 4 Anchor Reference Reference/Anchor

    [0157] In Table 3, signal X is either Reference or Test with equal probability for the sequences in lines 1-2, or Reference or Anchor for the sequences in lines 3-4. Lines 1-2 serve to investigate if the Test system is perceptually-transparent compared to the Reference system, and, similarly, lines 3-4 serve to investigate if the Anchor system is perceptually-transparent compared to the Reference system. The signal types employed were the speech and music input signals defined in the analysis (described above) of RTF estimation (using the proposed method) for the experimental system described above. Different segments of the same audio material were used for producing signals A, B, and X, and in each test an ABX sequence has been played only once.

    [0158] FIGS. 11, 12, and 13 show the average success rate of Test and Anchor systems for jazz music, pop music, and speech, respectively, following the listening test. FIG. 14 shows the overall success rate, which is the average for all signal types, following the listening test. A success rate of 50% is interpreted as perceptually-transparent since it corresponds to the average success rate of an equiprobable guess. A success rate of 100% is interpreted as completely non-transparent, and a 75% rate is interpreted as partially-transparent. The results show that the method developed is perceptually-transparent for the jazz music audio recording, and is partially perceptually-transparent for the pop music and speech. On the other hand, the anchor system, or baseline solution is very close to being completely non-perceptually-transparent for all input signals.

    [0159] The proposed method may be adapted to perform transparent RTF estimation for a multiple-channel system with L loudspeakers for L corresponding audio channels (rather that two). In this case, spectral splitting is performed by using a filter bank and complementary filter banks, to obtain separation in frequency between some or all of these multiple channels (it is possible to use less filter banks than channels. For example, if it is desired to separate only one channel from the rest of the L1 channels, and in this case, two filter banks will be sufficient). I center frequencies, f.sub.i, i=0, . . . I1, with values restricted to the range between zero and half of the sampling frequency, f.sub.s/2 are selected, while for each center frequency, a corresponding frequency band, O.sub.i is defined. A corresponding filter, B.sub.1 (f) is constructed for each center frequency and frequency band and a filter is constructed for eack loudspeaker as a summation of filters for predetermined center frequencies. Calibration signals which are uncorrelated across the multiple channels are then generated using the original audio signals and the constructed filters. These calibration signals are played-back by the plurality of loudspeakers and recorded by the microphone. The recorded played back calibration signals are used to simultaneously estimate the multiple-channel RTF.

    [0160] The above examples and description have of course been provided only for the purpose of illustrations, and are not intended to limit the invention in any way. As will be appreciated by the skilled person, the invention can be carried out in a great variety of ways, employing more than one technique from those described above, including the internet, a cellular network or any other wireless data network, all without exceeding the scope of the invention.

    REFERENCES

    [0161] [1] D. D. Rife, J. Vanderkooy, Transfer-function measurement with maximum-length sequences, Journal of the Audio Engineering Society 37 (6) (1989) 419-444.

    [0162] [2] C. Dunn, M. J. Hawksford, Distortion immunity of mls-derived impulse response measurements, Journal of the Audio Engineering Society 41 (5) (1993) 314-335.

    [0163] 555 [3] R. C. Heyser, Acoustical measurements by time delay spectrometry, Journal of the Audio Engineering Society 15 (4) (1967) 370-382.

    [0164] [4] A. Berkhout, M. M. Boone, C. Kesselman, Acoustic impulse response measurement: A new technique, Journal of the Audio Engineering Society 32 (10) (1984) 740-746.

    [0165] [5] A. Farina, Simultaneous measurement of impulse response and distortion with a swept-sine technique, in: Audio Engineering Society Convention 108, Audio Engineering Society, 2000.

    [0166] [6] S. Muller, P. Massarani, Transfer-function measurement with sweeps, Journal of the Audio Engineering Society 49 (6) (2001) 443-471.

    [0167] [7] T. Gustafsson, J. Vance, H. Pota, B. Rao, M. Trivedi, Estimation of acoustical room transfer functions, in: Decision and Control, 2000. Proceedings of the 39th IEEE Conference on, 570 Vol. 5, IEEE, 2000, pp. 5184-5189.

    [0168] [8] N. Aoshima, Computer-generated pulse signal applied for sound measurement, The Journal of the Acoustical Society of America 69 (5) (1981) 1484-1488.

    [0169] [9] Y. Suzuki, F. Asano, H.-Y. Kim, T. Sone, An optimum computer-generated pulse signal suitable for the measurement of very long impulse responses, The Journal of the Acoustical Society of America 97 (2) (1995) 1119-1123.

    [0170] [10] G.-B. Stan, J.-J. Embrechts, D. Archambeau, Comparison of different impulse response measurement techniques, Journal of the Audio Engineering Society 50 (4) (2002) 249-262.

    [0171] [11] B. S. Lavoie, W. R. Michalson, Auto-calibrating surround system, U.S. Pat. No. 7,158,643 (Jan. 2 2007).

    [0172] [12] C. Hak, R. Wenmaekers, J. Hak, L. Van Luxemburg, A. Gade, Sound strength calibration methods, in: International Congress on Acoustics, ICA, 2010.

    [0173] [13] N. Zacharov, P. Suokuisma, Method for loudness calibration of a multichannel sound systems and a multichannel sound system, U.S. Pat. No. 6,639,989 (Oct. 28 2003).

    [0174] [14] J. Johnston, S. Smirnov, Room acoustics correction device, U.S. patent application Ser. No. 11/289,328 (May 31 2007).

    [0175] [15] A. Gilloire, M. Vetterli, Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellation, IEEE transactions on signal processing 40 (8) (1992) 1862-1875.

    [0176] [16] Y. Lin, D. D. Lee, Bayesian regularization and nonnegative deconvolution for room impulse response estimation, IEEE Transactions on Signal Processing 54 (3) (2006) 839-847.

    [0177] [17] P. N. Kulkarni, P. C. Pandey, D. S. Jangamashetti, Binaural dichotic presentation to reduce the effects of spectral masking in moderate bilateral sensorineural hearing loss, International journal of audiology 51 (4) (2012) 334-344.

    [0178] [18] A. Amano-Kusumoto, J. M. Arono, M. Itoh, S. D. Soli, The effect of dichotic processing on the perception of binaural cues, in: Thirteenth Annual Conference of the International Speech Communication Association, 2012.

    [0179] [19] P. C. Loizou, A. Mani, M. F. Dorman, Dichotic speech recognition in noise using reduced spectral cues, The Journal of the Acoustical Society of America 114 (1) (2003) 475-483.

    [0180] [20] H. Vold, J. Crowley, G. T. Rocklin, New ways of estimating frequency response functions., Sound & Vibration 18 (11) (1984) 34-38. [21] Y. Avargel, I. Cohen, On multiplicative transfer function approximation in the short-time fourier transform domain, IEEE Signal Processing Letters 14 (5) (2007) 337-340.

    [0181] 615 [22] P. Welch, The use of fast fourier transform for the estimation of power spectra: a method based on time averaging over short, modifed periodograms, IEEE Transactions on audio and electroacoustics 5 (2) (1967) 70-73.

    [0182] [23] H. Herlufsen, Dual channel FFT analysis (part ii), Bruel & Kaejr Technical Review (1984-2).

    [0183] [24] M. Smith, T. Barnwell, A new filter bank theory for time-frequency representation, IEEE transactions on acoustics, speech, and signal processing 35 (3) (1987) 314-327.

    [0184] [25] B. ISO, 3382-2, acoustics-measurement of room acoustic parameters-part 2: Reverberation time in ordinary rooms, International Organization for Standardization, Geneve.

    [0185] [26] Avishai Cohen Trio & Ensemble, Remembering. At Home, Razdaz Recordz (2005).

    [0186] [27] Amy Winehouse, Stronger than me. Frank, Island Records Ltd. (2003).

    [0187] [28] Trevor Noah Is Lupita Nyong'os Son (2018), added by The Tonight Show Starring Jimmy Fallon [online]. Available at: https://www.youtube.com/watch?v=ctTKPs66rCU [Accessed 31, Oct. 2018].

    [0188] [29] W. Munson, M. B. Gardner, Standardizing auditory tests, The Journal of the Acoustical Society of America 22 (5) (1950) 675-675.

    [0189] [30] L. D. Brown, T. T. Cai, A. DasGupta, Interval estimation for a binomial proportion, Statistical science (2001) 101-117.