SPEAKER ARRAY, SIGNAL PROCESSING DEVICE, SIGNAL PROCESSING METHOD, AND SIGNAL PROCESSING PROGRAM
20220321998 · 2022-10-06
Inventors
- Kimitaka TSUTSUMI (Musashino-shi, Tokyo, JP)
- Kenta IMAIZUMI (Musashino-shi, Tokyo, JP)
- Atsushi NAKADAIRA (Musashino-shi, Tokyo, JP)
- Yoichi HANEDA (Musashino-shi, Tokyo, JP)
Cpc classification
H04S2400/15
ELECTRICITY
H04R2499/15
ELECTRICITY
H04S7/301
ELECTRICITY
H04R2203/12
ELECTRICITY
International classification
H04R1/34
ELECTRICITY
Abstract
The scale of an apparatus that reproduces a sound field is reduced. A speaker array 1 includes a plurality of speakers arranged at intersections of a first plurality of virtual lines arranged parallel to each other at equal intervals and a second plurality of virtual lines that are perpendicular to the first plurality of virtual lines and are arranged parallel to each other at equal intervals, wherein multipoles of a given order are superimposed using the plurality of speakers to realize wave field synthesis.
Claims
1. A speaker array comprising: a plurality of speakers arranged at intersections of (i) a first plurality of virtual lines arranged parallel to each other at a first interval and (ii) a second plurality of virtual lines that are perpendicular to the first plurality of virtual lines and that are arranged parallel to each other at a second interval, wherein multipoles of a given order are superimposed using the plurality of speakers to realize wave field synthesis.
2. The speaker array according to claim 1, wherein the plurality of speakers are arranged at coordinates obtained by calculating equation (1) for 0≤m≤N to superimpose multipoles of up to an N-th order.
Equation (1):
x=(m−2μ)d(0≤μ≤m)
y=(n−2v)d(0≤v≤n) Equation (1) m, n: Order numbers of multipole in x- and y-axis directions where N=m+n, m≥0, and n≥0 N: Order number of multipoles superimposed by speaker array μ, v: Indices of speaker in x- and y-axis directions d: Interval between adjacent speakers
3. A signal processing apparatus comprising: a filter coefficient determination unit, implemented using one or more computing devices, configured to calculate weighting coefficients for a plurality of speakers according to positions of the plurality of speakers, the plurality of speakers being arranged at intersections of a first plurality of virtual lines arranged parallel to each other at equal intervals and (ii) a second plurality of virtual lines that are perpendicular to the first plurality of virtual lines and that are arranged parallel to each other at equal intervals; and a convolution calculation unit, implemented using one or more computing devices, configured to multiply the weighting coefficients for the plurality of speakers by input signals to calculate output signals to be reproduced by the plurality of speakers.
4-5. (canceled)
6. A signal processing apparatus comprising: a focal coordinate determination unit, implemented using one or more computing devices, configured to determine, as positions of a plurality of focused sound sources used to superimpose multipoles of a given order, intersections of (i) a first plurality of virtual lines arranged parallel to each other at a first interval and (ii) a second plurality of virtual lines that are perpendicular to the first plurality of virtual lines and that are arranged parallel to each other at a second interval; a circular harmonic series conversion unit, implemented using one or more computing devices, configured to calculate weighting coefficients to be assigned to the multipoles of the given order superimposed by the plurality of focused sound sources from a circular harmonic series; a filter coefficient calculation unit, implemented using one or more computing devices, configured to calculate weighted driving functions to be assigned to a plurality of speakers constituting a linear speaker array from the positions of the plurality of focused sound sources and the weighting coefficients assigned to the multipoles; and a convolution calculation unit, implemented using one or more computing devices, configured to convolve the weighted driving functions with input signals to calculate output signals to be given to the plurality of speakers.
7-8. (canceled)
Description
BRIEF DESCRIPTION OF DRAWINGS
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
DESCRIPTION OF EMBODIMENTS
[0029] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the description of the drawings, the same parts are denoted by the same reference signs and the description thereof will be omitted.
First Embodiment
[0030] As illustrated in
[0031] The plurality of speakers of the speaker array 1 according to the embodiment of the present invention are formed in an xy plane as illustrated in
[0032] The speakers illustrated in
[0033] In
[0034] Each of the plurality of speakers reproduces a signal calculated by a signal processing apparatus 2 which will be described later, thereby realizing a sound field that protrudes in front of the speakers and has directivity. The signal processing apparatus 2 weights multipoles realized in the speaker array 1 to calculate input signals to the speakers.
[0035] The speaker array 1 realizes multipoles of a given order distributed in a plane. In the embodiments of the present invention, a basis multipole which is a multipole having an m-th order in the x-axis direction and an n-th order in the y-axis direction is defined as a (m, n) multipole. Basis multipoles refer to basic multipoles which are generally called dipoles, quadrupoles, or the like.
[0036] Basis multipoles and the directivity of their sound fields will be described with reference to
[0037]
[0038]
[0039]
[0040]
[0041] In order to superimpose multipoles of up to an N-th order, speakers are arranged at coordinates obtained by calculating equation (1) for 0≤m≤N.
[Math. 1]
x=(m−2 μ)d(0≤μ≤m)
y=(n−2v)d(0≤v≤n) Equation (1)
n: Order numbers of multipole in x- and y-axis directions
where N=m+n, m≥0, and n≥0
N: Order number of multipoles superimposed by speaker array
μ, v: Indices of speaker in x- and y-axis directions
d: Interval between adjacent speakers
[0042]
[0043] A speaker in the center of each diagram shown in
[0044] The speaker array 1 according to the first embodiment has a plurality of speakers closely arranged in a grid pattern. Thus, the speaker array 1 can reduce the area in which the speaker array 1 is disposed. By superimposing multipoles of a given order using a plurality of speakers closely arranged in a grid pattern, the speaker array 1 can also reproduce a sound field that can reproduce the phase of sound as well with high accuracy, similar to the wave field synthesis technique.
Second Embodiment
[0045] A second embodiment will be described with respect to a method of reproducing the same sound fields as those generated by the basis multipoles using the speaker array 1 according to the first embodiment.
[0046] Signals to be reproduced by the speakers are processed by the signal processing apparatus 2 illustrated in
[0047] The signal processing apparatus 2 includes a filter coefficient determination unit 11 and a convolution calculation unit 12.
[0048] The filter coefficient determination unit 11 calculates weighting coefficients for the plurality of speakers included in the speaker array 1 according to the first embodiment illustrated in
[0049] The weighting coefficients for the plurality of speakers are calculated using equation (2). In equation (2), each speaker illustrated in
m, n: Order numbers of multipole in x- and y-axis directions
where N=m+n, m≥0, and n≥0
μ,v: Indices of speaker in x- and y-axis directions
X: Variable indicating m or n
ζ: Variable indicating μ or v
j: Imaginary unit
d: Interval between adjacent speakers
k: Wavenumber (k=2πf/c)
f and c are frequency and sonic velocity of audio signal to be controlled
[0050] The convolution calculation unit 12 multiplies weighting coefficients for the plurality of speakers by the input signals to calculate output signals to be reproduced by the plurality of speakers. An output signal is calculated for each speaker. The output signals are signals to be reproduced by the speakers. As shown in equation (3), the output signal of each speaker is obtained by multiplying the input signal by the weight calculated for the speaker using equation (2).
[Math. 3]
S.sub.μ,v(Ω)=g.sub.μ,v.sup.m,n.Math.S(Ω) Equation (3)
S(Ω): Input signal
S.sub.μ,v(Ω): Signal reproduced through speaker (μ, v)
[0051] In the second embodiment, the same sound fields as those generated by the basis multipoles can be reproduced by inputting signals obtained by multiplying the input signals by the weighting coefficients calculated using equation (2) to the speakers.
Third Embodiment
[0052] A third embodiment will be described with respect to a method of realizing a sound field generated by a sound source having complicated directivity with the speaker array 1 according to the first embodiment.
[0053] Signals to be reproduced by the speakers are processed by a signal processing apparatus 2a illustrated in
[0054] A filter coefficient determination unit 11a calculates weighting coefficients for the plurality of speakers of the speaker array 1 according to the first embodiment from weighting coefficients w.sup.m,n assigned to multipoles of a given order superimposed by the plurality of speakers and the positions of the speakers. The filter coefficient determination unit 11a receives the order of the speaker array 1 from the outside and specifies the positions of the speakers of the speaker array 1 using equation (1). The filter coefficient determination unit 11a calculates the weighting coefficients for the speakers from the outside using the weighting coefficients of the multipoles realized by the speaker array 1.
[0055] The weighting coefficients for the plurality of speakers are calculated using equation (4) and the weighting coefficients w.sup.m,n assigned to the multipoles of a given order. Equation (4) is a transformation of equation (2) using the weighting coefficients assigned to the (m, n) multipoles.
w.sup.n,m: Weighting coefficient assigned to (m, n) multipole
m, n: Order numbers of multipole in x- and y-axis directions
where N=m+n, m≥0, and n≥0
μ,v: Indices of speaker in x- and y-axis directions
X: Variable indicating m or n
ζ: Variable indicating ,u or v
j: Imaginary unit
d: Interval between adjacent speakers
k: Wavenumber (k=2πf/c)
f and c are frequency and sonic velocity of audio signal to be controlled
[0056] A convolution calculation unit 12a multiplies weighting coefficients w.sup.m,n for the plurality of speakers by the input signals to calculate output signals to be reproduced by the plurality of speakers. An output signal is calculated for each speaker. The output signals are signals to be reproduced by the speakers. As shown in equation (5), the output signal of each speaker is obtained by multiplying the input signal by the weight calculated for the speaker using equation (4). Equation (5) shows that the input signal multiplied by the summation of the weighting coefficients w.sup.m,n calculated using equation (4) while varying m and n over the ranges of 0≤m≤N and 0≤m≤N−m for the speaker corresponding to the index (α, β) is the output signal to be reproduced by the speaker.
S(Ω): Input signal
S.sub.μ,v(Ω): Signal reproduced through speaker (μ, v)
ĝ.sub.μ′,v′.sup.m,n0 when at least one of μ′ and v′ is not an integer
[0057] The weighting coefficient w.sup.m,n to be assigned to the (m, n) multipole can be obtained, typically for a directional sound source which is a target on the sound collecting side, using a least squares method or the like for signals observed at control points arranged on a unit circle surrounding the sound source. Values calculated using the least squares method for the signals observed at the control points arranged on the unit circle can be calculated as elements of a matrix W by solving equation (6).
[Math. 6]
W=(G.sup.HG+λI).sup.−1G.sup.HS
W=[w.sup.0,0 . . . w.sup.0,N].sup.T
S=[S.sub.0(Ω) . . . S.sub.L-1(Ω)].sup.T
G=[g.sub.0 . . . g.sub.L-1]
g.sub.q=[u.sub.0,0.sup.q].sup.T
u.sub.m,n.sup.q=G.sub.2D(r.sub.q,k).Math.(2dk).sup.m+n cos.sup.mϕ.sub.q sin.sup.nϕ.sub.q Equation (6)
L: Number of control points set on unit circle at equal intervals
[0058] In the third embodiment of the present invention, a sound field generated by a sound source having a desired directivity can be reproduced by reproducing the output signals calculated using equation (5) through the speakers.
[0059] Fourth Embodiment
[0060] The third embodiment has been described with reference to the case where the weighting coefficients w.sup.m,n to be assigned to the multipoles are obtained using the least squares method or the like. However, the least squares method sometimes fails to reliably obtain the weighting coefficients w.sup.m,n because the least squares method often causes an underdetermined problem. A fourth embodiment will be described with reference to the case where the weighting coefficients w.sup.m,n of the multipoles are analytically calculated from a circular harmonic series. The fourth embodiment is suitable when a circular harmonic series C.sub.m+n can be obtained from a sound field generated by a directional sound source which is a target on the sound collecting side.
[0061] Signals to be reproduced by the speakers are processed by a signal processing apparatus 2b illustrated in
[0062] A filter coefficient determination unit 11b calculates weighting coefficients w.sup.m,n to be assigned to the multipoles of a given order superimposed by the plurality of speakers of the speaker array 1 according to the first embodiment from a circular harmonic series C.sub.m+n. The filter coefficient determination unit 11b receives the order of the speaker array 1 from the outside and specifies the positions of the speakers of the speaker array 1 using equation (1). The filter coefficient determination unit 11b calculates the weighting coefficient of each multipole realized by the speaker array 1 from a circular harmonic series in a sound collecting environment from the outside.
[0063] The filter coefficient determination unit 11b calculates the weighting coefficient w.sup.m,n to be assigned to each multipole by substituting the circular harmonic series C.sub.m+n into equation (7).
w.sup.m,n: Weighting coefficient assigned to (m, n) multipole
m,n: Order numbers of multipole in x- and y-axis directions
where N=m+n, m≥0, and n≥0
j: Imaginary unit
k: Wavenumber (k=2πf/c)
f and c are frequency and sonic velocity of audio signal to be controlled
C.sub.m+n: Circular harmonic series
[0064] The filter coefficient determination unit 11b further calculates the weighting coefficient to be assigned to each speaker from the above equation (4) and the weighting coefficients w.sup.m,n assigned to the multipoles of a given order.
[0065] When the weighting coefficient to be assigned to each speaker has been calculated, the same processing as in the third embodiment is performed. Specifically, a convolution calculation unit 12b multiplies weighting coefficients w.sup.m,n for the plurality of speakers by the input signals to calculate output signals to be reproduced by the plurality of speakers. An output signal is calculated for each speaker. The output signals are signals to be reproduced by the speakers. As shown in the above equation (5), the output signal of each speaker is obtained by multiplying the input signal by the weight calculated for the speaker using equation (4). Equation (5) shows that the input signal multiplied by the summation of the weighting coefficients w.sup.m,n calculated using equation (4) while varying m and n over the ranges of 0≤m≤N and 0≤m≤N−m for the speaker corresponding to the index (α, β) is the output signal to be reproduced by the speaker.
[0066] In the fourth embodiment, the signal processing apparatus 2b calculates the weighting coefficients w.sup.m,n of the multipoles from a circular harmonic series and calculates a weight to be assigned to each speaker from the weighting coefficients w.sup.m,n of the multipoles as described above. The signal processing apparatus 2b can further multiply the input signal by the weight assigned to each speaker of the speaker array 1 to generate a signal to be input to the speaker. The fourth embodiment can reproduce a sound field accurately by avoiding the least squares method which often causes an underdetermined problem.
Fifth Embodiment
[0067] In a fifth embodiment, a linear speaker array in which a plurality of speakers are arranged in a straight line is used and multipoles are weighted to realize a multipole sound source that protrudes in front of speakers and has directivity. In the fifth embodiment, a linear speaker array is used and multipoles are weighted to realize a multipole speaker array in which a plurality of focused sound sources are arranged in a grid pattern as illustrated in
[0068] The fifth embodiment will be described with reference to the case where the speakers of the speaker array are arranged in a straight line, but the present invention is not limited to this. The speaker array includes a plurality of speakers, while the plurality of speakers do not have to be arranged in a straight line.
[0069] In the fifth embodiment, a multipole sound source is realized by creating two or more focused sound sources of different polarities at positions close to each other. A focused sound source is a combination of non-directional point sound sources (monopole sound sources) of different polarities.
[0070] Signals to be reproduced by the speakers are processed by a signal processing apparatus 2c illustrated in
[0071] The focal coordinate determination unit 13 determines the intersections of a first plurality of virtual lines arranged parallel to each other at equal intervals and a second plurality of virtual lines perpendicular to the first plurality of virtual lines and arranged parallel to each other at equal intervals as the positions of a plurality of focused sound sources used to superimpose multipoles of a given order. The positions of the focused sound sources are provided symmetrically with respect to the center coordinates of the multipoles.
[0072] The focal coordinate determination unit 13 determines the positions of the focused sound sources according to equation (8).
[Math. 8]
x=x.sub.c+(m−2μ)d(0≤μ≤m)
y=y.sub.c+(n−2v)d(0≤v≤n) Equation (8)
(x.sub.c, y.sub.c): Center coordinates of multipole
m,n: Order numbers of multipole in x- and y-axis directions
where N=m+n, m≥0, and n≥0
μ,v: Indices of speaker in x- and y-axis directions
[0073] Multipole sound sources are constructed by creating focused sound sources at coordinates obtained by calculating equation (8) for 0≤m≤N and 0≤n≤N−m.
[0074] The circular harmonic series conversion unit 14 calculates weighting coefficients to be assigned to multipoles of a given order superimposed by the focused sound sources from a circular harmonic series.
[0075] The circular harmonic series conversion unit 14 calculates the weighting coefficients w.sup.m,n to be assigned to the multipoles by substituting the circular harmonic series C.sub.m+n into equation (7) as in the fourth embodiment.
[0076] The filter coefficient determination unit 11c calculates weighted driving functions to be assigned to the plurality of speakers of the linear speaker array from the positions of the focused sound sources and the weighting coefficients assigned to the multipoles.
[0077] The filter coefficient determination unit 11c calculates weighted driving functions to be convolved with input signals for the speakers of the linear speaker array based on each pair of focal coordinates determined by the focal coordinate determination unit 13. The filter coefficient determination unit 11c calculates a driving function using each pair of focal coordinates. For each multipole, the filter coefficient determination unit 11c calculates a weighted driving function to be assigned to each speaker from a combined driving function that is calculated from the coordinates and driving functions of focused sound sources constituting the multipole and a weight assigned to the multipole. Here, the filter coefficient determination unit 11c calculates the combined driving function of the multipole by summing functions multiplied by driving functions for the coordinates of focused sound sources included in the multipole. The filter coefficient determination unit 11c calculates a weighted driving function to be assigned to each speaker by weighting combined driving functions calculated for the multipoles by weights assigned to the multipoles and summing the resulting combined driving functions.
[0078] First, when calculating a weighted driving function for a given speaker, the filter coefficient determination unit 11c calculates a driving function for each focused sound source using equation (9).
Position of focused sound source x=(x, y)
Position of i-th speaker x.sub.i=(x.sub.i,y.sub.i)
k: Wavenumber (k=Ω/c), c: Sonic velocity
Ω: Each frequency (Ω=2πf), f: Frequency
j=√{square root over (−1)}, H.sub.1.sup.(1): Hankel Function of first kind of order 1
[0079] The filter coefficient determination unit 11c calculates a weighted driving function for each speaker using the weights calculated by the circular harmonic series conversion unit 14.
[Math. 10]
D(x.sub.iΩ)Σ.sub.α=−N.sup.NΣ.sub.β=−N+∥α∥.sup.N−∥α∥S.sub.α,β(Ω).Math.D.sub.2.5D(x.sub.i,x.sub.α, β,Ω) Equation (10)
N: Order number of multipoles superimposed by speaker array
α, β: Indices of focused sound sources that constitute multipole
[0080] Although equations (9) and (10) relate to driving functions obtained in a two-dimensional plane assuming a line sound source as a sound source, other driving functions may be used. For example, driving functions obtained in a two-dimensional plane assuming a point sound source as a sound source may be used as shown in equations (11) and (12). The filter coefficient determination unit 11c may calculate the driving functions using equation (11) and calculate weighted driving functions of equation (12).
[0081] When the filter coefficient determination unit 11c has calculated the weighted driving functions for the speakers of the linear speaker array, the convolution calculation unit 15 convolves the weighted driving functions with the input signals to calculate output signals to be given to the speakers.
[0082] In the fifth embodiment, the signal processing apparatus 2c obtains weighted driving functions to be assigned to the speakers of the linear speaker array and convolves the weighted driving functions with the input signals to calculate output signals to be given to the speakers. In the fifth embodiment, it is possible to realize a virtual multipole speaker array where focal coordinates are provided in a grid pattern, like the positions of speakers illustrated in
[0083] For example, a general-purpose computer system including a central processing unit (CPU) (a processor) 901, a memory 902, a storage 903 (a hard disk drive (HDD) or a solid state drive (SSD)), a communication device 904, an input device 905, and an output device 906 as illustrated in
[0084] Each signal processing apparatus 2 may include an input/output interface for receiving/outputting input signals, conditions for calculating output signals, and output signals.
[0085] The signal processing apparatus 2 may be implemented on one computer or may be implemented on a plurality of computers. The signal processing apparatus 2 may also be a virtual machine implemented on a computer.
[0086] The signal processing program may be stored in a computer-readable recording medium such as an HDD, an SSD, a universal serial bus (USB) memory, a compact disc (CD), a digital versatile disc (DVD), or may be distributed via a network.
[0087] The present invention is not limited to the above embodiments and many modifications can be made within the scope of the gist thereof.
REFERENCE SIGNS LIST
[0088] 1 Speaker array
[0089] 2 Signal processing apparatus
[0090] 11 Filter coefficient determination unit
[0091] 12 Convolution calculation unit
[0092] 13 Focal coordinate determination unit
[0093] 14 Circular harmonic series conversion unit
[0094] 901 CPU
[0095] 902 Memory
[0096] 903 Storage
[0097] 904 Communication device
[0098] 905 Input device
[0099] 906 Output device