SOUND IMAGE LOCALIZATION DEVICE, SOUND IMAGE LOCALIZATION METHOD, AND PROGRAM

Abstract

Provided is a sound image localization device capable of flexibly controlling directivity with a short calculation time. A sound image localization device that reflects, on a reflector 50, a sound signal radiated from a speaker array 40 arranged with a plurality of speakers SP.sub.1 to SP.sub.Q on a straight line to localize a sound image includes an expansion coefficient calculation unit 10 configured to analytically calculate expansion coefficients by performing a spherical harmonic function expansion on a window function representing desired directivity, a filter coefficient generation unit 20 configured to convert the expansion coefficients into filter coefficients corresponding to each of the speakers SP.sub.1 to SP.sub.Q, and a speaker drive unit 30 configured to generate a speaker drive signal for driving each of the speakers SP.sub.1 to SP.sub.Q by convolving the filter coefficients in a voice signal.

Claims

1. A sound image localization device that reflects, on a reflector, a sound signal radiated from a speaker array arranged with a plurality of speakers on a straight line to localize a sound image, the sound image localization device comprising: an expansion coefficient calculation unit, including one or more processors, configured to analytically calculate expansion coefficients by performing a spherical harmonic function expansion on a window function representing desired directivity; a filter coefficient generation unit, including one or more processors, configured to generate filter coefficients corresponding to each of the speakers from the expansion coefficients; and a speaker drive unit, including one or more processors, configured to generate a speaker drive signal for driving each of the speakers by convolving the filter coefficients in a voice signal.

2. The sound image localization device according to claim 1, wherein the filter coefficient generation unit is configured to generate the filter coefficient by multiplying each of the expansion coefficients by a corresponding weight of each of the speakers based on spherical harmonic functions being reproduced by the speakers.

3. A sound image localization method to be executed by a sound image localization device that reflects, on a reflector, a sound signal radiated from a speaker array arranged with a plurality of speakers on a straight line to localize a sound image, the sound image localization method comprising: analytically calculating expansion coefficients by performing a spherical harmonic function expansion on a window function representing desired directivity; generating filter coefficients corresponding to each of the speakers from the expansion coefficients; and generating a speaker drive signal for driving each of the speakers by convolving the filter coefficients in a voice signal.

4. A recording medium storing a program, wherein execution of the program causes one or more computers to perform operations comprising: analytically calculating expansion coefficients by performing a spherical harmonic function expansion on a window function representing desired directivity; generating filter coefficients corresponding to each of speakers from the expansion coefficients; and generating a speaker drive signal for driving each of the speakers by convolving the filter coefficients in a voice signal.

5. The recording medium according to claim 4, wherein generating the filter coefficients further comprises generating the filter coefficient by multiplying each of the expansion coefficients by a corresponding weight of each of the speakers based on spherical harmonic functions being reproduced by the speakers.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0013] FIG. 1 is a block diagram showing a configuration example of a sound image localization device according to an embodiment of the present invention.

[0014] FIG. 2 is a view schematically showing a sound beam in an end-fire direction.

[0015] FIG. 3 is a view showing a polar coordinate system.

[0016] FIG. 4 is a view schematically showing an example of a spherical harmonic function for degrees up to n=3.

[0017] FIG. 5 is a flowchart showing a processing procedure to be executed by the sound image localization device shown in FIG. 1.

[0018] FIG. 6 is a view schematically showing a state of sound image localization provided by the sound image localization device shown in FIG. 1.

[0019] FIG. 7 is a view schematically showing an observation system at the time of designing a filter of directivity control by a least-squares method.

DESCRIPTION OF EMBODIMENTS

[0020] Embodiments of the present invention will be described below with reference to the drawings. In the plurality of drawings, the same components are denoted by the same reference numerals, and will not be repeatedly described.

[0021] FIG. 1 is a block diagram showing a configuration example of a sound image localization device according to an embodiment of the present invention.

[0022] A sound image localization device 100 shown in FIG. 1 analytically derives an expansion coefficient of a virtual speaker by performing a spherical harmonic function expansion on a window function having an arbitrary window width instead of arranging control points as in conventional directivity control, and reproduces the spherical harmonic function by a multi-pole sound source with a linear speaker array. According to such a method, it is possible to generate a sound beam in an end-fire direction with a short calculation time in such a manner that a beam width can be flexibly controlled, thereby forming a virtual speaker, and to present a sound image to a plurality of listeners. The end-fire direction is a direction along an axis of a one-dimensional array.

[0023] FIG. 2 is a view schematically showing a sound beam in the end-fire direction. FIGS. 2(a) and 2(b) schematically shows a difference in a width of a sound beam. In FIG. 2(a), the width of the sound beam is narrow. In FIG. 2(b), the width of the sound beam is wide. The sound image localization device 100 according to the embodiment realizes control of the width of the sound beam shown in FIG. 2 without providing many control points as in the conventional case.

[0024] As shown in FIG. 1, the sound image localization device 100 according to the embodiment includes an expansion coefficient calculation unit 10, a filter coefficient generation unit 20, a speaker drive unit 30, a speaker array 40, and a reflector 50. The sound image localization device 100 excluding the speaker array 40 and the reflector 50 can be realized by, for example, a computer including a ROM, a RAM, and a CPU. In such a case, a content of a function to be processed by the sound image localization device 100 is described by a program. The speaker array 40 shows an example in which a plurality of speakers SP.sub.1 to SP.sub.Q are arranged on a straight line.

[0025] The expansion coefficient calculation unit 10 analytically calculates an expansion coefficient by performing a spherical harmonic function expansion on a window function representing desired directivity. The desired directivity is given from the outside by a beam width θ.sub.ω (0<θ.sub.ω≤π).

[0026] The window function will be described by taking a cosine window (Expression (1)) as an example. An example of another window function includes a rectangular window.

[00001]$\begin{array}{cc}\left[\mathrm{Math}.1\right]& \\ d\left(\theta \right)=\{\begin{array}{cc}\cos \left(\frac{\pi }{2{\theta }_w}\theta \right),& \mathrm{for}0\le \theta \le {\theta }_w\\ 0,& \mathrm{elsewhere}\end{array}& \left(1\right)\end{array}$

[0027] (Spherical Harmonic Function)

[0028] Here, a polar coordinate system shown in FIG. 3 is considered. In this case, a sound pressure S(r, θ, ϕ, ω) observed at any point on a sphere can be expressed by the following expression.

[00002]$\begin{array}{cc}\left[\mathrm{Math}.2\right]& \\ S\left(r,\theta ,\varphi ,\omega \right)=\underset{n=0}{\overset{\infty }{.Math.}}{A}_n^m\left(\omega \right)Y_n^m\left(\theta ,\varphi \right).& \left(2\right)\end{array}$

[0029] Here, Y.sup.m.sub.n(θ, ϕ) represents a spherical harmonic function, and A.sup.m.sub.n(ω) represents an expansion coefficient thereof, which can be expressed by the following expression, respectively.

[00003]$\begin{array}{cc}\left[\mathrm{Math}.3\right]& \\ Y_n^m\left(\theta ,\varphi \right)=\sqrt{\frac{2n+1}{4\pi }\frac{\left(n-m\right)!}{\left(n+m\right)!}}{P}_n^m\left(\cos \theta \right)e^{jm\varphi },& \left(3\right)\\ A_n^m\left(\omega \right)={\int }_0^{2\pi }{\int }_0^{\pi }S\left(r,\theta ,\varphi ,\omega \right){Y_n^m\left(\theta ,\varphi \right)}^{*}\sin \theta d\varphi d\theta .& \left(4\right)\end{array}$

[0030] Here, Pmn(•) represents an associated Legendre function, and Expression (4) is called a spherical harmonic function expansion.

[0031] FIG. 4 is a view schematically showing an example of a spherical harmonic function for degrees up to n=3. A case where an order m is 0 or more indicates a real part, and a case where the order m is less than 0 indicates an imaginary part.

[0032] When a spherical harmonic function expansion is performed in a state where a desired characteristic d(θ) modeled in Expression (1) is substituted into S(r,θ,ϕ,ω) of Expression (2) and the order m of the spherical harmonic function is set to 0, an expansion coefficient A.sup.0.sub.n corresponding to the multi-pole sound source can be obtained.

[00004]$\begin{array}{cc}\left[\mathrm{Math}.4\right]& \\ \begin{array}{c}{A}_n^0={\int }_0^{2\pi }{\int }_0^{{\theta }_w}\cos \left(\frac{\pi }{2{\theta }_w}\theta \right){Y_n^0\left(\theta ,\varphi \right)}^{*}\sin \theta d\varphi d\theta \\ =2\pi \sqrt{\frac{2n+1}{4\pi }}{\int }_0^{{\theta }_w}\cos \left(\frac{\pi }{2{\theta }_w}\theta \right)P_n\left(\cos \theta \right)\sin \theta d\theta \end{array}& \left(5\right)\end{array}$

[0033] An expansion coefficient for degrees up to n=2 are shown below.

[00005]$\begin{array}{cc}\left[\mathrm{Math}.5\right]& \\ \begin{array}{c}{A}_0^0=2\pi \sqrt{\frac{1}{4\pi }}{\int }_0^{{\theta }_w}\cos \left(\frac{\pi }{2{\theta }_w}\theta \right)P_0\left(\cos \theta \right)\sin \theta d\theta \\ =\frac{\sqrt{\pi }}{2}\left(\frac{1+\sin {\theta }_w}{\frac{\pi }{2{\theta }_w}+1}-\frac{1-\sin {\theta }_w}{\frac{\pi }{2{\theta }_w}-1}\right)\end{array}& \left(6\right)\\ \begin{array}{c}{A}_1^0=2\pi \sqrt{\frac{3}{4\pi }}{\int }_0^{{\theta }_w}\cos \left(\frac{\pi }{2{\theta }_w}\theta \right)P_1\left(\cos \theta \right)\sin \theta d\theta \\ =\frac{\sqrt{3\pi }}{4}\left(\frac{1+\sin 2{\theta }_w}{\frac{\pi }{2{\theta }_w}+2}-\frac{1-\sin 2{\theta }_w}{\frac{\pi }{2{\theta }_w}-2}\right)\end{array}& \left(7\right)\\ \begin{array}{c}{A}_2^0=2\pi \sqrt{\frac{5}{4\pi }}{\int }_0^{{\theta }_w}\cos \left(\frac{\pi }{2{\theta }_w}\theta \right)P_1\left(\cos \theta \right)\sin \theta d\theta \\ =\frac{\sqrt{5\pi }}{16}\left(3\frac{1+\sin 3{\theta }_w}{\frac{\pi }{2{\theta }_w}+3}-3\frac{1-\sin 3{\theta }_w}{\frac{\pi }{2{\theta }_w}-3}-\frac{1+\sin {\theta }_w}{\frac{\pi }{2{\theta }_w}+1}+\frac{1-\sin {\theta }_w}{\frac{\pi }{2{\theta }_w}-1}\right)\end{array}& \left(8\right)\end{array}$

[0034] An expansion coefficient can be analytically derived for degrees after n=2 as well.

[0035] The filter coefficient generation unit 20 generates a filter coefficient corresponding to each of the speakers forming the speaker array 40 from the expansion coefficient A.sup.m.sub.n by the following expression (step S2 (FIG. 2)).

[0036] (Directivity Control Technology Using Multi-Pole Sound Source)

[0037] A method is known in which desired directivity is developed by a spherical harmonic function and the obtained expansion coefficient A.sup.0.sub.n is applied to a multi-pole sound source to form directivity (for example, Reference Literature: Yoichi HANEDA et al., “Directivity synthesis using multipole sources based on spherical harmonic function expansion”, The Journal of the Acoustical Society of Japan, 69.11, 2013, 577-588).

[0038] The multi-pole sound source is a sound source in which point sound sources having the same amplitude are distributed in anti-phases as positions as close as possible to the origin. For example, when point sound sources are arranged at minute distances d in a z-axis direction, a sound pressure distribution M.sup.0.sub.n(r,θ,ϕ,ω) of the multi-pole sound source can be expressed by the following expression.

[00006]$\begin{array}{cc}\left[\mathrm{Math}.6\right]& \\ \begin{array}{c}{M}_n^0\left(r,\theta ,\varphi ,\omega \right)=Q{d}^n\frac{{\partial }^n}{\partial z^n}\left(\frac{e^{jkr}}{4\pi r}\right)\\ \approx {Q\left(\mathrm{jkd}\right)}^n\frac{e^{jkr}}{4\pi r}{Z}^n.\end{array}& \left(9\right)\end{array}$

[0039] The approximation is z=cos θ established when 1<<kr. A symbol Q represents an intensity of the point sound source. A symbol k represents a wavenumber (k=ω/c). In addition, the multi-pole sound source has directivity very similar to the spherical harmonic function, and the speaker array 40 arranged in the z-axis direction can reproduce directivity similar to the spherical harmonic function when the order m is 0.

[0040] In other words, the application to the multi-pole sound source can be expressed by the following expression.

[00007]$\begin{array}{cc}\left[\mathrm{Math}.7\right]& \\ S\left(r,\theta ,\varphi ,\omega \right)=\underset{n=0}{\overset{\infty }{.Math.}}{A}_n^m\left(\omega \right)M_n^m\left(\theta ,\varphi ,\omega \right).& \left(10\right)\end{array}$

[0041] The filter coefficient generation unit 20 generates a filter coefficient w(ω) by multiplying each expansion coefficient A.sup.m.sub.n by a corresponding weight D.sup.0.sub.n(ω) of each of the speakers when the spherical harmonic functions are reproduced by the speakers SP.sub.1 to SP.sub.Q (Expression (11)).

[00008]$\begin{array}{cc}\left[\mathrm{Math}.8\right]& \\ w\left(\omega \right)=\underset{n=0}{\overset{\infty }{.Math.}}{A}_n^0{D}_n^0\left(\omega \right)& \left(11\right)\end{array}$

[0042] The weight D.sup.0.sub.n(ω) can be expressed by the following expression when the number of speakers corresponding to the spherical harmonic functions for the degrees up to n=2 is five, for example.

[00009]$\begin{array}{cc}\left[\mathrm{Math}.9\right]& \\ D_0^0\left(\omega \right)=\sqrt{\frac{1}{4\pi }}.Math.\left[\begin{array}{c}0\\ 0\\ 1\\ 0\\ 0\end{array}\right],D_1^0\left(\omega \right)=\sqrt{\frac{3}{4\pi }}.Math.\left[\begin{array}{c}0\\ j/2kd\\ 0\\ -j/2kd\\ 0\end{array}\right],D_2^0\left(\omega \right)=\sqrt{\frac{5}{16\pi }}.Math.\left[\begin{array}{c}0\\ -3/k^2{d}^2\\ 6/k^2{d}^2-1\\ -3/k^2{d}^2\\ 0\end{array}\right]& \left(12\right)\end{array}$

[0043] Here, a symbol d represents a distance between the speakers SP.sub.1 to SP.sub.Q (the above-described minute distance). In addition, a symbol k represents the wavenumber (k=ω/c), and a symbol c represents a speed of light.

[0044] The speaker drive unit convolves the filter coefficient w(ω) in the voice signal input from the outside to generate speaker drive signals for driving the speakers SP.sub.1 to SP.sub.Q, respectively. As is clear from Expression (12), the speaker drive signal for degree n=0 is input only to the speaker SP3 with A.sup.0.sub.n(¼π).sup.0.5. The speaker drive signal for degree n=1 is input to the speakers SP.sub.2 and SP.sub.4. The speaker drive signal for degree n=2 is input to the speakers SP.sub.2, SP.sub.3, and SP.sub.4.

[0045] When such speaker drive signals are input to the speaker array 40, a sound signal corresponding to the desired directivity can be reproduced.

[0046] As described above, the sound image localization device 100 according to the embodiment is a sound image localization device that reflects, on the reflector 50, the sound signal radiated from the speaker array 40 arranged with the plurality of speakers in the straight line to localize the sound image, and includes the expansion coefficient calculation unit 10, the filter coefficient generation unit 20, and the speaker drive unit 30. The expansion coefficient calculation unit 10 performs the spherical harmonic function expansion on the window function indicating the desired directivity to analytically calculate the expansion coefficient. The filter coefficient generation unit 20 generates, from the expansion coefficient A.sup.m.sub.n, the filter coefficient w(ω) corresponding to each of the speakers SP.sub.1 to SP.sub.Q. The speaker drive unit 30 convolves the filter coefficient w(ω) in the voice signal to generate the speaker drive signals for driving the speakers SP.sub.1 to SP.sub.Q, respectively.

[0047] Thus, it is possible to provide the sound image localization device 100 that can flexibly control the directivity with a short calculation time.

[0048] (Sound Image Localization Method)

[0049] A sound image localization method executed by the sound image localization device 100 will be described below.

[0050] FIG. 5 is a flowchart showing a processing procedure executed by the sound image localization device 100.

[0051] First, the sound image localization device 100 is set with a beam width representing desired directivity (step S1). The beam width θ.sub.w (Expression (1)) is input to the expansion coefficient calculation unit 10 from the outside (step S1).

[0052] Next, the expansion coefficient calculation unit 10 performs the spherical harmonic function expansion on the window function representing the desired directivity d(θ) to analytically calculate the expansion coefficient A.sup.m.sub.n (step S2).

[0053] Next, the filter coefficient generation unit 20 generates a filter coefficient w(ω) corresponding to each of the speakers SP.sub.1 to SP.sub.Q forming the speaker array 40 from the expansion coefficient A.sup.m.sub.n (step S3). The filter coefficient generation unit 20 generates a filter coefficient w(ω) by multiplying each expansion coefficient A.sup.m.sub.n by a corresponding weight D.sup.0.sub.n(ω) of each of the speakers SP.sub.1 to SP.sub.Q when the spherical harmonic functions are reproduced by the speakers SP.sub.1 to SP.sub.Q (Expression (11)).

[0054] The speaker drive unit 30 convolves the filter coefficient w(ω) in the voice signal input from the outside to generate speaker drive signals for driving the speakers SP.sub.1 to SP.sub.Q, respectively (step S4).

[0055] As described above, the sound image localization method according to the embodiment is a sound image localization method to be executed by the sound image localization device 100 that reflects, on the reflector 50, the sound signal radiated from the speaker array 40 arranged with the plurality of speakers SP.sub.1 to SP.sub.Q on the straight line to localize the sound image. The sound image localization method according to the embodiment includes: expansion coefficient calculation step S2 of analytically calculating expansion coefficients A.sup.m.sub.n by performing a spherical harmonic function expansion on a window function representing desired directivity; filter coefficient generation step S3 of generating filter coefficients w(ω) corresponding to each of the speakers SP.sub.1 to SP.sub.Q from the expansion coefficients A.sup.m.sub.n; and speaker drive step S4 of generating a speaker drive signal for driving each of the speakers SP.sub.1 to SP.sub.Q by convolving the filter coefficients w(ω) in a voice signal. Thus, it is possible to provide the sound image localization method capable of flexibly controlling the directivity with a short calculation time.

[0056] FIG. 6 is a view schematically showing a state of sound image localization provided by the sound image localization device 100 and the sound image localization method according to the embodiment. As shown in FIG. 6, the sound image localization device 100 radiates the sound signals to the reflector 50 (for example, a ceiling) to realize upward sound image localization (a virtual speaker K.sub.SP).

[0057] Reference numeral 103 indicates a direct sound, reference numeral 104 indicates a reflected sound, and reference numeral 105 indicates a listening point. According to the sound image localization device 100, the listener located at the listening point 105 can perceive the upward sound image localization without using many control points.

Comparative Example

[0058] FIG. 7 is a view schematically showing an observation system when a filter for directivity control is designed by a least-squares method. Control points 1 to M annularly surround the speaker array 40 shown in FIG. 7.

[0059] From the directivity control by the least-squares method, a filter coefficient is obtained to minimize the sum of squares of an error between the desired directivity and the directivity observed at the control point. Accordingly, a calculation quantity increases. The directivity control by the least-squares method is well known, and thus will not be described by expressions.

[0060] Further, according to the method based on Non-Patent Literature 1, sound is reflected on the ceiling due to directivity reproduction of a regular polyhedron speaker and upward sound image localization is realized. In such a method, the directivity is formed using a normalized matched filter.

[0061] The normalized matched filter is obtained by providing a filter that matches the observed sound signal when the sound signal radiated from the speaker is observed at the observation point with the sound signal emitted by the speaker. Therefore, a transfer function to the target observation point is required for all of the speakers, resulting in an increase in calculation quantity.

[0062] In the sound image localization method according to the embodiment contrary to the comparative example, the expansion coefficient is analytically calculated by performing the spherical harmonic function expansion on the window function representing the desired directivity, and the filter coefficient corresponding to each of the speakers is generated from the expansion coefficient, thereby the calculation quantity can be reduced. In other words, it is possible to provide the sound image localization method capable of flexibly controlling the directivity with a short calculation time.

[0063] The characteristic function units of the sound image localization device 100 according to the embodiment can be realized by the computer including the ROM, the RAM, and the CPU. In such a case, the content of the function to be processed by each of the function units is described by the program. Such a program can be distributed via a recording medium such as a CD-ROM or a transmission medium such as the Internet.

[0064] It goes without saying that the present invention includes various embodiments and the like not described herein. Therefore, the technical scope of the present invention is defined only by the matters specifying the invention relating to the reasonable claims from the above description.

REFERENCE SIGNS LIST

[0065] 10 Expansion coefficient calculation unit [0066] 20 Filter coefficient generation unit [0067] 30 Speaker drive unit [0068] 40 Speaker array [0069] 50 Reflector (ceiling) [0070] 100 Sound image localization device [0071] 103 Direct sound [0072] 104 Reflected sound [0073] 105 Listening point