Method And System For Surround Sound Setup Using Microphone And Speaker Localization
20240064484 ยท 2024-02-22
Inventors
Cpc classification
H04S2420/01
ELECTRICITY
H04R5/04
ELECTRICITY
H04S7/301
ELECTRICITY
International classification
H04S7/00
ELECTRICITY
H04R5/04
ELECTRICITY
Abstract
The present disclosure relates to a method and system for calibrating a loudspeaker system in an environment (1). The loudspeaker system comprises an audio device (10) with a first and second loudspeaker arranged with a predetermined horizontal separation. The method comprises the steps of emitting (S2a, S2b) a first and second calibration audio signal from the first and second loudspeaker (11) of the audio device (10), wherein the second calibration audio signal is distinguishable from the first calibration audio signal. The method further comprises receiving (S3a, S3b), with a first external microphone (20) the first and second calibration audio signal, determining (S4) the position of the first external microphone (20) relative to the audio device (10) and calibrating (S8) the loudspeaker system based on the determined position of the first external microphone (20).
Claims
1. A method for calibrating a loudspeaker system in an environment, the loudspeaker system comprising an audio device with a first and second loudspeaker arranged with a predetermined horizontal separation, the method comprising: a) emitting a first calibration audio signal from the first loudspeaker of the audio device; b) emitting a second calibration audio signal from the second loudspeaker of the audio device, wherein the second calibration audio signal is distinguishable from the first calibration audio signal; c) receiving, with a first external microphone placed at a listening position in the environment, the first and second calibration audio signal, wherein the first external microphone is arranged on a microphone stand configured to position the first external microphone at a predetermined listening position height relative to a ground plane of the environment; d) determining, based on the received first and second calibration audio signal, the position of the first external microphone relative to the audio device, wherein determining the position comprises: determining at least one of an azimuth angle, , of the first external microphone relative to the audio device and a radial distance, d.sub.center between the first external microphone and the audio device, and determining, based on the received first and second calibration audio signal and the predetermined listening position height associated with the microphone stand an elevation angle, of the first external microphone relative to the audio device; and e) calibrating the loudspeaker system based on the determined position of the first external microphone.
2. The method according to claim 1, wherein determining the position of the first external microphone relative to the audio device comprises: determining a time of arrival of the received first and second calibration audio signal; and determining the position of the first external microphone based on the time of arrival of the received first and second calibration audio signals and the speed of sound.
3. The method according to claim 2, further comprising: obtaining a delay metric of the first and second loudspeaker respectively, the delay metric indicating a duration between a first point in time, when the first or second calibration audio signal is provided to the first or second loudspeaker, and a second point in time, when the first or second calibration audio signal is reproduced by the first or second loudspeaker; and wherein determining the position of the first external microphone is further based on the delay metric of the first and second loudspeaker.
4. The method according to claim 1, wherein said loudspeaker system further comprises at least one external loudspeaker being separate from the audio device and wherein the audio device further comprises a first and second internal microphone, the method further comprising: f) emitting a test audio signal from the at least one external loudspeaker; g) receiving the test audio signal with the first external microphone; h) receiving the test audio signal with the first and second internal microphones; and i) determining the position of the at least one external loudspeaker based on the position of the first external microphone and the received test audio signal of the first external microphone and the first and second internal microphone, wherein calibrating the loudspeaker system is further based on the determined position of the at least one external loudspeaker.
5. The method according to claim 4, further comprising: obtaining a loudspeaker property of the at least one external loudspeaker; and wherein determining the position of the at least one external loudspeaker is further based on the loudspeaker property of the at least one external loudspeaker.
6. The method according to claim 4, further comprising: receiving the test audio signal of the at least one external loudspeaker with a second external microphone provided in the environment or with a third internal microphone of the audio device; wherein determining the position of the at least one external loudspeaker is further based on the received test audio signal of the second external microphone or third internal microphone and the position of the second external microphone or third internal microphone relative to the audio device.
7. The method according to claim 4, further comprising: repeating steps a) to d) of claim 1 after the first external microphone has been moved to a new position, p.sub.new, said new position, p.sub.new, being different from the listening position; and repeating steps f) and g) of claim 4; wherein determining the position of the at least one external loudspeaker is further based on the position of the first external microphone at the new position, p.sub.new, and the received test signal of the first external microphone at the new position.
8. The method according to claim 1, wherein calibrating the loudspeaker system comprises assigning a speaker role to at least one loudspeaker of the loudspeaker system and/or adjusting at least one of a delay, phase, equalization or gain for at least one loudspeaker of the loudspeaker system.
9. The method according to claim 1, wherein the audio device comprises at least one of a sidewards-firing loudspeaker and an upwards-firing loudspeaker, and wherein the audio device comprises at least two loudspeakers configured to perform loudspeaker virtualization comprising establishing two acoustic channels forming a binaural acoustic channel pair impinging on a predetermined spatial region, said method further comprises: determining if the position of the first external microphone is within the predetermined spatial region; if the position is within the predetermined spatial region, calibrating the loudspeaker system comprises disabling the at least one sidewards-firing loudspeaker or upwards-firing loudspeaker; and if the position is outside the predetermined spatial region, calibrating the loudspeaker system comprises disabling the loudspeaker virtualization.
10. A computer program product comprising instructions which, when the program is executed by a central control unit of the audio device, causes the central control unit to carry out the method according to claim 1.
11. A system for calibrating a loudspeaker system in an environment comprising: an audio device, comprising a first loudspeaker and a second loudspeaker arranged with a predetermined horizontal separation, a first external microphone, configured to be placed at a listening position in the environment, wherein the first external microphone is arranged on a microphone stand configured to position the first external microphone at a predetermined listening position height relative to a ground plane of the environment, and a central control unit, configured to: cause a first calibration audio signal to be emitted from the first loudspeaker, cause a second calibration audio signal to be emitted from the second loudspeaker, wherein the second calibration audio signal is distinguishable from the first calibration audio signal, cause the first external microphone to receive the first and second calibration audio signal, determine, based on the received first and second calibration audio signal, the position of the first external microphone relative to the audio device, by determining at least one of an azimuth angle, , of the first external microphone relative to the audio device and a radial distance, d.sub.center, between the first external microphone and the audio device, and determining, based on the received first and second calibration audio signal and the predetermined listening position height associated with the microphone stand an elevation angle, , of the first external microphone relative to the audio device and calibrate the loudspeaker system based on the determined position of the first external microphone.
12. The system according to claim 11, wherein the microphone stand has a length of between 70 centimeters and 80 centimeters.
13. The system according to claim 11, wherein the audio device is a soundbar configured to be placed below or above a television.
14. A kit comprising an audio device with two loudspeakers and an external calibration microphone provided on a stand, wherein the audio device comprises a controller configured to perform the method according to claim 1.
15. The kit according to claim 14, wherein the kit is provided in a single package.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0050] These and other aspects of the invention will now be described in more detail, with reference to the appended drawings showing exemplary embodiments of the present invention, wherein:
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
DETAILED DESCRIPTION OF CURRENTLY PREFERRED EMBODIMENTS
[0065]
[0066] The audio device 10 comprises a rigid body which mechanically links the first and second loudspeaker 11, 12 to ensure that the first and second loudspeaker 11, 12 are arranged with the predetermined horizontal separation distance at all times. In some implementations, the audio device 10 is a soundbar comprising an elongated body configured to be arranged substantially horizontally, e.g., above or below a television. The audio device 10 thereby comprises a forward facing side, arranged to face an acoustic environment (e.g., a living room), and a rearward facing side opposite the forward facing side. The first and second loudspeakers 11, 12 of the audio device 10 in
[0067] In some implementations, the audio device comprises only two internal microphones 13, 14, alternatively, the audio device 10 further comprises a third internal microphone 15 which could be used to resolve an external loudspeaker ambiguity as will be described in more detail in the below.
[0068] With further reference to
[0069] While it is envisaged that the audio device 10 could be placed anywhere, with or without a television 40, the arrangement presented in
[0070] In some implementations, the audio device 10 is configured to cooperate with at least one external loudspeaker 30a, 30b, 30c also placed in the acoustic environment 1. For example, the at least one external loudspeaker 30a, 30b, 30c may be a satellite loudspeaker arranged to emit sounds which a user, sitting on the couch 51 and facing the television 40, perceives as originating from behind, above, below or to the side of the user. In some implementations, the audio device 10 and the at least one external loudspeaker 30a, 30b, 30c forms a surround sound setup with at least two front loudspeakers (realized by the audio device 10) and at least two rear loudspeakers (realized by at least two external loudspeakers 30a, 30b, 30c). For example, the first and second loudspeaker 11, 12 of the audio device 10 forms the front left and front right loudspeakers of a 5.1 surround sound setup and at least two external loudspeakers 30a, 30b, 30c forms the rear left and rear right loudspeaker of the 5.1 surround sound setup. In a similar fashion, additional external loudspeakers 30a, 30b, 30c may be arranged in the acoustic environment to enable more sophisticated surround sound setups such as 5.1.2, 5.1.4, 7.1, 7.1.2, 7.1.4 or even 11.1 or 22.2.
[0071] A central control unit 18 is used to control and coordinate the operation of the loudspeakers 11, 12 of the audio device 10 and the external loudspeakers 30a, 30b, 30c. The central control unit 18 may be provided as a unit which is separate from the audio device 10 and the external loudspeakers 30a, 30b, 30c or the central control unit 18 may be integrated with at least one of the audio device 10 and the external loudspeakers 30a, 30b, 30c. Preferably, as shown in
[0072] As seen in
[0073] While it is often easy for a user to install the audio device 10 at an ideal position (e.g., right below the television 40), the position at which the user will be located when e.g., watching the television 40 (with the television audio being played back by the audio device 10) is often not at the ideal position (e.g., symmetrically centered in front of the audio device 10 at a predetermined distance from the audio device 10). Additionally, if one or more external loudspeakers 30a, 30b, 30c are placed in the acoustic environment 1 it is often difficult for the user to arrange the one or more external loudspeakers 30a, 30b, 30c at the positions dictated by surround sound standards. For example, walls and furniture of the environment may not allow the user to place the external rear loudspeakers at the prescribed nominal positions for a 5.1 surround setup. Accordingly, the actual position at which the user will be located when listening to audio content, referred to as the listening position, and the placement of the audio device 10 and the external loudspeakers 30a, 30b, 30c relative to the listening position will vary from one setup to another. To this end, the loudspeaker system, i.e. the audio device 10 and any external loudspeakers 30a, 30b, 30c, must be calibrated after installation to enable the best possible performance.
[0074] This calibration is performed automatically, using the first external microphone 20 placed at the listening position, with the calibration method which is described in further detail in the below. The first external microphone 20 is placed at the intended listening position and connected to the central control unit 18. The first external microphone 20 may be connected with a wire to the central control unit 18 or it is envisaged that the first external microphone 20 connects wirelessly (not shown) to the central control unit 18.
[0075]
[0076] A sidewards-firing loudspeaker 113, 123 or upwards-firing loudspeaker 112, 122 is a directive loudspeaker which is arranged to emit audio signals that are reflected from the walls, ceiling and/or floor of the acoustic environment to then reach the user 25 at the listening position with a direction of incidence which is different from a direction of incidence coming from the audio device 10 straight to the user 25. In this way, the audio device 10 could enable a type of surround sound experience despite all loudspeakers being arranged essentially in front of the user 25. For example, sidewards-firing loudspeakers 113, 123 emit audio signals 113, 123 which are reflected from a right and left wall in the acoustic environment 1 and then reach the user 25 at the listening position with a respective direction of incidence similar to that of audio emitted by physical loudspeakers positioned at either side of the user 25. Accordingly, side audio channels may be enabled with sidewards-firing loudspeakers 113, 123 without the need to place physical loudspeakers at the sides of the listening position in the acoustic environment 1. Similarly, height (either above or below) and even rear audio channels may be enabled by loudspeakers firing in other directions so as to reflect the audio signals off different surfaces in the acoustic environment 1.
[0077] In some implementations, the front facing loudspeakers 110, 120 (which may be the same loudspeakers as the first and second loudspeaker 11, 12 of
[0078] In some implementations, the audio device 10 comprises both loudspeakers 110, 120 configured for loudspeaker virtualization and at least one of a sidewards-firing loudspeaker 113, 123 and an upwards-firing loudspeaker 112, 122. In such implementations, the calibration of the loudspeaker system comprises determining if loudspeaker virtualization should be used or if the sidewards/upwards-firing loudspeaker(s) 113, 123, 112, 122 should be used to enable a surround experience based on the position of the user 25 (i.e. the listening position) relative to the audio device 10. While loudspeaker virtualization is preferable as it enables very convincing surround sound effects, loudspeaker virtualization often requires that the person listening to the audio content is positioned within the predetermined spatial region 1000 in front of the audio device 10 to ensure sufficient performance of the virtualization and crosstalk cancellation. On the other hand, the sidewards/upwards-firing loudspeaker(s) 113, 123, 112, 122 enable a surround sound experience which is less sensitive to where the user 25 is located, meaning that if the listening position is determined to be outside the predetermined spatial region 1000 wherein the performance of the loudspeaker virtualization performs best or in the case of multiple listeners, it may be determined that the audio device 10 should rely on the sidewards/upwards-firing loudspeaker(s) 113, 123, 112, 122 instead of loudspeaker virtualization. If this is the case, the loudspeakers 110, 120 may be disabled or used as regular loudspeakers without loudspeaker virtualization. The loudspeakers 110, 120 may be used for both virtualization and regular loudspeakers simultaneously by superposition.
[0079]
[0080] Since the listening positioning is determined by the position of the user's head when the user 25 is located at the intended listening position, and since the listening position often involves the user 25 sitting in a chair or couch it may be difficult to place a microphone at the listening position and the calibration microphone 20 may then be placed at a place with a known relative displacement in at least one dimension from the listening position.
[0081] For example, the calibration microphone 20 could be placed on the sitting area of the chair or couch 51, whereby the calibration microphone 20 is displaced vertically below the intended listening position a distance H.sub.mic corresponding to the length of the upper body of an average human (approximately 70-80 centimeters). As a further example, the calibration microphone 20 could be placed on the backrest of the chair or couch 51 at the intended listening position whereby the calibration microphone 20 becomes displaced horizontally behind the intended listening position.
[0082] Preferably, as shown in
[0083] In some implementations, the stand 21 is provided with pivoting support members 22 which can be pivoted so as to fold the stand 21 into a transport position. This enables the stand 21 to take up much less space when it is not used and e.g., facilitates providing the stand 21 in a smaller package separately, or together with the audio device 10.
[0084] With reference to
[0085] At step S1 in
[0086] At step S3a and S3b the first external microphone 20 receives the emitted first and second calibration audio signals and at step S4 the position of the first external microphone 20 relative to the audio device 10 is determined.
[0087] The position of the first external microphone 20 relative to the audio device 10 is determined at step S4 by comparing e.g., the point in time when the first calibration audio signal is emitted from the first loudspeaker 11 and the point in time when the first calibration audio signal is received by the first external microphone 20. By comparing these points in time the acoustic travel time between the first loudspeaker 11 and first external microphone 20 can be determined. The acoustic travel time can then be used to determine the physical distance d.sub.11 between first loudspeaker 11 and the first external microphone 20. Analogously, the physical distance d.sub.12 between second loudspeaker 12 and the first external microphone 20 can also be determined based on the transmission and reception of the second calibration audio signal.
[0088] Seen in a horizontal plane, the distances d.sub.11 and d.sub.12 shown in
[0089] Additionally or alternatively, the azimuth angle (e.g., represented with an angle in the horizontal plane) can be determined by the distances d.sub.11, d.sub.12 and the horizontal separation distance between the first and second loudspeakers 11, 12.
[0090] In other words, the position of the first external microphone 20 (and thereby also the listening position) can be completely determined in a two-dimensional plane by extracting the radial distance d.sub.center and the azimuth angle from the received first and second calibration audio signals.
[0091] However, the calibration audio signal measurements on their own will not reveal the elevation angle of this two-dimensional plane shown in
[0092] In some implementations, user input is obtained at step S4 in
[0093] In some implementations, the position of the listening position (i.e. the position of the first external microphone 20) is used to calibrate the loudspeakers of the audio device 10. The calibration of the loudspeakers of the audio device 10 may comprise adjusting at least one of: a loudspeaker gain, a loudspeaker delay, a loudspeaker phase, a loudspeaker equalization and a loudspeaker role (e.g., front left, center or front right) of the loudspeakers in the audio device 10.
[0094] In some implementations, the loudspeaker system comprises at least one external loudspeaker in addition to the audio device 10. In some such implementations, the method further comprises step S7 of determining the position of the external loudspeakers using the first external microphone 20 positioned at the listening position.
[0095] The position of the external loudspeakers is determined by controlling (e.g., with the central control unit 18) each external loudspeaker to individually emit distinguishable test audio signals at step S5. The test audio signals could be the same as the calibration audio signals played by the audio device 10 and e.g., involve a frequency sweep which is sequentially played by each external loudspeaker. The test audio signals are received at step S6 by the first external microphone 20 and the first and second internal microphone 13, 14 of the audio device 10. The position of each external loudspeaker can then be determined by trilateration by comparing the absolute time of arrival of the test audio signals at each of the microphones 13, 14, 20 and considering the determined position of the first external microphone 20 relative to the audio device 10 (and therefore also the first and second internal microphones 13, 14). It is envisaged that while step S4 is performed prior to step S5 and S6 in
[0096] Using three microphones 13, 14, 20 to triangulate the position of an external loudspeaker leads to an ambiguity in the position of the external loudspeaker wherein two solutions for the position are obtained, wherein the two possible positions of the external loudspeaker are mirrored in a plane spanned by the first and second internal microphone 13, 14 and the first external microphone 20 at the listening position. This ambiguity may be resolved with a default setting wherein e.g., always the solution being above the plane defined by the first and second internal microphone 13, 14 and the first external microphone 20 is selected for external loudspeakers behind the listening position and vice versa for external loudspeakers in front of the listening position.
[0097] In some implementations, the ambiguity is resolved by the central control unit 18 obtaining loudspeaker information at step S7 shown in
[0098] The determined position of the external loudspeakers is then used at step S8 to calibrate at least one external loudspeaker of the loudspeaker system. Wherein the calibration of the at least one external loudspeaker involves adjusting/assigning at least one of: an external loudspeaker gain, an external loudspeaker delay, an external loudspeaker phase, an external loudspeaker equalization and an external loudspeaker role (e.g., rear-left, left-side, right-height) based on the determined position of the external loudspeaker relative to the listening position. For instance, external loudspeakers which are further away from the listening position may be provided with a shorter delay and higher gain compared to external loudspeakers which are closer to the listening position so as to achieve a balanced sound image at the listening position.
[0099] With reference to
[0100] Alternatively or additionally, the position of the external loudspeaker 30b can be determined by moving the first external microphone 20 to a new position and repeating some of the steps of the method. This will now be described in further detail with reference to
[0101] Preferably, the user is instructed to place the first external microphone 20 on the floor for the new position p.sub.new which enables the height above the floor of the new position to be estimated accurately (e.g., by the height of the microphone stand 21). At step S75a test signals are again emitted from the external loudspeakers 30a, 30b to be received at S76a by the first external microphone 20 at the new position p.sub.new. It is noted that as the audio device 10 is expected to be stationary, it is not necessary for the first and second internal microphones 13, 14 to receive the test audio signals when they are emitted the second time.
[0102] Based on the position of the first external microphone 20 at the listening position, the new position p.sub.new, and the test audio signals received by the first and second internal microphone 13, 14, the first external microphone 20 at the listening position and the first external microphone 20 at the new position p.sub.new the position of each external loudspeaker 30a, 30b is determined using trilateration. Thanks to the test audio signals received by the first external microphone 20 at the new position p.sub.new there remains no ambiguity as to the position of any external loudspeaker.
[0103] Alternatively or additionally, the position of the external loudspeaker 30b can be determined using a second external microphone 20b or a third internal microphone 15 (as shown in
[0104] However, it is also envisaged that the second external microphone 20b is separate from the first external microphone 20. In such cases, the second external microphone 20b also receives the calibration audio signals emitted by the audio device 10 at steps S2a and S2b from
[0105] At step S73b the test audio signal emitted by the external loudspeaker 30b is received by the second external microphone 20b (in addition to the test audio signal being received by the first and second internal microphone 13, 14 and the first external microphone 20). Using the test audio signals received by these four microphones 13, 14, 20, 20b and the determined position of the first external microphone 20 and the second external microphone 20b, the position of the external loudspeaker 30b may be determined (without ambiguity) using trilateration.
[0106] Alternatively, step S73b comprises receiving the test audio signal emitted by the external loudspeaker 30b with the third internal microphone 15 (in addition to the test audio signal being received by the first and second internal microphone 13, 14 and the first external microphone 20) and determining the position of the external loudspeaker 30b (without ambiguity) using the test audio signal received with these four microphones 13, 14, 15, 20. If the audio device 10 comprises a third internal microphone it is not necessary to provide a second external microphone 20b and therefore in some implementations, steps S71b and S72b are omitted.
[0107] The above described methods for determining the position of the external loudspeaker 30b may then be repeated for each external loudspeaker 30a, 30b present in the acoustic environment 1 so as to determine the position of all external loudspeakers 30a, 30b relative to the listening position and the audio device 10.
[0108]
[0109] Accordingly, the method allows a user to place external loudspeakers almost arbitrarily in the acoustic environment wherein the calibration will assign a suitable role to each (e.g., Lf, Rf or Rsh) automatically, without the user having to specify which loudspeaker that is intended for which role (e.g., by connecting it to a certain loudspeaker output port of the central control unit 18).
[0110] The person skilled in the art realizes that the present invention by no means is limited to the preferred embodiments described above. On the contrary, many modifications and variations are possible within the scope of the appended claims. For example, it is possible to use both a second external microphone and loudspeaker information to further enhance the accuracy of determining the position of external loudspeakers.