Method for audio reproduction in a multi-channel sound system

Abstract

The invention relates to a method for reproducing audio in a multi-channel sound system including two input signals (L and R), wherein output signals are generated for different sound perception levels. In order to develop said method in such a way that audio can be reproduced within a larger range of applications in a multi-channel sound system, according to the invention, only a lower sound perception level (7) and a higher sound perception level (6) are generated, and a maximum of six output signals are generated, a maximum of two output signals being allocated to the lower sound perception level (7) and a maximum of four output signals being allocated to the higher sound perception level (6).

Claims

1. A device with sound input and sound output channels, as well as a processor, wherein loudspeakers are assigned to the device, wherein a software is imported onto the processor, which contains an algorithm, which is processed by the processor, wherein the algorithm covering a method for audio reproduction in a multi-channel sound system comprising two input signals L and R, wherein output signals are generated for different listening levels, wherein the device is modular with a first modular unit and one or more additional modular units, wherein in the first modular unit of the device only one lower listening level and only one upper listening level are generated, wherein a maximum of six output signals, with a maximum of two output signals for the lower listening level and a maximum of four output signals for the upper listening level, are generated, and wherein the first modular unit of the device is expanded in modular fashion in that the output signals of the first unit serve as input signals one of the one or more additional modular units, in order to generate further lower and upper listening levels by the one or more additional modular units of the device.

2. The device according to claim 1, wherein the first modular unit and the additional modular units each have two input channels R and L, wherein in each of the first modular unit and the additional modular units a left output signal LHi and a right output signal RHi are generated in the lower listening level and the upper listening level by the algorithm in the signal processor so that four output signals, two for the upper listening level and two for the lower listening level are generated.

3. The device according to claim 2, wherein the left output signal LHi and the right output signal RHi are added to a mono signal LHi+RHi in the upper listening level and supplied to a first loudspeaker of the loudspeakers.

4. The device according to claim 2, further comprising a soundbar, wherein the output signals R and L in the lower listening level are taken as channels L1 and R1 directly to left and right loudspeakers of the soundbar, and wherein the output signals R and L serve as input signals R and L to one of the one or more additional modular units in order to generate a lower listening level and an upper listening level for the one of the one or more additional modular units by means of the algorithm in the signal processor on which the software is located.

5. The device according to claim 2 wherein in one of the additional modular units wherein starting from a splitting of the input signals R and L, output signals R and L are generated in the lower listening level and, in the upper listening level 6 a left output signal LHi and a right output signal RHi are generated, so that four output signals are generated, two for the upper listening level LHi and RHi, and two for the lower listening level L and R.

6. The device according to claim 5, wherein the left output signal LHi is mixed with the right input signal R and the right output signal RHi is mixed with the left input signal L in the lower listening level.

7. The device according to claim 6, wherein the device comprises a soundbar 40 having a total of five output channels, namely four output signals R, L, LHi+L, RHi+R in the lower listening level and one output signal LHi+RHi in the upper listening level , wherein the output signals R and L in the lower listening level are taken as channels L1 and R1 directly to left and right loudspeakers of the soundbar 40, and wherein the mixed signals in the lower listening level are supplied to two further loudspeakers of the soundbar.

8. The device according to claim 7, wherein the device further comprises a level control, an equalizer or a compressor, wherein the output channels are processed by the level control, the equalizer or the compressor.

9. The device according to claim 1, further comprising a subwoofer, and wherein the output signals R and L in the lower listening level, added in the signal sequence and before they are split again, are input to a low pass filter and, at the same time, processed as R and L signals in the signal processor.

10. The device according to claim 1, wherein two input channels Rt1 and Lt1, which result from summation of the right input channel R and a center channel, and from summation of the left input channel L and the center channel generate the output signals R1Hi and L1Hi in the upper listening level and the left output signal L1 and the right output signal R1 in the lower listening level , so that four output signals, two for the upper and two for the lower listening level, are generated.

11. The device according to claim 10, wherein the generated output signals R1Hi, L1Hi, L1 and R1 are not used again as input signals to one of the one or more additional modular units, wherein two further input signals SR and SL are surround signals, and are processed in parallel in the processor into output signals, which are decoded by a parallel processing into the output signals R2Hi, L2Hi, L2 and R2 in the upper and lower listening levels, and wherein the two output signals L1, L2 as well as the output signals R1, R2 are supplied to loudspeakers of the lower listening level , whereas the output signals L1Hi, R1Hi, L2Hi and R2Hi of the upper listening level are summed up to the signals RtHi, LtHi of the upper listening level and are supplied to loudspeakers of the upper listening level.

Description

[0017] In the following, the invention is explained in greater detail by means of the drawings. In diagrammatic representation,

[0018] FIG. 1 shows a loudspeaker arrangement of a 3D sound format with different listening levels of the prior art,

[0019] FIG. 2 shows a method of the invention,

[0020] FIGS. 3A-B, 4A-B, 5A-B, 6A-B, 7A-B, and 8A-B show different embodiments of AN equipment, into which a method of FIG. 2 is integrated,

[0021] FIGS. 9 to 11 show further embodiments of the method according to the invention and

[0022] FIG. 12 shows a device into which the method according to the invention of the embodiment of FIG. 11 is integrated.

[0023] FIG. 1 shows a conventional, three-dimensional audio reproduction system in a larger room 2, which is occupied by a listener 3, within the scope of a 9.1 surround-sound format. In the room 2, several loudspeakers of a loudspeaker arrangement 5, to which lower as well as higher listening levels 4a, 4b, 5a, 5b are assigned, are distributed.

[0024] The upper listening level 4a, with two loudspeakers with the left higher signal L.sub.Hi and the right higher signal R.sub.Hi as output signals, are in the front area of the room 2. Furthermore, the lower listening level 5a with four loudspeakers with the left signal L, the channel C (Center), the right channel R and the LFE (low frequency effect) channel as output signals, are in the front area of the room 2. The upper listening level 4b with two loudspeakers with the left, higher surround signal S.sub.L,hi and the right, higher surround signal S.sub.R,hi as output signals, are in the rear region of the room 2. The lower listening level 5b with two loudspeakers with the two surround signals S.sub.L, S.sub.R as output signals is in the front region of the room 2.

[0025] Before the signals are distributed in the lower and upper listening levels 4a, 4b, 5a, 5b to the loudspeakers, they are processed within the scope of a multichannel sound system and, starting out from the input signals R and L, by an audio processor intended for this purpose.

[0026] FIG. 2 shows the method according to the invention, which, starting out from the two input channels R and L, generates, over linear and parallel channels 8, 9, the output signals R and L in the lower listening level 7 and the left output signal L.sub.Hi and the right output signal R.sub.Hi n the upper listening level 6, so that four output signals, two for the upper and two for the lower listening level, are generated. A signal processor in the form of an audio processor, on which there is a software, serves for carrying out the method. The software contains an algorithm, which is processed by the signal processor, the algorithm covering the method.

[0027] As furthermore shown in FIG. 2, the upper listening level 6 passes through further steps of the method, starting out from the two input signals L and R.

[0028] In particular, the method sections are [0029] a decoding, [0030] a signal control, [0031] a phase correction, [0032] a frequency adjustment, [0033] an encoding, [0034] a master section.

[0035] To begin with, three channels are decoded from the two output signals L and R and formed parallel next to the channels 8, 9, which are guided linearly to the output. The upper listening level 6 arises by these means, while the channels 8, 9, which are guided linearly to the output, form the lower listening level 7.

[0036] The decoded channels are the left spatial channel R.sub.L=L−R, the right spatial channel R.sub.R=L−R and the center channel L+R.

[0037] The channels R.sub.L and R, illustrate the premises and reflections within the input signals L, R, whereas the channel C (center channel) depicts the addition of both input channels L, R. By these means, it is possible to process the input signals L, R further, when it is a question of a mono signal. If there is a mono signal at the input, the channels R.sub.L and R, remain mute and the channel C passes on the signal information and thus makes the further signal processing possible.

[0038] After this encoding step, the channel R, is passed into the signal detector 10. The latter issues the control signal “1”, when the signal strength of R, falls below the threshold level selected, and the control signal “0”, when the level of the channel R, rises above the selected threshold level. The threshold level is −20 dB and the reaction time (trigger) zero seconds.

[0039] The control signals of the signal detector 10 are multiplied by the signal multiplier 11 with the signal of the center channel. If no recognized signal is present in the channel R.sub.R, so that there is no stereo signal in the channels R.sub.L and R.sub.R above or equal to the signal strength specified by the threshold level and the signal detector 10 generates the control signal “1”, the channel C is multiplied by “1” and supplied to a further processing. If a recognized signal is present in the channel R.sub.R, so that a stereo signal is in the channels R.sub.L and R.sub.R above or equal to the signal strength specified by the threshold level and the signal detector 10 generates the control signal “0”, the channel C is multiplied by “0” and not released for further processing, since the signal is equal to zero, so that it is recognized unequivocally whether a stereo signal is present.

[0040] In order to avoid a phase shift of the channels R.sub.L, R.sub.R, a phase correction is made in a next step of the method, as furthermore shown clearly in FIG. 2, in order to transform the signal from the channels R.sub.L and R.sub.R into a stereo signal free from phase shift. This is achieved by the use of a delay 12 in the channel R.sub.R. The channel R.sub.R is delayed with respect to the channel R.sub.L so that the phases of the two channels are placed into a not phase-shifted audio signal in stereo. The delay time is 140 samples at a frequency of 48 kHz and 16 bit.

[0041] In order to intensify the later impression of a reflection for the upper listening level 6, the phase of the channel C is also adjusted and, moreover, by a delay 13, which is used on the channel C.sub.R, after the channel C (L+R) has been split into the channels C.sub.L and C.sub.R after the signal multiplier 11 and continued in this fashion in dual mono channels. The channel C is strictly a mono channel and can be converted into a stereo signal by splitting into the two duo mono channels C.sub.L and C.sub.R and the retardation of the channel C.sub.R to the channel C.sub.L by a delay and, moreover, with a phase correlation above 0. By these means, the audio impression of an increased diffusivity of the original signal results and contributes to the impression of the tonal range of heightened hearing, since a mono signal, which was recorded with microphones installed in an elevated position, is reproduced also not linearly but diffusely and afflicted with reflections, depending on the nature of the recording room and the height of the installed microphones.

[0042] Within the scope of a further step of the method, the frequency of the center channel C is adjusted by means of the equalizer 14. The frequency adjustment of channel C adjusts the frequency-dependent reproduction of the latter in the later output signals L.sub.Hi, R.sub.Hi of the upper perception level 6 and, moreover independently of the later frequency adjustment of the output signal. By these means, the sound character of the output signals L.sub.Hi, R.sub.Hi can be adjusted optimally to the AV equipment shown in FIGS. 3 to 8, over which these two channels can be emitted. The encoding, as a further step of the method, sums up the stereo signal of the channels R.sub.L, R.sub.R and the stereo signal of the channels C.sub.L, C.sub.R to the channels L.sub.t, R.sub.t in such a manner, that the channels RL and C.sub.L form the channel Lt and the channels C.sub.R and R.sub.R form the channel R.sub.t. The summing up is accompanied by a level adjustment at the level controls 15, 16, 17, 18, since the levels of the newly created channels L.sub.t, R.sub.t are raised by the described summing up of the channels R.sub.L, R.sub.R and C.sub.L, C.sub.R. The level adjustment lowers the levels R.sub.L, R.sub.R, C.sub.L, C.sub.R correspondingly, so that their summing up cannot lead to overloading. Due to the encoding, there is now a stereo signal, which can be processed by the subsequent master section and also played back by conventional commercial audio playback components. Alternatively, it is also possible to generate two independent stereo signals, in that the channels R.sub.L, R.sub.R, and C, C.sub.R, are not encoded, so that four output signals arise in the upper listening level 6.

[0043] In order to intensify the auditory impression of a “sound reflection upward”, the signals L.sub.t and R.sub.t, as is furthermore evident from FIG. 2, are adjusted over the equalizers 19, 20 within the scope of the master section, individually to their later use in their frequency responses. Depending on the desired radiation characteristics, the signals L.sub.t and R.sub.t appear to be further removed from the original source of sound. The effect of the sound emission can also be imitated here by a frequency response. The further removed it appears to be from the source of sound upwards, the more can, for example, the upper frequencies be lowered by a low-pass filter. By adjusting the frequency, it is also possible to match this sound result optimally to the loudspeaker or loudspeakers, which radiates or radiate the output signals L.sub.Hi, R.sub.Hi, later on.

[0044] By using an echo and/or a stereo delay 21, which are mixed with the signal L.sub.t, R.sub.t in a ratio which can be adjusted individually and according to the type of use of the method, a room as well as a sound delay is portrayed. By these means, it is ensured that the output signals L.sub.Hi, R.sub.Hi of the upper listening level 6 can also portray various rooms and sound delays through the use of different presets, which can be saved, in order to be able to match the sound result even more closely to a true “sound reflection upwards” as well as to the individual sound conceptions of the manufacturer and/or the user.

[0045] In order to intensify the hearing sensation that the output signals L.sub.Hi, R.sub.Hi reproduce sound “which comes up from below” even further, a compression step is inserted into the master section, as shown in FIG. 2. Adjusting the compressor 22 or a limiter ensures that the signal is smoothed, so that the sound peaks are intercepted and the quieter parts of the audio signal R.sub.t,Hi, R.sub.t,Hi are raised. This enhances the audio impression of the diffuse and remote sound, since sound peaks preferably occur in the vicinity of a sound source and decrease as the recording microphone is moved away upwards from there. Moreover, by means of the compression it is possible to adjust the ratio of the dynamic response to the channels L, R in the lower listening level 7.

[0046] The level adjustment of the channels L.sub.t,Hi, R.sub.t,Hi at the level adjusters 23, 24 is a further step of the method, in that the output level is adjusted in relation to channels of the lower listening level 7, so that the impression of heightened hearing can be matched perfectly to the respective hearing situation. Alternatively, it is also possible to mix the audio signal L.sub.t,Hi, R.sub.t,Hi once again with the channels L, R, in order to be able to portray an enhanced sound impression also in loudspeaker systems with only two loudspeakers or even only one.

[0047] The following parameters come into consideration for the individual steps of the method.

Phase correction: [0048] Delay time: 140 samples at a frequency of 48 kHz, 16 bit [0049] Channel C phase adjustment [0050] Delay time: 10 samples at a frequency of 48 kHz, 16 bit [0051] Channel C frequency adjustment: [0052] High pass filter: limit frequency at 200 Hz, gain=0, Q factor equals 1.41 [0053] Low pass filter: limit frequency at 3000 Hz, gain=0, Q factor=1.41

Encoding:

[0054] The levels are adjusted so that the encoded summing up of the channels RL, RR, CL, CR has the same level (dB) as that of RL, RR before the summing up.

Master Section/Frequency Adjustment:

[0055] High pass filter: limit frequency at 200 Hz, gain=0, Q factor=1.41 [0056] Low pass filter: limit frequency at 3000 Hz, gain=0, Q factor=1.41

Master Section/Room/Reflection

[0057] Individually adjustable, no ideal settings, depends on the method used. Advantageously, the decay for echo is brief, that is, decay times of 0.51 seconds to 0.67 seconds and a pre-delay of 20 milliseconds

Master Section/Compression:

[0058] Threshold: −10 dB [0059] Ratio: 8:00:1 [0060] Attack: 0.46 milliseconds [0061] Release: 560 milliseconds [0062] Knee: 80

Master Section Level Adjustment (dB)

[0063] The level can be adjusted individually for the device and the environment, in which the method is to be used.

[0064] FIGS. 3 to 8 show audio video equipment (AV equipment), in which the method according to the invention is integrated. For this purpose, the AV equipment in each case has a signal processor, which is not shown in FIGS. 3 to 8 and on which software is located. The software contains an algorithm, which is processed by the signal processor in the form of an audio processor, wherein the algorithm covers the method according to the invention. It is a common feature of the AV equipment, shown in FIGS. 3 to 7, that, in addition to the sound input and sound output channels, it also has a picture input and picture output channels.

[0065] AV equipment, such as a television set (TV) and a flat screen set 28, shown in FIGS. 3a, 3b, have not only one or two loudspeakers for radiating mono and stereo sound, but three loudspeakers, 26, 27 for the mono sound (FIG. 3b) or four loudspeakers, 26, 27 for the stereo sound (FIG. 3a), since the upper listening level has been added. The upper listening level is extracted, as it were, from the lower listening level by the encoding described in FIG. 2. This is indicated by the dotted arrows in FIGS. 3 to 8. The loudspeakers, 26, 27 are installed in the conventional manner in accordance with the individual requirements of the equipment and mounted so that they make a coordinated audible range possible. It is also possible, for example, to let the loudspeakers of the upper listening level radiate upwards, in order to allow the audible range to become even more diffuse upwards.

[0066] A mobile PC 25 (FIGS. 4a, 4b), a tablet PC 29 (FIGS. 5a, 5b) and a smart phone 31 (FIGS. 7a, 7b) represent further examples of the application in vertical use as well as in horizontal use, as does a radio 32 (FIG. 8a, 8b).

[0067] A sound bar 33 is also, as is evident from FIGS. 6a, 6b, not only used for the reproduction of the total sound of AV equipment, such as a television set, but also, in accordance with the invention, for radiating the extracted upper listening level. New loudspeaker constellations within these types of equipment arise from this since, for example, also a sound bar with individual outputs for the upper listening level according to the invention, supplies the loudspeakers of the TV set, which are no longer active for the operation of a sound bar, with the new signals of the upper listening level and the TV set can thus be operated more economically. Since a stereo signal is also generated within the scope of the invention, it can be combined in the AV equipment in turn with matrix surround sound decoders, in order to subject the sound of the upper listening level to a surround decoding. With that, it is possible to extract the whole of the upper listening level forwards and rearwards.

[0068] The embodiments of the present invention are not limited to the examples given above. Rather, a number of variations is conceivable, which make use of the solution shown also for embodiments of a different type. For example, the channels 8, 9 in the lower listening level 7 can also be processed further.

[0069] The inventive principle of the modular-like, expandable smallest unit of a signal generation, which leads to complex loudspeaker configurations, is also illustrated in FIG. 9.

[0070] Starting out from the two input channels R and L, the left output signal L.sub.Hi and the right output signal R.sub.Hi are generated in the lower listening level 7 and the upper listening level 6 by means of an algorithm in the signal processor 34, so that, to begin with, four output signals, two for the upper listening level 6 and two for the lower listening level 7, are generated.

[0071] As it is furthermore evident from FIG. 9, the left output signal L.sub.Hi and the right output signal R.sub.Hi are then added to a mono signal L.sub.Hi+R.sub.Hi in the upper listening level 6 and supplied to a first loudspeaker 35.

[0072] The output signals R and L in the lower listening level 7 are then taken as channels L.sub.1 and R.sub.1 directly to the loudspeakers 36, 37 of the soundbar 40. At the same time, the output signals R and L serve as input signals R and L, in order to generate a lower listening level 7 and an upper listening level 6 once more within the scope of the method according to the invention. This takes place again by means of the algorithm in the signal processor 34, on which the software is located. The software contains an algorithm, which is processed by the signal processor.

[0073] Starting out from the splitting of the input signals R and L, the output signals R and L are generated in the lower listening level 7 and, in the upper listening level 6, the left output signal L.sub.Hi and the right output signal R.sub.Hi are generated, so that, once again, four output signals are generated, two for the upper listening level 6, that is, L.sub.Hi and R.sub.Hi, and two for the lower listening level 7, that is, L and R. Subsequently, the signals L.sub.Hi and R.sub.Hi are mixed with the signals R and L in the lower listening level 7, that is, is added to the signal L and R.sub.Hi to the signal R. By these means, the added or mixed signals in the lower listening level are supplied to two further loudspeakers 38, 39 of the sound bar 40. Accordingly, the sound bar 40 has a total of five output channels, namely four output signals R, L, L.sub.Hi+L, R.sub.Hi+R in the lower listening level 7 and one output signal L.sub.Hi+R.sub.Hi in the upper listening level 6. All output channels can be processed further by the level control, the equalizer, the compressor etc.

[0074] The variation of a modular-like, expandable smallest unit, shown in FIG. 9, can be expanded in a sound bar by a subwoofer 41, as shown in FIG. 10. For this purpose, as shown in FIG. 10, the output signals R and L in the lower listening level, added in the signal sequence and before they are split again, can be sent to a low pass filter 42 and, at the same time, processed as R and L signals in the signal processor 34.

[0075] FIG. 11 also illustrates a further variation of the inventive principle of the modular-like, expandable smallest unit of a signal generation, which leads to complex loudspeaker configurations.

[0076] FIG. 11 shows the method according to the invention that the two input channels R.sub.t1 and L.sub.t1, which result from the summations R+C and L+C (C=center channel), generate the output signals R.sub.1Hi and L1Hi in the in the upper listening level 7 and the left output signal L.sub.1 and the right output signal R.sub.1 in the lower listening level 6, so that four output signals, two for the upper and two for the lower listening level, are generated. Here also, the signal processor 34 is used to generate the signals and, moreover, in the form of an audio processor, on which a software is located, which contains the algorithm.

[0077] The embodiment of the method according to the invention, shown in FIG. 11, differs from that described in FIG. 10 in that the generated output signals R.sub.1Hi, L.sub.1Hi, L.sub.1 and R.sub.1 are not used again as input signals, but that two further input signals S.sub.R and S.sub.L, in the form of surround signals, are processed in parallel in the processor into output signals, which are decoded by a parallel processing into the output signals R.sub.2Hi, L.sub.2Hi, L.sub.2 and R.sub.2 in the upper and lower listening levels. The two output signals L.sub.1, L.sub.2 as well as the output signals R.sub.1, R.sub.2 are sent to the loudspeakers of the lower listening level 6, whereas the output signals L.sub.1Hi, R.sub.1Hi, L.sub.2HI and R.sub.2Hi of the upper listening level 7, as shown furthermore in FIG. 11, are summed up to the signals R.sub.tHi, L.sub.tHi of the upper listening level 7, which are supplied to the loudspeakers of the upper listening level 7.

[0078] The further LFE channel is guided directly to its own outlet and, as LFE output channel, is supplied there to a further loudspeaker. This output channel, like all the other output channels, can also be processed further by a level control, equalizer, compressor, etc. The loudspeaker configuration of audio equipment, which corresponds to the embodiment described in connection with FIG. 11, is illustrated in FIG. 12.

[0079] It is a common feature of both the embodiments shown in FIGS. 10 and 11, that the method according to the invention is processed repeatedly in the signal processor 34.

LIST OF REFERENCE NUMERALS

[0080] 2 room [0081] 3 listener [0082] 5 loudspeaker arrangement [0083] 4a, 4b, 6 upper listening level [0084] 5a, 5b, 7 lower listening level [0085] 8, 9 channels [0086] 10 signal detector [0087] 11 signal multiplier [0088] 12, 13, 21 delay [0089] 14, 19, 20 equalizer [0090] 15, 16 level control [0091] 17, 18 level control [0092] 22 compressor [0093] 23, 24 level control [0094] 25 PC [0095] 26, 27 loudspeaker [0096] 28 flat screen [0097] 29 PC [0098] 31 smart phone [0099] 32 radio [0100] 33 sound bar [0101] 34 signal processor [0102] 35, 36, 37 loudspeaker [0103] 38, 39 loudspeaker [0104] sound bar [0105] subwoofer [0106] low pass filter