LOWER LAYER REPRODUCTION

20220038838 · 2022-02-03

    Inventors

    Cpc classification

    International classification

    Abstract

    An audio processor for reproducing multichannel audio has a normal layer processing and a lower layer processing. The normal layer processing is configured for processing one or more channels of the object-specific audio or the multichannel audio belonging to a normal layer. The lower layer processing is configured for processing at least one channel or more channels of the object-specific audio or the multichannel audio belonging to a lower layer. The lower layer processing is configured to feed at least one signal belonging to the one channel or the more channels of the lower layer to a subwoofer output.

    Claims

    1. An audio processor for reproducing object-specific audio or multichannel audio, comprising: a normal layer processor configured for processing one or more channels of the object-specific audio or the multichannel audio belonging to a normal layer; a lower layer processor configured for processing at least one channel or more channels of the object-specific audio or the multichannel audio belonging to a lower layer, wherein the normal layer is a listening layer laying within a height of a listener's head as seen from a listener's perspective and wherein the normal layer lies above the lower layer as seen from the listener's perspective; wherein the lower layer processor is configured to feed at least one signal belonging to the one channel or the more channels of the lower layer to a subwoofer output, so as to reproduce the one or more channels of the lower layer using a subwoofer wherein frequencies of a frequency portion of the one or more channels of the lower layer are above 150 Hz or even above 300, 500 or 1000 Hz so as to be high enough to enable a localization of the sound generated by the subwoofer.

    2. The audio processor according to claim 1, wherein the lower layer processor is configured to feed at least one signal belonging to a first of the one or more channels of the lower layer to a first subwoofer output and to feed at least another signal belonging to a second of the one or more channels of the lower layer to a second subwoofer output.

    3. The audio processor according to claim 2, wherein the first subwoofer output is assigned to a first lateral room direction and wherein the second subwoofer output is assigned to a second lateral room direction, different from the first room direction.

    4. The audio processor according to claim 1, wherein the one signal of the one or more channels of the lower layer comprises a frequency portion which comprises only frequencies above a frequency portion of one or more LFE channels, or which is above a crossover frequencies of the one or more channels of the normal layer, or which is above selected crossover frequencies of the one or more channels of the normal layer, and/or wherein the one signal of the one or more channels of the lower layer comprise a frequency portion which comprise only frequencies above 80 Hz, above 100 Hz, above 120 Hz, above 150 Hz, above 200 Hz, above 300 Hz, above 500 Hz, above 1000 Hz.

    5. The audio processor according to claim 1, further comprising a LFE/bass processor which is configured to feed one or more LFE channels of the object-specific audio or the multichannel audio or low frequency portions of the one or more channels of the normal layer to the subwoofer via the subwoofer output.

    6. The audio processor according to claim 5, wherein the lower layer processor is configured to route a low frequency portion of the one or more channels of the lower layer to the LFE/bass processor.

    7. The audio processor according to claim 1, wherein the lower layer processor comprises a bandpass filter for defining a frequency range for the one or more channels belonging to a lower layer; or wherein the lower layer processor comprises a bandpass filter for defining a frequency range for the one or more channels of the lower layer and for virtualization processing.

    8. The audio processor according to claim 7, wherein the lower layer processor is configured to route a low frequency portion below the defined frequency range of the one or more channels of the lower layer to the LFE/bass processor, wherein the low frequency portion processed by the LFE/bass processor results in signals complementary to signals resulting from the lower portion of the bandpass filtering.

    9. The audio processor according to claim 1, wherein the lower layer processor is configured to route a high frequency portion of the one or more channels of the lower layer to the normal layer processor, such that the high frequency portion of the one or more channels of the lower layer is reproduced together with the one or more channels of the normal layer.

    10. The audio processor according to claim 9, wherein the high frequency portion of the one or more channels of the lower layer is reproduced via the normal layer processor by use of a reduced or adapted amplification, when compared to the amplification of the portion reproduced via the lower layer, and/or, wherein the higher frequency portion is reproduced via the normal layer processor in a delayed manner, when compared to the portion reproduced via the lower layer processor.

    11. The audio processor according to claim 1, wherein the normal layer is a listening layer laying within a height of a listener's head from a listener's perspective, wherein the normal layer lies above the lower layer as seen from the listener's perspective.

    12. The audio processor according to claim 1, wherein the audio processor comprises a height layer processor for processing one or more channels of the object-specific audio or the multichannel audio belonging to a height layer.

    13. The audio processor according to claim 1, further comprising a calibration unit for performing a calibration procedure, wherein the calibration procedure comprises a calibration for calibrating the one or more channels of the lower layer reproduced by use of a subwoofer output.

    14. The audio processor according to claim 1, wherein the audio processor comprises an up-/downmixing unit which is configured to perform an upmixing or downmixing of the lower layer out of one or more channels of the normal layer, e.g. for conventional stereo or multichannel audio, and/or which is configured to perform a rendering of objects arranged at lower positions to the lower layer for object-specific audio.

    15. An audio system for reproducing multichannel audio, comprising: an audio processor for reproducing multichannel audio according to claim 1; at least one soundbar or sound system for reproducing a normal layer; and at least one subwoofer or at least one two-way audio loudspeaker or multi-way loudspeaker for reproducing the lower layer.

    16. The audio system according to claim 15, wherein the at least one subwoofer or the at least one two-way audio loudspeaker or the at least one multi-way audio loudspeaker is arranged at the floor.

    17. The audio system according to claim 15, wherein the at least one subwoofer or the at least two-way audio loudspeaker or the at least one multi-way audio loudspeaker comprises a midrange transducer or a tweeter.

    18. A method for reproducing multichannel audio, comprising processing one or more channels of object-specific audio or multichannel audio belonging to a normal layer; processing at least one channel or more channels of the object-specific audio or the multichannel audio belonging to a lower layer; wherein the normal layer lies above the lower layer, wherein the processing of the one or more channels of the lower layer comprises a sub-step of feeding at least one signal belonging to the one or more channels of the lower layer to a subwoofer output.

    19. The method according to claim 18, wherein the normal layer is reproduced using a soundbar or a sound system.

    20. A non-transitory digital storage medium having stored thereon a computer program for performing a method for reproducing multichannel audio, comprising processing one or more channels of object-specific audio or multichannel audio belonging to a normal layer; processing at least one channel or more channels of the object-specific audio or the multichannel audio belonging to a lower layer; wherein the normal layer lies above the lower layer, wherein the processing of the one or more channels of the lower layer comprises a sub-step of feeding at least one signal belonging to the one or more channels of the lower layer to a subwoofer output, when said computer program is run by a computer.

    Description

    BRIEF DESCRIPTION OF THE DRAWINGS

    [0036] Embodiments of the present invention will be subsequently discussed referring to the enclosed figures, in which:

    [0037] FIG. 1 shows a block diagram of an audio processor according to a first embodiment;

    [0038] FIG. 2a shows a block diagram of a sound system to be used in combination with the above processor according to further embodiments;

    [0039] FIG. 2b shows another block diagram of another sound system to be used in combination with the above-described processor according to further embodiments;

    [0040] FIG. 3 shows an exemplary block diagram of a generic bass management to be used in combination with embodiments;

    [0041] FIG. 4 shows a schematic block diagram of an audio processor in accordance to an enhanced embodiment; and

    [0042] FIG. 5 shows a schematic block diagram of a further audio processor in accordance to an enhanced embodiment

    DETAILED DESCRIPTION OF THE INVENTION

    [0043] Below, embodiments of the present invention will subsequently be discussed referring the enclosed figures, wherein identical reference numerals are provided to objects having similar or identical function so that the description thereof is mutually applicable and interchangeable.

    [0044] Before discussing the approach of reproducing a lower layer according to an inventive approach, different methods for sound reproducing using soundbars will be discussed. Embodiments of the present invention make use of these sound reproducing techniques, e.g., for reproducing the normal layer (cf. FIG. 1).

    [0045] One class of devices are based on ‘psychoacoustic methods’ or the like, i.e. the reproduction system applies a processing that tries to evoke at the listener's ears auditory ques that generate a percept of sound coming from a specific direction, advantageously another direction than that of the actual sound reproduction device. Such methods go by names like e.g. cross-talk cancelation, HRTF processing, binaural processing, psychoacoustic filtering, etc . . . , in general virtualization processing.

    [0046] Similar to such reproduction methods being used for horizontal and elevated height reproduction, also a reproduction of floor level sounds in soundbar systems could be achieved by psychoacoustic methods (e.g. HRTF processing).

    [0047] Another method of reproducing sound by soundbar devices is based on (room) acoustic methods. Sounds can for example be steered or directed to reflective surfaces (by either positioning loudspeakers in a beneficial way, or by using array processing such as beamforming). The reflective boundaries of the listening environment (which is usually a common living room in consumer homes), will reflect the sound towards the listener's position. Such, the perception of sound emanating from the ceiling or a wall, or a position somewhere behind the actual wall can be evoked.

    [0048] For the reproduction of surround and overhead sounds, such methods are already in use. One could also target the objective of lower layer sound reproduction by using the reflective approach as has been used for elevated sound reproduction. However, in contrast to the propagation path and acoustic properties that can be expected when using a ceiling as reflective boundary surface (where a ceiling is usually quite predictable and standard), the acoustic properties of the path via the floor can be heavily varying. The floor may e.g. be covered with diverse carpeting or a hard floor, both of which behave totally different in terms of their acoustic properties. While such acoustic properties could be taken care of by measuring the actual properties in the present environment, further problems arise with that method of reproduction. Tables can be positioned between the sound reproduction device and the listening space which either act as diffusors, or in the worst case totally block sound propagation via that path. Furthermore, if the soundbar is positioned on a shelf, but not aligned with the front edge of the shelf, such a ‘downfiring’ approach would directly be targeted towards the close-by shelf.

    [0049] Below with respect to FIG. 1 another approach according to the present invention will be discussed enabling lower layer reproduction.

    [0050] FIG. 1 shows an audio processor 10 comprising a normal layer processing 12 and a lower layer processing 14. The audio processor 10 receives an object-specific audio or a multi-channel audio signal MCA, which may consist out of a plurality of separate channels, or by a signal to be downmixed or to be upmixed or as object specific audio or any other surround sound format.

    [0051] This MCA signal is divided into at least two multichannel audio signal portions, namely a portion to be reproduced as normal layer (i.e., in a height substantially complying to the position of the listener's head (cf. MCA.sub.N) and into a lower layer portion MCA.sub.L, i.e., a portion for reproducing the lower level sound/floor level sound below the height of the listener's head.

    [0052] The MCA.sub.N is processed by the normal layer processing 12 and may comprise a plurality of channels, e.g., left and right. These channels may be fed to an output, e.g., connected to a soundbar 20, which may be arranged at the listener's head height. The outputs for the normal layer processing are marked by 12o.

    [0053] The MCA.sub.L'S signals are reproduced using the lower layer processing 14. Further, this is configured to process the at least one or more channels of the multichannel audio belonging to the lower layer by feeding at least one signal belonging the one or more channels of the lower layer to a subwoofer output 14o. Via this approach, the MCA.sub.L signal is reproduced using a subwoofer 22, which typically is positioned at the floor of the listening room so that sound output by the subwoofer 22 seems to be localized at the floor level.

    [0054] According to embodiments, the frequency portion to be reproduced by use of the lower layer processing 14 is above the typical subwoofer frequencies, such that the frequencies are high enough to enable a localization of the sound source. For example, the frequencies may be above 150 Hz or above 100 Hz, or even above 300, 500 or 1000 Hz.

    [0055] FIG. 2 shows a common soundbar system with the soundbar 20 and the subwoofer 22. Here, the subwoofer 22 may be connected to the soundbar by being used wired or wirelessly. This sound system comprising the elements 20 and 22 may be driven by the audio processor 10 as discussed with respect to FIG. 1.

    [0056] Regarding the normal sound processing 12 it should be noted that same may also use the subwoofer 22 via the output 14o in order to reproduce the low frequency effect (LFE) signals contained with the sound signal MCA.sub.N and/or to reproduce low frequencies split out the MCA.sub.N signal by use of a crossover.

    [0057] Some enhanced sound reproduction systems make use of two LFE channels/signals, this is an additional benefit over common systems using just one subwoofer 22. So both individual LFE signals can be reproduced with individual/dedicated subwoofers 22. If only one LFE channel is present in the input signal, this can be reproduced using both subwoofers (not shown).

    [0058] In common systems, the subwoofers 22 are used to play back the bass signals that cannot be reproduced by the soundbar 20 itself. For that purpose, usually (and also in the proposed system), a bass management system can be/is used. Such bass management systems usually divide the reproduced sounds into a low frequency portion (that is routed to the subwoofer 22) and a high frequency portion (that is played back by the soundbar 20).

    [0059] It should be noted that bass management may also be referred to as LFE/bass processing. The bass management (in sense of bass processing) enables to forward low frequency portions of the one or more channels of the normal layer to the LFE channel/subwoofer. Bass management (in sense of LFE processing) may also comprise processing of the low frequency portions or the LFE signal(s) forwarded to the LFE channel(s)/subwoofer(s), e.g. when different types of subwoofers are used or when the subwoofer has a certain amplification/phase correction due to its position in the room.

    [0060] FIG. 2b shows another sound system comprising the soundbar 20 as well as two subwoofers 22l and 22r. Background thereof is that some advanced audio reproduction systems feature two LFE channels (e.g., “The 22.2 multichannel sounds and its reproduction at home and personal environment”). And also in literature benefits of using uncorrelated lower frequency bass signals have been discussed.

    [0061] These two subwoofers 22l and 22r can be driven by the lower layer reproduction 14 as discussed above. Beneficial with two subwoofers is, that the low frequency part can be routed to two subwoofers 22l, 22r, and such stereophonic effects can be reproduced and such be preserved if they have been present in the input signals.

    [0062] According to embodiments the subwoofers 22l, 22r are now also used to play (for specific input channels or object positions, namely the once corresponding to a lower layer) also higher frequency sound, for which likely already a sound localization by a listener is possible.

    [0063] Since the subwoofers 22l, 22r are placed on the floor, those specifically routed sounds will also be perceived as coming from the floor level. This is exactly the intend of floor level sound, and such a convenient solution to solve that problem for consumer audio playback via soundbar devices. Note, the general idea as discussed with respect to FIG. 1 and FIG. 2a works with only one subwoofer 22, which would then receive a mono-downmix of the lower array signals MCA.sub.L, while according to the enhanced approach, the MCA.sub.L is assigned to the different room directions and fed to the corresponding subwoofer outputs.

    [0064] Of course, the two subwoofers 22l and 22r may also be used by the normal layer processing 12 to reproduce the LFE signals or the low frequencies belonging to the MCA signals which are filtered out of the signal fed to the soundbar 20.

    [0065] Usually, subwoofers 22l, 22r are used to support the low frequency reproduction, because the low frequency components of the content can usually not be reproduced by the often small loudspeakers built into soundbars. (The same is true for loudspeaker systems using small satellite loudspeakers and a subwoofer.)

    [0066] For specific LFE (low frequency effect) signals, those low frequency signals also have a rather high energy and can therefore not be reproduced by the normal loudspeakers or the transducers in the soundbar enclosure.

    [0067] In addition to only playing back the LFE signal, the subwoofer in soundbar systems (or also in conventional loudspeaker systems featuring small satellites-style loudspeakers and a subwoofer) feature bass management systems.

    [0068] Basically, bass management systems contain a high-pass filter for each of the input channels and a corresponding/complementary low pass filter. The high pass part of the main channels is routed to the primary reproduction means (either e.g. small loudspeakers, or a soundbar), while the low-pass parts of all the channels plus the LFE input signal are routed to a subwoofer. Usually, the crossover frequency between the high-pass and the low-pass part is somewhere around 100 Hz (maybe between 80 Hz and 120 Hz, but that frequency is not exactly fixed/standardized and can be chosen by the system's manufacturer).

    [0069] This generic mono-bass management for enhancing the above described audio processor 10 is illustrated by FIG. 3. FIG. 3 shows an exemplary block diagram of a generic mono-bass management 16 (i.e., playing back the low frequency sound using only a single subwoofer as described in context of FIG. 2a).

    [0070] The bass management 16 receives a plurality of channels 1, N, M, wherein the channels 1 to N are the channels belonging to the normal layer (cf. MCA.sub.N) which are high pass filtered by the filters 60hp and forwarded to be reproduced, e.g., to the entity 12. The low pass portion of all channels 1-N as well as M is extracted (filtered) and forwarded by the low pass filter 16lp, such that the low pass portion can be fed to the subwoofer. The channel M is also forwarded to the low pass filter 16lp directly and fed after low pass filtering by the low pass filter 16lp to the subwoofer. Note, that the mixer 16m adds all low pass signals from the channels 1 to N and the signal of the channel M. Note, that the low pass filter 16lp receives the entire frequency band of all signals 1 to M. According to embodiments, different variants of such systems exist, and sometimes the LFE input is also boosted by a specific amount. As illustrated by FIG. 3, channel M is directly processed by the low pass filter 16lp without processing same using the high pass filters 16hp. For example, channel M can represent the input for the LFE signal.

    [0071] FIG. 4 shows another variant of a processor, namely the processor 10′. This comprises the lower layer processing 14′ as well as the normal layer processing 12′ including the bass management 16′. Of cause, the normal layer processing 12′ (soundbar processing, processor for beamforming, etc.) can further comprise other processing means beside the HP and LP.

    [0072] The lower layer processing comprises an optional bandpass 14b′, and optional band stop 14bs′, an optional equalizer 14e′ and an output 14o′. The band stop forwards the signal or low portion of the signal or a high portion (e.g. above 1500 Hz, above 2500 Hz, above 3000 Hz or above 3500 Hz) of the signal to the normal processing 12′ including the base management 16′.

    [0073] The input MCA to the reproduction system is a multi-channel audio file containing sounds that are intended to be played back in different heights (e.g. on a horizontal plane, and below that plane, and above). Since the present invention is mainly concerned with a specific processing for lower array sounds, it is referred to the known technology (e.g. WO2017/021162) with regard to the reproduction of horizontal and ‘above ear height’ signals by use of the soundbar system. Such, the input signals are exemplarily divided into ‘lower layer channels MCA.sub.L and all other channels MCA.sub.N.

    [0074] The ‘all other channels’ MCA.sub.N passing the (stereo/multi-channel) bass management 16′ and are then further processed by the soundbar processing 12′. (The order of the soundbar processing and the bass management as well as the specifics of the soundbar 20 processing and potentially included processing to optimize or protect the loudspeakers etc. are not relevant here and can easily be included into the inventive method.)

    [0075] The lower layer channels are routed to the processing 14′, which can perform one, a plurality or all of the below discussed functionalities. [0076] Extract a specific frequency range (which is adjustable based on the specific system). This frequency range is indicated by a bandpass 14b′ (BP) in FIG. 4. This bandpass signal can be further processed (e.g. gain modified and EQed to match the other parts of the reproduction system) and is then routed/panned to the two subwoofers [0077] The complementary signal (i.e. the bandstop signal, indicated as BS 14bs′ in FIG. 4) is routed differently than the BP signal part and processed like the rest of the input signals (i.e. all other input channels) [0078] The bandpass limits are selected such, that for a limited frequency range, the signals are played back by the subwoofers. The selection of this frequency range may be such that the signals are located in the same plane as the subwoofers 22l, 22r (i.e. on floor level). [0079] Advantageously, a bandpass signal (as opposed to a fullband signal) is used for playback over the subwoofers 22l, 22r, since usually subwoofers cannot reproduce (very) high frequency sound in a good quality. Still, they can easily reproduce sounds that are above the usual LFE and bass management crossover-frequencies. [0080] Furthermore, if the frequencies are getting too high, the sounds could potentially be located as coming directly out of the subwoofers, which is not intended. The loud-speakers/subwoofers themselves should ideally not directly be localized, but rather phantom images generated by the interaction of both subwoofers. [0081] The sum of the BP and the BS signals is the complete lower array signal, so no signal components are lost during reproduction. [0082] The system is tuned such, that although the high frequency parts of the signals are played back through the standard soundbar processing, the localization of the lower array sounds is dominated by the floor level subwoofer output. (That can be achieved e.g. by appropriate time-delays between the sounds routed to the sub-woofers and those routed to the standard soundbar processing).

    [0083] Note that the used subwoofer or subwoofers may, for example, be built/configured/tuned in such a way that they can also play back higher frequency range than the usual LFE/bass processing frequency range (bass management frequency range). Usually such (external) subwoofers are positioned on the floor, next to the place where the soundbar is positioned (or in the corners or on the sidewalls). For lower layer sound present in the content, the subwoofers play also high frequency components of those sounds—such, these signals are rendered by a system that is physically positioned on the floor, and will such be perceived from floor level.

    [0084] According to embodiments, for the LFE or bass management signals, the subwoofers are used as they would be used in a conventional system.

    [0085] According to further embodiments, above a certain frequency, the lower layer sounds can be redistributed to be not only played back using the subwoofers, but also the soundbar itself (and its processing). The idea behind this step is the following: Since subwoofers usually use large transducers/membranes, they get very directive for high frequencies (i.e. while low frequencies are emitted rather omnidirectional, the actual positioning of the subwoofer is not so important for the evoked perception. Furthermore, low frequencies are anyways not so easily localizable. The higher the frequency gets in comparison to the size of the membrane, the sound emission gets more directive, and sound is emitted predominantly to the forward direction. Such, the positioning of the subwoofer would be an influencing factor for the spatial perception—and that is not intended. It is intended to keep the freedom of the possibility to position the subwoofer where it best fits. [Furthermore, towards higher frequencies, the sound reproduction of a large membrane like that from a subwoofer gets more and more uncontrolled and chaotic]).

    [0086] According to embodiments, in addition to the low frequency driver, a subwoofer may comprise a high frequency driver (e.g. midrange or tweeter). For example, one embodiment could basically make use of a standard high quality (i.e. able to reproduce low frequency sounds) two- or multiway loudspeaker instead of a dedicated subwoofer.

    [0087] Another embodiment could focus on adding tweeters or high frequency reproduction to the subwoofers/subwoofer enclosures that aims at achieving a high frequency sound reproduction with little directivity/in such a way that the origin of the sound itself cannot easily be located (to again get rid of the directionality effect and have the freedom to freely position the subwoofer)—such, also higher frequency sounds could directly be played back by the loudspeakers (i.e. subwoofers) that are positioned on the floor.

    [0088] Of course, if people already have a standard stereo or multichannel reproduction system using (large) loudspeakers, that may be already floor-standing loudspeakers, those could be used for the purpose of lower array reproduction—such a system could then basically be enhanced by a soundbar for the reproduction of the horizontal and upper part according to further embodiments/alternatives. Expressed in other words this means that the subwoofer signal generated by the lower layer processing is used to drive the floor-standing loudspeakers in order to reproduce the lower level sound.

    [0089] According to embodiments, the sound processing for the lower layer signals could be combined with HRTF- or binaural processing to improve perception of the lower layer channels.

    [0090] According to further embodiments, the sound processing for the lower layer signals could be combined with/extended by sound processing which optimizes the sound quality, based on the (actual/current) position and/or orientation of the subwoofer(s) and/or the listener(s). This could be applied manually or automatically, offline or in realtime.

    [0091] The method could also be applied for subwoofer/bass arrays that use more than two subwoofers that are potentially spread out across the room. Furthermore, the method would also work with a system that uses a calibration system. Such, the sound processing for the lower layer signals could be combined with an enhanced room calibration system which would optimize the reproduced sound quality of the subwoofers—and therefore the lower layer channels—to the listening situation in a specific room where the reproduction system is used. Since the proposed invention makes use of multiple subwoofers, the information gathered by the calibration system could also be used to further optimize the modal behavior of the room acoustics by applying active compensation filters to the subwoofers.

    [0092] If an upmix is part of the sound processing 20, it could be—according to embodiments—extended to incorporate the additional lower layer channels such, that the created sound field gets vertically enhanced/extended, even if the original input signals wouldn't contain lower layer channels.

    [0093] The above described bass management could be either passive or active bass management.

    [0094] The bass management can be designed such, that all signals belonging to the left side/left hemisphere are managed/processed separately from the signals belonging to the right side/right hemisphere. (Similar, if two subwoofers would be positioned in the front and back, this separation would also apply according to front hemisphere and back hemisphere.)

    [0095] While most of the embodiments and figures in this report are based on channel-based input signals, all processing can—according to embodiments—be adopted to work also with object based input where the mapping to specific channels is not given, but the actual spatial position of an audio object may be indicated by metadata delivered together with the actual audio contents. Such objects can either be statically positioned at an indicated position, or change their spatial position dynamically over time. Furthermore, the above method can also be used for Ambisonics and Higher Order Ambisonics and Scene Based audio input formats.

    [0096] Note, since two or more subwoofer are available, the multichannel bass management could also apply a decorrelation to the potentially only mono bass-signals, to further enhance the perceived spaciousness of the reproduced sound image.

    [0097] According to a further embodiment, the concept can also be used to extend existing loudspeakers systems by the use of a soundbar. (I.e. if already high quality floor standing speakers are available, those could act as the proposed subwoofers of the above method).

    [0098] The proposed method can be used to supplement existing soundbar rendering solutions by including a lower layer. This means that the lower layer reproduction method is independent of the rendering strategy (e.g. acoustic or psychoacoustic as exemplified before) that is used for the reproduction of e.g. the horizontal sound or the elevated (above head) sound.

    [0099] Embodiments provide an audio reproduction system featuring at least one subwoofer, where the subwoofer is configured to play back also high frequency sounds for specific parts of the input signals. (those ‘specific parts’ would e.g. be the lower array signals, or if object audio would be panned to the respective positions).

    [0100] According to an embodiment, the audio reproduction system may be a soundbar type.

    [0101] According to a further embodiment the audio reproduction system features at least two subwoofers.

    [0102] According to a further embodiment the subwoofers are used (in addition to playing back the LFE and the bass managed low frequency signals) to reproduce the lower array content of immersive multi-channel audio input.

    [0103] According to a further embodiment, the subwoofers are used (in addition to playing back the LFE and the bass managed low frequency signals) to reproduce object audio when the audio objects are panned to lower array directions.

    [0104] According to a further embodiment, the additional signals played back by the subwoofer are a bandpass portion of specific input signals (‘additional signals’=in addition to playing back the LFE and the bass managed low frequency signals).

    [0105] According to a further embodiment complementary signals to the bandpass portion of the specific input signals are played back by standard playback means (i.e. e.g. the normal soundbar processing).

    [0106] FIG. 5 shows another implementation of the audio processor 10″. The soundbar 20 consists of an arrangement of multiple drivers that are driven by loudspeaker feed signals which are calculated in the soundbar processing stage 12″ (this stage is also often referred to as virtualization or rendering). The input signals to the soundbar processing stage 12″ are the channels MCA.sub.N that address the horizontal and upper layers of the loudspeaker setup the content has been produced for.

    [0107] The input channels MCA.sub.L for the lower layer sounds (in this specific example three channels, L1, L2, and L3) go through a first preprocessing stage (Pre_L1, Pre_L2, Pre_L3), which is marked by 14″. This preprocessing 14″ includes e.g. a gain adjustment to match the lower layer sound reproduction to the rest of the system, such this preprocessing stage may be specific to the actual reproduction system.

    [0108] The high frequency part of the lower layer sounds, which will not be reproduced by the subwoofers 22l, 22r, is filtered out by the adjustable crossover filters (X-Over) and those signal parts are fed to the soundbar processing. A second preprocessing stage (Pre2_L1, Pre2_L2, Pre2_L3, e.g. gain) can be used to adjust/align those signal parts to match specific characteristics of the other input signals of the soundbar processing.

    [0109] The low frequency components of the lower array sounds that are reproduced by the two subwoofers 22l, 22r are further equalized (EQ). This EQ is used to achieve a neutral timbre when playing back sounds on the subwoofer with frequencies that are usually not intended to be played back over (standard) subwoofers. (This EQ stage can be tuned by a listener in the product design stage, furthermore, it can be automatically adjusted by a measurement system to adapt to the specific situation in the present listening environment. Furthermore, a part of this EQing could already be stored in some filters that are implemented in the actual subwoofer hardware.)

    [0110] Since multiple lower layer sounds (three in this example) are played back over only two subwoofers, a panning/routing stage distributes the sounds such that (similar to usual stereo reproduction systems) a phantom image reproduction is achieved to basically simulate the channel for which no specific subwoofer is available.

    [0111] Subsequently, all processed signals (the ones from the soundbar processing as well as the ones from the lower array processing) go through a bass management system, which can include either active or passive stereo or mono bass management (as explained at another point in the application text).

    [0112] The subsequent driver processing includes parts like equalization filters and dynamic processing that are used to maximize the systems performance and are also used as safeguard for the actual hardware (e.g. the specific transducers) used in the hardware.

    [0113] Note, two external subwoofers 22l and 22r are used in the system. They may be ideally placed on the left and right side of the soundbar 20 on the floor.

    [0114] As the proposed rendering method reproduces frequencies over the subwoofers which are untypical for usual subwoofer membrane sizes, the frequency dependent characteristics (frequency response, directivity pattern) of the specific subwoofer at hand may be taken into account. Such, average filters to achieve a well-balanced high frequency reproduction in a large area can be generated. Alternatively, the frequency response can be adjusted by a measurement at the actual listening position.

    [0115] In that respect, the EQ stages indicated in the figure (for the channels L1, L2, and L3) are also used to adjust the individual channels to counter differences in timbre and level that would appear due to the phantom-image reproduction of (at least) one of those channels.

    [0116] One actual implementation (which is of course adjusted to the specific soundbar system) uses a crossover frequency of 3.5 kHz for X-Over. Such, frequencies below 3.5 kHz are reproduced by the subwoofers (only for the signals of the lower layer input).

    [0117] Although in above embodiments the usage of two subwoofer has been discussed to enable lower layer sound from two different room directions (Left-right or front-rear), the system/approach may be enhanced to more than the two (e.g. four) subwoofer for reproducing lower layer sound from three, four, etc. room directions.

    [0118] Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent a description of the corresponding method, where a block or device corresponds to a method step or a feature of a method step. Analogously, aspects described in the context of a method step also represent a description of a corresponding block or item or feature of a corresponding apparatus. Some or all of the method steps may be executed by (or using) a hardware apparatus, like for example, a microprocessor, a programmable computer or an electronic circuit. In some embodiments, some one or more of the most important method steps may be executed by such an apparatus.

    [0119] Depending on certain implementation requirements, embodiments of the invention can be implemented in hardware or in software. The implementation can be performed using a digital storage medium, for example a floppy disk, a DVD, a Blu-Ray, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, having electronically readable control signals stored thereon, which cooperate (or are capable of cooperating) with a programmable computer system such that the respective method is performed. Therefore, the digital storage medium may be computer readable.

    [0120] Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.

    [0121] Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing one of the methods when the computer program product runs on a computer. The program code may for example be stored on a machine readable carrier.

    [0122] Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.

    [0123] In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.

    [0124] A further embodiment of the inventive methods is, therefore, a data carrier (or a digital storage medium, or a computer-readable medium) comprising, recorded thereon, the computer program for performing one of the methods described herein. The data carrier, the digital storage medium or the recorded medium are typically tangible and/or non-transitionary.

    [0125] A further embodiment of the inventive method is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or the sequence of signals may for example be configured to be transferred via a data communication connection, for example via the Internet.

    [0126] A further embodiment comprises a processing means, for example a computer, or a programmable logic device, configured to or adapted to perform one of the methods described herein.

    [0127] A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.

    [0128] A further embodiment according to the invention comprises an apparatus or a system configured to transfer (for example, electronically or optically) a computer program for performing one of the methods described herein to a receiver. The receiver may, for example, be a computer, a mobile device, a memory device or the like. The apparatus or system may, for example, comprise a file server for transferring the computer program to the receiver.

    [0129] In some embodiments, a programmable logic device (for example a field programmable gate array) may be used to perform some or all of the functionalities of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor in order to perform one of the methods described herein. Generally, the methods may be performed by any hardware apparatus.

    [0130] While this invention has been described in terms of several embodiments, there are alterations, permutations, and equivalents which will be apparent to others skilled in the art and which fall within the scope of this invention. It should also be noted that there are many alternative ways of implementing the methods and compositions of the present invention. It is therefore intended that the following appended claims be interpreted as including all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.