Apparatus for generating audio signal to compensate for missing components in the audio signal
11425500 · 2022-08-23
Assignee
Inventors
Cpc classification
G10H2210/321
PHYSICS
G10H2210/311
PHYSICS
H04R2430/20
ELECTRICITY
H04R2430/03
ELECTRICITY
International classification
Abstract
Apparatus for processing an audio signal including an audio processing device configured to process, evaluate and modify an audio signal.
Claims
1. Apparatus for processing an audio signal comprising a number of samples to generate missing harmonics of low-frequency components in the audio signal, the apparatus comprising at least one audio processing device configured to: process the audio signal in a time-dependent representation of the audio signal; determine an interval between a first zero-crossing and a further zero-crossing of the audio signal; determine a first set of sample points in the interval, the first set of sample points comprising a number of sample points at first positions in the interval; determine a second set of sample points in the interval, the second set of sample points comprising a number of sample points at second positions in the interval; modify the audio signal in the interval, on basis of an audio signal modification rule, by changing positions of the sample points of the first set of sample points in the interval such that the position of each sample point of the first set of sample points is changed from its respective first position in the first set of sample points to its a second position in the second set of sample points; apply the modified audio signal interval to the respective interval of the original audio signal so as to generate a modified audio signal; wherein the at least one audio processing device is configured to modify the audio signal on the basis of the audio signal modification rule; wherein the audio signal modification rule is or comprises a tilting function, configured to tilt a zero-crossing tangent at the first zero-crossing or at the further zero-crossing of the audio signal in clockwise or counter-clockwise direction.
2. Apparatus according to claim 1, wherein the audio signal modification rule specifies a defined change of the positions of the sample points of the first set of sample points in the interval such that each sample point of the first set of sample points is changed from the respective first position in the first set of sample points to the respective second position in the second set of sample points such that the sample points of the second set of sample points are equally spaced.
3. Apparatus according to claim 2, wherein the audio signal modification rule is or comprises a mapping function, particularly a monotonic mapping function, configured to map input sample points of the first set of sample points having the respective first position to output sample points of the second set of sample points having the respective second position.
4. Apparatus according to claim 1, wherein the audio signal processed by the at least one audio processing device has a specific original waveform, whereby the at least one audio processing device is configured to modify the specific original waveform of the audio signal to at least one target waveform of the audio signal.
5. Apparatus according to claim 4, wherein the at least one audio processing device is configured to modify the specific original waveform of the audio signal on the basis of the audio signal modification rule specifying a defined change of the waveform of the audio signal from its original waveform to at least one target waveform of the audio signal.
6. Apparatus according to claim 4, wherein the target waveform is a symmetric waveform, particularly a rectangular-waveform, a triangle-waveform or a needle-waveform, or an asymmetric waveform, particularly a sawtooth-waveform, preferably a straight or dented falling or rising sawtooth-waveform.
7. Apparatus according to claim 1, wherein the at least one audio processing device is configured to apply a skipping rule or skipping factor according to which at least one zero-crossing between the first zero-crossing and the further zero-crossing is not considered for determining the interval between the first zero-crossing and the further zero-crossing of the audio signal.
8. Apparatus according to claim 1, further comprising at least one first filter device arranged to apply at least one filtering rule on the audio signal before the audio signal is processed by the at least one audio processing device, and/or at least one second filter device arranged to apply at least one filtering rule on the audio signal after the audio signal was processed by the at least one audio processing device.
9. Apparatus according to claim 8, wherein at least one of the at least one first filter device and the at least one second filter device comprises a lowpass filter device.
10. Apparatus according to claim 1, further comprising one or more additional audio processing devices arranged in a parallel arrangement relative to the at least one audio processing device.
11. Apparatus according to claim 10, wherein the one or more additional audio processing devices have different audio signal modification properties than the at least one audio signal processing device and are configured to modify the audio signal on the basis of second audio signal modification rule, by changing positions of the sample points of the first set of sample points in the interval such that each sample point of the first set of sample points is changed from its respective first position in the first set of sample points to a third position in the second set of sample points in accordance with the second audio signal modification rule.
12. Apparatus according to claim 11, wherein the first modification rule of the at least one audio processing device specifies a defined change of the waveform of the audio signal from its original waveform to at least one first target waveform of the audio signal, and the second modification rule of the one or more additional audio processing devices specifies a defined change of the waveform of the audio signal from its original waveform to a second target waveform of the audio signal.
13. Apparatus according to claim 12, wherein the first target waveform of the audio signal is opposite in shape and/or orientation to the at least one further target waveform of the audio signal.
14. Apparatus according to claim 1, wherein the apparatus further comprises a first skipping rule or skipping factor application audio processing device which is configured to apply a first skipping rule or skipping factor according to which the at least one zero-crossing between the first zero-crossing and the further zero-crossing is not considered for determining the interval between the first zero-crossing and the further zero-crossing of the audio signal, and one or more additional skipping rule or skipping factor application audio processing devices which are configured to apply at least one further skipping rule or skipping factor according to which the at least one zero-crossing between the first zero-crossing and the further zero-crossing is not considered for determining the interval between the first zero-crossing and the further zero-crossing of the audio signal.
15. Apparatus according to claim 1, wherein the at least one audio processing device is configured to determine the number of sample points between the first zero-crossing and the further zero-crossing such that it is identical to the number of sample points in the respective interval in the original audio signal.
16. Method for processing an audio signal comprising a number of samples to generate missing low-frequency components in the audio signal, the method comprising: processing the audio signal in a time-dependent representation of the audio signal; determining an interval between a first zero-crossing and a further zero-crossing of the audio signal; determining a first set of sample points in the interval, the first set of sample points comprising a number of sample points at first positions in the interval; determining a second set of sample points in the interval, the second set of sample points comprising a number of sample points at second positions in the interval; modifying the audio signal in the interval, on basis of an audio signal modification rule, by changing positions of the sample points of the first set of sample points in the interval such that the position of each sample point of the first set of sample points is changed from a first position in the first set of sample points to a second position in the second set of sample points; applying the modified audio signal interval to the respective interval of the original audio signal so as to generate a modified audio signal; wherein modifying the audio signal is carried out on the basis of the audio signal modification rule; wherein the audio signal modification rule is or comprises a tilting function, configured to tilt a zero-crossing tangent at the first zero-crossing or at the further zero-crossing of the audio signal in clockwise or counter-clockwise direction.
Description
(1) Exemplary embodiments of the invention are described with reference to the Fig., whereby:
(2)
(3)
(4)
(5)
(6)
(7)
(8) The apparatus 1 comprises an audio input device 2, i.e. a device through which a digital input audio signal can be input to the apparatus 1, and an audio outputting device 3, i.e. a device through which a modified audio signal can be output in an acoustic environment. The audio input device 2 may comprise one or more audio input elements, e.g. digital audio input interfaces. The audio output device 3 may comprise one or more audio output elements, such as loudspeakers.
(9) The apparatus 1 may generally, be applied in any audio application where, e.g. due to constructive and/or physical limitations of audio output elements, e.g. loudspeakers, a poor low frequency response is given. In other words, the apparatus 1 may generally, be applied in any audio application in which, due to constructive and/or physical limitations of audio output elements, e.g. loudspeakers, a virtual bass enhancement is of use for compensating missing harmonics of low-frequency components in an audio signal.
(10) An exemplary audio application of the apparatus 1 is a mobile device application or a portable device application. As such, the apparatus 1 may be installed in a mobile device or in a portable device, e.g. a mobile computer, a smartphone, a tablet, a mobile loudspeaker, etc.
(11)
(12) In the exemplary embodiment of
(13) The audio processing device 5 is configured to process an input audio signal comprising a number of samples in a time-dependent representation of the input audio signal, particularly in a half-wave representation of the input audio signal (see
(14) The audio processing device 5 is further configured to determine an interval I between a first zero-crossing and a further zero-crossing of the input audio signal in the time-dependent representation of the input audio signal. The audio processing device 5 is thus, configured to analyze the time-dependent representation of the input audio signal for zero-crossings, i.e. locations at which the graph function interconnecting the sample points P of the input audio signal in the time-dependent representation crosses the time axis and, based on the determination of respective zero-crossings, determine an interval between a first zero-crossing, i.e. a first location at which the graph function interconnecting the sample points P of the input audio signal crosses the time-axis for a first time, and a further zero-crossing (or second zero-crossing), i.e. a further location at which the graph function interconnecting the sample points P of the input audio signal crosses the time-axis for a further time (or second time). During operation of the apparatus 1, the audio processing device 5 thus, analyzes the time-dependent representation of the input audio signal for respective zero-crossings and, based on the determination of respective zero-crossings, determines an interval I between a respective first zero-crossing and a respective further zero-crossing (or second zero-crossing).
(15) Respective first zero-crossings and further zero-crossing can be direct consecutive zero-crossings. However, it is also possible that respective first zero-crossings and further zero-crossing are not direct consecutive zero-crossings, but indirect consecutive zero-crossings such that at least one zero-crossing lies in between a respective first zero-crossing and a respective further zero-crossing. As such, a respective interval I may extend between two directly consecutive zero-crossings of the time-dependent representation of an input audio signal or a respective interval I may extend between two indirectly consecutive zero-crossings of the time-dependent representation of an input audio signal.
(16) The audio processing device 5 is further configured to determine a first set S1 of sample points P in the determined interval I, the first set of sample points P comprising a number of sample points P at first positions in the interval I (see
(17) The audio processing device 5 is further configured to determine a second set S2 of sample points in the determined interval I, the second set S2 of sample points P comprising a number of sample points P at second positions in the interval I (see
(18) As is apparent from
(19) The audio processing device 5 is further configured to modify the input audio signal in the interval I, on basis of an audio signal modification rule, by changing positions of the sample points P of the first set S1 of sample points P in the interval I such that each sample point of the first set S1 of sample points P is changed from its respective first position in the first set S1 of sample points P as indicated in
(20) The audio processing device 5 is further configured to apply the modified audio signal interval I to the respective interval of the original input audio signal so as to generate a modified audio signal. The application of the modified audio signal to the respective interval of the original input audio signal may also be carried out through the mixer device 9. During operation of the apparatus 1, the audio processing device 5 thus, applies the modified audio signal interval to the respective interval of the original input audio signal so as to generate a modified audio signal. The modified audio signal is acoustically perceivable or perceived as if the original input audio signal would comprise the generated harmonics of low-frequency components. The modified audio signal is typically, invariant to the level of the input audio signal such that there is no need to apply automatic gain control stages.
(21) The modified audio signal may be output in an acoustic environment, e.g. a vehicle cabin, via the audio output device 3.
(22) As is apparent from the above description of the operation of the audio processing device 5, the audio processing device 5 is thus, configured to re-sample an input audio signal having a number samples, particularly on a non-uniformly spaced basis, and, particularly on a uniformly spaced basis, spread the samples out again by changing of the positions of the sample points P of the first set S1 of sample points P such that each sample point P of the first set S1 of sample points P is changed from its respective first position in the first set S1 of sample points P to its respective second position in the second set S2 of sample points P.
(23) As is apparent from the exemplary embodiments of
(24) The audio processing device 5 may be configured to determine the number of sample points P between the first zero-crossing and the at least one further zero-crossing such that is identical to the number of sample points P in the respective interval I in the original input audio signal. Determining the number of sample points P between the first zero-crossing and the at least one further zero-crossing such that is identical to the number of sample points P in the respective interval I in the original input audio signal typically, positively affects the generation of harmonics of low-frequency components.
(25) The audio processing device 5 may be configured to modify the audio signal on basis of an audio signal modification rule specifying a definable or defined change of positions of the sample points P of the first set S1 of sample points in the interval I such that each sample point P of the first set of sample points S1 is changed from its respective first position in the first set S1 of sample points P (see
(26) As is further apparent from
(27) The audio signal modification rule may be or may comprise a mapping function, particularly a monotonic mapping function, configured to map input sample points P of the first set S1 of sample points P1 having a respective first position to output sample points P of the second set S2 of sample points P having a respective second position. As is apparent from
(28) Three examples of a respective mapping function f(x) are given below with a resulting waveform shape of the modified audio signal in parentheses. Example 1: f(x)=(e.sup.x*D−1)/(e.sup.D−1) (rising dented sawtooth waveform) Example 2: f(x)=(e.sup.D−e.sup.xr*D)/(e.sup.D−1) (falling dented sawtooth waveform) Example 3: f(x)=log(1+(x*D))/log(1+D) (falling straight sawtooth waveform)
(29) Thereby, x can be a function of the sample points P of the second set S2 of sample points P, whereby x(P)=P/(N−1), where N is the number of sample points P in the second set S2 of sample points P where P=0 for the first sample point in the respective set and P=N−1 for the last sample point P in the respective set. As such, x(P) lies in a range of [0, 1].
(30) The above exemplary mapping functions f(x) are rising monotonously within in the range of [0, 1], include a pre-definable or pre-defined distortion parameter D, and may operate on a reversed input vector x.sub.r, where x.sub.r(P)=x(N−1)−x(P).
(31) Additionally or alternatively, the audio signal modification rule may be or may comprise a tilting function, configured to tilt a zero-crossing tangent of the audio signal in clockwise or counter-clockwise direction (see
(32) As is apparent e.g. from
(33) A respective target waveform of the input audio signal may be a symmetric waveform (see
(34) The audio processing device 5 may be configured to apply a skipping rule or a skipping factor according to which at least one zero-crossing between a first zero-crossing and a further zero-crossing is not considered for determining the interval I between the first zero-crossing and the further zero-crossing of the audio signal. The application of a respective skipping rule or a respective skipping factor may allow for generating modified audio signal with very low frequencies. As a general rule, the higher the skipping a factor the lower the frequencies of the modified audio signal.
(35) In the exemplary embodiments of
(36)
(37) The exemplary embodiments of
(38) As is apparent from the embodiments of
(39)
(40)
(41) As such, the first audio signal modification rule of a respective first audio processing device may specify a defined change of the waveform of the audio signal from its original waveform to at least one first target waveform of the audio signal, and the at least one further audio signal modification rule of a respective at least one further audio processing device may specify a defined change of the waveform of the audio signal from its original waveform to at least one further target waveform of the audio signal. Thereby, the first target waveform of the audio signal as specified by the at least one first audio signal modification rule may be opposite to the at least one further target waveform of the audio signal as specified by the at least one further audio signal modification rule.
(42) Further, a first audio processing device 5.1 may also be configured to apply a first skipping rule or a first skipping factor according to which at least one zero-crossing between a first zero-crossing and a further zero-crossing is not considered for determining the interval I between the first zero-crossing and the further zero-crossing of the audio signal, and a further audio processing device 5.2 may be configured to apply at least one further skipping rule or at least one further skipping factor according to which at least one zero-crossing between a first zero-crossing and a further zero-crossing is not considered for determining the interval I between the first zero-crossing and the further zero-crossing of the audio signal. Thereby, the first skipping rule or first skipping factor as applicable by the first audio processing 5.1 device may be equal or different, i.e. higher or lower, to the further skipping rule or a further skipping factor as applicable by further audio processing device 5.2. In the exemplary embodiment of
(43)
(44)
(45)
(46)
(47) In the exemplary embodiment of
(48)
(49) Each apparatus 1 according to the embodiments of the Fig. generally allows for implementing a method for processing an audio signal comprising the following steps:
(50) processing an audio signal comprising a number of non-uniformly spaced sampling points P in a time-dependent representation of the audio signal, particularly in a half-wave representation of the audio signal;
(51) determining an interval I between a first zero-crossing and a further zero-crossing of the audio signal;
(52) determining a first set S1 of sample points P in the interval, the first set S1 of sample points P comprising a number of sample points P at first positions in the interval I;
(53) determining a second set S2 of sample points P in the interval, the second set S2 of sample points P comprising a number of sample points P at second positions in the interval I;
(54) modifying the audio signal in the interval I, on basis of an audio signal modification rule, by changing positions of the sample points P of the first set S1 of sample points P in the interval I such that each sample point P of the first set S1 of sample points P is changed from its respective first position in the first set S1 of sample points P to its respective second position in the second set S2 of sample points P;
(55) applying the modified audio signal interval to the respective interval of the original audio signal so as to generate a modified audio signal.
(56) Each apparatus 1 according to the embodiments of the Fig. generally allows for implementing a method for outputting an audio signal, particularly in a vehicle cabin, comprising the following steps:
(57) processing an audio signal comprising a number of non-uniformly spaced sampling points in a time-dependent representation of the audio signal, particularly in a half-wave representation of the audio signal;
(58) determining an interval I between a first zero-crossing and a further zero-crossing of the audio signal;
(59) determining a first set S1 of sample points P in the interval I, the first set S1 of sample points P comprising a number of sample points P at first positions in the interval I;
(60) determining a second set S2 of sample points P in the interval I, the second set S2 of sample points P comprising a number of sample points P at second positions in the interval I;
(61) modifying the audio signal in the interval I, on basis of an audio signal modification rule, by changing positions of the sample points P of the first set of sample points P in the interval I such that each sample point P of the first set S1 of sample points P is changed from its respective first position in the first set S1 of sample points P to its respective second position in S2 the second set of sample points P;
(62) applying the modified audio signal interval to the respective interval I of the original audio signal so as to generate a modified audio signal;
(63) outputting the modified audio signal, particularly in a vehicle cabin.
(64) One or more specific features of a first exemplary embodiment can be combined with one or more specific features of at least one further exemplary embodiment.