ARTIFACT REDUCTION ON TRANSITIONS BETWEEN AUDIO TRACKS
20240171926 ยท 2024-05-23
Inventors
Cpc classification
H04S2400/09
ELECTRICITY
International classification
Abstract
An audio artifact reduction technique operates on a pair of temporally-adjacent audio tracks. Samples at an end portion of a first track may be altered according to an inter-track sample discontinuity at a boundary between the two tracks. Samples at a beginning portion of a second track also may be altered according to the inter-track discontinuity. These altering operations may cause the sample values and the end of the first track and the beginning of the second track to be equal to each other at the boundary between the two tracks. In one aspect, the altering may generate adjustment curves that alter sample values of the tracks around the boundary between them. In another aspect, the altering may trim the tracks at zero crossings of track sample values nearest to the boundary between the tracks.
Claims
1. An audio artifact reduction method, comprising, at a pair of temporally-adjacent audio tracks: altering samples at an end portion of a first track according to an inter-track sample discontinuity at a boundary between the pair of temporally-adjacent audio tracks, and altering samples at a beginning portion of a second track according to the inter-track discontinuity, wherein the altering of the samples at the end portion and the beginning portion cause sample values and the end of the first track and the beginning of the second track to be equal at the boundary between the two tracks.
2. The method of claim 1, wherein the sample values at the end of the first track and the beginning of the second track both are zero.
3. The method of claim 1, wherein the altering comprises, for the first track: deriving an adjustment curve based on a sample value at a terminal end of the first track, and applying the adjustment curve to samples of the first track in the end portion.
4. The method of claim 3, wherein the adjustment curve has a value at the terminal end of the first track that is equal in magnitude but opposite in sign to the sample value at a terminal end of the first track.
5. The method of claim 3, further comprising, applying a limiting function to the adjustment curve prior to the applying step when application of an unlimited adjustment curve would cause adjusted sample value(s) of the first track to exceed a limit value for such samples.
6. The method of claim 1, wherein the altering comprises, for the second track: deriving an adjustment curve based on a sample value at a terminal start of the second track, and applying the adjustment curve to samples of the second track in the beginning portion.
7. The method of claim 6, wherein the adjustment curve has a value at the terminal start of the second track that is equal in magnitude but opposite in sign to the sample value at the terminal start of the second track.
8. The method of claim 6, further comprising, applying a limiting function to the adjustment curve prior to the applying step when application of an unlimited adjustment curve would cause adjusted sample value(s) of the second track to exceed a limit value for such samples.
9. The method of claim 1, wherein the altering steps alter a length of at least one of the first and second tracks.
10. The method of claim 1, wherein the altering comprises, for the first track, trimming from the first track the end portion that extends from a sample location corresponding to final zero crossing to an end of the first track.
11. The method of claim 1, wherein the altering comprises, for the second track, trimming from the second track the beginning portion that extends from a sample location corresponding to the beginning of the second track to a first zero crossing of the second track.
12. The method of claim 1, wherein the altering comprises, for the first track, replacing sample values in an end portion of the first track that extends from a sample location corresponding to final zero crossing to an end of the first track with zero values.
13. The method of claim 1, wherein the altering comprises, for the second track, replacing sample values in a starting position of the second track that extends from a sample location corresponding to the beginning of the second track to a first zero crossing of the second track with zero values.
14. The method of claim 1, wherein the first and second audio tracks are generated by a spatial audio processing algorithm.
15. An audio artifact reduction method, comprising: for a first track of a pair of temporally-adjacent audio tracks: deriving a first adjustment curve based on a sample value at a terminal end of the first track, and applying the first adjustment curve to samples of the first track in the end portion; and for a second track of the pair of temporally-adjacent audio tracks: deriving a second adjustment curve based on a sample value at a terminal start of the second track, and applying the second adjustment curve to samples of the second track in the beginning portion.
16. The method of claim 13, wherein, following the applying steps, an altered sample value at the terminal end of the first track and an altered sample value at terminal start of the second track have the same magnitude.
17. The method of claim 13, wherein the first adjustment curve has a value at the terminal end of the first track that is equal in magnitude but opposite in sign to the sample value at the terminal end of the first track.
18. The method of claim 13, wherein the second adjustment curve has a value at the terminal start of the second track that is equal in magnitude but opposite in sign to the sample value at the terminal start of the second track.
19. The method of claim 13, further comprising, applying a limiting function to adjusted sample value(s) when application of an unlimited adjustment curve would cause adjusted sample value(s) of the second track to exceed a limit value for such samples.
20. A system, comprising: a processor, and a memory system storing program instructions that, when executed by the processor, cause the processor to perform an artifact reduction method for a pair of temporally-adjacent audio tracks, comprising: first altering samples at an end portion of a first track according to an inter-track sample discontinuity at a boundary between the two tracks, and second altering samples at a beginning portion of a second track according to the inter-track discontinuity, wherein the altering steps cause the sample values and the end of the first track and the beginning of the second track to be equal at the boundary between the two tracks.
21. The system of claim 18, further comprising a rendering device having an input for audio rendering signals generated from the artifact reduction method.
22. The system of claim 18, wherein the method further stores program instructions of a spatial audio rendering method that generate the temporally-adjacent audio tracks.
23. The system of claim 18, wherein: the first altering comprises: deriving a first adjustment curve based on a sample value at a terminal end of the first track, and applying the first adjustment curve to samples of the first track in the end portion; and the second altering comprises: deriving a second adjustment curve based on a sample value at a terminal start of the second track, and applying the second adjustment curve to samples of the second track in the beginning portion.
24. The system of claim 18, wherein: the first altering comprises trimming from the first track the end portion that extends from a sample location corresponding to final zero crossing to an end of the first track, and the second altering comprises trimming from the second track the beginning portion that extends from a sample location corresponding to the beginning of the second track to a first zero crossing of the second track.
25. Computer readable memory storing program instructions that, when executed by a processing device, cause the processing device to perform an artifact reduction method for a pair of temporally-adjacent audio tracks, comprising: first altering samples at an end portion of a first track according to an inter-track sample discontinuity at a boundary between the two tracks, and second altering samples at a beginning portion of a second track according to the inter-track discontinuity, wherein the altering steps cause the sample values and the end of the first track and the beginning of the second track to be equal at the boundary between the two tracks.
26. The medium of claim 23, wherein: the first altering comprises: deriving a first adjustment curve based on a sample value at a terminal end of the first track, and applying the first adjustment curve to samples of the first track in the end portion; and the second altering comprises: deriving a second adjustment curve based on a sample value at a terminal start of the second track, and applying the second adjustment curve to samples of the second track in the beginning portion.
27. The medium of claim 23, wherein: the first altering comprises trimming from the first track the end portion that extends from a sample location corresponding to final zero crossing to an end of the first track, and the second altering comprises trimming from the second track the beginning portion that extends from a sample location corresponding to the beginning of the second track to a first zero crossing of the second track.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0003]
[0004]
[0005]
[0006]
[0007]
[0008]
[0009]
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
DETAILED DESCRIPTION
[0022] Aspects of the present disclosure provide an audio artifact reduction method that operates on a pair of temporally-adjacent audio tracks. According to the method, samples at an end portion of a first track may be altered according to an inter-track sample discontinuity at a boundary between the two tracks. Samples at a beginning portion of a second track also may be altered according to the inter-track discontinuity. These altering operations may cause the sample values and the end of the first track and the beginning of the second track to be equal to each other at the boundary between the two tracks or sufficiently close to each other to mitigate artifacts.
[0023] The inventor determined that audio artifacts often arise due to application of various audio processing algorithms that are sensitive to the input discontinuities at the track boundaries. These algorithms can generate signal discontinuities at the start and the end of the track due to pre-ringing and tails that are generated by the filters within these audio processing algorithms. As discussed below, the input and output signals may be manipulated at the track boundaries to reduce the artifacts or even achieve seamless audio transitions between tracks.
[0024]
[0025]
[0026]
[0027]
[0028] According to the method 100, samples of the two tracks T1 and T2 may be adjusted by their respective ramp signals R.sub.end and R.sub.start.
[0029] The method 100 of
[0030] Another example is shown in
[0031] It is expected that application of the method 100 will mitigate artifacts that occur when sample level discontinuities occur between two temporally-adjacent tracks and they are processed by spatial audio rendering techniques.
[0032] In practice, application of the ramp signals Ramp.sub.end, Ramp.sub.start impose their own distortions to rendered audio. The durations T.sub.end and T.sub.start and the profiles of the ramps Ramp.sub.end, Ramp.sub.start may be tailored to suit individual application needs. For example, rather than apply linear ramps as shown in
[0033] The principles of the present disclosure find application where content transitions create sample discontinuities at the beginnings or ends of content tracks. The example of
[0034] Additionally, the principles of
[0035] Similarly, if track T2 were the very last track to be rendered in an audio rendering session, a discontinuity may be created at the end of the track T2 where the session transitions from track T2 to silence (again, a virtual zero-valued track). Application of the method 100 would cause a ramp (also not shown in
[0036] The principles of the present disclosure find application with ramp signals having a variety of shapes. In the example of
[0037] It may occur that application of a ramp signal causes track samples to exceed predetermined limit values (e.g., minimum and/or maximum values) that are valid for the samples. Aspects of the present disclosure may apply limiting functions to samples as they are added to ramp values to bring them within applicable limit values.
[0038]
[0039]
[0040]
[0041]
[0042] In
[0043]
[0044]
[0045] The method 1700 of
[0046]
[0047] The principles of the present disclosure may be applied several times as desired in audio distribution chains to combat artifacts imposed by audio processing.
[0048] In such applications, the artifact remediation techniques described hereinabove may be applied at one or more processing stages within the audio distribution chain 1900. It is proposed to apply artifact remediation at a stage 1940 immediately prior to rendering processing 1950. In this manner, artifacts that may arise due to track discontinuities may be remedied. It also may occur that the artifact remediation techniques described hereinabove may be applied earlier in the distribution chain, such as an intermediate stage 1920, following stage(s) that may generate audio with inter-track discontinuities. For example,
[0049] In such applications, different artifact remediation stages 1920, 1940 may apply the same or different instances of the remediation techniques described hereinabove. For example, in one aspect, both stages 1920, 1940 may apply the method of
[0050]
[0051] The foregoing discussion has presented aspects of the present disclosure as performed by artifact remediation stages 1920, 1940. In application, these remediation stages may be embodied by processing devices. The processing devices may include consumer electronic devices such as media players, entertainment centers, set top boxes, smart speakers, personal computers, notebook computers, tablet computers, mobile phones, and/or gaming consoles. These processing devices also may include server computers and media production equipment. In such applications, the processing devices may include a processor and a memory. The memory may store instructions that, when executed by the processor, perform the methods and techniques described hereinabove. The memory, of course, also may store the audio content that are to be processed by the artifact remediation techniques described hereinabove. The memory may include semiconductor-, magnetic-, and/or optical-based storage media for storage of program instructions and/or audio content.
[0052] The artifact remediation stages 1920, 1940 may include communication hardware for exchange of audio content with other processing devices. The communication hardware, for example, may include a wired network interface (e.g., an Ethernet interface) to effectuate communication over a wired communication channel. As another example, the communication hardware may comprise a wireless interface, such as a radio transceiver, to effectuate communication over a wireless communication channel. Such a wireless communication channel may include a cellular network or a Wi-Fi network. Audio content exchange may occur via the Internet.
[0053] The artifact remediation stages 1920, 1940 described herein may be implemented in software, such as one or more of applications of a processing device or as part of the processing device's operating system. Additionally or alternatively, the systems, methods, and techniques described herein may be implemented in dedicated hardware components such as application specific integrated circuits, field programmable gate arrays and/or digital signal processors. Further, these components may be provided as hybrid systems that distribute functionality across dedicated hardware components and programmed general purpose processors, as desired.
[0054] Several aspects of the disclosure are specifically illustrated and/or described herein. However, it will be appreciated that modifications and variations of the disclosure are covered by the above teachings and within the purview of the appended claims without departing from the spirit and intended scope of the disclosure.