Abstract
Method for live manipulation of signal flows via a controller, wherein the method comprises of feeding in a first signal flow and a further signal flow, each having X signal flow layers, wherein X is greater than 2. The method further comprises of separating the signal flow layers from each signal flow into a respective series of sub-signal flows, related to the signal flow, as according to a predetermined ratio, wherein each sub-signal flow has Y sub-signal flow layers, wherein Y is smaller than X. The method comprises of reading a desired ratio between the first signal flow and the further signal flow via a controller. The method comprises of merging corresponding sub-signal flows as according to the desired ratio in order to obtain a modified series of sub-signal flows. The method comprises of feeding out the modified series.
Claims
1. A method for live manipulation of signal flows via a controller, the method comprising: feeding in a first signal flow and a further signal flow, each having X signal flow layers, wherein X is greater than 2; separating the signal flow layers from each signal flow into a respective series of sub-signal flows, related to the signal flow, as according to a predetermined ratio, wherein each sub-signal flow has Y sub-signal flow layers, wherein Y is smaller than X; reading a desired ratio between the first signal flow and the further signal flow via a controller; merging corresponding sub-signal flows as according to the desired ratio in order to obtain a modified series of sub-signal flows; and feeding out the modified series.
2. The method according to claim 1, wherein the signal flows are audio flows and wherein the signal flow layers are audio channels provided to be transmitted to different loudspeakers in a space in order to obtain surround audio.
3. The method according to claim 2, wherein the signal flows are mastered audio flows.
4. The method according to claim 1, further comprising synchronizing the sub-signal flows in a processing unit before the step of merging.
5. The method according to claim 4, wherein a synchronization flow runs in the processing unit, and wherein the step of synchronizing is performed by synchronizing each sub-signal flow with the synchronization flow.
6. The method according to claim 1, wherein the controller has volume controls which are operatively coupled to respective sub-signal flows from the series, and wherein the step of feeding out further comprises feeding out at a volume related to a setting of the corresponding volume control.
7. The method according to claim 1, wherein a volume pattern is defined which extends over a predetermined period of time and is repetitively replicated, wherein the volume pattern for each sub-signal flow layer from the modified series is provided with a different starting point, wherein the controller further has a pattern controller which is operatively coupled to the sub-signal flows, and wherein the step of feeding out further comprises feeding out at a volume which is further related to a product of a setting of the pattern controller and the corresponding volume pattern.
8. A device comprising: a processing unit configured for live manipulation of signal flows and a controller configured to read a desired ratio between a first signal flow and at least one further signal flow, the controller being operatively connected to the processing unit; wherein the processing unit has a first infeed configured for feeding in the first signal flow and has at least one further infeed for feeding in the at least one further signal flow, wherein each signal flow has X signal flow layers, wherein X is greater than 2; wherein the processing unit further has a separator configured to separate the signal flow layers from each signal flow into a respective series of sub-signal flows, related to the signal flow, as according to a predetermined ratio, wherein each sub-signal flow has Y sub-signal flow layers, wherein Y is smaller than X; wherein the processing unit further has a mixer configured to merge corresponding sub-signal flows as according to the desired ratio in order to obtain a modified series of sub-signal flows; and wherein the processing unit further has an outfeed configured for feeding out the modified series.
Description
[0023] The invention will be further described with reference to an exemplary embodiment shown in the drawing.
[0024] In the drawing:
[0025] FIG. 1 shows a general flow of the method; and
[0026] FIGS. 2 and 3 show alternative embodiments of a flow of the method.
[0027] The same or similar elements are designated in the drawing with the same reference numerals.
[0028] In the context of the description mastering is defined as finalizing an audio mix into a uniform overall sound.
[0029] In the context of the description dimension is further defined in accordance with the number of layers of a signal flow. Each signal flow has a determined number of layers. For audio it is known to transmit different layers to different locations in a space. It will be apparent to the skilled person that mono sound has one dimension, also written as 1D, that stereo, which has two layers, has two dimensions 2D and that 5.1 surround audio has 6 dimensions 6D.
[0030] In the context of the description a controller is further defined as a device which transmits a signal on the basis of a physical input. It will be apparent to the skilled person that a controller can be any one of a computer mouse, touchpad, keyboard, Musical Instrument Digital Interface MIDI device, etc. It will be apparent to the skilled person here that the controller is not limited to the above described examples.
[0031] FIG. 1 shows a general flow of the method for live manipulation of signal flows 1a, 1b, . . . via a controller 15. Signal flows 1a, 1b, . . . are typically fed into a processing unit 9. The signal flows 1a, 1b, . . . in FIG. 1 are surround audio flows, more specifically a 5.1 surround form. Signal flows 1a, 1b, . . . each have 6 signal flow layers 2a, 2b, In the case of 5.1 surround audio these channels are typically used for left, right, center, rear left, rear right and LFE signals. It will be apparent to the skilled person that the method also provides for live manipulation of more than two signal flows 1a, 1b, 1c, 1d, etc.
[0032] FIG. 1 further shows that signal flows 1a, 1b, . . . are separated into sub-signal flows 3a.sub.1, 3a.sub.2, 3a.sub.3 and 3b.sub.1, 3b.sub.2, 3b.sub.3, as according to a predetermined ratio. In the context of separating signal flows into sub-signal flows it is also possible to refer to separating as according to a predetermined division. The sub-signal flows each have two sub-signal flow layers. In this embodiment signal flow 1a, 1b is separated as according to the 5.1 format into three sub-signal flows 3a.sub.1, 3a.sub.2, 3a.sub.3 and 3b.sub.1, 3b.sub.2, 3b.sub.3—left, right—LFE, center—rear left, rear right. Sub-signal flow left-right then represents 3a.sub.1; LFE-center represents 3a.sub.2 and rear left, rear right represents 3a.sub.3. Each sub-signal flow 3a.sub.1, 3a.sub.2, 3a.sub.3 and 3b.sub.1, 3b.sub.2, 3b.sub.3 has two sub-signal flow layers 4a.sub.1, 4a.sub.2, 4a.sub.3, 4a.sub.4, 4a.sub.5 and 4a.sub.6 and can further be processed as a stereo signal. Sub-signal flow 3a.sub.1 then has sub-signal flow layers 4a.sub.1, 4a.sub.2 as related layers. In this embodiment this would correspond with respectively the left and right sound signal. Sub-signal flow 3a.sub.2 has sub-signal flow layers 4a.sub.3, 4a.sub.4 as related layers and sub-signal flow 3a.sub.3 then has sub-signal flow layers 4a.sub.5, 4a.sub.6 as related layers. In the embodiment it has been chosen to separate into a series of sub-signal flows with two sub-signal flow layers because this embodiment assumes that hardware and/or software is able to process stereo audio files, in other words, to process two layers.
[0033] FIG. 1 further shows that, after separating of signal flows 1a, 1b, . . . into sub-signal flows 3a.sub.1, 3a.sub.2, 3a.sub.3 and 3b.sub.1, 3b.sub.2, 3b.sub.3, the sub-signal flows 3a.sub.1, 3a.sub.2, 3a.sub.3 (corresponding to signal flow 1a) are simultaneously triggered 18, as well as sub-signal flows 3b.sub.1, 3b.sub.2, 3b.sub.3 (corresponding to signal flow 1b) being simultaneously triggered 19. Each series of sub-signal flows will be processed further as a bundle, such that during processing the series of sub-signal flows remains coupled to each other in time.
[0034] FIG. 1 further shows that the different sub-signal flows 3a.sub.1, 3a.sub.2, 3a.sub.3 and 3b.sub.1, 3b.sub.2, 3b.sub.3 are merged 12 into a modified series of sub-signal flows 5.sub.1, 5.sub.2, 5.sub.3 as according to a desired ratio 11 by controller 15. 3a.sub.1 is merged with 3b.sub.1 into sub-signal flow 5.sub.1, 3a.sub.2 with 3b.sub.2 into 5.sub.2, etc. 3a.sub.3 is merged with 3b.sub.3 into sub-signal flow 5.sub.3. The modified sub-signal flows 5.sub.1, 5.sub.2, 5.sub.3 have related sub-signal flow layers 6.sub.1, 6.sub.2, 6.sub.3, 6.sub.4, 6.sub.5 and 6.sub.6.
[0035] The modified series of sub-signal flows 5.sub.1, 5.sub.2, 5.sub.3 are fed out by processing unit 9. After feeding out, the modified sub-signal flows can be played by loudspeakers.
[0036] In the illustrated embodiment of FIG. 1 the modified series of sub-signal flows 5.sub.1, 5.sub.2, 5.sub.3 are fed out. It will be apparent to the skilled person that the modified series of sub-signal flows 5.sub.1, 5.sub.2, 5.sub.3 can also be merged into a surround audio file 7 in processing unit 9. Surround audio file 7 then comprises the modified sub-signal flow layers 8.sub.1, 8.sub.2, 8.sub.3, 8.sub.4, 8.sub.5 and 8.sub.6.
[0037] FIG. 2 illustrates an alternative embodiment wherein the signal flows 1a, 1b, . . . have eight signal flow layers 2a, 2b, . . . which are fed into processing unit 9. The signal flows in FIG. 2 are separated into two sub-signal flows 3a.sub.1, 3a.sub.2. The alternative embodiment illustrates that the separating takes place as according to a determined ratio/division of the signal flow layers. The sub-signal flow 3a.sub.1 of FIG. 1 has 5 sub-signal flow layers 4a.sub.1-4a.sub.5. The sub-signal flow 3a.sub.2 has three sub-signal flow layers 4a.sub.6-4a.sub.8. In this embodiment it has been chosen to separate into a series of sub-signal flows with respectively five sub-signal flow layers and three sub-signal flow layers in order to demonstrate that the invention can also be applied in an alternative context. In this alternative context it is hypothetically assumed that hardware and/or software is able to process sub-signal flows with five flow layers. It will be apparent that this alternative context is a theoretical and purely hypothetical context of a more extensive hardware and/or software. This alternative embodiment serves only to illustrate the possibilities in future developments of hardware and/or software.
[0038] It will be apparent to the skilled person that in this alternative embodiment the series of sub-signal flows with the three signal flow layers can comprise two empty signal flows so that a total of five flow layers is obtained. The first and second sub-signal flows then each have five sub-signal flow layers and can then still be processed uniformly by the processing unit.
[0039] FIG. 2 further shows a synchronization flow 10 running in processing unit 9. Synchronizing of the sub-signal flows with a synchronization flow 10 has two aspects. A first aspect is to bring the flows to the same number of beats per minute, also referred to as BPM. The synchronization flow runs at a tempo determined by the user, which tempo determines the number of beats per minute BPM. In this embodiment it is assumed that this is 120 BPM. Each signal flow can be stretched or compressed so as to have the same beats per minute BPM. This principle is known to the skilled person and is therefore not further elucidated. Once the tempo of the synchronization flow is known, the processing unit will automatically bring sub-signal flows 3a.sub.1, 3a.sub.2, 3b.sub.1 and 3b.sub.2 to the predetermined tempo.
[0040] A second aspect relates to the aligning of the beats. This aspect is relevant once the sub-signal flows have been brought to the same tempo characteristic for the synchronization flow. More specifically, the sub-signal flows will be automatically aligned with the characteristic beat of the synchronization flow. After the aligning, sub-signal flows 3a.sub.1 and 3a.sub.2 will automatically begin to follow synchronization flow 10 at a point in time t.sub.1. At a point in time t.sub.2 the sub-signal flows 3b.sub.1 and 3b.sub.2 will then be synchronized with synchronization flow 10, before the step of merging 12.
[0041] The sub-signal flows 3a.sub.1, 3a.sub.2, 3b.sub.1 and 3b.sub.2 are brought to a predetermined tempo by the synchronizing. In other words, the sub-signal flows are brought to the same speed, also referred to as Beats per Minute (BPM). Owing to the synchronizing, more particularly the aligning, sub-signal flows 3a.sub.1, 3a.sub.2, 3b.sub.1 and 3b.sub.2 run concurrently in synchronized manner at point in time t.sub.2, whereby the DJ can control the transition in simple manner by means of the controller. Once sub-signal flow 3a.sub.1, 3a.sub.2 is synchronized with synchronization flow 10, each sub-signal flow can be triggered 18 into playing the audio signal using controller 15. After synchronization of sub-signal flows 3b.sub.1 and 3b.sub.2, each of these sub-signal flows can also be simultaneously triggered 19 using controller 15.
[0042] FIG. 2 further shows that the different synchronized sub-signal flows 3a.sub.1, 3a.sub.2 and 3b.sub.1, 3b.sub.2, 3 are merged 12 as according to a desired ratio 11 by processing unit 9, on the basis of input from controller 15, into a modified series of sub-signal flows 5.sub.1, 5.sub.2. The desired ratio 11 relates here to a desired volume ratio between the signal flows. 3a.sub.1 is merged with 3b.sub.1 into sub-signal flow 5.sub.1, 3a.sub.2 with 3b.sub.2 into 5.sub.2. The modified sub-signal flows 5.sub.1, 5.sub.2 have related sub-signal flow layers 6.sub.1, 6.sub.2, 6.sub.3, 6.sub.4. Each modified sub-signal flow comprises the sub-signal flows in the desired volume ratio.
[0043] FIG. 2 further shows that the sub-signal flows can be fed out directly from processing unit 9.
[0044] FIG. 3 shows a further alternative embodiment wherein signal flows 1a, 1b, . . . are fed into a processing unit 9. Signal flows 1a, 1b, . . . in FIG. 3 are 7.1 audio flows. Signal flows 1a, 1b, . . . each have 8 signal flow layers 2a, 2b, In 7.1 surround audio these channels are typically used for left, right, center, rear left, rear right and LFE and height-adjusted loudspeaker signals. Each sub-signal flow 3a.sub.1, 3a.sub.2, 3a.sub.3, 3a.sub.4 and 3b.sub.1, 3b.sub.2, 3b.sub.3, 3b.sub.4 has two sub-signal flow layers 4a.sub.1, 4a.sub.2, 4a.sub.3, 4a.sub.4, 4a.sub.5, 4a.sub.6, 4a.sub.7, 4a.sub.8. Sub-signal flow 3a.sub.1 then has sub-signal flow layers 4a.sub.1, 4a.sub.2 as related layers. In this embodiment this would correspond with respectively the left and right sound signal.
[0045] FIG. 3 further shows that a controller 15 reads 11 a desired ratio 13a, 13b. Ratio 13a is here the volume ratio between the first signal flow 1a and the further signal flow 1b, and ratio 13b is the reciprocal of 13a. After the desired ratio 13a, 13b has been read 11, the sub-signal flows can be merged 12 as according to the ratio 13a, 13b.
[0046] In an alternative embodiment FIG. 3 further shows that controller 15 has volume controls 16 which are operatively coupled to the respective sub-signal flows 5.sub.1, 5.sub.2, 5.sub.3, 5.sub.4. A DJ (disc jockey) or artist can control each individual output to the respective loudspeakers by means of the volume controls 16. A volume control can for instance be a rotary knob, slide or pressure-sensitive switch. The DJ can control the volume of the front left and right loudspeakers, or alternatively switch them off completely, by means of the volume control related to sub-signal flow 5.sub.1. It will be apparent that this can take place simultaneously or separately for each sub-signal flow. It will also be apparent to the skilled person that a DJ can control more than just the volume. A DJ can also control timbre related to each sub-signal flow by influencing the frequency bands. The frequency bands are typically separated into High (or Treble), Medium and Low (or Bass).
[0047] FIG. 3 further shows in an alternative embodiment that the controller can define a pattern 17 on each modified sub-signal flow layer. FIG. 2 shows particularly an embodiment wherein a volume pattern 17a.sub.1, 17a.sub.2, . . . is defined, which is repetitively replicated. In the alternative embodiment a sinusoidal volume pattern is illustrated. Volume pattern 17a.sub.1 is provided with a different starting point than volume pattern 17a.sub.2, 17a.sub.3, etc. It will be apparent that any pattern can be applied to the modified sub-signal flow layers. A pattern can for instance also be a timbre pattern. It is alternatively also possible for a pattern not to be repetitively replicated.
[0048] The signal flows can for instance have a Dolby Surround, Dolby Surround-Ex, Dolby Atmos, DTS, DTS-ES, Auro 3D, SDDS format. It is also possible to manipulate any other form of surround audio.
[0049] In the illustrated embodiment of FIG. 1 a 6-channel surround sound audio file is illustrated. It will be apparent to the skilled person, as illustrated in FIG. 3, that 7.1, 10.2, 11.1, 22.2 surround sound audio files, or variants thereof, can also be manipulated.
[0050] It will be apparent to the skilled person that the sub-signal flows can have any audio coding format. The sub-signal flows can for instance be converted into MP3, WAV, AAC, but are not limited thereto.
[0051] The skilled person will appreciate on the basis of the above description that the invention can be embodied in different ways and on the basis of different principles. The invention is not limited here to the above described embodiments. The above described embodiments and the figures are purely illustrative and serve only to increase understanding of the invention. The invention is not therefore limited to the embodiments described herein, but is defined in the claims.
