AN EFFECTS DEVICE FOR A MUSICAL INSTRUMENT AND A METHOD FOR PRODUCING THE EFFECTS

Abstract

An effects device for a musical instrument, comprising: an input (18) for receiving a signal from a musical instrument; a control input (7) for receiving a control signal; an output (8, 9) for connecting the device to a sound reproduction device; a memory (30) configured to record the input signal; and a processor (29) configured, upon receiving a control signal, to select a section of the recorded input signal from the memory (30) and to loop it, wherein the processor (29) is configured to overlap a start and end regions of the selected section when looping. A method is also provided for producing an effect for a musical instrument, comprising the steps: a) recording an input signal from a musical instrument into memory (30), b) selecting a section of the recorded input signal and looping it, wherein a start and end regions of the selected segment are overlapping when looping.

Claims

1. An effects device for a musical instrument, comprising: an input for receiving a signal from a musical instrument; a control input for receiving a control signal; an output for connecting the device to a sound reproduction device; a memory configured to record the input signal; and a processor configured, upon receiving a control signal, to select a section of the recorded input signal from the memory and to loop it, wherein the processor is configured to overlap a start and end regions of the selected section when looping.

2. The device according to claim 1, wherein the processor is further configured to choose the overlapping start and end regions based on the regions similarity.

3. The device according to claim 2, wherein the regions similarity is determined by calculating correlation between the regions.

4. The device according to claim 1, wherein the processor is configured to cross-fade the overlapping start and end regions of the selected section when looping.

5. The device according to claim 1, wherein the processor is further configured to choose from the memory the section containing the longest possible portion of the recorded input signal suitable for looping.

6. The device according to claim 5, wherein the processor is configured to determine and select the longest signal portion where variance of signal is the steadiest.

7. The device according to claim 1, wherein the processor is configured to filter the selected section of the recorded input signal.

8. The device according to claim 7, wherein the filtering of the selected section is done by applying an adaptive parametric equalizer which normalizes the harmonic content between loop end-points so that the produced sound is even.

9. The device according to claim 1, wherein the processor is configured to dynamically compress the selected section so that the whole section sounds even.

10. The device according to claim 1, wherein the device has an additional control input that allows modifying the decay length of the looped signal.

11. The device according to claim 1 wherein the processor is configured to filter the looped signal so that higher harmonics decay faster than lower harmonics while the most significant harmonic is gradually enhanced to resemble a particular guitar's signal.

12. A method for producing an effect for a musical instrument, comprising the steps: a) recording an input signal from a musical instrument into memory; and b) selecting a section of the recorded input signal and looping it, wherein a start and end regions of the selected segment are overlapping when looping.

13. The method according to claim 12, wherein the selected section contains the longest possible portion of the input signal showing the steadiest signal variance.

14. The method according to claim 12 wherein the overlapping start and end regions are selected based on the regions similarity.

15. The method according to claim 12, wherein the overlapping start and end regions of the selected section are cross-faded.

16. The method according to claim 12, wherein the selected section is filtering by applying an adaptive parametric equalizer that normalizes the harmonic content of the signal thus ensuring an even sound for the whole section.

17. The method according to claim 12, wherein the selected section is dynamically compressed to ensure that the total section sounds even.

18. The method according to claim 12, further comprising the step of modifying the length of decay of the looped playback.

19. The method according to claim 12, further comprising the step of filtering the looped playback so that higher harmonics decays faster than lower harmonics thus the most significant harmonic is gradually enhanced to resample a typical guitar signal.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0038] FIG. 1 is an illustration of the device's outer body and external elements.

[0039] FIG. 2 shows a cross-section of the device.

[0040] FIG. 3 shows the device's bottom side with internal potentiometers.

[0041] FIG. 4 illustrates a signal path and main electronic blocks.

[0042] FIG. 5 illustrates the relationship between the DRY and WET signals and outputs 1 and 2, depending on the state of the SPLIT switch.

[0043] FIG. 6 shows the device's main block diagram.

[0044] FIG. 7 is a diagram of processing block F2.

[0045] FIG. 8 shows an example of audio data content stored in the memory device (Circular audio buffer), upon receiving the main control signal.

[0046] FIG. 9 is a simplified representation of audio signal (variance, spectrum centroid, envelope, etc.) before (top) and after (bottom) smoothening.

[0047] FIG. 10 shows region Xindicating the beginning of the most recent musical event.

[0048] FIG. 11 shows the most recent musical event isolated.

[0049] FIG. 12 shows selecting a sample from a low-dynamic musical event (full region EB).

[0050] FIG. 13 shows selecting a sample from a high-dynamic musical event (region KL is chosen, based on e).

[0051] FIG. 14 illustrates how short section of audio (sample), suitable for looping is determined.

[0052] FIG. 15 illustrates continuous circular playback of sample without any adjustments.

[0053] FIG. 16 is a block diagram of F2.4adaptive parametric EQ.

[0054] FIG. 17 shows results of FFT analysis at the sample's start and end regions; threshold of the peak-detection algorithm.

[0055] FIG. 18 illustrates interpolating the values of spectrum peaks between the sample's start and end regions.

[0056] FIG. 19 illustrates three filter transfer functions designed to compensate the change in harmonic content within the sample.

[0057] FIG. 20 shows results of FFT analysis at the sample's start and end regions after adaptive parametric EQ.

[0058] FIG. 21 shows sample before and after compression.

[0059] FIG. 22 shows misconnected points when looping.

[0060] FIG. 23 illustrates cross-fading.

[0061] FIG. 24 shows two regions (A & B), at the sample's start and end points.

[0062] FIG. 25 illustrates region A positioned on multiple points within region B; corresponding SDF values plotted.

[0063] FIG. 26 illustrates Fade-in and Fade-out regions of the sample aligned

[0064] FIG. 27 illustrates the dynamic cross-fading algorithmregions FI and FO divided into subsections, and compared target amplitude.

[0065] FIG. 28 is a sample shown as audio waveform, adjusted for circular playback.

[0066] FIG. 29 shows circular playback demonstrated with resulting outputcontinuous loop.

[0067] FIG. 30 is a F4Post-FX Block diagram.

[0068] FIG. 31 illustrates a transfer function of low-pass filter over time.

[0069] FIG. 32 shows a low-pass filter's cutoff frequency (f_c) over time.

[0070] FIG. 33 shows a band-pass filter's cutoff frequency (f_c) over time.

[0071] FIG. 34 shows a change of the Band-pass filter's gain over time.

[0072] FIG. 35 shows a Decay Gain-value over time, in relation with the TIME potentiometer's setting.

[0073] FIG. 36 illustrates a looped signal's rise, decay, tail regions.

DETAILED DESCRIPTION

[0074] The following provides clarification of certain recurring terminology used in this document.

[0075] Dry signalanalog audio signal coming from a musical instrument (via pick-up systems, microphones, etc.).

[0076] Musical eventAny separate chord, note or interval performed on a musical instrument.

[0077] Complex audio signalas opposed to oscillator-generated tones or audio output from single-strings, complex audio signal may consist of multiple main harmonics (polyphony) and an array of overtones, as well as leaking frequencies from microphones or pick-up systems.

[0078] Attackthe initial impulse of a musical event,for example the moment of strumming or plucking of a set of strings, first contact when blowing into a wind instrument's mouthpiece, etc.usually the loudest part of the musical event, with a percussive nature.

[0079] Decaythe main part of the musical event following the attackfor example the gradual decay of a ringing set of strings, sustained wind instrument note, etc.

[0080] Releasethe abrupt cessation of a musical event, such as lifting fingers away from a guitar's stringsusually considered as noise.

[0081] SampleThe isolated decay part of a given musical event, suitable for looping for cross-fading and looping.

[0082] Looped sampleSample, played in a circular loop, forming an even continuous sustained tone.

[0083] Wet signalLooped sample with all necessary post-effects added, such as time-varying EQ, volume fade, Rise and Tail regions, and other. The wet signal is considered the end-product of the current invention/method.

External Parts, Features

[0084] The following description relates to the preferred embodiment of the invention (FIG. 1) and aims to describe the optimal configuration of the sound synthesis method for live-performance use. The invention aims to provide the musician with an option of effortlessly sustaining the decay-sound of any complex audio signal, for examplefull chords, intervals or individual notes and harmonicsand prolonging their decay length according to needs.

[0085] The device in the preferred embodiment is contained within a rigid metallic body 1 (FIG. 1) suitable to withstand heavy-duty conditions and aggressive use of the foot-operated pedal 2 for inputting the control signal 34. The device's main preferred user interface is a spring-loaded foot-operated metallic pedal 2 for inputting the main control signal 34, in the shape of a piano's Sostenuto pedal. The pedal 2 for inputting the control signal 34 connects internally to a two-position on/off contact switch 13 (FIG. 2). Future versions of the device may include a gradual multi-positional or pressure-sensitive switch, which may be used, for example, to interact with one of the device's adjustable parameters, such as the response-speed of the device (fade-in or fade-out speed of the wet signal, upon receiving the main control signal 34)

[0086] In the current preferred embodiment, four external rotary potentiometers 3, 4, 5, 6 (FIG. 1) are mounted on the top-facing panel of the device, allowing for easy access to the device's adjustable parameters. It is desirable to give the user maximum control over the majority of the device's features, such as: [0087] the volume relationship between the dry signal and the wet signal, upon receiving the control signal (BLEND potentiometer 3), [0088] the wet signal's decay-length (TIME potentiometer 4), [0089] the dry signal's temporary volume and/or gain increase, upon receiving the control signal (GAIN potentiometer 5). [0090] the wet signal's resolution/smoothness (GLITCH potentiometer 6),

[0091] The preferred embodiment also offers two internal potentiometers 15, 16 (FIG. 3), located on the main printed circuit board (PCB, FIG. 2) for adjusting the speed at which the wet signal fades in or out of the overall mix upon receiving the main control signal 34.

[0092] Currently the wet signal's fade-in speed (RISE) and fade-out length (TAIL) are determined automatically in relation to the value of the TIME potentiometer 4, but user may extend or shorten the ratio by removing a special protective rubber cover 17 (FIG. 3) and adjusting the internal potentiometers 15, 16 (FIG. 3).

[0093] The number of potentiometers offered by the device, their specific names, purposes and configuration may change in future versions of the device.

[0094] Dry audio signal from instruments is received by the device via one standard inch jack input 7 (FIG. 1). The device is designed to work well with any analog audio signal source (magnetic pickups, piezo pickups, microphones, etc.). Other types of inputs may be used in future versions of the device (XLR, RCA etc.).

[0095] Musicians are encouraged to use the device in tandem with other external effects units (pedals, sequencers, etc.). In the preferred embodiment, the device offers two inch jack outputs 8, 9 (FIG. 1) in order to support a simultaneous connection with two separate effects chains and/or amplification devices. When only one output 8 is used, the wet and dry signals are combined into one channel, but when both jack outputs 8, 9 are used the wet and dry signals may be split. A two-position selection switch 10 (SPLIT) may be installed on the invention's back-panel, allowing the user to control the relationship between the dry and wet signal within both of the device's outputs (FIG. 5).

[0096] The device can be powered via a standardized 9V DC power supply input 11such power sources are the most widely used among musicians. Due to the relatively high power consumption of the proposed device, there will likely be no attempt to include a 9V PP3 battery slot in the device (which is the industry standard for similar effects units). Future versions of the device may offer a separate rechargeable battery pack, designed specifically for this invention.

[0097] The device in its current embodiment does not provide a separate ON/OFF switchthe device will switch ON as soon as the appropriate 9V DC power supply is connected to the power supply input 11 and a jack is plugged into the output 8. The device's ON state may be indicated by an indication LED 14 (FIG. 2) installed underneath the pedal 2 for inputting the control-signal 34. Another indication LED 12 may be positioned on the face of the body 1, programmed in relation with one of the device's parameters, for exampleindicating when the maximum setting on the TIME potentiometer 4 has been dialed in, etc.

Signal Path and Main Electronic Blocks

[0098] The main functional electronics blocks, indicated in FIG. 4, are: one audio input 18, one input buffer 19, drive circuit 22, signal mixer circuit 23, one output sensor 24, one SPST electronically controllable analog switch 26, SPST manual switch 27, microcontroller unit (MCU) 29, memory device 30, audio codec 31, pre-amplifier 32, anti-alias filter 33, two outputs 35, 36, two output buffers 37, 38, one SPDT electronically controllable analog switch 39.

[0099] The proposed device receives analog signal from audio input 18 which then passes through an audio buffer 19. In the preferred embodiment, the device is capable of receiving analog audio signal from sound-sources and splitting it into two pathsdry and wet 20, 21.

[0100] Dry Signal

[0101] The dry signal may be amplified by a designated DRIVE circuit 22 and sent towards the signal mixer circuit BLEND 23, where it is combined with the wet signal. If both output jacks 8, 9 (FIG. 1) are plugged in, the sensor 24 located on the analog OUT 2 36 sends a control-signal 25 to the analog switch 26 which may interrupt the dry signal's path to OUT 1 35. This allows the user to completely separate the dry and wet signals, which may be desirable when forming two individual signal chains to two different amplification devices and/or effects units. By adjusting the manual switch SPLIT 27 (FIG. 4), (10 in FIG. 1) the user may choose to send the dry signal to both OUT 1 35 and OUT 2 36the dry/wet signal's relationship within both outputs is indicated fully in FIG. 5.

[0102] Further embodiments of the invention may offer a different number of analog outputs and alternative methods of separating or combining the dry and wet signals.

[0103] It may be desirable to have a temporary increase of the dry signal's gain and/or volume levels during the time when wet signal is being generated. In the preferred embodiment an analog DRIVE circuit 22 begins affecting the dry signalsending it into a soft-clipping stage. The currently preferred diode-based DRIVE circuit 22 is only activated by a designated analog switch 39 when a control signal 28 from the MCU 29 is being receivedwhen the foot-pedal 2 (FIG. 1) is pressed. The amount of gain and/or volume increase added to the dry signal may be adjusted by the user via an analog potentiometer 5 (FIG. 1). If no volume or gain increase is desirable then the GAIN potentiometer 5 (FIG. 1) may be set at unity value.

[0104] Other analog or digital effects may be added to the dry signal path 20 in future iterations of the invention, such as compression, EQ, and so on.

[0105] Wet Signal

[0106] The wet signal is produced digitally by the MCU 29, out of a small portion of the audio signal recorded in real-time and stored in the device's memory unit 30.

[0107] Regarding the wet signal path 21, it is necessary to convert the analog audio signal from an instrument, for example, a guitar's pickup (magnetic, piezo, etc.) or an instrument microphone, into a digital signal. Before being digitized by an ADC-DAC codec 31, the signal passes through an analog buffer 19, pre-amp 32 and an anti-alias filter 33. In the preferred embodiment the analog signal is being digitized by a lossless audio codec 31 at a 64 kHz sample-rate; however other devices with a different sample-rate may be used.

[0108] The MCU 29 constantly stores the digitized signal from the audio codec 31 in a memory device 30. In the preferred embodiment, a 64 Megabit RAM is used, configured to continuously rewrite onto itself and to hold the last few seconds of audio, but other types of memory devices may be used in future embodiments. Upon receiving the main control signal 34 (pedal 2 pressed down), the MCU 29 will access the audio signal stored in the memory device 30, analyze it and choose a suitable note-decay portion (hereinafteraudio sample) of the most recent musical event (chord, note, etc.). See SEC 8.3 for a detailed description of how the sample suitable for looping is chosen and prepared for looping. This sample is used to form a continuous loop (looped sample) (block F3), which is then adjusted in block F4 and to produce the wet signal.

[0109] The formed digital wet signal is passed from the MCU 29 through a DAC audio codec 31, which converts it back into analog signal and sends it to the mixer circuit (BLEND) 23. Both of the device's outputs 35, 36 are buffered through analog output buffers 37, 38 and the wet signal produced by the device will always be sent to OUT 1 35. The volume balance between the wet and dry signal in OUT 1 35 may be adjusted by the user with the BLEND potentiometer 3 (FIG. 1), connected to the signal mixer circuit 23.

Adaptive Real-Time Audio Sampling and Looping Method

[0110] As stated in previous sections, the aim of the proposed device is to give musicians the opportunity of prolonging the decay portion of any complex musical sound, such as a strummed chord, a single note, etc., while preserving most of the natural characteristics of each particular instrument and/or of each particular musical event (attack, volume, vibrato etc.). It is also stated in the summary of this document that the sound synthesis method used in this device, referred to in this document as adaptive real-time audio sampling and looping, is different from oscillator-based synthesizers, because it is not able to generate new musical sounds autonomously, and always requires a previous audio source-signal (musical event) which is used for sampling and synthesizing sound (wet signal). The resulting output is therefore pre-determined in tonality, note composition and timbre by its respective source-sound (musical-event). The following section aims to clarify and illustrate the full process of producing the Sostenuto effect (wet signal).

[0111] FIG. 6 diagram should be viewed in relation to FIG. 4, where Analog block F1 relates to the dry signal chain 20 and DRIVE circuit 22 (FIG. 4), and Blocks F2, F3, F4, represent the actions performed by the audio codec 31, MCU 29, and memory device 30, in order to form the wet signal.

[0112] Processing Block F2 is where the signal from the memory unit 30 is analyzed, and where a suitable audio sample from the source-event is selected and adjusted (EQ & compression). Looping Block F3 is where a continuous circular playback loop is formed (looped sample). Post FX Block F4 controls the signal's dynamics, decay length, responsiveness, etc., and may add various embellishments (filters, EQ, etc.) to the looped samplethus producing wet signal.

[0113] F2 is the main software Block of the device, and it is where the Adaptive Real-Time sampling and looping of audio signal is performedthe audio processing method which is the key distinguishing factor of the proposed invention.

Block F2.1

[0114] Upon receiving the control signal 34 (FIG. 4) from foot-pedal 2 (FIG. 1), the MCU 29 reads the device's memory unit 30 which is configured to constantly rewrite onto itself forming a Circular Audio Buffer (CAB) FIG. 8. The current Memory device 30 is configured to hold approximately one second of audio with a 64 kHz sample rate, however future iterations may increase the size of the Memory device 30 to accommodate a larger CAB (Circular audio buffer) (FIG. 8).

[0115] In order to choose a sample best suitable for synthesizing the wet signal the most recently recorded musical event must be identified from the CAB and it must be analyzed in order to detect the musical event's attack, decay and release portions (see clarification of terms above).

Block F2.2

[0116] As soon as the main control signal 34 is received, Block F2.2 proceeds to analyze the audio signal stored in the memory device's 30 CAB at that moment (FIG. 8). The complexity of raw audio data from musical instruments (complex polyphonic sounds, multiple strings, harmonics, resonance, and other factors) may inhibit the process of choosing a sample suitable for looping; therefore, the raw audio data is simplified.

[0117] Raw audio signal may be simplified in a number of mathematical and statistical methods, thus producing a smooth audio curve representing the signal's dynamic and/or spectral properties as shown in FIG. 9.

[0118] One of the methods that may be used by the device is based on calculating the signal's variance over time, and then applying a sliding average function to even out the variance's raw results.

[0119] First the signal is split into small segments and Var(X) is calculated in each segment:

[00001]$\mathrm{Var}\left(X\right)=\underset{k=0}{\overset{K}{.Math.}}.Math..Math.{\left(X\left[k\right]-\stackrel{\_}{X}\right)}^2;$

where: [0120] Xsignal portion analyzed, [0121] Xsegment's mean value, [0122] X[k]k.sup.th point of the segment and [0123] Klength of the segment.

[0124] As variance values throughout the whole CAB are obtained, a sliding average function may be used to obtain a smoother, more even audio signal curve:

[00002]$\mathrm{SA}\left(x\right)=\frac{1}{L}.Math.\underset{k=0}{\overset{L-1}{.Math.}}.Math..Math.X\left[x+k\right];$

where:

[0125] Llength of the sliding average (number of points per calculationtypically 3, 5, 7.) [0126] Xvariance function to even out [0127] SA(x)x.sup.th point of Sliding Average result [0128] ksummation index

[0129] An alternative method of simplifying the audio signal is performing a series of spectral centroid calculations at various points throughout the length of the CAB. The raw signal is split into small segments and FFT analysis is performed for each segment. The FFT values are multiplied by their respective FFT frequency bins kthe sum of these results are used to form a spectral centroid of that particular segment. As centroid values throughout the whole CAB are obtained, a curve representing the audio signal's spectral and dynamic properties over time is formed.

[00003]$\mathrm{Centroid}=\underset{k=0}{\overset{\mathrm{NFFT}}{.Math.}}.Math..Math.\mathrm{kF}\left[k\right];$

where: [0130] F[k]k.sup.th point of FFT result [0131] kFFT frequency bin [0132] NFFTlength of FFT analysis window

[0133] The resulting evened out audio signal curve (FIG. 9) can now be analyzed in order to identify the most recent musical event, such as a strummed chord, plucked note, etc. The curve of the signal stored in the CAB is split into many small segments (FIG. 10) and the behavior of the signal curve (whether it is rising or falling) within each segment is analyzed starting from point B FIG. 10, where the control signal 34 is received, and moving towards the beginning of the CAB (point A, FIG. 10).

[0134] If the main-control signal 34 has been received during the decay portion of a ringing chord/note etc., it is expected that the first series of segments will show a continuous positive tendency when analyzed in the method described above (from point B () towards point A (beginning of CAB)), indicating a gradual dynamic or spectral decay of the signal. As soon as the tendency of the signal curve turns negative, as highlighted in region X, FIG. 10, it is considered that the release part of the previous musical event has been reachedall signal related to the most recent musical event has already been identified (point B till region X, FIG. 10). Point C is established at the beginning of region X (FIG. 10), and all signal prior to point C is discarded (region A-C, FIG. 10), and hereinafter the isolated section from point C to point B (FIG. 11) is considered the most recent musical event.

Block F2.3

[0135] As discussed above, it is assumed that each musical event consists of an attack, decay and release part. The most recent musical event (FIG. 11) must now be deconstructed and analyzed, in order to find a smooth portion of audio, suitable for loopingi.e. the musical event's decay period (sample).

[0136] FIGS. 12 and 13 demonstrate how the particular length of the sample suitable for looping is determined.

[0137] Firstly, the audio signal curve's peak value within region C-B is established (point D, FIG. 12) and point E is established slightly after point D based on a set constant (for example, 85% of the length of D-B but not exceeding 0.1 seconds). The region is then normalized based on the curve's value at point E, thus the curve's value (y) at point E (n, FIG. 12) is 1 (n=1 after normalization) and the (y) value at point B (m, FIG. 12) may vary depending on the audio signal received.

[0138] The (y) difference between n-m is calculated and region d is established (d=nm). If d is smaller than a pre-determined constant a then the whole section E-B is selected for further processing (case demonstrated in FIG. 12). The value of constant a may vary in embodiments, but current experience shows that the optimal value of a is between 0.15 and 0.25.

[0139] If d is larger than the given constant a (case demonstrated in FIG. 13) then a limiting threshold region e is introduced based on the value of d/2. The software moves the position of region e along the y axis to select the longest possible region within E-B where the signal falls within the limits of region e. In this particular case illustrated in FIG. 13, a region between points K and L has been identified as the longest continuous section with a steady, even signal curve (within the limits of e). Anything outside the region K-L (regions C-K; L-B FIG. 13) is considered an unusable portion of the musical event.

[0140] The resulting portion of audio signal, indicated in FIG. 13 (region K-L), is now considered the musical event's decay portion (smooth section of a decaying audio signal) which may be used for forming a continuous loop.

[0141] Other methods for separating the note/chord's gradual decay periods may be used in further embodiments of the invention. For example, a musical event's attack portion may be determined based on certain spectral changes, characteristic to the attack period of a note/chord, such as a rapid increase and decrease (peak) in higher frequency bands (typically above 2 Khz).

[0142] When the musical event's (chord/note) decay period is established, (usually with a length between 0.1 and 1 seconds) (K-L, FIG. 14) the processor will create a new audio portion from region K-L, hereinafter referred to as sample, shown in FIG. 14.

[0143] The proposed device's ability to autonomously detect a musical event's decay periodsample (with a unique-length each time (between 0.1-1 sec), depending on the particular musical event) is its main distinguishing feature from looper and delay devices described in the summary of this document, where a time-interval for looping or performing repeated playback must be pre-selected manually.

[0144] All processes described further in this document, including the filtration, compression, cross-fading, looping and playback of the sample can be performed within the MCU 29, while all new incoming audio signal is being constantly stored on the external memory 30 and readily accessible for processing at any time.

[0145] This ensures that the pedal 2 for inputting the main control signal 34 may be pressed rapidly, and a new sample may be selected and instantly formed into wet signal at any time, even while the previous wet signal is still fading out (TAIL).

Block F2.4

[0146] Even though the chosen sampleshown in FIG. 14is already the isolated decay part of the given musical eventif it were played back to back in a continuous cycle (looped), for example, the way a basic looper unit does (or a delay unit under certain settings), the resulting wet signal would sound staggered and unnatural, due to mismatches in dynamics and timbre in the sample's start and end regions (FIG. 15).

[0147] This is because any audio sample produced from analog instruments is likely to fluctuate and change over timemost notably there is an overall change in volume (amplitude) within each the sample, due to the natural gradual decay of musical sounds such as the case with plucked strings, bells, percussion etc., or other dynamics irregularities that may occur when playing wind and bowed instruments.

[0148] Also, in the case of every individual musical event (depending on its tonality, the instrument's timbre, attack, etc.), different harmonic components will decay at different rates over timetypically higher frequencies will decay more rapidly than lower frequencies (FIG. 17).

[0149] Block F2.4 (FIG. 16) employs a method named Adaptive Parametric Equalization to even out these harmonic fluctuations throughout the length of the whole sample.

Blocks F2.4.1-F2.4.7 (FIG. 16):

[0150] Before looping the sample FFT analysis at the sample's start region is performed, and its most significant frequency bands are identified, based on a threshold set by a conventional peak-detection algorithm. As a resulta certain number of frequency bands are identified as the signal's extremes (FIG. 17), and these are considered the sample's main harmonics. The same frequency bands are then measured using FFT at the sample's end region, thus indicating the change occurring in the sample's most significant frequency bands over time. The device in its preferred embodiment typically identifies a pre-set number (p) of the most dominant frequency bands, but any number of frequency bands may be used, also depending on the nature of the sample, or how the threshold is setin FIG. 17 these are shown as four (p=4) main spectrum peaks.

[0151] Block F2.4.8 uses the spectral information gathered during FFT analysis in the previous Blocks (F2.4.3-F2.4.7) to generate the parameters for a time-varying parametric EQ, in order to compensate for the changes in the sample's most significant harmonics (FIG. 17).

[0152] The aim is to preserve these frequency bands throughout the sample at the same level as in the start region (FIG. 20). FFT results from the sample's start-region (points a1-a4, FIG. 18) and end region (points c1-c4, FIG. 18), can be interpolated to predict new values of said spectrum peaks at intermediary points.

[0153] Only one such set of points is illustrated in FIG. 18 (b1-b4), but the number of intermediary points resulting from interpolation may be increased according to preference.

[0154] Based on the spectrum peak values at points a1-a4, b1-b4 and c1-c4a corresponding time-varying band-pass filter EQ may be generated and gradually applied to the sample. The sample is filtered gradually in small segments, with a different set of EQ parameters for each segment. FIG. 19 shows three filter transfer functions based on the measurements indicated in FIG. 18, howeveras stated abovethe number of intermediary points may be increased.

[0155] As a resultwhen playing the selected sample in a looped cycle the audible difference between the sample's start and end points becomes less obvious, meanwhile preserving the instrument's or particular musical event's distinguishing spectral properties (FIG. 20).

[0156] Further embodiments of the invention may use more complex methods for equalizing spectral content of a given sample, for example, perform FFT analysis for each segment and generating a more detailed set of parameters without the use of interpolation. Another embodiment may apply a set of Goertzel filters using the frequencies detected during FFT analysis of the sample's start region in order to measure changes of the most significant harmonic components throughout the sample for each segment.

[0157] In block F2.5 the sample's overall volume change (caused by natural note-decay or other factors) is evened-out, by using dynamic range compression (FIG. 21). Depending on each particular sample, the required amount of compression will differ; therefore the compressor's threshold level will be set based on the sample's average amplitude.

[0158] The particular type of compression, as well as its variable parameters (knee, ratio, attack speed etc.) may be adjusted differently in various embodiments of the device, but fundamentallythe use of a compressor (dynamic range limiter) is instrumental for synthesizing a continuous, even musical sound from portions of audio signal, recorded in real-time and stored on the device's Memory unit 30.

[0159] The current order of events (adaptive EQ.Math.compression.Math.) may be altered, interchanged or supplemented with additional steps in order to achieve the desirable effect. Other embodiments/methods may combine the equalization and compression blocks in a single process, based on either a specifically designed multiband compression system or, alternatively, use a more detailed equalization system.

[0160] Even after the previous steps (EQ (F2.4) and compression (F2.5)) any complex/polyphonic audio sample, when played in a circular way may still produce audible clicks or noises at its connection points if no cross-fading region is established (FIG. 22showing misconnected points).

[0161] In block F2.6 the sample's precise positions for cross-fading (FIG. 23) are determined, where the optimal overlap region is selected in such a way as to eliminate any noise, audible interference or phase mismatch during cross-fading.

[0162] FIG. 24 illustrates two regions (A, B) selected at the start and end of the sample; their size being defined as a certain percentage of the overall sample, which may vary in different embodiments. The value axis (y) on FIG. 24 and FIG. 25 shows the amplitude of the sample selected previously in F2.3. The objective is to find a portion of the signal within region B (the end portion of the sample), which is most similar to region A (the sample's start-portion)this information will be used later for choosing an optimal overlapping position for cross fading.

[0163] To find the best overlapping positions the information within regions A and B is down-sampled in order to decrease the computation time, and similarities within both regions are compared by using a Squared Difference Function (SDF).

[00004]$\mathrm{SDF}\left[k\right]=\underset{n=0}{\overset{N}{.Math.}}.Math..Math.{\left(A\left[n\right]-B\left[n+k\right]\right)}^2,$

where: [0164] SDF[k]squared difference function [0165] Nlength of region A [0166] kindex of SDF function [0 . . . length of SDF result]. [0167] nindex of regions A and B [0 . . . N] [0168] A[ ]region A [0169] B[ ]region B [0170] Additional conditions:

n+klength(B).

[0171] As shown in (FIG. 25) Region A is positioned on a multitude of positions inside region B and the Squared Difference between both overlapping regions is calculated in each location (number of positions is based on the resolution of the down-sampled signal). The position with the lowest value of SDF is considered the most desirable looping point for cross-fading regions A and B (E, FIG. 25), where phase mismatch and other undesirable effects would be reduced to a minimum.

[0172] Other methods, such as cross-correlation, may be used to determine matching regions suitable for overlapping.

[0173] Block F2.7 creates a cross-fade between the overlapping regions in order to avoid a volume increase due to the summing of two signal parts FI and FO where the length of FI is the difference between L and E (FI=FO=LE) (FIG. 26). The use of cross-fading is a standard practice in audio engineering and editing, therefore approaches may varybut ultimately the goal of cross-fading is to reduce any remaining audible connection and/or transitional sounds to a minimum, resulting in a maximally transition between sounds when looping the overlapped sample.

[0174] Different types of cross-fading may be used; FIG. 27 illustrates the dynamic cross-fading algorithm used by the current preferred embodiment of the device. The cross-fading parameters are determined by dividing regions FI and FO into smaller sub-sections, and based on the measurements of signal power or amplitude within those subsections, adding FI and FO in such a way that the sum of both signals remains at a target value (signal amplitude at point E).

[0175] The volume fade-out and fade-in is then applied permanently to the audio sample in regions FI and FO according to the cross-fading parameters determined in the previous block F2.7 thus forming the adjusted sample (FIG. 28).

[0176] Adjusted samplean audio sample chosen from the most recent musical event, adjusted by the Adaptive Parametric EQ, dynamic range compressor and with volume decreases at cross-fading regions FI and FO.

Looping the Adjusted Sample and Producing the Final WET Signal

[0177] The adjusted sample may now be sent to block F3, where it is played back circularly, as shown in FIG. 29as soon as the adjusted sample's end region (point E in FIG. 29), is reached a new playback read begins from the adjusted sample's start region (point K), forming an overlap and summing the start and end regions FI and FO of the sample.

[0178] The resulting output signal from block F3 is a maximally even continuous musical signal generated from a complex audio sample which, in the opinion of the inventors and many musicians, is a more realistic synthesized signal than those synthesized by envelope/oscillator-based units etc.

[0179] The continuously looped sample (as shown in FIG. 29) is now sent to POST FX Block F4 (FIG. 30), where it may undergo certain adjustments, to make the resulting wet signal sound more similar to how musical instruments behave in nature. Firstly, the gradual change of certain frequencies may be reinstituted into the continuous loop, using time-varying low-pass and band-pass filters (F4.1, F4.2), and also, depending on the TIME potentiometer's setting, the overall gain decay of the wet signal may be applied in F4.3.

[0180] FIG. 31 illustrates how the transfer function K.sub.LPF of the time-varying low-pass filter F4.1 changes over time. The low-pass filter's cut-off frequency f.sub.c varies in time as shown in FIG. 32, where three separate points in time (t.sub.1, t.sub.2, t.sub.3) show the corresponding f.sub.c values (f.sub.ct1, f.sub.ct2, f.sub.ct3). The value of the dominant frequency f.sub.dom shown in both figures may be determined based on the results of the FFT analysis of the given musical event performed earlier in F2.4.1. f.sub.dom may also be multiplied by a constant J (FIG. 32) to establish the initial value of the filter's cut-off frequency. As the filter's cut-off frequency decays, it gradually approaches the f.sub.dom frequency band, without ever crossing itas shown in FIG. 32. After point t.sub.3 the low-pass filter's cut-off frequency f.sub.c remains roughly static in slight oscillation.

[0181] The band-pass filter F.4.2 is used to apply a gradual boost to the looped sample's dominant frequency band. The change in time of the transfer function K.sub.BPF is shown in FIG. 33, where values G.sub.BPFt1, G.sub.BPFt2, G.sub.BPFt3 at given points in time (t.sub.1, t.sub.2, t.sub.3) indicate the gradual increase in gain for the dominant frequency band (center frequency is f.sub.dom. The resulting tendency of G.sub.BPF (FIG. 34) shows a gradual rise, followed by a slightly oscillating static pattern from point t.sub.3 onwards (similar to those shown in FIG. 32).

[0182] Additionally in the preferred embodiment, the user may manually control the signal's overall decay length by adjusting the TIME potentiometer 4 (FIG. 1) from a very short setting (realistic) (such as 5 seconds long)to an infinite decay. FIG. 35 illustrates the pattern for the looped sample's overall gain decay over time, depending on the TIME potentiometer's 4 setting.

[0183] A specific LED 12 may be installed, indicating when the device is in the INFINITE decay mode (max TIME setting in FIG. 35)TIME potentiometer 4 is in the maximum setting.

[0184] The resulting signal, consisting of a sample (determined and adjusted in Block F2) looped circularly (in block F3) adjusted by a time-varying low-pass filter and gradual volume decrease (Post FX Block F4) is considered the completed wet signal.

[0185] The wet signal can also be faded out of the mix rapidly by releasing the foot-pedal 2 (control signal is interrupted). The exact speed of the fade-out region (Tail reg. in FIG. 36) may be set proportionally to the settings of TIME potentiometer 4, and further adjusted by using the internal TAIL potentiometer 16.

[0186] The preferred embodiment is designed and adjusted for achieving a controllable wet signal which is maximally realistic to the natural decay-sound of any source instrument or musical event.

[0187] However, it may be desirable for some users to produce a distorted, unrealistic choppy wet signal where the samples are looped inaccurately. A dedicated GLITCH potentiometer 6 (FIG. 1) increases the value of the limiting threshold in BLOCK F2.2 and F2.3, above the optimal setting. As a result the separation of attack and decay within sound-events is performed inaccurately, thus producing an odd effect. Different ways of distorting/disrupting the wet signal may be offered in future iterations of the proposed invention.

[0188] In further embodiments, other effects may be added in the POST-FX block F4, in order to alter the properties of the wet signal, including classic digital effects, such as delay, reverb, tremolo, chorus, dynamic compression etc.

[0189] After the finished wet signal has been produced and all desired effects have been added to it, it is sent to the DAC (digital-analog converter) 31, then to F5 BLEND BLOCK (see 23, FIG. 4; F5, FIG. 6), and finally to analog output buffer 37.

[0190] The produced wet analog signal can be routed to one or multiple outputs. In the preferred embodiment, the invention offers a two- jack output system 35, 36 with three possible output configurations, controlled by a two-position switch 10 labeled SPLIT (FIG. 1).

[0191] As mentioned before, the wet signal and the dry signal may be mixed together and sent to one output 35. The mixing ratio between the wet and dry signals is adjustable by an analog potentiometer labeled BLEND 3 (FIG. 1).

[0192] By adjusting the TIME potentiometer 4, the user may control the length and behavior of the wet signal over time, according to needs; FIG. 35 illustrates the principle of how the wet signal may behave over time according to different TIME potentiometer 4 settings.

[0193] The method and device proposed is designed to produce the claimed Sostenuto wet signal and send it to the analog outputs with a minimal, humanly-inaudible time delay between pressing the pedal 2 and receiving the wet signal in the devices output/s. In practice, however, it may be desirable to have the wet signal gradually fade-in as indicated in FIG. 36 (Rise reg.). The precise speed of the fade-in (Rise reg.) may be adjusted with the RISE internal potentiometer 15.

[0194] As mentioned in the summary of this document - the method and device proposed is not able to generate new tonal content autonomously, and always requires a previous source-audio signal (most recent musical event) for sampling and synthesizing the wet signal. Therefore the success of the method depends on the precise input of the Main Control signal 34, which has to always follow the musical event.

[0195] In case if a faulty main control signal 34 is received (before or during the attack period of a musical event) and no clear sample may be selected, a basic reverb or delay setting may be applied to the audio signal to produce a substitute for the expected wet signal.

[0196] The current device's preferred method of inputting the main control signal 34 (manualvia pressing the foot-pedal 2) may be altered. It must be noted that other types of switches, buttons or external controllers may also be used for inputting the main control signal 34. Future versions of the device may also be able to generate the main control signal 34 automatically based on audio signal analysis, thus avoiding the need for any switches, buttons, pedals, etc., or any other means for inputting the main control signal 34. For example, the main control signal 34 may be generated automatically, as soon as the release part of a musical event is detected, thus beginning the formation of the wet signal immediately after the release of a note/chord.

[0197] One practical application of such a method is the possibility of synthesizing wet signal from multiple musical events simultaneously, for exampleduring the time when the device is engaged, each new detected musical event may trigger its own main control signal 34, as described above, be looped and sent to the BLEND circuit 23. Such an approach would allow the musician to play a succession of notes/chords (musical events) and have each one of them ring out (simultaneous looped playback) for as long as necessarybased, for example on the TIME potentiometer's 4 setting.

REFERENCE NUMBERS

[0198]

TABLE-US-00001 1 body 2 pedal 3 BLEND potentiometer 4 TIME potentiometer 5 GAIN potentiometer 6 GLITCH potentiometer 7 jack input 8 jack output 1 9 jack output 2 10 SPLIT switch 11 DC power supply input 12 LED for indication 13 two-positional switch 14 power LED 15 RISE internal potentiometer 16 TAIL internal potentiometer 17 protective rubber cover 18 audio input 19 input buffer 20 DRY signal path 21 WET signal path 22 DRIVE circuit 23 BLEND circuit 24 sensor for output 2 25 control signal (output 2) 26 analog switch 27 split switch 28 DRIVE control signal 29 MCU 30 memory unit 31 DAC-ADC codec 32 pre-amp 33 anti-alias filter 34 main control signal 35 output 1 36 output 2 37 output buffer (out 1) 38 output buffer (out 2) 39 DRIVE circuit switch