Tuning of a drum
11211038 · 2021-12-28
Inventors
Cpc classification
International classification
G10D13/10
PHYSICS
Abstract
A method for assisting a user in tuning a drum comprising the steps of: considering a strike on the drum whereby the strike is detected in a sensor signal in at least one of following domains: a time domain, a frequency domain, a complex domain; recording a first sound fragment of the strike; converting the first sound fragment from the time domain to the frequency domain; analyzing the first sound fragment in order to detect a fundamental tone with fundamental tone frequency of the drum; calculating an overtone frequency or overtone frequency range of a first overtone of the drum by means of a predetermined algorithm related to the fundamental tone frequency; setting a filter with a pass frequency band covering the calculated overtone frequency or overtone frequency range; and indicating, via a user interface, at each further strike when the frequency of the first overtone detected in the pass frequency band is higher or lower than a target overtone frequency.
Claims
1. A method for assisting a user in tuning a drum, comprising: detecting a strike on a drum within a sensor signal of a vibration sensor; recording a sound fragment of the strike by means of the vibration sensor; transforming the sound fragment of the strike from a time domain into a frequency domain; analyzing at least a part of the sound fragment in the frequency domain in order to detect at least one of following: a fundamental tone of the drum, a first overtone; performing a magnitude manipulation in at least a part of a power spectrum of the sound fragment of the strike, whereby the magnitude manipulation changes relative magnitude ratios of frequency bins within the power spectrum of the sound fragment of the strike on the drum; determining a magnitude range; selecting a magnitude peak and determining a frequency related thereto; deeming the determined frequency related to the selected magnitude peak as a detected tone.
2. The method according to claim 1, wherein the selected magnitude peak is not a maximum peak.
3. The method according to claim 1, wherein the at least a part of the power spectrum of the sound fragment of the strike is determined by at least one of following: a cut-off frequency, a frequency band, a frequency, a detected tone.
4. The method according to claim 1, further comprising: determining at least one of following characteristics of the strike: an impact location, a hardness of the strike, an impact moment over time, a damping, a frequency distribution, a distribution and a progression of spectral content detected in the frequency domain over a determined time period, an acoustic envelope containing the acoustic signature related to the impact location.
5. The method as claimed in claim 1, wherein the selected magnitude peak is not in the at least a part of a power spectrum of the sound fragment of the strike wherein the magnitude manipulation is performed.
6. The method according to claim 1, wherein the strike on the drum is detected within the sensor signal of the vibration sensor when at least one threshold value is exceeded, wherein the at least one threshold value is set to a signal characteristic of at least a part of the sensor signal, wherein the at least one threshold value is set in at least one of following domains: a time domain, a frequency domain, a complex domain.
7. The method according to claim 1, wherein the at least a part of the power spectrum of the sound fragment of the strike is adjusted adaptively.
8. The method according to claim 1, further comprising: determining whether the frequency of the selected magnitude peak is at least one of following: above a frequency of a target tone, below a frequency of target tone, equal to a frequency of a target tone; whereby the frequency of the target tone is at least one of following: a calculated frequency, a previously detected frequency, a chosen frequency.
9. The method according to claim 1, further comprising at least one of the following: indicating to a user via a user interface whether and how a tension of a drum head has to be adjusted compared to a target tone, displaying a detected tone, displaying an indication of a detected tone, displaying a difference between a detected tone and a target tone, displaying a target tone, producing a sound signal, indicating via a user interface whether a center strike on the drum is desired, indicating via a user interface whether an edge strike on the drum is desired.
10. The method according to claim 1, further comprising: setting at least one magnitude threshold; selecting the magnitude peak when a magnitude related thereto is at least one of following: below the at least one magnitude threshold, equal the at least one magnitude threshold.
11. The method according to claim 1, wherein the vibration sensor is physically arranged on a drumhead by at least one of the following techniques: printing, transferring, laminating, coating, welding, adhering, and whereby at least a part of the vibration sensor is in a physical contact with at least one layer of the drumhead, and whereby the physical contact is at least one of the following; direct, indirect via a medium.
12. A digital storage medium comprising instructions which, when executed, cause a data processing device to perform the steps of the method as claimed in claim 1.
13. An apparatus for assisting a user with tuning a drum, comprising a data processing device coupled operationally to a digital storage medium for performing the steps of the method as claimed in claim 1, which apparatus is further at least comprising one of the following: a vibration sensor, an operational coupling with a vibration sensor, a means to enable an operational coupling with a vibration sensor, a means to modify the position of the vibrations sensor in relation to a drum head, a means to modify the position of the vibration sensor in relation to the apparatus, a means for recording the sound fragment, a means to receive a data of a strike on a drum, a means to receive a sensor signal of a vibration sensor, a means to receive processed data related to a strike on drum, a means to receive data related to a detected tone, a means to receive a power spectrum related to a strike on a drum, a means to receive a detected tone, a means to receive a target tone, a means for mounting at least a part of the apparatus on at least one of following: a rim of a drum, a part of a drum, a part of another musical instrument, a directional mechanism for orienting the apparatus, a removable clamp, a user interface, a means for wireless communication, a skin tension sensor, a means for connecting the apparatus to at least a part of a striking medium, a means for connecting it to at least a part of a body part, a means for connecting it to at least a part of a hand, a means for connecting it to at least a part of an arm.
14. A method for assisting a user in tuning a drum, comprising: detecting a strike on a drum within a sensor signal of a vibration sensor; recording a sound fragment of the strike by means of the vibration sensor; transforming the sound fragment m a time domain into a frequency domain; analyzing at least a part of the sound fragment in the frequency domain in order to detect at least one of following: a fundamental tone of the drum, a first overtone; performing a magnitude manipulation in at least a part of a power spectrum of the sound fragment of the strike, whereby the magnitude manipulation changes relative magnitude ratios of frequency bins within the power spectrum of the sound fragment of the strike; determining a magnitude range; selecting a magnitude peak and determining a frequency related thereto; deeming the determined frequency related to the selected magnitude peak as a detected tone; wherein the vibration sensor is at least one of following: physically arranged on a drumhead and whereby at least a part of the vibration sensor is either: or in direct mechanical contact with at least one layer of the drumhead, or in indirect mechanical contact via a medium with the at least one layer of the drumhead; or directly arranged on at least one layer of a drumhead by at least one of the following techniques: printing, transferring, laminating, coating, welding, adhering, and whereby at least a part of the vibration sensor is either: or in direct mechanical contact with at least one layer of the drumhead, or in indirect mechanical contact via a medium with the at least one layer of the drumhead; determining at least one of following characteristics of the strike: an impact location, a hardness of the strike, an impact moment over time, a damping, a frequency distribution, a distribution and a progression of spectral content detected in the frequency domain over a determined time period, an acoustic envelope containing the acoustic signature related to the impact location.
15. The method according to claim 14, wherein the selected magnitude peak is not a maximum peak.
16. The method according to claim 14, wherein the at least a part of the power spectrum of the sound fragment of the strike is determined by at least one of following: a cut-off frequency, a frequency band, a frequency, a detected tone.
17. The method as claimed in claim 14, wherein the selected magnitude peak is not in the manipulated part of the power spectrum.
18. The method according to claim 14, wherein the strike on the drum is detected within the sensor signal of the vibration sensor when at least one threshold value is exceeded, wherein the at least one threshold value is set to a signal characteristic of at least a part of the sensor signal, wherein the at least one threshold value is set in at least one of following the domains: a time domain, a frequency domain, a complex domain.
19. The method according to claim 14, wherein the at least a part of the power spectrum of the sound fragment of the strike is adjusted adaptively.
20. The method according to claim 14, further comprising: determining whether the frequency of the selected magnitude peak is at least one of following: above a frequency of a target tone, below a frequency of target tone, equal to a frequency of a target tone; whereby the frequency of the target tone is at least one of following: a calculated frequency, a previously detected frequency, a chosen frequency.
21. The method according to claim 14, further comprising at least one of the following: indicating to a user via a user interface whether and how a tension of a drum head has to be adjusted compared to a target tone, displaying a detected tone, displaying an indication of a detected tone, displaying a difference between a detected tone and a target tone, displaying a target tone, producing a sound signal, indicating via a user interface whether a center strike on the drum is desired, indicating via a user interface whether an edge strike on the drum is desired.
22. The method according to claim 14, further comprising: setting at least one magnitude threshold; selecting the magnitude peak when a magnitude related thereto is at least one of following: below the at least one magnitude threshold, equal the at least one magnitude threshold.
23. A computer-readable medium having stored thereon instructions to cause a processor to execute a method for assisting a user with tuning a drum, the method comprising: detecting a strike on a drum within a sensor signal of a vibration sensor recording a sound fragment of the strike by means of the vibration sensor; transforming the sound fragment m a time domain into a frequency domain; analyzing at least a part of the sound fragment in the frequency domain in order to detect at least one of following: a fundamental tone of the drum, a first overtone; performing a magnitude manipulation in at least a part of a power spectrum of the sound fragment of the strike, whereby the magnitude manipulation changes relative magnitude ratios of frequency bins within the power spectrum of the sound fragment of the strike; determining a magnitude range; selecting a magnitude peak and determining a frequency related thereto; deeming the determined frequency related to the selected magnitude peak as a detected tone; wherein said computer-readable medium is installed on at least one of following: a smart device, a wearable, an accessory, a smart watch, a console, a tablet, a computer, a digital workstation, a notebook, a laptop; a mobile electronic device, a tablet, a smartphone, a trigger interface, a drum brain, a server, a website, a PDA, a pad.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The invention will now be further described on the basis of an exemplary embodiment shown in the drawing.
(2) In the drawing:
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
DETAILED DESCRIPTION
(19) The same or similar element is designated in the drawing with the same reference numeral.
(20) In the context of this description the following definitions will be used:
(21) The resonance of a strike comprises all vibrations which occur as a result of an agitation of an object or object structure which causes mechanical vibration and/or elongation of this object or this object structure which may or may not be discernible to human hearing. The resonance duration of a strike is the duration for which these vibrations exist.
(22) The acoustic characteristics of the resonance of a strike comprise all spectral information related to the vibrations occurring as a result of an agitation of an object or object structure which causes mechanical vibration and/or elongation of this object or this object structure which may or may not be discernible to human hearing. These characteristics can be detected, among other ways, in the time domain, the frequency domain or a combination thereof and are characteristic of and typical of a determined resonance of a determined object or a determined object structure occurring due to a determined agitation.
(23) Agitation of an object or object structure is understood to mean: the addition of energy to this object or this object structure or removing energy from this object or this object structure, optionally through direct mechanical contact with this object or this object structure, such as for instance a strike with a body part or object, a friction with body part or object or a damping with a body part or object; or optionally through indirect mechanical contact by controlling the movement of the medium in which this object or this object structure is situated, such as the surrounding air, atmosphere or liquid. Each type of agitation results in a specific type of resonance of this object or this object structure with its own acoustic characteristics which can be distinguished from each other by analyzing the signal of the resonance of this type of strike in the frequency domain and/or time domain.
(24) Considering a strike is understood to mean receiving the signal content of at least one or more input signals from one or more microphone signal input channel(s) which comprise(s) signal content information related to the recording of the resonance of a strike or at least a part of the resonance duration of a strike, in order to obtain at least one or more of the following data, insights or results by analyzing these signal contents:
(25) a detection of a strike on a percussion surface, on a drum or on a component thereof, on a percussion instrument, on a drum skin;
(26) a determination of a moment in time at which the strike occurs;
(27) a determination of a moment in time at which a determined; part of the resonance duration of a strike occurs;
(28) a determination of a moment in time at which a determined part of the resonation duration of a strike occurs, more specifically the part where an amplitude peak of the strike occurs;
(29) a determination of a moment in time at which an amplitude peak of the strike occurs;
(30) a determination of a vibration frequency associated with a strike or a determined part of the resonance duration thereof;
(31) a determination of a vibration frequency associated with a determined part of the resonance duration thereof, such as a part which may partially comprise or may wholly not comprise an amplitude peak;
(32) a determination of the impact location of a strike;
(33) a determination of an impact location of a strike, a recognition of an object or an object structure on the basis of the acoustic characteristics of the resonance of a strike;
(34) a determination of the distribution of the magnitudes of a resonance of a strike across the detected spectrum or a part thereof in order to obtain a determination of an impact location of a strike, a recognition of an object or an object structure on the basis of the acoustic characteristics of the resonance of a strike in the frequency domain;
(35) a determination of the amplitude or magnitude of at least a part of the resonance duration of a strike from at least two microphone signal input channels.
(36) This has the purpose of tuning an instrument, triggering an instrument for electronic or hybrid playing purposes, amplifying or recording an instrument.
(37) An input signal, such as a microphone signal, vibration sensor signal, a sensor signal and so on, also referred to in this text as signal, is a signal which is analog or digital or otherwise originating from or generated by or influenced by a microphone or other vibration sensor under the influence of or resulting from the resonance of an object or object structure. This input signal runs over a signal input, a channel, a signal input channel or over a signal channel such as the microphone signal channel. The signal content of the input signal thus comprises information related to the resonance of an object or an object structure. The signal content of the input signal could be influenced in analog or digital manner by means of filtering, equalizing, amplification, windowing or other manipulation techniques.
(38) A strike detection buffer, as well as a strike buffer, comprises signal content which for instance originates at least partially from the input signal and can be at least partially created on the basis of signal content which may or may not have been influenced in analog or digital manner.
(39) In order to obtain a good understanding of the invention in relation to the prior art, the prior art is elucidated below with its drawbacks and with the differences between the invention and the prior art.
(40) Described in U.S. Pat. No. 8,502,060 B2 is an apparatus provided with a clamp for attaching the apparatus to a drum and which has only one microphone. This built-in microphone is situated on the underside of the apparatus and is directed away from the lower surface of the apparatus and directed toward the skin of the drum when this apparatus is mounted on a drum.
(41) The position of the microphone of this apparatus cannot however be directed in variably adjustable or desired manner toward a determined location on the skin of the drum without rotating or moving the whole apparatus and hereby also influencing the angle of view on the display of the apparatus.
(42) This apparatus has the drawback that it is hereby less suitable for recording, within the directional field of the microphone, frequencies such as for instance first overtones of the skin which are generated at a determined location on the skin, which location lies outside the directional field or recording field of the built-in microphone, in comparatively sufficiently loud or sufficiently pronounced manner without moving or picking up the apparatus itself in order to aim the microphone more easily at the impact location. The recording sensitivity of the directional field or recording field is not the same over the whole extent of this field. This fact likewise reinforces the effect that for instance overtones generated close to tuning pegs situated far from the apparatus, and so further outside the directional field of the built-in microphone, are detected comparatively less loudly or in less pronounced manner in the microphone signal.
(43) In a preferred embodiment of the apparatus of the invention at least one microphone is provided which can be aimed without having to move the whole apparatus for this purpose.
(44) By aiming the microphone the distance between the microphone and the skin can indirectly also be determined in variable manner, although in the preferred embodiment a control mechanism could also be provided with which the height distance of the microphone and the drum skin can be set or adjusted.
(45) This has the advantage on the one hand that the angle of view of the screen can remain unchanged while the microphone can still be directed toward a determined preferred location by the user. On the other hand there is the advantage that the sensitivity for signals from the direction of the directional field of the microphone can be improved because the microphone can be directed toward locations on the skin where it is wished to record frequencies sufficiently loudly or in comparatively more pronounced manner.
(46) In another preferred embodiment of the apparatus as described in this invention the apparatus is designed such that it can be held in the hand, whereby at least one microphone can be easily directed toward a determined location.
(47) The frequencies generated at the location toward which the microphone is directed are, as also elucidated above, discerned as louder in the microphone signal. There are hereby more easily detectable within the microphone signal.
(48) In order to tune a drum to an overtone generated on the skin close to a determined tuning peg it can be useful to actually direct the microphone toward a location on the skin where the movement, and so the air displacement, related to the vibration mode associated with this overtone is the highest, since at this location the overtone will have the most pronounced presence in the microphone signal and will thus be more easily detectable.
(49) In order to tune a drum to a fundamental tone, it can be useful to direct the microphone toward a location in the center of the skin since the movement of the skin related to the vibration mode associated with the fundamental tone is the greatest here. At this location the air displacement caused by the fundamental tone is therefore also the greatest and the sound occurring as a result, i.e. the fundamental tone, will have the most pronounced presence in the microphone signal when a microphone is directed toward this location on the skin. This tone is hereby more easily detectable as magnitude peak value in a power spectrum of the signal.
(50) Directing of the microphone toward a determined location can, as demonstrated above, thus enhance the detection of an overtone or a fundamental.
(51) It may also be useful in this respect, though not essential, to provide a microphone at a location other than on the underside of the apparatus, whereby the directional range can optionally be increased or the visibility of the direction in which the microphone is aimed is improved, or the accessibility to the microphone to be directed is simplified. A height control can if desired also be provided via which the distance between the microphone and the skin can be determined independently of the direction of the microphone.
(52) In a preferred embodiment wherein hands-free application is not required the apparatus has a clamp which is designed to mount the apparatus on the tensioning rim or hoop of a drum or on another component thereof by means of gripping jaws. This clamp is more preferably suitable for use with wooden, plastic and metal tensioning hoops in the most usual sizes for bass drums, toms, floor toms or snare drums. The tensioning width of the clamp between the gripping jaws more preferably has for this purpose a range which is sufficiently large and preferably comprises at least 20 mm to 50 mm. The clamp can for instance consist of at least one component, wherein the jaws thereof can move flexibly in relation to each other, although the clamp can equally well be a component structure consisting of several components.
(53) The clamp of the apparatus in this invention can be embodied such that it is a separate component or a separate component structure which can be connected as desired to the other parts of the apparatus, whereby the clamp is removable. It may also be useful to provide a directional mechanism with determined freedoms of movement on the apparatus or on the clamp, such as for instance, though not limited thereto, a rod mechanism or a ball joint, or to provide for connection to the apparatus, which allows the whole apparatus to be individually oriented in accordance with determined freedoms of movement relative to the position of the clamp or a part thereof.
(54) When in a preferred embodiment of the apparatus having at least two microphones at least one microphone is situated on the underside of the apparatus, both gripping jaws of the clamp are then preferably individually movable, and are also indirectly connected to the lower shell of the housing of the tuning apparatus in order to minimize or prevent disruptive vibration transfer between clamp and microphone.
(55) The apparatus or system as described in this invention is equipped in a preferred embodiment with a manner of tuning or method of tuning which allows a simple focus mode to be implemented which has the purpose of simplifying the detection of a determined tone of a drum, such as a fundamental tone, or a determined overtone such as the first overtone.
(56) In this manner of tuning or method of tuning or focus mode method the following steps are performed:
(57) Firstly a first strike on a drum is detected by means of a strike detection analysis performed on at least one microphone signal.
(58) This strike detection analysis of at least one microphone signal can for instance take place by observing the amplitude progression in the time domain, but more preferably takes place in the frequency domain by observing the magnitude progression of the microphone signal in one frequency band or in multiple frequency bands which optionally wholly comprises or comprise the overall bandwidth of the discerned spectrum.
(59) For this purpose strike detection buffers are for instance analyzed in the frequency domain over a period of time by examining a power spectrum thereof and checking whether this complies with determined conditions and/or has acoustic properties which are related to the occurrence of a strike.
(60) Detection of a strike in the time domain as described in U.S. Pat. No. 8,642,874 B2 has the drawback that without further frequency filtering of the input signal there is the risk that a loud tone in the ambient sound with acoustic properties other than those of a drum stroke can be erroneously interpreted as a drum stroke.
(61) In the present invention on the other hand, the strike is detected in a preferred embodiment in the frequency domain. Detection of a strike in the frequency domain allows analysis of the frequency content of the signal in order to thus recognize the acoustic characteristics of a drum stroke and/or a determined instrument subject to the characteristic signal content, whereby it is possible on the one hand to reduce the risk of ambient sound erroneously being interpreted as a drum stroke and whereby it becomes possible on the other to distinguish from each other strikes on, or agitation of, determined types of instrument or determined drums or percussion instruments of for instance a drum kit or parts thereof. ‘Triggering’ or ‘detection of a strike’ via strike detection analysis of strike detection buffers in the frequency domain in this way allows recognition of strike type with buffer lengths shorter than 500 ms, and preferably shorter than 25 ms, impact part recognition and/or instrument recognition in a short time period. Via strike detection analysis focused on impact part recognition, the impact location on an instrument can be found, for instance an edge strike can thus be distinguished from a center strike and an edge strike from a hoop strike by looking at the distribution and the progression in the magnitudes of the individual frequency bins in a power spectrum, optionally only within determined frequency bands of the spectrum, over a determined time period. The strike hardness of the strike, for instance for playing purposes or in order to determine the strike consistency, can for instance be determined by adding up the total magnitudes as detected within all bins or of only a part thereof. When different input signals are present, a more accurate picture of the strike hardness can be obtained by processing the signal content of the individual channels in relation to each other.
(62) In a preferred embodiment of the apparatus of this invention the method further also comprises a step, or the apparatus also comprises the option, of giving via the user interface an indication related to the strike hardness of a detected strike. It is hereby possible for instance to indicate to the user via a sound, the loudness or volume of which is related to the detected strike hardness, or via a visualization related to the detected strike hardness, what the intensity of the detected strike hardness was or to what extent it differs at a subsequent strike from a preceding strike or from a determined target strike hardness.
(63) In this strike detection analysis the resonance of a strike is detected in a microphone signal when the signal content satisfies at least one specific condition, such as for instance a magnitude limit value being exceeded for a determined time interval, possessing a determined acoustic signature or frequency content or a sudden increase in magnitude or a sudden decrease in magnitude over a determined time interval in the overall detected spectrum or in a part thereof, and the like. A strike type can for instance hereby be recognized, but also an agitation such as a strike on an object or object structure with another object or body part as well as an agitation such as damping of the vibration of an object or an object structure with another object or a body part can also be detected. It would thus be possible to detect in the signal when a cymbal is struck or when a resonating cymbal is damped by hand, when the cymbals of a high-hat are closed or opened with the foot pedal, when a resonating drum is struck or damped with the finger, stick or hand, and so forth. This information can be utilized for both tuning purposes and playing purposes. For playing purposes the strike detection, strike type recognition or impact part recognition could be related to separate MIDI files suitable for instance for electrical, electronic or hybrid percussion. The magnitude progression of the frequency content of the signal over a determined time period could thus also be linked adaptively to the user with specific output signals or sounds which are influenced by this magnitude progression, whereby a quasi-real-time percussion response occurs which has the tonal properties and/or the intonation of the strike which is detected in the input signal or related to the content of the strike buffer.
(64) For tuning purposes or for tuning a drum, when a strike or optionally a damping thereof is detected, in a further step a strike buffer is recorded or compiled which comprises the total resonance duration of the strike or damping, or at least a part thereof.
(65) This strike buffer is then preferably analyzed in the frequency domain in order to determine at least one of the following properties of the strike: the amplitude of the strike or damping, the impact location of the strike or damping, the initial moment in time, such as the moment of impact of the strike or the beginning of the damping, a suitable frequency peak of the strike associated with the fundamental tone or an overtone thereof, such as the first overtone, for tuning a drum, or the frequency distribution of the strike or the frequency progression of the strike.
(66) In order to determine a suitable frequency peak of the strike associated with the fundamental tone or an overtone thereof, such as the first overtone, for tuning a drum, a frequency of a suitable magnitude peak related to a determined frequency bandwidth in a power spectrum is determined which is then deemed the most dominant frequency present in this strike buffer which comprises the overall resonance duration of the strike or damping, or at least a part thereof.
(67) Via the user interface the user can subsequently activate a focus mode wherein detection is facilitated of determined magnitude peaks associated with determined frequencies or frequency bands in at least one frequency bandwidth optionally comprising the overall discerned frequency spectrum.
(68) This focus mode can be deemed a simple focus mode. The simple focus mode can be activated via a command which the user inputs via the user interface, for instance such as via pressing a button, or via touching a specific zone on the user interface of the apparatus. In a preferred embodiment the apparatus has a button or touch zone which can be employed to switch the apparatus on or off, but also to activate or deactivate a focus mode.
(69) The activation of the simple focus mode preferably takes place when a determined inputted or retrieved frequency or frequency band, which can be a target frequency, or a detected frequency or a detected magnitude peak or a value related to the foregoing, is displayed via the user interface as a result of a first strike. The shown value as described above can then be stored by the apparatus as target tone, which target tone can be utilized to calculate the difference from a tone detected at a subsequent strike when the focus mode is active.
(70) The simple focus mode involves a focus area being defined around a determined frequency of frequency band deemed as target tone, which can be inputted or retrieved or be detected at a first or a preceding strike as a frequency or detected magnitude peak or which can have a value related to the foregoing, inside or outside which area the magnitude is measured for at least one frequency bin within a power spectrum.
(71) This measured magnitude will be employed as reference magnitude, wherein in an additional step a magnitude manipulation operation is performed on the frequency content of at least a part of the strike buffer, which magnitude manipulation has the result that the relative magnitude ratios of the frequencies or frequency bins is changed within at least a part of the power spectrum of a strike buffer or a part thereof.
(72) U.S. Pat. No. 8,502,060 B2 describes a filter method which is based on a bandpass filter which is placed symmetrically around a frequency detected as maximum peak value within the recorded signal of a strike and where it is assumed that this peak value corresponds to the frequency associated with the first overtone, wherein the filter prevents frequencies falling outside the pass frequency range being shown.
(73) The focus area determined according to the present invention differs from a bandpass filter since no frequencies are filtered out of the signal from the strike buffer. Nor does setting of the focus area in focus mode prevent the possibility of frequencies falling outside the focus area being shown. For this purpose the focus mode makes use of a magnitude manipulation operation, optionally supplemented with a magnitude filter which is set to a magnitude-manipulated strike buffer or magnitude-manipulated power spectrum thereof, of which only the mutual ratios of the frequency content has been changed, but wherein no frequencies have been removed for tone analysis, tone selection or frequency bin selection for tuning purposes. A frequency bin selection algorithm modified to be specific magnitude manipulation operation comprises specific conditions which are adjusted to this specific magnitude manipulation operation, whereby a tone suitable for tuning purposes can be detected.
(74) When being determined, the focus area need not of course be set symmetrically with cut-off frequencies which have an equal frequency interval relative to the detected magnitude peak or a frequency related thereto.
(75) It is perfectly well possible to determine an asymmetrical focus area relative to a determined inputted or retrieved frequency or frequency band or a detected magnitude peak or a frequency related thereto, this having a wholly different frequency interval between on the one hand the upper maximum frequency thereof and the detected magnitude peak, or a frequency related thereto, and on the other the lower minimum frequency and the detected magnitude peak or a frequency related thereto.
(76) In this simple focus mode a focus area is in this way first defined which has a frequency band range at least partially comprising at least one of the following: an inputted frequency or frequency band, a retrieved frequency or frequency band or a detected magnitude peak associated with a frequency band or a frequency related thereto which is for instance associated with a fundamental tone or an overtone thereof, such as the first overtone. The focus area will be set at each subsequent strike when the simple focus mode is active.
(77) At each subsequent strike, when the simple focus mode is active, a power spectrum is then calculated of the strike buffer of this subsequent strike and a search is made within the bandwidth of this focus area for the frequency band or the frequency bin within the power spectrum which has the lowest magnitude. The magnitude value associated with this frequency bin of the power spectrum is subsequently stored and optionally multiplied by a coefficient.
(78) Within the power spectrum of the strike buffer of this subsequent strike the magnitudes of all frequencies or frequency bins associated with the frequency range not forming part of the focus area are then normalized proportionally to the stored magnitude value as maximum or limited to this value, which stored magnitude value is optionally multiplied by a coefficient.
(79) U.S. Pat. No. 8,502,060 B2 describes a tone selection method which is based on the selection of a maximum magnitude peak within a delimited frequency range with a bandwidth smaller than the overall discerned spectrum and which has an upper limit frequency and a lower limit frequency. In a possible embodiment this frequency range or this frequency band is the same as the frequency band set with the passband filter.
(80) The focus mode as described in the present invention conversely makes use of a tone selection method which is adapted to the specific magnitude manipulation operation of the focus mode.
(81) In a preferred embodiment a tone analysis or tone selection method is applied for tuning purposes wherein a search is made for a suitable frequency bin within the whole discerned spectrum of a strike buffer or a part of a strike buffer over the whole bandwidth of a magnitude-manipulated power spectrum. This bin can then be selected and further processing of at least the suitable frequency bin can be added as additional step. An example of an additional step can be: rounding off this value or calculating a spectral centroid frequency which is more preferably rounded off to a multiple of 0.1 Hz. A value related hereto is then regarded as detected tone and can be displayed via the user interface or stored or used for further processing.
(82) In a preferred embodiment of a method or apparatus according to my invention a search is made within the overall bandwidth range of the discerned spectrum within the strike buffer for a magnitude peak, a frequency of which is calculated and which is deemed as detected frequency. This is different from the method or the apparatus as described in U.S. Pat. No. 8,502,060 B2, wherein only a delimited part thereof is searched for a peak value.
(83) A more advanced focus mode consists via a further extended method of still further delimiting the focus area with magnitude threshold values and searching for magnitude peaks falling within or outside these peak values, and a search need be made not for a maximum peak but for a peak which falls within or outside the threshold values but does not correspond to a maximum peak.
(84) In the simple focus mode a magnitude passband is preferably also defined with lower and/or upper limit values. Selection or display of frequencies or frequency ranges lying outside the magnitude passband can thus be avoided during selection of a suitable magnitude peak. It is also possible to employ only one threshold value or employ just, or more than, two threshold values so as to delimit the magnitude ranges as desired, for instance in accordance with the signal content and/or in accordance with the tone analysis or peak selection requirements.
(85) In a further preferred embodiment determining of the focus area takes place on the basis of an assumed, known, inputted or detected location of the fundamental tone of a drum. The focus area is thus related to the fundamental tone of a drum. This focus area can be redefined here in adaptive manner when the fundamental tone of a drum changes. The fundamental tone can fall within the focus area, but needs not do so.
(86) In similar manner to the above focus methods, focus mode variants are also possible wherein a magnitudes are inverted and wherein a minimum peak is searched for or wherein the symbol is unimportant, but wherein a search is made for a peak with a determined deviation relative to a determined value or wherein a search is made in only a determined range of the overall discerned spectrum in the strike buffer for a suitable peak which lies for instance at a determined interval from a detected fundamental tone, as already described at length in this text.
(87) It is also possible to increase the magnitudes of the frequencies or frequency bins within the focus area such that they exceed a magnitude threshold value which is for instance set such that it lies above the maximum magnitude value measured in the power spectrum outside the focus area, so that during magnitude peak detection the maximum value within the focus area is detected as maximum peak value. It is likewise possible to decrease the magnitudes of the frequencies or frequency bins within the focus area such that they fall below a magnitude threshold value which is for instance set such that it lies below the minimum magnitude value of a frequency bin situated in the power spectrum outside the focus area, so that during magnitude peak detection below a determined maximum magnitude threshold value the maximum magnitude value within the focus area is detected as maximum magnitude peak value.
(88) All magnitude manipulation techniques which have the purpose of changing the mutual ratios of the loudness of the respective frequencies and/or of the magnitudes of the frequency bins in a power spectrum of a strike buffer fall within this invention.
(89) These frequencies or frequency bins can comprise the whole discerned spectrum or only a part thereof, irrespective of whether these frequencies or frequency bins fall within a determined passband or a determined focus area or fall just outside it. Magnitude manipulation techniques, whereby a magnitude deviation or a magnitude ratio difference results or is created between the frequency bins which lie within a focus area and those which fall outside a focus area, so that determined frequency bins become more easily detectable via an algorithm such as a tone analysis method or a pitch detection method for tuning purposes, do of course fall within this invention.
(90) Many alternative combinations and magnitude manipulation techniques are of course possible which are not all listed in this text.
(91) All manipulations in the frequency domain of the frequency content of a microphone or vibration sensor signal or a signal buffer used for tone analysis for tuning purposes, or of the magnitudes of frequency bins in a power spectrum thereof, whereby their relative magnitude ratio is changed, and without frequencies being wholly removed from the signal, fall within the tuning method as discussed in this invention. These manipulations preferably take place in the frequency domain. They can however also take place in the time domain.
(92) When the focus mode is activated the apparatus preferably shows via the user interface for each subsequent strike a value which is related to a detected tone, as well as the difference between this detected tone and a target tone.
(93) Variants wherein the separate functional parts are split up into separate devices are also included in this invention.
(94) It is possible in this respect to have an embodiment with a separate first device which is for instance provided with a signal input for receiving the signal from a vibration sensor or microphone part and/or wherein said vibration sensor or microphone part is integrated directly into the device, wherein the first device records an input signal and/or strike buffers and which can for instance be equipped with a clamp for mounting on an instrument or component thereof or on a stand optionally in the vicinity thereof. This first device then passes the recorded signals to a second device for processing thereof in accordance with the steps of the method described in this invention, or this first device itself processes the signals in accordance with the steps of the method described in this invention and sends a result of the processing to a second device which shows a value related to this processing via a user interface. An example hereof can be an application on a smart peripheral, software program or a piece of code installed on a computer, laptop, notebook, PDA, pad, tablet; smart phone or a smart watch or successors thereof as second device which receives data from at least one first device and processes and/or shows the data via the user interface.
(95) In a further preferred embodiment the apparatus can also be equipped for the purpose, within a drum kit assembled by the user by creating a set of a determined number of individual drums, of calculating for all individual drums thereof a fundamental target tone on the basis of an interval which is defined by the user and which can be individually set between at least two individual drums of this drum kit, wherein a reference drum is also determined within this drum kit which has a target tone or which is assigned and against which this interval is expressed.
(96) In this way a frequency is more preferably determined per individual skin of the drums for the ideal first overtone thereof based on multiplying the calculated, detected, inputted or selected fundamental tones by determined coefficients which are for instance determined empirically and which on the one hand can optionally also be selected by the user on the basis of indicating a preferred setting via the user interface or which can on the other be loaded via a predetermined ‘target tone, coefficient or preferred setting preset’ or a combination of at least two hereof, which can for instance be purchased or downloaded.
(97) Different types of coefficient can for instance be related to different types of drum skins and be stored in for instance ‘presets’ which can be retrieved by the user for further processing, for instance via the user interface of the apparatus.
(98) The user can in this way indicate which specific type of drum skin is being tuned, whereby a target tone can be calculated, or target tones can be calculated, on the basis of a coefficient which is for instance related to the specific type of drum skin or to determined physical properties thereof.
(99) The calculated target tones are more preferably stored per drum and used to calculate the difference from a detected tone.
(100) At least one of the following data is then shown here as feedback to the user via the user interface: the detected tone, the difference between the detected tone and the target tone, the target tone.
(101) A maximum of two of the following data are more preferably shown as feedback to the user via the user interface: the detected tone, the difference between the detected tone and the target tone, the target tone.
(102) In yet another preferred setting the tuning apparatus or the tuning application is combined with a sales device which is provided with a shop part which is equipped to show and/or sell digital and/or physical products or services, and which products or services can be ordered or purchased by the user via the user interface of the tuning apparatus or tuning application, wherein these products or services are preferably related to musical instruments, sound effects, sound databases, accessories and prerequisites for making music, creating, recording, storing or processing sound or prerequisites for maintaining musical instruments.
(103) In a further preferred embodiment the user can indicate one of the following data per drum via the interface: the brand and/or type of the instrument, the brand and/or type of at least one of the one or more drum skins which have been mounted or are desirably to be mounted, the brand and/or type of damping which has been mounted or is desirably to be mounted, which components of tensioning rings and the like have been used, wherein a visualization such as an image of the indicated data is preferably also shown via the user interface. This allows at least partial virtual configuration of an instrument, wherein at least partial visualization takes place. This visualization or this configuration is preferably linked in its content to the sales device provided in the tuning apparatus or the tuning application and/or to an external sales device such as for instance a web shop.
(104) The user can more preferably log into the tuning apparatus or the tuning application with a profile linked to his/her personal entity. Personal preferred settings and preferred tunings and target tones can hereby be saved and loaded externally and different users can have their own account linked to their profile, wherein the same tuning apparatus of the same tuning application can load and/or display different personal preferred settings and preferred tunings depending on who is logged in.
(105) The configuration data and/or preferred settings are preferably stored and managed in or outside the tuning apparatus or the tuning application for further processing. Transfer of the configuration data is possible via data transfer which can take place in wired or wireless manner.
(106) In a preferred embodiment of the apparatus or tuning method according to this invention the target tone of the individual skins calculated on the basis of a coefficient or coefficients is not displayed. During tuning of the skin two data are then displayed as feedback via the user interface, these preferably being the detected tone on the one hand and the difference between this detected tone and the calculated target tone on the other.
(107)
(108) Like substantially all instruments, drums 1 provided with a tensioning system can be tuned. The sound, including the timbre, the pitch, the reverberation duration and so on can be adjusted by tuning. A drum 1 is tuned by changing the tension of skin 4. The tension of skin 4 relates to the force with which skin 4 is tensioned over rim 3 as well as to the uniformity of the tension distribution along the periphery of rim 3. While the absolute tension of skin 4 over rim 3 substantially determines the pitch of the drum, the uniformity will mainly determine the timbre and resonance of the drum. Tuning a drum 1 in order to obtain an optimal sound is difficult, particularly for an inexperienced user. Skin 4 is typically tensioned over rim 3 of drum 1 such that rim 3 comprises a plurality of segments and wherein skin 4 can be tensioned or slackened in each of the segments by a user. A uniform tuning or uniform tension is obtained when the tension distribution close to rim 3 is the same, or approximately the same, in each of the segments. The uniformity of the tension relates to the uniformity of the distributing thereof around the periphery of the skin. A uniform tension provides for a balanced timbre across the reverberation duration or resonance of a strike on the drum.
(109) A uniform tension is deemed as the tension of the skin at which all separate vibration frequencies of the skin, such as are present for instance as first overtone, are identical to each other or substantially identical to each other per respective rim strike close to the individual tuning control means 8a-8h.
(110) In the example of
(111) When a drum skin is tapped the skin vibrates. This vibration of the skin can be detected by the vibration sensors and thus generates or influences a sensor signal which is recorded by a signal acquisition setting suitable for this purpose and which can be deemed a sound fragment, which can for instance be a signal such as an analog wave form.
(112) An analysis of the signal content of this wave form allows, among other things, examination of the spectral components present therein for tuning purposes. For this purpose the signal content has to be converted from the time domain to the frequency domain. Diverse suitable methods and algorithms known to the experienced skilled person exist for this purpose. Examples of suitable conversion methods or algorithms are, among others: algorithms of the Fourier Transformation family, such as a Fast Fourier Transformation (FFT); a Discrete Fourier Transformation (DFT); a Sparse Fourier Transformation (SFT); or a Short-Time Fourier Transformation (STFT); a Discrete Cosine Transformation or Discreet Sine Transformation (DCT) or (DST), also Fast and Discrete transformation methods forming part of the Hartley family, such as for instance FHT or DHT, fall within the possibilities; Fast and Discrete transformation methods such as the Laplace transformation, or transformations forming part of the wavelet transformation family can likewise be suitable, including for instance FWT and DWT. The invention is not however limited to these methods. Multiresolution analysis (MRA) and multiscale approximation (MSA), McAulay-Quatieri Analysis (MQ); Karhunen-Loève Transform (KLT); and also Autoregressive Spectral Analysis (AR); and so on are likewise examples of methods enabling a conversion of the signal content from the time domain to the frequency domain or tone analysis. This list is not limitative.
(113) Following conversion of the signal content from the time domain to the frequency domain it is generally possible to obtain for instance an energy spectrum, a power spectrum or a magnitude spectrum, optionally after conditioning of the signal, filtering, windowing thereof in the time domain or in the frequency domain, from which information can be derived relating to inter alia the frequency, the magnitude, the phase of the signal as well as the energetic flux, the distribution of the spectral content, the location of the spectral centroid, the relative location of the partials and their relative magnitude ratio, and so forth. When multiple sound fragments are thus considered in a determined time period, the variations in said information types can also be considered and compared over the course of this time period. A spectral envelope can in this way be obtained which can express for instance the timbre of a strike or an instrument, whereby a picture can for instance also be formed of the dynamic progression thereof. The thus obtained data can be utilized to instruct the user about the tuning of his/her instrument and how best to adjust it.
(114) Analysis of the spectral content of a sound fragment over a time period at the beginning of a strike on the one hand and over a time period at the end of a strike on the other gives an indication of the magnitude distribution of the partials thereof over time, wherein the first partial is the fundamental tone and the second partial corresponds to the first overtone thereof.
(115) Comparing the information obtained from both fragments gives an indication of the frequency bands within which the fundamental tone and the first overtone thereof are situated.
(116) As known to the skilled person, a Short Term Fourier Transform (STFT), among others, is typically suitable for determining the dynamic progression of the spectral content over a considered time period for the purpose of time resolution, and methods such as DCT, FST, DFT or FFT are typically suitable for analyses in which the time resolution is less important than the frequency resolution, although as stated above many other methods are suitable.
(117) Tests have shown that the ratio between the amplitudes of the available partials, such as the ratio between the amplitude of the fundamental tone and the amplitude of the first overtone, is different at the beginning of a sound fragment comprising the whole duration of the resonance of a strike than at the end thereof. In the case of a drum with two skins the fundamental tone typically has a more prominent presence compared to the amplitude of the first overtone at the beginning of a strike than at the end of this same strike. This is because when a skin vibrates the vibration mode of the fundamental tone retains energy for a shorter time compared to the vibration mode of the first overtone because the vibration mode of the fundamental tone produces sound in a more efficient manner. Further tests have moreover indicated here that in a microphone sound fragment of a drum stroke, typically the amplitude peaks present in the frequency range lying between the fundamental tone and the first overtone thereof are noticeably less pronounced compared to the fundamental tone and the first overtone thereof than the amplitude peaks present in the area following the first overtone, so the range in which the overtones of a higher order are situated. This is because, the higher the overtones are in the frequency spectrum, the closer together they are.
(118) This insight allows a further refinement of the tuning method of this invention so that the filter can be determined in an even more robust manner.
(119) In the case of a center strike an indication of the location of the first overtone frequency range can thus preferably be obtained by analysis in the frequency domain of a final fragment or part thereof over time, while a fundamental tone frequency range is preferably determined by analysis in the frequency domain of a first fragment or part thereof over time. Analysis of the frequency content of a sound fragment from a strike on a specific drum in the time domain enables the filter to be adjusted on the basis of a predetermined algorithm which also takes into account the thus determined fundamental tone frequency range without the exact fundamental tone frequency within this determined fundamental tone frequency range being known.
(120) The filter is in this way adjusted in an adaptive manner on the basis of a predetermined algorithm, here likewise taking account of the spectral content of a center strike, whereby for each further strike on the same drum the filter can be applied with increased operational certainty. The filter is thus adjusted adaptively to a specific drum with determined tuning.
(121) By verifying the location of the fundamental tone within a determined fundamental tone frequency band in the sound fragment of a further strike, wherein the location of the fundamental tone in this further strike is compared to the location thereof as previously determined during a first strike, the pass frequency of the filter can be modified adaptively when the position of the fundamental tone shifts as a result of the skin being retuned without another center strike being necessary for this purpose. This verification and filter calibration step is preferably applied at each further strike and has the advantage that the filter adjustment is adaptive to the operation of tuning. This improves the robustness of the filter, since the adjustment thereof is calibrated during the course of the tuning process according to the steps of the method of the invention.
(122) It is alternatively also possible to analyze the sound fragment in the time domain in order to obtain determined frequency information, optionally after conditioning, filtering, smoothing of the signal and so on. By measuring the duration of the first cycle of the wave form in the time domain the period of the most dominant frequency in the sound fragment can for instance be estimated in order to thus obtain an indication about the frequency thereof. While this method does not result in the accurate determination of the fundamental tone frequency in the case of a central strike, and so cannot be used for accurate tuning purposes, this method does however provide the option of determining a frequency range within which the fundamental tone is probably located. This knowledge can then be used in the detection of the fundamental tone frequency in the sound fragment. It is for instance alternatively possible in the time domain to count the number of peaks or count zero point crossovers of the waveform within this sound fragment of a detected strike within a determined time period in order to obtain an approximate indication of the most dominant frequency present in the specific sound fragment during the time period under consideration.
(123) A fundamental tone frequency range obtained in this way can be situated around the frequency obtained from analysis of a first fragment of a center strike in the time domain. Allowance is made here in the determination of the width of the fundamental tone frequency range for a certain degree of inaccuracy which is characteristic of the frequency determination methods in the time domain applied for a strike on a drum. In a sound fragment of an undamped center strike the fundamental tone frequency is however typically the most dominant frequency in the frequency spectrum. Particularly in the case of a center strike this method can result in a sufficiently accurate indication of a fundamental tone frequency range within which the fundamental tone is probably located, in order for instance to enable the filter setting to be determined on the basis of the thus found fundamental tone frequency range or a thus determined fundamental tone frequency. In general terms an analysis of the sound fragment in the time domain in the manner as described above allows the approximate frequency of the fundamental tone to be known, and thus at least an indication of the fundamental tone frequency range to be obtained within which the fundamental tone is probably situated, so that the filter setting for the overtone can be determined at least on this basis. According to the method of the invention, for the step in which the determination of a fundamental tone takes place, the conversion of the time signal to the frequency domain can in this respect also be interpreted as a step in which at least a fundamental tone frequency range is determined in the time domain. A fundamental tone frequency range or a fundamental tone frequency can thus be determined here on the basis of analyzing the sound fragment of a strike in the time domain, and this range can be used according to the method of this invention to determine an overtone frequency range of a determined overtone as pass frequency range of a filter within which the determined overtone can be detected.
(124) For this purpose a modified preprocessing step or conditioning step of the signal content is preferably performed wherein for instance high or other superfluous frequency content in the signal is filtered out and/or wherein the signal is smoothed, in order to obtain a more reliable indication of a fundamental tone frequency range. Smoothing takes place by way of example by applying a convolution-based filter function, such as a Savitszky-Golay filter, because this technique does not distort the overtones and fundamental tone in disruptive manner for the purpose of determination thereof on the basis of the smoothed signal. An overtone filter setting can subsequently be determined in the same manner according to the invention on the basis of the fundamental tone frequency range determined in the time domain or the fundamental tone frequency determined in the time domain, whereby at each further strike a predetermined overtone is detectable within the pass range of the thus determined filter.
(125) For a more precise determination of the fundamental tone frequency of a strike on a drum the frequency domain can for instance be searched for instance for a suitable spectral peak in order to determine a fundamental tone frequency, although other tone determining methods are also suitable for this purpose. Irrespective of whether the fundamental tone is determined in a sound fragment in the time domain or in the frequency domain, a pass frequency range can be set on the basis of a determined fundamental tone frequency or fundamental tone frequency range in accordance with the method of this invention.
(126) The invention is based on the insight, among others, that a center strike and an edge strike on skin 4 of drum 1 comprise different information, as will be further elucidated below, which different information can be correlated to each other during tuning. The information content of a center strike or an edge strike is also different over the reverberation duration thereof, this also providing for further correlation options. A center strike on skin 4 of drum 1 is defined as a strike on the central zone of the skin, designated in the figure with reference numeral 6. Central zone 6 can further be specified here as the circular zone with the center of skin 4 as center point, wherein the circular zone has a radius which is half the average radius of the opening with rim 3 over which skin 4 is tensioned. An edge strike is defined as a strike close to rim 3. A strike close to rim 3 can further be specified as a strike outside central zone 6 as defined above. An edge strike is preferably specified as a strike within the zone 11, wherein the radius is about 5 cm less than the average radius of the opening with rim 3. Typical of an edge strike is that a segment of rim 3 can in each case be designated to which the edge strike is most closely adjacent. In the figure the designations 7a, 7b, . . . , 7h are illustrative of zones of edge strikes adjacent in the example of
(127) In the case of a drum 1 with a plurality of skins the lower skin is preferably not damped at the position of lower rim 5 during a center strike, while the lower skin is damped at the position of second rim 5 during an edge strike. Damping of the lower skin at the position of rim 5 is defined here as mechanically preventing vibration of the lower skin and/or the underlying air mass at the position of second rim 5. This is possible for instance by pressing a hand of the user against the skin, placing the instrument on a surface whereby the free movement of the air mass close to the skin is prevented or by laying drum 1 on a soft object such as a cushion when the second skin must be damped at the position of rim 5. By not damping the second skin during the center strike and damping the second skin during an edge strike the information from the respective center strike and edge strike will be less complex and more easily processable for use in the method described below. Notwithstanding that damping of a skin during an edge strike will be more easily processable for use purposes, the tuning method as described in this text is specifically suitable for successful analysis of the first overtone during an edge strike without any damping of the second skin, since the filter as determined on the basis of a first sound fragment of a center strike makes it possible to successfully determine the first overtones of the skins during a second edge strike without skins having to be damped for this purpose.
(128) In a sound fragment of an undamped center strike the most dominant frequency is typically the fundamental tone frequency. An analysis of the sound fragment in the time domain as described above allows the frequency of the fundamental tone to be approximately known in order to thus obtain an indication of the frequency range within which the fundamental tone is probably situated.
(129) When the information obtained by analyzing a sound fragment within the time domain is combined with the information obtained by analyzing the same sound fragment within the frequency domain, areas can be delimited in a robust manner within which it is highly probably necessary to search for a determined fundamental tone or a determined overtone, such as for instance the first overtone.
(130) The precise location of the fundamental tone and the first overtone thereof within the same sound fragment, or within different sound fragments of strikes on a skin of the same drum, can hereby be determined with greater certainty without these having to be the most dominant frequencies within the considered fragment. This allows accurate detection of the first overtone and the fundamental tone without these having to be the greatest peak within the magnitude spectrum.
(131) The method and the device or apparatus according to the invention preferably comprise a user interface which gives instructions to the user about respectively center strike and edge strike when these are requested during performing of the method. When the method requires a center strike as input, the user interface can thus give the user instructions for performing a center strike, wherein the instructions can relate to the location where the user must tap on skin 4 as well as to not damping the lower skin at the position of second rim 5. When the method requires an edge strike, the method can also comprise of instructing a user via a user interface about the position where the user must tap on skin 4 as well as about damping the lower skin at the position of second rim 5. By giving these instructions to the user via the user interface even an inexperienced user will be capable of optimum tuning of a drum, and the susceptibility to error of the method described below will be minimized. In a preferred embodiment the latter instruction is not essential here. Notwithstanding the fact that the robustness of the operation can be optimized still further by the damping, damping of a skin will often be perceived by an experienced user as being inconvenient or impractical because this operation requires more effort and makes the tuning process more time-consuming. In an alternative preferred embodiment aimed at more experienced users, showing this latter instruction is therefore not essential. Not having to damp a skin thus results in an increased user convenience during tuning.
(132) The part of the user interface which provides the user with instructions as described above, and which possibly also supplies other information and feedback, is deemed the information output part of the user interface. It will be apparent here that it is possible to inform the user in different ways. Via for instance a display the user can be further informed by means of, among others, digits, numbers, letters, words, symbols, pictograms, color variations and so forth about the tension of the skin and/or the hardness of a strike. LEDs, for instance in multiple colors or at multiple positions, can alternatively be used to inform the user about the tension of the skin and/or the hardness of a strike. As further alternative a sound signal can be used to give the user information relating for instance to the detected pitch and/or the hardness of a detected strike. The manner in which the user is informed is not limited according to this invention to the above examples.
(133) According to the invention the user interface preferably also comprises an information input part which is equipped with provisions with which a user can manipulate settings of the device or the apparatus, such as for instance controllers, bottoms, a touchscreen, switches, controls and so forth. Via the information input part of the user interface the user can him/herself indicate, as alternative to the above description in which the interface automatically indicates to the user which type of strike is required, whether he or she wishes to give an edge strike or a center strike on the skin, wherein the associated steps of the method can be correctly performed. Via the information input part of the interface a user can for instance further also indicate, among other things, whether a determined target overtone is desired, select or input a tone, indicate whether a determined display mode is desired, set variables, retrieve a determined user setting, retrieve or disable a determined functionality of the apparatus according to the invention, operate functions, navigate through menus and so on.
(134) Tests have shown that the spectral content of a strike on a drum depends on the hardness of the strike, wherein the frequency of for instance the fundamental tone varies with the strike hardness. The same tests have also shown that the strike hardness can affect the location of the maximum amplitude peak of the fundamental tone or an overtone. It is found here that a drum can better be tuned uniformly when all considered sound fragments are of a similar strike hardness. It is therefore useful for a user to receive feedback about the hardness of a performed strike during performing of the steps according to the method of the invention in order to obtain a uniform tension.
(135) To this end the user, for instance during triggering of a strike, is informed on the basis of the considered sound fragment of the strike or a part thereof about the strike hardness of the detected strike, wherein an indication of the strike hardness is preferably given via the user interface.
(136) The user is more preferably additionally informed per detected strike about the measured strike hardness or for instance about the difference between the measured strike hardness and a determined target strike hardness which for instance corresponds to an ideal strike hardness. This has the advantage that the user can him/herself modify the strike hardness at each further strike so that a more constant strike hardness of separate strikes on a skin can be obtained so that tuning can take place efficiently and consistently. The strike hardness can be shown in any random manner, such as a dB value, a number, a designation on a scale division and so forth. The quantity is of minor importance here.
(137) The use of velocity values, as is usual in the MIDI protocol, is an example of a suitable way of reproducing and communicating the hardness of a strike in a simple manner. An impact location can for instance also be expressed and communicated on the basis of the MIDI protocol. A sound file related to the MIDI information can be played back here via the information output part of the user interface. Drum emulation software or other sound output functionalities can for instance be controlled in similar manner on the basis of the MIDI information obtained about at least the hardness of a detected strike.
(138)
(139)
(140)
(141)
(142)
(143) Other than in the case of a center strike wherein the overtones typically have a weak presence in the sound fragment, it is however possible in the case of an edge strike that fundamental tone 12 has a strong presence in a sound fragment of the edge strike. Characteristic of a sound fragment of an edge strike is that the overtones usually have a more prominent presents relative to the fundamental tone. It is however possible here that the first overtone does not have such a dominant presence that it has the greatest amplitude peak in the frequency spectrum. In practice either the first overtone 21 or an overtone 22 of a higher order, or even fundamental tone 12, can have a dominant presence in the spectrum of a sound fragment of an edge strike wherein none of the skins are damped.
(144) Tests have shown that the tuning of drum takes place best on the basis of first overtone 21. Recent studies relating to the frequencies of sound fragments of center strikes 10 and edge strikes 11 of drums have made clear that the frequencies of the ideal first overtone can be calculated on the basis of the frequency of fundamental tone 12.
(145) The method according to the invention therefore comprises of first determining the fundamental tone frequency 14 and the fundamental tone amplitude 15 following a center strike. On the basis of this fundamental tone frequency 14 and the fundamental tone amplitude 15 a calculation is then made by means of a predetermined algorithm of the frequency range of first overtone 21, and the overtone amplitude range, which has a determined amplitude range 18, 19 within which the amplitude 42 of this first overtone 21 is situated. The method likewise comprises of placing a filter with a pass frequency band between 16, 17 comprising the calculated first overtone frequency range which is most likely to comprise first overtone 21. In
(146) The fundamental tone frequency 14 is determined for instance on the basis of a spectral centroid of a limited frequency band comprising the greatest amplitude peak of fundamental tone 12.
(147) Following the center strike a filter will be placed at each edge strike in order to detect first overtone 21 within the pass frequency band thereof. The filter preferably comprises the pass frequency band filter and a filter for delimiting the amplitude range.
(148) The frequency of first overtone 41 detected in area 20 after an edge strike 11 is compared to the calculated overtone frequency which is based on the fundamental tone frequency 14 detected during a center strike 20. When the detected first overtone frequency 41 is lower than the calculated first overtone frequency, the user will be informed via the user interface that skin 4 must be tensioned at the position of the associated edge strike. When the detected first overtone frequency 41 is higher than the calculated overtone frequency, the user will be informed via the user interface that skin 4 must be slackened at the position of the edge strike. When the detected frequency 41 of the first overtone is roughly the same as the calculated first overtone frequency, the user can be informed that the tension of the skin at the position of the edge strike is optimal. Via a display the user can be informed by means of words and/or pictograms about the tension of the skin. LEDs, for instance in multiple colors or at multiple positions, can alternatively be used to inform the user about the tension of the skin. As further alternative a sound signal can be used to inform the user. First overtone frequency 41 is preferably determined on the basis of a spectral centroid of a limited frequency band comprising the maximum amplitude peak of first overtone 21. Other methods are also suitable for this purpose.
(149)
(150) A trigger method 24 has the purpose of detecting a strike within the sensor signal from sound sensor 23. Multiple amplitude threshold values, for instance related to the spectral flux, energetic flux or the signal strength within multiple frequency ranges or frequency bands, can alternatively be employed to detect a strike on the basis of a trigger method 24. An amplitude threshold value is preferably scaled in proportion to a considered ambient sound level. This scaling or adjustment can take place in a calibration step, for instance at the beginning of the tuning process. The advantage of adjusting the amplitude threshold value or values in relation to a considered ambient sound level, wherein the set threshold value or values is or are typically higher than an average amplitude value of the ambient sound over a time period or a peak value thereof, has the advantage of greatly reducing or even precluding the chance of sounds other than those originating from a strike, such as ambient sounds, being deemed as a strike by trigger method 24.
(151) The duration of the recording as performed in block 25 can for instance on the one hand be determined beforehand on the basis of a duration setting which defines a chosen time period or on the other hand depend on the amplitude progression over the reverberation duration of the strike as discerned by trigger method 24. Trigger method 24 can for this purpose for instance determine that the recording of a sound fragment in block 25 begins when an amplitude level in the time domain, or the energy level in the frequency domain over a time period, rises above a threshold value. Trigger method 24 can then for instance determine that the recording of a sound fragment in block 25 ends when an amplitude level or energy level falls below a threshold value. There is hereby a maximum probability of the whole duration of the strike being recorded in the sound fragment, and the spectral content of the sound fragment is related as closely as possible to the considered strike. When a predetermined duration setting is employed, it could be that the defined time period is too short to be able to record the whole reverberation duration of a strike, so that perhaps insufficient information is recorded if it is too long, and it is possible that ambient sound brings about a disruptive distortion of the spectral content of the sound fragment.
(152) A preferred embodiment of trigger method 24 can further also comprise a step for determining the hardness of a strike. This could take place by way of example on the basis of a maximum amplitude peak which is detected in the time domain or within a determined frequency range thereof. The amount of spectral energy can be measured in other manner in order to determine the strike hardness in the frequency domain. The determination of the strike hardness can alternatively take place on the basis of the information available in the sound fragment, or a part thereof, recorded in step 25 in the time domain or frequency domain. It is further of minor importance according to the method of this invention which technique or method is used to determine the hardness of a strike.
(153) In yet another preferred embodiment trigger method 24 can likewise comprise a step for determining the impact location of a strike. This can take place by way of example on the basis of the distribution and the progression of the spectral content detected in the frequency domain over a determined time period. The spectral content could be considered over the whole spectrum or within a determined frequency range thereof. Acoustic envelopes can also be utilized in the frequency and/or the time domain which define acoustic characteristics of strikes related to determined impact locations. One or more acoustic envelopes can for instance be utilized which are each related to their own frequency range in order to obtain from their content an acoustic signature which comprises the acoustic characteristics of a determined strike which is for instance related to an impact location on a determined drum. These acoustic signatures are preferably stored per impact location and per drum. During triggering in step 24 the spectral information and the acoustic characteristics of a detected strike can hereby be compared to these stored acoustic signatures in order to check with which stored acoustic signature the acoustic characteristics of the detected strike sufficiently correspond to be able to decide where the impact location of the strike is. These acoustic envelopes can be determined in a calibration step on the basis of calibration strikes at different impact locations, so that per impact location an acoustic signature is obtained which can be stored and which for instance defines relevant spectral content, acoustic envelopes and the other acoustic characteristics of for instance an edge strike, a center strike, a kettle strike, a hoop strike and so forth on a determined drum with a determined tuning. By comparing the acoustic characteristics of a further detected strike to the stored envelopes obtained from the calibration strikes it is hereby possible to determine whether the further strike is for instance an edge strike, a center strike, a kettle strike, a hoop strike and so forth on a determined drum. A determined information output, such as a visual indication of the impact location on a symbolic representation of a skin or a drum, playback of a sound related thereto and so on, can be coupled via the user interface to the detected strike location. The user can also be informed about the consistency of the location of different strikes on a skin for practice purposes or tuning purposes and so forth.
(154) When vibration sensor 23 comprises a plurality of sensors, such as for instance at least one microphone and a piezo-transducer, it is possible to determine in trigger method 24 by means of time difference of arrival of the individual sensor signals what the impact location of a detected strike is, optionally combined with the detection of acoustic signatures. The sensor signal of the piezo-transducer can for instance also be used to detect an onset event and/or the strike hardness prior to the consideration of the sensor signals from the microphone or microphones in order to determine the impact location and/or strike hardness. It is further of minor importance according to the method of this invention which technique or method is used to determine the impact location of a strike.
(155) The use of channel values, as is usual in the MIDI protocol, is an example of a suitable way of reproducing and communicating the impact location of a strike in a simple manner. Each impact location is then assigned its own MIDI channel. A sound file related to the MIDI channel value can be played back here via the information output part of the user interface. Drum emulation software or other sound output functionalities can for instance be controlled in similar manner on the basis of the MIDI information obtained about at least the hardness of a detected strike.
(156) As further alternative the sensor signal from microphone 23 can be used to distort a sound via spectral modelling techniques.
(157) As sound recording device 23 a microphone can on the one hand be used, although other types of vibration sensor can on the other hand also be used, such as for instance vibration sensors which are arranged physically on skin 4 of drum 1 and can generate or influence an electrical signal when drum 4 is played. In this respect the following sensor types can be regarded as vibration sensors 23 in this invention, without being limited thereto: optomechanical sensors, optical sensors, mechanical distance meters, acceleration sensors, inductive sensors, transducers, capacitive sensors and so on. Likewise included here as vibration sensor 23 are sensors which are indirectly in mechanical contact via a medium with skin 4, such as piezo-transducers which are mechanically connected to the skin or the instrument via a vibration-absorbing material, such as for instance a foam, elastomer, rubber or felt, or sensors which are in direct mechanical contact with skin 4 or the instrument, such as piezo-transducers, electret transducers, PVF film, accelerometers, MEMS sensors, contact microphones. Contactless recording devices such as for instance optical sensors, such as laser vibrometers, IR sensors, NIR sensors, which are not mechanically connected to skin 4, are also deemed to be a sound recording device 23 according to the method of this invention. The use of optical sensor types as vibration sensor 23 has the advantage that triggering on the basis of a strike is not influenced, or less so, by ambient sound and that ambient sound is likewise not present, or less so, in the sound fragment obtained from the sensor signal from such a vibration sense 23. Applications of HALL sensors or capacitive sensors, wherein only a part of the sensor is in contact with skin 4, are likewise included in the invention. More specifically, applications wherein only a part of a sensor or sensors is in direct contact with or arranged on skin 4, whereby the relevant sensor part or sensor parts influences or influence the sensor signal statically or dynamically when skin 4 moves, such as for instance an electrically conductive layer which functions as capacitor plate which is arranged on the skin and vibrates relative to another capacitor plate or coil arranged elsewhere, fall within the invention and are deemed as vibration sensors 23 within the context of the invention. Likewise included here as vibration sensor 23 according to the invention are sensors arranged physically on skin 4, such as for instance: laminated sensors, transferred sensors, adhered sensors, welded sensors and so on.
(158) Also regarded as vibration sensors 23, sometimes also referred to as sound recording device 23, are sensors which are arranged directly on a layer of a skin 4, such as: laminated, coated or printed sensors, including: inductive sensors, magnetic sensors, piezo-electric sensors, piezo-resistive sensors, resistive sensors, capacitive sensors, strain sensors such as strain gauges, interdigital capacitors or plate capacitors and so on. Examples of these types of sensor are described in PCT application (Pub. NO.: WO 2012/122608 A1) as shown in
(159) A fragment of the signal from vibration sensors 23, the ‘microphone signal’, is sometimes referred to in this text as ‘sound fragment’. It will be apparent to a skilled person that there is a wide variety of vibration sensors 23 which can generate and/or influence a signal in relation to a movement in or a vibration of a skin 4, and which are consequently suitable for recording a sound fragment. The thus influenced or generated sensor signal is further not necessarily limited to the sound actually generated or discernible to us which results from vibration of skin 4, nor is it limited to a wholly faithful reproduction thereof. A microphone is known to be able to record a sound fragment correctly over a notably large frequency range.
(160) Via the user interface of the user a center strike is preferably requested, or alternatively the user indicates that he/she wishes to perform a center strike, and it is therefore assumed that the strike detected in step 24 is a center strike. Following recording of a first sound fragment in step 25, the whole sound fragment is preferably analyzed in step 27 for the purpose of determining the fundamental tone amplitude 15 of the fundamental tone frequency 14.
(161) Depending on the trigger setting in step 24 and recording setting in step 25, the sound fragment may comprise the whole resonance or reverberation duration of a strike. Only a part of the sound fragment can also be analyzed for this purpose, in which case preferably a first part thereof in time, in order to determine herein the location and the amplitude of the fundamental tone frequency range or of the fundamental tone, and wherein in the shortest possible time period following the strike an accurate determination thereof is performed in step 27. It is also possible in a second time segment of the sound fragment, for instance when the amplitude of the signal has fallen below a determined level of the measured maximum amplitude, to determine the position of fundamental tone 14 and a specific overtone thereof. This is based on the insight that over the whole resonance or reverberation duration of a strike the overtones have a more pronounced presence relative to fundamental tone 14 in the frequency spectrum of a strike at the end of a strike than at the beginning thereof.
(162) The location of the first overtone relative to fundamental tone 14 is typically inharmonic, and so typically other than in the case of instruments having a harmonic overtone interval structure, such as for instance stringed instruments. The higher the overtones in the frequency spectrum, the smaller the ratio becomes between the vibration numbers of the overtones, or the intervals between the overtones. In contrast to harmonic instruments, the ratio between the vibration numbers is not an integer in the case of a drum. The ratio between the vibration numbers, also referred to as the intervals between the fundamental tone and overtones, of drums with multiple skins moreover depends on the tension of the individual skins. Since a drum with multiple skins is an acoustically coupled system, the above ratio is moreover not constant but depends on the individual skin tensions and the volumetric properties of the air volume associated with the skins. The vibrating air column, the internal air volume of the drum which is enclosed between the skins of a drum with multiple skins and which is thus acoustically coupled thereto, reduces the intervals between the overtones, thereby decreasing their pitch. The intervals between the overtones and fundamental tone 14 of a drum 1 with two skins 4 typically depend on the tuning of the individual skins 4. The tuning of the individual skins 4 determines the location of their first overtone frequency range relative to fundamental tone 14 of drum 1. On the basis of a fundamental tone frequency 14 measured in step 27 of a sound fragment of a first strike on a skin 4 of drum 1 recorded in step 25, a predetermined algorithm allows determination of separate first overtone frequency ranges for the individual skins 4 of drum 1 within which the first overtone of the individual skins 4 is most probably situated. A filter can hereby be adjusted in step 28, whereby during consideration of each further edge strike on a skin 4 of drum 1 the first overtone can be determined with great certainty in step 32. During the calculation the predetermined algorithm takes into account a non-constant ratio between the vibration numbers of the overtones.
(163) When in step 25 a sound fragment has been recorded, this sound fragment is converted in step 26 from the time domain to the frequency domain. In the case of a center strike the method will continue after step 26 with step 27, the situation of a center strike being indicated here in the Figure by arrow 29. The fundamental tone is detected in step 27. For the detection of the fundamental tone a part of the recorded sound fragment is considered which optionally comprises the whole sound fragment. In particular the fundamental tone frequency 14 and optionally also the fundamental tone amplitude 15 will be determined. In step 28 a filter can then be determined on the basis of the fundamental tone frequency, and preferably the fundamental tone amplitude. The filter determined in step 28 comprises at least a pass frequency band, and preferably also a pass amplitude range. When the filter has been determined in step 28, the method will start again from the beginning, with the difference that, after the filter has been determined in step 28, edge strikes are requested from the user. These are strikes on zones 7 in
(164) An analysis of a second part of a first sound fragment, in which case preferably a later part thereof in time, which optionally wholly or partially comprises the above stated first part thereof, is preferably suitable for a further determination of an area in which the various first overtones of the fundamental tone, which are generated close to the different individual tuning control locations (e.g. the tensioning pegs), can be expected. Information can in this way be obtained during analysis of a first sound fragment of a strike about the fundamental tone as well as information about the anticipated location of the first overtones per tuning control location. This analysis provides the advantage that an algorithm can be employed which, without prior knowledge of the interval between the fundamental tone and the first overtones per tuning control location, determines more robustly and with greater accuracy an area comprising the probable location of the individual overtones generated close to the separate tuning control locations. This makes possible the use of an adaptive analysis algorithm for the first overtone which takes into account the variables such as are present in each individual first sound fragment. The determining of the area of the first overtone can thus be adjusted adaptively in each case to the conditions present per first sound fragment, for instance for the different strikes on different drums and/or on differently tuned drums.
(165) Once steps 24 to 26 have been completed for the edge strike, the method will continue with step 31. This is illustrated by arrow 30 which indicates that the strike is an edge strike. An edge strike is preferably requested via the user interface of the user and it is consequently assumed that the detected strike is an edge strike. The user alternatively indicates via the user interface that he/she wishes to perform an edge strike.
(166) In step 31 the filter is placed such that in step 32 the first overtone can be detected from the sound fragment of the edge strike. In step 33 the detected overtone frequency from step 32 is then compared to the calculated overtone frequency of step 28. On the basis of the comparison 33 the user interface indicates to the user in step 34 whether skin 4 must be tensioned, slackened or is optimal at the location of the edge strike. By analyzing multiple edge strikes along the periphery of the skin in this way a user can tune skin 4 in a simple manner.
(167) The calculated overtone frequency can in this example also be a predetermined target overtone frequency which may or may not be an ideal overtone frequency. When an indication of the tuning is given in step 34, it is likewise possible for a fundamental tone frequency or an overtone frequency or first overtone frequency to be shown here, and wherein a difference as obtained from step 33 is optionally explicitly shown. It is even possible in an alternative embodiment to skip step 33 and that step 34 involves the direct display of a target tone, a fundamental tone frequency or an overtone frequency as for instance determined in step 32.
(168)
(169) The apparatus can comprise further elements 40. Shown in
(170) As further alternative the method as shown in
(171) The apparatus according to the invention can further be applied in a situation in which a fundamental tone is determined beforehand, for instance selected manually by a user or calculated in relation to other fundamental tones within a set, and consequently not measured from a first sound recording. On the basis of this predetermined fundamental tone the filter can then be set so that overtones are more easily detectable, as discussed at length above.
(172)
(173) When the individual sensor signals from the plurality of sensors 54a-54h are processed simultaneously, though separately, for the purpose of performing trigger method 24 and recording step 25, the separate signal content of the plurality of sensors 54a-54h are considered simultaneously for performing the further steps according to the method of this invention.
(174) On the basis of only a single strike on skin 4 information is hereby obtained per sensor 54a-54h about: the fundamental tone of the drum as performed in step 27, the overtones close to the separate tuning control locations as performed in step 32, as well as about the hardness of the strike and the impact location thereof as performed in step 24 and 25.
(175) Determining the filter in step 28 and setting the filter in step 31 take place in this example either individually per sensor 54a-54h on the basis of separate filters with separate settings, or this alternatively takes place collectively for the plurality of sensors 54a-54h on the basis of separate filters with a collective adjustment. According to the method of the invention this allows, per sensor 54a-54h and so per tuning location, the first overtone to be determined in step 32 in a pass frequency range of an individual sound fragment per sensor 54a-54h from the same strike on skin 4.
(176) The information obtained per sensor 54a-54h can then be combined or grouped so that for instance an overall picture of the fundamental tone frequency of skin 4 is obtained or so that for instance a correlated picture of the first overtones from the tuning control locations of tuning control means related to each other, such as tuning control means lying adjacency of or over each other, can be considered for further processing thereof. The sensor signals from multiple skins with sensors 54a-54h of the same drum can also be considered simultaneously in similar manner during the same strike on the drum.
(177)
(178) In order to determine the frequency related to the selected peak it is for instance possible in a preferred embodiment that a rounding-off takes place, or that for instance a spectral centroid around the selected peak is calculated, and that the found spectral centroid is optionally further rounded off to preferably a multiple of 0.1 Hz, prior to an optional display thereof via the user interface as detected tone 55a or as an indication thereof which is related thereto.
(179) Via the user interface a value or indication is thus shown which is related to selected peak 55 or to detected tone 55a, and the user then activates the focus mode via the user interface, whereby the location of selected peak 55, detected tone 55a or a position related thereto is stored as reference R for the purpose of setting a focus area during each subsequent strike. Detected tone 55a or selected peak 55 or the reference R is also stored here as target tone.
(180)
(181)
(182)
(183) Over the whole discerned spectrum of the same subsequent strike, so over all bins of the power spectrum of the strike buffer, or of a part of this strike buffer, a search is then made for a suitable magnitude peak 59 within the determined magnitude range M, which can be a maximum magnitude peak within this determined magnitude range M. This suitable magnitude peak 59 is then detected via an algorithm suitable for this purpose. The detected peak is selected and a frequency related thereto is determined. This detected peak or this frequency related thereto is deemed as detected tone 60.
(184) In order to determine the frequency related to the selected peak it is for instance possible in a preferred embodiment that a rounding-off takes place or that for instance a spectral centroid around the selected peak is calculated, and that the found spectral centroid is optionally further rounded off to preferably a multiple of 0.1 Hz, prior to an optional display thereof via the user interface as detected tone 60 or as an indication thereof which is related thereto.
(185) In yet another preferred embodiment an indication related to a difference between detected tone 60 and a target tone is given here via the user interface, which target tone is for instance the reference R or detected tone 55a from step 1.
(186) It is noted that, following detection of a peak at a further strike, a refining step can be performed each time in order to measure the characteristics of the peak with greater accuracy. A focus mode as described with reference to
(187)
(188) Hereby the type of settings 68, 69, 70, 71 that are applied in steps 23a, 24a, 25a, 26a are determined in a determining step 67, which has at least one of the following determining data 66 as input, also referred to as instrument data 66:
(189) a frequency response curve, for example related to the frequency response of a vibration sensor or microphone, but not limited thereto;
(190) an ambient sound content data, which could be measured, analyzed, recorded, predicted through calculation, or obtained in any other way or by any other manner;
(191) an audio acquisition mode provided by an operating system: for example like OS, Windows, Android, iOS or alike or any successor thereof, but not limited thereto;
(192) a noise canceling mode;
(193) a gain control mode;
(194) an audio acquisition mode with or without integrated signal processing steps;
(195) a voice recognition mode;
(196) a drumhead type;
(197) a type of instrument, for example like: a tom, a floor tom, a snare drum, a kick drum, a conga, a bongo, a tympani, a marching drum, a tambourine, a hand drum, a djembe, a guitar, a string instrument, a saxophone, a wind instrument, a piano, but not limited thereto;
(198) a diameter of a drum;
(199) a depth of a drum;
(200) a volume of a drum;
(201) a brand of a drum;
(202) a series of a drum;
(203) an impact location on a drumhead;
(204) a type of stroke, strike or hit;
(205) a thickness of a drumhead;
(206) a mass of a drumhead;
(207) a type of a drumhead;
(208) a batter head;
(209) a resonant head;
(210) a type of tone like: a fundamental tone, an overtone of a certain order, like the first overtone for example;
(211) a frequency or note related to at least of the following: a fundamental tone, an overtone of a certain order, like the first overtone for example;
(212) a frequency;
(213) a frequency range;
(214) a note;
(215) a note range;
(216) a tone;
(217) a tone range;
(218) This determination performed by determining step 67 is based upon the input of instrument data 66 and at least one of the following:
(219) a calculation;
(220) a logic analysis;
(221) an execution of a logic instruction set;
(222) instructions or information retrieved from a database;
(223) instructions or information retrieved from a look-up table;
(224) instructions or information received from an external source;
(225) instructions or information received via an input like an interface;
(226) or instructions information obtained by any other matter.
(227) In the scope of this invention it is important that the determination performed by determining step 67 and its output is based upon the specific input of instrument data 66.
(228) However, hereby it is not of any further importance how the input instrument data 66 is provided to determining step 67, neither is it of any further importance how the determining step 67 determines which of the following optional steps 23a, 24a, 25a, 26a are executed, and how the determining step 67 determines what type of settings 68, 69, 70, 71 are applied in the steps 23a, 24a, 25a, 26a.
(229) For example in a case when it is required to detect strike on a drum in a setting with much ambient sound that may mask the sound of the drum, or in a case when it is required to detected a tone in a situation wherein the drum generates a lot of overtones that interfere with the correct detection of a desirable tone, like a fundamental tone or a first overtone thereof, the efficiency of the observation of a strike on a drum by a user could be low, and/or the correct detection of a desirable tone could be erratic without the execution of at least one of the following steps 23a, 24a, 25a, 26a.
(230) However, when the method of
(231) For example if ‘a drum type’ is used as instrument data 66, then this drum type is the input of the determining step 67, in which case said step can determine at least one type of settings 68, 69, 70, 71 in such a way that any signal content in the sound fragment belonging a frequency range which is not related to the a typical tuning frequency range of a conga, thus a range that contains the fundamental tone and the first overtone thereof, is removed from the vibration sensor signal and/or sound fragment and/or that preferably any content belonging to the typical tuning frequency range of a conga is amplified.
(232) By removing unwanted signal content from said vibration sensor signal and/or by amplifying desirable signal content in said vibration sensor signal in step 23a, the vibration sensor signal is optimized for a successful detection of a strike on the drum of a given drum type in a noisy environment in step 24.
(233) Also the successful detection of the fundamental tone in step 27, and the successful detection of the overtone tone in step 32 is improved for the given drum type in the given sound environment when with the abovementioned type of settings 68, 69, 70, 71 applied.
(234) Hereby the user is able to tune the drum in a more efficient manner, with less missed strikes, and less erratic tone detections, coming from interference of unwanted signal content like overtones or ambient noise.
(235) In another example the power spectrum is equalized or modified in at least one of the following steps 23a, 24a, 25a, 26a, for example to achieve a flat frequency response in the sensor signal, the sound fragment, its power spectrum or a part thereof, in such a way that it compensates for flaws in the frequency sensitivity of vibration sensor 23, which increases the chance of a correct detection of a strike in step 24, or which increases the chance of a correct detection of a tone in step 27, or 32. Without this correction step of the frequency response curve, the tone detection would be biased by the uneven sensitivity of the vibration sensor throughout the spectrum.
(236)
(237) Each of the steps 23a, 24a, 25a and 26a contain a type of settings 68, 69, 70, 71 which are determined in determining step 67 based upon instrument data 66, as shown in
(238) The following type of settings define the type of action performed during the execution of their related step:
(239) types of conditioning 68 for a signal optimization step 23a;
(240) strike detection parameters and settings 69 for a triggering optimization step 24a;
(241) recording settings 70 for a sound fragment optimization step 25a;
(242) domain conversion parameters and settings 71 for a frequency domain optimization step 26a.
(243) An illustration of the type of settings and their type of action is illustrated in the text below.
(244) Signal optimization step 23a has the purpose to optimize the signal acquired from vibration sensor 23 for successful execution of at least one of the succeeding steps, whereby the input signal coming from vibration sensor 23 is conditioned or in the time domain or in the frequency domain, or in the complex domain, or in a combination thereof, by applying at least one of the following techniques, conditioning settings 68 or types of conditioning 68:
(245) a signal smoothing;
(246) a signal filtering in order to change the frequency content of the signal of one or more frequency bands;
(247) a smoothing of bins of a power spectrum;
(248) a modification of the magnitude of at least one bin of the power spectrum, or of at least one frequency band;
(249) a modification of at least a part of the signal content of the sensor signal in at least one of the following domains: a time domain, a frequency domain, a complex domain, whereby said sensor signal can be in analog or in digital form, and whereby the aforementioned modification of the signal content is one of the following modification types: an amplification, a shelving, an attenuation, a leveling, a normalizing, an equalizing, and whereby this modification type is affecting or whereby these modification types are affecting the full spectrum of the sensor signal or a part thereof, or whereby this modification type is affecting or whereby these modification types are affecting one or more frequency bands of the sensor signal or a part thereof, whereby at least one of the bands contains at least one frequency;
(250) an ambient sound content and level;
(251) a low pass filter;
(252) a high pass filter;
(253) a band pass filter;
(254) a notch filter;
(255) a shelving type of filter;
(256) an attenuation;
(257) an amplification;
(258) an equalizing;
(259) a normalization;
(260) a level of intensity, an amplitude, a magnitude, a ratio, a value or any other relative or absolute value to set the amount of modification mentioned above;
(261) a sample rate for ADC;
(262) a buffer over-sampling amount, which could be a formula, a ratio or any other relative or absolute value suitable to set the amount of over-sampling;
(263) a buffer down-sampling amount, which could be a formula, a ratio or any other relative or absolute value suitable to set the amount of down-sampling;
(264) a buffer size;
(265) a zero padding amount, which could be formula, a ratio or any other relative or absolute value suitable to set the amount of zero-padding.
(266) The above list is an illustration of a selection of possible types of conditioning 68 only and it is not restrictive. In the scope of this invention, also other types of conditioning 68 of the signal content of the sensor signal are included in step 23a.
(267) Triggering optimization step 24a has the purpose to ease the detection of strike on a drum in trigger method 24.
(268) Hereby, as further described below, strike detection parameters and settings 69 are set in step 24a in order to optimize the successful detection of a strike on a drum. Detecting a strike on a drum or detecting a hit on a drum is sometimes also referred to as ‘triggering’.
(269) By the execution of steps 23 and 24 together, a strike by a user on a drum is considered.
(270) To consider a strike on a drum, a sensor signal is acquired from a vibration sensor in step 23 whereby the signal can be optionally conditioned in step 23. Thereafter, in step 24, the sensor signal is analyzed in at least one of the following domains: the time domain or in the frequency domain, or in the complex domain, or in a combination thereof, to detect at least: an onset event which is related to a strike on a drum.
(271) The detection of a strike on a drum in step 24, can be optimized by applying at least one of the following techniques or strike detection parameters and settings 69 in a step 24a:
(272) a strike detection threshold exceeding duration;
(273) a strike detection magnitude threshold in at least one strike detection frequency range;
(274) a rate of change threshold;
(275) a phase threshold;
(276) an oversampling rate;
(277) a downsampling rate;
(278) a sample buffer size;
(279) a duration in time;
(280) a magnitude manipulation amount;
(281) a magnitude manipulation frequency band;
(282) a spectral centroid range;
(283) at least one strike detection frequency range wherein strike detection analysis is performed. Such a strike detection frequency range can either completely contain the full spectrum, or it could contain at least one frequency band thereof. Said frequency band thereof could be defined by determining at least one cut-off frequency under which, above which, or around which the strike detection frequency range is located. Hereby the cut-off frequency could be comprised within or be excluded from said frequency band thereof;
(284) an amplitude modification amount. Whereby the amount is for example being a relative value or an absolute value, but not limited thereto, and whereby the modification is for example being an amplification, a shelving, an attenuation, but not limited thereto;
(285) a magnitude modification amount. Whereby the amount is for example being a relative value or an absolute value, but not limited thereto, and whereby the modification is for example being an amplification, a shelving, an attenuation, but not limited thereto.
(286) The above list is an illustration of a selection of possible types of strike detection parameters and settings 69 only and it is not restrictive. In the scope of this invention, also setting other types of strike detection parameters and settings 69 are included in step 24a.
(287) Sound fragment optimization step 25a has the purpose to optimize the recorded sound fragment of step 25 for the successful execution of at least one of the succeeding steps: 26, 27, 28, 29, 30, 31, 32, 33.
(288) Hereby a signal buffer or a sound fragment is recorded in step 25 and at least one of the following recording settings 70 is applied in applied in step 25a:
(289) a pre-attack comprise time, or any other setting to include signal content of the moment preceding an impact of a strike in a buffer, or in a recorded sound fragment;
(290) an attack comprise time, or any other setting to include signal content of the initial moment of impact of a strike in a buffer, or in a recorded sound fragment;
(291) an attack skip time, or any other setting to exclude signal content the initial moment of impact of strike from a buffer, or in a recorded sound fragment;
(292) a hit threshold exceeding duration;
(293) one or more hit detection frequency ranges;
(294) a hit detection magnitude threshold in at least one hit detection frequency bands;
(295) a rate of change threshold;
(296) a phase threshold;
(297) a buffer over-sampling amount, which could be a formula, a ratio or any other relative or absolute value suitable to set the amount of over-sampling;
(298) a buffer down-sampling amount, which could be a formula, a ratio or any other relative or absolute value suitable to set the amount of down-sampling;
(299) a buffer size;
(300) a zero padding amount, which could be formula, a ratio or any other relative or absolute value suitable to set the amount of zero-padding;
(301) a buffer size of the recorded sound fragment;
(302) a magnitude manipulation amount;
(303) a magnitude manipulation frequency band.
(304) The above list is an illustration of a selection of possible types of recording settings 70 only and it is not restrictive. In the scope of this invention, also setting other types of recording settings 70 are included in step 25a.
(305) Frequency domain optimization step 26a has the purpose to ease the successful detection a suitable tone of a strike on a drum, for example in step 27 or in step 32.
(306) Hereby, either all of the steps 29, 30, 28, 31, 33, 34 could be executed, or either it could be possible to skip the execution of at least one of the steps 29, 30, 28, 31, 33, 34, in which case for example the detected tone could be memorized for further processing and/or a value related thereto could be outputted to the user directly, with or without the execution of steps 33 and 34.
(307) The aforementioned detected tone, for example as result of step 27 or 32, can be the fundamental tone, or an overtone like the first overtone of the fundamental tone, or any higher order overtone thereof.
(308) In step 26a is at least one of the following domain conversion parameters and settings 71 are applied:
(309) a conversion algorithm to convert the recorded sound fragment of step 25 from the time domain to the frequency domain;
(310) a log size of an FFT or of a related transform;
(311) a windowing type;
(312) a hopping size;
(313) a modification of at least a part of the frequency content of the in step 24 recorded sound fragment or a of part thereof in at least one of the following domains: a frequency domain, a complex domain, whereby the aforementioned modification of the frequency content is one of the following modification types: an amplification, a shelving, an attenuation, a leveling, a normalizing, an equalizing, and whereby this modification type is affecting or whereby these modification types are affecting the full spectrum of the recorded sound fragment or a part thereof, or whereby this modification type is affecting, or whereby these modification types are affecting one or more frequency bands of the recorded sound fragment or of a part thereof, whereby at least one of the bands contains at least a sort of frequency content;
(314) an ambient sound content and level;
(315) a frequency range inside of which, outside of which, or around which frequency content will be modified by a modification of the magnitudes of the spectral content in a power spectrum;
(316) a frequency above which, below which, or around which, frequency content will be modified modification of the magnitudes of the spectral content in a power spectrum;
(317) a low pass filter in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(318) a high pass filter in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(319) a band pass filter in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(320) a notch filter in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(321) a shelving type of filter in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(322) an attenuation in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(323) an amplification in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(324) an equalizing in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(325) a normalization in a power spectrum or in a related representation of the signal content of the recorded sound fragment or of a part thereof;
(326) a level of intensity, an amplitude, a magnitude, a power, an energy amount, a ratio, a value or any other relative or absolute value to set the amount of modification mentioned above of the recorded sound fragment or of a part thereof;
(327) a buffer over-sampling amount, which could be a formula, a ratio or any other relative or absolute value suitable to set the amount of over-sampling of the recorded sound fragment or of a part thereof;
(328) a buffer down-sampling amount, which could be a formula, a ratio or any other relative or absolute value suitable to set the amount of down-sampling of the recorded sound fragment or of a part thereof;
(329) a buffer size;
(330) a zero padding amount, which could be formula, a ratio or any other relative or absolute value suitable to set the amount of zero-padding;
(331) a peak to peak cutting setting;
(332) a signal smoothing algorithm;
(333) a frequency response curve, for example related to the frequency response of a vibration sensor or microphone, but not limited thereto,
(334) an audio acquisition mode provided by a logic program, a software application or an operating system: for example like OS, Windows, Android or iOS, but not limited thereto,
(335) a noise cancellation;
(336) an echo cancellation;
(337) a gain control.
(338) The above list is an illustration of a selection of possible types of domain conversion parameters and settings 71 only and it is not restrictive. In the scope of this invention, also setting other types of domain conversion parameters and settings 71 are included in step 26a.
(339)
(340) In
(341) Hereby the connection between the tuning apparatus 73 and the strike medium 72 could be permanent or temporary. Alternatively the tuning apparatus 73 could be detachable from the strike medium 72 or it could be fully integrated in it, or with it so the tuning apparatus and the strike medium become one single device.
(342) Hereby it could be possible that some form of link, bond or connection 74 is created between at least a part of the tuning apparatus 73 and at least a part of the strike medium 72, for example said link, bond or connection could be a mechanical connection by means of at least one the following: a mechanical fastener, a nail, a hook, a clamp, a pinch, a grip, a bolt, a screw, a tensioning rod, a set screw a dowel, a string, a cord, a rope, a strap, a vacuum suction cup, a tightening band, a pull force exerting means, a pressure force exerting means, a wrap, a sleeve, a hook and loop fastener, a chain, a buckle, a press fit, a fit with a cavity or a contraption of an enclosure or another means, a pin, a dowel, any other connection, but not limited thereto.
(343) Alternatively it could be possible that some chemical form of link, bond or connection 74 is created between at least a part of the tuning apparatus 73 and at least a part of the strike medium 72, for example by means of a glue, an adhesive, a gel, a welding, any other chemical bond but not limited thereto.
(344) Alternatively it could be possible that some other form of link, bond or connection 74 is created between at least a part of the tuning apparatus 73 and at least a part of the strike medium 72, for example by means of a vacuum force or a magnetic force, an electrostatic force, but not limited thereto.
(345) As shown in
(346)
(347)
(348) One advantage of connecting a tuning apparatus 73 with a striking medium 72 is that a user has one free hand to operate a drum key when handling the tuning apparatus. This results in more freedom of handling, which makes the tuning of a drum more comfortable.
(349) Another advantage of connecting a tuning apparatus 73 with a striking medium 72 is that the vibration sensor 23 can be registering sound fragments close to the area of impact on the drum. This avoids the problem of erratic tone detection due to sound fragment biasing compared to when a vibration sensor of a tuning apparatus is mounted in a static orientation and position in relation to the drumhead. Hereby erratic tone detections, whereby a fundamental tone is detected when an overtone is expected and vice versa, are reduced, and more robust detection of a fundamental tone or an overtone within the sound fragment can be achieved. This results in higher correct detection rate of a fundamental or an overtone.
(350) When the vibration sensor 23 is directed towards the impact area on the drumhead, and in proximity of the impact area on the drumhead at the moment of impact, the locally generated sound can be registered locally by the vibration sensor 23, hereby enhancing the quality of the sound fragment and adding robustness to the detection of a strike and the detection of a tone like a fundamental or an overtone thereof, meanwhile reducing the chance for erratic tone detection.
(351) In a preferred embodiment the abovementioned apparatus 73 is also outfitted with wireless communication means, in order to output data related to the tuning of a drum and/or a strike on a drum, like for example: a detected frequency or a detected difference with a target frequency, a sensor signal buffer, a power spectrum, an impact strength of a strike, the moment of impact, an impact location and/or in order to receive data as input like for example: tuning presets, instrument data 66, but not limited thereto.
(352) The description above and the shown Figures show embodiments of examples of the invention. The invention is however not limited to these examples and will be defined solely in the claims.