Abstract
A method of enabling a hearer to hear desired sound while also being able to be aware of ambient sound, comprises providing a first non-sound signal representative of said desired sound, deriving a second non-sound signal from said ambient sound, combining the first and second non-sound signals in providing a third non-sound signal, and converting said third non-sound signal into sound.
Claims
1. A method of enabling a hearer to hear desired sound while also being able to be aware of ambient sound, comprising providing a first non-sound signal representative of said desired sound, deriving a second non-sound signal representative of said ambient sound without phase shift, combining the first and second non-sound signals in providing a combined non-sound signal, converting said combined non-sound signal into sound, and further comprising providing, for said second non-sound signal, a single threshold representative of a single threshold, for the volume and/or frequency of said ambient sound, or providing for said second non-sound signal, both of a lower threshold and an upper threshold representative of a single threshold, representative of a lower threshold and an upper threshold for the volume and/or frequency of said ambient sound, and providing, by phase-shifting, a third non-sound signal representative of a partially cancelling, ambient sound signal, and combining the first, second and third non-sound signals in providing said combined signal.
2. A method according to claim 1, and further comprising variably adjusting said single threshold, or said lower threshold and/or said upper threshold for said second non-sound signal.
3. A method according to claim 1, and further comprising emitting an alert upon exceeding of said single threshold, or of said lower threshold and/or said upper threshold for said second non-sound signal.
4. A method according to claim 1, and further comprising variably adjusting said second non-sound signal to represent adjustment of the volume and/or frequency of said ambient sound.
5. A method according to claim 1 and further comprising providing a fourth non-sound signal representative of a fully cancelling ambient sound signal and combining the first, second, third and fourth non-sound signals in providing said combined signal.
6. A method according to claim 1, and in the form of selective sound cancellation of the ambient sound giving differentiation between wanted and unwanted sounds in the ambient sound.
7. A method according to claim 6, wherein said third non-sound signal has been preset before said providing thereof.
8. A method according to claim 7, wherein a user selects which sound to cancel by choosing the preset non-sound signal from among a range of differing, preset non-sound signals.
9. A method according to claim 8, wherein the preset non-sound signal is synthesizable.
10. A method according to claim 6, wherein a user selects which sound to cancel by varying one or more sound-cancelling parameters.
11. A method according to claim 10, wherein the one or more sound-cancelling parameters are: amount of phase shift; time delay; individual frequencies; volume; equaliser (hi, hi-mid, mid, lo-mid, and/or lo); compression; gating; spectral enhancement; threshold; range; gain; ratio; attack; release; minimum; maximum; sensitivity, vocal, or reverberation or any combination thereof.
12. A method according to claim 1, wherein the sound into which said combined non-sound signal is converted is transmitted to a listening person in a space and through air in said space and containing said person.
13. A system for enabling a hearer to hear desired sound while also being able to be aware of ambient sound, comprising a first outputting device adapted to output a first non-sound signal representative of said desired sound, a second outputting device adapted to output a second non-sound signal representative of said ambient sound without phase shift, a third inputting arrangement adapted to provide, by phase-shifting, a third non-sound signal representative of a partially cancelling, ambient sound signal, a combining arrangement adapted to combine the first, second and third non-sound signals to provide a combined non-sound signal, and a converting device adapted to emit sound converted from said combined non-sound signal, wherein said second outputting device is adapted to provide a single threshold or both of a lower threshold and an upper threshold for said second non-sound signal.
14. A system according to claim 13, wherein said second outputting device is variably adjustable to adjust variably said single threshold, or said lower threshold and/or said upper threshold.
15. A system according to claim 13, and further comprising an alerting device able to communicate with said second outputting device to alert to exceeding of said single threshold, or of said lower first threshold and/or said upper threshold.
16. A system according to claim 13, wherein said second outputting device is variably adjustable to adjust variably said second non-sound signal.
17. A method of enabling a hearer to hear desired sound while also being able to be aware of ambient sound, comprising: providing a first non-sound signal representative of said desired sound, deriving a second non-sound signal representative of said ambient sound without phase shift, combining the first and second non-sound signals in providing a combined non-sound signal, converting the combined non-sound signal into sound, and further comprising variably adjusting said second non-sound signal to represent variable adjustment of the frequency of said ambient sound, and providing, by phase-shifting, a third non-sound signal representative of a partially cancelling, ambient sound signal, and combining the first, second and third non-sound signals in providing said combined signal.
18. A method according to claim 17, wherein said adjusting is automatic.
19. A method according to claim 17, wherein the sound into which said combined non-sound signal is converted is transmitted to a listening person in a space and through air in said space and containing said person.
20. A method of enabling a hearer to hear desired sound while also being able to be aware of ambient sound, comprising: providing a first non-sound signal representative of said desired sound, deriving a second non-sound signal representative of said ambient sound without phase shift, combining the first and second non-sound signals in providing a combined non-sound signal, converting said combined non-sound signal into sound, and providing for the sound to be heard a single threshold, or both of a lower threshold and an upper threshold, for the volume and/or the frequency of the sound to be heard, and further comprising providing, by phase-shifting, a third non-sound signal representative of a partially cancelling, ambient sound signal, and combining the first, second and third non-sound signals in providing said combined signal.
21. A method according to claim 20, and further comprising variably adjusting said single threshold, or said lower threshold and/or said upper threshold for said second non-sound signal.
22. A method according to claim 20, and further comprising emitting an alert upon exceeding of said single threshold, or of said lower threshold and/or said upper threshold for said second non-sound signal.
23. A method according to claim 20, and further comprising variably adjusting said second non-sound signal to represent adjustment of the volume and/or frequency of said ambient sound.
24. A method according to claim 20 and further comprising providing a third non-sound signal representative of a partially cancelling, ambient sound signal, and combining the first, second and third non-sound signals in providing said combined signal.
25. A method according to claim 24 and further comprising providing a fourth non-sound signal representative of a fully cancelling ambient sound signal and combining the first, second, third and fourth non-sound signals in providing said combined signal.
26. A method according to claim 24, and in the form of selective sound cancellation of the ambient sound giving differentiation between wanted and unwanted sounds in the ambient sound.
27. A method according to claim 26, wherein said third non-sound signal has been preset before said providing thereof.
28. A method according to claim 27, wherein a user selects which sound to cancel by choosing the preset non-sound signal from among a range of differing, preset non-sound signals.
29. A method according to claim 28, wherein the preset non-sound signal comprises one or more sound-cancelling parameters.
30. A method according to claim 26, wherein a user selects which sound to cancel by varying one or more sound-cancelling parameters.
31. A method according to claim 30, wherein the one or more sound-cancelling parameters are: amount of phase shift; time delay; individual frequencies; volume; equaliser (hi, hi-mid, mid, lo-mid, and/or lo); compression; gating; spectral enhancement; threshold; range; gain; ratio; attack; release; minimum; maximum; sensitivity, vocal, or reverberation or any combination thereof.
Description
(1) In order that the invention may be clearly and completely disclosed, embodiments thereof will now be described, by way of example only, with reference to the accompanying drawings, in which:
(2) FIG. 1 is schematic drawing of a selective sound cancelling system;
(3) FIG. 2 is a representation of an application interface through which the sound cancelling system can be operated;
(4) FIG. 3A is schematic drawing of a simplified, selective, sound cancelling system;
(5) FIG. 3B is a schematic drawing of a less simplified, selective, sound cancelling system;
(6) FIG. 4 is a schematic drawing of a sound cancelling system and shows Sound Cancelling Mode A;
(7) FIG. 5 is a schematic drawing of a sound cancelling system and shows Sound Cancelling Mode B;
(8) FIG. 6 is a schematic drawing of a sound cancelling system and shows Sound Cancelling Mode C;
(9) FIG. 7 is a schematic drawing of a sound cancelling system and shows Selective Sound CancellingHearing Aids;
(10) FIG. 8 is a schematic drawing of a sound cancelling system and shows Non-Microphone Sound Cancelling;
(11) FIG. 9 is a schematic drawing of a sound cancelling system and shows Speaker-Based Selective Sound Cancelling;
(12) FIGS. 10 and 11 are representations of respective simple application interfaces for operating the system;
(13) FIGS. 12 to 15 are representations of advanced application interfaces for operating the system, the interfaces being where respectively ambience, compression, EQ and limiter settings can be fine-tuned;
(14) FIGS. 16 and 17 are representations of application interfaces for operating the system and through which settings may be stored and recalled/imported, respectively;
(15) FIG. 18 is a representation of a karaoke interface for operating the system;
(16) FIG. 19 is a schematic drawing of a basic system applicable particularly to circumstances in which a listener to desired audio is using enclosed ear-or headphones;
(17) FIG. 20 is a schematic drawing of a relatively simple example of a system within that basic concept;
(18) FIG. 21 is a schematic drawing of a less simple example of a system within that basic concept;
(19) FIG. 22 is a diagram of an iPhone phone to which an app. (application) corresponding to the example of FIG. 21 has been uploaded; and
(20) FIG. 23 is a schematic drawing of a simple system applicable particularly to circumstances in which a listener to desired audio using enclosed ear-or headphones wishes to exclude as much as feasible of ambient sound.
(21) FIG. 1 shows an overall selective sound cancelling system to exemplify application of an embodiment of the invention to a modern music-capable mobile phone. This example is intended to explain the features employed to create a selective sound cancelling system and method and it should not be taken as a limitation of how and where the invention may be used. The specific example used is an Apple iPhone phone, as it is the simplest to describe. The built-in microphone of the mobile phone and/or an additional, external microphone can be used. The system may be configured to work with two or more microphones. The system can work with all headsets, including generic ear-bud headphones. However, it works best when used with enclosed ear-or headphones. It should be mentioned that FX means effects.
(22) In the iPhone example, a user may upload a software app. (application) to his iPhone mobile phone to enable the system and provide an application interface which operates the system. The user turns on the app. and is presented with a screen, exemplified in FIG. 2. This Figure represents one simple interface, others being exemplified in FIGS. 10 and 11, which provides limited adjustment of sound cancelling parameters.
(23) In a first mode of operationin which no audio awareness is requiredwith the user wearing his ordinary headphones or earphones, the fader labelled calibrate may be adjusted up or down until ambient sound is totally eliminated or vastly reduced. The user need not do anything else if he desires not to hear any ambient sound and he may simply press play on his usual music player. Following this type of adjustment only, the user may enjoy the music while hearing minimal or no background soundwhich provides the advantage of the user's being able to hear more of the music at lower, safer levels of volume. If the phone is used to make a call in this first mode, then the app. pauses until after the user has finished.
(24) As a further possibility, the user may use the system to reduce or eliminate ambient sound without listening to music.
(25) In a second mode, where audio awareness is required, in addition to the steps mentioned above with respect to the first mode, the user moves the fader labelled ambience until he can hear his immediate surroundings at a desired level. The ambience fader allows the user to choose how much of the background sound he hears and allows him to hold a conversation, whilst eliminating or significantly reducing unwanted sound. The effects of both the ambience fader and the calibrate faders allow the user to listen to music, make phone calls, and hold live conversations, whilst retaining audio awareness of his immediate surroundings with active selective sound cancelling. In addition to the above, the user may use the app. to noise cancel the receiver sound during a phone call before that sound is transmitted to a recipient caller, which makes conversation for both parties easier and clearer at lower levels of volumeand allows easier and clearer conversations in areas of high background soundfor example when making a call in a windy environment.
(26) In particular, the system allows a user to eliminate, practically all, if not all, background sound, even while listening to music, and still be able to hear things like a police siren, fire alarm, doorbell, or someone talking to him.
(27) As exemplified in FIG. 3A, the system can allow a selected portion of the ambient sound received by the microphone 2 to be emitted by the headphones 11 in addition to the desired audio corresponding to the electrical output signal from the desired audio source 9. FIG. 3B shows a less simplified schematic of selective sound cancelling; the system produces the effects described above by taking a signal from the microphone (Mic) of the mobile phone and phase-shifting it to produce a cancelling phase-altered signal. Typically this is done by altering the phase of the signal by 180 degrees (further allowing the user to fine-tune the phase shift + or 1 to 5 degrees in each direction). Those skilled in the art will know that, to produce a fully-cancelling phase-altered signal, some leeway is required in the number of degrees of phase shift, as the amount of shift required for correction is affected by numerous external factors, for example wind direction and speed. The phase-altered signal is processed and fed into the headphones, causing the sounds to cancel each other out. However, as mentioned herein, this application of the system and method is only suitable when the user desires to cancel out all background ambienceas described in relation to the first mode of operation. For the second mode of operation, in addition to the above, the system takes a second identical signal from the Mic and produces a partially-cancelling phase-altered signal. Typically this is done by altering the phase of the signal by 45 degrees (although the amount of phase shift can be any partially-cancelling phase shift). This phase-altered signal is further processed to affect individual frequencies, volume, and other audio characteristics using EQ, compression, gates, and/or spectral enhancers, to achieve a desired effect. When this signal is fed into the headphones, no further noise cancelling is provided so that it remains audible. A user may now listen to music on his telephone while retaining a safe level of audio awareness.
(28) Advantageously, this system allows a user to listen to his headphones in a number of useful modes such as: total sound cancelling of all ambient sounds; alarm mode, where the user wishes to be alerted by, e.g. a fire alarm, a police siren or even when someone in the user's immediate vicinity talks to him; or audio awareness mode, where a user can control and turn down the background ambience he hearsallowing him to retain audio awareness of his immediate surroundings while listening to music or other audio, or when making or receiving a call on his music playing telephone.
(29) An advanced interface is shown in FIGS. 12 to 15. Through the advanced interface the user has the option to edit key sound-cancelling parameters, allowing him effectively to choose the ambient background sound he wants to hear. For example, a user may want to noise cancel the sound of train tracks whilst being able to hear a message over a train's public address system. A number of other innovative features are accessed via the advanced mode. FIG. 12 shows the range of features that can be accessed through the ambience tab, for example, threshold, range and gain. FIG. 13 shows the range of features accessible through the compression tab, for example, threshold, ratio, attack, release and gain. As to FIG. 14, this shows the features of EQ which may be adjusted through the EQ tab, for example, hi, hi-mid, mid, lo-mid, and lo. A more sophisticated EQ may be used, for example, band filtering with an adjustable Q factor. FIG. 15 shows the range of features that are adjustable through the limiter tab, for example min., max., sensitivity and gain.
(30) FIGS. 16 and 17 show the interface through which advanced setting may be stored and recalled. A number of blank preset settings are provided for a user to save his own preferred settings. In addition, factory-set presets can be accessed from this interface.
(31) FIGS. 4, 5 and 6 show Modes A to C for sound cancelling. Mode A relates to selective sound cancelling and shows one or more optional microphones. Mode B relates to maximum sound cancelling. In Mode C, the features enclosed in dotted lines can either be user-controlled via a software interface (see FIG. 1) or be included in an external controller unit.
(32) An alternative embodiment is shown in FIG. 7, which exemplifies selective sound cancelling on hearing aids. Hearing aid users often find themselves caught in a vicious circle that results in damaging their hearingit is instinctive for a user to turn up his hearing aid as his hearing deteriorates or when there is a lot of background sound. This can accelerates hearing loss. This embodiment solves this and other associated problems by cancelling out unwanted background ambient sound. This allows the user to hear more easily and at much safer levels of volumepreserving his hearing. In particular, hearing aids can be modified to include the present system. An optional external controller may be added to the hearing aid allowing a user to fine-tune what sound to cancelto suit personal preference and requirements; in particular, components enclosed by the dotted lines could be incorporated in an external hardware module allowing users to fine tune the system to work according to their needs or preferences. Alternatively, a number of presets can be programmed into the hearing aid to work in various modes, e.g. selectively to reduce unwanted ambient sound such as machinery, motor cars, trains and/or aeroplanes.
(33) FIG. 8 shows a further alternative embodiment which is a non-microphone version. The system may employ representations of common sound factors as presetsin effect allowing non-Mic devices to work with the system and without the use of a microphone, e.g. standard mp3 players. The app for non-Mic platforms may contain a number of presets such as airplane mode, where the sound to be cancelled is engine or cabin sounds. A user also has the option of using and creating his own previously recorded sound samples to serve as counter signals for sound cancellation. For example, a user can record ambient sound using a mobile phone, save the file as an MP3 and import it to his MP3 player to be used as the sound source to cancel. In this mode the system allows a user to synthesise the sound he wants to cancel (i.e. not hear). Further to this, the system may employ an external microphone, allowing it to be used on any music player. There are a wide range of headphones that feature a built-in microphone, allowing mp3 hardware and all other audio delivery systems to work with the system.
(34) A further alternative embodiment is shown in FIG. 9 and is directed towards speaker-based selective sound cancelling. Variations of the system can be used to suit specific applications. For example, a living room may require a 4-microphone configuration, whilst a large hall may require 30 microphones. An audio specialist would need to advise on placement of microphones and loud-speakers, and calibrate the system. This is useful for eliminating or significantly reducing unwanted background sound in rooms, in open-plan offices, in cinemas, concert halls, meeting rooms, and even at open-air events. The actual positioning of the microphones and loud-speakers would be determined after a full acoustic survey by an acoustic specialist who would also advise on the selective sound cancellation configuration and on the equipment required, e.g. the number of microphones and loud-speakers. A living room example, with a television set, three noise-receiving microphones and six noise-cancelling loud-speakers, is shown in FIG. 9. The system illustrated in FIG. 9 allows a user to tweak the remote control until optimal settings are achieved. In more complex situations, such as open plan offices or theatres, calibration would be completed by a trained specialist. In particular, it is noteworthy that a microphone is positioned in front of each source of unwanted sound in FIG. 9. Further, loud-speakers are positioned near the unwanted sound. Therefore, with the loud-speaker emitting a cancelling, phase-altered signal of that unwanted sound, sound-cancelling is achieved. Although not shown, if a door bell were to chime, that sound would not be cancelledunless desired by the userand thereby would alert the user.
(35) FIG. 18 shows a karaoke interface, particularly a multitrack recorder, in which mode a user can record vocals or any instrument such as guitar or drums. The user may adjust features, such as vocal, reverberation, delay and compressor, along with the master volume. Through this interface the user may adjust the sound-cancelling effects produced and save, import, export files/settings together with the normal play, etc. functions.
(36) The following possible additional features of the system are now described in brief detail.
(37) The app. which implements the system can be designed to accept software plug-ins. The definition of a plug-in, as used on this system, is a separate piece of compatible software that can be used in conjunction with the system to add new features. Once a user has installed the app. on his device he can download or otherwise acquire an add on piece of software (plug-in) that is used by the main app. to add or increase functionality. For example, a user can download a voice-changing or reverberation effect plug-in.
(38) The system may feature a recording facility allowing a user to record meetings, messages, memos, or karaoke, with active selective sound cancelling. The recorded file can be played back on any music player and can be exported to any external device, e.g. PC or MP3 player and sent via mms or e-mail [and can be listened to by any caller].
(39) The system may be incorporated into an external hardware unit that can feature a microphone to work on standard mp3 players, hearing aids or other devices that do not have microphones. Other hardware, such as external controllers (wired or wireless) in the form of faders, knobs, or touch screen, may be used to control the sound-cancelling parameters [and other features such as EQ, delay, reverberation etc.].
(40) The system can be configured to make any mobile phone or (microphone equipped device) function as a powerful fully-featured hearing aid, with many advantages over traditional hearing aids stemming from selective sound-cancelling functionality.
(41) The system may be configured to make any mobile phone or (microphone equipped device) into a powerful fully-featured listening device that can also transmit over the Internet (if the device is Internet-enabled) or as a normal telephone call.
(42) Referring to FIG. 19, in this basic concept ambient sound is received by a microphone which transmits an electrical output signal representing the ambient sound to a treatment stage which receives another electrical output signal from a source of desired audio, such as music from a digital audio player (MP3). The two signals are combined, (with or without other treatment) and the resulting electrical signal is supplied to enclosed ear-or headphones and converted into audio heard by the wearer of the ear-or headphones.
(43) In the example illustrated in FIG. 20, the electrical output signal from the microphone is gated such that, upon the ambient sound represented by that electrical output signal exceeding a predetermined volume, the gate begins to output an electrical signal to a mixer which also receives the electrical output signal from the source of desired audio (e.g. an MP3 player). The gate threshold is adjustable by the wearer using, for example, a slider. The wearer can also adjust the microphone volume by means of, for example, another slider. The electrical output signal from the mixer is supplied to the ear-or headphones the audio output volume from which is controllable by the user by means of, for example, a slider providing, in effect, a master volume control.
(44) In an alternative example, the gate may have, in addition to the one threshold, an upper threshold, preferably settable independently of the lower thresholdor maybe even set by the manufacturerto safeguard the wearer against extremely loud sound.
(45) In the example shown in FIG. 21, a visual representation of the electrical output signal from the microphone and thus of the ambient sound is displayed. The electrical signal is again gated and the wearer can set the threshold. If the gate threshold is exceeded, the gate output may result in a vibratory, visual or audio alert if the wearer has chosen to switch an alert mode control ON. The gated ambient sound volume represented by the gated electrical output signal can be adjusted by the wearer and the adjusted signal input to a mixer which receives the electrical output signal from the desired audio source (e.g. an MP3 player). The electrical output signal from the mixer is again fed to the ear-or headphones and a master volume control is again provided.
(46) FIG. 22 shows an iPhone touch-screen phone into which has been uploaded what we call our Awareness! app. The various features thereof will now be described progressing in a continuous loop around the phone from the top left-hand corner thereof. Tapping the left-hand end of the track scroll switches to the next previous track whilst tapping to the right-hand end thereof switches to the next following track. Alternatively, swiping left to right or right to left between those ends switches to the next previous or next following track. Tapping at the essency supplies help and other information. Tapping at Awareness! overrides the desired audio source and leaves simply the output derived from the ambient sound. If the LED (light emitting diode) representation is green, this means that the gate threshold has not been exceeded. If it turns red, this means that the threshold has been exceeded. In the event that, as is the case with this app. example being described, there are upper and lower gating thresholds, these may be set, as indicated by the lines T-hi and T-lo, by carrying out a vertical pinching action on the screen. Shown on the screen is a 3D background with vertical lines which indicate presence and amplitude of ambient sound. The phone can be shaken to cause shuffling of the tracks in a random manner. The screen can be locked. Various settings, such as those for the gating threshold and the volumes can be set through sliders which are displayable upon the screen. The vibratory alert can be turned on or off. The microphone can be switched on or off by tapping or the finger can be held down to set the microphone output level and sensitivity. The iTunes library can be accessed. The screen can be swiped horizontally to raise or lower the player volume. Shown is screen 1 of the app. If it is inactivated for more than three seconds, the various controls disappear from the screen leaving only the 3D background, which is screen 2. With the player controls shown, pressing and holding the left or right button scrolls the music. Pressing the central button can produce play, pressing it again produces pause and pressing and holding it returns the track to the beginning. If all three buttons are swiped, their positioning on the screen and their sizes become selectable, so that the user can resize them or drag them individually to anywhere on the screen.
(47) Referring to FIG. 23, the inversion 5, as regards both amplitude and frequency of the electrical output signal 3 from the microphone 2, means that no ambient sound is mixed in at 8, although of course that does not prevent a minor proportion of the ambient sound reaching the ears of the listener in other ways.
(48) While the various embodiments of the invention have generally been described as treatments relating to the volumes of sound heard by the hearer, the invention is applicable also to treatment of frequencies of such sounds, or to both frequencies and volumes of such sounds.
