Directional Microphone and System and Method for Capturing and Processing Sound

Abstract

Microphones, microphone systems, and methods for capturing and processing sound are described. The microphones and microphone systems may adaptively change the direction from which sound is captured. The microphones and microphone systems avoid the need to provide arrays of microphones, while providing adaptive beamforming without a time delay between each channel of information, and multi-directional sound capture. A dependency between the frequency response and system size is also avoided.

Claims

1. A directional microphone comprising a plurality of layers, each layer comprising a single sensing element or an array of sensing elements, the single sensing element or the sensing elements of the array of sensing elements being oriented perpendicular to a respective direction of sensitivity, wherein the plurality of layers are spaced from each other to allow free movement of the sensing elements.

2. The microphone of claim 1, wherein the plurality of layers comprises: a first layer; and a second layer orthogonal to the first layer, the first layer comprising sensing elements oriented in a first direction, and the second layer comprising sensing elements oriented in a second direction different than the second direction.

3. The microphone of claim 1, wherein the single sensing element or each sensing element of the plurality of sensing elements comprises a stainless steel fiber.

4. The microphone of claim 1, wherein the single sensing element or each sensing element of the plurality of sensing elements comprises a thin sheet.

5. The microphone of claim 1, wherein the single sensing element or each sensing element of the plurality of sensing elements is piezoresistive.

6. The microphone of claim 1, wherein the single sensing element or each sensing element of the plurality of sensing elements is piezoelectric.

7. The microphone of claim 1, wherein the single sensing element or each sensing element of the plurality of sensing elements is magnetoresistive.

8. The microphone of claim 1, wherein the single sensing element or each sensing element of the plurality of sensing elements is configured for optical sensing.

9. The microphone of claim 1, wherein the plurality of layers are stacked such that the plurality of layers are collocated and such that signals from the plurality of layers are provided without time delays therebetween.

10. The microphone of claim 1, wherein an electrical output of each layer of the plurality of layers is processed to perform signal processing, the electrical outputs having no time delay therebetween.

11. The microphone of claim 10, wherein a respective weight is applied to the electrical output of each layer of the plurality of layers such that the signal processing comprises beamforming.

12. The microphone of claim 11, wherein the respective weights are frequency independent.

13. The microphone of claim 11, wherein the beamforming comprises summing the electrical outputs with the respective weights applied thereto.

14. The microphone of claim 1, wherein the plurality of layers are separated such that the free movement of the sensing elements occurs without collision with a sensing element in another layer of the plurality of layers.

15. The microphone of claim 1, wherein the sensing elements in each array of sensing elements are connected in series.

16. The microphone of claim 1, wherein the sensing elements in each array of sensing elements are connected in parallel.

17. A sensor system comprising: a frame; a printed circuit board supported in the frame; a first magnet supported in the frame above the printed circuit board; a second magnet supported in the frame below the printed circuit board; and a directional microphone according to claim 1 and supported by the printed circuit board between the first and second magnets.

18. A switch comprising a directional microphone according to claim 1, wherein the directional microphone is constructed to turn on the switch dependent on a direction of incoming sound.

19. A directional microphone comprising: a plurality of sensing element layers, each sensing element layer of the plurality of sensing element layers comprising a sensing element oriented in a respective plane, the plurality of sensing element layers being stacked such that the respective planes are in parallel; wherein the sensing element of each sensing element layer of the plurality of sensing element layers is oriented perpendicular to a respective direction of sensitivity.

20. The directional microphone of claim 19, further comprising: a first magnet; and a second magnet spaced from the first magnet; wherein the plurality of sensing element layers are disposed between the first and second magnets.

21. The directional microphone of claim 19, wherein the plurality of sensing element layers are spaced from one another to allow free movement of the sensing elements.

22. The directional microphone of claim 19, wherein: the sensing element of each sensing element layer of the plurality of sensing element layers is one of an array of sensing elements in each sensing element layer; and the sensing elements in each array of sensing elements are oriented perpendicular to the respective direction of sensitivity.

23. A directional microphone comprising: a first magnet; and a second magnet spaced from the first magnet; a plurality of sensing element layers disposed between the first and second magnets, each sensing element layer of the plurality of sensing element layers comprising a sensing element, wherein the sensing element of each sensing element layer of the plurality of sensing element layers is oriented perpendicular to a respective direction of sensitivity.

24. The directional microphone of claim 23, wherein: the sensing element of each sensing element layer of the plurality of sensing element layers is one of an array of sensing elements in each sensing element layer; and the sensing elements in each array of sensing elements are oriented perpendicular to the respective direction of sensitivity.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Embodiments will now be described with reference to the appended drawings wherein:

[0014] FIG. 1 is a plan view of a printed circuit board (PCB) with a multi-layer microphone;

[0015] FIG. 2 is a circuit schematic for a two-layer microphone;

[0016] FIG. 3 is a PCB layout for the two-layer microphone;

[0017] FIG. 4 is a perspective view of a magnetic housing for a two-layer microphone;

[0018] FIG. 5 is a perspective view of an experimental setup for the magnetic housing depicted in FIG. 4;

[0019] FIG. 6 is a schematic plan view of a multi-layer microphone comprising more than two layers;

[0020] FIG. 7 is a schematic perspective view of the multi-layer microphone of FIG. 6; and

[0021] FIG. 8 is a polar pattern diagram for a three-layer microphone.

DETAILED DESCRIPTION

[0022] The proposed system provides various advantages and improvements relative to the related technologies.

[0023] Collocated multi-directionalityExisting multi-directional systems require the use of arrays of microphones with a physical spacing between each microphone corresponding to the desired wavelength of sound capture. In the proposed solution, layers of bi-directional fibers are stacked on top of each other with physical spacing corresponding to the fiber diameter. This enables the overall system size to be small and provides channels of information corresponding to each direction with nearly zero-time delay between each other.

[0024] Small form factorThe array of fibers for each layer is in plane with the sound wave to make the system thin. Each fiber in the array can be connected in series to maximize sensitivity in the confined geometry.

[0025] ModularityStacking more bi-directional layers on top of each other in different angular orientations provides additional directions of sensitivity.

[0026] Single microphone dynamic beamformingBecause a single microphone is sensitive to multiple directions, weights can be added to each individual direction to dynamically steer the direction that the microphone is most sensitive to. Because there is no time delay between channels of information (each corresponding to a specific direction) the directional solution works across the whole audible range of frequencies without loss in sensitivity.

[0027] Low computational complexityBecause the proposed solution does not rely on the time-delay beamforming principle and are inherently directional, complex or time-consuming signal processing are not required to get a direction. To adaptively provide beamforming, the system can use a simple weighted sum of the microphone outputs and thus have a relatively simple and fast solution for beamforming in real-time.

[0028] The system described herein is a continuation of the work published by Professor Ron Miles in Ref. [6] and as described in co-pending PCT Patent Application No. ______ filed on ______, claiming the benefit of priority from U.S. Provisional Patent Application No. 62/432,046 filed on Dec. 9, 2016, the contents of which are incorporated herein by reference. In this previous work, there is described a fiber of a mass and stiffness low enough to move exactly with the flow of a surrounding fluid medium, in this case air. An electrical signal corresponding to the particle velocity of the air flow is output by electromagnetic induction. The fiber is conductive (e.g., stainless steel) and placed within a magnetic field such that movement of the fibers induces a voltage. An array of these fibers is used and connected in series to increase the sensitivity of the microphone and create a 1D microphone that outputs an electrical signal based on sounds only coming in a single direction.

[0029] In the presently described system, the fiber-based microphone is expanded to develop multi-directional microphones that can capture sound coming from different directions. As described below, this is done by using multiple layers oriented in different directions. While the existing concept demonstrated in [6] senses sound waves oriented perpendicular to the plane of an array of fibers, the presently described system is oriented to capture sound waves arriving parallel to the plane of the array of fibers, but perpendicular to each individual fiber. This allows one to stack multiple layers very close to one another, thus creating a single collocated sensor that is multi directional. An example of this is shown in FIG. 1.

[0030] Turning now to the figures, in FIG. 1 an array of stainless steel fibers is oriented both vertically 10 and horizontally 12, and orthogonal to one another. The vertical fibers 10 sit on top of a PCB 14 while the horizontal fibers 12 sit just under the PCB 14. As a result, the two layers of fibers have enough space in between them so that they are free to move with incoming air flow without colliding with the other layer. Each layer of fibers has an associated amplifier circuit to read out an electrical signal corresponding to the average velocity of each layer of fibers. Thus, the output of this manifestation of the presently described system has two channels corresponding to each of the two layers. A schematic of the circuitry 16 and a PCB layout 18 are shown in FIG. 2 and FIG. 3 respectively.

[0031] The holes 20 in the PCB 18 shown in FIG. 3, labeled U1, U3, U5, and U7 can be used to solder each end of the suspended fibers 10, 12 above and below the rectangular hole in the PCB. Traces are made along the rectangular gap of the PCB 18 to attach the fibers 10, 12 in each layer electrically in series. The resulting microphone 22, can be placed in a frame 24 (e.g., plastic 3D printed frame) between two magnets 26 (e.g., made from Neodymium). A schematic drawing of the housing 24 used to hold the microphone is shown in FIG. 4, and a photograph of the setup, illustrating the magnets 26, is shown in FIG. 5.

[0032] The microphone 22 embodiment shown in FIG. 5 is powered by two 9-volt batteries 28 and placed on a grounding plane 30 to reduce noise. One channel of the microphone measures sound flow along port A and the other channel measures sound flow along port B, corresponding to the movement of a specific layer of fibers 10, 12. Sound arriving in the direction of the opening labeled A moves the vertically oriented fibers 10 while sound arriving in the direction of opening B moves the horizontally oriented fibers 12. By attaching weights to each channel and summing the two outputs, one can effectively steer the beam pattern of the microphone 22 towards any direction in-plane with the microphone 22.

[0033] It can be appreciated that this principle can be extended by adding additional layers to the microphone to add more channels and add sensitivity to additional directions. A schematic drawing of this is shown in FIGS. 6 and 7.

[0034] As shown in FIGS. 6 and 7, additional directions of sensitivity can be incorporated into a single microphone package by adding another layer of fibers oriented perpendicular to the desired direction of sensitivity. The microphone illustrated in FIGS. 6 and 7 is sensitive to 3 different directions; however, this principle can be readily extended to even more directions. Because each layer (corresponding to sensitivity of the microphone to a specific direction) is composed of an array of thin nanofibers oriented in the same plane as the direction of incoming sound waves, an additional layer of sensitivity for each desired direction can be added without adding a significant amount of thickness to the overall microphone. This is advantageous because this provides the potential to build a single, multi-directional microphone 22 on a single chip once scaled down in size. The corresponding beam patterns for the microphone 22 shown in FIGS. 6 and 7 is illustrated in FIG. 8.

[0035] The collocated multi-directional acoustic sensor provides a new set of abilities in signal processing and beamforming applications. Current methods of beamforming rely on a time delay principle wherein multiple microphones are in separate locations spatially (antenna). However, introducing time delay to the system comes at the cost of having the frequency-dependent weights for beamforming. It is also well known that to avoid the performance degradation at low frequencies, the antenna should be very long where each sensor is connected to a long-tapped delay line (TDL) [7]. In other words, to appropriately process typical signals in a microphone array, a large amount of weights is needed for each microphone in the system corresponding to different frequencies. This structure is not considered to be feasible in space-constrained applications such as hearing aid devices and are computationally expensive.

[0036] Such poor performance at low frequencies can be particularly problematic for broadband signals such as voice where bass and low frequencies are dominant. By maintaining a single collocated structure, not only can the presently described solution save significant space, beamforming can be achieved without a time delay in the data. Because the response of the proposed solution is frequency independent (without time delay), each output channel only needs a single weight associated with it for further processing, rather than a different weight for each frequency in the desired spectrum. This eliminates the need for TDL and consequently significantly decreases the computational load. Thus the use of a collocated microphone architecture as proposed in this disclosure creates a possibility for faster, real-time processing in a variety of desirable applications such as echo cancellation, beamforming and source separation.

[0037] The above-described principles can be modified in several ways. First, the whole device could be scaled down into a smaller package (or scaled up into a larger package). Scaling down can be done using various manufacturing methods for creating high precision structures with small feature sizes such as MEMS fabrication, electrospinning, or other nanofiber fabrication techniques. This allows for the use of thinner fibers within closer spacing to allow the packing of an increased number of fibers in series in the same area. Additional layers could be added into the structure while maintaining the same effective area and adding minimal thickness to the device (on the order of 1 micron).

[0038] Moreover, the fibers themselves used to create each layer of the microphone do not need to be perfectly cylindrical. While nanofibers have been used in the present solution, other geometries can be used as long as the sensing element is of low enough mass and stiffness that it accurately samples the motion of enough molecules of the surrounding medium. An example of an alternative sensing element to a nanofiber can be a very thin sheet (e.g., 100 nm thick and 2 microns wide). Arrays of thin sheets electrically connected in series could be used to compose each layer of the microphone. The use of thin sheets may make fabrication with MEMS easier, as well as allow multiple layers to be stacked even closer to one another.

[0039] While the current method of sensing each layer of fibers uses electromagnetic induction, each fiber could be made of a material that generates a voltage upon stress (i.e. piezoelectric) or changes in resistivity (i.e. piezo resistive or magnetoresistive) to produce an electrical output corresponding to motion of the fiber. Additionally, optical sensing could enable multi-directional sound sensing with fewer layers of fibers. For example, two lasers pointed perpendicularly could be used to measure the vibration of a single fiber in two directions. Three lasers and two fibers would provide 3D sound capture.

[0040] Because the current methodology generates a small amount of power due to an external sound field, a microphone can be constructed that turns on a circuit or switch, dependent on the direction of incoming sound. The thickness, tension, and mass of the fibers can be used to tune the resonance frequency of the system if it is desired to wake up or close a switch for a specific desired frequency of excitation.

[0041] While the beamforming is carried out in software, an analog equivalent circuit can be created to steer the beam as well. This would create a smart microphone that can dynamically steer a beam without needing a computationally intensive processor or brain. The microphone itself could be made standalone and used as a recording device or one for control.

[0042] The principles and systems described herein can be applied in many areas and applications that involve spatial sound capture. An advantage this device brings over other alternatives is that it can separate sounds coming from multiple directions (or track moving sound objects) all in a single package without using large arrays. Additionally, because it avoids the use of multiple microphones separated spatially, it maintains high quality audio. Some of the specific applications include, but are not limited to:

[0043] 1. Studio microphonesthis technology has apparent applications to work as traditional studio microphones. With this, bands or multiple speakers can be recorded with a single microphone if standing in discrete locations.

[0044] 2. Smartphonesnew functionality for smartphones including audio zooming similar to how a camera zoom works. The smart phones can also be aware where sound is coming from and only turn on from voice directly in front of it (as opposed to unrelated noise in the environment).

[0045] 3. Smart home devices (voice assistant, smart speakers, smart TV, etc.)smart home devices requiring far field speech recognition.

[0046] 4. Teleconferencinga dynamically steerable microphone that steers to whoever is speaking, while blocking out surrounding noise.

[0047] 5. Drones/UAVssensors for detecting gunshots/artillery, for collision avoidance, or speed measurements (air flow).

[0048] 6. AR/VRnew ambisonic type microphones for 360 sound capture and AR devices that let you choose what sounds in the environment to listen to and which to mute

[0049] 7. Securitymicrophone that tell you where sound along a perimeter is coming from, or turns on a security system once sound or movement is heard.

[0050] 8. Wearablesmicrophones to give wearables voice capability without having to bring wearable device right next to the user's mouth.

[0051] 9. Hearing Aids/Hearablesvast improvement on directional hearing aids and hearables that can selectively choose which sounds to listen in on.

[0052] 10. Laptops/Tabletsmicrophones that only pick up sound coming from the user in front of it for applications like Skype, WebEx, etc.

[0053] 11. Automotivemicrophones that improve hands free Bluetooth and speech recognition in automotive vehicles by drowning out noise from the road.

[0054] 12. Noise emission testing/machine monitoringmicrophones used to pinpoint where noise is coming from in a piece of machinery for designing quieter engines or performing predictive health monitoring.

[0055] 13. Traffic monitoringsound sensors can be used to count the amount of vehicular or pedestrian traffic in a desired area, or listen to the general noise energy coming from various directions.

[0056] 14. Smart citiessound sensors distributed across a city to give an additional layer of information for analytics.

[0057] 15. Pipe Monitoringmicrophones that can listen in to pipelines (water, gas, etc.) to detect the presence of leaks.

[0058] 16. Noise Cancellingthese sensors can be integrated into various consumer electronics (smartphones, headphones, etc.) and used to cancel noise coming from a specific direction.

[0059] 17. Weather Monitoringit can be used as a flow sensor distributed in various locations across a large area to map the direction of wind flow. Because the fibers are very sensitive to low frequency, it can also be used to sense infrasound.

[0060] Trackingbecause the sensors are very sensitive to low frequencies, they can be used to track moving objects that have an infrasound emitter on them; this can be used for indoor localization in small radiuses without generating audible noise.

[0061] For simplicity and clarity of illustration, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth in order to provide a thorough understanding of the examples described herein. However, it will be understood by those of ordinary skill in the art that the examples described herein may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the examples described herein. Also, the description is not to be considered as limiting the scope of the examples described herein.

[0062] It will be appreciated that the examples and corresponding diagrams used herein are for illustrative purposes only. Different configurations and terminology can be used without departing from the principles expressed herein. For instance, components and modules can be added, deleted, modified, or arranged with differing connections without departing from these principles.

[0063] It will also be appreciated that any module or component exemplified herein that executes instructions may include or otherwise have access to computer readable media such as storage media, computer storage media, or data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Computer storage media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. Examples of computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by an application, module, or both. Any such computer storage media may be part of the PCB 14, any component of or related to the PCB 14, etc., or accessible or connectable thereto. Any application or module herein described may be implemented using computer readable/executable instructions that may be stored or otherwise held by such computer readable media.

[0064] The steps or operations in the flow charts and diagrams described herein are just for example. There may be many variations to these steps or operations without departing from the principles discussed above. For instance, the steps may be performed in a differing order, or steps may be added, deleted, or modified.

[0065] Although the above principles have been described with reference to certain specific examples, various modifications thereof will be apparent to those skilled in the art as outlined in the appended claims.

REFERENCES

[0066] [1] W. Julius and H. F. Olson. Sound pick-up device, Dec. 27 1932. U.S. Pat. No. 1,892,645.

[0067] [2] R. N. Miles, Q. Su, W. Cui, M. Shetye, F. L. Degertekin, B. Bicen, C. Garcia, S. Jones, and N. Hall. A low-noise differential microphone inspired by the ears of the parasitoid fly Ormia ochracea. Journal of the Acoustical Society of Amercia, 125(4, Part 1): 2013-2026, April 2009.

[0068] [3] Miles, R. N., Cui, W., Su, Q. T., & Homentcovschi, D. (2015). A MEMS low-noise sound pressure gradient microphone with capacitive sensing. Journal of Microelectromechanical Systems, 24(1), 241-248.

[0069] [4] A. Reid, J. F.C. Windmill, amd D. Uttamchandani. Bio-inspired Sound Localization Sensor with High Directional Sensitivity. Procedia Engineering, 120: 289-293, September 2015.

[0070] [5] R, Miles, D. Robert, and R. Hoy. Mechanically coupled ears for directional hearing in the parasitoid fly ormia ochracea. The Journal of the Acoustical Society of America, 98(6): 3059-3070, 1995.

[0071] [6] Zhou, Jian, and Ronald. N, Miles. Sensing fluctuating airflow with spider silk. Proceedings of the National Academy of Sciences (2017): 201710559, and SI www.pnas.org/cgi/content/short/1710559114.

[0072] [7] Harry L. Van Trees, Optimum Array Processing: Part IV of Detection, Estimation, and Modulation Theory, Wiley, 2002

[0073] [8] Iman Moazzen and Pan Agathoklis, Efficient Implementation of Broadband Beamformers Using Nested Hexagonal Arrays and Frustum Filters, in IEEE Transactions on Signal Processing, vol. 61, no. 19, pp. 4796-4805, Oct. 1, 2013.