IN-EAR WIRELESS AUDIO MONITOR SYSTEM WITH INTEGRATED INTERFACE FOR CONTROLLING DEVICES

Abstract

An in-ear wireless audio monitor system with integrated interface for controlling devices includes an in-ear monitor device in communication with a communication module. The in-ear monitor device provides audio, tactile, and other information to a wearer, and transmits information from sensors located in or on the device to the communication module which effectuates control of external devices over a two-way MIDI link. Thus, a performer using the device may command control of an external lighting, audio, or other device by using head gestures, or other movements or sounds such as using their teeth or tongues.

Claims

1. An in-ear wireless audio monitor system with integrated interface for controlling devices, comprising: an in-ear monitor comprising a transducer for providing audible and/or tactile signals to a wearer; and a plurality of sensors for detecting movements of a wearer; and control circuitry operable to detect one or more signals generated by at least one of the plurality of sensors and in response generate a command to control external music, audio, video and other performance devices via MIDI and other communications protocols, and further operable to receive feedback from external music, audio, video, and other performance devices via MIDI and other communications protocols.

2. The system of claim 1, wherein the control circuitry comprises a battery, a central processing unit, and a communications interface.

3. The system of claim 1, wherein the control circuitry, in response to the received feedback, commands a notification to the wearer via haptic, audible, or other wearer-perceptible means.

4. The system of claim 2, wherein the wireless communications interface is operable to transmit and receive over WiFi, Bluetooth, NFC, NFMI, cellular, 5G, and optical communications protocols, and combinations thereof.

5. The system of claim 1, wherein the sensors comprise microphones, infrared sensors, mechanical switches, motion sensors, acceleration/deceleration sensors; temperature, capacitive sensors, and combinations thereof.

6. The system of claim 1, further comprising a communication module operably coupled to the control circuitry, wherein the communication module is operable to propagate commands to external equipment in MIDI and other communications protocol.

7. The system of claim 6, wherein the communication module is integral with the in-ear monitor and in wired communication with the control circuitry.

8. The system of claim 6, wherein the communication module is configured to communicate wirelessly with lighting equipment, audio amplification equipment, audio processing equipment, and combinations thereof.

9. The system of claim 6, wherein the communication module includes memory operable to store commands, libraries of commands, and macro commands comprised of multiple individual commands.

10. An in-ear wireless audio monitor system with integrated interface for controlling devices, comprising: an in-ear monitor comprising a transducer for providing audible and/or tactile signals to a wearer; a plurality of sensors for detecting movements of a wearer; control circuitry comprising a battery, a central processing unit, and a wireless communications interface, operable to detect one or more signals generated by at least one of the plurality of sensors and in response generate a command to control an external device; and a communication module operably coupled with control circuitry, wherein the communication module is operable to communicate wirelessly with external equipment to propagate commands to the external equipment in MIDI and other communications protocol.

11. The system of claim 10, wherein the wireless communications interface is operable to transmit and receive over WiFi, Bluetooth, NFC, NFMI, cellular, 5G, and optical communications protocols, and combinations thereof.

12. The system of claim 10, wherein the communication module is housed integrally with the in-ear monitor.

13. The system of claim 10, wherein the plurality of sensors comprises microphones, infrared sensors, mechanical switches, motion, acceleration/deceleration sensors; temperature, capacitive sensors, and combinations thereof.

14. The system of claim 10, wherein the communication module is configured to communicate with lighting equipment, audio amplification equipment, audio processing equipment, and combinations thereof.

15. The system of claim 14, wherein the communication module includes memory operable to store commands, libraries of commands, and macro commands comprised of multiple individual commands.

16. An in-ear wireless audio monitor system with integrated interface for controlling devices, comprising: a wearable in-ear monitor comprising a battery, central processing unit, and a wireless communications interface; a plurality of sensors positioned on the in-ear monitor for detecting movements of a wearer; a communication module operably coupled with the in-ear monitor, wherein the communication module is operable to communicate wirelessly with external equipment and to propagate commands to the external equipment using MIDI and other communications protocols.

17. The system of claim 16, wherein the wireless communications interface is operable to transmit and receive over WiFi, Bluetooth, NFC, NFMI, cellular, 5G, and optical communications protocols, and combinations thereof.

18. The system of claim 16, wherein the plurality of sensors comprises microphones, infrared sensors, mechanical switches, motion, acceleration/deceleration sensors, temperature sensors, capacitive sensors, and combinations thereof.

19. The system of claim 16, wherein the communication module is configured to communicate wirelessly with lighting equipment, audio amplification equipment, audio processing equipment, and combinations thereof.

20. The system of claim 16, wherein the system includes memory operable to store commands, libraries of commands, and macro commands comprised of multiple individual commands.

Description

DESCRIPTION OF THE DRAWINGS

[0017] Illustrative embodiments are described in detail below with reference to the attached drawing figures, and wherein:

[0018] FIG. 1 is a perspective view of an in-ear wireless audio monitor with integrated interface for controlling devices in accordance with an exemplary embodiment of the present invention.

[0019] FIG. 2 is a general block diagram of the in-ear wireless audio monitor of FIG. 1 in accordance with an exemplary embodiment of the present invention.

[0020] FIG. 3 is a detailed block diagram of the in-ear wireless audio monitor of FIGS. 1 and 2 in accordance with an exemplary embodiment of the present invention.

[0021] FIG. 4 is a detailed block diagram including a communication module for integral or distributed use with the in-ear wireless audio monitor and control module of FIGS. 1 through 3 in accordance with an exemplary embodiment of the present invention.

DETAILED DESCRIPTION

[0022] The subject matter of select exemplary embodiments is described with specificity herein to meet statutory requirements. But the description itself is not intended to necessarily limit the scope of embodiments thereof. Rather, the subject matter might be embodied in other ways to include different components, steps, or combinations thereof similar to the ones described in this document, in conjunction with other present or future technologies. Terms should not be interpreted as implying any particular order among or between various steps herein disclosed unless and except when the order of individual steps is explicitly described. The terms “about” or “approximately” as used herein denote deviations from the exact value by +/−10%, preferably by +/−5% and/or deviations in the form of changes that are insignificant to the function.

[0023] The invention will be described herein with respect to several exemplary embodiments. It should be understood that these embodiments are exemplary, and not limiting, and that variations of these embodiments are within the scope of the present invention.

[0024] Looking first to FIG. 1, an in-ear monitor device in accordance with a first exemplary embodiment of the present invention is depicted generally by the numeral 100. The in-ear monitor device comprises a main body portion 102 comprising a housing 104 containing circuitry, sensors, and a battery as will be described in more detail hereinbelow. First and second external microphones 106a, 106b are positioned on opposite sides of the front side of the housing 104. A touch panel 108 on the front side of the housing 104 provides a touch pad or switch for manual control by a user. The touch panel 108 may be a switch, such as a push button switch, or may be a capacitive or other touch sensor capable of detecting a touch or presence of a finger of the user. In some embodiments, the touch panel comprises multiple switches, sensors or zones, with the multiple zones corresponding to distinct inputs which may control separate functions.

[0025] A cylindrical tube 110, configured for partial insertion into the ear canal of a user/wearer is attached to and extends rearwardly from the right side of the housing 104. A foam tip 112 is positioned over the end of the tube 110 to protect the ear canal of the wearer and to provide a snug fit within the canal. An LED 114 is positioned at the front end of the tube to provide visual indication of the status of the in-ear monitor, and/or to visually convey other information.

[0026] In addition to the externally visible components of the in-ear monitor as just described, turning to FIG. 2, a block diagram of other circuitry and components located internally to the housing 104 is depicted. The internal components include a battery 116 for providing power to the circuitry, sensors, and components of the in-ear monitor. Sensors 118 include: motion sensors, such as accelerometers, operable to detect movement of the in-ear monitor such as movement of the wearer's head; radar sensors operable to detect movement and/or the presence of objects, such as a wearer waving or passing their hand in proximity to the in-ear monitor; touch sensors, such as touch panel 108, operable to detect touch by a wearer's fingers; temperature sensors, operable to detect the temperature of the wearer and/or the temperature of the air or objects in the vicinity of the wearer; infrared sensors operable to detect the presence of other people; and GPS sensors operable to detect a geographic location and position of the in-ear device. In alternative embodiments, other sensors such as directional sensors, altitude sensors, humidity sensors, and other sensors known in the art may be deployed on or within the in-ear monitor.

[0027] Looking still to FIG. 2, a central processing unit CPU 120 is operable to execute instructions such as applications (apps) and other programs to collect, analyze, store, and transmit data from the various other circuitry and sensors. It should be understood that the CPU 102 includes the necessary memory to store the instructions and data, with the memory internal to the CPU or external and contained in other circuitry. A pulse code modulation unit (PCM) 122 is operable to convert analog audio signals captured by any of the microphones of the in-ear monitor device to corresponding digital signals. A wireless radio interface 124 is operable to transmit and receive data and information to and from the in-ear monitor device. A touch interface 126 may include the front panel touch interface 108 as previously described, and may include additional touch sensors or switches, with the touch interface 126 operable to receive user touch input.

[0028] External microphones 128 may include the external microphones 106a, 106b as previously described, and may include additional external microphones, such as to implement noise cancellation or to provide additional audio detection capabilities. In-ear transducer 130 is operable to convert signals and information received by the in-ear monitor device to audible signals hearable by the wearer. In-ear transducer 130 will primarily and typically be used to convert a received digital audio signal to an analog signal for use by the wearer as a monitor—i.e., to hear themselves play or sing. In-canal microphone 132 is positioned within the cylindrical tube 110 and is operable to detect sounds and/or vibrations generated by the user when speaking, singing, clicking their teeth, or popping their tongue. As described above, these detected sounds may be translated to commands to instigate or effectuate commands to control various external devices.

[0029] A digital signal processor (DSP) 134 is operable to process and/or analyze digital signals, such as audio signals within the in-ear monitor to implement equalizations, detect specific frequencies or sounds, and the like.

[0030] Turning to the detailed block diagram of FIG. 3, in further and alternative embodiments, the in-ear monitor device may include further and additional inputs, outputs, and processing capabilities. As seen in FIG. 3, the in-ear control module may include one or more CPUs 200 as previously described, memory 202, DSPs 204, and analog-to-digital and digital-to-analog converters 206. Power circuitry 208 may include a battery as previously described or may include a supercapacitor, as well as charging and power monitoring circuitry. Amplifier 210 is operable to amplify the analog audio signal provided to the in-ear transducer to provide an audible audio signal to the wearer.

[0031] As shown in FIG. 3, the CPUs 200 and circuitry are configured to execute various Apps 212 for performing various functions, Codecs 214 to encode and decode signals, Analytics 216 to analyze various signals and information, and artificial intelligence 218 to provide adaptive and learning algorithms—e.g., to learn and/or predict upcoming events—and/or to monitor various information and signals exchanged, received, and transmitted by the in-ear monitor.

[0032] A user interface (UI) 220 coordinates and implements the various sensors, inputs, and outputs to allow a user/wearer to control the device. For example, the UI may implement detection of a long-press of the touch sensor to instigate a power-off of the device, and may implement a quick double tap of the touch sensor to change modes of operation.

[0033] Looking still to FIG. 3, various sensor inputs such as microphones 221, motion sensors 222, radar sensors 224, touch sensors 226, temperature sensors 228, infrared sensors 230, and GPS sensors 232, all as described above, may be inputs to the in-ear monitor device. Outputs of the in-ear monitor may include LED indicators 234, such as LED 114 as previously described, transducers 236, such as the in-ear transducer 130 as previously described, and haptic feedback devices 238 to provide subtle haptic cues to the wearer.

[0034] Looking to FIG. 4, communication module 300 is operable to communicate with the in-ear monitor device 100 either directly, in an embodiment where the communication module is integral with the in-ear monitor device 100, or over any one of, or combinations of, various wireless communications methods and protocols. In the embodiment of FIG. 4, the communication module 300 preferably may WiFi 302, Bluetooth 304, NFC 306, NFMI 308, and 5G communications capabilities. In one wireless or distributed embodiment of the system of the present invention, communication module 300 communicates with the in-ear monitor device 100 over a WiFi or Bluetooth connection, or a combination of those methods and protocols. In alternative embodiments, the communication module may include further communications methods, such as optical or other digital or analog transmitters and receivers.

[0035] In a preferred embodiment, communication module 300 is integrated in the housing of the in-ear monitor device and is in direct communication with the control circuitry of the device. In alternative embodiments, the communication module may be separate from the in-ear monitor device, and may be configured as a wearable device, such as in a belt-clip attachable housing. In further embodiments, the communication module 300 may be housed in mobile phone and/or may be implemented in a mobile phone or other portable electronics device, such as a smart watch.

[0036] As described previously, and as depicted in FIG. 4, the communication module 300 is configured to communicate with one or more external devices 312 such as sound processing and effects units, lighting and other visual effects units, sound amplification and sound reinforcement units, other musical instruments, and the like. Preferably, the communication link 314 between the communication module 300 and the external devices 312 is a two way link, accomplished using an industry standard MIDI protocol or other two-way audio or musical communications link protocol. In alternative embodiments other communications protocols may be used.

[0037] With the in-ear monitor device and communication module as set forth, the system of the present invention may capture input from any of the various sensors and inputs to the in-ear monitor device and effectuate a command to the integrated or wirelessly connected communication module and further to an external device over the MIDI link. For example, as previously described, an accelerometer in the in-ear monitor may capture a head nod by the performer, which the communication module translates to a “lights on” command, which is transmitted across the MIDI data stream, causing the lighting module to turn on the house lights.

[0038] Preferably, the in-ear monitor device, communication module, or both include one or more libraries of gestures, sensor inputs, etc. defining desired actions corresponding to various artist ‘intents’, essentially forming a vocabulary of command and control options that can be implemented by the artist, for example, by head movements, clicking of the teeth, spoken commands, and combinations thereof. It should be understood that the libraries of gestures, etc. may be located locally in the in-ear monitor device or may be located in the communication module regardless of whether the communication module is integrated with the in-ear monitor or implemented as a stand-alone device as previously described.

[0039] The commands to be executed may be either local commands—which act locally at the in-ear monitor, e.g., to turn up the volume of the in-ear monitor—or may be commands for external devices, effectuated through the communication link over the MIDI interface to various devices such as rack-mount effects, recording equipment, telecommunications equipment, lighting and special effects, and even other digitally connected instruments.

[0040] The libraries of commands may further include macros, stacked, and/or sequential commands, wherein a single head gesture by the artist may instigate multiple simultaneous commands, such as to an external amplifier, lighting control, and in-ear volume, or may instigate a series of sequential commands, such as turning on lighting, then after a predetermined time, increasing the amplifier volume, etc.

[0041] Thus, as described herein, it should be understood that the system of the present invention may be implanted as an integrated system, wherein the entirety of the system is contained in the housing of the wearable, in-ear monitor device, or may be configured as a distributed system, wherein the system is implemented in separate subunits—e.g., as separate in-ear monitor device and separate communication module. These and other variations and configurations are within the scope of the present invention

[0042] And, as described previously, the system of the present invention is not limited to use with musical instruments or by musicians. For example, dancers may use the system to capture their various singing and movement routines to trigger musical sounds or lighting events. A performer in another scenario might utilize movements of the head, for example, to serve as rhythmic drum control triggers, or might assign movements or other triggering events from the MIDI enabled in-ear monitor to correspond to various notes on a keyboard. Clicking one's teeth, or silently popping the tongue off of the roof of the performer's own mouth might trigger the engagement or disengagement of a backing track, or might serve to initiate or stop a recording, or start/stop a looper track. A musician nodding his or her head in rhythmic time might instigate calibration of B.P.M. (beats per minute) of a click-track used to keep other musicians perfectly in-time to the lead artist.

[0043] In further implementations, an on-the-street news reporter using the system of the present invention may control a camera or cameras using head movements, or an in-studio announcer may instigate camera cuts or other desired actions without relying on off-camera personnel. These and other implementations are within the scope of the present invention.

[0044] Many different arrangements of the various components depicted, as well as components not shown, are possible without departing from the scope of the description provided herein. Embodiments of the technology have been described with the intent to be illustrative rather than restrictive. Alternative embodiments will become apparent to readers of this disclosure after and because of reading it. Alternative means of implementing the aforementioned can be completed without departing from the scope of exemplary embodiments. Identification of structures as being configured to perform a particular function in this disclosure is intended to be inclusive of structures and arrangements or designs thereof that are within the scope of this disclosure and readily identifiable by one of skill in the art and that can perform the particular function in a similar way. Certain features and sub-combinations are of utility and may be employed without reference to other features and sub-combinations and are contemplated within the scope of exemplary embodiments described herein.