SYSTEM AND METHODS FOR BIOSIGNAL DETECTION AND ACTIVE NOISE CANCELLATION
20230240581 · 2023-08-03
Inventors
Cpc classification
International classification
A61B5/00
HUMAN NECESSITIES
Abstract
An apparatus for sensing electrical currents in a subject has a geodesic net structure of electrode elements connect by flexible legs. The electrode elements each have an inner electrode facing and sensing electrical currents in the subject and an outer layer electrode facing away and sensing external electrical noise. The legs have flexible conductive material that electrically connects the outer electrodes so that they are all connected and are electrically the same or similar to the subject's body part. The outputs of the electrodes are converted to multiplexed digital signals and transmitted to signal processing circuitry that identifies the noise present in the signals from the outer electrodes and removes the noise from the signals from the inner electrodes so as to output clean EEG data for each inner electrode. Additional electrodes that detect extraneous neuro-muscular currents are also used to determine the noise in the inner electrode output signals.
Claims
1. An apparatus for sensing biosignals of a head of a subject, said apparatus comprising: a net structure configured to be supported on the head of the subject; the net structure comprising a plurality of electrode structures connected in the net structure by elastic legs each connected with a respective pair of the electrode structures; the electrode structures each including a respective first electrode directed toward and sensing biosignals in the head of the subject; a respective second electrode supported adjacent the first electrode and directed away from the head of the subject and sensing electrical signals in an environment around the head of the subject; the legs each having a respective elastic conduction element extending between the associated electrode structures, the conduction elements being connected electrically with the second electrodes of the electrode structures connected with the leg; and a respective elastic insulation structure between the associated conduction element and the head of the user so as to electrically insulate the conduction element from the head of the user.
2. The apparatus of claim 1, wherein the legs also each have an outwardly disposed elastic insulation layer outward of the elastic conduction elements.
3. The apparatus of claim 1, wherein the net structure is an arrangement in which each of the electrode elements is connected with five or six of the legs, all of said legs having the conduction elements thereof connected with the second electrodes so that the second electrodes of the net structure are all interconnected electrically, and wherein the net structure has electrical properties that are similar to electrical properties of the head of the user.
4. The apparatus of claim 3, wherein the net structure includes further electrode elements having first and second electrodes at a perimeter of the net structure, said further electrode elements having four or fewer links to adjacent electrode structures of the net structure.
5. The apparatus of claim 1, wherein the electrode structures each have a respective analog to digital converter receiving electrical signals from the first and second electrodes and converting said electrical signals to digital signals that are output to digital circuitry that processes the digital signals so as to derive EEG data therefrom.
6. The apparatus of claim 5, wherein the electrode structures each have a multiplexer receiving raw signals from the first and second electrodes and multiplexing said raw signals with a control signal having a frequency of 5 kHz or greater and transmitting a resulting multiplexed output to the analog/digital converter.
7. The apparatus of claim 5, wherein the digital circuitry processes the digital signals by identifying noise in the signals from the second electrodes, and then producing EEG signals derived from the signals from the first electrodes from which the noise is removed.
8. The system of claim 7, wherein the identifying of the noise includes separating the signals into component waveforms, averaging the signals from the second electrodes, or processing the signals of the second electrodes with a neural network trained to identify the noise of the net structure.
9. The apparatus of claim 8, wherein the system further comprises additional electrodes generating signals responsive to muscle activity of the subject, and wherein the identifying of the noise includes averaging the signals from the second electrodes and the signals of the additional electrodes prior to removing the noise from the signals from the first electrodes.
10. A method of sensing electrical currents in skin of a subject, said method comprising: deriving an output from a first electrode directed toward the skin of the subject; deriving an output from a second electrode connected with the first electrode and directed away from the skin of the subject in an electrically connected net structure that has electrical properties similar to electrical properties of the skin of the subject; determining a noise component in the signal from the second electrode; and storing or outputting EEG data derived from the output from the first electrode from which the noise component has been removed.
11. The method of claim 10, wherein the determining of the noise component includes dividing the output from the second electrode into a set of discrete waveform components; and wherein the EEG data is derived by dividing the output from the first electrode into a respective set of discrete waveform components, and then clustering the discrete waveform components so as to identify the discrete waveform components that are present in the output from the first electrode but not in the output from the second electrode, and removing from the output of the first electrode the waveform components that are present in the output of the second electrode.
12. The method of claim 11, wherein the method further comprises deriving additional signals from additional electrodes picking up electrical background currents created by muscle activity in the subject; and scaling the additional signals to correspond in amplitude to amplitudes of the signals from the second electrodes over a period of a number of milliseconds prior thereto; and wherein the determining of the noise includes combining the scaled additional signals with the signals from the second electrodes.
13. The method of claim 12, wherein the additional electrodes are operatively associated with a mastoid, an eye or a muscle of the subject; and wherein the scaling includes determining an amplitude range of the output from the second electrode over a predetermined period of time, scaling an amplitude of the output of the additional electrode to correspond to the amplitude range of the output of the second electrode, and then summing the scaled output with the output of the second electrode to determine said noise.
14. The method of claim 10, wherein the skin of the subject is on a head of the subject on which the first electrodes are placed with conductive gel therebetween.
15. An apparatus for sensing biosignals of a head of a subject, said apparatus comprising: a structure configured to be supported on the head of the subject; the structure comprising a plurality of electrode structures; the electrode structures each including a respective first electrode directed toward and sensing biosignals in the head of the subject; a respective second electrode supported adjacent the first electrode and directed away from the head of the subject and sensing electrical signals in an environment around the head of the subject; the electrode structures having electronic circuitry therein that receives the outputs of the first and second electrodes, converts the outputs to digital signals in the electrode structure, and transmits the digital signals to a signal processor external to the head mounted structure.
16. The apparatus of claim 15, wherein the electronic circuitry includes a multiplexer that combines the signals so as to form a single electrode output signal, and an analog/digital converter that converts the single electrode output signal to a sequence of digital data signals with a voltage of 2 to 6 volts each corresponding to the amplitude of the signal from one of the electrodes, and transmits the sequence of the digital data signals along a single conductor to the signal processor.
17. The apparatus of claim 16, wherein the multiplexer multiplexes the digital signals by outputting the single electrode output signal for a cycle of a control signal as the output of the first electrode, and then switching in a next cycle of the control signal to output the single electrode output signal for the next cycle of the control signal as the output of the second electrode, and then switching back to the output of the first electrode so that the single electrode output signal alternates between the output of the first electrode and the output of the second electrode every cycle of the control signal.
18. The apparatus of claim 17, wherein the control signal has a frequency of at least 3 kHz.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
DETAILED DESCRIPTION
[0063]
[0064] In
[0065] Existing systems that provide these dual-layer electrode arrangements are very cumbersome and difficult to install. A prior-art EEG head-mounted dual-layer apparatus is shown in
[0066] The headgear apparatus of the present invention avoids this complicated procedure, and is shown in
[0067] The legs are made of nonconductive elastomeric polymer material such as is used in single-layer geodesic EEG headgear, and allow for stretching of the net 17 to fit onto the subject's head.
[0068] In addition to the nonconductive elastic material, the legs 19 also include strips of elastic conductive material 27 that overlie a lower layer 29 of the nonconductive leg material, and that are, in turn, covered by a protective layer of nonconducting elastic material 31. The conductive material also has portions indicated at 25 that overlie and are electrically connected with the outwardly disposed second layer electrodes. The conductive material of all the legs is preferably cut from a single sheet of material, and together the legs 19 provide a structure electrically linking all of the outward second layer electrodes that provides a structure with electrical properties similar to the scalp so as to receive environmental signals in the same way so that the noise can be detected separately from the EEG data in the scalp.
[0069] The geodesic dual-layer EEG relies on the second layer being an elastic and conductive material or a like fabric that stretches above the noise portion of the dual-electrode. The fabric runs between the electrodes, creating the second conductive layer. To prevent contacting the second layer with the skin, or other unwanted contact with the subject, the second layer runs in a sandwich of the nonconducting elastic connections between the electrodes.
[0070] The elastic conductive material is preferably the material sold by Eeonyx Corp, Pinole, Calif., under the trade name Eeyonyx. It has electrical impedance or resistance that is between 0.1 and 1 MOhm over the length of the legs 19. The dimensions of the strips of material in legs 19 are preferably a width of at least 5 mm, a thickness of less than 5 mm, preferably 2 mm to 3 mm, and a length between the electrode units of greater than 1 cm, preferably 2 cm to 4 cm between the electrode units of the geodesic net.
[0071] The outer protective layer 31 of elastomeric nonconductive material surrounds the conductive layer 27 and protects it from possible electrical contacts or other artifacts from contact outside the subject.
[0072]
[0073] In the electrode unit 21, first layer electrode 3 and its cap well 5, and second layer electrode 13 are both supported in an enclosure or housing 33 that is securely connected with ends of the links or legs 19 supporting the electrode unit 21. The housing 33 is connected with the supporting nonconductive elastic layer 29. The conductive layer 27 overlies that layer 29, and extends upward surrounded by the protective insulation of layer 31 up to an upper part of the electrode unit 21, where a portion 35 of the inner (and, if needed, outer) conductive layer 27 is exposed, and is electrically connected with the outer second-layer electrode 13 by gel 14, linking the electrode 13 electrically to the entire net. The conductive fabric completely covers the second-layer electrode, and is connected electrically to all of the conductive layers 27 of all of the legs 19 running to that particular node of the EEG geodesic network. The outer layer 31 completely overlies and insulates the outer surface of the central portion 35 of the conductive layer. The gel may be applied between the interface of the electrodes and the scalp or the conductive fabric in several ways, including the use of a saline-soaked foam or a semi-permeable hydrogel, commonly referred to as “dry gel”, or by injecting conductive gels at the interface using a syringe. To facilitate this, the electrode unit 21 has conduits 39A and 39B communicating from the exterior of the headset to the space around the electrode on the skin of the subject. One of these channels 39A or 39B can be used as an access passage into which a syringe may be inserted, allowing injection of the gel, and the other as a vent that permits escape of any air displaced by the injection of the gel.
[0074]
[0075] It will be understood that a similar structure with five legs is present at each geodesic node that has only five legs attached, or at the edge nodes that have fewer legs.
[0076] Referring to
[0077] As seen in
[0078] Wire 40 preferably also includes additional separate wires that provide (1) constant voltage DC-current electrical power to the circuit 38 to power the A/D converter and multiplexer, and any other components in it, and (2) a connection to ground for the circuit 38.
[0079] Referring to
[0080] Multiplexer 41 creates a sort of time division multiplex signal relying on a control signal 43 that is 5 kHz or greater, and outputs the multiplexed signal to A/D converter 44. The multiplexor produces an analog output signal created by switching the input signal between the first electrode output and the second electrode output every cycle of the control signal, which is typically a much higher frequency than any component of the electrode signal. The analog signal that is output consequently is made up of alternate cycles in which the output of the first electrode is transmitted and then the output of the second electrode is transmitted as the analog output signal. This results in loss of alternate portions of the analog output of each electrode analog signal, but the frequency of the control signal is so much higher than the frequency content of the electrode signals, e.g., greater than 3 kHz or 5 kHz, that this is not a significant loss of information. However, the combination or multiplexing of the two signals into a single analog signal allows for use of only one A/D converter for both electrodes. A/D converter 44 converts the combined multiplexed analog signal to a digital signal comprised of a series of sequential digital data packets of 2 to 4 bytes of bits at a voltage, e.g., 3 or 5 volts, each derived from a respective cycle of the combined analog signal and either corresponding to the amplitude in the cycle of either the first or second electrodes 3 and 13, and a time stamp for the digital data. A/D converter 44 outputs the digital signal along output wire 45 to electronics of digital signal hub 47, where the digital signal is demodulated into separate data for the biodata electrode and noise layer electrode signals, which are transmitted to processing circuitry or computer 48. Processing circuitry 48 processes the signals so as to remove the noise and derive a clean EEG data signal, and then stores the EEG data in data storage 50A, e.g., a computer accessible memory, and/or displays the EEG data to a user interface 50B, e.g., a display monitor. This digital dual-layer concurrent EEG (DDLC-EEG) system provides analog to digital conversion of both EEG and noise layer in the electrode enclosure, and only digital signal transfers to the Digital Signal Hub. This eliminates cable sway artifacts, which are one of the most prominent sources of EEG noise.
[0081] In addition, as described above, wires 46 providing connection to ground and wires 48 providing DC current power extend together with, alongside and electrically insulated from the data lines 45 to the digital signal hub where they connect to ground or a DC power source.
[0082] Particularly preferred as components for this circuitry are the data acquisition systems in single integrated circuits (ICs) that integrate the multiplexer, the oscillating control signal, analog to digital converter and digital signal transmission protocols. Examples of such ICs are ADS112C04 and/or ADS1115 from Texas Instruments. Both of those ICs are approximately 3 mm wide and approximately 3 mm in height, and approximately 1 mm thick, and are specifically designed for biosignal monitoring. Additionally, both chips include a virtual reference that makes the recordings of the first and second electrodes against a stable potential, adding to the consistency of the recordings.
[0083] In addition to the noise from the environment, there is also noise in an EEG signal from the muscular activity of the subject being tested. Usually this is noise from the movements of the subject's eyes or neck muscles, or other neuro-muscular sources, all collectively referred to here as EMG noise. Much of that noise may be picked up by electrodes properly placed on the subject's body that are not part of the net structure 17.
[0084]
[0085] Once the raw EEG and noise signals are received and the noise signal is processed or pre-processed, the signal processor 49 performs a comparison or exclusion step 8, in which the processor removes or eliminates the portions of the raw EEG signal that are present in the noise signal. The removal of the noise signal results in a clean EEG signal, which is then stored and/or displayed to a user in step 10.
[0086] The signal processor 49 is preferably a digital processor, e.g., a computer, and the EEG signals and the noise data are electronic signals in the form of digital data that is processed by numerical wave-processing methods. However, the signal processing here described may be adapted to be used in a system in which the input raw EEG signals and noise layer signals are analog signals. In either case, however, the signal data is processed in real-time, or with a few milliseconds delay so that output or storage is essentially immediate.
[0087]
[0088] Generally, EMG signals have a much higher amplitude than EEG signals, by a great deal. To adapt to this, the system receives the EMG signal 51 and the second layer noise signal 53, and scales down the EMG amplitude as set out in
[0089] The EMG may be an analog signal if the EEG apparatus is one in which the EEG remains analog, or a digital one in which the EEG signal has been converted to digital, as in the preferred embodiment EEG apparatus described above. In either case, the second-layer noise signal is sampled for a period of milliseconds, e.g. 100 milliseconds or less, and the amplitude range during that period is determined (step 55). That amplitude range is then used to scale down the EMG output data and normalize it (step 57) so that it doesn't drown out all other data. The scaled-down EMG data is then summed with the second layer noise data (step 59) to yield immersive noise data 61, which contains essentially all of the environmental noise to which the EEG is subject. Merging the EMG in the noise-layer data after adjusting the EMG amplitude with the amplitude of the noise from the noise layer ensures that both can be identified during post-processing. That immersive noise data is supplied to the signal processor 49 for removal from the raw EEG signal (step 8 or
[0090]
[0091] The commonly used “forward” ASR method determines the components of the “noise-free” signal offline (i.e., before use of the EEG apparatus) using principal component analysis (PCA). The ASR then tries to find the components of the noise-plus-signal mixture during the EEG reading that have the same characteristics as the “noise-free” components that were figured out beforehand, and then outputs those components as the cleaned signal.
[0092] In contrast, the present method receives the pure noise and EMG from the immersive noise data as though it were the “noise-free” data, and then tries to find the EEG components that are the most similar to immersive noise data components. Those similar noise components are then rejected from the EEG electrode output, producing remaining EEG components that have minimized artifacts.
[0093] As shown in the diagram of
[0094] The immersive noise data signal is then input to the ASR process as though it were the “noise-free” offline signal 65 input to the ASR in the prior art. In the present design, however, the pure immersive noise data signal, without the EEG signal, is inputted and subjected to PCA analysis (step 67) that converts the immersive noise signal data into data defining a set of principal components 69, i.e., constituent waveforms of the noise.
[0095] The EEG output 63 is from the inside electrodes 3, and is a combination of noise and the EEG biosignals 71. That signal is also subjected to PCA in real time (step 73) to yield data defining another set of principal components 75 containing components of both the noise and the desired EEG signals.
[0096] The data defining the two sets of principal components (i.e., the components of the EEG-plus-noise, and the components of the immersive noise alone) are then compared with each other in a component clustering step 77, in which the set of principal components are divided into data defining a set of the principal components found in both the EEG-plus-noise and immersive noise signals (79), and data defining the principal components found only in the EEG-plus-noise signals (81). The shared components are the noise part of the signals, and are output at step 83 as data for analysis, if desired. The components found exclusively in the outputs from the inner electrodes are the clean EEG signal, and are also output at 85 as the clean EEG signal. This corresponds to step 8 of the flowchart in
[0097] It should be noted that the PCA method is an exemplary method to decompose signals to its components. Other source-separation method including independent component analysis, canonical correlation analysis, empirical mode decomposition, variational autoencoders, singular value decomposition, and/or other artificial intelligence techniques can be used based on the use of the systems for the EXG applications.
[0098] Three widely used EEG referencing methods of the prior art are shown in
[0099] In all of these prior-art approaches, the reference signal is derived from the scalp, similar to EEG signals. Therefore, the EEG biodata signals are also partly canceled by use of a reference signal that is not electrically isolated from the EEG electrodes.
[0100] The determination of the noise layer signal to be removed from the raw EEG signal may be determined in a number of ways in the system of the invention.
[0101] One method is illustrated in
[0102] This average noise method can be improved by using the method of
[0103]
[0104] This method may further be improved by first combining the noise signals of each outer-layer electrode 13 with a scaled immersive noise derived from electrodes sensing EMG, as described above in the method of
[0105] Another method for determining the noise present in the system may use a trained or adaptive neural network, or a time-series generative neural network, such as a conditional time-series adversarial network (ctGAN), that is trained to identify and/or augment noise signals. In that context, training may take place by providing the GAN with a publicly available dataset of electrode outputs for EXG, and EEG in particular from public repositories such as openenuro.org, or eegnet.org to learn the features of “clean” EEG signals, including but not limited to learning the latent features of the signals to be used as templates for clustering of the components as discussed in 77,
[0106] Generally, the noise signal output derived by any of the above methods, i.e., the average of the second-layer electrode outputs, the combination of the second-layer outputs with EMG signals, and the use of the corresponding outer-layer electrode signal (with or without an EMG signal) is compared with and eliminated from the raw EEG signal from the inner layer electrode. This may be accomplished by using the EEG reference noise output from any of these methods as input to the reverse ASR method shown in
[0107] Although the use of EEG signal detection is customarily in the medical area, there are new applications for the use of EEG devices to which the present invention is applicable. In particular, virtual-reality headsets, augmented-reality gear, and wearables that have embedded biosignal sensors, including EEG electrodes, can derive a benefit from the noise cancellation systems described herein, and can as a result provide a direct brain-machine interface in the headset.
[0108] The terms used herein should be understood to be terms of description rather than limitation, as those of skill in the art with this disclosure before them will be able to make modifications in the disclosed system without departing from the spirit of the invention.