GHz-THz ULTRASONICS AND OPTICS FOR NEUROTECHNOLOGY DEVICES, METHODS, AND APPLICATIONS
20210187329 · 2021-06-24
Assignee
Inventors
Cpc classification
H10N39/00
ELECTRICITY
A61B5/0084
HUMAN NECESSITIES
B81B2201/0271
PERFORMING OPERATIONS; TRANSPORTING
International classification
B06B1/06
PERFORMING OPERATIONS; TRANSPORTING
Abstract
An integrated GHz ultrasonic neuro-cognitive system including a chip-cyborg having a network of biological neurons that forms a biological information processor, which can be controlled by electronics, optics, and GHz ultrasonic beams. In one example, the chip-scale microsystem includes a CMOS chip with RF CMOS and piezoelectric thin film transducers that can generate GHz ultrasonic waves, which can be phased to form narrow beams, achieving significant ultrasonic intensity to affect neurons. With a sufficient number of ultrasonic pixels, the focal point of the beam can be narrow enough to focus effect specific section of a neuron to enhance or decrease synaptic weights owing to ultrasonic radiation forces and acoustic streaming.
Claims
1. A neuro-cognitive system, comprising: a plurality of cognitive units, wherein the cognitive units are connected; a substrate having at least one surface; an electrode configured to detect an electrical output from at least one of the plurality of cognitive units; a CMOS chip attached to the surface of the substrate; a plurality of transducers connected to the CMOS chip; wherein each of the plurality of transducers is configured to emit a phased ultrasonic beam which extends from the respective transducer toward the surface of the substrate.
2. The system of claim 1, wherein the substrate supports the growth of cognitive units, further wherein the cognitive units are neurons or nerves.
3. The system of claim 1, further comprising a microfluidic cavity in the substrate, the microfluidic cavity configured to receive the plurality of cognitive units.
4. The system of claim 1, wherein each of the plurality of transducers is a piezoelectric GHz AlN transducer stack.
5. The system of claim 3, wherein the plurality of transducers are arranged in an array on the CMOS chip.
6. The system of claim 1, wherein the CMOS chip comprises a metallization stack and one or more transistors attached thereon.
7. The system of claim 1, wherein the CMOS chip has a radio frequency (RF) coil for at least one of power and data communication.
8. The system of claim 1, wherein each cognitive unit is a neuron or a group of neurons.
9. The system of claim 1, wherein the substrate has a thickness within a range of 0.1 to 1 mm.
10. The system of claim 1, wherein the electrode is an electrical pad.
11. The system of claim 1, wherein the CMOS chip comprises a thickness within a range of 500 to 700 μm.
12. A neuro-cognitive system, comprising: a plurality of cognitive units, wherein the cognitive units are connected; a CMOS chip having a top surface and a bottom surface; a plurality of transducers connected to the CMOS chip; and wherein each of the plurality of transducers is configured to emit an ultrasonic pulse to at least a portion of the plurality of cognitive units.
13. The system of claim 12, wherein each of the transducers has a frequency within the 100 to 200 GHz range.
14. The system of claim 12, wherein the plurality of transducers are arranged in an array.
15. The system of claim 12, further comprising a radio frequency (RF) coil connected to the CMOS chip.
16. The system of claim 15, further comprising a thin film battery wirelessly connected to the RF coil.
17. The system of claim 12, wherein each cognitive unit is a neuron or a group of neurons, and the plurality of cognitive units are connected via one or more synapses for each cognitive unit.
18. The system of claim 11, wherein the plurality of cognitive units form a network and the network is programmable.
19. The system of claim 11, wherein the plurality of transducers is configured to perform at least one of: extract action potentials, program synaptic weights, modulate neuron network and control cell growth.
20. A method for reading an electrical output of one or more cognitive units, comprising the steps of: providing a neuro-cognitive system having a substrate with a top surface and a bottom surface, a microfluidic cavity within the top surface, an electrode extending into the microfluidic cavity, a CMOS chip attached to the bottom surface of the substrate, and a plurality of piezoelectric GHz transducers connected to the CMOS chip; placing one or more cognitive units into the microfluidic cavity, each of the one or more cognitive units having electrically excitable cells; emitting a phased ultrasonic beam from at least one of the plurality of piezoelectric GHz transducers; wherein the phased ultrasonic beam extends from the respective piezoelectric GHz transducer toward the top surface of the substrate; and detecting, via the electrode, the electrical output of at least one of the one or more cognitive units.
21. The method of claim 20, wherein the plurality of piezoelectric GHz transducers are arranged in an array on the CMOS chip.
22. The method of claim 20, wherein the CMOS chip has radio frequency (RF) communication.
23. The method of claim 20, wherein the CMOS chip comprises a thickness within a range of 500 to 700 μm.
24. The method of claim 20, further comprising the step of taking an optical image of the top surface of the substrate.
25. The method of claim 24, further comprising the step of transmitting the optical image to a control computer.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0012] One or more aspects of the present invention are particularly pointed out and distinctly claimed as examples in the claims at the conclusion of the specification. The foregoing and other objects, features, and advantages of the invention are apparent from the following description taken in conjunction with the accompanying drawings in which:
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
DETAILED DESCRIPTION OF THE INVENTION
[0022] Aspects of the present invention and certain features, advantages, and details thereof, are explained more fully below with reference to the non-limiting examples illustrated in the accompanying drawings. Descriptions of well-known structures are omitted so as not to unnecessarily obscure the invention in detail. It should be understood, however, that the detailed description and the specific non-limiting examples, while indicating aspects of the invention, are given by way of illustration only, and are not by way of limitation. Various substitutions, modifications, additions, and/or arrangements, within the spirit and/or scope of the underlying inventive concepts will be apparent to those skilled in the art from this disclosure.
[0023] Referring now to the figures, wherein like reference numerals refer to like parts throughout,
[0024] The bottom surface 16 of the substrate 12 comprises a CMOS chip 18. In the preferred embodiment, the CMOS chip 18 has RF CMOS technology, which uses RF for external powering and communication by RF wireless interlinks. As shown in
[0025] Still referring to
[0026] Referring back to
[0027] Still referring to
[0028] Turning now to
[0029] Referring now to
[0030] Thus, in both embodiments (
[0031] By operating at GHz frequencies, sonic beams 28 are formed with 2-5 μm focal points ˜1-2 degree beam widths that can be used to interrogate and scan a neuron 100 such that specific sites of the neuron with specific synaptic connections can be exposed (
[0032] The system 100 in
[0033] In an embodiment, a back-propagation or back-propagation like algorithm is implemented to program a biological neural network. The purpose of programing the system 10 is to make the system 10 generate a desired output neural activation (at pre-established output neurons) in response to a set of input stimuli. The electrical, optical, and ultrasonic data (received from ultrasonic reflected signals scanned over the neural formed layer to the silicon surface with incident sonic waves) will be interpreted by the computer program, which will in turn establish an ultrasonic beam protocol that will modify the weights to reduce the difference between present output and desired output.
[0034] In an embodiment for a method for stimulating, differentiating, positioning, and reading signals from neural cells, ultrasonic and acoustics are used with optical verification. Axons and neurons 100 will be placed on a surface 14 of a chip 18 with AlN (Aluminum nitride) piezoelectric thin film transducer arrays 26 (with high frequencies in the 100-200 GHz range), as shown in
[0035] The neurons 100 and related axons are monitored optically on the top surface 14 of the ultrasonic chips 18, while the ultrasonic and acoustic transducers 24 will be used to scan the surface 14 from the backside (or bottom surface 16). To quantify neural measurements and modulation, optical imaging is used, such as optical imaging of ion channel firing using optical labels, such Ca+ specific dyes. Other optical tools known in neural imaging can be used to image both single cell layers and tissue slices of up to 100-300 μm using two photon imaging.
[0036] The amplitude and phase of the return ultrasonic pulses from the neurons 100 will be used to detect action potential over a long time. Physical approaches include: (a) The neuron mass density variations and rigidity of the axons wall will generate sufficient ultrasonic impedance contrast to detect the cell on the transducers 24, as shown in
[0037] Regarding neuromodulation, one or more GHz ultrasonic pixels can be phased in a way to add coherently on the tissue side such that the intensity of the ultrasound is enough to trigger effects that lead to neuromodulation. The acoustic intensity can be written as l=pcv.sub.p.sup.2=pcω.sup.2 u.sub.p where ρ is the density of water (˜1000 kg/m.sup.3), c is the speed of sound (˜1500 m/s), v.sub.p is the peak particle velocity, which is equal to ω.sup.2 u.sub.p.sup.2 where ω is the angular frequency, and u.sub.p is the peak displacement of the sonic pulse. The peak displacement of a sonic pulse excited by one of the transducers can be estimated to be d.sub.33V where d.sub.33 is the piezoelectric coefficient and V is the applied voltage, which is typically in the 1 to 3 volts range for CMOS compatibility. For N transducer phased to add up coherently in water, and assuming a focal point of approximately a wavelength, we estimate the strain in water to be
which is ˜60*10.sup.−6 for 1 GHz and one AlN transducer (N=1, d.sub.33˜6*10.sup.−12C/N).
[0038] Mechanically induced strain on cellular membranes have been known to induce ion channel activation at 10-50μ-strain, indicating that there should be effects of the sonic beam on membrane ion channels seen. Since this strain is at a high frequency, and the mechanisms of the ion channels are likely to be nonlinear functions of applied strain owing to configurations of protein sub-assemblies that have nonlinear properties, the AC strain field is likely to be rectified to produce observable effects. In addition to direct strain, there may also be effects of radiation force, acoustic streaming. The radiation force
can be very high owing to high absorption at GHz frequencies. Related to acoustic radiation forces is acoustic streaming induced by gradients in radiation forces that can excite fluid flow vortices, which in turn can cause shear stresses. In order to quantify the effect on modulation of action potential generation, optical measurements are relied on to independently verify action potentials. Optical Ca.sup.2+ imaging will be used to measure the neural activity timed with US pulse excitation. The neural activity modulation will be quantified by varying the sonic field and frequency and correlating electrical, ultrasonic execution to electrical excitation. We plan on using an in vitro system that will allow us to characterize neuromodulation on the cellular level and build this up to a 3D cell culture system to show that we can localize effects of ultrasonic stimulation at varying depths from the transducer, using both multi-photon Ca.sup.2+ imaging and electrode arrays with the ability to obtain readings from several micrometers in depth. In some embodiments, the depth is within the range of 1 to 1000 micrometers.
[0039] Regarding cell differentiation using ultrasonic forces, ultrasonic beams 28 can induce radiation forces and acoustic streaming on the transducer surface that can apply time-averaged DC mechanical stimuli to cells. GHz ultrasonic with smaller wavelengths will enable very tightly focused beams for excitation of cells at specific location enabling identification of mechanisms. It has been shown that the mechanical forces transmitted through the cells walls can activate proteins that can affect the nucleus by mechanical adhesion and pulling forces. Stem cells can be isolated from a cell culture using this technique of isolating cells via differences in cellular mechanics. Ultrasonics modifies surface adhesion in addition to forces on cells, as many studies have shown cells collecting at nodes of standing sonic waves. Stem cells that produce neural blastomas will be exposed to ultrasonic fields and be optically imaged for differentiation. There is the possibility for differentiation of cells and also the ability to distinguish the stage of differentiation of a cell using GHz ultrasonic exposure. Therefore, the experimental design takes place in two parts.
[0040] The first set of experiments being whether the interaction of cells with substrate can be detected, and subsequently biomechanics, using ultrasonic stimulation. The second part of experimentation will be to determine, using this biomechanics data, whether a cell has been differentiated after exposure to ultrasound. Cellular biomechanics has been investigated for a long time by using substrate interactions, a variety of force microscopy techniques, and optical trapping. Previous studies have shown the use of ultrasonics to create acoustic tweezers that can be used to deduce cellular forces. Using a similar approach, data can obtained that quantifies cellular response to ultrasonics, and by extension cellular mechanics, using optical techniques to connect this to differentiation. Then, on longer time scale, cells can be influenced with ultrasound and deduce whether cells can be differentiated, and do so in a localized manner, creating microenvironments of differentiated cells without having to rely heavily on microfluidics, much like many other studies that show in vitro differentiation and tissue engineering with complex structures defining differentiation factor compartments. In addition to this one mechanism of ultrasonic differentiation, ultrasound has been shown to influence cellular uptake, which means that cells influenced by ultrasound, due to similar mechanisms presented in
[0041] To base the observed results on hypothesis based on physical principles, and to explain phenomenological observations, analytical and COMSOL based finite element models of the transducers and interactions with biological tissue can be developed. FEM models of ion channels embedded in membranes will be simulated in COMSOL using nonlinear material models corresponding to those of tissue like materials. The sonic fields will interact with the models to allow computational verification of strain generated, radiation force, and acoustic streaming based on the velocity fields extracted from COMSOL. The FEM results can be verified from first order analytical models of ultrasonic absorption and field distribution based on piston models of the transducer in the fluids with varying degree of random heterogeneity owing to neurons distributed within tissue.
[0042] All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and/or ordinary meanings of the defined terms.
[0043] While various embodiments have been described and illustrated herein, those of ordinary skill in the art will readily envision a variety of other means and/or structures for performing the function and/or obtaining the results and/or one or more of the advantages described herein, and each of such variations and/or modifications is deemed to be within the scope of the embodiments described herein. More generally, those skilled in the art will readily appreciate that all parameters, dimensions, materials, and configurations described herein are meant to be exemplary and that the actual parameters, dimensions, materials, and/or configurations will depend upon the specific application or applications for which the teachings is/are used. Those skilled in the art will recognize, or be able to ascertain using no more than routine experimentation, many equivalents to the specific embodiments described herein. It is, therefore, to be understood that the foregoing embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, embodiments may be practiced otherwise than as specifically described and claimed. Embodiments of the present disclosure are directed to each individual feature, system, article, material, kit, and/or method described herein. In addition, any combination of two or more such features, systems, articles, materials, kits, and/or methods, if such features, systems, articles, materials, kits, and/or methods are not mutually inconsistent, is included within the scope of the present disclosure.
[0044] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprise” (and any form of comprise, such as “comprises” and “comprising”), “have” (and any form of have, such as, “has” and “having”), “include” (and any form of include, such as “includes” and “including”), and “contain” (any form of contain, such as “contains” and “containing”) are open-ended linking verbs. As a result, a method or device that “comprises”, “has”, “includes” or “contains” one or more steps or elements. Likewise, a step of method or an element of a device that “comprises”, “has”, “includes” or “contains” one or more features possesses those one or more features, but is not limited to possessing only those one or more features. Furthermore, a device or structure that is configured in a certain way is configured in at least that way, but may also be configured in ways that are not listed.
[0045] The corresponding structures, materials, acts and equivalents of all means or step plus function elements in the claims below, if any, are intended to include any structure, material or act for performing the function in combination with other claimed elements as specifically claimed. The description of the present invention has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. The embodiment was chosen and described in order to best explain the principles of one or more aspects of the invention and the practical application, and to enable others of ordinary skill in the art to understand one or more aspects of the present invention for various embodiments with various modifications as are suited to the particular use contemplated.