A system, including a first prosthetic device configured to evoke a hearing percept based on a first ambient sound and a second non-invasive device configured to stimulate skin based on a second ambient sound generated by a voice.

A system, including a first prosthetic device configured to evoke a hearing percept based on a first ambient sound and a second non-invasive device configured to stimulate skin based on a second ambient sound generated by a voice.

A method for providing information to a user, the method including: receiving an input signal from a sensing device associated with a sensory modality of the user; generating a preprocessed signal upon preprocessing the input signal with a set of preprocessing operations; extracting a set of features from the preprocessed signal; processing the set of features with a neural network system; mapping outputs of the neural network system to a device domain associated with a device including a distribution of haptic actuators in proximity to the user; and at the distribution of haptic actuators, cooperatively producing a haptic output representative of at least a portion of the input signal, thereby providing information to the user.

A movement and expression sensor has a plurality of fiber Bragg gratings (FBG) disposed along the length of an optical fiber, and the optical fiber is placed in contact with a subject's skin surface. The sensors are interrogated for reflected wavelength, which is converted into a temperature or a strain. A series of such measurements can be made to determine the movement or position of the sensor location. A garment may be formed using the sensors and an elastomeric material, such that the sensors may be worn and removed, and the movements of the elastomer in the areas of sensors measured as a wavelength shift to characterize movement or estimate location. The elastomeric garment may be formed as a mask, or a sock, such as for use with a face, or foot.

A movement and expression sensor has a plurality of fiber Bragg gratings (FBG) disposed along the length of an optical fiber, and the optical fiber is placed in contact with a subject's skin surface. The sensors are interrogated for reflected wavelength, which is converted into a temperature or a strain. A series of such measurements can be made to determine the movement or position of the sensor location. A garment may be formed using the sensors and an elastomeric material, such that the sensors may be worn and removed, and the movements of the elastomer in the areas of sensors measured as a wavelength shift to characterize movement or estimate location. The elastomeric garment may be formed as a mask, or a sock, such as for use with a face, or foot.

An approach to notifying a person who is hard of hearing of audible events based on a configurable device. The device has microphones and associated buttons mounted on its surface. The user programs the device by depressing a selected button longer than a preconfigured time to place the device in listen mode. The user generates the desired audible event and the device records the audible event. The selected button is depressed again to instruct the device to associate the audible event with a visual alarm indicator of colored/flashing lights and/or a text projection. The device listens for the audible event and activates the visual alarm indicator when the device detects the audible event.

An apparatus and method for use in treating tinnitus, employs a sound processing unit, a tactile unit, and an interface therebetween. The tactile unit comprises an array of stimulators each of which can be independently actuated to apply a tactile stimulus to a subject, and an input for receiving a plurality of actuation signals from the interface and directing individual actuation signals to individual stimulators. The sound processing unit receives an audio signal at an input, analyses the signal with a digital signal processor to generate the actuation signals which are representative of the audio signal, and provides the plurality of actuation signals to the interface. In a preferred embodiment the digital signal processor divides the audio signal into a series of frames in the time domain, performs a transform on each frame to generate a set of coefficients representing said frame, and maps the set of coefficients to a set of actuation signals to be applied to the array.

An apparatus and method for use in treating tinnitus, employs a sound processing unit, a tactile unit, and an interface therebetween. The tactile unit comprises an array of stimulators each of which can be independently actuated to apply a tactile stimulus to a subject, and an input for receiving a plurality of actuation signals from the interface and directing individual actuation signals to individual stimulators. The sound processing unit receives an audio signal at an input, analyses the signal with a digital signal processor to generate the actuation signals which are representative of the audio signal, and provides the plurality of actuation signals to the interface. In a preferred embodiment the digital signal processor divides the audio signal into a series of frames in the time domain, performs a transform on each frame to generate a set of coefficients representing said frame, and maps the set of coefficients to a set of actuation signals to be applied to the array.

A hearing device may provide hearing-to-touch sensory substitution as a therapeutic approach to deafness. Through use of signal processing on received signals, the hearing device may provide better accuracy with the hearing-to-touch sensory substitution by extending beyond the simple filtering of an incoming audio stream as found in previous tactile hearing aids. The signal processing may include low bitrate audio compression algorithms, such as linear predictive coding, mathematical transforms, such as Fourier transforms, and/or wavelet algorithms. The processed signals may activate tactile interface devices that provide touch sensation to a user. For example, the tactile interface devices may be vibrating devices attached to a vest, which is worn by the user. The vest may also provide other types of information to the user.

A hearing device may provide hearing-to-touch sensory substitution as a therapeutic approach to deafness. Through use of signal processing on received signals, the hearing device may provide better accuracy with the hearing-to-touch sensory substitution by extending beyond the simple filtering of an incoming audio stream as found in previous tactile hearing aids. The signal processing may include low bitrate audio compression algorithms, such as linear predictive coding, mathematical transforms, such as Fourier transforms, and/or wavelet algorithms. The processed signals may activate tactile interface devices that provide touch sensation to a user. For example, the tactile interface devices may be vibrating devices attached to a vest, which is worn by the user. The vest may also provide other types of information to the user.