Systems and methods for viseme data generation are disclosed. Uncompressed audio data is generated and/or utilized to determine the beats per minute of the audio data. Visemes are associated with the audio data utilizing a Viterbi algorithm and the beats per minute. A time-stamped list of viseme data is generated that associates the visemes with the portions of the audio data that they correspond to. An animatronic toy and/or an animation is caused to lip sync using the viseme data while audio corresponding to the audio data is output.

Embodiments relate to enhancing haptic communication by using two or more cutaneous actuators to create constructive or destructive interference patterns on the receiving user's skin. The actuator signals for the two or more cutaneous actuators are shaped and generated so that the two or more cutaneous actuators cause vibrations on the receiving user's patch of skin to increase or decrease. In this way, various enhancement to haptic communication can be achieved.

A method including receiving input indicative of a parameter related to an operating environment of an implantable portion of a prosthesis and adjusting an adjustable system of the prosthesis based on the received input.

A communication aid system includes a sound receiving device and a display device. The sound receiving device includes multiple microphones and a controller. When in a sound receiving mode, the controller controls a corresponding subset of the microphones to receive sound to generate one or more collected audio signals, and performs corresponding audio signal processing on the collected audio signal (s) to generate a processed audio signal. The display device includes an audio-to-visual converter and a display. The audio-to-visual converter receives the processed audio signal, recognizes speech information contained therein, and converts the speech information into visual information to be displayed by the display.

A reference acoustic input is processed into a quantization representation such that the quantization representation comprises acoustic components determined from the reference acoustic input, wherein the acoustic components comprise amplitude, rhythm, and pitch frequency of the reference acoustic input. A visual representation is generated that simultaneously depicts the acoustic components comprising amplitude, rhythm, and pitch frequency of the reference acoustic input. A user spoken input may be received and similarly processed and displayed.

The glasses with display may include a bridge, two temples hingedly coupled to the bridge, and a directional microphone array, the directional microphone array including two or more microphones positioned on the bridge or the temples. The glasses with display may also include a user microphone array, the user microphone array including one or more microphones positioned on the temples and oriented toward the mouth of a user wearing the glasses with display or one or more bone conduction microphones. In addition, the glasses with display include two lenses positioned in the bridge, at least one of the lenses including a display, the display visible by the user, the display including one or more of a directional display, closed caption display, and user volume display. The glasses with display additionally include a processor adapted to receive audio signals from the directional microphone array and the user microphone array, or from a separate mobile device, the processor adapted to control the display.

A haptic communication system includes a broadband signal generator to extract parameters from sensor signals describing a message for transmission to a user. Broadband carrier signals are generated by aggregating a plurality of frequency components. Actuator signals are generated by encoding the parameters from the sensor signals into the broadband carrier signals. One or more cutaneous actuators are communicatively coupled to the broadband signal generator to receive the actuator signals. Haptic vibrations are generated corresponding to the actuator signals on a body of the user to communicate the message to the user.

In some examples, natural language processing based sign language generation may include ascertaining a speech video that is selected by a user, and determining, based on application of natural language processing to contents of the speech video, a plurality of sentences included in the speech video. For each sentence of the plurality of sentences identified in the speech video, a sign language sentence type, a sign language sentence structure, and a sentiment may be determined. For each sign language sentence structure and based on a corresponding sentiment, a sign video may be determined. Based on the sign video determined for each sentence of the plurality of sentences identified in the speech video, a combined sign video may be generated.

Methods and devices to deliver a tactile speech analog to a person's skin providing a silent, invisible, hands-free, eyes-free, and ears-free way to receive and directly comprehend electronic communications. Embodiments include an alternative to hearing aids that will enable people with hearing loss to better understand speech. A device, worn like watch or bracelet, supplements a person's remaining hearing to help identify and disambiguate those sounds he or she can not hear properly. Embodiments for hearing aids and hearing prosthetics are also described.

Embodiments relate to operating multiple cutaneous actuators to provide the sensation of motions or actions occurring within the body. A part of receiving user's body (e.g., limb or head) is placed between the cutaneous actuators. The cutaneous actuators are operated in sequence, causing the illusion of motions or actions occurring inside the body part, as opposed to patches of skin where the cutaneous actuators are located. By differing the time interval between the activation of the cutaneous actuators and/or amplitude of vibrations generated by the cutaneous actuators.