Described are techniques for automatically improving the accessibility of webpages and other content using machine learning and artificial intelligence systems. Webpage data may include visual data used to render visible elements and audio data used to render audible elements, such as digitized speech representative of at least a portion of the visible elements. In some cases, text data may be generated based on the audio data. The audio data may be modified based on target text strings, patterns, and characteristics determined in the text data, or the audio data may be analyzed directly. Additionally, user interactions with particular visible elements and corresponding audible elements may be compared. If the user interactions for a visible element exceed the user interactions for a corresponding audible element, the audio data associated with the audible element may be modified.

A Sound translating system configured to touch human skin comprising: a sound converter configured to process sound waves to a plurality of sound bands, wherein each sound band of the plurality of sound bands is represented by at least one electrical signal having specific electrical characteristics, wherein the sound converter is further configured to transmit the at least one electrical signal; at least one device comprising a plurality of actuators, wherein at least one actuator of the plurality of actuators is configured to convert the at least one electrical signal to mechanical vibration, wherein the mechanical vibration of each actuator stimulate tactile of one of a plurality of zones on the human skin, wherein the at least one actuator is dedicated to at least one predefined zone of the plurality of zones; and wherein, the predefined zone complies with a map used to allocate sound bands to zones on the human skin.

A speech assessment device and method for a multisyllabic-word learning machine, and a method for visualizing continuous audio are provided. By performing the step of starting the assessment mode, the step of selecting words to be assessed, the step of choosing to play or record, the step of recording, the step of visualization (including the step of picking out fundamental frequency, the step of defining analysis point, the step of transforming polygonal lines, and the step of simplifying the polygonal lines), the step of repeating, and the step of assessment, the speech assessment device and method for a multisyllabic-word learning machine are capable of providing assistance in oral language learning, and capable of rehabilitating patients with hearing impairment through visual aids.

A haptic device comprises a signal generator that is configured to receive an input word that is a unit of a language written using consonant-vowel pairs. The signal generator converts the input word into one or more consonant-vowel pairs of the input word. The signal generator further converts the one or more consonant-vowel pairs into a sequence of actuator signals. The sequence of actuator signals is formed from a concatenation of sub-sequences of actuator signals. Each phoneme corresponding to a unique sub-sequence of actuator signals. The haptic device further comprises a two dimensional array of cutaneous actuators configured to receive the sequence of actuator signals from the signal generator, each of the actuator signals mapped to a cutaneous actuator of the two dimensional array of cutaneous actuators.

A method comprises inputting an audio signal into a machine learning circuit to compress the audio signal into a sequence of actuator signals. The machine learning circuit being trained by: receiving a training set of acoustic signals and pre-processing the training set of acoustic signals into pre-processed audio data. The pre-processed audio data including at least a spectrogram. The training further includes training the machine learning circuit using the pre-processed audio data. The neural network has a cost function based on a reconstruction error and a plurality of constraints. The machine learning circuit generates a sequence of haptic cues corresponding to the audio input. The sequence of haptic cues is transmitted to a plurality of cutaneous actuators to generate a sequence of haptic outputs.

A haptic communication system includes a broadband signal generator to extract parameters from sensor signals describing a message for transmission to a user. Broadband carrier signals are generated by aggregating a plurality of frequency components. Actuator signals are generated by encoding the parameters from the sensor signals into the broadband carrier signals. One or more cutaneous actuators are communicatively coupled to the broadband signal generator to receive the actuator signals. Haptic vibrations are generated corresponding to the actuator signals on a body of the user to communicate the message to the user.

A haptic device comprises a signal generator that is configured to receive an input word that is a unit of a language. The signal generator converts the input word into one or more phonemes of the input word. The signal generator further converts the one or more phonemes into a sequence of actuator signals. The sequence of actuator signals is formed from a concatenation of sub-sequences of actuator signals. Each phoneme corresponding to a unique sub-sequence of actuator signals. The haptic device further comprises a two dimensional array of cutaneous actuators configured to receive the sequence of actuator signals from the signal generator, each of the actuator signals mapped to a cutaneous actuator of the two dimensional array of cutaneous actuators.

A haptic communication device includes one or more cutaneous actuators to generate haptic vibrations corresponding to actuator signals received by the one or more cutaneous actuators. A dampening member, proximate to a body of a user wearing the haptic communication device, focuses the haptic vibrations at one or more distinct locations on the body. The dampening member has one or more first openings, wherein the one or more cutaneous actuators transmit the haptic vibrations to the one or more distinct locations through the one or more first openings. A spacing member contacts the dampening member and is separated from the body by the dampening member. The spacing member has one or more second openings dimensioned to receive and secure the one or more cutaneous actuators.

A haptic communication device includes an array of cutaneous actuators to generate haptic sensations corresponding to actuator signals received by the array. The haptic sensations include at least a first haptic sensation and a second haptic sensation. The array includes at least a first cutaneous actuator to begin generating the first haptic sensation at a first location on a body of a user at a first time. A second cutaneous actuator begins generating the second haptic sensation at a second location on the body of the user at a second time later than the first time.

Embodiments relate to operating multiple cutaneous actuators to provide the sensation of motions or actions occurring within the body. A part of receiving user's body (e.g., limb or head) is placed between the cutaneous actuators. The cutaneous actuators are operated in sequence, causing the illusion of motions or actions occurring inside the body part, as opposed to patches of skin where the cutaneous actuators are located. By differing the time interval between the activation of the cutaneous actuators and/or amplitude of vibrations generated by the cutaneous actuators.