The invention discloses an electroencephalogram-controlled video input and auditory display blind guiding apparatus and method. The apparatus includes a video acquisition module, an electroencephalogram acquisition module, a processor and an audio playback module. The video acquisition module is connected to the processor, the electroencephalogram module is connected to the processor and configured to acquire an electroencephalogram signal, the audio playback module is connected to the processor, and the processor is separately connected to the video acquisition module, the electroencephalogram acquisition module and the audio playback module. According to the present invention, control of a region of interest in the blind guiding apparatus is achieved by means of the electroencephalogram signal, so that sensing a whole image and sensing details of interest in the image are switched conveniently. A region of interest in a current video is set by using the electroencephalogram, a flexible auditory display resolution and a control method are provided for a user, and the user can sense global information or local detail information of the image with the setting of the region of interest, so that the defect of low auditory display resolution is overcome effectively. The invention can be widely applied to different occasions where blind guiding is required.

A method for detecting and/or localizing keyboard accessibility failures (KAFs) in a web page is disclosed. A web page is rendered in a browser on a display portion of a computing system. A keyboard navigation flow graph based on based on keyboard-based navigation of a user with the web page. A second point-click navigation flow graph based on mouse-based navigation of the user with the web page. One or more KAFs are determined based on a comparison of the first graphical model with the second graphical model.

Methods and systems are disclosed to facilitate creating the sensation of vibrotactile movement on the body of a user. Vibratory motors are used to generate a haptic language for music or other stimuli that is integrated into wearable technology. The disclosed system in certain embodiments enables the creation of a family of devices that allow people such as those with hearing impairments to experience sounds such as music or other input to the system. For example, a “sound vest” or other wearable array transforms musical input to haptic signals so that users can experience their favorite music in a unique way, and can also recognize auditory or other cues in the user's real or virtual reality environment and convey this information to the user using haptic signals.

A method for inputting and outputting a text comprising characters is disclosed, wherein the text is input via an input unit and/or output via an output unit in the form of a combination of full text and short text. The short text is input and/or output including at least one abbreviation in the form of characters or combinations of characters, to which predefined full text contents are allocated.

A method includes displaying, on a touchscreen, a video comprising a video frame and determining, based on a saliency map of the video frame, a region of interest in the video frame. The method also includes detecting a touch on a region of the touchscreen while the video frame is displayed and generating a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest.

Methods and devices related to converting sign language are described. In an example, a method can include receiving, at a processing resource of a computing device via a radio of the computing device, first signaling including at least one of text data, audio data, or video data, or any combination thereof, converting, at the processing resource, at least one of the text data, the audio data, or the video data to data representing a sign language, generating, at the processing resource, different video data based at least in part on the data representing the sign language, wherein the different video data comprises instructions for display of a performance of the sign language, transmitting second signaling representing the different video data from the processing resource to a user interface, and displaying the performance of the sign language on the user interface in response to the user interface receiving the second signaling.

A method and system for color mapping digital visual content for improved viewing by a color vision deficient observer includes receiving the digital visual content to be color mapped, clustering color values of the digital visual content into a plurality of color clusters, assigning each color cluster to a respective one of a set of target color values in which the set of target color values have increased visual distinguishability for the color vision deficient observer; and for each color cluster, mapping the color values of the color cluster to the target color value, thereby generating a color-mapped digital visual content. One or more regions of interest of the content can be identified and the color mapping may be applied onto to those regions of interest.

A method for aligning an input interface (240) of a touchscreen (230) with an overlay (210) for the touchscreen (230) is provided. The method comprises receiving a touch input on the touchscreen (230), wherein the touch input identifies a first position on the touchscreen (230) corresponding to an alignment mark (220) of the overlay; determining, based on the received touch input, a region of the touchscreen (230) in which to render the input interface (240); and rendering the input interface (240) in the determined region of the touchscreen (230).

Wearable systems and methods to allow for a two-way communication to convey ASL signing to a deaf person and translate the ASL to sound for communication to people with normal hearing. The system will also display signs to a deaf-mute person to communicate by having signs displayed visually from the corresponding sound or text input. The input can be captured on the device or streamed to the device using short range radio and the on-board computer will translate the different lingual inputs to a final output via a wireless device speaker or display. The LIDAR sensor on the device is able to sense the depth of the signs and should work in the low-light settings.

In accordance with some embodiments, a method is performed at a first device with one or more processors, non-transitory memory, and a display. The method includes displaying, on the display, a device control transfer affordance while operating the first device based on user input from an input device that is in communication with the first device. The method includes receiving a device control transfer user input from the input device selecting the device control transfer affordance that is displayed on the display of the first device. In response to receiving the device control transfer user input, the method includes configuring a second device to be operated based on user input from the input device and ceasing to operate the first device based on user input from the input device.