An exemplary embodiment of the present disclosure provides a method of communication, the method comprising receiving a signal from a subject, wherein the signal represents activity in a brain of the subject associated with one or more spatiotemporal movements of one or more portions of the subject's body, correlating the signal to a portion of a coded language system and outputting the portion of the coded language system.

An exemplary embodiment of the present disclosure provides a method of communication, the method comprising receiving a signal from a subject, wherein the signal represents activity in a brain of the subject associated with one or more spatiotemporal movements of one or more portions of the subject's body, correlating the signal to a portion of a coded language system and outputting the portion of the coded language system.

Some implementations include methods for communicating features of images to visually impaired users. An image to be displayed on a touch sensitive screen of a computing device may include one or more objects. Each of the one or more objects may be associated with a bounding box. A contact with the image may be detected via the touch sensitive screen. The contact may be determined to be within a bounding box associated with a first object of the one or more objects. Responsive to detecting the contact to be within the bounding box associated with the first object, a caption of the first object may be caused to become audible and the touch sensitive screen may be caused to vibrate based on a vibration pattern unique to the first object.

Systems and methods associated with a vehicle are provided. The systems and methods include an occupant output system including an output device, a camera or other perception device, and a processor in operable communication with the occupant output system and the camera or other perception device. The processor is configured to execute program instructions to cause the processor to: receive image or other perception data from the camera or other perception device, the image or other perception data including at least part of a head and/or body of an occupant of the vehicle, analyze the image or other perception data to determine if the occupant is of hearing and vision impaired, when the occupant is determined to be of vision and hearing impaired, decide on an output modality to assist the occupant, and generate an output for the occupant on the output device, and in the output modality.

Communication systems, methods, and non-transitory machine-readable storage media are disclosed herein. A communication system may include a communication device configured to receive a video stream including sign language content and any content indicators associated with the video stream during a real-time communication session within a single communication device or between a plurality of communication devices. The communication system may also include a translation engine configured to automatically translate the sign language content into word content during the real-time communication session without assistance of a human sign language interpreter. Further, the communication system may be configured to output the word content translation to a communication device during the real-time communication session.

A computer-implemented method, a computer system and a computer program product enhance user interaction with a virtual or augmented environment. The method includes obtaining a user profile. The user profile includes a constraint of a user. The method also includes identifying a plurality of objects in the augmented reality environment. In addition, the method includes determining an intent of the user with respect to navigating the augmented reality environment. The method further includes calculating a probability of interaction between the user and an identified object based on the intent. Lastly, the method includes generating an enhancement threshold for each of the identified objects based on the probability of interaction and the constraint of the user.

A device and a method storing accommodation measure evaluation data that associates an accommodation measure for a person in a minority group with evaluation of the accommodation measure are provided. When the accommodation measure to be provided for the person in the minority group is input, an evaluation of the accommodation measure to be provided is acquired based on the input accommodation measure and the accommodation measure evaluation data, and the evaluation is displayed on a display monitor or the like. Furthermore, a higher evaluation is given to a specific accommodation measure (first accommodation measure) than another accommodation measure (second accommodation measure), which enables the more detailed evaluation to be performed.

Implementations described herein relate to methods, systems, and computer-readable media for accessible computer-user interactions. For example, a method can include displaying a graphical user interface on a display screen. The graphical user interface includes a virtual assessment, the virtual assessment is representative of an assessment examination, and the graphical user interface further comprises a graphical element that represents a portion of a logical problem of the assessment examination. The method can also include receiving a signal indicative of placement of a physical object onto the display screen above the graphical element, repositioning the graphical element responsive to physical movement of the physical object on the display screen, and generating a portion of an assessment score based at least in part on one or more of: physical movement of the physical object on the display screen, the signal, or the repositioning of the graphical element.

Systems and methods relating to displaying images are disclosed. In one embodiment, sensor data is received via one or more sensors of a wearable head device comprising a display, the sensor data indicative of a surrounding environment of a user of the wearable head device. An image can be determined based on the sensor data, the image corresponding to the surrounding environment. A visibility of a first portion of the image corresponding to a first portion of the surrounding environment can be enhanced. Enhancing a visibility of a second portion of the image corresponding to a second portion of the surrounding environment can be forgone. The enhanced first portion of the image and a view of the second portion of the surrounding environment can be presented concurrently via the display of the wearable head device.

Custom alerts may be generated based on sound type indicators determined using a machine learning classification model trained on user-provided sound recordings and user-defined sound type indicators. A device may provide a sound recording and a type indicator identifying an entity that made a sound in the recording for storage in a database that includes a plurality sound recordings associated with a plurality of type indicators. A machine learning classification model may be trained based on the stored recordings, including the user-defined recordings. The model may be used to classify sounds recorded by other devices and generate alerts identifying the type of sound. Thus, multiple users may contribute data to customize machine learning models that recognize sounds and generate alerts based on user-defined identifiers.