Presented herein are techniques for increasing the user experience of implantable hearing prostheses through improvements in post-implantation clinical care.

A device and associated methods for entering a PIN via tapping are disclosed. The device can be configured to determine a number of taps provided by a PIN holder on a touch sensor in representation of a PIN digit and to store the number of taps as a digit in a sequence that represents the PIN. Indications for interaction with the device can be provided to PIN holders in the form of auditory cues. A visually impaired PIN holder may be able to complete a PIN entry process by following the indications for interaction, tapping on a touch sensor a number of times equal to the value of the digit of the PIN to be entered, and performing gestures mapped to commands for the device.

Computer-implemented method of browsing a resource through voice interaction comprising the following steps: A. acquiring (100) from a user a request aimed at browsing a resource; B. downloading (130) the requested resource; C. performing a syntactic parsing (135) of the downloaded resource; D. extracting (150) from the downloaded resource one or more lists, if any, of selectable shortcuts pointing to portions inside or outside the downloaded resource through a syntactic analysis and/or a semantic analysis and/or a morphological-visual analysis of extraction of lists of selectable shortcuts on the basis of an ontology (245) corresponding to the type of resource; E. on the basis of the ontology (245) corresponding to the type of resource, building (225) a list of one or more lists of selectable shortcuts extracted in step D ordered according to a list prioritisation; F. extracting (150) from the downloaded resource one or more content elements through a syntactic analysis and/or a semantic analysis and/or a morphological-visual analysis of extraction of content elements on the basis of the ontology (245) corresponding to the type of resource; G. on the basis of the ontology (245) corresponding to the type of resource, building (290) a list of content elements extracted in step F ordered according to a content element prioritisation; H. on the basis of the lists built in steps E and G and on the basis of the ontology (245) corresponding to the type of resource, building a final structure of lists of selectable shortcuts and of content elements; I. playing (125) a voice prompt based on the final structure and starting a voice interaction with the user for browsing the resource.

Computer-implemented method of browsing a resource through voice interaction comprising the following steps: A. acquiring (100) from a user a request aimed at browsing a resource; B. downloading (130) the requested resource; C. performing a syntactic parsing (135) of the downloaded resource; D. extracting (150) from the downloaded resource one or more lists, if any, of selectable shortcuts pointing to portions inside or outside the downloaded resource through a syntactic analysis and/or a semantic analysis and/or a morphological-visual analysis of extraction of lists of selectable shortcuts on the basis of an ontology (245) corresponding to the type of resource; E. on the basis of the ontology (245) corresponding to the type of resource, building (225) a list of one or more lists of selectable shortcuts extracted in step D ordered according to a list prioritisation; F. extracting (150) from the downloaded resource one or more content elements through a syntactic analysis and/or a semantic analysis and/or a morphological-visual analysis of extraction of content elements on the basis of the ontology (245) corresponding to the type of resource; G. on the basis of the ontology (245) corresponding to the type of resource, building (290) a list of content elements extracted in step F ordered according to a content element prioritisation; H. on the basis of the lists built in steps E and G and on the basis of the ontology (245) corresponding to the type of resource, building a final structure of lists of selectable shortcuts and of content elements; I. playing (125) a voice prompt based on the final structure and starting a voice interaction with the user for browsing the resource.

A hearing assistance device adapted to be worn by a wearer comprises a processor configured to generate a sequence of audio cues that audibly guide the wearer through a series of actions involving the wearer's head and neck in accordance with a predetermined corrective or therapeutic maneuver. A speaker is configured to play back the sequence of audio cues for reception by the wearer. One or more sensors are configured to sense movement of the head during each of the actions. The processor is configured to determine if head movement for an action associated with each audio cue has been correctly executed by the wearer, and produce an output indicative of successful or unsuccessful execution of the actions by the wearer.

A voice output method is a voice output method in a moving body of public transportation. The voice output method includes: a storage step of storing a voice output to an inside of the moving body, the voice being stored by being divided into a guide voice related to information on the moving body and an advertising voice related to advertising; a determination step of determining whether or not a passenger of the moving body includes a visually impaired person; and a restraint step of, by the moving body, restraining the advertising voice from being output when determination is made that the passenger includes the visually impaired person.

A voice output method is a voice output method in a moving body of public transportation. The voice output method includes: a storage step of storing a voice output to an inside of the moving body, the voice being stored by being divided into a guide voice related to information on the moving body and an advertising voice related to advertising; a determination step of determining whether or not a passenger of the moving body includes a visually impaired person; and a restraint step of, by the moving body, restraining the advertising voice from being output when determination is made that the passenger includes the visually impaired person.

A personal navigation system includes a sensing suite (50) that is configured to find a safety route for a person; a set of modules (200) including a generation module that is configured to generate an auditory-haptic content (70) that is not perceived visually but perceived by auditory sense or haptic sense and indicates the found safety route; and a communication device (30) that is configured to communicate the auditory-haptic content to the person.

Methods, apparatus and systems for recognizing sign language movements using multiple input and output modalities. One example method includes capturing a movement associated with the sign language using a set of visual sensing devices, the set of visual sensing devices comprising multiple apertures oriented with respect to the subject to receive optical signals corresponding to the movement from multiple angles, generating digital information corresponding to the movement based on the optical signals from the multiple angles, collecting depth information corresponding to the movement in one or more planes perpendicular to an image plane captured by the set of visual sensing devices, producing a reduced set of digital information by removing at least some of the digital information based on the depth information, generating a composite digital representation by aligning at least a portion of the reduced set of digital information, and recognizing the movement based on the composite digital representation.

Methods, apparatus and systems for recognizing sign language movements using multiple input and output modalities. One example method includes capturing a movement associated with the sign language using a set of visual sensing devices, the set of visual sensing devices comprising multiple apertures oriented with respect to the subject to receive optical signals corresponding to the movement from multiple angles, generating digital information corresponding to the movement based on the optical signals from the multiple angles, collecting depth information corresponding to the movement in one or more planes perpendicular to an image plane captured by the set of visual sensing devices, producing a reduced set of digital information by removing at least some of the digital information based on the depth information, generating a composite digital representation by aligning at least a portion of the reduced set of digital information, and recognizing the movement based on the composite digital representation.