Aspects of the present invention provide an approach for non-visually mapping an environment. In an embodiment, a set of images that is within the field of view of the user is captured from a video capture device worn by the user. Environmental text that is within the set of images is identified. An aural contextual indicator that corresponds to the environmental text is then generated. This aural contextual indicator indicates the informational nature of the environmental text. An aural map of the environment is created using a sequence of the generated aural contextual indicators. This aural map is delivered to the user via an aural output device worn by the user in response to a user request.

A wearable tactile navigation device and method. The wearable tactile navigation device includes a tactile navigation actuator. The tactile navigation actuator includes a feedback contact and is configured to control the feedback contact based on a direction indication signal to generate a tactile signal having a direction indication. A direction indicated by the tactile signal substantially coincides with a suggested moving direction provided to a user of the wearable tactile navigation device.

Processing circuitry provided in a mobile device of a user requiring mobility assistance is programmed to: request multimodal personal transportation assistance from a pool of candidate companions, receive a location of a selected companion and a proposed route between the user to the selected companion, and determine an estimated time of arrival of the selected companion at a current location of the user. The proposed route includes pedestrian travel and the request for multimodal personal transportation identifies any specific needs of the user.

A motorized walking cane operated by a rechargeable battery powered linear actuator that assists a person to rise from a sitting position to a standing position and to lower from a standing position to a sitting position. The speed of the linear actuator can be adjusted with the use of a variable speed controller. The motorized lift cane can include an interface for receiving additional accessories.

The technology disclosed herein includes a navigation system for a visually impaired person. The navigation system may include a plurality of fixtures, a plurality of installations, wherein each installation is electronically connected to a fixture, and an electronic device, the electronic device configured to receive auditory or tactile signals from each installation and produce a signal indicative of a fixture location.

There is presented a system and method for providing real-time object recognition to a remote user. The system comprises a portable communication device including a camera, at least one client-server host device remote from and accessible by the portable communication device over a network, and a recognition database accessible by the client-server host device or devices. A recognition application residing on the client-server host device or devices is capable of utilizing the recognition database to provide real-time object recognition of visual imagery captured using the portable communication device to the remote user of the portable communication device. In one embodiment, a sighted assistant shares an augmented reality panorama with a visually impaired user of the portable communication device where the panorama is constructed from sensor data from the device.

A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.

Embodiments herein relate to hearing assistance devices and related systems and methods for providing visual feedback to a subject undergoing physical therapy or vestibular movement training. In an embodiment, a method of providing physical or vestibular therapy to a subject is included. The method can include prompting the subject to move in a predetermined direction by a predetermined amount as part of a first predetermined movement. The method can further include tracking movement of the subject using a first IMU disposed in a fixed position relative to the subject's head. The method can further include generating feedback data by comparing the tracked movement of the subject against the predetermined direction and amount of the first predetermined movement. The method can further include generating a feedback image using the feedback data. Other embodiments are included herein.

A system is provided to minimize, or potentially eliminate, veering of a visually impaired user that is walking along a linear path. The system includes a wearable apparatus to be worn by a user. Further, the system includes a sensor, which measures ambulatory motion of the user along a linear path, that adheres to the wearable apparatus. The system also includes a processor that adheres to the wearable apparatus. The processor determines ambulatory motion deviation from the linear path according to the ambulatory motion being in excess of a predetermined angular threshold, and also determines according to one or more veering detection criteria if the ambulatory motion deviation is a veering motion or a purposeful turn. Finally, the system includes a left non-visual output device and a right non-visual output device that adheres to a right side of the wearable apparatus.

A portable pedestrian navigation system including a computing device, a proximity sensor and an output device. The proximity sensor and the output device are communicatively coupled to the computing device and the computing device is adapted for receiving environmental data at least from the proximity sensor. Based on the environmental data, A candidate guide entity near the pedestrian is identified. Based on the environmental data, the output device is used for guiding the pedestrian in accordance with a movement of the identified candidate guide entity as a selected guide entity.