An assistive device and method for non-visually discerning a three dimensional (3D) real-world area surrounding a user, comprises a haptic feedback interface. The assistive device receives input to select a mode in the assistive device and based on the selected mode, determines each of a plurality of objects within a first proximity range of the assistive device as a relevant object or a non-relevant object to obtain a set of relevant objects and a set of non-relevant objects. The assistive device determines a scaling factor based on the first proximity range and the selected mode, and further adjusts sizes of the set of relevant objects to map the set of relevant objects with a set of haptic elements of the haptic feedback interface. The assistive device generates touch-discernible feedback on the haptic feedback interface to enable the user to non-visually discern the 3D real-world area surrounding the user.

An eyesight device for the visually impaired comprises a case having a front, rear and side walls. An ultrasonic sensor is provided on at least the front wall although, preferably, ultrasonic sensors are provided on the front and side walls to provide a greater range of peripheral vision. A microcontroller within the case is coupled to the ultrasonic sensor. A power source energizes the microcontroller. An audible signal generating means is adapted to generate an audible signal. The microcontroller is programmed to receive the output of the ultrasonic sensor and computing the distance between the case and an obstacle spaced from the case and energize the audible signal generating means when the distance is less than a preselected threshold distance. Attaching means is provided for attaching the case to an item of clothing of the user to free the hands of the user.

A system and method for providing indoor situational awareness and navigational aid for the visually impaired user, is disclosed. The processor may receive input data. The processor may enhance the image based upon the angle and the depth information. The processor may determine “directional saliency”, “saliency at rest” and “saliency in motion” of the enhanced image of the scene to provide situational awareness and generate a virtual graph with a grid of nodes. The processor may probe each node in order to check whether or not the point corresponding to said node is on a floor and determine the shortest path to a destination in the virtual graph by only considering the points on the floor. The processor may convert the description of the shortest path and the scene into one or more of audio or Braille text instruction to the user.

Provided is an information processing apparatus capable of presenting information in a presentation way that allows each user to easily accept information. The information processing apparatus including a processing unit configured to present content to a user on a basis of sensor information acquired by a sensor configured to detect reaction of the user to a stimulus given to the user.

A device for providing haptic sensation includes a haptic feedback interface. A plurality of videos each recording a real time or near-real time event in a three-dimensional real-world area from a different viewing angle is received and a user input via a mode selector in form of at least one of a gesture or a physical touch input on the mode selector to indicate a selection of an image-capture device is received, wherein the selected image-capture device captures a video of an event from a specific viewing angle that a user prefers to experience. A plurality of different motion of a plurality of objects in an upcoming scene of a captured video is detected based on a look-ahead buffer of the video. One or more movable haptic cues are generated as a different amount of pressure on the haptic feedback interface in synchronization with a current scene.

An eyesight device for the visually impaired comprises a case having a front, rear and side walls. An ultrasonic sensor is provided on at least the front wall although, preferably, ultrasonic sensors are provided on the front and side walls to provide a greater range of peripheral vision. A microcontroller within the case is coupled to the ultrasonic sensor. A power source energizes the microcontroller. An audible signal generating means is adapted to generate an audible signal. The microcontroller is programmed to receive the output of the ultrasonic sensor and computing the distance between the case and an obstacle spaced from the case and energize the audible signal generating means when the distance is less than a preselected threshold distance. Attaching means is provided for attaching the case to an item of clothing of the user to free the hands of the user.

A device for providing haptic sensation includes a haptic feedback interface. A plurality of videos each recording a real time or near-real time event in a three-dimensional real-world area from a different viewing angle is received and a user input via a mode selector in form of at least one of a gesture or a physical touch input on the mode selector to indicate a selection of an image-capture device is received, wherein the selected image-capture device captures a video of an event from a specific viewing angle that a user prefers to experience. A plurality of different motion of a plurality of objects in an upcoming scene of a captured video is detected based on a look-ahead buffer of the video. One or more movable haptic cues are generated as a different amount of pressure on the haptic feedback interface in synchronization with a current scene.

One or more computing devices, systems, and/or methods for controlling an output device are provided. For example, features are extracted from data points of an object. A set of data points are identified from the data points based upon the set of data points having features corresponding to target features. Marker elements are assigned to the set of data points. A mapping structure is used to assign output indicators to the marker elements. The output device is controlled to provide output indicators assigned to marker elements as the marker elements become a current focus of the user navigation.

An integrated pedestrian access system configured to communicate with one or more traffic controllers that control a plurality of pedestrian signal heads to convey pedestrian signal indications to a pedestrian proximate a pedestrian crosswalk is provided. The integrated pedestrian access system includes at least one first receiver communicatively coupled to the one or more traffic controllers and includes at least one first pedestrian pushbutton for receiving a pedestrian signal request from the pedestrian and at least one second receiver communicatively coupled to the one or more traffic controllers including at least one second pedestrian pushbutton. At least one first receiver wirelessly transmits the pedestrian signal request and wirelessly receives an acknowledgment responsive to the pedestrian signal request. The receivers each wirelessly transmit and receive information related to a status of the pedestrian crosswalk or a status of the pedestrian signal indications displayed on at least one pedestrian signal head.

The ultrasonic sound guide system presents the audio broadcasting system based on the inaudible ultrasonic sound to assist the indoor and outdoor navigation of the visually impaired. The transmitters are placed at the point of interest to propagate the frequency modulated voice signal in ultrasonic sound range. The receiver device is carried by the visually impaired in wearable device form to receive the ultrasonic sound for the voice signal via demodulation. Since the ultrasonic sound demonstrates the acoustic properties, the directivity, attenuation, and superposition of ultrasonic sound provide the acoustic clue to the receiver device user for localizing the transmitter positions. The visually impaired hear the designated voice signal and follow the signal strength to arrive at the specific location. The ultrasonic sound guide system is useful device to localize the place in near field without touching the braille. The receiver device can be any independent form such as eyeglasses, neckband, walking cane attachment device, hand-held device, etc. those are not blocking the ear canal. Also, the receiver device can be realized by smartphone application software using the hardware and sensors in the smartphone.