Methods, systems, and products estimate distances to aid a visually impaired user of a mobile device. As the user carries the mobile device, a camera in the mobile device captures images of a walking cane. The images of the walking cane are analyzed to infer a distance between a tip of the walking cane and the mobile device. The distance may then be used by navigational tools to aid the visually impaired user.

A mobility tool for the blind and visually impaired includes a rod and an earpiece. The earpiece is configured to position on an ear of a user so that a first speaker is positioned proximate to an ear canal of the ear. A sensing module is coupled to a lower end of the rod and is configured to detect a temperature hazard, a water hazard, and a traffic hazard. A navigation and communications module is coupled to an upper end of the rod and is operationally coupled to the sensing module and the earpiece. The navigation and communications module comprises a GPS transceiver that is configured to send and receive location coordinates. The sensing module is configured to detect a respective hazard along a route, positioning the first speaker to selectively broadcasting directions for the route and a warning of the respective hazard to the user.

A tactile or haptic guidance device incorporates a LIDAR assembly and servo motor assembly or linear actuators to provide tactile feedback to the user. The LIDAR assembly determines obstacles in the path of the user and the micro-controller uses the LIDAR data to send a signal to the servo motor assembly or linear actuators, which will cause translational or rotational movement along one or more axes with appropriate amounts of force to provide tactile feedback to the user about objects in their path.

A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.

A system is provided to minimize, or potentially eliminate, veering of a visually impaired user that is walking along a linear path. The system includes a wearable apparatus to be worn by a user. Further, the system includes a sensor, which measures ambulatory motion of the user along a linear path, that adheres to the wearable apparatus. The system also includes a processor that adheres to the wearable apparatus. The processor determines ambulatory motion deviation from the linear path according to the ambulatory motion being in excess of a predetermined angular threshold, and also determines according to one or more veering detection criteria if the ambulatory motion deviation is a veering motion or a purposeful turn. Finally, the system includes a left non-visual output device and a right non-visual output device that adheres to a right side of the wearable apparatus.

A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.

A tactile or haptic guidance device incorporates a LIDAR assembly and servo motor assembly or linear actuators to provide tactile feedback to the user. The LIDAR assembly determines obstacles in the path of the user and the micro-controller uses the LIDAR data to send a signal to the servo motor assembly or linear actuators, which will cause translational or rotational movement along one or more axes with appropriate amounts of force to provide tactile feedback to the user about objects in their path.

It is determined whether a traffic light is recognized in an image based on each of a result of a recognition operation by a traffic light first recognition unit (a recognition operation of the traffic light for an image acquired by a camera using a learned model based on pre-annotated data) and a result of a recognition operation by a traffic light second recognition unit (a recognition operation of the traffic light for an image acquired by the camera based on a feature amount of the traffic light). This makes it possible to sufficiently obtain the recognition accuracy of the traffic light, and to appropriately perform an instruction to a pedestrian according to the state of the traffic light.

When a frontmost white line of a crosswalk cannot be detected due to an obstacle existing on the crosswalk, an edge position of the obstacle closer to a pedestrian in an image acquired by a camera is set as the frontmost white line of the crosswalk. As a result, a vibration generation device vibrates in a pattern that urges the pedestrian to stop at the time when the pedestrian reaches a position before the edge position of the obstacle closer to the pedestrian, so that a stop notification for walking can be appropriately performed to the pedestrian even when the obstacle exists on the crosswalk.

An assistive apparatus for sensing the environment in the vicinity of a user, and provide feedback signals generated based on the sensing data to the user. The assistive apparatus includes a sensing device configured to collect data characterizing the environment, a processing device, including one or more processors, configured to process an input including the collected data into presentation data specifying an audio signal and/or a haptic signal, and a presentation device configured to deliver the audio signal or the haptic signal to the user.