A method facilitates communication of program information to visitors to museums and other facilities that include displays for educational interest. The method operates with a system including an APP downloadable onto a smartphone or other module, a facility system located within the museum or other facility and ability to communicate between the facility system and the smartphone or other module. The method facilitates communication with visitors needing any one or more of visual assistance, hearing assistance, and/or sensory assistance. The system includes a protocol translator which facilitates operation of the inventive method.

A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.

A wearable device is disclosed. The wearable device comprises a glove, fingers, and one or more finger band cable guides connected to each of the fingers. A servo mount is coupled to the glove and a plurality of extension and flexion servo motors are coupled to the servo mount. A plurality of flexion cables and a plurality of extension cables are coupled to the plurality of extension and flexion servo motors and the fingers. An abduction and adduction servo motor is coupled to an abduction and adduction servo motor mount coupled to the glove. A controller actuates the plurality of extension and flexion servo motors and the abduction and adduction servo motor to move the finger portions. The wearable device further comprises a gyroscope to measure wrist movement and at least one vibration motor to provide haptic feedback to a wearer.

A wearable device is disclosed. The wearable device comprises a glove, fingers, and one or more finger band cable guides connected to each of the fingers. A servo mount is coupled to the glove and a plurality of extension and flexion servo motors are coupled to the servo mount. A plurality of flexion cables and a plurality of extension cables are coupled to the plurality of extension and flexion servo motors and the fingers. An abduction and adduction servo motor is coupled to an abduction and adduction servo motor mount coupled to the glove. A controller actuates the plurality of extension and flexion servo motors and the abduction and adduction servo motor to move the finger portions. The wearable device further comprises a gyroscope to measure wrist movement and at least one vibration motor to provide haptic feedback to a wearer.

An application on a mobile phone or tablet computer or eyeglasses listens to the speech of a profoundly deaf person and interprets it in real time. It can then repeat it in a normal voice. The voice recognition is trained to the voice of the profoundly deaf person.

An application on a mobile phone or tablet computer or eyeglasses listens to the speech of a profoundly deaf person and interprets it in real time. It can then repeat it in a normal voice. The voice recognition is trained to the voice of the profoundly deaf person.

Embodiments relate to performing haptic communication using frequency decomposition of speech where dominant frequencies of a speech is detected at a speech source and then sent to a signal generator to actuate actuators mapped to the dominant frequencies. The digitized version of the speech is segmented into a plurality of frames and then a predetermined number of dominant frequencies are detected from each frame. The dominant frequencies of frequencies are sent over to the signal generator so that the actuators corresponding to the dominant frequencies are activated for a time period corresponding to the frame.

Embodiments relate to performing haptic communication using frequency decomposition of speech where dominant frequencies of a speech is detected at a speech source and then sent to a signal generator to actuate actuators mapped to the dominant frequencies. The digitized version of the speech is segmented into a plurality of frames and then a predetermined number of dominant frequencies are detected from each frame. The dominant frequencies of frequencies are sent over to the signal generator so that the actuators corresponding to the dominant frequencies are activated for a time period corresponding to the frame.

A haptic communication device includes one or more cutaneous actuators to generate haptic vibrations corresponding to actuator signals received by the one or more cutaneous actuators. A dampening member, proximate to a body of a user wearing the haptic communication device, focuses the haptic vibrations at one or more distinct locations on the body. The dampening member has one or more first openings, wherein the one or more cutaneous actuators transmit the haptic vibrations to the one or more distinct locations through the one or more first openings. A spacing member contacts the dampening member and is separated from the body by the dampening member. The spacing member has one or more second openings dimensioned to receive and secure the one or more cutaneous actuators.

A haptic communication device includes one or more cutaneous actuators to generate haptic vibrations corresponding to actuator signals received by the one or more cutaneous actuators. A dampening member, proximate to a body of a user wearing the haptic communication device, focuses the haptic vibrations at one or more distinct locations on the body. The dampening member has one or more first openings, wherein the one or more cutaneous actuators transmit the haptic vibrations to the one or more distinct locations through the one or more first openings. A spacing member contacts the dampening member and is separated from the body by the dampening member. The spacing member has one or more second openings dimensioned to receive and secure the one or more cutaneous actuators.