A method and device for reading, writing, and communication by deafblind users is provided to enable such exemplary functions as word processing, text messaging, Internet access, and telephonic communication. By combining a chordic keyboard for user input with a self-scrolling Braille pad for reading Braille, embodiments of the invention enable the user's hands to stay in place on a user console rather than having to constantly switch back and forth between typing messages versus reading or checking for messages. This in turn enables duplex communication because the user can read or acknowledge incoming messages even while typing. It also reduces the dynamic complexity experienced in reading Braille because a body part used for reading Braille can remain constantly available for receiving messages simply by resting in place on the self-scrolling Braille pad without any swiping, thereby eliminating swiping gestures and the problem of timing them with the receipt of messages.

A refreshable Braille display device includes a housing having a surface containing a set of tactile markers thereon; a carriage in cooperation with the housing, the carriage having a surface containing a tactile marker thereon and a series of individual refreshable Braille cells positioned above the tactile marker for tactile reading by a user; and a moving mechanism for moving the carriage relative to the housing such that the tactile marker on the surface of the carriage is aligned with one of the tactile markers in the set of tactile markers on the surface of the housing.

An active, specialized stylus and sharp color graphics may be combined with a tactile display in order to increase accessibility to the blind and visually impaired. A tactile display may consist of an array of pins that may be raised to varying heights to represent contours and outlines of images that are recognizable when touched. A specialized stylus may allow the user to instantly create, touch and save tactile drawings or alter with multi-sensory feedback. A tactile and visual display may consist of an array of pins, with circular or squared-off tops. Physical attributes may be given to individual pins, the screen itself (LED), or a LCD WXGA or other type of projector may be incorporated so that enhanced visual imaging is combined with tactile graphics to give those with different levels of visual impairment a multisensory feedback when experiencing images or drawings. Also this technology may be used with autistic students and those with learning disabilities, as well as serve as a means of entertainment.

A braille teaching/autocorrecting system includes a camera configured to detect image data corresponding to at least one braille character. The braille teaching/autocorrecting system also includes a processor coupled to the camera and configured to identify the at least one braille character based on the image data and determine feedback data based on the identification of the at least one braille character.

A first touch gesture is sensed at a subset of a set of six Braille dot touch points at a virtual Braille keyboard. The first touch gesture corresponds to a Braille character. A second touch gesture is sensed that concurrently touches each of the six Braille dot touch points in the set of Braille dot touch points. A contact with a layout of the virtual Braille keyboard with at least one Braille dot touch point is continuously maintained while transitioning from the first touch gesture to the second touch gesture. In response to the second touch gesture, the Braille character is accepted.

A method of writing using a multipurpose keypad that includes alphabetic letters, glyphs, numbers, punctuation marks, typographical symbols, and mathematical symbols. The keypad can be activated by making short traces with a fingertip instead of taping on a touch sensitive screen. The keypad can simultaneously use alphabets of different languages including the alphabets for the blind and visually impaired people. The method of writing enables speeds up the writing process by using a combination of traces to represent syllables or short words in different languages, something like shorthand writing. The method allows the practical use of more than 170 mathematical symbols. Finally, the method can be used in literary work, mathematics, science computer software and other varieties of written materials.

An operating terminal operates an external device for projecting and retracting a part of the external device, and includes: a display unit that displays an image; a touch panel on the display unit, and configured to detect a touched area of an object and to receive a position signal in response to the touched area; a determining unit that determines a change of the touched area on the touch panel, based on the position signal; a detecting unit that detects a boundary of areas having different features in the touched area in the image; and a signal generating unit that generates a drive signal indicating a drive amount for causing the part of the external device to be projected and retracted, based on a determination result by the determining unit and a detection result by the detecting unit, and outputs the drive signal to the external device.

Embodiments disclosed herein describe systems and methods for a tactile braille display that reduces the number of actuators used to position movable pins. In embodiments, the actuators may be configured to move a plurality of movable pins at different times while also being configured to move independent movable pins.

A refreshable Braille display device includes a housing having a surface containing a set of tactile markers thereon; a carriage in cooperation with the housing, the carriage having a surface containing a tactile marker thereon and a series of individual refreshable Braille cells positioned above the tactile marker for tactile reading by a user; and a moving mechanism for moving the carriage relative to the housing such that the tactile marker on the surface of the carriage is aligned with one of the tactile markers in the set of tactile markers on the surface of the housing.

A first touch gesture is sensed at a subset of a set of six Braille dot touch points at a virtual Braille keyboard. The first touch gesture corresponds to a Braille character. A second touch gesture is sensed that concurrently touches each of the six Braille dot touch points in the set of Braille dot touch points. A contact with a layout of the virtual Braille keyboard with at least one Braille dot touch point is continuously maintained while transitioning from the first touch gesture to the second touch gesture. In response to the second touch gesture, the Braille character is accepted.