PORTABLE BRAILLE TRANSLATION DEVICE AND METHOD
20220215154 · 2022-07-07
Assignee
Inventors
- Rajana M. Panchani (London, GB)
- Michael D. McGrath (Rochester, NY, US)
- Patrick W.B. Gerrits (Wijchen, NL)
- Peter Granby (Hertfordshire, GB)
Cpc classification
H04N1/00827
ELECTRICITY
G09B21/003
PHYSICS
G06F40/58
PHYSICS
B41J3/32
PERFORMING OPERATIONS; TRANSPORTING
G09B21/008
PHYSICS
H04N1/00336
ELECTRICITY
B41J3/36
PERFORMING OPERATIONS; TRANSPORTING
International classification
B41J3/32
PERFORMING OPERATIONS; TRANSPORTING
Abstract
Devices and methods use a processor, a scanner, and a display screen. The processor is used to recognize Braille characters within the field of view of the scanner. The processor is used to convert the Braille characters into text, and the display screen is used to display the text visibly.
Claims
1. A handheld apparatus comprising: a body having a handle portion; a processor within the body; a tactile output device on the handle portion operatively connected to the processor; a camera on the body operatively connected to the processor; and a display screen on the body operatively connected to the processor, wherein the processor is adapted to recognize Braille characters and text characters within a field of view of the camera, wherein the processor is adapted to convert the Braille characters into output text and convert the text characters into output Braille, wherein the display screen is adapted to provide Braille-to-text translation by displaying the output text visibly, and wherein the tactile output device is adapted to provide text-to-Braille translation by outputting the output Braille as Braille bump patterns.
2. The handheld apparatus according to claim 1, further comprising a battery operatively connected to the processor, wherein, when operating under battery power supplied by the battery, the apparatus comprises a handheld portable apparatus.
3-4. (canceled)
5. The handheld apparatus according to claim 1, wherein the processor is adapted to translate the Braille characters from one Braille Grade to a different Braille Grade, and wherein the tactile output device is adapted to provide Braille-to-Braille translation by outputting the different Braille Grade as the Braille bump patterns.
6. The handheld apparatus according to claim 1, further comprising an input/output device operatively connected to the processor, wherein the input/output device is adapted to transmit the output text to external devices.
7. The handheld apparatus according to claim 1, further comprising a button on the body, wherein the display screen is adapted to display the output text visibly at the same time the Braille characters are within the field of view of the camera and the button is activated.
8. A printing apparatus comprising: a processor; a printing engine operatively connected to the processor; a display screen operatively connected to the processor; and a scanner wand operatively connected to the processor, wherein the scanner wand includes a tactile output device operatively connected to the processor, wherein the processor is adapted to recognize Braille characters and text characters within a field of view of the scanner wand, wherein the processor is adapted to convert the Braille characters into output text and convert the text characters into output Braille, wherein the display screen is adapted to provide Braille-to-text translation by displaying the output text visibly, wherein the tactile output device is adapted to provide text-to-Braille translation by outputting the output Braille as Braille bump patterns, and wherein the printing engine is adapted to print visible marks representing the output text on print media and to print embossed patterns representing the output Braille on the print media.
9. The printing apparatus according to claim 8, wherein the scanner wand comprises a detachable, hand-held device wirelessly in communication with the processor.
10-11. (canceled)
12. The printing apparatus according to claim 8, wherein the processor is adapted to translate the Braille characters from one Braille Grade to a different Braille Grade, and wherein the tactile output device is adapted to provide Braille-to-Braille translation by outputting the different Braille Grade as the Braille bump patterns.
13. The printing apparatus according to claim 8, further comprising an input/output device operatively connected to the processor, wherein the input/output device is adapted to transmit the output text to external devices.
14. The printing apparatus according to claim 8, further comprising a button on the scanner wand, wherein the display screen is adapted to display the output text visibly at the same time the Braille characters are within the field of view of the scanner wand and the button is activated.
15. A method comprising: recognizing Braille characters and text characters within a field of view of a camera of a handheld device; converting the Braille characters into output text using a processor of the handheld device; converting the text characters into output Braille using the processor of the handheld device; displaying the output text using a display screen of the handheld device to provide Braille-to-text translation; and outputting the output Braille as Braille bump patterns using a tactile output device of the handheld device to provide text-to-Braille translation.
16. The method according to claim 15, further comprising powering the handheld device using a battery of the handheld device.
17. (canceled)
18. The method according to claim 15, further comprising: translating the Braille characters from one Braille Grade to a different Braille Grade using the processor; and outputting the different Braille Grade as the Braille bump patterns using the tactile output device to provide Braille-to-Braille translation.
19. The method according to claim 15, further comprising transmitting the output text to external devices using an input/output device of the handheld device.
20. The method according to claim 15, wherein the displaying the output text is performed at the same time the Braille characters are within the field of view of the camera and a button on the handheld device is activated.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0013] Various exemplary systems and methods are described in detail below, with reference to the attached drawing figures, in which:
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
DETAILED DESCRIPTION
[0021] As mentioned above, existing systems can convert visible textbooks into Braille books to allow sight-impaired users access to such materials. Also, tactile output devices can provide the Braille characters' raised dots to a single finger of the user, or tactile output devices can present entire lines or pages of Braille characters to the user.
[0022] The apparatuses and methods herein provide handheld devices that can be utilized to scan either printed visible text or Braille and convert the same into text or Braille. The systems and methods herein are very useful for providing non-sight-impaired users with translations of Braille into visible text. This allows non-sight-impaired users to check the position and location of Braille characters to ensure their proper utilization. In other words, these systems and methods allow non-sight-impaired users to proofread various Braille books and signs, whether the user understands Braille or not. Further, these systems and methods are useful for providing sight-impaired users the ability to easily scan Braille documents that can be later converted to visible text documents.
[0023] The devices and methods herein offer support to those users that are visually impaired by providing, in one embodiment, a wireless wand that performs Braille-to-text or text-to-Braille translation, so the translated form can be printed, for example. This makes the communication and workflows between normal and visually impaired users easier. In some examples, these devices and methods digitize a braille document that has been scanned and then save the file on a server, which can be printed. This converts a braille document into text for a non-impaired visual person's use.
[0024] Adding a Braille scanner wand to an existing printing device family may not require hardware modifications, which tend to be very costly, because simple connections (e.g., USB, Bluetooth, etc.) can be utilized and all additional processing (e.g., Braille translation) can be performed by the processor within the wand or through a simple update of the printer's software applications. In one example, the wand's processor outputs the scanned file into a format that a printer can immediately use or that the printer can convert to either text or to braille, which can then be printed. In one example, the conversion of the Braille is performed by standard Optical Braille Recognition (OBR) software. Additionally, the file output by the wand can be stored as a document on a server or directly printed as a visually readable visible text document.
[0025] Different devices herein can handle one or more Grades of Braille. Generally, Braille can be considered to have three different Grades. These include Grade 1, which is a character for character translation of plain visible text (for example alphabetic characters and punctuation marks); Grade 2, which uses a contracted form of Braille (for example, there is a single symbol for “the” rather than spelling it out t-h-e, which makes reading of documents much faster); and Grade 3, which is Braille shorthand and is the least used Grade of Braille because it is not widely standardised. Since Grade 3 has not been standardised it has not been used for official publications.
[0026] Different feature-levels are provided in different versions of the devices herein. Some low-feature devices herein may only process Grade 1 Braille, while higher-feature devices herein may process Grades 1, 2, and/or 3. Devices and methods herein detect which grade of Braille is being scanned and automatically process the scan differently depending upon the detected Grade. If a lower-feature device is not capable of processing a specific Braille Grade, an error message is provided to the user.
[0027] Thus, the devices and methods herein provide a way to interpret visible text and/or braille and scan/print such information. This helps support teacher/pupil type learning to bridge between seeing and not seeing people, for example. Further, the devices and methods herein support medical records/personal information on a braille document, promoting sharing at chemists/hospitals/dentists, etc. Also, the devices and methods herein are highly useful for checking what Braille signage actually says. All such data can be saved and sent to third party sign producers. Devices and methods herein also allow error/grammar checking of Braille documents by those not proficient in Braille.
[0028] Referring now to the drawings,
[0029] In the example shown in
[0030] Specifically, the Braille pattern 136 shown in
[0031] Braille scanners and cameras or commonly available devices, and such devices optically, sonically, etc., detect the raised areas of each individual Braille character 132, 134, 136 (e.g., by observing visual shadows in images or measuring bump heights relative to flat surfaces, etc.). The OBR processing then converts each pattern of raised areas in the different columns of the Braille characters to alphanumeric characters (e.g., A-Z, 0-9, punctuation, etc.).
[0032] Some OBR processing techniques automatically correct perceived errors such as transposed letters, incorrectly recognized patterns of bumps in scans, etc., in order to provide the cleanest Braille-to-text translation possible. However, some embodiments herein provide an option to prevent such automatic corrections from occurring, with the default option shutting the automatic correction off. The embodiments herein default to having no automatic correction because the devices and methods herein are sometimes utilized to proofread existing Braille text, which may have been installed or formed incorrectly. In other words, by keeping OBR's automatic correction features off, improperly formed Braille characters and grammatical/spelling errors will be provided as output, allowing the Braille proofreading to be more accurate. While the automatic correction can always be turned on through menu choices, not using automatic correction enhances the proofreading ability of these devices and methods.
[0033] Thus, the embodiments herein are very useful for users who are not proficient in Braille but desire to check/proofread various Braille words that may be in visible text or on signage. Thus, the portable Braille scanner 114 can translate Braille into on-screen 104 visible text 140 at any location (e.g., in the field) to allow non-Braille proficient users to proofread the translated Braille signs and/or books.
[0034] Additionally, the input/output device 116 (that is operatively connected to the processor 112) is adapted to transmit the visible text 140 and/or Braille characters 132, 134, 136 to external devices (using connected wires or wirelessly through computer networks), such as facsimile servers, email servers, document storage servers, etc. Therefore, any Braille characters scanned in by the portable Braille scanner apparatus 100 can be sent to printers to be printed, saved as a document in cloud storage, sent to other devices over computerized networks, etc.
[0035] The tactile Braille output device 106 is also operatively connected to the processor 112 to allow Braille characters 132, 134, 136 to be output to the tactile Braille output device 106. Specifically, an optional concave curved portion (recessed, inwardly curved portion) of the handle 110 where the tactile Braille output device 106 is located is at the position of the handle 110 where a user's finger would rest, and the concave curve may be sized to match the average size of a human finger. In other embodiments, the tactile Braille output device 106 may be positioned along a linear (non-recessed) portion of the body 102 of the portable Braille scanner apparatus 100.
[0036] The tactile Braille output device 106 is a commonly available device and includes columns of projection elements (e.g., piezoelectric elements, motor actuated elements) that extend and retract to match the Braille bump pattern being output. In other words, the projections of the tactile Braille output device 106 extend and retract to match the embossed bumps a user would feel when touching a sheet with Braille characters embossed thereon. With various embodiments herein, most of the tactile Braille output device 106 can be located within the interior of the handle 110, with only the tactile output portion having the columns of projection elements resting along the surface of the concave curved portion of the handle 110 that the user's finger contacts.
[0037] While some larger tactile Braille output devices can simultaneously represent multiple Braille characters (some tablet size tactile Braille output devices can even output an entire page of Braille characters at one time) with the compact form of the tactile Braille output device 106 positioned along the handle portion 110 of the portable Braille scanner apparatus 100, some embodiments herein present a single Braille character or a few Braille characters at a time through the tactile Braille output device 106. In other words, each sequential Braille character may be individually briefly output through the tactile Braille output device 106 for a period of time and then followed by the next Braille character, where the series of Braille characters that are output through the tactile Braille output device 106 form the words that are being output.
[0038] Therefore, as shown in
[0039] Thus,
[0040] More specifically, as shown in
[0041] The processor 112 is also adapted to translate the scanned Braille into a different Braille Grades (see the discussion of the different Braille Grades above) when performing the Braille-to-Braille translations shown in
[0042] In addition, by operating as a personal Braille-to-Braille reader, the portable Braille scanner apparatus 100 is able to amplify the Braille patterns being output for users who, for example, have finger sensitivity issues or to overcome touch issues that occur when the raised bumps of Braille visible text become worn down and difficult to detect physically by touch.
[0043]
[0044] The input/output device 214 is used for communications to and from the printing device 204 and comprises a wired device or wireless device (of any form, whether currently known or developed in the future). The tangible processor 224 controls the various actions of the printing device 204. A non-transitory, tangible, computer storage medium device 210 (which can be optical, magnetic, capacitor based, etc., and is different from a transitory signal) is readable by the tangible processor 224 and stores instructions that the tangible processor 224 executes to allow the computerized device to perform its various functions, such as those described herein. Thus, as shown in
[0045] The printing device 204 includes at least one marking device (printing engine(s)) 240 that use marking material, and are operatively connected to a specialized image processor 224 (that may be different from a general-purpose computer because it is specialized for processing image data), a media path 236 positioned to supply continuous media or sheets of media from a sheet supply 230 to the marking device(s) 240, etc.
[0046] Additionally, the printing engines 240 may comprise embossing engines specifically design to print Braille markings on paper by physically pushing and distorting the surface of the paper (physical embossing). Alternatively, the printing engines may comprise laser or ink printers capable of depositing different heights of toner/ink in order to form raised bumps and thereby print raised Braille characters on the paper (printed Braille). The printing engines 240 are intended to illustrate all forms of Braille printing devices, whether currently known or developed in the future. Therefore, the Braille characters can be printed on the sheets of media by the printing engines 240 using either inks/toners or by physically forming indentations and raised areas using embossing devices.
[0047] After receiving various markings from the printing engine(s) 240, the sheets of media can optionally pass to a finisher 234 which can fold, staple, sort, etc., the various printed sheets. Also, the printing device 204 can include at least one accessory functional component (such as a scanner/document handler 232 (automatic document feeder (ADF)), etc.) that also operate on the power supplied from the external power source 220 (through the power supply 218).
[0048] The one or more printing engines 240 are intended to illustrate any marking device that performs embossing or applies marking material (toner, inks, plastics, organic material, etc.) to continuous media, sheets of media, fixed platforms, etc., in two- or three-dimensional printing processes, whether currently known or developed in the future. The printing engines 240 can include, for example, devices that use electrostatic toner printers, inkjet printheads, contact printheads, three-dimensional printers, embossing devices, etc. The one or more printing engines 240 can include, for example, devices that use a photoreceptor belt or an intermediate transfer belt or devices that print directly to print media (e.g., inkjet printers, ribbon-based contact printers, etc.).
[0049] The scanner wand 120 can be used by operators of the printing device 204 to scan in Braille items (e.g., books, documents, etc.) to allow such Braille items to be copied or transmitted in either visible text or Braille (possibly Braille of a different Grade). In some embodiments, the hand-held scanner wand 120 is detachable from the printing apparatus 204, and such a scanner wand 120 can be in communication (wired or wireless) with the processor 224 of the printing device 204. For example, the scanner wand 120 can be completely physically separate from the printing apparatus 204 or can be connected to the printing apparatus 204 by way of a cable 124, which can be a communications cable (e.g., USB cable) or can be a simple retractable wire tether that prevents the scanner wand 120 from being taken too far from the printing device 204. Additionally, the scanner wand 120 may be connected to the printing device 204 by a hook, magnetic holder, tray holder, during non-use (during storage).
[0050] As shown in
[0051]
[0052]
[0053] In either the scanner wand 120 or the stand-alone handheld portable Braille scanner apparatus 100, the processor 112/214 can again be adapted to recognize visible text 140 characters within the field of view 150 of the scanner 114 wand 120 or camera. Thus, again the processor 112/214 is adapted to convert the visible text 140 characters into Braille characters 132, 134, 136, allowing all apparatuses herein to perform Braille-to-text translation/copying, Braille-to-Braille translation/copying, and text-to-Braille translation/copying.
[0054]
[0055]
[0056] These methods can also recognize visible text characters within the field of view of the scanner in item 308. In item 310, such methods convert the visible text characters into Braille characters (possibly of different Grades). With these methods, in item 312, the Braille characters are output using the tactile Braille output device of the handheld device. These methods also can transmit the visible text to external devices using an input/output device of the handheld device in item 314.
[0057] While some exemplary structures are illustrated in the attached drawings, those ordinarily skilled in the art would understand that the drawings are simplified schematic illustrations and that the claims presented below encompass many more features that are not illustrated (or potentially many less) but that are commonly utilized with such devices and systems. Therefore, Applicants do not intend for the claims presented below to be limited by the attached drawings, but instead the attached drawings are merely provided to illustrate a few ways in which the claimed features can be implemented.
[0058] Many computerized devices are discussed above. Computerized devices that include chip-based central processing units (CPU's), input/output devices (including graphic user interfaces (GUI), memories, comparators, tangible processors, etc.) are well-known and readily available devices produced by manufacturers such as Dell Computers, Round Rock Tex., USA and Apple Computer Co., Cupertino Calif., USA. Such computerized devices commonly include input/output devices, power supplies, tangible processors, electronic storage memories, wiring, etc., the details of which are omitted herefrom to allow the reader to focus on the salient aspects of the systems and methods described herein. Similarly, printers, copiers, scanners and other similar peripheral equipment are available from Xerox Corporation, Norwalk, Conn., USA and the details of such devices are not discussed herein for purposes of brevity and reader focus.
[0059] The terms printer or printing device as used herein encompasses any apparatus, such as a digital copier, bookmaking machine, facsimile machine, multi-function machine, etc., which performs a print outputting function for any purpose. The details of printers, printing engines, etc., are well-known and are not described in detail herein to keep this disclosure focused on the salient features presented. The systems and methods herein can encompass systems and methods that print in color, monochrome, or handle color or monochrome image data. All foregoing systems and methods are specifically applicable to electrostatographic and/or xerographic machines and/or processes.
[0060] In addition, terms such as “right”, “left”, “vertical”, “horizontal”, “top”, “bottom”, “upper”, “lower”, “under”, “below”, “underlying”, “over”, “overlying”, “parallel”, “perpendicular”, etc., used herein are understood to be relative locations as they are oriented and illustrated in the drawings (unless otherwise indicated). Terms such as “touching”, “on”, “in direct contact”, “abutting”, “directly adjacent to”, etc., mean that at least one element physically contacts another element (without other elements separating the described elements). Further, the terms automated or automatically mean that once a process is started (by a machine or a user), one or more machines perform the process without further input from any user. Additionally, terms such as “adapted to” mean that a device is specifically designed to have specialized internal or external components that automatically perform a specific operation or function at a specific point in the processing described herein, where such specialized components are physically shaped and positioned to perform the specified operation/function at the processing point indicated herein (potentially without any operator input or action). In the drawings herein, the same identification numeral identifies the same or similar item.
[0061] It will be appreciated that the above-disclosed and other features and functions, or alternatives thereof, may be desirably combined into many other different systems or applications. Various presently unforeseen or unanticipated alternatives, modifications, variations, or improvements therein may be subsequently made by those skilled in the art which are also intended to be encompassed by the following claims. Unless specifically defined in a specific claim itself, steps or components of the systems and methods herein cannot be implied or imported from any above example as limitations to any particular order, number, position, size, shape, angle, color, or material.