Talking multi-surface keyboard
20200081551 ยท 2020-03-12
Inventors
Cpc classification
G06F3/038
PHYSICS
G06F3/0216
PHYSICS
G06F3/04886
PHYSICS
G06F3/0236
PHYSICS
G06F1/1626
PHYSICS
International classification
G06F3/023
PHYSICS
G06F3/0354
PHYSICS
G06F3/038
PHYSICS
G06F3/02
PHYSICS
Abstract
An input device is provided having at least a plurality of touch-sensitive back surfaces, with ability to split into several independent units, with adjustable vertical and horizontal angles between those units; a method of dividing the keys of a keyboard into interface groups; each group having a home key and associated with a finger; a method of dynamically mapping and remapping the home keys of each interface group to the coordinates of the associated fingers at their resting position, and mapping non-home keys around theft associated home keys on the touch-sensitive back surfaces; a method of calculating and remapping home keys and non-home keys when the coordinates of the fingers at the resting position shift during operation; a method of reading each activated key immediately and automatically; a method of detecting typos and grammatical errors and notifying operators using human speech or other communication methods.
Claims
1. A data processing input device comprising: a. an apparatus with at least a plurality of touch-sensitive back surfaces; and b. each of said touch-sensitive back surfaces having the ability to sense a range of pressure and presence of forces; and c. each of said touch-sensitive back surfaces having the ability to be configured as a mouse pads, a keyboard, or a variation of a mouse pad and a keyboard; and d. each of said touch-sensitive back surfaces having the ability to detect the presence and actions of one or a plurality of fingers, objects, or both; and e. said apparatus having the ability to be split into two or more independent units; and f. said units having the ability to be reattached together at an adjustable horizontal angle and an adjustable vertical angle between said units; and g. supportive means on each of said units to be wrapped around, worn on, or fastened around the hands or on other parts of the body of an operator; and h. a method of receiving information indicative of the contact points between one or a plurality of said touch-sensitive back surfaces, and a finger or a plurality of fingers, directly or indirectly through an object or a plurality of objects, or through a combination of fingers and said objects; and i. a method of registering the coordinates of said contact points when fingers or said objects are at resting position as if resting on the home keys of a computer, and the coordinates of fingers or said objects when retracted or extended upward, downward, left or right from the resting position as if typing on non-home keys of a computer; and j. a method of selecting, dividing, and rearranging the keys of a keyboard or an input device into interface groups, each group consisting of one or a plurality of keys, each group having at least one home key, each group associated with one finger for activation; and k. a method of dynamically mapping one or a plurality of said interface groups on said touch-sensitive back surfaces such that the home keys of said interface groups are mapped to the coordinates of their associated fingers at their resting position, and the non-home keys of said interface groups mapped to the coordinates of their associated fingers when in extended or retracted position; and l. a method of detecting when the coordinates of the fingers at their resting position or the coordinates of said objects move or shift, and recurrently remapping the home keys of said interface groups to the new coordinates of the associated fingers at resting position; and m. a method of recurrently calculating and remapping the new coordinates of the non-home keys of said interface groups when their associated home keys moves or shift; and n. a method of detecting when fingers or said objects activate associated home keys and non-home keys or perform other actions individually or simultaneously with one or a plurality of fingers or with said objects on said touch-sensitive back surfaces; and o. a method of switching one or a plurality of said touch-sensitive back surfaces to different operating modes to work as a computer keyboard, a mouse pad, a multi-mouse pad, a gaming pad, a numeric pad, a calligraphy pad, a navigation pad, a pad to control other devices and machinery, and a pad with one or a plurality of computer mice, each activated by one or a plurality of fingers or by said objects; and p. a method of transmitting signals pertaining to the activated keys and actions performed on said surfaces, to one or a plurality of computers or other devices; and q. one or a plurality of storage media, one or a plurality of processors, power electronics, and one or a plurality of communication modules.
2. A system providing for the input device in claim 1 a. an apparatus comprising a module to generate sound and signals identifiable by human senses; and b. a method of notify an operator as each key is activated; and c. a method of immediately and automatically pronouncing an activated character, a single letter, a code, or a command using human speech; and d. a method of immediately and automatically notifying the operator with an option to correct a misspelled word or a grammatical error; and e. a method of reading a word once it is correctly entered, and reading a paragraph once it is completed without grammatical errors.
Description
DRAWINGSFIGURES
[0034] While multiple non-limiting exemplary embodiments are disclosed, other embodiments will become apparent to those skilled in the art from the following detailed description. As will be realized, the embodiments are capable of modifications in various aspects, all without departing from the spirit and scope of the embodiments discussed herein. Accordingly, the drawings and detailed description are to be regarded as illustrative in nature and not restrictive.
[0035] Therefore all disclosed embodiments are described by way of example only, with reference to the accompanying drawings in which, one or more embodiments are illustrated with the same reference numerals referring to the same pieces of an embodiment throughout the drawings. It is understood that the invention is not limited to the embodiments depicted in the drawings herein, but rather it is defined by the claims appended hereto and equivalent structures:
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
DETAILED DESCRIPTIONFIGS. 1 to 6FIRST EMBODIMENT
[0054]
[0055] The touch screen 105 is capable of detecting at least the touch of two thumbs simultaneously and to display a plurality of icons, a plurality of running program windows, as well as text boxes and a plurality of programmable soft keys.
[0056]
[0057] Both touch pads 202 and 213 are capable of detecting a range of pressure levels. Each pressure level describes a specific action, for example, tapping with a finger, touching or resting on the touchpad, sliding or moving a single finger or a plurality of fingers on a touch pad, squeezing a touch pad with the palm of one or both hands, pressing harder on a touch pad with a finger, etc.
[0058] Most computer keyboards have alphanumeric keys including home keys A,S,D,F,J,K,L.,;, non-home keys, numeric keys, punctuation keys, mathematical operators, and a set of special keys including function keys. Tab, Caps, Shift, Ctrl, Command, Alt, Scroll, and Delete are examples of special keys. Recent computer keyboards include additional keys to activate and control running programs on the host computer. For example a computer keyboard may have keys to open a web browser, a menu, and Start and Stop keys for playing music. There are associated non-home keys of a home key that are activated by the same finger that activates said home key. For example as shown in
[0059] The first embodiment provides at least a housing (
[0060] The non-volatile storage media holds the programs and information pertaining to all available keyboard and keypad layouts, and customized keyboard and keypad layouts. Said programs provide at least BIOS support to initialize and operate the embodiment.
[0061] The keys of every available keyboard and keypad layouts are divided into a plurality of interface groups. The elements of each interface group are comprised of one home key and none, one, or a plurality of non-home keys. A non-home key is a key that is activated by the same finger that activates the associated home key. Each interface group is assigned to and activated by one of the fingers of the operator. For example, in
TABLE-US-00002 TABLE 1 Interface Home Home and Associated Assigned Group Key Non-home Keys Hand finger A A Q A Z Tab Caps Shift Left Pinky finger S S W S X Ring finger D D E D C Middle finger F F R F V T G B Index finger J J Y H N U J M Right Index finger K K I K , Middle finger L L O L . Ring finger Semicolon ; P ; / ' Backspace Pinky finger Enter Shift Left Left Space Left Left thumb Space Space Right Right Space Right Right thumb Space Space
[0062] Also as shown in
[0063]
[0064]
OperationFirst Embodiment
[0065] There are practically unlimited ways of running aforesaid five programs. The following is only an example of running said programs to operate the first embodiment. Holding two mechanical keys 110 and 112 in
[0066] The operator, at the first use of said embodiment may call up the second program to choose and activate a keyboard layout. The operator may also call the third program at least once to customize the position of his hands and initial resting position of fingers.
[0067] When the third program is called, the operator is prompted to follow a series if instruction to detect and register the contact points of each finger at the resting position on the touch pads on back surfaces, as well as the contact points of each finger when extending or retracting to tap on other areas on the touch pads, as if typing and activating the non-home keys of a keyboard.
[0068] The coordinates of the resting position of each finger of each hand, as well as the coordinates of of each finger when extended or retracted as if typing on a non-home key, is registered. For example, when the operator is prompted to rest all 8 fingers on the two touch pads on the back surfaces, the third program detects and registers the coordinates of the contact point of the left Index finger at resting position and maps the F key to said coordinates. Then through a sequence of prompts, the operator taps on the left touch pad while extending and retracting the left Index finger as if typing on the non-home keys R, V, T, G, and B on a QWERTY keyboard. The center of each contact point or the coordinates of each contact point between the left Middle finger and the touch pad are grouped together as elements of the F interface group.
[0069] As shown in
[0070] Once all contact points or coordinates of all fingers are registered, the third program maps each of the contact points to a key. The third program calculates the distance between each non-home key and its associated home key, and the distance between same non-home key and the next home key. For example, as shown in
[0071] The fourth program is the main program that runs automatically all the time to detect activities performed by the hands and fingers of the operator and to generate codes relative to each activity on a touch pad or on a touch screen. For example, when the operator taps on the mapped location of key D with the left Middle finger, a character code representing lowercase letter d is generated. If the operator was holding the Shift key with right pinky finger while performing the same action, a character code representing uppercase letter D is generated.
[0072] As the operator's hands move, the location or coordinates of the home keys will also shift and move. Fourth program recurrently detects the new coordinates of fingers at their resting position. The new coordinates of fingers are reregistered and the associated groups of keys are dynamically mapped to the new coordinates. Since the information pertaining to non-home keys and their distances from the two home keys is already available, the new coordinates of the non-home keys are recalculated and adjusted based on the new coordinates of their associated home keys.
[0073] For example, in
[0074] Let's say for example, that the left hand of the operator moved and shifted slightly. In this example in
[0075] The left and right thumbs of the operator activate the mechanical keys located below the front touch screen, and all soft programmable keys mapped on the touch screen.
[0076] The fifth program detects activated keys and automatically pronounces every letter and reads every command and every word that is entered without a spelling mistake. If the operator intended to type in the word cared but it was entered as cares, then the operator would hear what was types and would be able to correct and replace that word. When typos, grammatical errors, or other errors are detected, said program notifies the operator using human speech and provides options to correct typos and other errors. Said program may also use other forms of notification, for example vibration or displaying a message on the display monitor or on the touch screen. Said program may also record and transcribe voice into text and into computer commands, letting the operator only correct errors made during the transcribing process.
[0077] There are different modes of operation include Text Mode, Extended Mode, Arrows Mode, Keypad Mode, Mouse Pad Mode, Multiple Mouse Pad Mode, Calligraphic Pad Mode, etc. Other modes of operation may be achieved by creating new customized layouts. The operator may activate any of these modes by pressing a soft key or a mechanical key that is preprogrammed for that purpose.
[0078] In Text Mode, as shown in Hg. 1, mechanical keys 109, 110, 112, and 115 represent Ctrl, left Space, right Space, and Alt keys. Also in Text Mode as shown in
[0079] However in Numeric Mode as shown in
[0080] Table 2 shows interface groups and associated elements in Numeric Mode. In this mode of operation one or both of the touch pads on back surfaces may be mapped with the same interface groups. For example, interface group 5 with elements 8, 5, and 2 may be associated with the left Middle finger, right Middle finger, or both.
TABLE-US-00003 TABLE 2 Interface Home Home and Associated Assigned Group Key Non-home Keys Hand finger Minus Minus / - * Left Pinky Finger 4 4 7 4 1 Ring finger 5 5 8 5 2 Middle finger 6 6 9 6 3 + Enter Index finger 4 4 7 4 1 / Minus * Right Index finger 5 5 8 5 2 Middle finger 6 6 9 6 3 Ring finger Plus Plus Enter + Pinky Finger Zero Zero 0 Left Left thumb Dot Dot . Right Right thumb
[0081] Extended Mode provides access to different symbols, function keys, numbers, and special keys. Table 3 shows interface groups and associated elements in Extended Mode. For example, the Middle finger activated elements of interface group 3 in Extended Mode. Function keys F3, F13, and digit 3 key are the elements of interface group 3.
TABLE-US-00004 TABLE 3 Interface Home Home and Associated Assigned Group Key Non-home Keys Hand finger 1 1 F1 1 F11 Left Pinky finger 2 2 F2 2 F12 Ring finger 3 3 F3 3 F13 Middle finger 4 4 F4 4 F14 Index finger 5 5 F5 5 F15 Right Index finger 6 6 F6 6 F16 Middle finger 7 7 F7 7 F17 Ring finger 8 8 F8 8 F18 Pinky finger 9 9 9 Left Left thumb 0 0 0 Right Right thumb F9 F9 F9 Left Left thumb* F10 F10 F10 Right Right thumb*
[0082] Each thumb may activate at least two mechanical keys boated on the front surface below the touch screen. For example, in
[0083] In Multiple Mouse Pads Mode, both touch pads located on the back of the embodiment become mouse pads. In this mode, one or a plurality of fingers of each hand may control the movements of a mouse or perform different activities independently or together. For example, by sliding the Index finger of the left hand on the left touch pad, the operator can move the pointer of the 1.sup.st mouse and perform another action by tapping with the same finger on the touch pad. Similarly, the Index finger of the right hand may perform the same action with the left Index finger, but to control a 2.sup.nd mouse. Additionally, when using 2 fingers, 3 fingers, or even 4 fingers simultaneously, the operator may perform either one of the common actions of a typical mouse, or execute a series of actions that otherwise would take several steps to accomplish. For example, in a drawing program, by using two index fingers, the operator may grab the two ends of a line, move and stretch it to fit in a new location, which otherwise, the operator would have to move each end of the line one step at a time. In another example, the operator may rotate, zoom, and perform other actions on an object simultaneously by using several fingers of a hand or two.
[0084] Table 4 below shows an example of the functions that may be assigned to each finger. As stated earlier, by combining functions of a plurality of fingers, a new set of function may be derived. These new functions may expand the capabilities of currently available computer programs or, benefit and expand the capabilities of programs that will become available in the future due to said derived new set of functions.
TABLE-US-00005 TABLE 4 Interface Home Home and Associated Assigned Group Key Non-home Keys Hand finger Left Pinky finger Zoom Zoom Zoom-in Zoom-out Ring finger Rotate Rotate Rotate Page-up Middle finger Page-down Mouse-1 Mouse-1 Mouse-1 Index finger Mouse-2 Mouse-2 Mouse-2 Right Index finger Rotate Rotate Rotate Page-up Middle finger Page-down Zoom Zoom Zoom-in Zoom-out Ring finger Pinky finger Hold Hold Hold Left Left thumb Hold Hold Hold Right Right thumb
[0085] In Arrows Mode, tapping with the right Index finger on its resting location will move the cursor or the selected object to the left; tapping with the right Ring finger on its resting location will move the cursor or the selected object to the right, and tapping with the right Middle finger above or below its resting location will move the cursor or the selected object up or down accordingly. Same functions may be achieved by the fingers of the left hand.
[0086] Different functions may be assigned to the touch pads located on the left and the right edges of the first embodiment and it may vary depending on the selected layout or modes of operation. In
[0087] The operator of the first embodiment may stand up and hold said embodiment up, lay it down on a desk, or dock it on a docking station during operation. As shown in
[0088] Thus, since the computer keys in the first embodiment are mapped dynamically, and on two back surfaces, it provides faster typing speed and greater ergonomic advantage. The blind, or people with different personal preferences may customize it according to their preferences.
DETAILED DESCRIPTIONFIG. 7SECOND EMBODIMENT
[0089]
OperationSecond Embodiment
[0090] When an embodiment is docked onto the second embodiment, all the ports of the docking station become available to the docked embodiment and the recharging process begins. The operator may use the docked embodiment while charging.
DETAILED DESCRIPTIONFIGS. 8 AND 9THIRD EMBODIMENT
[0091] The third non-limiting exemplary embodiment as shown in
[0092] In
OperationThird Embodiment
[0093] The third embodiment operates like a smart phone but with added features and capabilities of the first embodiment.
DETAILED DESCRIPTIONFIG. 10FOURTH EMBODIMENT
[0094] The fourth non-limiting exemplary embodiment as shown in
[0095] The same set of volatile and non-volatile storage media, voice module, power module, electronic circuitry, and programs available on the first embodiment are built into the fourth embodiment (not shown). Therefore, all functions and capabilities of the first embodiment are available on the fourth embodiment.
OperationFourth Embodiment
[0096] The fourth embodiment operates like the first embodiment but without a front touch screen as shown in
DETAILED DESCRIPTIONFIG. 11FIFTH EMBODIMENT
[0097] The fifth non-limiting exemplary embodiment provides a touch pad 1103 and a communication module (not shown). It may be attached to a mobile or a stationary device.
OperationFifth Embodiment
[0098] An operator attaches the fifth embodiment to the back of a mobile device or a smart phone and connects it to the host through a wire, for example a USB cable, or enables wireless connection to the host. The operator installs and runs the same set of programs on the host that is available on the first embodiment. This is to configure and customize the fifth embodiment. Operation and feature of the fifth embodiment is the same as the operation and features of the third embodiment.
DETAILED DESCRIPTIONFIG. 12SIXTH EMBODIMENT
[0099] The sixth non-limiting exemplary embodiment provides two units that operate like a computer mouse but with a round touch pad around each mouse as shown in
[0100] The twelfth embodiment recharges its batteries (not shown) when connected to the host with a wire (not shown) and makes use of the memory and other resources of the host.
OperationSixth Embodiment
[0101] Assuming that we are using the right hand unit in this example, the operator lays his right hand on the cup 1203 and rests his fingers on the round touch pad 1201. The operator runs the initial configuration program by pressing and holding the pressure sensitive pad 1202. Sixth embodiment is configured and operates like the first embodiment except as described otherwise.
[0102] The mouse pointer in said embodiment is moved either by moving the device or switching the touch pad into a mouse pad by pressing the mode switch button (not shown). The operator may call the first, second or the third program by pressing and holding on the pressure sensitive pad 1202 for more than 3 seconds. Once configured, the operator may use the round touch pad 1201 to enter text or use it as a computer mouse pad. Since both left-hand and right-hand units may be active simultaneously, the operator may perform advanced mouse functions with two mouse pads, or control several mice on each pad using a plurality of fingers on each pad.
DETAILED DESCRIPTIONFIG. 13SEVENTH EMBODIMENT
[0103] The seventh non-limiting exemplary embodiment is an example of a mobile device with slide-out extended touch-sensitive touch pads.
DETAILED DESCRIPTIONFIG. 14EIGHTH EMBODIMENT
[0104] The eighth non-limiting exemplary embodiment is an example of a mobile device with two extended touch pads as shown in
[0105] Dynamic soft key 1403, as an example, is mapped on the right-hand touch pad 1402, and dynamic soft key 1406, as an example, is mapped on the left-hand touch pad 1407. The eighth embodiment provides larger typing surface for an operator's fingers.
DETAILED DESCRIPTIONFIG. 15NINTH EMBODIMENT
[0106] The ninth non-limiting exemplary embodiment as shown in
DETAILED DESCRIPTIONFIG. 16TENTH EMBODIMENT
[0107] The tenth non-limiting exemplary embodiment as shown in
DETAILED DESCRIPTIONFIG. 17ELEVENTH EMBODIMENT
[0108] The eleventh non-limiting exemplary embodiment as shown in
OperationSeventh to Eleventh Embodiment
[0109] Embodiments seven, eight, nine, ten, and eleven are also examples of ergonomically designed mobile devices. Said embodiments provide larger surface for fingers of an operator. Said embodiments operate like the third embodiment.
DETAILED DESCRIPTIONNO FIG.TWELFTH EMBODIMENT
[0110] Another non-limiting exemplary embodiment (not shown) is a steering wheel of an automobile, or a gaming console. Several static keys are mounted on the front facing surface and on the sides of said embodiment, while dynamically mapped keys are on the bottom surface and are activated with eight fingers of an operator. Front and side keys are activated with the thumbs. Said embodiment may have a plurality of back surfaces for each hand. One hand may activate dynamically mapped keys or command buttons while the other hand may activate a mouse pad or a plurality of mouse pads.
CONCLUSION, RAMIFICATION, AND SCOPE
[0111] Thus the reader will see that one or more exemplary embodiments of a computer keyboard provides healthier posture of fingers, wrists, hands, and arms; more ergonomic convenience, and faster typing speed. It can be integrated and enhance the capabilities of a portable device like a smart phone, to be used in navigation or other industries, as well as used by the blind.
[0112] One or more exemplary embodiments provide an input device with dynamically mapped keys on two of its back surfaces, with vertically and horizontally adjustable angles between the back surfaces.
[0113] Shoulders, arms, wrists, and fingers of operators of the provided embodiments are no longer confined to statically positioned keys; rather the dynamic keys follow the fingers of operators. Unlike a conventional flat keyboard with front-facing keys, the wrists of operators no longer sit on the median nerve; developing Carpal Tunnel Syndrome; nor are confined to the sides of a one-piece, non-adjustable portable keyboard with statically positioned keys.
[0114] With the ability to split an input device into two separate units as provided by one or more exemplary embodiments, operators do not have to keep those units up and close to each other in front of theft eyes in order to type. Operators may stand, walk, lie in the bed, run or do other activities while typing on each of the separable unit. Operators are no longer confined to using only two thumbs; rather they may use the rest of their fingers on the back of the provided embodiments and type. A greater space is also available on the front-facing surface of such devices for applications since the majority of the keys are mapped and activated on the back surfaces.
[0115] One or more exemplary embodiments provide an input device with flexibility of switching into a keyboard, a keypad, a navigation pad, an arrow-pad, a mouse-pad, a multi-mouse pad, or a calligraphic pad.
[0116] Versatile and customizable layouts provide for different types of input devices in different modes of operation. It also meets the needs of different operators such as the Blind and people with less than 10 active fingers. A sound module reads every single character as entered, a word, a paragraph, and a command using human speech. The sound module automatically detects typos and provides option to correct a misspelled word or to correct a grammatical error using human speech or other notification methods.
[0117] Thus, several advantages of one or more aspects include advanced ergonomic features that not only help overcome stress on shoulders, arms, wrists, fingers, and prevent backaches and fatigue; but also provide faster typing speed. The flexibility of moving fingers from the initial resting position during operation provides greater comfort. Hence, increased typing speed, greater efficiency is achieved while operators maintain healthier posture of fingers, wrists, hands, arms, and the body.
[0118] While my above description contains several exemplary embodiments, many other variations are also possible. For example many types of embodiments may be manufactured in different sizes, weights, colors, material, shapes, or connect and communicate with attached or remote devices in different manner or operate in different mode or function.