Method and apparatus for resolving touch screen ambiguities

Abstract

A method and apparatus that resolve near touch ambiguities in a touch screen includes detecting a touch screen touch event and detecting a vibro-acoustic event. These events generate signals received respectively by two different sensors and/or processes. When the two events occur within a pre-defined window of time, they may be considered to be part of the same touch event and may signify a true touch.

Claims

1. A method for reducing unintentional activation of a touch-sensitive display of a device, the method comprising: providing a first sensor for detecting a first event indicating an object touching or hovering over the touch-sensitive display, wherein the first sensor comprises a touch screen sensor based on a capacitive, optical, or electric field technology; providing a second sensor for detecting a second event indicating a vibro-acoustic event imparting vibrations into the device via the touch-sensitive display or via other device portions outside the touch-sensitive display, wherein the first event and the second event are distinctly different physical phenomena, wherein the second sensor comprises at least one of a condenser microphone or a microelectro-mechanical systems (MEMS) microphone; initiating a time window associated with a window timer in response to detecting at least the first event associated with the first sensor or the second event associated with the second sensor, wherein the time window comprises a period of time less than 500 milliseconds; based on both the first event and the second event being detected within the time window, determining that an object is touching the touch-sensitive display, an object is not hovering over the touch-sensitive display, and vibrations are imparted into the device via the touch-sensitive display; based on the second event but not the first event being detected within the time window, determining that vibrations are imparted into the device but not via the touch-sensitive display and that an object is not touching the touch-sensitive display; activating the touch-sensitive display from a low energy usage state in response to both the first event and the second event being detected within the time window and in response to determining that an object is touching the touch-sensitive display, an object is not hovering over the touch-sensitive display, and vibrations are imparted via the touch-sensitive display into the device; and maintaining the touch-sensitive display in the low energy usage state in response to the second event but not the first event being detected within the time window and in response to determining that vibrations are imparted into the device, but not via the touch-sensitive display, and that an object is not touching the touch-sensitive display.

2. The method recited in claim 1, further comprising: in response to the first sensor detecting the first event and the second sensor not detecting the second event within the time window, determining that the first event indicates an object is not touching the touch-sensitive display.

3. The method recited in claim 1, wherein the time window comprises a maximum period of 300 milliseconds.

4. An apparatus comprising: a touch-sensitive display; a first sensor for detecting a first event indicating an object touching or hovering over the touch-sensitive display, wherein the first sensor comprises a touch screen sensor based on a capacitive, optical, or electric field technology; a second sensor for detecting a second event indicating a vibro-acoustic event imparting vibrations into the apparatus via the touch-sensitive display or via other apparatus portions outside the touch-sensitive display, wherein the first event and the second event are distinctly different physical phenomena, wherein the second sensor comprises at least one of a condenser microphone or a microelectro-mechanical systems (MEMS) microphone; at least one logic device for: initiating a time window associated with a window timer in response to detecting at least the first event associated with the first sensor or the second event associated with the second sensor, wherein the time window comprises a period of time less than 500 milliseconds, based on both the first event and the second event being detected within the time window, determining that an object is touching the touch-sensitive display, an object is not hovering over the touch-sensitive display, and vibrations are imparted into the device via the touch-sensitive display; based on the second event but not the first event being detected within the time window, determining that vibrations are imparted into the device but not via the touch-sensitive display and that an object is not touching the touch-sensitive display; activating the touch-sensitive display from a low energy usage state in response to both the first event and the second event being detected within the time window and in response to determining that an object is touching the touch-sensitive display, an object is not hovering over the touch-sensitive display, and vibrations are imparted via the touch-sensitive display into the device; and maintaining the touch-sensitive display in the low energy usage state in response to the second event but not the first event being detected within the time window and in response to determining that vibrations are imparted into the device, but not via the touch-sensitive display, and that an object is not touching the touch-sensitive display.

5. The apparatus recited in claim 4, wherein the at least one logic is further configured for determining that the first event indicates an object is not touching the touch-sensitive display in response to the first sensor detecting the first event and the second sensor not detecting the second event within the time window.

6. The apparatus recited in claim 4, wherein the time window comprises a maximum period of 300 milliseconds.

7. The apparatus recited in claim 4 wherein the at least one logic device comprises an OR gate connected to initiate a time window generator associated with the time window when either of the first sensor and the second sensor detects a respective first or second event, and an AND gate connected to activate the touch-sensitive display when both the first sensor and the second sensor detect respective first and second events during the time window.

8. A non-transitory computer readable medium containing instructions for reducing inadvertent activation of a touch-sensitive display of a device, wherein execution of the program instructions by a processor causes the processor to carry out the steps of: providing a first sensor for detecting a first event indicating an object touching or hovering over the touch-sensitive display, wherein the first sensor comprises a touch screen sensor based on a capacitive, optical, or electric field technology; providing a second sensor for detecting a second event indicating a vibro-acoustic event imparting vibrations into the device via the touch-sensitive display or via other device portions outside the touch-sensitive display, wherein the first event and the second event are distinctly different physical phenomena, wherein the second sensor comprises at least one of a condenser microphone or a microelectro-mechanical systems (MEMS) microphone; initiating a time window associated with a window timer in response to detecting at least the first event associated with the first sensor or the second event associated with the second sensor, wherein the time window comprises a period of time less than 500 milliseconds; based on both the first event and the second event being detected within the time window, determining that an object is touching the touch-sensitive display, an object is not hovering over the touch-sensitive display, and vibrations are imparted into the device via the touch-sensitive display; based on the second event but not the first event being detected within the time window, determining that vibrations are imparted into the device but not via the touch-sensitive display and that an object is not touching the touch-sensitive display; activating the touch-sensitive display from a low energy usage state in response to both the first event and the second event being detected within the time window and in response to determining that an object is touching the touch-sensitive display, an object is not hovering over the touch-sensitive display, and vibrations are imparted via the touch-sensitive display into the device; and maintaining the touch-sensitive display in the low energy usage state in response to the second event but not the first event being detected within the time window and in response to determining that vibrations are imparted into the device, but not via the touch-sensitive display, and that an object is not touching the touch-sensitive display.

9. The computer readable medium of claim 8, wherein the steps further comprise: in response to the first sensor detecting the first event and the second sensor not detecting the second event within the time window, determining that the first event indicates an object is not touching the touch-sensitive display.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The included drawings are for illustrative purposes and serve only to provide examples of possible structures and process steps for the disclosed techniques. These drawings in no way limit any changes in form and detail that may be made to embodiments by one skilled in the art without departing from the spirit and scope of the disclosure.

(2) FIG. 1 is an example block diagram illustrating an apparatus for sensing touch events, in accordance with some embodiments of the present invention.

(3) FIG. 2 is an example timing diagram illustrating the relative time relationships of the two sensed events and a timer window, in accordance with some embodiments of the present invention;

(4) FIG. 3 is an example graphical representation illustrating three alternative touch-like events and their respective outcomes in regard to a touch-induced activation of the display, in accordance with some embodiments of the present invention; and

(5) FIG. 4 is an example flow chart of an embodiment of the method of the invention, in accordance with some embodiments of the present invention.

DETAILED DESCRIPTION

(6) Applications of methods and apparatus according to one or more embodiments are described in this section. These examples are being provided solely to add context and aid in the understanding of the present disclosure. It will thus be apparent to one skilled in the art that the techniques described herein may be practiced without some or all of these specific details. In other instances, well known process steps have not been described in detail in order to avoid unnecessarily obscuring the present disclosure. Other applications are possible, such that the following examples should not be taken as definitive or limiting either in scope or setting.

(7) In the following detailed description, references are made to the accompanying drawings, which form a part of the description and in which are shown, by way of illustration, specific embodiments. Although these embodiments are described in sufficient detail to enable one skilled in the art to practice the disclosure, it is understood that these examples are not limiting, such that other embodiments may be used and changes may be made without departing from the spirit and scope of the disclosure.

(8) One or more embodiments may be implemented in numerous ways, including as a process, an apparatus, a system, a device, a method, a computer readable medium such as a computer readable storage medium containing computer readable instructions or computer program code, or as a computer program product comprising a computer usable medium having a computer readable program code embodied therein.

(9) The disclosed embodiments may include methods of resolving near touch ambiguities in a touch-sensitive display including providing a first sensor for detecting a first event indicating an apparent activation of said touch-sensitive display, providing a second sensor for detecting a second event indicating an apparent activation of said touch-sensitive display, wherein said first and second events being distinctly different physical phenomena; and activating said touch-sensitive display only when both said first and second sensors detect respective first and second events within a selected time window.

(10) The disclosed embodiments may include apparatus to resolve near touch ambiguities in a touch-sensitive display and include a first sensor for detecting a first event indicating an apparent activation of said touch-sensitive display; a second sensor for detecting a second event indicating an apparent activation of said touch-sensitive display, wherein said first and second events being distinctly different physical phenomena; and at least one logic device responsive to said first and second sensors for activating said touch-sensitive display only when both said first and second sensors detect respective first and second events within a selected time window.

(11) The disclosed embodiments may include a machine-readable medium carrying one or more sequences of instructions for providing social information, which instructions, when executed by one or more processors, cause the one or more processors to detect a first event indicating an apparent activation of said touch-sensitive display; detect a second event indicating an apparent activation of said touch-sensitive display, wherein said first and second events being distinctly different physical phenomena; and activate said touch-sensitive display only when both said first and second sensors detect respective first and second events within a selected time window.

(12) In general, many touch screen technologies (e.g., capacitive touch screens) suffer from false triggers when a finger is close to the screen, but not physically touching, due to for example, capacitive coupling through the air. These false positive events are problematic as users often hover and move their fingers above the display while using touch screen devices, leading to incorrect input.

(13) Such unintended touch screen activations can be detrimental to overall device performance. Frequent unintended activations may incur increased battery usage which requires more frequent recharging and thus reduced availability of the device. Moreover, such unintended touch screen activations can enable device functions of which the user is unaware such as, for example in the case of smart phones, initiating unintentional phone calls which may incur phone charges and waste time for the unintended recipients of such phone calls. Other accidental device functions may alter program settings and thus generate errors that wreak havoc and confusion when the user intentionally seeks to use the program.

(14) FIG. 1 is an example block diagram illustrating an apparatus for sensing touch events, in accordance with some embodiments of the present invention. Embodiments of the present invention may significantly resolve near touch ambiguities in a touch screen by responding not only to a touch screen touch event, but also to a vibro-acoustic event (i.e., impact sound, acceleration). Only when a finger (or other implement, such as a stylus) physically touches a screen are mechanical vibrations imparted into the device. A near touch produces no such vibrations. These events generate signals received by two different sensors and/or processes and the two events must occur within a pre-defined window of time in order to be considered part of the same touch event. Thus, only a co-occurrence of both of these events may signify a true touch.

(15) Diagram 10 comprises a touch screen sensor 12, a vibro-acoustic event sensor 14 and a window timer 16. The touch screen sensor 12 comprises a touch-sensitive surface on a device (i.e., smart phone) which may be based on well-known capacitive, optical, resistive, electric field, acoustic or other technologies that form the underlying basis for touch interaction. An actual example of such a surface may be by way of illustration one of a Synaptics “Clear Pad Family” of capacitive touch screens.

(16) The vibro-acoustic event sensor 14 may comprise impact sensors, vibration sensors, accelerometers, strain gauges, or acoustic devices such as a condenser microphone, a piezoelectric microphone, MEMS microphone and the like. Actual examples of such devices include by way of illustration: Analog Devices ADXL 362 accelerometers, CUI Inc. 102-1721-ND electret microphones, and Analog Devices MiniSense 100 vibration sensors.

(17) Diagram 10 further comprises logic devices OR gate 18 and AND gate 20. Inputs of the OR gate 18 are connected to both the touch screen sensor 12 and the vibro-acoustic event sensor 14. The output of the OR gate 18 is connected to the window timer 16 to cause the window timer 16 to start a square wave-shaped time window whenever either of the touch screen sensor 12 or the vibro-acoustic event sensor 14 detects a respective event indicating an apparent activation of the display. The touch screen sensor 12, the vibro-acoustic event sensor 14 and the output of the window timer 16 are connected as inputs to the AND gate 20 so that only when both sensors detect respective events within the time window generated by the window timer 16, is a touch event fired resulting in screen activation.

(18) The use of two distinctly different sensors—the touch screen sensor 12 and the vibro-acoustic event sensor 14—produces four possible sensor event combinations, may be described in the Table 1 below.

(19) TABLE-US-00001 TABLE 1 Touch screen Touch screen triggered not triggered Vibro-acoustic event Touch event fired: YES Touch event fired: NO detected No vibro-acoustic Touch event fired: NO Touch event fired: NO event detected
The touch event firing (screen activation) may only occur when both the touch screen sensor 12 and the vibro-acoustic event sensor 14 detect different respective events caused by a physical action of the user. When neither event has been detected by the respective touch screen sensor 12 and the vibro-acoustic event sensor 14, or when only one event has been detected by the touch screen sensor 12 or the vibro-acoustic event sensor 14 in a selected time period, touch event firing does not result.

(20) It may be possible for vibro-acoustic events to occur independent of any user input. For example, by placing a smartphone onto a table, a mechanical vibration is produced that is similar in nature to the impact of a finger hitting a screen. However, without a paired touch screen event, no touch event is triggered.

(21) Further, there are techniques that can use acoustic processing to classify the type of touch (e.g., FingerSense). Thus, some embodiments of the present invention may employ such algorithms such that only a finger touch acoustic event and a touch screen event, trigger a system touch event. Any other impact types/sounds will lead to the touch being rejected, further increasing robustness. Processing may also be employed to reject sensor outputs which fail to meet selected criteria such as peak thresholds or signal shape requirements.

(22) FIG. 2 is an example timing diagram illustrating the relative time relationships of the two sensed events and a timer window, in accordance with some embodiments of the present invention. The timing diagram of FIG. 2 illustrates the relationship between the touch screen sensor 12 and the vibro-acoustic event sensor 14, the window timer 16 and the logic devices OR gate 18 and AND gate 20. As seen therein, whenever either of the touch screen sensor 12 or the vibro-acoustic event sensor 14 produces an initial output, the window timer 16 generates an output of selected time period. This time period may be selected to accommodate any anticipated timing sequence between sensor events depending upon the application. For some embodiments, for typical touch screen operation, a time period of less than 500 milliseconds may be utilized. For some embodiments, a maximum time period of 300 milliseconds may be utilized.

(23) As shown further in FIG. 2, when the two sensor-detected events occur within the selected timer window, the touch event is recognized (fired) to activate the touch-sensitive display (not shown). On the other hand, if only one of the two sensor-detected events occurs, the time window is initiated, but because the other event is not detected within the window time period, the touch-sensitive display is not activated.

(24) FIG. 3 is an example graphical representation illustrating three alternative touch-like events and their respective outcomes in regard to a touch-induced activation of the display, in accordance with some embodiments of the present invention. The practical results of the disclosed embodiment in regard to a touch screen device such as a smart phone, are illustrated in FIG. 3. FIG. 3 shows, respectively, the physical touch event, the near touch event and the no touch event. By employing the present invention, only the physical touch event results in activation of the touch screen. With the ambiguous near touch event, which would otherwise activate the screen without use of the present invention, the touch screen is not activated, thereby preventing inadvertent energizing of the display.

(25) FIG. 4 is an example flow chart of an embodiment of the method of the invention, in accordance with some embodiments of the present invention. Steps 30 and 40 represent sensor activation of first and second sensors based upon two different physical actions. Step 50 represents the initiating of the time window and step 60 determines whether or not both sensors were activated within the time window yielding a NOT TOUCH in step 70 and a YES TOUCH in step 80.

(26) Thus it will be understood that what has been disclosed herein are an apparatus and method for reducing or entirely eliminating unintentional activation of a touch-sensitive display by use of two distinct sensors detecting distinctly different physical phenomena to obviate display activation in response to an ambiguous near touch event.

(27) These and other aspects of the disclosure may be implemented by various types of hardware, software, firmware, etc. For example, some features of the disclosure may be implemented, at least in part, by machine-readable media that include program instructions, state information, etc., for performing various operations described herein. Examples of program instructions include both machine code, such as produced by a compiler, and files containing higher-level code that may be executed by the computer using an interpreter. Examples of machine-readable media include, but are not limited to, magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROM disks; magneto-optical media; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (“ROM”) and random access memory (“RAM”).

(28) Any of the above embodiments may be used alone or together with one another in any combination. Although various embodiments may have been motivated by various deficiencies with the prior art, which may be discussed or alluded to in one or more places in the specification, the embodiments do not necessarily address any of these deficiencies. In other words, different embodiments may address different deficiencies that may be discussed in the specification. Some embodiments may only partially address some deficiencies or just one deficiency that may be discussed in the specification, and some embodiments may not address any of these deficiencies.

(29) While various embodiments have been described herein, it should be understood that they have been presented by way of example only, and not limitation. Thus, the breadth and scope of the present application should not be limited by any of the embodiments described herein, but should be defined only in accordance with the following and later-submitted claims and their equivalents.