WIRELESS POSITIONING PEN WITH PRESSURE-SENSITIVE TIP
20180011550 · 2018-01-11
Assignee
Inventors
Cpc classification
G06F2203/0384
PHYSICS
International classification
G06F3/0346
PHYSICS
G06F3/0354
PHYSICS
Abstract
The present invention relates to a wireless positioning pen with a pressure-sensitive tip comprising an electric power source, optical system (1), inertial sensors and Bluetooth wireless technology, in which a casing (6) is provided with the second casing (7) in the rear, and the top part is provided with holes (61) with fingerboards (8) with buttons; said casing (6) provides a sliding housed body (4) with a battery (10) therein, a head (3) is attached to the front part thereof, and the first cover is (5) provided with a fastening mechanism (51) attached to lower part of the body (4), wherein the said body (4) houses a printed circuit board (2) consisting of the first fixed part (21), the second fixed part (22), the third fixed part (23), and the fourth fixed part (24) mutually interconnected with flexible parts (20), wherein the front body (4) part is provided with the optical system (1) configured for sliding thereof on the PCB fixed part (14) bearing the optical sensor (13) connected through the PCB flexible part (15) to the fourth fixed part (24), wherein the head (3) is provided with a tip button (92) with a light source (16), and in addition, a capacitive sensor (91).
Claims
1. A wireless positioning pen with a pressure-sensitive tip comprising an electric power source, optical system (1), inertial sensors and Bluetooth wireless technology characterized in that a casing (6) is provided with the second casing (7) in the rear, and the top part is provided with holes (61) with fingerboards (8) with buttons; said casing (6) provides a sliding housed body (4) with a battery (10) therein, a head (3) is attached to the front part thereof, and the first cover is (5) provided with a fastening mechanism (51) attached to lower part of the body (4), wherein the said body (4) houses a printed circuit board (2) consisting of the first fixed part (21), the second fixed part (22), the third fixed part (23), and the fourth fixed part (24) mutually interconnected with flexible parts (20), wherein the front body (4) part is provided with the optical system (1) configured for sliding thereof on the PCB fixed part (14) bearing the optical sensor (13) connected through the PCB flexible part (15) to the fourth fixed part (24), wherein the head (3) is provided with a tip button (92) with a light source (16), and in addition, a capacitive sensor (91).
2. A wireless positioning pen with a pressure-sensitive tip according to claim 1 characterized in that the optical system (1) consists of a holder (12) with one end configured to house the optical lenses (111), whereas the other end is configured for sliding on the fixed part (14) of a printed circuit board (PCB) (2) with an optical sensor (13).
3. A wireless positioning pen with pressure-sensitive tip according to claim 1 characterized in that the head (3) is provided with an expanding optical channel (19) with one end followed by the optical lenses (111), and the other end terminates in a free space, whereas both the optical channel (19) and optical system (1) are arranged coaxially with respect to the optical axis (17).
4. A wireless positioning pen with a pressure-sensitive tip according to claim 1 characterized in that the fingerboards (8) on the bottom are two-way.
5. A wireless positioning pen with a pressure-sensitive tip according to claim 1 characterized in that the first cover (5) is connected demountably with the body (4) via the fixing means (11) with a screw.
6. A wireless positioning pen with a pressure-sensitive tip according to claim 1 characterized in that the capacitive sensor (91) consists of a fixed electrode (911) built inside the first fixed part (21) and a mobile electrode (912).
7. The connection of the wireless positioning pen with a pressure-sensitive tip characterized in that the optical system (1) is connected to the printed circuit board (PCB) (2) further connected to the pressure-sensitive tip (9), wherein the battery (10) power supply is through the printed circuit board (PCB) (2).
8. The connection of the wireless positioning pen with a pressure-sensitive tip according to claim 6 characterized in that the optical system (1) comprises the light source (16) bi-directionally signal-connected with the optical sensor (13).
9. The connection of the wireless positioning pen with a pressure-sensitive tip according to claim 6 characterized in that the printed circuit board (2) includes a power manager (236) signally connected with the first voltage inverter (234) as well as the second voltage inverter (235), wherein the power manager (236) is further signally connected with a processor (241), bi-directionally signal-connected with an accelerator gyroscope module (242), further bi-directionally signal-connected with an antenna (243), and the first button (221), the second button (222), the third button (231), and the fourth button (232) are further signal-connected to the processor (241), wherein the latter button is further signal-connected to the power manager (236).
10. The connection of the wireless positioning pen with a pressure-sensitive tip according to claim 6 characterized in that the pressure-sensitive tip (9) includes a capacitive sensor (91) one-sidedly signal-connected with an RC oscillator (94) further signal-connected to the power manager (236).
11. The connection of the wireless positioning pen with a pressure-sensitive tip according to claim 6 characterized in that the powering of each electronic component is provided with a battery (10) interconnected with both the first voltage inverter (234) and the second voltage inverter (235), further via the first voltage inverter (234) with the processor (241), the charge pump (237), the optical sensor (13), and the RC oscillator (94).
12. A method of controlling the wireless positioning pen with a pressure-sensitive tip comprising a power source, optical system (1), inertial sensors and Bluetooth wireless technology according to claim 1 characterized in that it comprises: motion detection of the wireless positioning pen with a pressure-sensitive tip; and a change in the position of the cursor of the target controlled device depending on the detected motion; or evaluation of the screen of the target controlled device depending on the detected motion.
13. A method of controlling the wireless positioning pen with a pressure-sensitive tip according to claim 12 characterized in that the tilting motions of the wireless positioning pen with the press sensitive tip vertically translates the motions to the Y axis motion movement of the cursor of the target controlled devices, and tilting horizontally translates the motions to the X axis motion movement of the cursor for the target controlled devices.
14. A method of controlling the wireless positioning pen with a pressure-sensitive tip according to claim 12 characterized in that the tilting motions of the wireless positioning pen vertically scroll the screen of the target controlled device in the direction opposite to the motion of the wireless positioning pen.
15. A method of controlling the wireless positioning pen with a pressure-sensitive tip according to claim 12 characterized in that the rapid rotation motion of the wireless positioning pen around the longitudinal axis to one side and back followed by the rolling of the wireless positioning pen in a longitudinal axis makes the screen of the target controlled device move in a direction identical to the rolling of the wireless positioning pen.
Description
DESCRIPTION OF DRAWINGS
[0042] The invention is schematically shown in the drawings, where
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
EXAMPLES OF EMBODIMENTS
[0058] The invention will now be described in detail regarding the embodiments of the wireless positioning pen with the pressure-sensitive tip with reference to relevant drawings. The examples illustrate the unlimited embodiment variations of the positioning pen according to the invention.
[0059] The example embodiment of the multi-functional pen controller with the pressure-sensitive tip is illustrated in the attached drawings. According to
[0060] The configuration of each electronic component on the printed circuit board (PCB) 2 is illustrated in
[0061]
[0062] General processing of signals from the accelerometer gyroscope module 242 is described below.
[0063] The signals are processed in all user modes (functions), see Table 1.
[0064] Raw data (
[0065] The coordinate systems for acceleration and angular velocity are different intentionally. The acceleration system is selected to allow rotation offset CO1 for optical motion as well as rotation offset CO2 for 3D motion in the longitudinal pen axis according to X, Y components.
[0066] The X, Y, Z system for the gyroscope is selected in the accelerometer gyroscope module 242 so that X, Y components correspond to the motion in the F2 3D motion mode, and the Z axis is reserved for rolling.
[0067] The first order IIR filter is used to filter the acceleration according to the following formula:
{right arrow over (a)}(n)=0.9.Math.{right arrow over (a)}(n−1)+0.1.Math.{right arrow over (a.sub.s)}(n),
with the time period t.sub.n=15 ms, which exactly corresponds to the frequency of posting the position HID reports.
[0068] Acceleration filtration improves noise resistance and causes a slight phase delay with respect to angular velocities from which the accelerometer gyroscope module 242 offsets gained by CRL2 calibration are deducted. This is particularly manifested in fast motions in the F2 3D motion mode.
[0069] The offsets are deducted from the angular velocities as follows:
F1 Optical Motion User Function
[0070] The F1 Optical Motion function has been designed and used for optical X, Y axis positioning for surface 18 pen motion. Similarly to a traditional pen, the user causes cursor movement through the pen motions on the detected surface 18 of the target controlled device in the X, Y axes. The F1 optical motion function is automatically enabled after switching on the device by pressing the fourth button 232 and connecting to the target controlled device. The F5 optical scrolling function is enabled by pressing the first button 221. Pressing the second button 222 submits information about pressing the secondary button to the target controlled device in the manner well known for a standard computer mouse. Intermittent lighting of the LED diode 223 provides optical signalling for the enabled function.
[0071] When processing data from the optical sensor 13, the CO1 rotation offset for the optical motion methods are applied with respect to the pen longitudinal axis and CAL3 perpendicular calibration with respect to the detected surface 18. Furthermore, the positioning interruption methods are applied depending on the F6 pressure-sensitive tip 9.
[0072] The steps of the F1 optical motion function are illustrated in
[0073] Data is processed as follows:
{right arrow over (r)}=R.Math.A .Math.Δ{right arrow over (o)},
where
is a relative change to the position submitted in the HID report
is a relative change to a pad position as seen by the optical sensor 13
R is an offset matrix for CO1 rotation offset for the optical motion
A is a calibration matrix specified during CAL3 perpendicular calibration.
F2 User Function—3D Motion
[0074] The F2 3D Motion function is designed for 3D spatial pen motion. When the user hits a detected surface that is 18 not suitable for the optical sensor 13, e.g. glass etc. or for any reason, the user may position the cursor using the spatial pen motions. The F2 3D Motion function is enabled by pressing the fourth button 232. When the button 221 is pressed, the tilting of the wireless positioning pen with press sensitive tip upwards or downwards translates the motions to the Y axis motion movement of the cursor of the target controlled devices, and tilting to the right or left translates the motions to the X axis motion movement of the cursor of the target controlled devices including any combinations thereof. Pressing or releasing the second button 222 submits the information (HID report) on the status of the primary button to the target controlled device in the manner well-known for a standard computer mouse. When the first button 221 and the second button 222 are pressed simultaneously, positioning and submitting of information about pressing the primary button occurs at the same time in the manner known for a standard computer mouse, whereby the user may launch the drag and drop function, if available, on the target controlled device. While actively positioning, the second button 222 may be additionally pressed and released due to the design of the fingerboards 8 on the buttons. Pressing the second button 231 submits information about pressing the secondary button to the target controlled device in the manner well-known for a standard computer mouse. Intermitted lighting of the RGB LED diode 233 provides optical signalling for the enabled function.
[0075] The CO2 rotation offset methods apply during data processing for 3D motion with respect to the pen's longitudinal axis and the SF1 variable intensification method. Pressing and holding the first button 221 enables to position or respond to the pen motion in a 3D space. On the contrary, positioning is interrupted when the first button 221 is released. The pen vibrates when the first button 221 is either pressed or released, and said vibration translates unfavourably to the cursor position on the target controlled device. These unfavourable conditions have been resolved individually as follows. The start of the positioning is delayed by 200 ms when the first button 221 is pressed. Suppression of the pen vibrations with release of the first button 221 is managed by submitting the HID report −Δx, −Δy, where Δx, Δy are the position values from the previous HID report because when the first button 221 is released, the vibrations occur before the first button 221 status is detected (pressed/released)—as illustrated in the figure below.
Illustration of Pen Vibrations when Pressing/Releasing the First Button
[0076]
[0077] Data is processed as follows:
where
is the relative change in the position submitted in the HID report
{right arrow over (ω)} is the angular velocity vector measured by accelerometer gyroscope module 242
G is the CO2 offset matrix for 3D motion
g is SF1 variable intensification
is the intermediate result—non-intensified change in position
F3 User Function—3D Scrolling
[0078] The F3 3D scrolling function scrolls the image, document, website etc. by moving (tilting) the pen up or down.
[0079] The F3 3D scrolling function is enabled by a sequence of pressing, releasing, and holding the first button 221. From the moment when the first button 221 is permanently pressed, the image scrolls by the motion of tilting the pen upwards or downwards. The function ends upon releasing the first button 221. The pen vibrations due to pressing or releasing the first button 221 have no unfavourable impacts in the form of unintentional scrolling because their amplitude is usually lower than the one-line scrolling threshold. Intermitted lighting of RGB LED diode 223 provides optical signalling for the enabled function.
[0080] The CO2 rotation offset applies during data processing for the 3D motion with respect to the longitudinal pen axis identically to the F2 3D motion function with slightly different parameters. Information about the X axis is discarded and the Y axis information is used.
[0081]
[0082] Data is processed as follows:
{right arrow over (e)}=G.Math.{right arrow over (ω)},
Δscroll=h(e.sub.y).Math.e.sub.y,
where
Δscroll is the number of lines for scrolling submitted in the HID report on scrolling/buttons
{right arrow over (ω)} is the angular velocity vector measured by gyroscope
G is the CO2 offset matrix for 3D motion
h is the SF1 variable intensification of scrolling
is the intermediate result—non-intensified change of position
F4 User Function—Rolling Motion
[0083] The F4 rolling motion function is designed for scrolling an image, document, website and more by rolling the pen in a longitudinal axis.
[0084] The F4 rolling motion function is enabled by a gesture in the form of quick pivoting of the pen in the longitudinal axis several times to one side and back.
Example Course of the Angular Velocity in the Pen Longitudinal Axis (Z)
[0085] The detection algorithm records the moment with angular velocity over either a positive or a negative threshold—0.8 of the maximum range. When the threshold value is exceeded, the angular velocity polarity and current time are stored in a circular buffer for the length of eight samples. The gesture is recognized when the buffer holds an alternating sequence of −1 and 1 with a length of at least four samples with a time spacing of 2.4 seconds “from the oldest to the youngest”. Intermitted lighting of the RGB LED diode 233 provides optical signalling of the enabled function.
[0086] No CO2 rotation offset for 3D motion applies here for data processing; only the SF1 variable intensification with different parameters is applied.
[0087]
[0088] Data is processed as follows:
Δscroll=j(ω.sub.z).Math.ω.sub.z,
where
Δscroll is the number of lines for scrolling submitted in the HID report on scrolling/buttons
ω.sub.z is the Z component of angular velocity vector {right arrow over (ω)} measured by gyroscope.
j is the SF1 variable intensification of image scrolling.
F5 User Function—Optical Scrolling
[0089] The F5 optical scrolling function is designed for scrolling an image, document, website and more by the pen motion on a detected surface in the Y axis (from user and to user).
[0090] The F5 optical scrolling function is enabled upon pressing and holding the first button 221 during the F1 optical motion function. The image scrolls by motion on the detected surface 18 from the user or to the user. When the first button 221 is released, the F5 optical scrolling function is disabled and the F1 optical motion function is enabled. The pen motion from the user or to the user is configured in the ratio of 10 pixels (Δy)/1 line.
[0091] When processing data from the optical sensor 13, the CO1 rotation offset for the F1 optical motion function methods are applied with respect to the pen longitudinal axis and the CAL3 perpendicular calibration with respect to the detected surface 18.
[0092]
Processing of Data:
[0093]
where
Δscroll is the number of lines for scrolling submitted in the HID report on scrolling/buttons
is the relative change to a pad position as seen by the optical sensor 13
R is an offset matrix for CO1 rotation offset for the optical motion
A is the calibration matrix specified during CAL3 perpendicular calibration
is the intermediate result—change in position.
F6 User Function—Pressure-Sensitive Tip
[0094] The pressure-sensitive tip replaces the standard primary mouse button. The intensity of force applied on the tip button 92 cone, hereinafter “press”, is divided into several levels (soft press, medium press, and hard press).
Soft press—detection of contact with the detected surface 18
Medium press—click threshold
Hard press—double-click threshold
[0095] The RC oscillator 94 of the capacitive sensor 91 oscillates at a relatively stable frequency and detuning (frequency drop) up to about 20% occurs due to change of the press (intensity of the force applied to the tip button 92 cone). The requests for distinguishing the tip sensor require safe recognition of a 1% change in the frequency due to a change to the press.
Example Course of the Frequency of the RC Oscillator 94
[0096] The press is evaluated by measuring the frequency in 15 ms cycles. The measured value shows some unfavourable properties and these are software offset: [0097] The frequency may differ piece by piece (˜25%). [0098] Slow change to frequency due to temperature (˜5%). [0099] The frequency may shift permanently (˜10%) due to the aging of the press sensor. [0100] Each time it is switched on, the RC oscillator 94 may start at a slightly different frequency (˜1%). [0101] The frequency measurement of the RC oscillator 94 is deviated (˜10%), usually upwards, with about 1:1,000 likelihood.
[0102] The frequency from the RC oscillator 94 is filtered by a frame filter to discard instability. The last four measurements are stored in the buffer. Any measurement significantly different from the others is attenuated. This eliminates single measurement errors. On the contrary, the change in the frequency caused by pressing on the tip button 92 cone will not occur and discard within 15 ms.
[0103] The RC oscillator 94 frequency is further processed:
where
t.sub.v is information processed from the capacitive sensor 91. This is a dimensionless quantity, a number in the range from 0 (no press) up to 0.2 (maximum press)
f is the current frequency of the RC oscillator 94 after frame filter filtration
f.sub.0 is the estimated maximum frequency of the RC oscillator 94
f.sub.0 is computed from f using the first order IIR filter with different time constants for signal increase and decrease.
For f.sub.0<f:
f.sub.0(n)=0.9.Math.f.sub.0(n−1)+0.1.Math.f(n).
For f.sub.0≧f:
f.sub.0(n)=0.9998.Math.f.sub.0(n−1)+0,0002.Math.f(n).
[0104] The filter is configured that f.sub.0 quickly adapts to the frequency of the RC oscillator 94 after the pen is switched on. On the contrary, when f decreases, the estimated maximum frequency is decreased by about 1% in 1 second. This is sufficient to monitor the temperature drift of the RC oscillator 94.
[0105] The press level evaluation is used for the following functions: [0106] 1. The F1 optical motion function uses the press to derive the sending of the primary button mouse click (medium press level) or the primary button mouse double-click (hard press level). [0107] 2. For the F2 3D motion, F3 3D Scrolling, and F4 rolling motion functions, the press level over the medium press causes the F1 optical motion function to be enabled immediately. [0108] 3. The positioning is temporarily attenuated based on the press in the F1 optical motion function (sending the position in the HID report). When the tip button cone 92 is pressed, a slight approximation to the detected surface 18 occurs, whereby non-zero Δx Δy information is received from the optical sensor 13 despite that the cone did not move on the detected surface 18. As a result, this behaviour would prevent any clicking because the cursor would immediately jump aside before clicking. Therefore, positioning ceases at the moment of pressing on the tip button 92 cone, and positioning is resumed after 300 ms.
CO1 Rotation Offset for Optical Motion
[0109] The matrix R offsets rotation along the longitudinal pen axis during positioning. The accelerometer gyroscope module 242 measures gravitational acceleration for determination of the rotation:
[0110] In fact, the offset matrix performs the rotation operation:
where {right arrow over (a)} is the standard for the gravitational acceleration
|{right arrow over (a)}|=√{square root over (a.sub.x.sup.2+a.sub.y.sup.2+a.sub.z.sup.3)}.
[0111] The matrix rotation offset R is only used provided that the following condition has been met:
i.e. only when the gravity vector is not parallel with the longitudinal pen axis.
CO2 Rotation Offset for 3D Motion
[0112] The pen rotation offset around the longitudinal axis based on gravity vector a measured by the accelerometer gyroscope module 242:
SF1 Variable Intensification
[0113] A method for fully eliminating small and slow deviations. The method prevents cursor vibrations in a “steady” status (due to natural hand shakes or the accelerometer gyroscope module 242 failure). On the contrary, the cursor motion will increase in the case of rapid motion.
CAL1 Pressure-Sensitive Tip Calibration
[0114] Every human uses different force intensity when writing with a standard writing pen applied on the pressure-sensitive tip 9 cone (“press intensity”). The device is therefore provided with user calibration to “demonstrate” to the pen which press intensity is comfortable for the user.
[0115] Following the enabling of the calibration function, the user has 5 seconds to push the pressure-sensitive tip 9 cone several times onto the detected surface at the maximum force to be used for double-clicking. The pen detects the maximum press and derives 3 levels (and saves these in the FLASH memory):
TABLE-US-00002 Name of level Value Use soft press 0.1 * maximum To detect contact between tip and pad medium press 0.25 * maximum Click threshold hard press 0.9 * maximum Double-click threshold
CAL2 Accelerometer Gyroscope Module 242 Calibration
[0116] The offsets of the accelerometer gyroscope module 242 are provided in that the pen is left laid immobile (for about 10 seconds), N measurements are made (about 670), and the average is calculated:
[0117] Following the calibration {right arrow over (ω.sub.offset)} is stored in the storage media of the pen.
CAL3 Perpendicularity Calibration
[0118] The matrix A offsets the pen rotation with respect to the coordinate system of the detected surface 18. For example, there is a significant difference between left-handers and right-handers in definition of uniquely “handling” the pen.
and then by the angle orientation (which could also be icos(π/2), that corresponds to {right arrow over (v.sub.2)} from left to right):
[0119] The calibration matrix A is the rotation again only:
[0120] If no CRL3 perpendicular calibration was made, the matrix is:
[0121]
[0122] The connection function is as follows: The battery 10 (1.5V) provides voltage to the inverter 234, which increases the voltage to 1.8V and the processor 241, RC oscillator 94, optical sensor 13, and the charge pump 237 are thereby powered. The charge pump 237 transforms the voltage to 2.8V to power LED diode 223 and RGB LED diode 233. The battery 10 (1.5V) provides voltage to the inverter 235, which increases the voltage to 2.4V and the accelerometer gyroscope module 242 is thereby powered. The processor 241 bi-directionally communicates with the accelerometer gyroscope module 242, whereby it receives information about the 3D motions of the device. The capacitive sensor 91 detunes the RC oscillator 94 by the change to the capacity, and the processor 241 processes the frequency of the latter. The optical sensor 13 bi-directionally communicates with the processor 241 to obtain information about X, Y axes movement while moving the pen on the detected surface 18. The first button 221, the second button 222, the third button 231, as well as the fourth button 232 are connected to the processor 241, wherein the fourth button 232 is also connected to the power manager 236, whereby the switching on/off of the hardware pen is provided. The processor 241 and bi-directionally connected antenna 243 provide wireless connection with the target device.
INDUSTRIAL APPLICABILITY
[0123] The multi-functional pen controller for a computer according to this invention may be used for the comfortable control of computer devices.
LIST OF REFERENCE MARKS
[0124] 1 optical system [0125] 111 optical lens [0126] 12 holder [0127] 13 optical sensor [0128] 14 PCB fixed part [0129] 15 PCB flexible part [0130] 16 light source [0131] 17 optical axis [0132] 18 detected surface [0133] 19 optical channel/tube [0134] 2 PCB (printed circuit board) [0135] 20 flexible part [0136] 21 first fixed part [0137] 211 capacitive sensor surface [0138] 22 second fixed part [0139] 221 first button [0140] 222 second button [0141] 223 LED diode [0142] 231 third button [0143] 232 fourth button [0144] 233 RGB LED diode [0145] 234 1.8V voltage inverter [0146] 235 2.4V voltage inverter [0147] 236 power manager [0148] 237 charge pump [0149] 241 processor [0150] 242 accelerometer gyroscope module [0151] 243 antenna [0152] 23 third fixed part [0153] 24 fourth fixed part [0154] 25 first contact [0155] 26 second contact [0156] 3 head [0157] 31 head fastening mechanism [0158] 4 body [0159] 5 first cover [0160] 51 fastening mechanism [0161] 6 casing [0162] 61 hole [0163] 7 second casing [0164] 8 fingerboard [0165] 9 pressure-sensitive tip [0166] 91 capacitive sensor [0167] 911 fixed electrode [0168] 912 mobile electrode [0169] 92 tip button [0170] 921 pressure-sensitive tip rotation axis [0171] 93 plug [0172] 94 RC oscillator [0173] 10 battery [0174] 11 fastening means [0175] F1—X, Y axis positioning function for surface pen motion [0176] F2—X, Y axis positioning function for spatial pen motion [0177] F3—up and down angled pen scrolling motion function [0178] F4—longitudinal axis pen rolling motion function [0179] F5—X axis surface pen scrolling motion function [0180] F6—surface pressure-sensitive tip pressing intensity sensing function [0181] CO1—rotation offset for optical motion [0182] CO2—rotation offset for 3D motion [0183] SF1—variable intensification [0184] CAL1—pressure-sensitive tip calibration [0185] CAL2—gyroscope calibration [0186] CAL3—perpendicular calibration