SOFTWARE-DEFINED SENSING SYSTEM CAPABLE OF RESPONDING TO CPU COMMANDS
20170371492 · 2017-12-28
Inventors
- Han-Chang CHEN (New Taipei City, TW)
- Chung-Lin CHIA (Taoyuan City, TW)
- Chih-Wen WU (Miaoli County, TW)
- Yen-Hung TU (Taipei, TW)
- Jen-Chieh CHANG (New Taipei City, TW)
Cpc classification
G09G3/20
PHYSICS
G06F3/038
PHYSICS
G06F3/0488
PHYSICS
G09G5/003
PHYSICS
G06F3/14
PHYSICS
G06F3/04184
PHYSICS
International classification
G06F3/041
PHYSICS
G06F3/038
PHYSICS
G06F3/0488
PHYSICS
Abstract
A software-defined sensing system capable of responding to CPU commands, including: at least one input operation sensing module; at least one driving unit for driving the at least one input operation sensing module via at least one first interface; at least one control unit for receiving at least one sensors-configuration command via at least one second interface to control the at least one driving unit; at least one central processing unit, having at least one first function library to provide at least one sensors-configuration setting function for determining the sensors-configuration command; and at least one application program having at least one sensors-configuration function call instruction for generating the sensors-configuration command to provide at least one input sensing function.
Claims
1. a software-defined sensing system capable of responding to CPU commands for implementing an intelligent device, including: at least one input operation sensing module, each having a sensing plane consisting of at least one sensing element, the at least one sensing element having at least one sensing function selected from a group consisting of force sensing function, thermal sensing function, photo sensing function, magnetic field sensing function, electrical field sensing function, acoustic wave sensing function, radiation sensing function, chemicals sensing function and biosensing function; at least one driving unit, each being used for driving one of the at least one input operation sensing module via at least one first interface to execute a sensing procedure, and receiving a kind of sensed information via the at least one first interface; at least one control unit, each being used for receiving a sensors-configuration command via at least one second interface to generate the sensing procedure; at least one central processing unit, having at least one first function library, the at least one first function library containing at least one sensors-configuration setting function to determine the sensors-configuration command; and at least one application program, stored in at least one memory and to be executed by the at least one central processing unit; wherein, each of the at least one application program has at least one sensors-configuration function call instruction, and each of the at least one sensors-configuration function call instruction corresponds to one of the at least one sensors-configuration setting function so that when the at least one central processing unit executes the at least one application program, the sensors-configuration command is generated according to a called function of the at least one sensors-configuration setting function, and the sensing procedure is determined by the sensors-configuration command, and at least one input sensing function is thereby provided.
2. The software-defined sensing system as disclosed in claim 1, wherein each of the at least one control unit has a microprocessor, a memory and an operating timing control unit.
3. The software-defined sensing system as disclosed in claim 1, wherein each of the at least one driving unit has a multiplexing circuit, and a digital-to-analog conversion circuit and/or an analog-to-digital conversion circuit.
4. The software-defined sensing system as disclosed in claim 1, wherein each of the at least one driving unit and each of the at least one control unit are embodied in separated integrated circuits, or each of the at least one driving unit is integrated with one of the at least one control unit in an integrated circuit.
5. The software-defined sensing system as disclosed in claim 1, wherein each of the at least one control unit is integrated with one of the at least one central processing unit in an integrated circuit.
6. The software-defined sensing system as disclosed in claim 1, wherein the at least one control unit has at least one second function library, each of the at least one second function library contains at least one sensors-configuration determining function for generating a sensors-configuration data according one of the at least one sensors-configuration command to control one of the at least one driving unit, and thereby determine the sensing procedure.
7. The software-defined sensing system as disclosed in claim 6, wherein the application program is supported by an OS in the central processing unit, and the first function library and/or the second function library are/is used by the application program to generate the at least one input sensing function and/or at least one sensing spec according to instructions of the application program; or the application program is supported by a first OS in the central processing unit, and the control unit has a local application program supported by a second OS, the first function library is used by the application program to generate at least one first function of the at least one input sensing function and/or at least one first sensing spec, and the second function library is used by the local application program to generate at least one second function of the at least one input sensing function and/or at least one second sensing spec.
8. The software-defined sensing system as disclosed in claim 1, wherein the sensors-configuration command is selected from a group consisting of sensing device enable/disable configuration command, sensing function configuration command, and sensing spec setting command.
9. The software-defined sensing system as disclosed in claim 1, wherein the second interface is a wired transmission interface or a wireless transmission interface, and the central processing unit communicates with an external device in a wired transmission way or a wireless transmission way.
10. The software-defined sensing system as disclosed in claim 1, wherein the at least one control unit communicates with the at least one central processing unit in a one-to-one way or a one-to-many way or a many-to-one way.
11. The software-defined sensing system as disclosed in claim 1, wherein the input sensing function is selected from a group consisting of multi-points touch function, force sensing function, hover sensing function, 3D scan sensing function, 2D image sensing function, fingerprint sensing function, palm-print sensing function, and face characteristics sensing function.
12. The software-defined sensing system as disclosed in claim 1, wherein the sensing procedure includes determining a connecting status of the at least one sensing element of one of the at least one input operation sensing module.
13. The software-defined sensing system as disclosed in claim 1, wherein the sensing procedure includes determining a scan rule for the at least one sensing element of one of the at least one input operation sensing module.
14. The software-defined sensing system as disclosed in claim 1, wherein the sensing procedure includes determining a data format of sensed information from one of the at least one input operation sensing module.
15. The software-defined sensing system as disclosed in claim 1, wherein the input operation sensing module includes a sensor array selected from a group consisting of capacitive sensor array, force sensor array, photo sensor array, acoustic wave sensor array, and magnetic field sensor array.
16. The software-defined sensing system as disclosed in claim 1, wherein at least one of the at least one input operation sensing module is a touch display device, and an image display procedure and a touch sensing procedure of the touch display device act on at least one same electrode simultaneously or non-simultaneously, or act on different electrodes simultaneously or non-simultaneously.
17. The software-defined sensing system as disclosed in claim 16, wherein the sensing procedure includes a dynamic sensing mode for one of the at least one driving unit to determine an operating timing and/or at least one sensing area of the sensing plane for the touch sensing procedure.
18. The software-defined sensing system as disclosed in claim 16, wherein the touch display device is combined with a plurality of the input operation sensing modules to provide a hybrid input operation sensing function.
19. The software-defined sensing system as disclosed in claim 1, wherein the intelligent device is an intelligent input device, an intelligent vehicle control device, or an intelligent IOT device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0108]
[0109]
[0110]
[0111]
[0112]
[0113]
[0114]
[0115]
[0116]
[0117]
[0118]
[0119]
[0120]
[0121]
[0122]
[0123]
[0124]
[0125]
[0126]
[0127]
[0128]
[0129]
[0130]
[0131]
[0132]
[0133]
[0134]
[0135]
[0136]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0137] The present invention will be described in more detail hereinafter with reference to the accompanying drawings that show the preferred embodiments of the invention.
[0138] Please refer to
[0139] The driving circuit 200 has a first interface 201, a second interface 202, a third interface 203, and a control unit 204.
[0140] The first interface 201 is used to receive pixel data D.sub.IMG and touch configuration data D.sub.TC from the CPU 210, wherein the first interface 201 can transmit data in a serial manner or a parallel manner.
[0141] The second interface 202 is used to couple with the touch display module 220.
[0142] The third interface 203 is used to transmit touch data D.sub.TOUCH to CPU 210, wherein the touch data D.sub.TOUCH is derived by the control unit 204 during an execution of a touch detection procedure, and the third interface 203 can be an interface of I2C (inter integrated circuit), SPI (serial peripheral interface), 3W (3-wire), USB (universal serial bus), TTL (transistor-transistor logic), or LVDS (low voltage differential signal).
[0143] The control unit 204 uses the second interface 202 to drive the touch display module 220 to show an image according to the pixel data D.sub.IMG, and executes the touch detection procedure on the touch display module 220 via the second interface 202, wherein, the touch detection procedure is determined according to the touch configuration data D.sub.TC.
[0144]
[0145] The timing control unit 2041 is used to control an operation timing of the source driver unit 2042, the gate driver unit 2043, the touch driver unit 2044, and the touch detection unit 2045 according to the touch configuration data D.sub.TC, so as to execute an image display procedure and/or the touch detection procedure.
[0146] The memory unit 2046 is used to store the touch data D.sub.TOUCH.
[0147] The power unit 2047 can provide driving voltages for the source driver unit 2042 and the touch driver unit 2044.
[0148] The image interface unit 2048 is used to couple with the first interface 201 to receive the pixel data D.sub.IMG and the touch configuration data D.sub.TC from the CPU 210, and couple with the third interface 203 to transmit the touch data D.sub.TOUCH to the CPU 210. The touch data D.sub.TOUCH can include touch coordinates, a touch image, and vector information derived from multiple frames of the touch images, wherein the vector information can be used to predict a next touch location.
[0149] The communication interface 2049 is used to control data transmission of the first interface 201 and data transmission of the third interface 203.
[0150] Please refer to
[0151] In one embodiment, the touch configuration data D.sub.TC has 8 control bits D.sub.0-D.sub.7, wherein, D.sub.0 is used to enable/disable at least one touch point; D.sub.1-D.sub.2 are used to control a connection configuration of at least one multiplexer—the connection configuration of the at least one multiplexer can combine multiple touch points into an effective touch point—to determine at least one touch detection area; D.sub.3-D.sub.4 are used to control a weighting configuration of at least one touch point to provide a touch discrimination effect, wherein the weighting configuration can alter a signal gain and/or a threshold voltage of the touch detection unit 2045 to generate the touch discrimination effect, and thereby meet a touch request of an application program executed by the CPU 210; and D.sub.5-D.sub.7 are used to control a charging voltage for at least one touch point.
[0152] The driving circuit 200 can be implemented by a single integrated circuit or multiple integrated circuits. Please refer to
[0153] Besides, the touch display module 220 has a flat panel display, which is one selected from a group consisting of a thin-film-transistor display, an organic-light-emitting-diode display, a nanometer-carbon-tube display, a super-twisted-nematic display, and a field-emission display.
[0154] Thanks to the foregoing arrangement, the present invention can provide multiple functions. Please refer to
[0155] Please refer to
[0156] Please refer to
[0157] Please refer to
[0158] Please refer to
[0159] Please refer to
[0160]
[0161]
[0162]
[0163] performing a touch detection (one frame at a time) (step f); outputting touch data (one frame at a time) (step g); and determining if a further detection is needed? If yes, then go to step f; if no, go back to an initial step of this flowchart (step h).
[0164]
[0165]
[0166]
[0167]
[0168]
[0169]
[0170]
[0171] In addition to driving a touch display module, the driving circuit of the present invention can also be used to drive a touch module. For example, the touch display driving circuit capable of responding to CPU commands of the present invention can include:
[0172] a first interface for receiving touch configuration data from a CPU;
[0173] a second interface for coupling with a touch module; and
[0174] a control unit, which drives the touch module via the second interface to execute a touch detection procedure, wherein the touch detection procedure is determined according to the touch configuration data; and the touch module has a touch array, which is one selected from a group consisting of a capacitive type touch array, a resistive type touch array, an optical type touch array, an acoustic type touch array, a pressure sensing type touch array, and a radar type touch array.
[0175] Besides, the touch display driving circuit capable of responding to CPU commands can be implemented by a single integrated circuit or multiple integrated circuits.
[0176] The first interface can be used to transmit data in a serial manner or a parallel manner.
[0177] The touch configuration data includes multiple control bits.
[0178] The multiple control bits can be used to determine a connection configuration of at least one multiplexer, and a weighting configuration of at least one touch point.
[0179] The multiple control bits can be further used to enable/disable at least one touch point.
[0180] Following the architecture and principle disclosed above, the present invention can be used to implement many touch functions like pressure sensing, finger print verification, palm print verification, ear image verification, or 3 dimensional touch sensing. One embodiment is as follows: a touch display driving circuit capable of responding to CPU commands, including:
[0181] a first interface for receiving pixel data and touch configuration data from a CPU and outputting touch report data to the CPU, wherein the first interface transmits data in a serial manner or a parallel manner and the touch configuration data includes multiple control bits;
[0182] a second interface for coupling with a touch display module;
[0183] a control unit, which drives the touch display module via the second interface to show an image according to the pixel data, executes a touch detection procedure on the touch display module via the second interface to derive touch detected data, and processes the touch detected data to generate the touch report data, wherein the touch detection procedure is determined according to the touch configuration data, the multiple control bits included in the touch configuration data are used to determine a connection configuration of at least one multiplexer to set a touch resolution profile, and a weighting configuration of at least one touch point to set a touch sensitivity profile, and the touch report data include data selected from a group consisting of data representing a sensed pressure profile exerted on the touch display module, data representing a finger print of a user, data representing a palm print, data representing an ear image, data representing at least one touched location, characteristic data of a finger print, characteristic data of a palm print, and characteristic data of an ear image.
[0184] The control unit preferably includes a timing control unit, a source driver unit, a gate driver unit, a touch driver unit, a touch detection unit, and an information processing unit.
[0185] The touch display module can include an in-cell touch display or an on-cell touch display or an out-cell touch display. The in-cell touch display or on-cell touch display has touch sensors integrated in a display, and the out-cell touch display has touch sensors stacked on a display. The touch detected data can be derived from a capacitive touch plane of the touch display module, and the touch detected data can be raw data or processed data of the raw data, wherein the raw data correspond to capacitance values detected on the capacitive touch plane.
[0186] The touch display module can further include a pressure sensor module and/or a finger print detection module, and the touch detected data can include data derived from the pressure sensor module and/or data derived from the finger print detection module.
[0187] The touch report data can further include data representing a change of the sensed pressure profile over time and/or data representing a change of a sensed touched area over time.
[0188] In addition, the touch report data can further include data representing a joystick style operation on a touch operation area, and the data representing a joystick style operation are derived according to a change of the sensed pressure profile over time or a change of a sensed touched area over time.
[0189] Please refer to
[0190] To release the workload of the control unit, some processing jobs can be transferred to the CPU side, and one embodiment is as follows: a touch display driving circuit capable of responding to CPU commands, including:
[0191] a first interface for receiving pixel data and touch configuration data from a CPU and outputting touch report data to the CPU, wherein the first interface transmits data in a serial manner or a parallel manner and the touch configuration data includes multiple control bits;
[0192] a second interface for coupling with a touch display module;
a control unit, which drives the touch display module via the second interface to show an image according to the pixel data, executes a touch detection procedure on the touch display module via the second interface to derive touch detected data, and processes the touch detected data to generate the touch report data, wherein the touch detection procedure is determined according to the touch configuration data, the multiple control bits included in the touch configuration data are used to determine a connection configuration of at least one multiplexer to set a touch resolution profile, and a weighting configuration of at least one touch point to set a touch sensitivity profile, and the CPU processes the touch report data to get data representing a sensed pressure profile exerted on the touch display module, or characteristic data of a finger print or a palm or an ear of a user, or data representing a change of the sensed pressure profile over time, or data representing a change of a sensed touched area over time.
[0193] Based on the principles elaborated above, a software-defined sensing system capable of responding to CPU commands can be further established.
[0194] Please refer to
[0195] The input operation sensing module 100 has a sensing plane consisting of at least one sensing element, the at least one sensing element having at least one sensing function selected from a group consisting of force sensing function, thermal sensing function, photo sensing function, magnetic field sensing function, electrical field sensing function, acoustic wave sensing function, radiation sensing function, chemicals sensing function and biosensing function. For example, the sensing plane can include a sensor array, which can be a capacitive sensor array, a force sensor array, a photo sensor array, an acoustic wave sensor array, or a magnetic field sensor array.
[0196] The driving unit 200, preferably having a multiplexing circuit 202 and a digital-to-analog conversion circuit and/or an analog-to-digital conversion circuit 203, is used to drive an input operation sensing module 100 via a first interface 201 to execute a sensing procedure, and used to receive one kind of sensed information via the first interface 201, where the sensed information can be capacitive sensed information, force sensed information, photo sensed information, acoustic wave sensed information, or magnetic field sensed information.
[0197] For possible embodiments, the sensing procedure can include determining a connecting status of the at least one sensing element of an input operation sensing module 100; or include determining a scan rule for the at least one sensing element of an input operation sensing module 100, where the scan rule can be a one-dimension scan rule, a two-dimension scan rule, a single-layer scan rule, a double-layers scan rule, a tracking scan rule, a GUI mapping scan rule, a dynamic frequency scan rule, or a dynamic resolution scan rule; or include determining a data format of sensed information from an input operation sensing module 100, where the data format can be a raw data format, a coordinate data format, a vector data format, a biological characteristic data format, or a hybrid fusion data format.
[0198] The control unit 210, preferably having a microprocessor (not illustrated in the figure), a memory (not illustrated in the figure) and an operating timing control unit 212, is used to receive a sensors-configuration command via a second interface 211 and control a driving unit 200 according to the sensors-configuration command, where the sensors-configuration command can be sensing device enable/disable configuration command, sensing function configuration command, or sensing spec setting command.
[0199] The central processing unit 300 has a first function library 301 containing at least one sensors-configuration setting function for determining the sensors-configuration command. Besides, the central processing unit 300 can have an output/input interface 302 for communicating with an external device 500 in a wired way or wireless way.
[0200] The application program 400 is stored in a memory and to be executed by a central processing unit 300, where the application program 400 has at least one sensors-configuration function call instruction, and each of the at least one sensors-configuration function call instruction corresponds to one of the at least one sensors-configuration setting function so that when a central processing unit 300 executes an application program 400, the sensors-configuration command is generated according to a called function of the at least one sensors-configuration setting function, and the sensing procedure is determined by the sensors-configuration command, and at least one input sensing function is thereby provided. The input sensing function can be a multi-points touch function, a force sensing function, a hover sensing function, a 3D scan sensing function, a 2D image sensing function, a fingerprint sensing function, a palm-print sensing function, or a face characteristics sensing function.
[0201] For possible embodiments, the driving unit 200 and the control unit 210 can be embodied in separated integrated circuits (as illustrated in
[0202] In a possible embodiment, the control unit 210 can have at least one second function library 213, and each of the at least one second function library 213 contains at least one sensors-configuration determining function for generating a sensors-configuration data according one of the at least one sensors-configuration command to control a driving unit 200, and thereby determine the sensing procedure.
[0203] In a possible embodiment, the second interface is a wired transmission interface or a wireless transmission interface.
[0204] For possible embodiments, the control units 210 communicate with the central processing units 300 in a one-to-one way (as illustrated in
[0205] For possible embodiments, the input operation sensing module 100 can be a touch display device, and an image display procedure and a touch sensing procedure of the touch display device act on at least one same electrode simultaneously or non-simultaneously, or act on different electrodes simultaneously or non-simultaneously. The sensing procedure can include a dynamic sensing mode for a driving unit 200 to determine an operating timing and/or at least one sensing area of the sensing plane for the touch sensing procedure.
[0206] Based on the foregoing schemes, the present invention can therefore utilize the first function library 301 and/or the second function library 213 to provide a variety of functions. In one possible embodiment, the application program 400 is supported by an OS (operating system) in the central processing unit 300, and the first function library 301 and/or the second function library 213 are/is used by the application program 400 to generate different input sensing functions and/or different sensing specs according to instructions of the application program. In another possible embodiment, the application program 400 is supported by a first OS (operating system) in the central processing unit 300, and the control unit 210 has a local application program supported by a second OS (operating system), the first function library 301 is used by the application program 400 to generate different first input sensing functions and/or different first sensing specs, and the second function library 213 is used by the local application program to generate different second input sensing functions and/or different second sensing specs.
[0207] Please refer to
[0208] Please refer to
[0209] Please refer to
[0210] Please refer to
[0211] Please refer to
[0212] Please refer to
[0213] Please refer to
[0214] Please refer to
[0215] Besides, please refer to
[0216] Besides, the intelligent device can be an intelligent input device, an intelligent vehicle control device, or an intelligent IOT (internet of things) device.
[0217] Please refer to
[0218] Please refer to
[0219] Please refer to
[0220] Thanks to the novel designs mentioned above, the present invention possesses the following advantages:
[0221] 1. The driving circuit of the present invention can configure and execute a touch detection procedure according to a CPU's commands.
[0222] 2. The driving circuit of the present invention can receive a touch configuration data from a CPU, wherein the touch configuration data has multiple control bits for determining a connection configuration of at least one multiplexer and a weighting configuration of at least one touch point.
[0223] 3. The driving circuit of the present invention can receive a touch configuration data from a CPU, wherein the touch configuration data has at least one control bit for enabling/disabling at least one touch point.
[0224] 4. The driving circuit of the present invention can receive a touch configuration data from a CPU, and use the touch configuration data to provide a resistor-capacitor delay compensation function.
[0225] 5. The driving circuit of the present invention can receive a touch configuration data from a CPU, and use the touch configuration data to provide a dynamic driving function.
[0226] 6. The driving circuit of the present invention can receive a touch configuration data from a CPU, and use the touch configuration data to provide an adaptive driving function.
[0227] 7. The driving circuit of the present invention can receive a touch configuration data from a CPU, and use the touch configuration data to provide a multi-stage driving function.
[0228] 8. The driving circuit of the present invention can receive a touch configuration data from a CPU, and use the touch configuration data to provide a three-dimensional touch detection function.
[0229] 9. The driving circuit of the present invention can receive a touch configuration data from a CPU, and use the touch configuration data to provide a graphical user interface touch detection function.
[0230] 10. The driving circuit of the present invention can configure a touch resolution profile and a touch sensitivity profile according to a CPU's commands so as to facilitate detecting a pressure profile on a touch operation area and/or a change of the pressure profile over time.
[0231] 11. The driving circuit of the present invention can configure a touch resolution profile and a touch sensitivity profile according to a CPU's commands so as to facilitate detecting a finger print of a user and/or characteristic data thereof.
[0232] 12. The driving circuit of the present invention can configure a touch resolution profile and a touch sensitivity profile according to a CPU's commands so as to facilitate detecting a palm print of a user and/or characteristic data thereof.
[0233] 13. The driving circuit of the present invention can configure a touch resolution profile and a touch sensitivity profile according to a CPU's commands so as to facilitate detecting an ear image of a user and/or characteristic data thereof.
[0234] 14. The software-defined sensing system capable of responding to CPU commands of the present invention can provide a first function library and/or a second function library for an application program to utilize to specify at least one input sensing interface via modularized instructions, and thereby meet the requirement of at least one input sensing mode.
[0235] 15. The software-defined sensing system capable of responding to CPU commands of the present invention can provide at least one sensing spec according to instructions of an application program so as to determine a sensing signal detection mode and a sensed data output format.
[0236] 16. The software-defined sensing system capable of responding to CPU commands of the present invention can provide at least one sensing function according to instructions of an application program, and the at least one sensing function can be a physical parameter sensing function, a chemical parameter sensing function, or a biological parameter sensing function.
[0237] 17. The software-defined sensing system capable of responding to CPU commands of the present invention can be applied to an intelligent input device, an intelligent vehicle control device, or an intelligent IOT device.
[0238] While the invention has been described by way of example and in terms of preferred embodiments, it is to be understood that the invention is not limited thereto. On the contrary, it is intended to cover various modifications and similar arrangements and procedures, and the scope of the appended claims therefore should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements and procedures.
[0239] In summation of the above description, the present invention herein enhances the performance over the conventional structure and further complies with the patent application requirements and is submitted to the Patent and Trademark Office for review and granting of the commensurate patent rights.