Gate-on-array based rolling shutter timing controlling device and controlling method
11663848 · 2023-05-30
Assignee
Inventors
Cpc classification
H04N25/443
ELECTRICITY
International classification
Abstract
The present invention includes a device for controlling rolling shutter timing, the device including: a first Gate-On-Array (GOA) driving unit configured to generate a reset signal for resetting an image sensor in a unit of a gate line; a second GOA driving unit configured to generate a scan signal for scanning the image sensor in the unit of the gate line; and a timing controller configured to control generation timing of the reset signal and the scan signal. According to the device and the method of controlling rolling shutter timing based on GOA, it is possible to satisfy a bezel-less edge level of a display panel of a smart phone, expand a fingerprint recognition area to a large area by rapidly reading a fingerprint location area, freely control an exposure time, and reduce occurrence of a delay time.
Claims
1. A device for controlling rolling shutter timing, the device comprising: a first Gate-On-Array (GOA) driving unit configured to generate a reset signal for resetting an image sensor in a unit of a gate line; a second GOA driving unit configured to generate a scan signal for scanning the image sensor in the unit of the gate line; and a timing controller configured to control generation timing of the reset signal and the scan signal, wherein when an exposure value (exposure time) is larger than one line time, the timing controller controls the scan signal to be generated before the reset signal, and when the exposure value (exposure time) is smaller than one line time, the timing controller controls the reset signal to be generated before the scan signal.
2. The device of claim 1, wherein when frame reset and frame scan of the image sensor are controlled with one scan signal, a logical sum of the reset signal and the scan signal, which are generated in the first GOA driving unit and the second GOA driving unit, respectively, is used as a scan signal.
3. The device of claim 1, wherein the generation of the reset signal and the scan signal is controlled based on a sub window enable signal for resetting or scanning a specific area in an entire area of the image sensor.
4. The device of claim 3, wherein when the reset signal and the scan signal share the same enable signal in a line time, the timing controller generates a control signal for time-dividing the enable signal and providing the time-divided enable signal.
5. The device of claim 1, wherein the timing controller generates frame timing independent to each of frame reset and frame scan, and controls the frame reset and the frame scan to be indefinitely operated with a time difference corresponding to an exposure value.
6. The device of claim 1, wherein the first GOA driving unit and the second GOA driving unit include a plurality of shift registers connected to a plurality of gate lines, respectively, of the image sensor.
7. The device of claim 1, wherein the image sensor includes a plurality of pixels defined by intersections of a plurality of rows of gate lines and a plurality of columns of data lines, and the plurality of pixels includes: a storage capacitor; a photo diode configured to detect light which is reflected from a fingerprint and incident, and changes a potential state of the storage capacitor; and a thin film transistor connected to the storage capacitor and the photo diode, and configured to transmit a detection signal according to the potential state of the storage capacitor.
8. A method of controlling rolling shutter timing, the method comprising: generating, by a first Gate-On-Array (GOA) driving unit, a reset signal for resetting an image sensor in a unit of a gate line; and generating, by a second GOA driving unit, a scan signal for scanning the image sensor in the unit of the gate line, wherein the image sensor is an image sensor based on a thin film transistor, the first GOA driving unit and the second GOA driving unit include a plurality of shift registers connected to a plurality of gate lines, respectively, of the image sensor, and generation timing of the reset signal and generation timing of the scan signal are separately controlled, when an exposure value (exposure time) is larger than a line time, controlling the scan signal to be generated before the reset signal, and when the exposure value (exposure time) is smaller than the line time, controlling the reset signal to be generated before the scan signal.
9. The method of claim 8, wherein when frame reset and frame scan of the image sensor are controlled with one scan signal, a logical sum of the reset signal and the scan signal, which are generated in the first GOA driving unit and the second GOA driving unit, respectively, is used as a scan signal.
10. The method of claim 8, wherein the generation of the reset signal and the scan signal is controlled based on a sub window enable signal for resetting or scanning a specific area in an entire area of the image sensor.
11. The method of claim 10, wherein when the reset signal and the scan signal share the same enable signal in a line time, a control signal for time-dividing the enable signal and providing the time-divided enable signal is generated.
12. The method of claim 8, wherein each of frame reset and frame scan is controlled with independent frame timing, and the frame reset and the frame scan are indefinitely operated with a time difference corresponding to an exposure value.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DETAILED DESCRIPTION
(16) In the detailed description of the present invention described below, reference is made to the accompanying drawings, which illustrate a specific exemplary embodiment in which the present invention may be carried out, as an example. The exemplary embodiment is described in detail sufficient to enable a person skilled in the art to carry out the present invention. It should be understood that various exemplary embodiments of the present invention are different from each other, but need not to be mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be implemented in other exemplary embodiments without departing from the spirit and the scope of the present invention in relation to one exemplary embodiment. Further, it should be understood that a location or disposition of an individual component in each disclosed exemplary embodiment may be changed without departing from the spirit and the scope of the present invention. Accordingly, the detailed description below is not intended to be taken in a limited meaning, and the scope of the present invention, if appropriately described, is limited only by the appended claims along with all scopes equivalent to those claimed by the claims. Like reference numerals in the drawings refer to the same or similar functions over several aspects.
(17)
(18) The method of
(19) The present invention is a device and a method of controlling shutter timing deviating from the foregoing existing method, and may sufficiently implement the rolling shutter method, and the present invention uses a Gate-On-Array (GOA), so that it is possible to achieve a bezel-less characteristic of a smart phone.
(20)
(21)
(22) The plurality of shift registers is configured as a chain and is synchronized to a line time clock, so that the GOA driving unit 210 for the image sensor generates a pulse while sequentially turning on and turning off an output of the shift register according to a line time period and opens a gate of each line of the image sensor.
(23) The display panel 100 is implemented as a touch screen to detect a touch input of a user. In another exemplary embodiment, a touch panel is separately provided to detect a touch input of a user. The touch screen or the touch panel may detect (2D touch) only a touch position, but may also detect a touch pressure (3D touch, force touch).
(24)
(25) The timing controller 300 determines timing of a signal applied to each gate line of the image sensor 200. The GOA driving unit 210 is connected with each gate line of the image sensor 200 and transmits a scan signal and a reset signal.
(26) The image sensor 200 includes a plurality of pixels defined by intersections of the plurality of rows of gate lines and the plurality of columns of data lines. Each pixel includes a storage capacitor, a photo diode, and a thin film transistor. The photo diode detects light reflected from a fingerprint and incident and changes a potential state of the storage capacitor. The thin film transistor is connected to the storage capacitor and the photo diode to transmit a detection signal according to the potential state of the storage capacitor. A DC-DC power converter 400 supplies power for driving the image sensor 200, the GOA driving unit 210, and the timing controller 300.
(27)
(28) As illustrated in
(29) Referring to
(30) A voltage of a node An+1 is also changed as described above by the application of a second clock signal CK2. That is, when the input terminal Out(n) is turned on, the voltage of the node An+1 raises from VOFF to VON−Vt (Vt is a voltage value of the input TFT). Thereafter, when the second clock signal CK2 is applied, the voltage of the node An+1 is raised from VON−Vt to 2×VON by a feedback capacitor and the n+1th line is turned on. Next, when the n+2th line is turned on, the voltage of the node An+1 is reset to VOFF, and the value is applied to the n+1th line.
(31)
(32) In
(33)
(34) In the case of the frame scan, when a specific area in the entire area of the image sensor 200 is desired to be first scanned (read), a start signal corresponding to the corresponding area may be first sent and read. In the case where windowing is not set, one start signal is enough, but in the present invention, the windowing is performed so that a specific area is selectively scanned, so that there are the plurality of start signals.
(35) Similar to the case of the frame reset, when a specific area in the entire area of the image sensor 200 is desired to be first reset, a start signal corresponding to the corresponding area may be first sent and reset.
(36) In the present invention, in order to implement the rolling shutter exposure control method in which exposure may be variably adjusted, the gate controls of two exposure frame and scan frame may rotate independently and continuously with a time difference as much as the exposure, and the shift register, the shift register clock, the register reset signal, and the sub window start signal corresponding to each of the frame reset and the frame scan are provided for the independent operation.
(37)
(38) A size of the sub window may be preset by a user. In the case of the start signal, the number of start signals may be varied according to the size of the sub window. For example, when the total gate lines are 1,878 and the sub window is set in the unit of 100 lines, 18 start signals are demanded. When two sets of 18 signals are provided for the frame reset and the frame scan gate control, it may be a bit of a burden to implement the bezel-less edge.
(39) In order to solve the foregoing problem, the present invention time-divides and generates a line gate signal of the frame scan and a line gate signal of the frame reset so that the line gate signals are not sent in one line time simultaneously. In particular, the line gate signal of the frame reset is generated earlier than the line gate signal of the frame scan. More particularly, the line gate signal of the frame scan may be sent to a middle portion (for example, ½ point of the line time) of the line time, and the line gate signal of the frame reset may be sent to an end portion (for example, after ¾ point of the line time) of the line time.
(40) As illustrated in
(41) In this case, when the reset signal and the scan signal share the same enable signal in the line time, the enable signal may be time-divided and shared. When the reset signal and the scan signal share the same enable signal in the line time, the timing controller 300 may generate a control signal for time-dividing the enable signal and providing the time-divided enable signal.
(42) The timing controller 300 may generate frame timing independent to each of the frame reset and the frame scan, and control the frame reset and the frame scan to be indefinitely operated with a time difference corresponding to the exposure time.
(43)
(44) A passive pixel circuit has a simple structure in which one transistor is provided in a photo diode because a voltage is not converted in a pixel. In the photo diode of the passive pixel circuit, a photocurrent generated by light is accumulated as charge in a capacitance of the photo diode. The transistor of the passive pixel circuit is a switch for selecting a pixel to read a signal, and when a voltage is applied to a row line, the switch is off and the accumulated charge is transmitted to a voltage converter through a column line.
(45) When the passive pixel circuit is adopted, the frame reset is performed through the scan gate signal, so that it is necessary to control the scan gate signal like the frame scan. As described above, there occurs the case where the frame reset and the frame scan controls the same signal, so that the device for controlling rolling shutter timing according to the present invention generates a final line gate output through a logical sum of the frame reset shift register output and the frame scan shift register output, as illustrated in
(46) That is, when the frame reset and the frame scan of the image sensor 200 are controlled with one scan signal, the logical sum of the reset signal and the scan signal generated in the first GOA driving unit and the second GOA driving unit, respectively, is used as the scan signal.
(47)
(48) As described above, in order to use the GOA driving unit, and control the exposure with various values while sharing the sub window start signal in the frame reset and the frame scan and rapidly reading the partial specific area of the entire image sensor 100, the timing control illustrated in
(49) The timing controller 300 independently generates GOA control signals in the unit of the line time of the frame reset and the frame scan with a time difference of the exposure value. The line times of the frame reset and the frame scan are the same, and the frame times formed of the line times are the same. Accordingly, even after several tens or hundreds of frames, the time difference between the frames of the frame reset and the frame scan corresponding to the exposure value is maintained the same.
(50)
(51) As illustrated in
(52)
(53) As illustrated in
(54)
(55) An active pixel circuit uses a method of converting charge into voltage in each pixel. In the active pixel circuit, each of the reset signal and the scan signal is applied, and a transistor for converting the charge accumulated in the capacitance of the photo diode into voltage is added. A transistor for a scan operation of reading a signal and a reset operation of reading the signal and then flushing the signal is further included, and as illustrated in
(56) In particular, in the 3T structure, three transistors are used in one pixel, and are called a reset TR, a source-follower TR, and a row-select TR. First, when a voltage is applied to a gate of the reset TR, an integration node voltage is set to a high voltage and the reset operation is performed. Then, when the reset TR is turned off, electrons among photo-generated carriers generated in the photo diode are drifted toward an integration node having a relatively higher voltage, so that the integration node voltage becomes smaller. In this case, the dropped voltage samples the voltage that is reset again in a next phase, and determines the amount of light incident to the pixel by using a difference between the two voltages. The 3T structure has an advantage that low voltage driving is possible. A Read-Out IC (ROIC) circuit is illustrated at the right side of
(57)
(58) In the case where the exposure value (exposure time) is larger than the one line time of the scan/reset, the case where the exposure value is larger than the frame reset (frame scan) time has the following relational expression.
Exposure value(exposure time)=Frame reset time−Idle time (1)
Idle time=Exposure value(exposure time)−Frame reset time (2)
(59) The M-th line of the (L+1)th frame reset and the N-th line of the L-th frame scan are the same line, so that the relationship of M=N is provided in
(60) In the case where the exposure value (exposure time) is larger than the one line time of the scan/reset, the case where the exposure value is smaller than the frame reset (frame scan) time has the following relational expression.
Exposure value of M-th line of frame reset and N-th line of frame scan=(N−M)×line time (i)
(61) As a result, as illustrated in
(62) For the M-th line time and the N-th line time, the exposure value is typically aligned in the unit of the line time, but the adjustment is required at the level of “one line time+pixel clock” or “several line times+pixel clocks”, the exposure value may be adjusted in a pixel clock unit at the level at which a frame reset line timing signal (RST and the like) and a frame scan line timing signal (SCAN, CDS, and the like) do not overlap at the same time.
(63)
(64) In the meantime, the method of controlling rolling shutter timing according to the present invention includes generating, by a first GOA driving unit, a reset signal for resetting an image sensor in the unit of a gate line, and generating, by a second GOA driving unit, a scan signal for scanning the image sensor in the unit of a gate line. The image sensor 200 may be an image sensor based on a thin-film transistor as described above. The first GOA driving unit and the second GOA driving unit includes the plurality of shift registers connected to the plurality of gate lines, respectively, of the image sensor. Generation timing of the reset signal and generation timing of the scan signal may be independently controlled by the timing controller 300.
(65) In the meantime, when the frame reset and the frame scan of the image sensor are controlled with one scan signal, the logical sum of the reset signal and the scan signal generated in the first GOA driving unit and the second GOA driving unit, respectively, is used as the scan signal.
(66) In particular, the generation of the reset signal and the scan signal is controlled based on a sub window enable signal for resetting or scanning a specific area in the entire area of the image sensor 200, and in this case, when the reset signal and the scan signal share the same enable signal in the line time, a control signal for time-dividing the enable signal and providing the time-divided enable signal may be generated.
(67) Each of the frame reset and the frame scan is controlled with the independent frame timing, and the frame reset and the frame scan are indefinitely operated with a time difference corresponding to the exposure time, thereby implementing rolling shutter driving.
(68) The method of controlling rolling shutter timing according to the present invention may further include controlling the scan signal to be generated before the reset signal when the exposure time exceeds the line time, and controlling the reset signal to be generated before the scan signal when the exposure time is equal to or smaller than the line time.
(69) The image sensor 200 may be implemented with a passive pixel circuit or an active pixel circuit. The image sensor 200 includes a plurality of pixels defined by intersections of the plurality of rows of gate lines and the plurality of columns of data lines. The plurality of pixels includes a storage capacitor, a photo diode which detects light reflected from a fingerprint and is incident and changes a potential state of the storage capacitor, and a thin film transistor. The thin film transistor is connected to the storage capacitor and the photo diode and transmits a detection signal according to the potential state of the storage capacitor.
(70) According to the device and the method of controlling rolling shutter timing based on GOA according to the present invention, it is possible to satisfy a bezel-less edge level of a display panel of a smart phone, expand a fingerprint recognition area to a large area by rapidly reading a fingerprint location area, freely control an exposure time, and reduce occurrence of a delay time.
(71) According to the generalization of the TFT image sensor, the rolling shutter control method which may adjust the TFT image sensor with various exposure values may be usefully applied to various cases, and particularly, for fingerprint recognition solutions in large-area full screen smart device (for example, a smart phone), a bezel-less TFT image sensor is essentially required, and the device and the method of controlling rolling shutter timing based on GOA according to the present invention may be a solution suitable to the technical demand.
(72) When the rolling shutter control method of the present invention, which introduces the GOA concept, is applied not only to the TFT image sensor, but also to the CIS image sensor that is currently generalized, it is possible to promote the effect of dramatically reducing a size of a gate control circuit block, compared to the case using a parallel decoding circuit.
(73) The method of controlling rolling shutter timing based on GOA according to various exemplary embodiments may be implemented in a program command executable through various computer means and recorded in a computer readable medium. The computer readable recording medium may include one or a combination of a program command, a data file, and a data structure. The program command recorded in the medium may be specially designed and configured for the present invention, or may also be known and usable to those skilled in computer software. Examples of the computer readable recording medium include a magnetic medium, such as a hard disk, a floppy disk, or a magnetic tape, an optical recording medium, such as a CD-ROM or a DVD, a magneto-optical medium, such as a floptical disk, and a hardware device which is specifically configured to store and execute the program command such as a ROM, a RAM, and a flash memory. An example of the program command includes a high-level language code executable by a computer by using an interpreter, and the like, as well as a machine language code created by a compiler. The hardware device may be configured to be operated with one or more software modules in order to perform the operation of the present invention, and an opposite situation thereof is available. The method of controlling rolling shutter timing based on GOA according to various exemplary embodiments may also be implemented in the form of a computer program or an application which is stored in a recording medium and executed by a computer.
(74) In addition, although the exemplary embodiments have been described above, these are only examples, and do not limit the present invention, and those skilled in the art will know that various modifications and applications which are not exemplified above are possible within the scope without departing from the essential characteristics of the present exemplary embodiment. For example, each component specifically presented in the exemplary embodiment may be modified and implemented. Further, it should be interpreted that the differences in relation to the modification and the application are included in the scope of the present invention defined in the accompanying claims.