SYSTEM AND METHOD FOR QUALITY INSPECTION ON OVERALL INKJET PRINTING MANUFACTURING PROCESS FOR DISPLAY DEVICE

Abstract

The disclosure discloses a system for quality inspection in the entire process of inkjet printing manufacturing of display devices, which includes a substrate inspection module, a nozzle inspection module, an ink droplet inspection module, a coating thickness inspection module and a control module. Through design and matching of these modules, it is possible to realize a series of operations such as substrate inspection, nozzle inspection, flying ink droplet inspection, liquid coating inspection and cured coating inspection. The invention also discloses a corresponding quality inspection method for the entire inkjet printing manufacturing process for display devices. The invention effectively compensates for the shortcomings of current technology which only inspect a single stage without taking the whole process into consideration, thereby realizing high-precision quality inspection of each stage in the inkjet printing manufacturing process of display devices, and significantly improving the quality and yield of the display device product.

Claims

1. A system for quality inspection on an entire inkjet printing manufacturing process for display devices, wherein the system comprises a substrate inspection module, a nozzle inspection module, an ink droplet inspection module, a coating thickness inspection module and a control module, wherein the substrate inspection module comprises a large-field downward-view unit, a high-magnification downward-view unit and a high-resolution vision unit, wherein the large-field downward-view unit and the high-magnification downward-view unit are all arranged on a first moving part with Y.sub.2 and Z.sub.2 degrees of freedom, that is, a second horizontal longitudinal degree of freedom, and a second vertical degree of freedom, and are respectively configured for performing coarse positioning inspection and fine positioning inspection on a substrate before inkjet printing; the high-resolution vision unit is arranged on a second moving part with Y.sub.1 and Z.sub.1 degrees of freedom, that is, a first horizontal longitudinal degree of freedom, and a first vertical degree of freedom, and is configured for performing visual quality inspection on the substrate before inkjet printing, a liquid coating or a cured coating sprayed onto the substrate; the nozzle inspection module comprises a large-field upward-view unit and a high-magnification upward-view unit, wherein the large-field upward-view unit and the high-magnification upward-view unit are all arranged on a third moving part with X.sub.1 degree of freedom, that is, a first horizontal degree of freedom, and are respectively configured for performing positioning inspection and visual quality inspection on a print head used for performing inkjet printing; the ink droplet inspection module comprises two sets of horizontal vision units arranged at an angle α, the two sets of horizontal vision units work synchronously to form a binocular vision system, which is arranged on a fourth moving part with X.sub.2 degree of freedom, that is, a second horizontal degree of freedom, and is configured for performing real-time visual inspection on volume, velocity, angle and shape of a flying ink droplet sprayed by the print head; the coating thickness inspection module comprises a set of white light interference vision unit, which is arranged in the same way as the high-resolution vision unit on the second moving part with Y.sub.1 and Z.sub.1 degrees of freedom, that is, the first horizontal longitudinal degree of freedom and the first vertical degree of freedom, and is configured for performing real-time visual inspection on coating thickness, volume and uniformity of the ink sprayed onto the substrate before and after curing; the control module comprises a real-time processing controller, a movement controller, a synchronous trigger control card, and an inkjet control card, wherein the movement controller is connected to the substrate inspection module, the nozzle inspection module, the ink droplet inspection module and the coating thickness inspection module respectively, control movements of these modules and obtaining position feedback information; the inkjet control card is configured to control the on/off of the nozzle and set a driving waveform, thereby controlling the nozzle to spray and output a triggering signal to the synchronous trigger control card; the synchronous trigger control card receives the triggering signal and delays triggering an operation of the ink droplet inspection module, thereby performing a real-time inspection on the volume, the velocity, the angle and the shape of the flying ink droplet; the real-time processing controller is connected to the substrate inspection module, the nozzle inspection module, the ink droplet inspection module and the coating thickness inspection module respectively, thereby controlling the above modules to work and obtain corresponding image data for processing, so as to obtain multiple inspection results comprising substrate defects, nozzle defects, liquid coating defects, and cured coating defects; the real-time processing controller is also connected to the movement controller, the synchronous trigger control card and the inkjet control card respectively, forming a closed-loop control on the entire inkjet printing manufacturing process of the display device.

2. The system according to claim 1, wherein for the substrate inspection module, the large-field downward-view unit and the high-magnification downward-view unit are both provided with a camera, a lens and a coaxial point light source, and the large-field downward-view unit is arranged on a print head module of an inkjet printing device; for the nozzle inspection module, the large-field upward-view unit and the high-magnification upward-view unit are both provided with a camera, a lens and a coaxial point light source, and the nozzle inspection module is arranged at a substrate absorbing platform; for the ink droplet inspection module, the two sets of horizontal vision units are each configured with a coaxially arranged camera, lens, a collimator lens and a light source, and four reflectors can be added as required, together they form a reflector set with a periscope optical path; for the coating thickness inspection module, the white light interference vision unit is provided with a camera, lens, a coaxial point light source and an interference object lens, a grating ruler with sub-micron resolution is added as a position feedback device to the Z.sub.1 degree of freedom, that is, the first vertical degree of freedom.

3. A method for quality inspection on an entire inkjet printing manufacturing process for display devices according to claim 1, wherein the method comprises the following steps: (a) use the substrate inspection module to perform the positioning inspection and the visual quality inspection on the substrate before inkjet printing, and record and establish a substrate defect feature database and a substrate defect distribution map; (b) use the nozzle inspection module to perform the positioning inspection and the visual quality inspection on the print head that perform inkjet printing, and record and establish a nozzle defect feature database; (c) use the ink droplet inspection module to perform the real-time visual inspection on the volume, the velocity, the angle and the shape of the flying ink droplet that is sprayed by the print head, and record and establish an ink droplet parameter feature database; (d) use the substrate inspection module and the coating thickness inspection module to perform the visual inspection on the quality of the liquid coating and the thickness of the liquid coating sprayed onto the substrate, and record and establish a liquid coating defect feature database and a liquid coating defect distribution map; (e) use the substrate inspection module and the coating thickness inspection module again to perform the visual inspection on the quality of the cured coating and the thickness of the cured coating that are sprayed onto the substrate and completely cured, and record and establish a cured coating defect feature database and a cured coating defect distribution map; (f) set defect determining criteria for the substrate, the nozzle, the ink droplets, the liquid coating, and the cured coating in advance, and form an inspection closed-loop between the nozzle and the ink droplet as well as an inspection closed-loop between the substrate, the nozzle, the ink droplet, the liquid coating and the cured coating according to the multiple defect feature databases and the parameter feature databases respectively formed in the above steps; then, deduce and determine a specific source of defect based on the cured coating defect and perform a corresponding optimal modulation, in this way, a quality closed-loop feedback control of the entire inkjet printing manufacturing process is realized.

4. The method according to claim 3, wherein for the above step (a), the step further comprises the following operation steps: (a1) activate the substrate inspection module, use the large-field downward-view unit first to find at least 2 positioning marks on the substrate, and then switch the large-field downward-view unit to the high-magnification downward-view unit for performing position inspection on the positioning marks, thereby calculating an installation position and a tilt angle of the substrate; (a2) the substrate moves sequentially to the preset marked position along a direction X.sub.1, that is, the first horizontal lateral direction, in the meantime, the high-resolution vision unit collects images of the substrate, after the movement in the direction X.sub.1 is completed, the high-resolution vision unit moves for a predetermined distance along a direction Y.sub.1, that is, the first horizontal longitudinal direction, and then the substrate moves reversely in the direction X.sub.1, in this way, the substrate and the high-resolution vision unit move alternately until the image of the entire substrate is collected, in the process, it is ensured that there is a certain overlap area in the adjacent images obtained from each collecting; (a3) obtain the complete substrate image by stitching adjacent images, and image processing is performed on the image to establish the substrate defect feature database and the substrate defect distribution map, then a substrate defect determining index C.sub.b is calculated according to the following formula (1), wherein when C.sub.b is greater than a preset threshold C.sub.b0, it is determined that the substrate is a defective substrate; $\begin{matrix} C_{b} = {.Math.}_{i = 1}^{N} b_{i} ({.Math.}_{j = 1}^{N_{i}} (\frac{D_{j}}{T_{i}} - 1)) & formula (1) \end{matrix}$ in the formula (1), N represents the number of defect categories of the substrate; T.sub.i, N.sub.i, b.sub.i respectively represent a threshold for determining the defect, the number of defects and a weighting coefficient in the i-th category; D.sub.j represents the measured defect feature parameter and D.sub.j>T.sub.i; i and j respectively represent integers of 1˜N and 1˜N.sub.i.

5. The method according to claim 3, wherein for the above step (b), the step further comprises the following operation steps: (b1) activate the nozzle inspection module, use the large-field upward-view unit first to find at least 2 positioning marks of the print head, then, switch the large-field upward-view unit to the high-magnification upward-view unit for performing position inspection on the positioning marks, thereby calculating an initial position of the nozzle; (b2) the high-magnification upward-view unit collects an image of each nozzle area and obtains nozzle contour information comprising contour points, then measure a nozzle size and calculate a nozzle defect index C.sub.n according to the following formula (2), wherein when C.sub.n is greater than a preset threshold C.sub.n0, it is determined that the nozzle is defective: $\begin{matrix} C_{n} = γ_{1} \frac{1}{N} {.Math.}_{i = 1}^{N} .Math. \sqrt{{(x_{i} - x_{0})}^{2} + {(y_{i} - y_{0})}^{2}} - r .Math. + γ_{2} (\max (\sqrt{{(x_{i} - x_{0})}^{2} + {(y_{i} - y_{0})}^{2}}) - \min (\sqrt{{(x_{i} - x_{0})}^{2} + {(y_{i} - y_{0})}^{2}})) & formula (2) \end{matrix}$ in the formula (2), N represents the number of the contour points, x.sub.i and y.sub.i respectively represent position coordinates of the contour point numbered i, and the value of i is an integer from 1 to N; γ1 and γ2 are preset weighting coefficients respectively; x.sub.0 and y.sub.0 respectively represent position coordinates of a center point of the nozzle; x and y respectively represent position coordinates of any one of the multiple contour points; r represents a radius of a circle corresponding to the nozzle.

6. The method according to claim 3, wherein for the above step (c), the step comprises the following operation steps: (c1) activate the ink droplet inspection module, and synchronously trigger the two sets of horizontal vision units to collect images of the flying ink droplets at multiple timings in a strobe mode, until the inspection on the flying ink droplets from all of the nozzles is completed; (c2) perform stereo calibration and image processing on the image of the flying ink droplets, then classify the shapes of the ink droplets, and simultaneously measure a series of ink droplet parameters such as volume, velocity, and angle, calculate an ink droplet defect index C.sub.d according to the following formula (3), wherein when C.sub.d is greater than a preset threshold C.sub.d0, it is determined that the ink droplet is a defective ink droplet: $\begin{matrix} C_{d} = d_{1} .Math. \frac{V}{V_{0}} - 1 .Math. + d_{2} .Math. \frac{v}{v_{0}} - 1 .Math. + d_{3} .Math. \frac{φ}{φ_{0}} - 1 .Math. + d_{4} .Math. \frac{θ}{θ_{0}} - 1 .Math. & formula (3) \end{matrix}$ in the formula (3), V.sub.0, v.sub.0, φ.sub.0, and θ.sub.0 respectively represent a preset ink droplet volume threshold, a velocity threshold, and two angle thresholds; d.sub.1, d.sub.2, d.sub.3, and d.sub.4 respectively represent the preset weighting coefficients; V represents the actually measured volume of the flying ink droplet, v represents the actually measured velocity of the flying ink droplet; φ and θ represent the actually measured azimuth and pitch angle of the flying ink droplet.

7. The method according to claim 6, wherein in sub-step (c2), the actual volume V of the flying ink droplet is measured through the following process: for the images of the flying ink droplets respectively obtained by the two sets of horizontal vision units, align the two contours in height, and use a 3rd order Hermite curve interpolation to construct a closed curve represented by the following formula (4) according to the four contour points in the same height plane; then an enclosed area S of the constructed closed curve is calculated, and the actual volume V of the flying ink droplet is calculated according to the following formulas (5) and (6) through a volume integration method: $\begin{matrix} H (x) = y_{1} (1 + 2 \frac{x - x_{1}}{x_{2} - x_{1}}) {(\frac{x - x_{2}}{x_{1} - x_{2}})}^{2} + y_{2} (1 + 2 \frac{x - x_{2}}{x_{1} - x_{2}}) {(\frac{x - x_{1}}{x_{2} - x_{1}})}^{2} + y_{1}^{'} (x - x_{1}) {(\frac{x - x_{2}}{x_{1} - x_{2}})}^{2} + y_{2}^{'} (x - x_{2}) {(\frac{x - x_{1}}{x_{2} - x_{1}})}^{2} & formula (4) \\ S = - k_{1} \int_{x_{1}}^{x_{2}} H_{1} (x) dx - k_{2} \int_{x_{2}}^{x_{3}} H_{2} (x) dx + k_{3} \int_{x_{3}}^{x_{4}} H_{3} (x) dx + k_{4} \int_{x_{4}}^{x_{1}} H_{4} (x) dx & formula (5) \\ V = Δ h .Math. S_{i} & formula (6) \end{matrix}$ in the formulas, H(x) represents a structure curve between the two contour points, and four segments of curves H.sub.1, H.sub.2, H.sub.3, and H.sub.4 are constructed between the four contour points in the same height plane; (x.sub.1, y.sub.1) and (x.sub.2, y.sub.2) respectively represent coordinate values of the two adjacent contour points that construct the Hermite curve; y.sub.1′ and y.sub.2′ respectively represent derivatives at the point (x.sub.1, y.sub.1) and (x.sub.2, y.sub.2); k.sub.1, k.sub.2, k.sub.3, k.sub.4 respectively represent correction coefficients for correcting an error of the ink droplet contour approximately represented by the Hermite curve; Δh represents a height between the adjacent height planes; S.sub.i represents the area enclosed by the closed curve in the i-th height plane.

8. The method according to claim 3, wherein for the above step (d), the step comprises the following operation steps: (d1) sequentially move the substrate after inkjet printing to the preset marked position according to the position feedback along the direction X.sub.1, that is, the first horizontal lateral direction, in the meantime, the high-resolution vision unit collects the image of the current substrate, after the movement in the direction X.sub.1 is completed, the high-resolution vision unit moves for a preset distance along the direction Y.sub.1, that is, the first horizontal longitudinal direction, and then the substrate moves reversely in the direction X.sub.1, in this manner, the high-resolution vision unit and the substrate move alternately until the image of the liquid coating is completely collected, in this process, it should be ensured that there is a certain overlap area in the adjacent images obtained from each image collection; (d2) obtain the complete liquid coating substrate image by stitching adjacent images, perform background subtraction and image processing on the obtained image, and establish a liquid coating defect feature database and a liquid coating defect distribution map; (d3) activate the coating thickness inspection module to perform scanning along the direction Z.sub.1, that is, the first vertical direction, so as collect a series of interference fringe images at each height position and record the corresponding vertical position value, calculate the liquid coating thickness distribution and the liquid coating volume according to a white light interference principle; (d4) calculate a local uniformity index U.sub.local of the liquid coating and a global uniformity index U.sub.global of the liquid coating according to the following formulas (7) and (8), and the inkjet printing quality is assessed based on these two indexes: $\begin{matrix} U_{local} = \frac{S_{h}}{S_{local}} & formula (7) \\ U_{global} = \frac{1}{K} {.Math.}_{k = 1}^{K} U_{k}, U_{k} = {\begin{matrix} 0, \frac{.Math. h_{c, k} - \overline{h} .Math.}{\overline{h}} > λ_{2} \\ U_{k}, \frac{.Math. h_{c, k} - \overline{h} .Math.}{\overline{h}} \leq λ_{2} \end{matrix} & formula (8) \end{matrix}$ in the above formulas, S.sub.local represents an area of a defined region of interest of the liquid coating substrate inspection image; S.sub.h represents an area of the region of which a thickness h satisfies $\frac{.Math. h - h_{c} .Math.}{h_{c}} \leq λ_{1}$ and which begins to be searched from a center of the region of interest, wherein h.sub.c represents a center thickness of the region of interest; λ.sub.1 represents a preset local uniformity coefficient of the liquid coating, λ.sub.2 represents a preset global uniformity coefficient of the liquid coating; K represents the number of regions of interest determined by sampling when calculating the global uniformity; h.sub.c,k and U.sub.k respectively represent the central thickness and local uniformity of the k-th region of interest, wherein the value of k is an integer from 1 to K; h represents an average value of the center thickness of the liquid coating of the K regions of interest.

9. The method according to claim 3, wherein for the above step (e), the step comprises the following operation steps: (e1) sequentially move the substrate after inkjet printing and curing to the preset marked position according to the position feedback along the direction X.sub.1, that is, the first horizontal lateral direction, in the meantime, the high-resolution vision unit collects the image of the current substrate, after the movement in the direction X.sub.1 is completed, the high-resolution vision unit moves for the preset distance along the direction Y.sub.1, that is, the first horizontal longitudinal direction, and then the substrate moves reversely in the direction X.sub.1, in this manner, the high-resolution vision unit and the substrate move alternately until the image of the cured coating is completely collected, in this process, it should be ensured that there is a certain overlap area in the adjacent images obtained from each image collection; (e2) obtain the complete cured coating substrate image by stitching adjacent images, perform background subtraction on the obtained image, and establish a cured coating defect feature database and a cured coating defect distribution map; (e3) activate the coating thickness inspection module to perform scanning along the direction Z.sub.1, that is, the first vertical direction, so as collect the series of interference fringe images at each height position and record the corresponding vertical position value, calculate the cured coating thickness distribution and the cured coating volume according to the white light interference principle; (e4) calculate the local uniformity index U.sub.local of the cured coating and the global uniformity index U.sub.global of the cured coating according to the following formulas (9) and (10), and the quality after inkjet printing curing is assessed based on these two indexes: $\begin{matrix} U_{local} = \frac{S_{h}}{S_{local}} & formula (9) \\ U_{global} = \frac{1}{K} {.Math.}_{k = 1}^{K} U_{k}, U_{k} = {\begin{matrix} 0, \frac{.Math. h_{c, k} - \overline{h} .Math.}{\overline{h}} > μ_{2} \\ U_{k}, \frac{.Math. h_{c, k} - \overline{h} .Math.}{\overline{h}} \leq μ_{2} \end{matrix} & formula (10) \end{matrix}$ in the above formulas, S.sub.local represents the area of the defined region of interest of the cured coating substrate inspection image; S.sub.h represents the area of the region of which the thickness h satisfies $\frac{.Math. h - h_{c} .Math.}{h_{c}} \leq μ_{1}$ and which begins to be searched from the center of the region of interest, wherein h.sub.c represents the center thickness of the region of interest; μ.sub.1 represents the preset local uniformity coefficient of the cured coating, μ.sub.2 represents the preset global uniformity coefficient of the cured coating; K represents the number of regions of interest determined by sampling when calculating the global uniformity; h.sub.c,k and U.sub.k respectively represent the central thickness and the local uniformity of the k-th region of interest, wherein the value of k is an integer from 1 to K; h represents the average value of the center thickness of the cured coating of the K regions of interest.

10. The method according to claim 3, wherein for the above step (f), the step of forming the inspection closed-loop between the nozzle and the ink droplet comprises the following operation steps: compare the nozzle defect feature database and the ink droplet parameter feature database, determine an impact of the nozzle defect on the ink droplet defect, and shut down the nozzle that cannot be used normally due to the nozzle defect; wherein the criteria for determining the impact of the nozzle defect on the ink droplet defect are set as follows: if the nozzle and its sprayed ink droplets are not defective, it is determined that the nozzle can be used normally; if the nozzle is defective but its sprayed ink droplets are not defective, it is determined that the nozzle defect does not cause ink droplet defects, and the nozzle can be used normally; if the ink droplets sprayed by the nozzle are defective, the driving waveform is modulated and the ink droplet inspection is performed again; under the circumstances, if the droplets are not defective, it is determined that the nozzle itself does not cause ink droplet defects and can be used normally, otherwise it is determined the nozzle defect is unacceptable and the defective nozzle is shut down; the step of forming the closed-loop for inspection between the substrate, the nozzle, the ink droplets, the liquid coating and the cured coating comprises the following operation steps: for the collected substrate defect feature database, the nozzle defect feature database, the ink droplet parameter feature database, the liquid coating defect feature database and the cured coating defect feature database, these feature databases are compared to determine the source of the defects, and then the criteria for determining the substrate defects, the nozzle defects, the ink droplet defects, and the liquid coating defects are adjusted accordingly; wherein the operation of determining the source of the defect and adjusting the determining criteria accordingly is as follows: the liquid coating defect feature database and the cured coating defect feature database are compared, if there is no liquid coating defect at the cured coating defect, then it is determined that the defect originates from the curing process or the criteria for determining the liquid coating defects need to be set to a lower level; if there is a liquid coating defect, the inkjet printing process is further analyzed, and the nozzles that are involved in printing the pixel having the cured coating defect are searched; the substrate defect feature database and the liquid coating defect feature database are compared, if there is a substrate defect at the liquid coating defect, the impact of the substrate defect on the liquid coating defect is further investigated, if the substrate defect will cause the liquid coating defect, the threshold C.sub.b0 for determining the substrate defect is set to be lower; if there is no substrate defect, it is determined that the defect originates from the spraying process or the criteria for determining the substrate defect needs to be set to a lower level, and the spraying process is further analyzed; the ink droplet parameter feature database is checked, if the ink droplets sprayed by the nozzle involved in printing the defective pixels are not defective, the threshold C.sub.d0 for determining the ink droplet defects needs to be set to a lower level, otherwise the nozzle and ink droplet inspection closed-loop method are adopted to determine whether the defects originate from the nozzle, if the defect originates from a nozzle but the nozzle is not defective in the nozzle defect feature database, the threshold C.sub.n0 for determining the nozzle defect is set to a lower level; the step of forming the quality closed-loop feedback control of the entire ink printing manufacturing process adopts the following method: the driving waveform is set to control the nozzle to spray, the criteria for determining the defects of the substrate, the nozzle, the ink droplets, the liquid coating, and cured coating are set and corresponding quality inspection is performed, the source of defects is deduced according to the nozzle, the ink droplet inspection closed-loop as well as the substrate, the nozzle, the ink droplet, the liquid coating and the cured coating inspection closed-loop, and the defect determining criteria in the corresponding stage are adjusted to reduce a missed inspection rate and a false inspection rate of the defects, if the cured coating defect is caused by the nozzle defect, the defective nozzle is shut down; if the cured coating defect is caused by the driving waveform, the driving form is adjusted.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0072] FIG. 1 is a schematic view of a framework of an overall system for quality inspection of the entire inkjet printing manufacturing process for display devices constructed by the disclosure.

[0073] FIG. 2 is a flowchart of an overall method for quality inspection of the entire inkjet printing manufacturing process for display devices constructed by the disclosure.

[0074] FIG. 3A is a schematic flowchart of collecting an image of a large-area substrate in a preferred embodiment of the disclosure.

[0075] FIG. 3B is a schematic flowchart of a method for inspecting a substrate in a preferred embodiment of the disclosure.

[0076] FIG. 4A is a schematic flowchart of a nozzle inspection method in a preferred embodiment of the disclosure.

[0077] FIG. 4B is a schematic view of the inspection principle of edge circle of the nozzle in a preferred embodiment of the disclosure.

[0078] FIG. 5A is a schematic view of the stereo calibration method in ink droplet inspection in a preferred embodiment of the disclosure.

[0079] FIG. 5B is a flowchart of an ink droplet image processing method in a preferred embodiment of the disclosure.

[0080] FIG. 5C is a flowchart of an inspection method for ink droplet shape and three-dimensional parameters in a preferred embodiment of the disclosure.

[0081] FIG. 5D is a schematic view of the principle of three-dimensional reconstruction of ink droplet volume in a preferred embodiment of the disclosure.

[0082] FIG. 6A is a schematic flowchart of a liquid coating inspection method in a preferred embodiment of the disclosure.

[0083] FIG. 6B is a schematic flowchart of a coating thickness inspection method based on white light interference in a preferred embodiment of the disclosure.

[0084] FIG. 7 is a schematic flowchart of a cured coating inspection method in a preferred embodiment of the disclosure.

[0085] FIG. 8 is a schematic view of a closed-loop for inspection on nozzle and ink droplet in a preferred embodiment of the disclosure.

[0086] FIG. 9 is a schematic view of a closed-loop for inspection on substrates, nozzles, ink droplets, liquid coating, and cured coating in a preferred embodiment of the disclosure.

[0087] FIG. 10 is a schematic view of the quality closed-loop feedback control of the entire inkjet printing manufacturing process in a preferred embodiment of the disclosure.

[0088] In all the drawings, the same reference numerals are used to denote the same elements or structures.

DETAILED DESCRIPTION OF DISCLOSED EMBODIMENTS

[0089] In order to make the objectives, technical solutions and advantages of the present disclosure clearer, the following further describes the present disclosure in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present disclosure, but not to limit the present disclosure.

[0090] FIG. 1 is a schematic view of a framework of an overall system for quality inspection of the entire inkjet printing manufacturing process for display devices constructed by the disclosure. As shown in FIG. 1, the system provided in the disclosure mainly includes a substrate inspection module, a nozzle inspection module, an ink droplet inspection module, a coating thickness inspection module, and a control module. The specific framework of these key modules and their operating methods are described in details below.

[0091] First of all, the substrate inspection module includes a large-field downward-view unit 12, a high-magnification downward-view unit 13, and a high-resolution vision unit 11, etc. Among the above units, the large-field downward-view unit 12 and the high-magnification downward-view unit 13 are both arranged on a first moving part with Y.sub.2 and Z.sub.2 degrees of freedom, that is, the second horizontal longitudinal degree of freedom and the second vertical degree of freedom, and are respectively configured for perform coarse positioning inspection and fine positioning inspection on the substrate before inkjet printing. The high-resolution vision unit 11 is arranged on a second moving part with Y.sub.1 and Z.sub.1 degrees of freedom, that is, the first horizontal longitudinal degree of freedom and the first vertical degree of freedom, and configured to perform visual quality inspection on the substrate before inkjet printing as well as the liquid coating or cured coating sprayed onto the substrate.

[0092] More specifically, as exemplarily shown in FIG. 1, the large-field downward-view unit 12 may include, for example, a camera, a lens, and a coaxial point light source. In a preferred embodiment of the disclosure, the lens may preferably adopt a 0.8× magnification MML lens according to specific requirements, which has a large field of view and is configured for performing coarse positioning inspection on the substrate. The high-magnification downward-view unit 13 may include, for example, a camera, a lens, and a coaxial point light source. In a preferred embodiment of the disclosure, the lens may adopt a 4× magnification MML lens according to specific requirements, which has high measurement accuracy, and is configured to perform fine positioning inspection on the substrate, and may be configured to perform defect inspection on partial regions of the substrate. The large-field downward-view unit 12 and the high-magnification downward-view unit 13 are both arranged on a first moving part with Y.sub.2 and Z.sub.2 degrees of freedom, and preferably can be arranged on a print headmodule of an inkjet printing device. The high-resolution vision unit 11 may include, for example, a high-resolution camera, a lens, and a coaxial light source. In a preferred embodiment of the disclosure, the camera may adopt a 29 million-pixel high-resolution SVS industrial camera according to requirements, which has a large field of view and thus improving inspection efficiency, is configured for performing quick quality inspection on substrates, liquid coating, and cured coating. Preferably, multiple sets of high-resolution vision systems 11 can be provided to improve inspection efficiency, and can be arranged on the moving component with Y.sub.1 and Z.sub.1 degrees of freedom.

[0093] The nozzle inspection module includes a large-field upward-view unit 21 and a high-magnification upward-view unit 22, wherein the large-field upward-view unit 21 and the high-magnification upward-view unit 22 are both arranged on the third moving part with X.sub.1 degree of freedom, that is, the first horizontal lateral degree of freedom, and they are respectively configured to perform positioning inspection and visual quality inspection on the print head.

[0094] More specifically, as exemplarily shown in FIG. 1, the large-field upward-view unit 21 may include, for example, a camera, a lens, and a coaxial point light source. In a preferred embodiment of the disclosure, the lens may preferably adopt a 0.8× magnification MML lens according to requirements, which has a large field of view and is configured to perform a coarse positioning inspection on the print head. The high-magnification upward-view unit 22 may include, for example, a camera, a lens, and a coaxial point light source. In a preferred embodiment of the disclosure, the lens may preferably adopt a 4× magnification MML lens according to requirements, which has high measurement accuracy and is configured to perform quality inspection on the nozzle. The large-field upward-view unit 21 and the high-magnification upward-view unit 22 are both arranged on a third moving part with X.sub.1 degree of freedom, and more preferably can be arranged at the substrate absorbing platform.

[0095] The ink droplet inspection module includes two sets of horizontal vision units arranged at an included angle α. The two sets of horizontal vision units work synchronously to form a binocular vision system, which is arranged on a fourth moving part with X.sub.2 degree of freedom, that is, the second horizontal lateral degrees of freedom, and is configured to perform a real-time visual inspection on the volume, velocity, angle and shape of the flying ink droplets sprayed by the print head.

[0096] More specifically, as exemplarily shown in FIG. 1, the first camera 45-1, the first lens 44-1, the first reflector set 43-1, the first collimating lens 42-1, and the first light source 41-1 are arranged coaxially along the center line. The second camera 45-2, the second lens 44-2, the second reflector set 43-2, the second collimating lens 42-2, and the second light source 41-2 are arranged coaxially along the center line. In a preferred embodiment of the disclosure, the lens may preferably adopt a 14× magnification Navitar lens according to requirements, which has high measurement accuracy. The first camera 45-1, the second camera 45-2, the first light source 41-1, and the second light source 41-2 work synchronously to form a binocular vision system. Since the observation area is required to be close to the lower surface of the print head when performing ink droplet observation, in a preferred embodiment of the disclosure, the first reflector set 43-1 and the second reflector set 43-2 each may include four reflectors to form a periscope optical path, so as to avoid interference between the first lens 44-1, the second lens 44-2 and the print head module. In other embodiments, if there is no mechanical interference, the first reflector set 43-1 and the second reflector set 43-2 can be optionally removed. The first light source 41-1 and the second light source 41-2 are high-power stroboscopic light sources, preferably a pulsed laser light source or a high-power stroboscopic LED. The first collimating lens 42-1 and the second collimating lens 42-2 collimate the optical path, and adjust the optical path with a certain divergence angle to be close to parallel light to ensure imaging brightness. The ink droplet inspection module has X.sub.2 degree of freedom and is configured to inspect the volume, velocity, angle, and shape of the flying ink droplets.

[0097] The coating thickness inspection module includes a set of white light interference vision unit, which is arranged in the same manner as the high-resolution vision unit 11 on the second moving part with Y.sub.1 and Z.sub.1 degrees of freedom, that is, the first horizontal longitudinal degree of freedom and the first vertical degree of freedom, and is configured to perform real-time visual inspection on the coating thickness, volume and uniformity of the ink sprayed onto the substrate before and after curing.

[0098] More specifically, as exemplarily shown in FIG. 1, the white light interference vision unit may include, for example, a camera 54, a lens 53, a coaxial point light source 52, and an interference object lens 51. In a preferred embodiment of the disclosure, a lens with 20× magnification and an integrated interference object lens may be adopted according to requirements, preferably a Mirau interference object lens may be adopted, which contains a reference mirror and a beam splitter. The coating thickness inspection module is configured to inspection the thickness, volume and uniformity of the ink coating before and after curing. The coating thickness inspection module has Y.sub.1 and Z.sub.1 degrees of freedom, and can preferably be set up with the high-resolution vision system 11 of the substrate inspection module. Z.sub.1 is a degree of freedom of high-precision movement of the position feedback device with high resolution, and preferably a grating ruler with sub-micron resolution may be adopted as the position feedback device.

[0099] In addition, the control module includes a real-time processing controller 32, a movement controller 31, a synchronous trigger control card 33, and an inkjet control card 34. The movement controller 31 is connected to the substrate inspection module, the nozzle inspection module, the ink droplet inspection module and the coating thickness inspection module respectively, controlling the movement of the modules and obtaining position feedback information. The inkjet control card 34 is configured to control the on/off of the nozzle and set the driving waveform, thereby controlling the nozzle to spray and output a triggering signal to the synchronous trigger control card 33. The synchronous trigger control card 33 receives the triggering signal and delays triggering the operation of the ink droplet inspection module, thereby performing a real-time inspection on the volume, velocity, angle and shape of the flying ink droplet. The real-time processing controller 32 is connected to the substrate inspection module, the nozzle inspection module, the ink droplet inspection module and the coating thickness inspection module respectively, thereby controlling the above modules to work and obtain corresponding image data for processing, so as to obtain multiple inspection results including substrate defects, nozzle defects, liquid coating defects, and cured coating defects. In addition, the real-time processing controller 32 is also connected to the movement controller 31, the synchronous trigger control card 33 and the inkjet control card 34 respectively, forming a closed-loop control on the entire inkjet printing manufacturing process of the display device.

[0100] More specifically, the synchronous trigger control card 33 receives the triggering signal, and triggers the first light source 41-1, the second light source 41-2, and the first camera 45-1 and the second camera 45-2 of the ink droplet inspection module to work through external triggering with a certain delay. The triggering frequency is the same as the spraying frequency to realize the image collection of flying ink droplets. In a preferred embodiment of the disclosure, the synchronous trigger control card 33 is an FPGA control circuit board with a time resolution of 20 ns. The real-time processing controller 32 is preferably an industrial computer, which is connected to respective inspection modules to control them to work and obtain image data for processing. The real-time processing controller 32 is connected with the movement controller 31, the inkjet control card 34, and the synchronous trigger control card 33 to realize parameter setting and data acquisition, and form a closed-loop control of the inkjet printing process.

[0101] As another key improvement of the disclosure, a corresponding quality inspection method is also provided, thereby correspondingly realizing quick and accurate inspection on corresponding defects, and establishing a defect feature database and a distribution map to facilitate subsequent defect analysis. In addition, the disclosure also provides specific inspection algorithms and defect definitions directed to each inspection process, and parameterized expressions for defect determining criteria.

[0102] Referring to FIG. 2, which shows a flowchart of an overall method for quality inspection of the entire inkjet printing manufacturing process for display devices constructed by the disclosure. As shown in FIG. 2, the method for quality inspection in the entire inkjet printing manufacturing process for display devices in the disclosure mainly includes the following steps, which will be thoroughly explained below in terms of principles and operations.

[0103] First, the substrate quality inspection step is performed.

[0104] The substrate inspection module is configured to perform positioning inspection and visual quality inspection on the substrate before inkjet printing, and record and establish the substrate defect feature database and the substrate defect distribution map.

[0105] More specifically, referring to FIG. 3A to FIG. 3B, the substrate inspection module is activated, the large-field downward-view unit 12 is adopted first to find at least 2 positioning marks on the substrate, and then the large-field downward-view unit 12 is switched to the high-magnification downward-view unit 13 for performing position inspection on the positioning marks, thereby calculating the installation position and tilt angle of the substrate.

[0106] Referring to FIG. 3A, the substrate moves sequentially to the preset marked position along the direction X.sub.1, that is, the first horizontal lateral direction. In the meantime, the high-resolution vision unit 11 collects images of the substrate. After the movement in the direction X.sub.1 is completed, the high-resolution vision unit 11 moves for a predetermined distance along the direction Y.sub.1, that is, the first horizontal longitudinal direction, and then the substrate moves reversely in the direction X.sub.1. In this way, the substrate and the high-resolution vision unit 11 move alternately until the image of the entire substrate is collected. In the process, it is ensured that there is a certain overlap area in adjacent images obtained from each collecting.

[0107] After the image of substrate is collected, the adjacent images are stitched to obtain a complete substrate image, and image processing is performed on the image to establish the substrate defect feature database and the substrate defect distribution map. Then the substrate defect determining index C.sub.b is calculated according to the following formula (1), wherein when C.sub.b is greater than the preset threshold C.sub.b0, it is determined that the substrate is a defective substrate.

[00009] $\begin{matrix} C_{b} = {.Math.}_{i = 1}^{N} b_{i} ({.Math.}_{j = 1}^{N_{i}} (\frac{D_{j}}{T_{i}} - 1)) & formula (1) \end{matrix}$

[0108] In the formula (1), N represents the number of defect categories of the substrate; T.sub.i, N.sub.i, b.sub.i respectively represent the threshold for determining the defect, the number of defects and weighting coefficient in the i-th category; D.sub.j represents the measured defect feature parameter and D.sub.j>T.sub.i; i and j respectively represent integers of 1˜N and 1˜N.sub.i. Specifically, C.sub.b0, b.sub.i, and T.sub.i are all empirical values, which can be set artificially according to actual conditions. In addition, in some preferred embodiments, a high-magnification downward-view system 13 can be used to further accurately inspect the inspected substrate defects.

[0109] In a preferable embodiment of the disclosure, in the above operation, the operation of image processing on the substrate image may preferably further include the following processes: defining the region of interest; performing filtering and noise reduction, preferably median filtering is adopted; performing template matching to divide the neighborhood region of pixel pits, preferably a shape-based template matching method is adopted; performing self-adjusting threshold segmentation to obtain pixel pits and defect regions; performing morphological operations; extracting mathematical features of pixel pits and defect regions, preferably the features such as area, aspect ratio, and average gray are extracted; performing defect classification based on support vector machine. The principles and specific methods of these image processing operations are known in the art, so related descriptions are not be repeated here.

[0110] According to another preferred embodiment of the disclosure, the substrate defect feature database can record information such as defect serial number, type, location, size, etc., and the substrate defect distribution map shows the defect location and serial number. For specific examples, refer to the following table 1 for reference.

TABLE-US-00001 TABLE 1 serial number defect type location size . . . 1 Missing (x.sub.1, y.sub.1) S.sub.1 features 2 Particles (x.sub.2, y.sub.2) S.sub.2 3 Scratches (x.sub.3, y.sub.3) S.sub.3 . . .

[0111] Next, the nozzle quality inspection step is performed.

[0112] In this step, the nozzle inspection module needs to be adopted to perform positioning inspection and visual quality inspection on the print head, and record and establish the nozzle defect feature database.

[0113] More specifically, referring to FIG. 4A to FIG. 4B, the nozzle inspection module is activated, first the large-field upward-view unit 21 is adopted to find at least 2 positioning marks of the print head. Then, the large-field upward-view unit 21 is switched to the high-magnification upward-view unit 22 for performing position inspection on the positioning marks, thereby calculating the initial position of the nozzle.

[0114] The high-magnification upward-view unit 22 collects an image of each nozzle area and obtains nozzle contour information including contour points. Then the nozzle size is measured and the nozzle defect index C.sub.n is calculated according to the following formula (2), wherein when C.sub.n is greater than the preset threshold C.sub.n0, it is determined that the nozzle has manufacturing defect or ink residual and so on.

[00010] $\begin{matrix} C_{n} = γ_{1} \frac{1}{N} {.Math.}_{i = 1}^{N} .Math. \sqrt{{(x_{i} - x_{0})}^{2} + {(y_{i} - y_{0})}^{2}} - r .Math. + γ_{2} (\max (\sqrt{{(x - x_{0})}^{2} + {(y_{i} - y_{0})}^{2}}) - \min (\sqrt{{(x - x_{0})}^{2} + {(y_{i} - y_{0})}^{2}})) & formula (2) \end{matrix}$

[0115] In formula (2), N represents the number of contour points, x.sub.i and y.sub.i respectively represent the position coordinates of the contour point numbered i, and the value of i is an integer from 1 to N; γ1 and γ2 are preset weighting coefficients respectively; x.sub.0 and y.sub.0 respectively represent the position coordinates of the center point of the nozzle; x and y respectively represent the position coordinates of any one of the multiple contour points; r represents the radius of the circle corresponding to the nozzle. In some preferable embodiments, C.sub.n0, γ1 and γ2 are all empirical values, which can be set artificially according to actual conditions. Further, with the same driving waveform, the ink droplet inspection module can be adopted to inspect the half ink droplet protrusions formed by each nozzle to verify the quality of the nozzle.

[0116] According to a preferred embodiment of the disclosure, in the above step, the step of pre-processing the nozzle image may preferably include operations such as setting the region of interest and reducing noise. In addition, the operation of measuring the size of the nozzle may preferably further include the following process: obtaining a more complete arc through Hough arc inspection, obtaining the initial value of the center and radius of the nozzle.fwdarw.by the given radius variation range, and obtaining the ring as the interval where the real edge of the nozzle is located.fwdarw.regarding the contour points inside the ring as the edge of the nozzle while regarding the contour points outside the ring as the edge of the defect.fwdarw.performing the least squares circle fitting on the selected contour points of the nozzle to get an accurate center and radius of the nozzle. Then the nozzle defect index C.sub.n is calculated to describe the nozzle quality, and the nozzle defect feature database is established.

[0117] According to another preferred embodiment of the disclosure, the nozzle defect feature database can, for example, record information such as nozzle serial number, center, radius, nozzle defect index C.sub.n, defect determining result, etc. For specific examples, refer to table 2 below.

TABLE-US-00002 TABLE 2 nozzle serial number center radius C.sub.n defect . . . 1 (x.sub.1, y.sub.1) r.sub.1 C.sub.n1 Y or N 2 (x.sub.2, y.sub.2) r.sub.2 C.sub.n2 Y or N 3 (x.sub.3, y.sub.3) r.sub.3 C.sub.n3 Y or N . . .

[0118] Next, the flying ink droplet inspection step is performed.

[0119] In the step, an ink droplet inspection module is adopted to perform real-time visual inspection on the volume, velocity, angle and shape of the flying ink droplet that is sprayed by the printhead, and record and establish an ink droplet parameter feature database.

[0120] More specifically, first the ink droplet inspection module is activated, and the two sets of horizontal vision units are synchronously triggered to collect images of flying ink droplets at multiple timings in a strobe mode, until the inspection on flying ink droplet from all nozzles is completed. Then, the stereo calibration and image processing are performed on the image of the flying ink droplets, then the shapes of the ink droplets sequentially, and a series of ink droplet parameters such as volume, velocity, and angle are simultaneously measured. Furthermore, the ink droplet defect index C.sub.d is calculated according to the following formula (3), wherein when C.sub.d is greater than the preset threshold C.sub.d0, it is determined that the ink droplet is a defective ink droplet.

[00011] $\begin{matrix} C_{d} = d_{1} .Math. \frac{V}{V_{0}} - 1 .Math. + d_{2} .Math. \frac{v}{v_{0}} - 1 .Math. + d_{3} .Math. \frac{φ}{φ_{0}} - 1 .Math. + d_{4} .Math. \frac{θ}{θ_{0}} - 1 .Math. & formula (3) \end{matrix}$

[0121] In formula (3), V.sub.0, v.sub.0, φ.sub.0, and θ.sub.0 respectively represent the preset ink droplet volume threshold, velocity threshold, and two angle thresholds; d.sub.1, d.sub.2, d.sub.3, and d.sub.4 respectively represent the preset weighting coefficients; V represents the actually measured volume of the flying ink droplet, v represents the actually measured velocity of the flying ink droplet; φ and θ represent the actually measured azimuth and pitch angle of the flying ink droplet.

[0122] As exemplarily shown in FIG. 5A to FIG. 5D, first, the first light source 41-1, the second light source 41-2, the first camera 45-1, and the second camera 45-2 of the ink droplet inspection module can be triggered externally through the synchronous trigger control card 33. The lag time t.sub.1 relative to the spraying is set, the ink droplet image at the time 1 is collected in a strobe mode. The lag time t.sub.2 relative to the spraying is set, the ink droplet image at the time 2 is collected in a strobe mode. The inspection on all nozzles is realized through the movement in X.sub.2 and Y.sub.2 degrees of freedom.

[0123] According to a preferred embodiment of the disclosure, due to the small field of view and small depth of field scenes under high magnification, the conventional calibration plate-based calibration method does not work well. It is preferable to adopt a Renishaw standard ball with a diameter of 300 um for calibrating the binocular vision system. Refer to FIG. 5A for details. A standard ball is configured on the print head module, the standard ball is controlled to move within the field of view of the ink droplet inspection module, and the position of the standard ball is recorded as (x, y, z). Stereo calibration is performed through the neural network, thereby obtaining the variation relationship between the coordinates (X.sub.1,Y.sub.1) and (X.sub.2,Y.sub.2) of the standard ball in the images captured by the first camera 45-1 and the second camera 45-2 and the three-dimensional coordinate (x, y, z) of the movement coordinate system. The designed neural network is preferably a two-layer neural network.

[0124] Next, referring to FIG. 5B, according to another preferred embodiment of the disclosure, the ink droplet image processing can be performed as follows. The region of interest is defined for the ink droplet image at the time 1 and the time 2. The ink droplet region is converted from low gray region to high gray region through gray reversal. Preferably the median filtering method is adopted for noise reduction. The region where ink droplets might exist is obtained through self-adjusting threshold segmentation. The coarse ink droplet region is obtained through connection and feature threshold method, and is selected preferably according to the region area and roundness feature. The coarse ink droplet region is expanded as the region of interest for fine segmentation, and preferably the expanded region is obtained through morphological expansion. Gauss Laplace Filter is adopted to solve the divergence of the gradient of the region of interest. Candidate contours of ink droplets are obtained through zero-crossing detection. The region filling and the morphological operation are performed to obtain the final ink droplet contours.

[0125] Then referring to FIG. 5C, according to another preferred embodiment of the disclosure, the volume, velocity, angle, and shape of the ink droplet can be inspection in the following methods. For example, the shape of the ink droplet can be classified by a support vector machine to identify spherical ink droplet, satellite ink droplet, tailing, etc. Then the ink droplet parameters are measured, and the three-dimensional position of the ink droplet at time 1 and time 2 is reconstructed respectively according to the results of the stereo calibration, so as to calculate the three-dimensional velocity and angle of the ink droplet. The contours of the ink droplets in the images captured by the first camera 45-1 and the second camera 45-2 are aligned in terms of height. The 3rd order Hermite curve interpolation is adopted to construct the closed curve according to the four contour points in the same height plane. The enclosed area of the constructed closed curve is calculated, and the volume of the ink droplet is calculated through volume integration method. The volume threshold V.sub.0, velocity threshold v.sub.0, angle threshold φ and θ.sub.0, and weighting coefficients d.sub.1, d.sub.2, d.sub.3, and d.sub.4 are set artificially according to actual conditions. The ink droplet defect index C.sub.d is calculated to screen out defective ink droplets, thereby establish the ink droplet parameter feature database.

[0126] Then referring to FIG. 5D, according to another preferred embodiment of the disclosure, the actual volume V of the flying ink droplet can be measured preferably by the following process.

[0127] For the images of flying ink droplets respectively obtained by the two sets of horizontal vision units, align the two contours in height, and the 3rd order Hermite curve interpolation is adopted to construct the closed curve represented by the following formula (4) according to the four contour points in the same height plane. Then the enclosed area S of the constructed closed curve is calculated, and the actual volume V of the flying ink droplet is calculated according to the following formulas (5) and (6) through the volume integration method.

[00012] $\begin{matrix} H (x) = y_{1} (1 + 2 \frac{x - x_{1}}{x_{2} - x_{1}}) {(\frac{x - x_{2}}{x_{1} - x_{2}})}^{2} + y_{2} (1 + 2 \frac{x - x_{2}}{x_{1} - x_{2}}) {(\frac{x - x_{1}}{x_{2} - x_{1}})}^{2} + y_{1}^{'} (x - x_{1}) {(\frac{x - x_{2}}{x_{1} - x_{2}})}^{2} + y_{2}^{'} (x - x_{2}) {(\frac{x - x_{1}}{x_{2} - x_{1}})}^{2} & formula (4) \\ S = - k_{1} \int_{x_{1}}^{x_{2}} H_{1} (x) dx - k_{2} \int_{x_{2}}^{x_{3}} H_{2} (x) dx + k_{3} \int_{x_{3}}^{x_{4}} H_{3} (x) dx + k_{4} \int_{x_{4}}^{x_{1}} H_{4} (x) dx & formula (5) \\ V = Δ h .Math. S_{i} & formula (6) \end{matrix}$

[0128] In the formulas, H(x) represents the structure curve between two contour points, and four segments of curves H.sub.1, H.sub.2, H.sub.3, and H.sub.4 are constructed between the four contour points in the same height plane; (x.sub.1, y.sub.1) and (x.sub.2, y.sub.2) respectively represent the coordinate values of the two adjacent contour points that construct the Hermite curve; y.sub.1′ and y.sub.2′ respectively represent the derivatives at the point (x.sub.1, y.sub.1) and (x.sub.2, y.sub.2); k.sub.1, k.sub.2, k.sub.3, k.sub.4 respectively represent the correction coefficient for correcting the error of the ink droplet contour approximately represented by the Hermite curve; Δh represents the height between the adjacent height planes; S.sub.i represents the area enclosed by the closed curve in the i-th height plane.

[0129] In addition, according to another preferred embodiment of the disclosure, the ink droplet parameter feature database can record the nozzle serial number corresponding to the ink droplets, the ink droplet shape classification result, the volume, the velocity, the azimuth angle, the pitch angle, the ink droplet defect index C.sub.d, the ink droplet defect determining results and so on. Please refer to table 3 below for specific examples.

TABLE-US-00003 TABLE 3 nozzle serial azimuth pitch number shape volume velocity angle angle C.sub.d defect . . . 1 spherical V.sub.1 v.sub.1 φ.sub.1 θ.sub.1 C.sub.d1 Y or N 2 satellite V.sub.2 v.sub.2 φ.sub.2 θ.sub.2 C.sub.d2 Y or N 3 tailing V.sub.3 v.sub.3 φ.sub.3 θ.sub.3 C.sub.d3 Y or N . . .

[0130] Next, the liquid coating inspection step is performed.

[0131] In the step, the substrate inspection module and the coating thickness inspection module are adopted to perform visual inspection on the quality of the liquid coating and the thickness of the liquid coating sprayed onto the substrate, and record and establish a liquid coating defect feature database and a liquid coating defect distribution map.

[0132] More specifically, as shown in FIG. 6A to FIG. 6B, in the liquid coating inspection step, first the substrate after inkjet printing is sequentially moved to the preset marked position according to the position feedback along the direction X.sub.1, that is, the first horizontal lateral direction. In the meantime, the high-resolution vision unit 11 collects the image of the current substrate. After the movement in the direction X.sub.1 is completed, the high-resolution vision unit 11 moves for a preset distance along the direction Y.sub.1, that is, the first horizontal longitudinal direction, and then the substrate moves reversely in the direction X.sub.1. In this manner, the high-resolution vision unit 11 and the substrate move alternately until the image of the liquid coating is completely collected. In this process, it should be ensured that there is a certain overlap area in the adjacent images obtained from each image collection.

[0133] After the image collection of the liquid coating is completed, adjacent images are stitched to obtain a complete liquid coating substrate image, background subtraction and image processing are performed on the obtained image, and a liquid coating defect feature database and a liquid coating defect distribution map are established. In the operation process, according to a preferred embodiment of the disclosure, the step of processing the image may include operations such as setting the region of interest and noise reduction; performing template matching to divide grids through arrangement of pixel pits, preferably a shape-based template matching method is adopted; extracting the contour of the liquid coating image in the grid region corresponding to each pixel pit; further extracting mathematical features of the liquid coating image, and the mathematical features preferably include position, area, aspect ratio, average gray and so on; adopting the support vector machine to identify defects such as insufficient filling in the pit, ink overflow, insufficient volume in the pit, volume interference in the pit, bridging between pits, and scattered points. The principles and specific methods of these image processing operations are known in the art, so related descriptions are not be repeated here.

[0134] The coating thickness inspection module is activated to perform scanning along the direction Z.sub.1, that is, the first vertical direction, so as collect a series of interference fringe images at each height position and record the corresponding vertical position value. The liquid coating thickness distribution and liquid coating volume are calculated according to the white light interference principle. During this operation, according to another preferred embodiment of the disclosure, as shown exemplarily in FIG. 6B, for example, the neighborhood region of each pixel can be the region of interest, and the liquid coating in the region of interest can be inspected according to the white light interference principle. The coating thickness inspection module performs scanning along direction Z.sub.1, the camera 54 collects a series of interference fringe images at each height position and records the corresponding value Z.sub.1, the interference fringe images of all frames are processed, thereby obtaining a distribution curve showing the distribution of the gray of each pixel in the images as a function of height. The envelope of the gray distribution curve corresponding to each pixel in the images is obtained, and the envelope can be obtained preferably through the method based on Hilbert transformation. Then, the peak value of the envelope of the gray distribution curve corresponding to each pixel in the images is determined. The height value Z.sub.1 corresponding to the peak value is the zero optical path difference position. Since the white light interferometry measures the zero optical path difference position instead of the absolute height, the reference point position and its zero optical path difference position are subtracted from the position and the corresponding zero optical path difference height (X.sub.1,Y.sub.1,Z.sub.1) of each pixel in the images to obtain the three-dimensional point coordinates of the coating surface, and then the liquid coating thickness is further calculated; preferably the volume integration method is adopted to calculate the liquid coating volume.

[0135] Additionally, the local uniformity index U.sub.local of the liquid coating and the global uniformity index U.sub.global of the liquid coating are calculated according to the following formulas (7) and (8), and the inkjet printing quality is assessed based on these two indexes.

[00013] $\begin{matrix} U_{local} = \frac{S_{h}}{S_{local}} & formula (7) \\ U_{global} = \frac{1}{K} {.Math.}_{k = 1}^{K} U_{k}, U_{k} = {\begin{matrix} 0, \frac{.Math. h_{c, k} - \overline{h} .Math.}{\overline{h}} > λ_{2} \\ U_{k}, \frac{.Math. h_{c, k} - \overline{h} .Math.}{\overline{h}} \leq λ_{2} \end{matrix} & formula (8) \end{matrix}$

[0136] In the above formulas, S.sub.local represents the area of the defined region of interest of the liquid coating substrate inspection image; S.sub.h represents the area of the region of which the thickness h satisfies

[00014] $\frac{.Math. h - h_{c} .Math.}{h_{c}} \leq λ_{1}$

and which begins to be searched from the center of the region of interest, wherein h.sub.c represents the center thickness of the region of interest. λ.sub.1 represents the preset local uniformity coefficient of the liquid coating, λ.sub.2 represents the preset global uniformity coefficient of the liquid coating; K represents the number of regions of interest determined by sampling when calculating the global uniformity; h.sub.c,k and U.sub.k respectively represent the central thickness and local uniformity of the k-th region of interest, wherein the value of k is an integer from 1 to K; h represents the average value of the center thickness of the liquid coating of the K regions of interest.

[0137] In addition, according to another preferred embodiment of the disclosure, the liquid coating defect feature database can record information such as defect serial number, defect type, coordinates of the pixel pit to which the defect belongs, defect location, size, etc. Furthermore, with regard to the insufficient volume in pits and volume interference defects, the volume thereof can be recorded, and the liquid coating defect distribution map shows the defect location and serial number. For specific examples, see table 4 below.

TABLE-US-00004 TABLE 4 defect serial coordinates of number defect type pixel pit location size volume . . . 1 Insufficient filling (R.sub.1, C.sub.1) (x.sub.1, y.sub.1) S.sub.1 in pits 2 Ink overflow (R.sub.2, C.sub.2) (x.sub.2, y.sub.2) S.sub.2 3 Insufficient (R.sub.3, C.sub.3) (x.sub.3, y.sub.3) S.sub.3 V.sub.3 volume in pits 4 Volume (R.sub.4, C.sub.4) (x.sub.4, y.sub.4) S.sub.4 V.sub.4 interference in pits 5 Bridge between (R.sub.5, C.sub.5) (x.sub.5, y.sub.5) S.sub.5 pits 6 Scattered points (R.sub.6, C.sub.6) (x.sub.6, y.sub.6) S.sub.6 . . .

[0138] Next, the cured coating inspection step is performed.

[0139] In the step, the substrate inspection module and the coating thickness inspection module need to be adopted again to perform visual inspection on the quality of the cured coating and the thickness of the cured coating that are sprayed onto the substrate and completely cured, and record and establish a cured coating defect feature database and a cured coating defect distribution map.

[0140] More specifically, as shown in FIG. 7, the substrate after inkjet printing and curing is sequentially moved to the preset marked position according to the position feedback along the direction X.sub.1, that is, the first horizontal lateral direction. In the meantime, the high-resolution vision unit 11 collects the image of the current substrate. After the movement in the direction X.sub.1 is completed, the high-resolution vision unit 11 moves for a preset distance along the direction Y.sub.1, that is, the first horizontal longitudinal direction, and then the substrate moves reversely in the direction X.sub.1. In this manner, the high-resolution vision unit 11 and the substrate move alternately until the image of the cured coating is completely collected. In this process, it should be ensured that there is a certain overlap area in the adjacent images obtained from each image collection.

[0141] After the image collection of the cured coating is completed, the adjacent images are stitched to obtain a complete cured coating substrate image, background subtraction is performed on the obtained image, and a cured coating defect feature database and a cured coating defect distribution map are established. In the operation process, according to a preferred embodiment of the disclosure, the step of processing the image may include operations such as setting the region of interest and noise reduction; performing template matching to divide grids through arrangement of pixel pits, preferably a shape-based template matching method is adopted; extracting the contour of the cured coating image in the grid region corresponding to each pixel pit; further extracting mathematical features of the cured coating image, and the mathematical features preferably include position, area, aspect ratio, average gray and so on; adopting the support vector machine to identify defects such as insufficient filling in the pit, ink overflow, insufficient volume in the pit, volume interference in the pit, bridging between pits, and scattered points. The principles and specific methods of these image processing operations are known in the art, so related descriptions are not be repeated here.

[0142] Thereafter, the coating thickness inspection module is activated to perform scanning along the direction Z.sub.1, that is, the first vertical direction, so as collect a series of interference fringe images at each height position and record the corresponding vertical position value. The cured coating thickness and cured coating volume are calculated according to the white light interference principle. During this operation, according to another preferred embodiment of the disclosure, for example, the neighborhood region of each pixel pit can be the region of interest, and the cured coating in the region of interest can be inspected according to the white light interference principle. The coating thickness inspection module performs scanning along direction Z.sub.1, the camera 54 collects a series of interference fringe images at each height position and records the corresponding value Z.sub.1, the interference fringe images of all frames are processed, thereby obtaining a distribution curve showing the distribution of the gray of each pixel in the images as a function of height. The envelope of the gray distribution curve corresponding to each pixel in the images is obtained, and the envelope can be obtained preferably through the method based on Hilbert transformation. Then, the peak value of the envelope of the gray distribution curve corresponding to each pixel in the images is determined. The height value Z.sub.1 corresponding to the peak value is the zero optical path difference position. Since the white light interferometry measures the zero optical path difference position instead of the absolute height, the reference point position and its zero optical path difference height are subtracted from the position and the corresponding zero optical path difference height (X.sub.1,Y.sub.1,Z.sub.1) of each pixel in the images to obtain the three-dimensional point coordinates of the coating surface, and then the cured coating thickness is calculated; preferably the volume integration method is adopted to calculate the cured coating volume.

[0143] Next, the local uniformity index U.sub.local of the cured coating and the global uniformity index U.sub.global of the cured coating are calculated according to the following formulas (9) and (10), and the inkjet printing quality is assessed based on these two indexes.

[00015] $\begin{matrix} U_{local} = \frac{S_{h}}{S_{local}} & formula (9) \\ U_{global} = \frac{1}{K} {.Math.}_{k = 1}^{K} U_{k}, U_{k} = {\begin{matrix} 0, \frac{.Math. h_{c, k} - \overline{h} .Math.}{\overline{h}} > μ_{2} \\ U_{k}, \frac{.Math. h_{c, k} - \overline{h} .Math.}{\overline{h}} \leq μ_{2} \end{matrix} & formula (10) \end{matrix}$

[0144] In the above formulas, S.sub.local represents the area of the defined region of interest of the cured coating substrate inspection image; S.sub.h represents the area of the region of which the thickness h satisfies

[00016] $\frac{.Math. h - h_{c} .Math.}{h_{c}} \leq μ_{1}$

and which begins to be searched from the center of the region of interest, wherein h.sub.c represents the center thickness of the region of interest. μ.sub.1 represents the preset local uniformity coefficient of the cured coating, μ.sub.2 represents the preset global uniformity coefficient of the cured coating; K represents the number of regions of interest determined by sampling when calculating the global uniformity; h.sub.c,k and U.sub.k respectively represent the central thickness and local uniformity of the k-th region of interest, wherein the value of k is an integer from 1 to K; h represents the average value of the center thickness of the cured coating of the K regions of interest.

[0145] In addition, according to another preferred embodiment of the disclosure, the cured coating defect feature database can record information such as defect serial number, defect type, coordinates of the pixel pit to which the defect belongs, defect location, size, etc. Furthermore, with regard to the insufficient volume in pits and volume interference defects, the volume thereof can be recorded, and the cured coating defect distribution map shows the defect location and serial number. The cured coating defect feature database and its distribution map are the same as the liquid coating defect feature database and its distribution database. For specific examples, see table 4 above.

[0146] Finally, quality inspection and closed-loop feedback control steps are performed.

[0147] In the step, the defect determining criteria for the substrate, the nozzle, the ink droplets, the liquid coating, and the cured coating are set in advance, and an inspection closed-loop between the nozzle and the ink droplet as well as an inspection closed-loop between the substrate, the nozzle, the ink droplet, the liquid coating and the cured coating are formed according to the multiple defect feature databases and parameter feature databases respectively established in the above steps. Then, the specific source of defect can be deduced and determined based on the cured coating defect and the corresponding optimal modulation can be performed. In this way, the quality closed-loop feedback control of the entire inkjet printing manufacturing process is realized.

[0148] More specifically, as exemplarily shown in FIG. 8, according to a preferred embodiment of the disclosure, the step of forming the inspection closed-loop between the nozzle and the ink droplet preferably includes the following operation steps.

[0149] The nozzle defect feature database and the ink droplet parameter feature database are compared, the impact of the nozzle defect on the ink droplet defect is determined, and the nozzle that cannot be used normally due to the nozzle defect is shut down. Specifically, the criteria for determining the impact of the nozzle defect on the ink droplet defect are set as follows. If a nozzle and its sprayed ink droplets are not defective, it is determined that the nozzle can be used normally; if a nozzle is defective but its sprayed ink droplets are not defective, it is determined that the nozzle defect does not cause ink droplet defects, and the nozzle can be used normally; if the ink droplets sprayed by a nozzle are defective, the driving waveform is modulated and the ink droplet inspection is performed again. Under the circumstances, if the droplets are not defective, it is determined that the nozzle itself does not cause ink droplet defects and can be used normally, otherwise it is determined the nozzle defect is unacceptable and the defective nozzle is shut down.

[0150] In addition, as exemplarily shown in FIG. 9, according to another preferred embodiment of the disclosure, the step of forming the inspection closed-loop between the substrate, the nozzle, the ink droplet, the liquid coating and the cured coating preferably includes the following operation steps.

[0151] For the collected substrate defect feature database, the nozzle defect feature database, the ink droplet parameter feature database, the liquid coating defect feature database and the cured coating defect feature database, these feature databases are compared to determine the source of the defects, and then the criteria for determining the substrate defects, the nozzle defects, the ink droplet defects, and the liquid coating defects are adjusted accordingly. Specifically, the operation of determining the source of the defect and adjusting the determining criteria accordingly is as follows. The liquid coating defect feature database and the cured coating defect feature database are compared. If there is no liquid coating defect at the cured coating defect, then it is determined that the defect originates from the curing process or the criteria for determining the liquid coating defects need to be set to a lower level. If there is a liquid coating defect, the inkjet printing process is further analyzed, and the nozzles that are involved in printing the pixel having the cured coating defect are searched. The substrate defect feature database and the liquid coating defect feature database are compared. If there is a substrate defect at the liquid coating defect, the impact of the substrate defect on the liquid coating defect is further investigated. If the substrate defect will cause the liquid coating defect, the threshold C.sub.b0 for determining the substrate defect is set to be lower. If there is no substrate defect, it is determined that the defect originates from the spraying process or the criteria for determining the substrate defect needs to be set to a lower level, and the spraying process is further analyzed. The ink droplet parameter feature database is checked. If the ink droplets sprayed by the nozzle involved in printing the defective pixels are not defective, the threshold C.sub.d0 for determining the ink droplet defects needs to be set to a lower level, otherwise the nozzle and ink droplet inspection closed-loop method are adopted to determine whether the defects originate from the nozzle. If the defect originates from a nozzle but the nozzle is not defective in the nozzle defect feature database, the threshold C.sub.n0 for determining the nozzle defect is set to a lower level.

[0152] Referring to FIG. 10, according to another preferred embodiment of the disclosure, the following method can be adopted to perform quality closed-loop feedback control in the entire inkjet printing manufacturing process. The driving waveform is set to control the nozzle to spray, the criteria for determining the defects of the substrate, the nozzle, the ink droplets, the liquid coating, and cured coating are set and corresponding inspection method is performed to inspect the substrate, the nozzle, the ink droplets, the liquid coating, and cured coating to form the corresponding defect feature databases and parameter feature databases. The source of defects is deduced according to the nozzle, the ink droplet inspection closed-loop as well as the substrate, the nozzle, the ink droplet, the liquid coating and the cured coating inspection closed-loop, and the determining criteria directed at the substrate defect, the nozzle defect, the ink droplet defect and the liquid coating defect are adjusted to reduce the missed inspection rate and false inspection rate of the defects. If the cured coating defect is caused by the nozzle defect, the defective nozzle is shut down; if the cured coating defect is caused by the driving waveform, the driving form is adjusted, thereby forming the closed-loop feedback control for the quality of the entire inkjet printing manufacturing process.

[0153] In summary, according to the quality inspection system and method for the entire inkjet printing manufacturing process provided in the disclosure, by designing multiple vision modules and control modules, as well as corresponding quality inspection algorithms, it is possible to achieve on-line quality inspection on the substrate, nozzle, ink droplet, liquid coating and cured coating. By comparing and analyzing the defect feature databases and parameter feature databases, the inspection results of each stage of the process can be verified and the defect determining criteria can be adjusted. Meanwhile, the source of defects in the inkjet printing manufacturing process can be analyzed. In this way, the systematic inspection and control of the quality of the entire inkjet printing manufacturing process can be realized.

[0154] Those skilled in the art can easily understand that the above descriptions are only preferred embodiments of the present disclosure and are not intended to limit the present disclosure. Any modification, equivalent replacement and improvement, etc. made within the spirit and principle of the present disclosure should fall within the protection scope of the present disclosure.

SYSTEM AND METHOD FOR QUALITY INSPECTION ON OVERALL INKJET PRINTING MANUFACTURING PROCESS FOR DISPLAY DEVICE

Assignee

Inventors

Cpc classification

Classification Explorer

B41J2/2142

PERFORMING OPERATIONS; TRANSPORTING

Classification Explorer

B05B12/08

PERFORMING OPERATIONS; TRANSPORTING

Classification Explorer

G06T7/0004

PHYSICS

Classification Explorer

B05B12/082

PERFORMING OPERATIONS; TRANSPORTING

Classification Explorer

B05B12/084

PERFORMING OPERATIONS; TRANSPORTING

Classification Explorer

B05D1/02

PERFORMING OPERATIONS; TRANSPORTING

Classification Explorer

H01L21/67253

ELECTRICITY

International classification

Classification Explorer

B41J2/21

PERFORMING OPERATIONS; TRANSPORTING

Classification Explorer

B41J2/195

PERFORMING OPERATIONS; TRANSPORTING

Classification Explorer

B41J29/393

PERFORMING OPERATIONS; TRANSPORTING

Classification Explorer

G06T7/00

PHYSICS

Abstract

Claims

Description