Surface inspection apparatus and surface inspection method
10788430 ยท 2020-09-29
Assignee
Inventors
- Jin Nozawa (Anjo, JP)
- Yasuyuki Kuno (Miyoshi, JP)
- Yukio Ichikawa (Ichinomiya, JP)
- Masataka Toda (Toyohashi, JP)
- Munehiro Takayama (Kariya, JP)
Cpc classification
G01N21/8851
PHYSICS
G01N2021/8829
PHYSICS
International classification
Abstract
A surface inspection apparatus includes: an inspection pattern forming unit that forms inspection patterns; a projection unit that projects the inspection patterns onto an inspection target object; a captured image acquiring unit that acquires captured images of the inspection target object; an edge extraction image creating unit that extracts edges from captured images, and creates edge extraction images; a correction coefficient setting unit that sets a correction coefficient for correcting intensities of edges in the edge extraction image; an intensity correcting unit that corrects the intensities of the edges; a corrected edge extraction image creating unit that creates corrected edge extraction images; an integrated image creating unit that creates a single integrated image by integrating the brightness values at the same position of the inspection target object; and a determination unit that determines the presence or absence of unevenness on a surface of the inspection target object.
Claims
1. A surface inspection apparatus comprising: an inspection pattern forming unit configured to form a plurality of inspection patterns in which first patterns having a predetermined brightness or higher and second patterns having a brightness lower than the brightness of the first patterns are alternately arranged, and sequentially deviated by a predetermined deviation amount in a direction in which the first patterns and the second patterns are alternately arranged; a projection unit configured to project the plurality of inspection patterns formed by the inspection pattern forming unit onto an inspection target object by sequentially displaying the plurality of inspection patterns on a display screen; a captured image acquiring unit configured to acquire a captured image of the inspection target object each time the inspection pattern is projected; an edge extraction image creating unit configured to extract an edge from each of a plurality of captured images acquired by the captured image acquiring unit, and create an edge extraction image, for every captured image, which represents the extracted edge based on a difference in a brightness value between the edge and a portion other than the edge; a correction coefficient setting unit configured to set a correction coefficient for correcting an intensity of a first edge in a predetermined first direction in the edge extraction image and an intensity of a second edge in a second direction orthogonal to the first direction in the edge extraction image, based on the intensity of the first edge and the intensity of the second edge, so as to reduce a degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other; an intensity correcting unit configured to correct the intensity of the first edge and the intensity of the second edge based on the correction coefficient; a corrected edge extraction image creating unit configured to create a plurality of corrected edge extraction images from the plurality of edge extraction images based on the intensity of the first edge and the intensity of the second edge which are corrected by the intensity correcting unit; an integrated image creating unit configured to create a single integrated image by integrating the brightness values at the same position of the inspection target object throughout the plurality of corrected edge extraction images; and a determination unit configured to divide the integrated image into a plurality of sections and determine the presence or absence of unevenness on a surface of the inspection target object based on the brightness values for every divided section.
2. The surface inspection apparatus according to claim 1, wherein the corrected edge extraction image creating unit creates the corrected edge extraction images based on a composite intensity of the intensity of the first edge and the intensity of the second edge, and the correction coefficient is set such that the composite intensity is lower than an intensity of an edge in accordance with a magnitude of unevenness of the inspection target object to be detected.
3. A surface inspection method comprising: forming a plurality of inspection patterns in which first patterns having a predetermined brightness or higher and second patterns having a brightness lower than the brightness of the first patterns are alternately arranged, and sequentially deviated by a predetermined deviation amount in a direction in which the first patterns and the second patterns are alternately arranged; projecting the plurality of inspection patterns formed in the forming onto an inspection target object by sequentially displaying the plurality of inspection patterns on a display screen; acquiring a captured image of the inspection target object each time the inspection pattern is projected; extracting an edge from each of a plurality of captured images acquired in the acquiring, and creating an edge extraction image, for every captured image, which represents the extracted edge based on a difference in a brightness value between the edge and a portion other than the edge; setting a correction coefficient for correcting an intensity of a first edge in a predetermined first direction in the edge extraction image and an intensity of a second edge in a second direction orthogonal to the first direction in the edge extraction image, based on the intensity of the first edge and the intensity of the second edge, so as to reduce a degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other; correcting the intensity of the first edge and the intensity of the second edge based on the correction coefficient; creating a plurality of corrected edge extraction images from the plurality of edge extraction images based on the intensity of the first edge and the intensity of the second edge which are corrected in the correcting; creating a single integrated image by integrating the brightness values at the same position of the inspection target object throughout the plurality of corrected edge extraction images; and dividing the integrated image into a plurality of sections and determining the presence or absence of unevenness on a surface of the inspection target object based on the brightness values for every divided section.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The foregoing and additional features and characteristics of this disclosure will become more apparent from the following detailed description considered with the reference to the accompanying drawings, wherein:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
DETAILED DESCRIPTION
(12) A surface inspection apparatus according to an embodiment disclosed here is configured to be able to appropriately inspect the presence or absence of unevenness on a surface of an inspection target object. The unevenness on the surface of the inspection target object does not mean unevenness originally provided on the inspection target object (unevenness derived from a shape of the inspection target object) but means unevenness unintentionally formed on the surface of the inspection target object (unevenness that is not derived from the shape of the inspection target object). Hereinafter, a surface inspection apparatus 1 according to the present embodiment will be described.
(13)
(14) The inspection pattern forming unit 10 forms an inspection pattern P in which first patterns F, which have a predetermined brightness or higher, and second patterns S, which have a brightness lower than the brightness of the first patterns F, are alternately arranged. The first pattern F having a predetermined brightness or higher is an indication which is displayed with predetermined luminance or higher when the inspection pattern P is displayed on a display screen 21 of the projection unit 20 to be described below, and for example, the first pattern F is an indication having white color. Meanwhile, the second pattern S having a brightness lower than the brightness of the first pattern F is an indication which is displayed with luminance lower than the brightness of the first pattern F when the inspection pattern P is displayed on the display screen 21, and for example, the second pattern S is an indication having black color. The inspection pattern P has the first patterns F and the second patterns S which are alternately arranged in a predetermined direction. In the present embodiment, as illustrated in
(15) The inspection pattern forming unit 10 forms the plurality of inspection patterns P that sequentially deviate by a predetermined deviation amount in the direction in which the first patterns F and the second patterns S are alternately arranged.
(16) The process of forming the plurality of inspection patterns P in which the first patterns F having the predetermined brightness or higher and the second patterns S having the brightness lower than the brightness of the first pattern F are alternately arranged and which sequentially deviate by the predetermined deviation amount in the direction in which the first patterns F and the second patterns S are alternately arranged is referred to as an inspection pattern forming step in a surface inspection method.
(17) Referring back to
(18) The process of sequentially displaying the plurality of inspection patterns P, which are formed by the inspection pattern forming step, on the display screen 21 and projecting the plurality of inspection patterns P onto the inspection target object 2 is referred to as a projection step in the surface inspection method.
(19) The captured image acquiring unit 30 acquires a captured image of the inspection target object 2 each time the inspection pattern P is projected. As described above, the plurality of inspection patterns P are formed, and the projection unit 20 sequentially changes and displays the plurality of inspection patterns P. The captured image acquiring unit 30 acquires the captured image of the inspection target object 2 onto which the inspection pattern P is projected as the inspection pattern P is changed.
(20) The process of acquiring the captured image of the inspection target object 2 each time the inspection pattern P is projected is referred to as a captured image acquiring step in the surface inspection method.
(21) Referring back to
(22) The process of extracting the edges from the plurality of captured images acquired by the captured image acquiring step and creating the edge extraction images, for every captured image, in which the extracted edges are indicated based on the difference in a brightness value between the edge and the portion which is not the edge is referred to as an edge extraction image creating step in the surface inspection method.
(23)
(24) The extraction of the edge may be performed by using, for example, the publicly known Canny method.
(25) Assuming that an intensity of the horizontal edge is defined as a horizontal intensity Ix and an intensity of the vertical edge is defined as a vertical intensity Iy, a composite intensity I, which is an overall intensity, is expressed by the following Equation (1) (see part (f) of
I=Ix+Iy(1)
(26) Here, if the edges are extracted by using a threshold value (a single threshold value) set based on the intensity merely calculated based on Equation (1), the horizontal edges and the vertical edges are sometimes not connected to one another, as illustrated in part (f) of
(27) Here,
(28) Therefore, based on an intensity of a first edge in a predetermined first direction in the edge extraction image and an intensity of a second edge in a second direction orthogonal to the first direction in the edge extraction image, the correction coefficient setting unit 50 sets correction coefficients for correcting the intensity of the first edge and the intensity of the second edge in order to reduce a degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other. The intensity of the first edge in the predetermined first direction in the edge extraction image corresponds to the aforementioned horizontal edge in the edge extraction image in the present embodiment, and the intensity of the second edge in the second direction orthogonal to the first direction in the edge extraction image corresponds to the aforementioned vertical edge in the edge extraction image in the present embodiment. The degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other refers to a degree of influence which causes the other of the first edge and the second edge to be hardly detected due to the intensity of one of the first edge and the second edge. As the degree of influence is increased, the other of the first edge and the second edge is hardly detected as described above.
(29) Therefore, the correction coefficient setting unit 50 sets the correction coefficient for correcting the intensity of the first edge and the intensity of the second edge. As described above, assuming that the intensity of the horizontal edge is defined as the horizontal intensity Ix and the intensity of the vertical edge is defined as the vertical intensity Iy, the composite intensity I is expressed by Equation (1). The correction coefficient setting unit 50 sets correction coefficients A and B capable of correcting the horizontal intensity Ix and the vertical intensity Iy in Equation (1), respectively. However, 0A1, and 0B1. The composite intensity I corrected by the correction coefficients is expressed by Equation (2).
I=AIx+BIy(2)
(30) Here, in a case where the edges are connected in the Canny method, the hysteresis threshold value processing is performed on the sum of the intensity of the horizontal edge and the intensity of the vertical edge, and as a result, it is possible to reduce the degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other by correcting the horizontal edge and the vertical edge, as described above. Therefore, by setting in advance a direction of a contour of the inspection pattern P to be projected, it is possible to remove a contour derived from the shape and selectively extract only a contour of the projected stripe.
(31) The process of setting the correction coefficient for correcting the intensity of the first edge and the intensity of the second edge, based on the intensity of the first edge in the predetermined first direction in the edge extraction image and the intensity of the second edge in the second direction orthogonal to the first direction in the edge extraction image, in order to reduce the degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other, is referred to as a correction coefficient setting step in the surface inspection method.
(32) It is appropriate that the correction coefficient setting unit 50 sets the correction coefficient so that the composite intensity of the intensity of the first edge and the intensity of the second edge is lower than an intensity of an edge in accordance with a magnitude of unevenness on the inspection target object 2 to be detected. The intensity of the edge in accordance with the magnitude of the unevenness on the inspection target object 2 to be detected may be specified by, for example, providing in advance unevenness on a limit sample or the like, irradiating the inspection pattern P to the limit sample, as described above, and then extracting edges. The correction coefficient setting unit 50 may be set the correction coefficient such that the composite intensity of the intensity of the first edge and the intensity of the second edge is lower than the intensity of the edge in accordance with of the magnitude of the unevenness to be detected, which is acquired from the limit sample. Therefore, the intensity of the edge resulting from the shape of the inspection target object 2 may be lower than the intensity of the edge resulting from the unevenness to be detected, and as a result, it is possible to prevent erroneous detection.
(33) The intensity correcting unit 60 corrects the intensity of the first edge and the intensity of the second edge based on the correction coefficients.
(34) The process of correcting the intensity of the first edge and the intensity of the second edge based on the correction coefficients is referred to as an intensity correcting step in the surface inspection method.
(35) Based on the intensity of the first edge and the intensity of the second edge which are corrected by the intensity correcting unit 60, the corrected edge extraction image creating unit 70 creates a plurality of corrected edge extraction images from the plurality of edge extraction images. The intensity of the first edge and the intensity of the second edge which are corrected by the intensity correcting unit 60 are the intensity of the first edge and the intensity of the second edge corrected by using the correction coefficients A and B. The edge extraction image is created by the edge extraction image creating unit 40. In respect to the edge extraction images, the corrected edge extraction image creating unit 70 creates the corrected edge extraction images made by correcting the intensity of the first edge and the intensity of the second edge. That is, the corrected edge extraction image creating unit 70 creates the corrected edge extraction images based on the composite intensity of the intensity of the first edge and the intensity of the second edge. The sentence the corrected edge extraction images are created based on the composite intensity of the intensity of the first edge and the intensity of the second edge means that the edges are detected by using the two threshold values (the high threshold value and the low threshold value) set based on the aforementioned composite intensity.
(36) The process of creating a plurality of corrected edge extraction images from the plurality of edge extraction images based on the intensity of the first edge and the intensity of the second edge which are corrected by the intensity correcting step is referred to as a corrected edge extraction image creating step in the surface inspection method.
(37) Referring back to
(38) As described above, in the corrected edge extraction image, the edge portion is indicated with bright color (e.g., white) and the other portion, which is not the edge, is indicated with color (e.g., black) darker than the color of the edge portion. Therefore, the integrated image creating unit 80 integrates the brightness values at the same position throughout the plurality of corrected edge extraction images and creates the single integrated image in which the integrated result is indicated at a position corresponding to the position in the corrected edge extraction image. An example of the integrated image is illustrated in
(39) The process of creating the single integrated image by integrating brightness values at the same position in the inspection target object 2 throughout the plurality of corrected edge extraction images is referred to as an integrated image creating step in the surface inspection method.
(40) The determination unit 90 divides the integrated image into a plurality of sections and determines the presence or absence of unevenness on the surface of the inspection target object 2 based on the brightness values for every divided section. The sentence the integrated image is divided into the plurality of sections means that the integrated image is divided into the sections having a predetermined size. In the present embodiment, the integrated image is divided in a grid pattern. It is appropriate that the section is formed so that, for example, the size of the section in the grid pattern has pixel resolving power such as 1010 dot on screen data or is a size of 1 mm1 mm on the surface of the inspection target object 2. When there is unevenness on the surface of the inspection target object 2, the brightness value of the edge in the corrected edge extraction image is increased, and as a result, the brightness value of the edge in the integrated image is also increased. When there is a section having a large brightness value (a section in which the brightness value is changed), the determination unit 90 determines, based on the size of the section, that there is unevenness on the surface of the inspection target object 2. Meanwhile, when there is no section having a large brightness value, the determination unit 90 determines that there is no unevenness on the surface of the inspection target object 2.
(41) As described above, it is possible to inspect the presence or absence of unevenness on the surface of the inspection target object 2 by using the integrated image, but because the brightness value of the integrated image is irregular, it is not easy to perform the accurate inspection even though the predetermined threshold value is used. Therefore, it is appropriate that the determination unit 90 divides the integrated image into the plurality of sections and determines the presence or absence of unevenness on the surface of the inspection target object 2 based on the integrated value of the brightness values for every divided section.
(42) For example, the determination unit 90 may perform the determination based on average values of the brightness values for every section. That is, the determination unit 90 calculates, for every divided section, the average values of brightnesses in the corresponding sections, and plots the calculated result on a map in which a vertical axis indicates an average brightness corresponding to calculated result and a horizontal axis indicates the sections.
(43) The determination unit 90 plots the respective calculated results, and determines that there is no unevenness on the surface of the section when the average brightness of the objective section is less than a predetermined threshold value, and determines that there is unevenness on the surface of the section when the average brightness of the objective section exceeds the threshold value. Further, even though the result (average brightness) in each of the sections exceeds (goes beyond) the threshold value, in consideration of erroneous detection, irregularity, or the like, the entire inspection target object 2 may be evaluated as no problem, for example, if a proportion of the number of sections determined as having unevenness to the number of all sections is equal to or less than a predetermined value.
(44) The process of dividing the integrated image into the plurality of sections and determining the presence or absence of unevenness on the surface of the inspection target object 2 based on the brightness values for every divided section is referred to as a determination step in the surface inspection method.
Other Embodiments
(45) In the embodiment, the example in which the quadrangular shape in
(46) As illustrated in
(47) The embodiment disclosed here may be used for a surface inspection apparatus and a surface inspection method which inspect the presence or absence of unevenness on a surface of an inspection target object.
(48) A feature of a surface inspection apparatus according to an aspect of this disclosure resides in that the surface inspection apparatus includes: an inspection pattern forming unit configured to form a plurality of inspection patterns in which first patterns having a predetermined brightness or higher and second patterns having a brightness lower than the brightness of the first patterns are alternately arranged, and sequentially deviated by a predetermined deviation amount in a direction in which the first patterns and the second patterns are alternately arranged; a projection unit configured to project the plurality of inspection patterns formed by the inspection pattern forming unit onto an inspection target object by sequentially displaying the plurality of inspection patterns on a display screen; a captured image acquiring unit configured to acquire a captured image of the inspection target object each time the inspection pattern is projected; an edge extraction image creating unit configured to extract an edge from each of a plurality of captured images acquired by the captured image acquiring unit, and create an edge extraction image, for every captured image, which represents the extracted edge based on a difference in a brightness value between the edge and a portion other than the edge; a correction coefficient setting unit configured to set a correction coefficient for correcting an intensity of a first edge in a predetermined first direction in the edge extraction image and an intensity of a second edge in a second direction orthogonal to the first direction in the edge extraction image, based on the intensity of the first edge and the intensity of the second edge, so as to reduce a degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other; an intensity correcting unit configured to correct the intensity of the first edge and the intensity of the second edge based on the correction coefficient; a corrected edge extraction image creating unit configured to create a plurality of corrected edge extraction images from the plurality of edge extraction images based on the intensity of the first edge and the intensity of the second edge which are corrected by the intensity correcting unit; an integrated image creating unit configured to create a single integrated image by integrating the brightness values at the same position of the inspection target object throughout the plurality of corrected edge extraction images; and a determination unit configured to divide the integrated image into a plurality of sections and determine the presence or absence of unevenness on a surface of the inspection target object based on the brightness values for every divided section.
(49) With this configuration, the intensity of the first edge and the intensity of the second edge are weighted by the correction coefficient, and as a result, it is possible to reduce the degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other. The edges are detected by the intensity of the first edge and the intensity of the second edge which are corrected based on the correction coefficient, and as a result, it is possible to connect the edges derived from the inspection pattern (the edges that indicate a contour of the inspection target object) even though the edges are broken. In addition, it is possible to distinguish a contour resulting from a shadow formed in accordance with a lighting position and a shape of an inspection target object and a contour resulting from a projected stripe pattern, and as a result, it is possible to detect a contour based on the inspection pattern. Therefore, it is possible to appropriately inspect the presence or absence of unevenness on a surface of an inspection target object.
(50) It is preferable that the corrected edge extraction image creating unit creates the corrected edge extraction images based on a composite intensity of the intensity of the first edge and the intensity of the second edge, and the correction coefficient is set such that the composite intensity is lower than an intensity of an edge in accordance with a magnitude of unevenness of the inspection target object to be detected.
(51) When the composite intensity is corrected as described above, the inspection is performed without missing edges resulting from a magnitude of unevenness to be detected. Therefore, it is possible to appropriately inspect the presence or absence of unevenness on a surface of an inspection target object.
(52) A feature of a surface inspection method according to another aspect of this disclosure resides in that the surface inspection method includes: forming a plurality of inspection patterns in which first patterns having a predetermined brightness or higher and second patterns having a brightness lower than the brightness of the first patterns are alternately arranged, and sequentially deviated by a predetermined deviation amount in a direction in which the first patterns and the second patterns are alternately arranged; projecting the plurality of inspection patterns formed in the forming onto an inspection target object by sequentially displaying the plurality of inspection patterns on a display screen; acquiring a captured image of the inspection target object each time the inspection pattern is projected; extracting an edge from each of a plurality of captured images acquired in the acquiring, and creating an edge extraction image, for every captured image, which represents the extracted edge based on a difference in a brightness value between the edge and a portion other than the edge; setting a correction coefficient for correcting an intensity of a first edge in a predetermined first direction in the edge extraction image and an intensity of a second edge in a second direction orthogonal to the first direction in the edge extraction image, based on the intensity of the first edge and the intensity of the second edge, so as to reduce a degree of influence of one of the intensity of the first edge and the intensity of the second edge against the other; correcting the intensity of the first edge and the intensity of the second edge based on the correction coefficient; creating a plurality of corrected edge extraction images from the plurality of edge extraction images based on the intensity of the first edge and the intensity of the second edge which are corrected in the correcting; creating a single integrated image by integrating the brightness values at the same position of the inspection target object throughout the plurality of corrected edge extraction images; and dividing the integrated image into a plurality of sections and determining the presence or absence of unevenness on a surface of the inspection target object based on the brightness values for every divided section.
(53) The surface inspection method is not substantially different from the surface inspection apparatus and may exhibit the same effect as the surface inspection apparatus.
(54) The principles, preferred embodiment and mode of operation of the present invention have been described in the foregoing specification. However, the invention which is intended to be protected is not to be construed as limited to the particular embodiments disclosed. Further, the embodiments described herein are to be regarded as illustrative rather than restrictive. Variations and changes may be made by others, and equivalents employed, without departing from the spirit of the present invention. Accordingly, it is expressly intended that all such variations, changes and equivalents which fall within the spirit and scope of the present invention as defined in the claims, be embraced thereby.