Method for examining a value document, and means for carrying out the method

Abstract

There is described a method for examining a value document while employing a digital image of the value document which comprises pixels, wherein the image is examined for the presence of at least one irregularity relating to a pre-specified property of the value document, when such an irregularity is found an examination region representing the irregularity is fixed in dependence on the size and/or position and/or form of the irregularity in the image, and for checking the irregularity only a part of those pixels of the digital image that correspond to the examination region is employed.

Claims

1. A method for examining a value document while employing a digital image of the value document which comprises pixels, wherein the image is examined for the presence of at least one irregularity relating to a pre-specified property of the value document, when such an irregularity is found an examination region representing the irregularity is fixed in dependence on the size and/or position and/or form of the irregularity in the image, and the irregularity is checked, wherein of pixels of the digital image that correspond to the examination region only a part is employed in checking the irregularity, and wherein the part of the pixels of the digital image employed in checking the irregularity forms an image of the examination region that is reduced in its pixel resolution; and wherein the pixels of the digital image correspond to locations on a grid, and the part of the pixels that is employed upon checking lies on a subgrid of the grid, the subgrid having a pre-specified grid constant that is greater than that of the grid.

2. The method according to claim 1, wherein the pre-specified property of the value document is its form.

3. The method according to claim 1, wherein upon checking the irregularity only a part of those pixels that correspond to the examination region is employed only when the size of the examination region or the number of pixels that represent the examination region exceeds a pre-specified limiting value.

4. The method according to claim 1, wherein it is established upon checking the irregularity whether the irregularity corresponds to one of at least two possible value-document defects.

5. The method according to claim 1, wherein the digital image of the value document is captured while employing an optical sensor.

6. A computer program with program code upon whose execution by means of at least one processor a method according to claim 1 is executed.

7. A non-transitory computer readable medium on which a computer program according to claim 6 is stored.

8. An examination device for examining a value document having an optical sensor for capturing a digital image of the value document, and an evaluation device which is configured for carrying out a method according to claim 1 while employing a digital image captured by means of the optical sensor.

9. The examination device according to claim 8, wherein the evaluation device has at least one processor and a storage in which a computer program wherein the digital image of the value document is captured while employing an optical sensor is stored, so that upon execution of the program code of the computer program by means of the processor the a method for examining a value document is carried out while employing a digital image of the value document which comprises pixels, wherein the image is examined for the presence of at least one irregularity relating to a pre-specified property of the value document, when such an irregularity is found an examination region representing the irregularity is fixed in dependence on the size and/or position and/or form of the irregularity in the image, and the irregularity is checked, wherein only a part of those pixels of the digital image that correspond to the examination region is employed.

10. An apparatus for processing value documents having a feeding device for feeding single or singled value documents to be processed, an output device having at least one output portion for receiving processed value documents, a transport device for transporting single or singled value documents from the feeding device to the output device, and an examination apparatus according to claim 8, wherein the optical sensor of the examination device is configured and adapted for capturing a digital image of the value document while it is being transported by means of the transport device.

11. The method according to claim 1, wherein the at least one irregularity comprises a dog's-ear, a folded portion, or a detached portion.

12. The method according to claim 1, wherein the pixel resolution of the examination region is reduced by a pre-specified factor.

13. The method according to claim 1, wherein the examination region is fixed in dependence on a position of bending points along edges of the value document and the direction of portions of the edges that are separated by the bending points.

14. A method for examining a value document while employing a digital image of the value document which comprises pixels, wherein the image is examined for the presence of at least one irregularity relating to a pre-specified property of the value document, when such an irregularity is found an examination region representing the irregularity is fixed in dependence on the size and/or position and/or form of the irregularity in the image, and the irregularity is checked, wherein of pixels of the digital image that correspond to the examination region only a part is employed in checking the irregularity, wherein the irregularity is checked by a comparison of an intensity and location of the part of the pixels of the examination region with a threshold intensity determined from a reference region outside of the examination region, wherein the examination region is fixed in dependence on a position of bending points along edges of the value document and the direction of portions of the edges that are separated by the bending points.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The invention will hereinafter be explained further by way of example with reference to the drawings. There are shown:

(2) FIG. 1 a schematic view of a value-document processing apparatus in the form of a bank-note sorting apparatus,

(3) FIG. 2 a schematic representation of an image of a value document having a dog's-ear,

(4) FIG. 3 a simplified flowchart of a first embodiment of a method for examining value documents that is capable of being carried out by means of the apparatus in FIG. 1,

(5) FIG. 4 a schematic representation of a part of the image of the value document in FIG. 2 to illustrate steps of the method in FIG. 3,

(6) FIG. 5 a simplified flowchart of a step S16 of the method in FIG. 3,

(7) FIG. 6 a simplified flowchart of a second embodiment of a method for examining value documents that is capable of being carried out by means of the apparatus in FIG. 1, and

(8) FIG. 7A- 7B schematic representations of an image of a value document having a Z-fold in a view orthogonal to the area of the value document (A) and a view parallel to the area of the value document (B).

DETAILED DESCRIPTION OF VARIOUS EMBODIMENTS

(9) A value-document processing apparatus 10 in FIG. 1, in this example an apparatus for processing value documents 12 in the form of bank notes, is configured for sorting value documents in dependence on the recognition of the authenticity and the state of processed value documents. The hereinafter described components of the apparatus are arranged in a housing (not shown) of the apparatus or held on said housing, unless they are designated as external.

(10) The apparatus has a feeding device 14 for feeding value documents, an output device 16 for receiving processed, i.e. sorted, value documents, and a transport device 18 for transporting singled value documents from the feeding device 14 to the output device 16.

(11) The feeding device 14 comprises, in this example, an input pocket 20 for a value-document stack and a singler 22 for singling value documents out of the value-document stack in the input pocket 20 and for feeding the singled value documents to the transport device 18.

(12) The output device 16 has, in this example, three output portions 24, 25 and 26 into which processed value documents can be sorted, being sorted according to the result of the processing. In this example, each of the portions comprises a stack pocket and a stacking wheel (not shown) by means of which fed value documents can be deposited in the stack pocket. In other embodiment examples, one of the output portions can be replaced by a device for destroying bank notes.

(13) The transport device 18 has at least two, in this example three, branches 28, 29 and 30 at whose ends one of the output portions 24, 25, 26 is arranged in each case, and, at the branching points, gates 32 and 34, controllable by positioning signals, by means of which value documents are feedable to the branches 28 to 30 and thus to the output portions 24 to 26 in dependence on positioning signals.

(14) On a transport path 36, defined by the transport device 18, between the feeding device 14, in this example more precisely the singler 22, and the first gate 32 after the singler 22 in the transport direction, is arranged a sensor device 38 which measures physical properties of value documents while the value documents are being transported past and forms sensor signals rendering the measuring results. In this example, the sensor device 38 has three sensors, namely, an optical remission sensor 40 which captures a remission color image and a remission IR image of the value document, an optical transmission sensor 42 which captures a transmission image and a transmission IR image of the value document, and a transmission ultrasonic sensor 44 which captures or measures as an ultrasound property the ultrasound transmission of the value document in a spatially resolved manner, and will hereinafter only be designated as an ultrasonic sensor for simplicity's sake. The sensor signals formed by the sensors correspond to measuring data or raw data of the sensors which, depending on the sensor, may have already been subjected to a correction, for example in dependence on calibrating data and/or noise properties.

(15) For capturing and displaying operator control data, the value-document processing apparatus 10 has an input/output device 46. The input/output device 46 is realized in this example by a touch-sensitive display device (touch screen). In other exemplary embodiments it can comprise for example a keyboard and a display device, for example an LCD display.

(16) A control and evaluation device 48 is connected via signal connections to the sensor device 38, the input/output device 46 and the transport device 18, in particular the gates 32 and 34.

(17) The control and evaluation device 48 forms a data processing device and has, besides corresponding data interfaces (not shown in the figures) for the sensor device 38 or its sensors, a processor 50 and a storage 52 connected to the processor 50, in which at least one computer program with program code is stored. Upon execution of the computer program, the control and evaluation device 48 or the processor 50 evaluates the signals or measurement values of the sensor device 38 and controls the apparatus in accordance with the properties of the value documents. Thus, in its function as an evaluation device it can evaluate the sensor signals, in particular for establishing an authenticity class and/or a state class of a processed value document; in its function as a control device it can actuate the transport device 18 in accordance with the evaluation and optionally store the measuring data. In other embodiment examples, there can also be provided an evaluation device separate from the control device and connected via interfaces to the sensors of the sensor device 38, on the one hand, and the control device, on the other hand. The evaluation device is then configured for evaluating the sensor signals and delivers the respective result to the control device, which actuates the transport device. The hereinafter described evaluation operations can then be carried out solely by the evaluation device.

(18) Further, the control and evaluation device 48 actuates the input/output device 46, inter alia, to display operator-control data, and captures via said device operator-control data which correspond to an operator's inputs.

(19) During operation, value documents are singled out of the feeding device and transported past the sensor device 38 or therethrough. The sensor device 38 captures or measures physical properties of the value document respectively transported past or through it and forms sensor signals or measuring data which describe the measurement values for the physical properties. The control and evaluation device 48 classifies a value document into one of pre-specified authenticity and/or state classes in dependence on the sensor signals of the sensor device 38 for the value document and on classification parameters stored in the evaluation device, and so actuates the transport device 18, here more precisely the gates 32, 34, by emitting positioning signals, that the value document is outputted in accordance with its class established upon the classification into an output portion of the output device 16 that is associated with said class. The association with one of the pre-specified authenticity classes, or the classification, is effected here in dependence on at least one pre-specified authenticity criterion.

(20) For checking value documents in the way described more precisely hereinafter, there are employed in particular transmission images captured by the transmission sensor 42. The transmission sensor 42 has an illumination portion by means of which a pre-specified capture region of the transport path can be illuminated with optical radiation in the visible and in a pre-specified infrared wavelength region. On the opposing side of the transport path 18 the transmission sensor 42 has a detection device for spatially resolved capture of an image in the wavelength region of visible light and of an infrared transmission image in the pre-specified infrared wavelength region.

(21) The transmission sensor 42 is configured as a line sensor which, during transport of the value document through the sensor, successively captures transmission line images of strips of the value document that extend transversely to the transport direction of the value document. Accordingly, the detection device comprises detector rows. The transmission sensor 42 joins together the captured line images into digital transmission images which comprise pixels whose properties are described by pixel data. In particular, it captures a digital transmission image of the value document while forming pixel data describing the pixels of the image, and transfers them to the evaluation device 48. The pixel data for a pixel describe in particular a lightness which describes the intensity received by the detection device for the pixel. The transmission sensor is so configured that the pixels respectively correspond to locations on a square grid. The length of the edges of a square amounts in this embodiment example to about 0.2 mm, so that the resolution amounts to about 125 dpi. Schematically and for better illustration, there is shown in FIG. 2 such a digital image of a value document 12 in which the pixels 56 are marked by black squares or dots at their center.

(22) In the hereinafter described method for examining a value document as illustrated in FIG. 3, it will be assumed that the value documents being checked should have a rectangular form, i.e. are of a value-document type that is characterized, inter alia, by a rectangular form of the value documents. The image in FIG. 2 shows an irregularity relating to a pre-specified property of the value document, namely its form. More precisely, the upper left corner 58 in FIG. 2 seems to be missing, which can be due to a dog's-ear or to the corner having been torn off and now being gone.

(23) For carrying out the method there is stored in the storage 52 a computer program with program code upon whose execution by means of the processor 50 the hereinafter described method is executed. The control and evaluation device 48 hence represents in particular also an evaluation device as intended by the present invention and, in combination with the transmission sensor 44, an examination device as intended by the present invention.

(24) For examining a value document, there is first captured in step S10 by means of the sensor device 38, more precisely the transmission sensor 42, a transmission image of the value document which, as explained above, comprises pixel whose lightness values are given by corresponding pixel data.

(25) In step S12 the image is examined as to whether an irregularity relating to a pre-specified property of the value document is present. In this embodiment example, the form is employed as the pre-specified property of the value document. More precisely, the property checked is that the form of the value document in the image must be a complete rectangle having four corners. For this purpose, there can first be established the smallest rectangle in which there are pixels with a lightness that differ from pixels representing the background in accordance with a pre-specified threshold value specific to the background without a value document.

(26) It can then be established for each of the corners of the rectangle whether it represents an irregularity. For this purpose, a search can be done for column portions of pixels that extend parallel to a first one of the sides and that have consecutive pixels with a lightness that correspond to the background beginning with the rectangle's second side orthogonal to said first side and forming the corner of the rectangle. In FIG. 2 such column portions can extend for example approximately vertically. Such column portions can be searched for beginning at the respective first side of the rectangle and in a direction away from the first side. The column portions must have a minimum number of pixels that is given by the noise behavior of the sensor and the resolution; when fewer pixels are found, the search for column portions is discontinued.

(27) The length of a found column portion adjacent to the first side and the position of the last found column portion having a pre-specified number of consecutive pixels with a lightness corresponding to the background along the second side define a rectangle that represents an irregularity. The corner of the rectangle and the end of the first column as well as the position of the last column fix a triangle which corresponds to a missing corner in the image of the value document.

(28) If no irregularities are found for any of the corners, a signal is formed that displays that no irregularities on the corners are present. The method is then continued with step S18 in which the result that no irregularity relating to form was found is employed.

(29) Otherwise, the following steps are carried out for each of the corners for which an irregularity was established. In FIG. 3 is represented only the case that only one corner was found.

(30) In step S14 the evaluation device 48 fixes an examination region 60 (cf. FIG. 4) in dependence on at least one property of the found irregularity. More precisely, it fixes the examination region of the size, position and form of the found irregularity. In FIG. 3 the examination region 60 is marked by dashed lines. The examination region 60 is determined as follows. A first triangle is defined by the missing corner, given by the corresponding corner 62 of the smallest rectangle employed in step S12, and the bending points 64 and 66 at which the contour of the value document in the image bends at its edges. The examination region 60 is then the triangle that results by mirroring the first triangle on the connection line between the bending points 64 and 66.

(31) In step S16 the evaluation device checks the irregularity while employing only a part of the pixels that corresponds to the examination region. In this embodiment example, the resolution of the digital image is lowered by a pre-specified factor, in the example the factor 2, so that the part of the pixels of the digital image forms an image of the examination region that is reduced in its resolution. As illustrated in FIG. 4, this happens as follows: In the original image in FIG. 2 the pixels 56 or the locations corresponding to the pixels are arranged on a square grid. The part of the pixels that is only employed for checking the irregularity corresponds to locations in the examination region that lie on a square grid whose squares have an edge length that is twice as great as that of the squares of the grid for the captured image. One of said pixels is marked in FIG. 4 by the reference sign 70.

(32) In the present case, the evaluation device 48 establishes upon checking the irregularity whether the irregularity corresponds to one of at least two possible value-document defects; in the present example the value-document defects yielding a similar irregularity in the image are the presence of a dog's-ear and the lack of the corner, for example because it was torn off

(33) The step S16 comprises substeps S16.1 to S16.3 which are illustrated in FIG. 5.

(34) A dog's-ear is characterized in that two layers of the value document lie one over the other in the folded-down region and hence the transmission in this region is strongly reduced. With a torn-off corner, in contrast, the lightness in the imaged part of the value document should correspond to that of the undamaged value document.

(35) In step S16.1 a threshold value is hence established for the further examination, said value corresponding to the average lightness of a pre-specified reference region 68 of the value document without holes or folds. As a threshold value there can be employed in particular the arithmetic average over the lightnesses of the pixels in the reference region. In the present example there is chosen as a reference region 68 a rectangle near the examination region 60, in which the lightness averaged over the pixels should correspond to that of the value document without folds.

(36) In step S16.2 the evaluation device establishes the number of those pixels of the part of the pixels in the examination region that are assumed to be too dark. In the present example, it establishes for this purpose a histogram which renders the frequency of pixels that are too dark, i.e. pixels with a lightness below the threshold value, in the examination region as a function of the distance from the corner of the rectangle. For this purpose, the distance of the mirrored corner point from the corner point is established. This is understood to be the radius of a greatest circle. The interval between 0 and said distance is divided into a pre-specified number of equally long subintervals. The interval limits then correspond to radii of concentric circles around the corner point of the rectangle. Altogether a kind of ring structure results.

(37) For each pixel to be examined in the examination region it is now established in which subinterval the distance of the pixel from the corner point of the rectangle lies and whether the lightness value undershoots the pre-specified threshold value. If the lightness value lies below the threshold value, a counter is increased by 1.

(38) The evaluation device 48 compares the thus obtained histogram with a reference histogram. The reference histogram has the same number of bins as the established histogram and is pre-specified in dependence on the employed resolution of the examination region and the noise behavior of the employed sensors. For all bins or subintervals the number of pixels that are too dark in the established histogram is compared bin by bin with the number in the reference histogram. If the pixel number for the respective bin of the established histogram is greater than the corresponding number in the reference histogram, a total counter is increased. The total counter is then so scaled that it corresponds to a share of the total number of examined pixels, i.e. pixels in the examination region. The total counter is the relative number of pixels that are too dark with regard to the threshold value and the reference histogram.

(39) In step S16.3 the evaluation device establishes in dependence on the established number whether the irregularity corresponds to a dog's-ear or a torn-off corner. For this purpose, it checks whether the relative number of pixels that are too dark exceeds a pre-specified limiting value. If this is the case, the presence of a dog's-ear is ascertained. Otherwise, the presence of a torn-off corner is ascertained.

(40) The method is then continued with step S18 in which the result is employed, for example in order to establish the bank note's fitness for circulation.

(41) A second embodiment example differs from the first embodiment example in that upon checking the irregularity only a part of the pixels of the examination region is only employed when the area of the examination region or the number of pixels therein exceeds a corresponding pre-specified limiting value. Otherwise, all pixels are employed.

(42) The method very schematically illustrated in FIG. 6 differs from the first embodiment example only by the steps S20 and S22, while the other steps are unchanged.

(43) In the step S20 following step S14 the evaluation device 48 establishes an area of the examination region established in step S14 and compares it with a corresponding pre-specified limiting value for the area. In other embodiment examples, the evaluation device 48 can establish, instead of the area of the examination region 60, the number of pixels corresponding to the examination region and establish it with a corresponding limiting value for the pixel number. The limiting value here is pre-specified in dependence on the computing speed of the evaluation device and the time available for carrying out the method, and is stored in the evaluation device 48.

(44) If the established area (or number) exceeds the limiting value, the method is continued as in the first embodiment example with the unchanged step S16.

(45) Otherwise, the evaluation device 48 executes a method step S22 which differs from the step S16 solely in that now all pixels corresponding to the examination region 60 are employed, and not only a part.

(46) A further embodiment example differs from the first embodiment example in that for checking the irregularity no histogram is employed as in the first embodiment example, but rather only the number of dark pixels in relation to the number of employed pixels of the image of the examination region that is reduced in resolution.

(47) A further embodiment example differs from the preceding embodiment example in that only a check for an irregularity in the form of a Z-fold is carried out. This is illustrated in FIG. 7. The subpicture A shows a view of the area of the value document, the subpicture B a view parallel to the area of the value document or of the edge. A Z-fold is understood to mean that the value document is first folded back in a direction transverse to one of its edges along a line 72 and then folded forward along a further line 74 extending parallel to the line 72 or at an acute angle thereto. The irregularity could be due here to a Z-fold or an adhesive strip.

(48) Here, too, an examination region 76 can be established in dependence on the position of bending points along the edges of the value document and the direction of the edges' portions that are separated by the bending points. The contour of said examination region 76 is shown by dashed lines in FIG. 7. The examination region can be given for example by a polygon whose corners the bending points 78, 80 along the edge that extends convexly and the intersection points 78 and 80 of the contour of the value document in the image and of straight lines through the bending points 78 and 80 that extend orthogonally to the edge portions, on whose extension the bending points lie.

(49) In other embodiment examples, a color remission image can be employed, in which case the pixel data comprise color coordinates for the color of each pixel.