Systems, methods, and computer programs for imaging an object and generating a measure of authenticity of the object
10699506 · 2020-06-30
Assignee
Inventors
- Jean-Luc DORIER (Bussigny, CH)
- Xavier-Cédric Raemy (Belmont-sur-Lausanne, CH)
- Todor DINOEV (Chavannes-près-Renens, CH)
- Edmund HALASZ (Orbe, CH)
Cpc classification
G01N21/31
PHYSICS
International classification
G01J3/40
PHYSICS
Abstract
An imaging system (200) for imaging and generating a measure of authenticity of an object (10) comprises a dispersive imaging arrangement (30) and an image sensor arrangement (60). They are positioned so that, when electromagnetic radiation (20) from the object (10) illuminates the dispersive imaging arrangement (30), the radiation splits out in different directions into at least a non-dispersed part (40) and a dispersed part (50), and those are imaged by the image sensor arrangement (60). The imaging system (200) is configured to then generate a measure of authenticity of the object (10) depending at least on a relation between the imaged dispersed part, the imaged non-dispersed part, and reference spectral information. The invention also relates to imaging methods, computer programs, computer program products, and storage mediums.
Claims
1. An imaging system for imaging an object and generating a measure of authenticity of the object, the imaging system comprising: an image sensor arrangement having one or more image sensors; and a dispersive imaging arrangement having one or more optical elements, wherein the dispersive imaging arrangement is so that, when electromagnetic radiation from the object illuminates the dispersive imaging arrangement, at least part of the electromagnetic radiation splits out in different directions into at least a non-dispersed part and a dispersed part; and positioned relative to the image sensor arrangement in such a manner as to allow the image sensor arrangement to image said non-dispersed part in a first portion of the image sensor arrangement, so as to obtain a non-dispersed image, and said dispersed part in a second portion of the image sensor arrangement, so as to obtain a dispersed image; the imaging system being configured for, after the image sensor arrangement has, in at least one imaging period, imaged the non-dispersed part and the dispersed part, generating a measure of authenticity of the object depending at least on a relation between the imaged dispersed part, the imaged non-dispersed part, and reference spectral information, wherein the generating of the measure of authenticity comprises one of: computing a synthetic image by deconvolving the imaged dispersed part by the imaged non-dispersed part, and determining the extent to which the synthetic image corresponds to the reference spectral information; computing a synthetic image by deconvolving the imaged dispersed part by the reference spectral information, and determining the extent to which the synthetic image corresponds to the imaged non-dispersed part; and computing a synthetic image by convolving the imaged non-dispersed part and the reference spectral information, and determining the extent to which the synthetic image corresponds to the imaged dispersed part.
2. The imaging system according to claim 1, wherein the dispersive imaging arrangement comprises at least one of: a diffractive element, a transmission diffraction grating, a blazed transmission diffraction grating, a volume holographic grating, a reflective diffraction grating, an arrangement comprising a beam splitter and a diffraction grating, and an arrangement comprising a beam splitter and a dispersive prism.
3. The imaging system according to claim 1, for imaging an object bearing a marking.
4. The imaging system of claim 3, wherein generating the measure of authenticity further comprises decoding a code from the marking within the imaged non-dispersed part and verifying the authenticity of the code.
5. The imaging system of claim 3, wherein the marking comprises at least one machine readable code.
6. An imaging method for imaging an object and generating a measure of authenticity of the object, the imaging method making use of: an image sensor arrangement having one or more image sensors; and a dispersive imaging arrangement having one or more optical elements, wherein the dispersive imaging arrangement is so that, when electromagnetic radiation from the object illuminates the dispersive imaging arrangement, at least part of the electromagnetic radiation splits out in different directions into at least a non-dispersed part and a dispersed part; and positioned relative to the image sensor arrangement in such a manner as to allow the image sensor arrangement to image said non-dispersed part in a first portion of the image sensor arrangement, so as to obtain a non-dispersed image, and said dispersed part in a second portion of the image sensor arrangement, so as to obtain a non-dispersed image; and the imaging method comprising: imaging, by the image sensor arrangement, in at least one imaging period, the non-dispersed part and the dispersed part, and generating a measure of authenticity of the object depending at least on a relation between the imaged dispersed part, the imaged non-dispersed part, and reference spectral information, wherein the generating of the measure of authenticity comprises one of: computing a synthetic image by deconvolving the imaged dispersed part by the imaged non-dispersed part, and determining the extent to which the synthetic image corresponds to the reference spectral information; computing a synthetic image by deconvolving the imaged dispersed part by the reference spectral information, and determining the extent to which the synthetic image corresponds to the imaged non-dispersed part; and computing a synthetic image by convolving the imaged non-dispersed part and the reference spectral information, and determining the extent to which the synthetic image corresponds to the imaged dispersed part.
7. The imaging method according to claim 6, comprising imaging, by the image sensor arrangement, in a plurality of illumination periods, the non-dispersed part and the dispersed part, wherein generating the measure of authenticity comprises: generating, for each illumination period, an intermediate measure of authenticity depending at least on a relation between the dispersed part imaged at the illumination period, the imaged non-dispersed part at the illumination period, and a part of the reference spectral information, said part of the reference spectral information being associated with how the object has been illuminated during the illumination period; and generating the measure of authenticity based on the plurality of generated intermediate measures of authenticity.
8. The imaging method according to claim 6, comprising imaging, by the image sensor arrangement, in a plurality of illumination periods, the non-dispersed part and the dispersed part, wherein generating the measure of authenticity comprises: processing the imaged non-dispersed part based at least on the non-dispersed part imaged at a first illumination period among the plurality of illumination periods and the non-dispersed part imaged at a second illumination period among the plurality of illumination periods, wherein the illumination conditions during the first illumination period at least partially differ from the illumination conditions during the second illumination period; processing the imaged dispersed part based at least on the dispersed part imaged at the first illumination period and the dispersed part imaged at the second illumination period; and generating the measure of authenticity depending at least on a relation between the processed imaged dispersed part, the processed imaged non-dispersed part, and the reference spectral information.
9. The imaging method according to claim 6, for imaging an object bearing a marking.
10. The imaging method of claim 9, wherein generating the measure of authenticity further comprises decoding a code from the marking within the imaged non-dispersed part and verifying the authenticity of the code.
11. The imaging method according to claim 6, further comprising a step of controlled illumination of the object.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Embodiments of the present invention shall now be described, in conjunction with the appended figures, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
(24)
(25)
(26)
(27)
(28)
(29)
(30)
(31)
(32)
DETAILED DESCRIPTION
(33) The present invention shall now be described in conjunction with specific embodiments. These specific embodiments serve to provide the skilled person with a better understanding, but are not intended to restrict the scope of the invention, which is defined by the appended claims. A list of abbreviations and their meaning is provided at the end of the detailed description.
(34)
(35) System 200 comprises an arrangement 60, hereinafter referred to as image sensor arrangement 60, consisting in one or more image sensors. System 200 also comprises another arrangement 30, hereinafter referred to as dispersive imaging arrangement 30, consisting in one or more optical elements.
(36) In one embodiment, image sensor arrangement 60 comprises one or more array CCD or CMOS detectors to record the intensity distribution of the incident electromagnetic energy. Dispersive imaging arrangement 30 not only disperses electromagnetic energy but may also gather electromagnetic energy from object 10 and focus the electromagnetic energy rays to produce an image of object 10 onto an image plane where image sensor arrangement 60 is positioned. In one embodiment, dispersive imaging arrangement 30 comprises, on the one hand, at least one of a diffractive element, a refractive element, one or more lenses, and an objective, in order to produce an image of object 10 onto the image plane where image sensor arrangement 60 is positioned, and, on the other hand, a long pass filter (also called long-wavelength pass filter) in order to limit the spectral range used for authentication.
(37) System 200 may also comprise optionally various auxiliary elements (not shown in
(38) Dispersive imaging arrangement 30 is constituted and positioned so that, when electromagnetic radiation 20 from object 10 illuminates arrangement 30 or in particular a specific part, surface, side, aperture, or opening thereof, at least part of radiation 20 splits out in different directions into at least a non-dispersed part 40 and a dispersed part 50. The word dispersive means here: that separates in its constituent wavelength components. Arrangement 30 may for example comprise: a diffractive element, a transmission diffraction grating (also known simply as transmission grating, or rarely as transmissive diffraction grating), a blazed transmission diffraction grating, a volume holographic grating, a grism (also called grating prism), a reflective diffraction grating, an arrangement comprising a beam splitter and a diffraction grating, an arrangement comprising a beam splitter and a dispersive prism, or a combination of any of those. If arrangement 30 diffracts radiation 20, non-dispersed part 40 may be referred to as the zero diffraction order part of the radiation, and dispersed part 50 may be referred to as a non-zero diffraction order part, such as for example the negative or positive first diffraction order part of the radiation.
(39) Here are some examples of transmission gratings that may be used in some embodiments of the invention: Example 1: Especially for a transmission grating mounted in front of an objective (see also in that respect
(40) Electromagnetic radiation 20 coming from object 10 and illuminating dispersive imaging arrangement 30 may originate in part or in full from the reflection of electromagnetic radiation emitted by an electromagnetic radiation source (not shown in
(41) Electromagnetic radiation 20 coming from object 10 usually contains radiation of more than one wavelength, especially when object 10 is authentic. That is, radiation 20 is usually polychromatic in the broad sense of the term, i.e. not necessarily limited to visible colours. Radiation 20 may for example be in any wavelength range encompassed between 180 nm (UV radiation) and 2500 nm (infrared radiation), i.e. in the visible light range and/or outside that range (for example in the near-infrared (NIR) or short-wavelength infrared (SWIR) range). The portion of radiation 20 reaching dispersive imaging arrangement 30 that is actually dispersed may depend on the characteristics of the optical element(s) forming arrangement 30. For example, long pass filter may be used to select the spectral range to be analysed.
(42) Furthermore, dispersive imaging arrangement 30 is positioned relative to image sensor arrangement 60 in such a manner as to allow arrangement 60 to simultaneously image in one imaging period (as illustrated by
(43) An example of image sensor that may be used in some embodiments of the invention is: a 1/3-Inch Wide-VGA CMOS Digital Image Sensor MT9V022 from ON Semiconductor, based in Phoenix, Ariz., U.S. That sensor has 752-by-480 pixels with size 6 m forming active imager size with dimensions of 4.51 mm2.88 mm and diagonal of 5.35 mm.
(44) An imaging period is here defined as being: a) if non-dispersed part 40 and dispersed part 50 are simultaneously acquired by image sensor arrangement 60, the period during which both non-dispersed part 40 and dispersed part 50 are acquired (as illustrated by
(45) In one embodiment, each or at least one imaging period has a duration having a value selected from the range of 5 to 1200 ms, and preferably selected from the range of 10 to 800 ms, such as for example 10, 20, 30, 50, 75, 100, 150, 200, or 300 ms.
(46) In one embodiment, the duration of the imaging period for imaging non-dispersed part 40 and the duration of the imaging period for imaging dispersed part 50 differ from each other. This embodiment may be advantageous in particular when using diffraction gratings having different efficiencies for the zero- and first-order. For example, the duration of the imaging period for imaging non-dispersed part 40 may be 10 ms, whereas the duration of the imaging period for imaging dispersed part 50 may be 100 ms.
(47) An illumination period (as illustrated by
(48) In one embodiment, the first and second portions of image sensor arrangement 60 are on two different image sensors of arrangement 60. When using two image sensors for imaging non-dispersed and dispersed parts 40, 50 their relative positioning has to be taken into account.
(49) In another embodiment, the first and second portions of arrangement 60 are two different portions of a single image sensor. In other words, in this embodiment, non-dispersed and dispersed parts 40, 50 may be captured in a single frame.
(50) The configuration (geometry, parameters, etc.) of the optical elements of dispersive imaging arrangement 60 allows the separation of dispersed part 50 from non-dispersed part 40 from within the single frame. Shorter wavelengths are less deflected than longer wavelengths. In one embodiment, system 200 is configured to avoid overlapping of first-order image at the shortest wavelength with the zero-order image (see also
(51) The portion of electromagnetic radiation 20 illuminating and passing through dispersive imaging arrangement 30 (therefore being dispersed in one set of directions and being non-dispersed in another set of directions) that is then actually detected by image sensor arrangement 60 depends on the characteristics of its image sensor(s). The electromagnetic radiation detected by the image sensor(s) may for example be in any wavelength range encompassed between 180 nm (UV radiation) and 2500 nm (infrared radiation), i.e. in the visible light range and/or outside that range (for example in the near-infrared (NIR) or short-wavelength infrared (SWIR) range). In that example, the lower limit of 180 nm may be imposed by material constraints of both dispersive imaging arrangement 30 and image sensor(s) 60, whereas the upper limit of 2500 nm may for example be imposed by the spectral response of indium gallium arsenide-based (GalnAs) infrared detectors. In one embodiment, the electromagnetic radiation detected by image sensor(s) 60 is in the range of visible light. In one embodiment, the electromagnetic radiation detected by image sensor(s) 60 is in the wavelength range of 180 nm to 2500 nm, more preferably in the range of 400 nm to 1000 nm.
(52) Yet furthermore, imaging system 200 is configured for, after image sensor arrangement 60 has imaged non-dispersed part 40 and dispersed part 50 in at least one imaging period, generating a measure of authenticity of object 10 depending at least on a relation between the imaged dispersed part, the imaged non-dispersed part, and reference spectral information. System 200 thus enables the verification of whether, and/or the extent to which, the relation between the imaged dispersed part, the imaged non-dispersed part, and the reference spectral information, which represents the expected spectral composition of electromagnetic radiation 20 coming from object 10, is in accordance with the expected underlying physics of the system. If so, object 10 is likely to be authentic. Otherwise, it is more likely to be a counterfeit. System 200 thus enables a form of material-based authentication, such as for example at least one of: a) material-based authentication of the ink used to create a mark printed on object 10, and b) material-based authentication of object 10 itself especially if object 10 is luminescing with a specific emission spectrum or has a specific reflection or absorption spectrum.
(53) The nature of the relation that is looked at, i.e. the relation between the imaged dispersed part, the imaged non-dispersed part, and the reference spectral information, may be understood in the sense that, if the reference spectral information corresponds or substantially corresponds to the spectral composition of electromagnetic radiation 20 coming from imaged object 10, the imaged dispersed part typically resembles (non-linear effects may also need to be taken into account) the result of the convolution of the imaged non-dispersed part with the reference spectral information, in which case object 10 is likely to be authentic. In contrast, if the reference spectral information does not correspond to the spectral composition of radiation 20 coming from imaged object 10, the imaged dispersed part typically noticeably differs from the result of the convolution of the imaged non-dispersed part with the reference spectral information, in which case object 10 is likely to be a counterfeit.
(54) More generally, the nature of the relation that is looked at, i.e. the relation between the imaged dispersed part, the imaged non-dispersed part, and the reference spectral information, may also significantly differ from a mere convolution, considering the existence of non-linear effects. The nature of the relation may be determined a) based on the underlying physics and geometry, b) empirically, and/or c) by simulation (for example, using raytracing methods of commercially available solutions, such as e.g. Zemax optical design program, available from Zemax, LLC, based in Redmond, Wash., U.S.).
(55) The underlying physics and geometry may include (i) the properties of dispersive imaging arrangement 30, image sensor arrangement 60, the transmission medium in between, etc., and (ii) effects of stretch of the image (zero- or first-order) in the direction of the dispersion (y axis), which may be compensated for by mapping of the y axis of the image (zero- or first-order) to a new y axis using a non-linear function. The image may be stretched due to 1) non-linear dispersion of the grating, 2) projection distortions (with different paths from arrangement 30 to arrangement 60), and/or 3) optics-specific field aberrations (as lenses may distort slightly differently the zero- and first-order).
(56) The non-linear effects may also, in one embodiment, be modelled as a relation between the dispersed and non-dispersed images and the reference spectrum in a form being as close to linear translation-invariant (LTI) as possible. In such a case, the determination of the non-linear effects may be performed for example by a) acquiring several zero- and first-order images of objects 10 with a known reference spectrum, and b) fitting the non-linear parameters to transform the relation to LTI.
(57) One way to determine the non-linear effects, and therefore the nature of the relation to be looked at, may be a mathematical analysis of the optical system and determination of the correction that has to or should be applied to make the system LTI. This may be done using optical equations found for example in textbooks such as Yakov G. Sosking, Field Guide to Diffractive Optics, SPIE, 2011. This may also be done numerically using optical software such as for example Zemax OpticStudio, available from Zemax, LLC.
(58) In one embodiment, dispersive imaging arrangement 30 diffracts electromagnetic radiation 20 using a diffraction grating, and the imaged non-dispersed part is the image in zero diffraction order of the diffraction grating, whereas the imaged dispersed part is the image in a first diffraction order of the diffraction grating. An average spectral irradiance of a region of the image may be reconstructed using the imaged non-dispersed and dispersed parts, and then the average spectral irradiance may be compared to the expected spectral irradiance (the reference spectral information). In one embodiment, the grooves profiles of the diffraction grating (e.g. blaze angle) are optimized to spread most of the input electromagnetic radiation into these two orders.
(59) In one embodiment, generating a measure of authenticity of object 10 comprises authenticating it, i.e. determining that it is likely to be authentic or not. In one embodiment, generating a measure of authenticity of object 10 comprises generating an authenticity measure (or index) such as for example a real value between 0 and 1, wherein 0 may mean fully sure that the object is not authentic and 1 may mean fully sure that the object is authentic.
(60) In practice, the authentication index typically does not reach the value 1 for all authentic objects (and 0 for all non-authentic ones). Hence, in one embodiment, a threshold between 0 and 1 is defined (for example a value comprised between 0.80 and 0.90, and in particular 0.85) above which the object is considered as authentic, and below which the object is considered as non-authentic. This threshold may for example be defined through measurements on a set of authentic and non-authentic objects. These measurements typically produce a bi-modal distribution of indexes (i.e., one part for the authentic objects concentrated towards the value 1 and one part for the non-authentic ones below, both separated by a gap). The robustness of the method is directly related to the extent to which the two parts (modes) of the index distribution are distant from one another. The threshold may then be placed in between either close to the index distribution of the authentic objects to minimize false positives or closer to the non-authentic index distribution to minimize false negatives.
(61) If object 10 is, for example, a container or package containing some goods, the generated measure of authenticity may merely amount to a measure of authenticity of the goods determined through a mark or sign existing on the container or package (assuming that the container or package has not been tampered with), not necessarily directly enabling to authenticate the goods as such.
(62) Since non-dispersed and dispersed parts 40, 50 of the electromagnetic radiation may be imaged in one imaging period, and since the imaging enables the determination of the spectral composition of incident electromagnetic radiation 20, imaging system 200 may be regarded as a form of snapshot spectral imager in the sense that the scene is not scanned during the imaging process. However, system 200 does not enable or at least does not necessarily enable obtaining the spectral composition, i.e. irradiance, of each point (x, y) of the scene, which is as such not necessary for authentication provided that there is a dominant spectral response in the image.
(63)
(64) Illumination arrangement 210 generates electromagnetic radiation 21 for illuminating object 10. In one embodiment, radiation 21 has known parameters (e.g., spectrum, power, homogeneity, etc.) to allow excitation of e.g. luminescence emission spectra to allow imaging of object 10 and/or mark thereon and analysing the emission spectra for authentication. As explained above with reference to
(65) In one embodiment, system 220 is connected to driving electronics and sensor reading electronics, so that, for example, image data outputted by imaging system 200 may be transferred to a processing unit for data treatment.
(66)
(67)
(68) Arrangement 30 of
(69) In arrangement 30 of
(70) In the embodiment of
(71)
(72) In
(73) Imaging system 200 receives electromagnetic energy 20 originating from object 10 to create a non-dispersed image 41 of object 10 onto image plane 65. Non-dispersed part 40 is produced by arrangement 30 in the same or similar way as an ordinary, non-dispersive imaging arrangement consisting merely of a lens.
(74) The dispersed part is shifted compared to the non-dispersed part and is blurred by the spectrum of electromagnetic energy 20 impinging arrangement 30. The minimum shift depends on the minimum wavelength present in the spectrum emitted by object 10 or depends on the minimum wavelength transmitted through arrangement 30. The minimum shift may also depend on some grating and system parameters (e.g. grooves density, order, and incident angle) which parameters define the angular dispersion of the grating.
(75) The three discrete dispersed images of mark on
(76)
(77) Image 51 corresponds to the minimum wavelength .sub.min that can be transmitted by the system and defined by a cut-on wavelength of a long pass filter of arrangement 30. Reference 62 shows the order separation, which, in one embodiment, corresponds to the size of image 41 of area 12. In one embodiment, arrangement 30 enables this order separation for the minimum wavelength .sub.min so as to efficiently authenticate object 10.
(78) In one embodiment, illumination arrangement 210 (not illustrated on
(79)
(80) In one embodiment, the imaging device making up imaging system 200 of
(81)
(82)
(83)
(84) In one embodiment, imaging device 100 of any one of
(85) In one embodiment, processing unit 70 of any one of
(86) In some embodiments, the imaging device making up imaging system 200 of
(87) In one embodiment, the imaging device making up imaging system 200 of
(88)
(89) If imaging step s300 consists in imaging non-dispersed part 40 and dispersed part 50 in a single illumination period, step s300 precedes generating step s400, usually without overlap. However, if step s300 consists in imaging non-dispersed part 40 and dispersed part 50 in a plurality of illumination periods (typically under different illumination conditions), imaging step s300 and generating step s400 may overlap (not shown in
(90) In particular, in a first sub-embodiment, illustrated by the flowchart of
(91) In a second sub-embodiment, illustrated by the flowchart of
(92) In a third sub-embodiment, illustrated by the flowchart of
(93) A possible implementation of step s400 in this third sub-embodiment may be described as follows:
(94) In step s450, a synthetic first diffraction order image is computed by convolving the known spectral signature of the authentic ink (i.e., the reference spectral information) with the zero-order image (i.e., the imaged non-dispersed part). Then, in step s460, a cross-correlation between the acquired first-order image (i.e., the imaged dispersed part) and the synthetic first-order image (i.e., the result of step s450) is used to compare them and generate a similarity parameter. This correlation may be performed not only on the images but also the first and second derivatives of the images to output three similarity parameters. Then, a decision is made by for example applying classifiers based on machine learning algorithms on the similarity parameter sets to authenticate mark on object 10.
(95) A convolution might, however, not always lead to the best results due to the existence of non-linear effects (as discussed above). Thus, in one embodiment of the invention, rather than carrying out a convolution in step s450, a model or function may be used, which may be determined in advance using instrument calibration data, measurements, modelling or a combination thereof. The model or function is a computation model for computing a synthetic first-order image (i.e., a synthetic dispersed part) from a given zero-order image (i.e., the imaged non-dispersed part) and a known spectrum (i.e., the reference spectral information). Similar considerations apply to deconvolving steps s410 and s430, which may be replaced by other models or functions.
(96) In order to carry out the comparison part of step s460 in this implementation, the acquired first-order image (i.e., the imaged dispersed part) and the synthetic first-order image (i.e., the output of step s450) are compared, and one or several matching similarity values are computed.
(97) In one embodiment, the matching value is the cross-correlation value of the two images, i.e. the acquired first-order image and synthetic first-order image. In another embodiment, the matching value is the cross-correlation value of the derivative of the two images. In a further embodiment, the matching value is the cross-correlation value of the second derivative of the two images. In yet another embodiment, more than one matching values are extracted from a combination of the previously proposed matching values. The computations may take place on the entire first-order images, or on a subset of it (region of interest). In one embodiment, the first-order image region of interest is the boundary box of the authentication mark. The boundary box is the smallest convex shape that contains the authentication mark. In another embodiment, an additional set of correlation values is computed based on the so-called DIBS images. The DIBS technique and the meaning of the DIBS images will be apparent from the explanations provided below with reference to
(98) In order to carry out the decision part of step s460 in this implementation, a decision algorithm is used to classify a measured sample into at least two categories: genuine or fake. Known machine learning algorithms may be used for that purpose, such as: support vector machine (SVM), decision trees, K-nearest neighbors algorithm (KNN), etc. In one embodiment, the learning features are the above-described similarity matching values. In one embodiment, other learning features are used, which are not related to cross-correlations such as for example the standard deviation of the pixel values (i.e., intensity values) of the first-order image, or the standard deviation of the pixel values of the zero-order image.
(99) In one embodiment, the standard deviation values and several sets of similarity matching values from images obtained under different excitation wavelengths (e.g. red, green or blue LED) are used. For example, one set of learning features used to describe one sample may be as shown in the following table:
(100) TABLE-US-00001 Feature 1 Value of the correlation of the acquired first-order image with the synthetic first-order image when illuminated by a blue LED Feature 2 Value of the correlation of the first derivative of the acquired first-order image with the first derivative of the synthetic first-order image when illuminated by a blue LED Feature 3 Value of the correlation of the second derivative of the acquired first-order image with the second derivative of the synthetic first-order image when illuminated by a blue LED Feature 4 Value of the correlation of the acquired first-order image with the synthetic first-order image when illuminated by a green LED Feature 5 Value of the correlation of the first derivative of the acquired first-order image with the first derivative of the synthetic first-order image when illuminated by a green LED Feature 6 Value of the correlation of the second derivative of the acquired first-order image with the second derivative of the synthetic first-order image when illuminated by a green LED Feature 7 Value of the standard deviation of the acquired first-order image when illuminated by a blue LED Feature 8 Value of the standard deviation of the acquired first-order image when illuminated by a green LED
(101) In one embodiment, the classifier may be trained in advance on a heterogeneous dataset consisting of randomized genuine samples and non-genuine samples.
(102) During the decision phase of the method, the classifier may classify the given samples using the features input into the classifier.
(103) The above-referred possible implementation of step s400 in the third sub-embodiment has been tested using classification algorithms (in that respect see for example: David Barber, Bayesian Reasoning and Machine Learning, Cambridge University Press 2011) as described in the following table:
(104) TABLE-US-00002 Learning The used features were the correlation value, first features derivative correlation value, second derivative correlation value, all three for blue and green LED excitation, correlation of DIBS values (as discussed below), and first- order standard deviation. Training A KNN classifier was trained on 340 samples (130 genuine and 210 non-genuine). Results When tested against a separate test set of 175 images consisting of never-seen-before backgrounds and codes, the classification accuracy was: 94.29% with 10 false positive and 0 false negative.
(105) Compared with imaging spectrometers used for scientific observations, the approach in the embodiments described with reference to
(106) In one embodiment, the convolution or deconvolution operation(s) of step s400 are performed per line of the image along the diffraction direction. Furthermore, when deconvolution step s410 of the embodiment described with reference to
(107) In one embodiment, as illustrated by the flowchart of
(108) In one embodiment, the step of decoding s492 the code is used to obtain information based on which the expected spectral composition of the electromagnetic radiation from object 10 and therefore the reference spectral information to be used for the spectrum-based authentication verification in step s400 can be retrieved (e.g. through a database). In such a manner, several different code families each associated with a different ink (and hence a different reference spectrum) can be printed on different classes of products and authenticated with the same device.
(109) In one embodiment, the marking comprises at least one machine readable code, which may for example comprise at least one of a linear barcode and a matrix barcode (e.g., a printed Data Matrix code or QR code). It is therefore possible, in some embodiments of the invention, not only to decode a two-dimensional matrix barcode (or the like) but also to carry out material-based authentication using the spectrum of the radiation coming from object 10, the radiation spectrum corresponding for example to the fluorescence emission spectrum of the ink used for the marking.
(110) In one embodiment, the marking comprises single spectral characteristics at least over one region of the marking. The marking may also comprise single spectral characteristics over the whole marking.
(111) In one embodiment, a mask is intentionally provided, as part of imaging system 200 and in addition thereto, on object 10 or in the vicinity thereof to reveal only a portion of object 10. This is advantageous in the case the whole object carries a substance having the reference spectral information or a large marking which covers the whole image. The mask artificially creates a transition from non-marked to marked area even if there would be no such transition without the mask. In one embodiment, imaging system 200 does not use any slit between dispersive imaging arrangement 30 and object 10. Not using a slit is advantageous in that this enables the simultaneous acquisition of an image and the spectrum thereof, without notably having to scan (by moving the imaging device or spectrometer) the surface of the object to measure the spectrum for each position.
(112) Now, before describing further embodiments of the invention, it may be useful to discuss some of the advantages brought about by some embodiments thereof, especially compared to prior art systems.
(113) The above-described imaging systems and methods in accordance with some embodiments of the invention are advantageous because they allow the construction of simple, compact, snapshot-based (non-scanning), low-cost, and versatile devices, which may for example be incorporated in hand-held audit devices. Acquiring images of both the non-dispersed part of the electromagnetic radiation and the dispersed part thereof indeed suffices, together with the reference spectral information, which is known in advance, to generate the measure of authenticity.
(114) In contrast, imaging spectrometers used for scientific observations, as mentioned above, are typically complex, expensive or bulky. This is because these prior art systems usually aim at obtaining high-resolution spatial and spectral information about all regions of the object or scene.
(115) Mechanical scanning of different bandpass filters in front of an imager allows reconstruction of a spectral irradiance map of the object I(x, y, ). However, the time to scan all filters and the complexity and fragility of the scanning mechanism makes the optical system cumbersome, not rugged and costly to implement.
(116) Tuning systems based on Fabry-Perot interferometer or multistage liquid crystals avoid mechanical complexity but require high-quality and costly optical components (i.e. interferometric mirrors). The scanning of the filter parameters needed to acquire full set of images can be slow and can become another limitation for the use in handheld authentication systems.
(117) Snapshot solutions relying on simultaneous imaging of an object through array of bandpass filters can achieve fast data acquisition and are especially adapted to handheld audit devices. Furthermore, such systems are compact and fit easily in a small volume of a hand-held device. The limited number of different passband filters is, however, a drawback, and it is also difficult to obtain suitable lenslet arrays. In addition, the spectral bands of the filter array have to be optimized to the ink spectral response, which prevents the use of off-the-shelf filter arrays while custom filter arrays are typically expensive to design and manufacture.
(118) The example of a grating-based imager using computer tomography (i.e. CTIS) requires either a complex holographically recorded Kinoform type grating or several crossed gratings able to disperse the light in set of orders around the zero order. The need of several gratings complicates the setup and furthermore, the exposure time should be extended to compensate low efficiency in higher diffraction orders. The data acquisition is therefore slowed, rendering the setup unsuitable for a hand-held device. Such arrangements also require expensive large sensors with multi mega-pixels and extensive calculation for the tomography inversion.
(119) The coded aperture imagers are as slow as the CTIS devices. Moreover, there is an intrinsic problem to reconstruct the full spectrum for specific design of the coded aperture. Meanwhile, integral field spectrometers require cumbersome image slicing optics and require relatively large surface image sensors.
(120) Imaging Fourier transform spectrometers are complex instruments relying on expensive interferometers or birefringent prisms. In either case, the spectrometers require scanning of either an air gap or an angular orientation of the elements to obtain spectra that makes them slow and fragile.
(121) The above-described prior art setups require complex optics and data treatment algorithms to calculate a full spectral data cube I(x, y, ), which is actually not required for authentication purposes. The inventors have found none of these prior art setups suitable for an economical, compact, robust, and fast auditing device based on a spectral imager.
(122) Let us now describe further embodiments of the invention, which may help understand some aspects and advantages of the invention.
(123) In one embodiment, imaging system 200 has an optical setup with a transmission diffraction grating 31 mounted in front of a lens objective 32 in a dispersive imaging arrangement 30 which is then arranged in front of an image sensor arrangement 60, as schematically illustrated on the left-hand side of both
(124)
(125) More complex marks such as full two-dimensional matrix barcodes typically produce smeared images in the first order of the grating 31 due to the specific, broader emission spectra of the inks, and an associated overlap of the successive spread dots in the direction of diffraction is observed, as illustrated on the right-hand side of
(126) Examples of zero- and first-order real images of a two-dimensional matrix barcode printed with two inks, i.e. ink type 1 and ink type 2, are shown in
(127) It can be observed that the images in zero- and first-order of the grating can be recorded simultaneously (as illustrated by
(128) The dispersed image in the first order is a convolution (or a convolution-like function) of the zero-order image of the two-dimensional matrix barcode with the ink fluorescence emission spectrum. As a result, the ink emission spectrum can be extracted by deconvolution (or deconvolution-like operation) of the first-order image using the spatial information from the zero-order image that is not affected by the grating dispersion.
(129) A deconvolution algorithm based on fast Fourier transform (FFT) may for example be used to extract the spectrum of the ink. It may use a set of columns from the images, extracted along the grating dispersion direction, comprising intensity profiles from the zero- and first-order images.
(130)
(131)
(132) Arrangement 30 of
(133) Since grating 31 is mounted in front of imaging lens 32, it deflects the beams differently for zero- and first-order and imaging lens 32 receives the input beams at different angles. In such a configuration, a wide-FOV imaging lens 32 is used which allows incident beams at angles specific for the first order.
(134) In arrangement 30 of
(135) In arrangement 30 of
(136) Let us now describe further embodiments of the invention involving imaging over a plurality of illumination periods, first with reference to
(137)
(138) Then, the measure of authenticity is generated. The generation of the measure of authenticity comprises the following steps.
(139) First, for each illumination period t.sub.i (1in), an intermediate measure of authenticity k.sub.i is generated depending at least on a relation between dispersed part 50 (A.sub.i) imaged at the illumination period t.sub.i, non-dispersed part 40 (B.sub.i) imaged at the illumination period t.sub.i, and a part of the reference spectral information, said part of the reference spectral information being associated with how object 10 has been illuminated during illumination period t.sub.i. In one embodiment, intermediate measure of authenticity k.sub.i is generated, for each illumination period t.sub.i, by determining, for each illumination period t.sub.i, the extent to which the dispersed part imaged at illumination period t.sub.i corresponds to a convolution of the non-dispersed part imaged at illumination period t.sub.i and said part of the reference spectral information associated with how object 10 has been illuminated during illumination period t.sub.i.
(140) Secondly, the measure of authenticity m is generated based on the plurality of intermediate measures of authenticity k.sub.1, k.sub.2, . . . , k.sub.n. This is illustrated on
(141)
(142) In one embodiment, generating s470, for each illumination period t.sub.i, the intermediate measure of authenticity k.sub.i comprises: determining, for each illumination period t.sub.i, the extent to which the dispersed part imaged at illumination period t.sub.i corresponds to a convolution of the non-dispersed part imaged at illumination period t.sub.i and said part of the reference spectral information associated with how object 10 has been illuminated during illumination period t.sub.i.
(143) In one embodiment (not illustrated in
(144)
(145) The imaged non-dispersed part {B.sub.1, B.sub.2, . . . , B.sub.n} is processed based at least on the non-dispersed part B.sub.1 imaged at a first illumination period t.sub.1 among the plurality of illumination periods t.sub.1, t.sub.2, . . . , t.sub.n and the non-dispersed part B.sub.2 imaged at a second illumination period t.sub.2, to produce the processed imaged non-dispersed part B.sub.x. All images B.sub.1, B.sub.2, . . . , B.sub.n may also be taken into account to produce the so-called processed imaged non-dispersed part B.sub.x. That is, the processed imaged non-dispersed part B.sub.x may be generated based on the non-dispersed parts imaged at a first to nth illumination periods t.sub.1, t.sub.2, . . . , t.sub.n. Likewise, the processed imaged dispersed part is generated based at least on the dispersed part A.sub.l imaged at a first illumination period t.sub.1 among the plurality of illumination periods t.sub.1, t.sub.2, . . . , t.sub.n and the dispersed part A.sub.2 imaged at a second illumination period t.sub.2, to produce the so-called processed imaged dispersed part A.sub.x. All dispersed parts A.sub.1, .sub.2, . . . , .sub.n imaged at all the illumination periods t.sub.1, t.sub.2, . . . , t.sub.n may alternatively be taken into account to produce the processed imaged dispersed part A.sub.x.
(146) Then, the measure of authenticity m is generated depending at least on a relation between the processed imaged dispersed part A.sub.x, the processed imaged non-dispersed part B.sub.x, and reference spectral information. In one embodiment, the measure of authenticity m is generated based at least on the extent to which the processed imaged dispersed part A.sub.x corresponds to a convolution of the processed imaged non-dispersed part B.sub.x and reference spectral information.
(147)
(148) Namely, referring to
(149) In
(150) In one embodiment, step s482 may be implemented as follows (likewise, step s484 may be implemented in a similar manner): First, a weighting factor is calculated based on a statistical processing of pixel values of the first image data B.sub.1 (i.e., the non-dispersed part imaged at illumination period t.sub.1) and pixel values of the second image data B.sub.2 (i.e., the non-dispersed part imaged at illumination period t.sub.2). Then, third image data B.sub.x (i.e., the so-called processed imaged non-dispersed part) is generated by calculating a weighted combination using the pixel values of said first image data B.sub.1, the pixel values of said second image data B.sub.2, and said weighting factor. Such an implementation may be performed to maximize the image contrast between a marking (e.g. a barcode) and the remaining background, as described in PCT application WO 2014/187474 A1 by the same applicant. WO 2014/187474 A1 discloses techniques to enhance the image of a mark or code printed over fluorescing background or other backgrounds. Several images of a mark or code are acquired under different illumination conditions, and an image subtraction algorithm suppresses the background to facilitate the extraction of the printed codes from the images.
(151) This embodiment, which will be described in more detail with reference to
(152) This embodiment addresses in particular the following potential problems: The imaged non-dispersed part and imaged dispersed part created by means of dispersive imaging arrangement 30, as discussed above, may overlap and, for example, the fluorescing background of a can cap (or the like) could pose problems for decoding and spectrum extraction. One embodiment of the invention to reduce the effect of overlap is to use optionally an appropriate mask which hides part of the image of object 10 to avoid the overlap between the zero- and first-order images of the code created by means of arrangement 30. Such a mask however is physical and may, under certain circumstances, disturb the code reading by reduction of the useful field of view. Further, the mask may complicate the opto-mechanical design of imaging system 200.
(153) The DIBS-based embodiment aims at addressing such problems. It uses images obtained through arrangement 30 which have an overlap between the orders, and a background subtraction using the DIBS technique is applied. The DIBS technique reduces the effect of fluorescing background (or the like) on the zero-order images (non-dispersed part 40) and further corrects the first-order images (dispersed part 50), thus improving the spectrum-based generation of the measure of authenticity. This is particularly advantageous when the fluorescing background has an excitation spectrum which differs from the ink to be authenticated (e.g. matrix code).
(154) An example of images of a sample object 10 with fluorescing background obtained with an imaging system 200 of
(155) Therefore, the image of
(156)
(157) In accordance with the above-mentioned DIBS-based embodiment, no mask is used, but images are acquired in a plurality of illumination periods t.sub.1, t.sub.2, . . . , t.sub.n with several different illuminations and then an image subtraction is carried out in accordance with the DIBS technique. This reduces the influence of a fluorescing background (or the like) on both the decoding (if used) and spectrum extraction.
(158) For example, the DIBS algorithm may use two images acquired by illuminating object 10 with blue and green light respectively. As an output of the algorithm, an image is obtained which is the difference of images taken with blue and green illumination. This image typically has better contrast when it comes to the printed code compared to the initial images, thus improving the performance of the decoding engine (if used). Furthermore, the resulting image also improves the spectrum extraction using the first-order image (i.e., dispersed part 50) created by means of dispersive imaging arrangement 30. This effect may be explained by the different excitation spectra for both the ink used to print the code and the fluorescing background of object 10 (e.g. a soft-drink can cap). The ink is better excited in blue than in green while the background of the soft-drink can cap has mostly the same excitation for both colours. Subtracting the images then leads to increase of the code contrast and improved spectrum extraction.
(159)
(160)
(161) Thanks to the DIBS algorithm, the treated image is more suitable for decoding and improves the spectrum-based generation of the measure of authenticity.
(162) Let us now describe further embodiments of the invention applicable to both the imaging over a single illumination period and the imaging over a plurality of illumination periods. These further embodiments may be combined with any of the above-described embodiments.
(163) In one embodiment, object 10 bears a visible or invisible mark (or sign) printed with a printing ink. Such ink contains coloring and/or luminescing agents, such as dye(s) and/or pigment(s) that are typically hard to produce and to reverse-engineer. These optical agents may be classified into two main classes: 1) optical agents producing specific reflective properties upon controlled illumination, and 2) optical agents producing luminescence upon controlled illumination.
(164) The expected spectral response of said optical agents, when subject to particular illumination conditions, is known a priori and constitutes the reference spectral information.
(165) In the case of reflective properties, the spectral response is called the spectral reflectivity, which is the fraction of electromagnetic power reflected per unit of wavelength. For example,
(166) In order for the reflectivity to be determined, a known broadband illumination source may be used, since the wavelength-dependent reflected electromagnetic radiation 20 (spectral radiance, which is measured) depends on the incident spectral composition of the illumination (spectral irradiance). The spectral reflectivity may be determined either using a calibrated illumination source (in wavelength) or by comparison with a surface of known spectral reflectivity (such as a reference white surface like Spectralon from LabSphere, based in North Sutton, N.H., U.S.) using a non-calibrated broadband light source. The term broadband means that the light source emits at least at all wavelengths in the range of interest. Examples of broadband light source spectral distribution are shown for a white LED (e.g., an OSRAM OSLON SSL white LED) in
(167) It can be observed from
(168) A second class of optical agents covers luminescent dyes or pigments and has different requirements in terms of illumination and measurement.
(169) Fluorescent dyes and pigments may be selected for example from perylenes (e.g. Lumogen F Yellow 083, Lumogen F Orange 240, Lumogen F Red 300, all available from BASF AG).
(170) This illumination and detection scheme is known in the field of measuring fluorescence and usually comprises a narrow band illumination source such as for example a single color LED (a blue one at 450 nm or a green one at 530 nm may be adapted to excite the Lumogen of
(171)
(172) In one embodiment, the reference spectral information is generated prior to operating the system and method of authentication. This may be done through a recording and registering of the extracted spectral information, in the same or very similar conditions of illumination and detection (for example using the same device or instrument) as the one to be used in the field.
(173) In one embodiment, a non-controlled illumination source may be used, provided that its spectral characteristics can be determined, through a spectral measurement and a subsequent correction may be made prior to extracting the measured spectral information from object 10 or mark to be authenticated.
(174)
(175) As illustrated by
(176) Processing unit 703 may include a processor, a microprocessor, or processing logic that may interpret and execute instructions. Main memory 707 may include a RAM or another type of dynamic storage device that may store information and instructions for execution by processing unit 703. ROM 708 may include a ROM device or another type of static storage device that may store static information and instructions for use by processing unit 703. Storage device 709 may include a magnetic and/or optical recording medium and its corresponding drive.
(177) Input device 702 may include a mechanism that permits an operator to input information to processing unit 703, such as a keypad, a keyboard, a mouse, a pen, voice recognition and/or biometric mechanisms, etc. Output device 704 may include a mechanism that outputs information to the operator, including a display, a printer, a speaker, etc. Communication interface 706 may include any transceiver-like mechanism that enables computing unit 700 to communicate with other devices and/or systems (such as with a base station, a WLAN access point, etc.). For example, communication interface 706 may include mechanisms for communicating with another device or system via a network.
(178) Computing unit 700 may perform certain operations or processes described herein. These operations may be performed in response to processing unit 703 executing software instructions contained in a computer-readable medium, such as main memory 707, ROM 708, and/or storage device 709. A computer-readable medium may be defined as a physical or a logical memory device. For example, a logical memory device may include memory space within a single physical memory device or distributed across multiple physical memory devices. Each of main memory 707, ROM 708 and storage device 709 may include computer-readable media. The magnetic and/or optical recording media (e.g., readable CDs or DVDs) of storage device 709 may also include computer-readable media. The software instructions may be read into main memory 707 from another computer-readable medium, such as storage device 709, or from another device via communication interface 706.
(179) The software instructions contained in main memory 709 may cause processing unit 703 to perform operations or processes described herein, such as for example generating the measure of authenticity. Alternatively, hardwired circuitry may be used in place of or in combination with software instructions to implement processes and/or operations described herein. Thus, implementations described herein are not limited to any specific combination of hardware and software.
(180)
(181) In one embodiment, imaging system 200 comprises, on the one hand, an imaging device comprising image sensor arrangement 60 and, on the other hand, a piece of equipment, hereinafter referred to as imaging accessory, comprising dispersive imaging arrangement 30.
(182) In this embodiment, the imaging device has a built-in camera (including associated lenses) and may be a hand-held device, such as for example at least one of: a mobile phone, a smartphone, a feature phone, a tablet computer, a phablet, a portable media player, a netbook, a gaming device, a personal digital assistant, and a portable computer device. The imaging device's built-in camera image sensors act as image sensor arrangement 60 in system 200.
(183) As mentioned above, the imaging accessory comprises dispersive imaging arrangement 30, such as for example a transmission diffraction grating, or any other dispersive element as already discussed above with reference to
(184) The imaging accessory is attachable, directly or indirectly (for example via a connecting piece of equipment), to the imaging device so that the imaging accessory's dispersive imaging arrangement 30 is positioned relative to the imaging device's image sensor arrangement 60 in such a manner that the imaging device and the imaging accessory form an imaging system 200 as described above, operable for imaging an object and generating a measure of authenticity of the object. In other words, the imaging accessory may be used for example to transform a smartphone into a portable imaging and authentication system as described above. The imaging accessory may for example be fixedly positionable over the smartphone rear camera. The processing and communications capabilities of the smartphone may then be used for implementing a processing unit 70 of imaging system 200.
(185) Furthermore, if the imaging device has a light source (such as for example flash LEDs used in a smartphone), said light source may operate as illumination arrangement 210 to illuminate the object 10 to be imaged and authenticated. A smartphone's light source is typically well adapted for reflectivity measurements. Alternatively, illumination arrangement 210 may be provided as part of the imaging accessory.
(186) This embodiment is advantageous in that the imaging accessory may be a passive accessory, requiring no additional power, and thus providing an affordable authentication solution.
(187)
(188) The invention further relates to the following embodiments: Embodiment (X2). Imaging system (200) of claim 1, wherein the imaging system (200) is an imaging device. Embodiment (X3). Imaging system (200) of claim 1, comprising an imaging device (100) comprising the image sensor arrangement (60) and the dispersive imaging arrangement (30), wherein the imaging device (100) is not configured to generate the measure of authenticity. Embodiment (X4). Imaging system (200) of embodiment (X2) or (X3), wherein the imaging device is a hand-held device. Embodiment (X7). Imaging system (200) according to any one of claims 1 to 3 and embodiments (X2) to (X4), wherein the imaging system (200) is configured for generating the measure of authenticity after the image sensor arrangement (60) has, in a plurality of illumination periods (t.sub.1, t.sub.2, . . . , t.sub.n), imaged the non-dispersed part (40) and the dispersed part (50); and generating the measure of authenticity comprises: generating, for each illumination period (t.sub.i), an intermediate measure of authenticity (k.sub.i) depending at least on a relation between the dispersed part imaged at the illumination period (t.sub.i), the non-dispersed part imaged at the illumination period (t.sub.i), and a part of the reference spectral information, said part of the reference spectral information being associated with how the object (10) has been illuminated during the illumination period (t.sub.i); and generating the measure of authenticity (m) based on the plurality of generated intermediate measures of authenticity (k.sub.1, k.sub.2, . . . , k.sub.n). Embodiment (X8). Imaging system (200) of embodiment (X7), wherein generating, for each illumination period (t.sub.i), the intermediate measure of authenticity (k.sub.i) comprises: determining, for each illumination period (t.sub.i), the extent to which the dispersed part imaged at the illumination period (t.sub.i) corresponds to a convolution of the non-dispersed part imaged at the illumination period (t.sub.i) and said part of the reference spectral information associated with how the object (10) has been illuminated during the illumination period (t.sub.i). Embodiment (X9). Imaging system (200) according to any one of claims 1 to 3 and embodiments (X2) to (X4), wherein the imaging system (200) is configured for generating the measure of authenticity after the image sensor arrangement (60) has, in a plurality of illumination periods (t.sub.1, t.sub.2, . . . , t.sub.n), imaged the non-dispersed part (40) and the dispersed part (50); and generating the measure of authenticity comprises: processing the imaged non-dispersed part based at least on the non-dispersed part imaged at a first illumination period (t.sub.1) among the plurality of illumination periods (t.sub.1, t.sub.2, . . . , t.sub.n) and the non-dispersed part imaged at a second illumination period (t.sub.2) among the plurality of illumination periods (t.sub.1, t.sub.2, . . . , t.sub.n), wherein the illumination conditions during the first illumination period (t.sub.1) at least partially differ from the illumination conditions during the second illumination period (t.sub.2); processing the imaged dispersed part based at least on the dispersed part imaged at the first illumination period (t.sub.1) and the dispersed part imaged at the second illumination period (t.sub.2); and generating the measure of authenticity (m) depending at least on a relation between the processed imaged dispersed part (A.sub.x), the processed imaged non-dispersed part (B.sub.x), and the reference spectral information. Embodiment (X10). Imaging system (200) of embodiment (X9), wherein generating the measure of authenticity (m) depends at least on the extent to which the processed imaged dispersed part (A.sub.x) corresponds to a convolution of the processed imaged non-dispersed part (B.sub.x) and the reference spectral information. Embodiment (X11). Imaging system (200) according to any one of claims 1 to 3 and embodiments (X2) to (X4) and (X7) to (X10), wherein the dispersive imaging arrangement (30) is positioned relative to the image sensor arrangement (60) in such a manner as to allow the image sensor arrangement (60) to image the non-dispersed part (40) and the dispersed part (50) in two portions of the same image sensor. Embodiment (X13). Imaging system (200) according to any one of claims 1 to 4 and embodiments (X2) to (X4) and (X7) to (X11), wherein a slit is not used between the dispersive imaging arrangement (30) and the object (10) to be imaged. Embodiment (X17). Imaging system (200) of claim 7, wherein the at least one machine readable code comprises at least one of a linear barcode and a matrix barcode. Embodiment (X18). Imaging system (200) according to any one of claims 5 to 7 and embodiment (X17), wherein the marking (11) comprises single spectral characteristics at least over one region of the marking (11). Embodiment (X19). Imaging system (200) of embodiment (X18), wherein the marking (11) comprises single spectral characteristics over the whole marking (11). Embodiment (X20). Imaging system (200) according to any one of claims 5 to 7 and embodiments (X17) to (X19), wherein the marking (11) comprises at least one of: optical agents producing specific reflective properties upon controlled illumination, and optical agents producing luminescence upon controlled illumination. Embodiment (X21). System (220) comprising an imaging system (200) according to any one of claims 1 to 7 and embodiments (X2) to (X4), (X7) to (X11), (X13), and (X17) to (X20), and an illumination arrangement (210) for controlled illumination of the object (10). Embodiment (X23). Imaging method of claim 8, wherein the imaging method is carried out by an imaging device. Embodiment (X24). Imaging method of claim 8, wherein the imaging method is carried out by an imaging system (200) comprising an imaging device (100) comprising the image sensor arrangement (60) and the dispersive imaging arrangement (30), wherein the imaging device (100) does not generate (s400) the measure of authenticity. Embodiment (X25). Imaging method of embodiments (X23) or (X24), wherein the imaging device is a hand-held device. Embodiment (X32). Imaging method according to any one of claims 8 to 14 and embodiments (X23) to (X25), wherein the dispersive imaging arrangement (30) is positioned relative to the image sensor arrangement (60) in such a manner as to allow the image sensor arrangement (60) to image the non-dispersed part (40) and the dispersed part (50) in two portions of the same image sensor. Embodiment (X33). Imaging method according to any one of claims 8 to 14 and embodiments (X23) to (X25) and (X32), wherein the dispersive imaging arrangement (30) comprises at least one of: a diffractive element, a transmission diffraction grating, a blazed transmission diffraction grating, a volume holographic grating, a reflective diffraction grating,
(189) an arrangement comprising a beam splitter and a diffraction grating, and an arrangement comprising a beam splitter and a dispersive prism. Embodiment (X34). Imaging method according to any one of claims 8 to 14 and embodiments (X23) to (X25), (X32) and (X33), wherein a slit is not used between the dispersive imaging arrangement (30) and the object (10) to be imaged. Embodiment (X37). Imaging method of claim 15 or 16, wherein the marking (11) comprises at least one machine readable code. Embodiment (X38). Imaging method of embodiment (X37), wherein the at least one machine readable code comprises at least one of a linear barcode and a matrix barcode. Embodiment (X39). Imaging method according to any one of claims 15 and 16 and embodiments (X37) and (X38), wherein the marking (11) comprises single spectral characteristics at least over one region of the marking (11). Embodiment (X40). Imaging method of embodiment (X39), wherein the marking (11) comprises single spectral characteristics over the whole marking (11). Embodiment (X41). Imaging method according to any one of claims 15 and 16 and embodiments (X37) and (X40), wherein the marking (11) comprises at least one of: optical agents producing specific reflective properties upon controlled illumination, and optical agents producing luminescence upon controlled illumination. Embodiment (X43). Computer program or set of computer programs comprising computer-executable instructions configured, when executed a computer or set of computers, to carry out an imaging method according to any one of claims 8 to 16 and embodiments (X23) to (X25), (X32) to (X34), and (X37) to (X41). Embodiment (X44). Computer program product or set of computer program products comprising a computer program or set of computer programs according to embodiment (X43). Embodiment (X45). Storage medium storing a computer program or set of computer programs according to embodiment (X43).
(190) Where the terms processing unit, storage unit, etc. are used herewith, no restriction is made regarding how distributed these elements may be and regarding how gathered elements may be. That is, the constituent elements of a unit may be distributed in different software or hardware components or devices for bringing about the intended function. A plurality of distinct elements may also be gathered for providing the intended functionalities.
(191) Any one of the above-referred units, such as for example processing unit 70, or devices, such as for example imaging device 110, may be implemented in hardware, software, field-programmable gate array (FPGA), application-specific integrated circuit (ASICs), firmware or the like.
(192) In further embodiments of the invention, any one of the above-mentioned processing unit, storage unit, etc. is replaced by processing means, storage means, etc. or processing module, storage module, etc. respectively, for performing the functions of the processing unit, storage unit, etc.
(193) In further embodiments of the invention, any one of the above-described procedures, steps or processes may be implemented using computer-executable instructions, for example in the form of computer-executable procedures, methods or the like, in any kind of computer languages, and/or in the form of embedded software on firmware, integrated circuits or the like.
(194) Although the present invention has been described on the basis of detailed examples, the detailed examples only serve to provide the skilled person with a better understanding, and are not intended to limit the scope of the invention. The scope of the invention is much rather defined by the appended claims. Abbreviations: ASICs application-specific integrated circuit a.u. arbitrary units CASSI coded aperture snapshot spectral imager CCD charge-coupled device CMOS complementary metal-oxide-semiconductor CTIS computed tomography imaging spectrometer DIBS differential illumination background subtraction FOV field of view FPGA field-programmable gate array KNN K-nearest neighbors algorithm I/mm lines per mm LED light-emitting diode LTI linear translation-invariant MAFC multi-aperture filtered camera MIFTS multiple-image Fourier transform spectrometer NIR near-infrared RAM random-access memory ROM read-only memory SHIFT snapshot hyperspectral imaging Fourier transform spectrometer SVM support vector machine SWIR short-wavelength infrared UV ultraviolet WLAN wireless local area network