Method for the generation of a correction model of a camera for the correction of an aberration

10931924 ยท 2021-02-23

Assignee

Inventors

Cpc classification

International classification

Abstract

To correct aberrations in the image plane of a camera while modifying selected, modifiable camera settings that influence aberrations quickly and simply, a plurality of features with different known feature positions is provided in space. For each selected, modifiable camera setting influencing the aberration, at least two defined setting specifications are provided for modifying respective camera settings. For each setting specification, the camera captures the plurality of features. The camera determines positions of features in the image plane. Via a known mathematical method, a connection between different known feature positions in space and corresponding image positions in the image plane of the camera is determined. For each of the setting specifications of the selected modifiable camera settings, correction parameters of at least one mathematical correction model are determined for correcting the aberration. The at least one correction model is stored in the camera together with the determined correction parameters.

Claims

1. A method for the generation of a correction model of a camera to correct at least one aberration influenced by a number of selected, modifiable camera settings in an image plane of the camera, comprising: providing for each of the selected, modifiable camera settings that influence the aberration, at least two defined setting specifications for the modification of the respective camera setting, capturing with the camera for each of the at least two defined setting specifications, a plurality of features with different known feature positions in space, determining image positions of the plurality of features in the image plane from the captured features, using at least one known mathematical method to determine a connection between the different known feature positions in space and the corresponding image positions in the image plane of the camera, for each of the at least two defined setting specifications of the selected modifiable camera settings, determining correction parameters at least of one specified mathematical correction model for the correction of the at least one aberration, and storing the at least one correction model in the camera together with the determined correction parameters.

2. The method according to claim 1, wherein the at least one aberration comprises at least one of a geometric distortion and/or a chromatic aberration and/or a vignetting.

3. The method according to claim 1, wherein the modifiable camera settings that influence the aberration comprise at least one of a focal width and/or a focal distance and/or an aperture and/or a wavelength of a light for the illumination of the features.

4. The method according to claim 1, wherein an equal camera distance from the image plane is provided for all of the plurality of features.

5. The method according to claim 4, wherein the plurality of features are arranged on a two-dimensional calibration plate as active or passive features.

6. The method according to claim 5, wherein the camera distance is modified at least twice, whereby at each camera distance the plurality of features for each of the at least two provided setting specifications are captured by the camera.

7. The method according to claim 1, wherein at least two features with a different camera distance are provided.

8. The method according to claim 7, wherein the plurality of features are arranged on a three-dimensional calibration object as active or passive features.

9. The method according to claim 1, wherein the plurality of features comprises at least ten features.

10. The method according to claim 1, wherein, a pinhole camera model according to Hartley and Zisserman is used as the mathematical method for the determination of the connection between the different known feature positions in space and the image positions in the image plane of the camera.

11. The method according to claim 2, wherein, a radial-tangential model according to Brown-Conrady is used as the correction model for the geometric distortion and/or the chromatic aberration.

12. The method according to claim 2, wherein, a radial vignetting function with vignetting parameters and a pixel intensity is used as the correction model for the vignetting.

13. A method for correction of at least one aberration in an image plane of a camera with a plurality of selected camera settings that influence the at least one aberration, in which a correction model of a camera to correct at least one aberration influenced by a number of selected, modifiable camera settings in the image plane of the camera is generated according to claim 1, the method comprising: for a setting specification of one of the selected camera settings influencing the aberration that deviates from the at least two defined setting specifications, calculating the correction parameters of the correction model for the correction of the at least one aberration from the determined correction parameters of the at least two defined setting specifications, storing the calculated correction parameters for the deviating setting specification in the correction model of the camera, and using the correction model with the stored calculated correction parameters to correct the at least one aberration in the image plane of the camera at the deviating setting specification.

14. The method according to claim 13, wherein the correction parameters for the deviating setting specification are calculated from the correction parameters of the at least two defined setting specifications by a hyperbolic function and one of a linear interpolation or a linear regression.

15. The method according to claim 5, wherein the plurality of features comprise circular features.

16. The method according to claim 8, wherein the plurality of features comprise circular features.

17. The method according to claim 1, wherein the plurality of features comprises at least twenty features.

18. The method according to claim 1, wherein the plurality of features comprises at least thirty features.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The present invention is explained in further detail below with references to FIGS. 1 to 4, which show preferred embodiments of the invention in an exemplary, schematic, and nonlimiting manner.

(2) FIG. 1 shows an exemplary illustration of an industrial image processing system,

(3) FIG. 2 shows an assembly for the calibration of a camera of an industrial image processing system with a camera and a calibration object,

(4) FIGS. 3A and 3B each show an example of an aberration of the geometric distortion,

(5) FIG. 4 shows the use of a correction model for the correction of aberrations of a camera.

DETAILED DESCRIPTION OF THE EMBODIMENTS

(6) FIG. 1 shows an exemplary illustration of an industrial image processing system 1 in a measurement application of an object O.sub.1. The image processing system 1 comprises a camera 2 and one or more lighting units 6 that are integrated in the camera, or external, and that are arranged in space in a stationary manner, for example on a suitable retaining device (not shown). The camera 2 is positioned so that the object O.sub.1 to be measured is in the capture range of the camera 2 and so that the camera can capture images of the object O.sub.1. The images are processed for example in a suitable evaluation unit 8, preferably to provide a measurement result of the object O.sub.1 to be measured. A measuring task could be, for example, the detection of certain features in a measuring plant E1 on the object O.sub.1 or also an actual measurement of the dimensions of the object O.sub.1 or components or the like arranged on it.

(7) The lighting unit 6 illuminates the object O.sub.1 to be measured in the capture area of the camera 2. In industrial image processing, preferably cameras 2 with monochrome image sensors are used, but the method according to the invention may also be used for cameras 2 with color sensors. The light L of the illumination has certain characteristics, for example a certain wave length , a certain light strength, etc. Generally, but not necessarily, monochrome light L in the visible range but also in the ultraviolet (UV) or infrared (IR) range is used for the illumination. Monochrome means that the wavelength of the light L is limited to the tightest possible wavelength band around a defined wavelength , ideally a specific wavelength , i.e., UV light or unicolor visible light L. If white light L, i.e., light L with various different wavelengths .sub.i is used for the illumination, monochrome errors can be corrected with a color and/or hyperspectral sensor of the camera 2 only on the pixels with the respective filters.

(8) The invention is described below with the help of a camera 2 with a monochrome image sensor. Depending on the surrounding condition of the overall image processing system 1, the lighting unit 6, or an illuminant arranged therein, even illumination cannot always be guaranteed, which may lead to an aberration of the camera 2. The optical system of the camera 2 itself may lead to aberrations as well, for example, a geometric distortion, a chromatic aberration, or a vignetting. The lighting unit 6 may also be controlled with an appropriate light controller 9, for example to balance fluctuations of the light strength or to realize a flashlight. Aberrations may cause the dimensions on the image taken of the object O.sub.1 by the camera 2 not to correspond to the actual dimensions of the object O.sub.1 or may cause the object not to be shown exactly as it is in reality. Depending on the extent of the aberration, measurement imprecisions may occur in particular in precise measuring tasks that distort the measuring result so much that it can no longer be used.

(9) Not only the lighting or the optical system play a role, however, but also, for example, the distance and angle between the camera 2 and the object O.sub.1 to be measured or the settings of the camera 2 or of a lens 7 such as the aperture or the focal width. The position of the object O.sub.1 may change for example from a first measuring position P.sub.1 to a second measuring position P.sub.2, or a larger object O.sub.2 is used. In the example shown, this would cause the angle and the distance of the camera 2 from the measuring plane E.sub.1 of the object O.sub.2 or the measuring plane E.sub.2 of the object O.sub.2 to change as well, which might lead to an aberration, for example a geometric distortion.

(10) Generally, a significant effort is made, in particular regarding measuring tasks, to keep the overall conditions of the image processing system 1 (angle, distance, light strength, wavelength of the light, aperture setting, focal width, etc.) as constant as possible and to calibrate the camera 2 in such a way that no or as few aberrations as possible are caused or that the aberrations are minimized. Here, to calibrate means that certain overall conditions are specified and that the camera 2 is calibrated exactly for these specified overall conditions. This can be done for example with known algorithms which are carried out for example in a control unit in the camera 2 or in the evaluation unit 8 of the camera 2.

(11) The calibration is generally based on calibration data for the specified overall conditions, which is used to compensate for the aberrations. Since such a calibration generally requires a great deal of effort and in particular because it applies only to the exact overall conditions that the calibration is based on, the flexibility of such an image processing system 1, for example when mounted on a robotic arm, is very limited. In such traditional image processing systems 1, a new calibration of the camera 2 must be performed each time the overall conditions change so as to be able to ensure correct measuring results. The method according to the invention addresses these disadvantages, as described in detail below on the basis of FIG. 2.

(12) FIG. 2 shows an industrial image processing system 1 in a coordinate system formed by an X-axis, a Y-axis and a Z-axis in space with a camera 2 comprising a lens 7 and a calibration object 3 in which a certain number of features M can be captured and analyzed by the camera 2. To obtain a required spatial depth, the camera 2 in the example shown is, for the calibration in the Z-direction, adjustably arranged to the calibration object 3 in a translational vertical manner and the calibration object 3 is arranged in a stationary manner.

(13) This makes it possible to change a camera distance l.sub.K of the camera 2 from the calibration object 3. The reverse may be the case as well, i.e., a stationary camera 2 and a calibration object 3 with a position that is translationally changeable in the Z-direction. Due to the changeable camera distance l.sub.K, a two-dimensional calibration object 3 may be used, a so-called two-dimensional calibration plate. To move the camera 2 in the Z-direction, the camera 2 may be mounted for example on a linear rail (not shown). The size of the calibration plate is preferably specified so that even at a minimum camera distance l.sub.K of the calibration plate, the camera 2 still covers the entire calibration plate with all features M.

(14) The starting position of the camera 2 may be chosen at random, but it is important that the translation of the camera 2 in the Z-direction is reproducible and that the distance differences of the individual camera distances l.sub.K are known as precisely as possible, which is possible without great effort. It is also important that the calibration plate is oriented as precisely as possible at a right angle to the camera to ensure that the distances of the features M in the Z-direction from the camera 2 do not differ at a certain camera distance l.sub.K. This can be ensured by means of the construction of the calibration assembly. The calibration plate is illuminated by a suitable lighting unit 6 as homogeneously as possible with preferably monochromatic light L.

(15) When the camera 2 captures an image from a real point in space, a so-called world-point P.sub.W(X,Y,Z), a corresponding image point P.sub.B(X,Y) is generated on an image plane 4 of the camera 2. The camera 2 has a specific number of modifiable camera settings such as a focal width, a focal distance F, an aperture B, or a known wavelength of the light L of an illumination with which an object to be captured, in the specific case the calibration object 3, here a calibration plate, is illuminated. With an active calibration plate, however, the features M themselves can illuminate with light L of the known wavelength . These modifiable camera settings generally cause aberrations in the image plane 4 of the camera 2 due to the physical behavior of the optical components of camera 2. Such aberrations are, for example, a geometric distortion, a vignetting, or a chromatic aberration. The characteristics, causes, and the effects of these aberrations are known, which is why they are not addressed here in detail. A geometric distortion, for example, causes the positions of the image points P.sub.B(X,Y) that are captured in the image plane 4 of the camera 2 not to correspond to the real positions of the world-points P.sub.W(X,Y), which leads to a pillow-shaped distorted image as shown in FIG. 3A or a drum-shaped distorted image as in FIG. 3B.

(16) In some applications, for example in traditional photography, such aberrations are accepted or even desired up to a certain degree, such as in art photography. In industrial image processing systems 1, aberrations are generally undesired, however, because particularly in measurement applications the measurement results would be distorted because an object O shown in the image plane 4 of the camera 2 is distorted. A measured distance or a measured position would, for example, not correspond to the actual distance to be measured on the object O or the real position of the object O.

(17) It is therefore preferable to minimize or even compensate for these aberrations with as little effort and as simply as possible. Mathematical methods for the correction of the aberrations are generally known from prior art and can be used to calibrate the camera 2 for a certain specified camera setting or a specified combination of a number of camera settings. The practical application is problematic, however, particularly when one or more camera settings of the camera 2 are modified, e.g., when the focal distance F or the camera 2 changes or when the wavelength of the light L of the illumination changes. In traditional calibration processes, the camera 2 would have to be recalibrated after every modification of a camera setting to be able to provide suitable measuring results, which is very time intensive and therefore undesired.

(18) The calibration object 3 in the example shown in FIG. 2 is a two-dimensional, passive, plane calibration plate and has a plurality i of features M.sub.i, which are arranged in a defined grid with known feature positions P.sub.Mi(X,Y) on the calibration plate. Passive means that the calibration plate must be illuminated by a suitable lighting unit 6. The illumination should be as even as possible across the entire surface of the calibration plate. In an active calibration plate, the individual features M themselves should illuminate as homogeneously as possible with light L of a specific wavelength .

(19) Plurality in this context means at least a number greater than one. In the example shown, for example, twenty features M are provided on the calibration plate. In general, the precision of the method according to the invention is increased the higher the number of features M is, but the number of the features should not be too high either because that would make the duration of the process longer, which is undesirable. Preferably, however, at least twenty features M are provided on the calibration plate, and especially preferable being at least thirty features, because this amount achieves a substantially good result and any further increase of the number of feature M would only result in slight precision increases.

(20) Preferably, the features M are, as in the example shown, formed as light circles on a dark background with as little reflection as possible so as to guarantee a high contrast. The circles are arranged on the calibration plate at equal distances m.sub.X, m.sub.Y from each other. The features M may also be arranged in a different form such as the form of a chessboard pattern and have different distances from each other. What is important is that the feature positions P.sub.Mi(X,Y) of the individual features M.sub.i are specified as exactly as possible on the calibration plate (the index i refers to the number of features M).

(21) Regarding the definition of the feature position P.sub.Mi(X,Y,Z) in space, it is necessary to determine the third coordinate, here that of the camera distance l.sub.K in the Z-direction, as accurately as possible. Light circles on a dark background with little reflection have the advantage that the positions of the circles, i.e., the feature positions P.sub.Mi(X,Y,Z), can be reliably determined even for blurry images. That is important because different image settings for the sharpness may be used for the determination of the correction parameters (as described below) without changing the camera distance l.sub.K, provided the camera 2 has a correspondingly modifiable camera setting (modifiable focal distance F). The lighting unit 6 should illuminate the circles as homogeneously as possible.

(22) In the case of a passive calibration plate, features M must be actively illuminated by a suitable lighting unit 6. Alternatively, however, an active calibration plate or an active three-dimensional calibration object 3 with active features M.sub.i could be used. Active features M are not illuminated by a lighting unit 6, but actively emit light to signal their position. Active features M.sub.i may be configured as point-shaped light-emitting diodes (LED). What is important here is that a homogenous light, preferably circular depiction, is achieved in the image. To this purpose, the LEDs could be recessed in holes on the calibration plate, for example, with a diffusing screen arranged above it. The light source could also consists of LCD, TFT, or other passive or active elements as they are used in the development of displays; e.g., a monochrome luminescent organic light-emitting diode (OLED) has the advantage to be a very homogeneous source of light across a given surface.

(23) The use of the two-dimensional calibration plate as a calibration object 3 is only optional, however; it is possible to use a three-dimensional calibration object 3 as well on which the features M.sub.i are arranged, hereby at least two features M.sub.i have a different camera distance l.sub.K. It is also possible, however, to use a single feature M.sub.i the position of which can be changed in space. A three-dimensional calibration object 3 has the advantage, for example, that the position of the camera 2 does not have to be changed relative to the three-dimensional calibration object 3 (=camera distance l.sub.K) (or vice versa).

(24) The method according to the invention is described below on the basis of the determination of a correction model for the correction of three aberrations for two modifiable camera settings at three different camera distances l.sub.K. The three aberrations are the geometric distortion, the chromatic aberration, and the vignetting, and the two modifiable camera settings are the wavelength of the light L of the illumination and the focal distance F. Of course, however, the method is not limited to the exemplary embodiment shown. It would also be possible to correct only one aberration by modifying just one camera setting (e.g., just aperture B or only the focal distance F) or to correct a number of aberrations while modifying several camera settings at the same time. In can be said in general that the more camera settings are modified and the more aberrations are corrected, the greater the effort required to perform the method according to the invention.

(25) According to the invention, at least two defined setting specifications are provided for the modification of the respective camera setting, and for each of the setting specifications provided, camera 2 captures an image of the plurality of features M.sub.i with different known feature positions P.sub.Mi(X,Y,Z) in space. In the specific example, the wavelength of the light L is modified three times and the focal distance F is modified three times as well. In addition, the camera distance l.sub.K is modified three times in the example shown, and for every camera distance l.sub.K1, l.sub.K2, l.sub.K3 as shown in FIG. 1, every wavelength .sub.1, .sub.2, .sub.3, and every focal distance F.sub.1, F.sub.2, F.sub.3, the camera 2 captures an image of each of the features M.sub.i arranged on the calibration plate. The setting specifications therefore pertain here to three different values of the wavelength and three different values of the focal distance F. Green light is used for example as wavelength .sub.1, blue light as wavelength .sub.2, and red light as wavelength .sub.3, which is generated by a suitable monochromatic illumination. It is not necessary to use visible light L; ultraviolet (UV) or infrared (IR) light L may be used as well.

(26) Overall, therefore, the camera 2 captures in this example 27 images of the twenty features M.sub.i. The first camera distance l.sub.K1 may be chosen at two-thirds of a focal distance F ( before focus), the third camera distance l.sub.K3 at five-thirds of a focal distance F ( after focus), and the second camera distance l.sub.K2 in the center between these two camera distances l.sub.K1, l.sub.K3. This arrangement has the advantage that no strongly defocused images are taken, which leads to easier lighting conditions and sharper pictures, which, in turn, makes a more precise determination of the feature positions P.sub.Mi(X,Y,Z) in the image plane 4 easier.

(27) Preferably, at least two setting specifications are selected for each camera setting, but particularly preferably three setting specifications each, as shown in the exemplary embodiment. The result is only slightly improved when more than three focal distances F are used. In general, and similar to the number of features M.sub.i, the principle applies that the greater the number of the setting specifications of a camera setting is, the more precise the result of the correction will be (albeit with an only slight improvement), but the greater the time spent on this will be as well. The selection of the number of features M.sub.i and the number of the setting specifications is preferably selected in the practical application so that both precision requirements are met and that time limits are adhered to. Preferably, precisely three setting specifications per modifiable camera setting and between twenty and forty features M.sub.i are used.

(28) From the images captured, the camera 2 determines, for example by means of a suitable computing unit 5, which is integrated in the camera 2, or arranged externally, the feature positions P.sub.Mi(X,Y) in the image plane 4, i.e., the image points P.sub.Bi. In the example shown, the center points of the circular features M.sub.i are determined for this purpose. By means of at least one known mathematical method, a connection between the different known feature positions P.sub.Mi(X,Y,Z) in space, i.e., the world-points P.sub.Wi and the corresponding image points P.sub.Bi(X,Y), i.e., the measure feature positions P.sub.Mi(X,Y) in the image plane 4 of the camera 2, the so-called point correspondences, are determined (the index i relates to the number of features M.sub.i. The feature positions P.sub.Mi(X,Y,Z) in space are, as described, defined by the known arrangement of the features M.sub.i on the calibration plate and by the camera distance l.sub.Kj in the Z-direction (the index j stands for the number of the modifiable camera distances l.sub.K). Preferably, the known pinhole camera model by Hartley & Zisserman is used for the determination of the connection or other suitable mathematical models.

(29) P.sub.Bi(X,Y)=P*P.sub.Wi(X,Y,Z) with the projection matrix P=K*[R|C] which can, in turn, be divided into a 33 calibration matrix K with

(30) K = [ f X s c X 0 f Y c Y 0 0 1 ] ,
a 33 rotation matrix R and a translation vector C. The parameters of the calibration matrix K are a horizontal and a vertical focal width f.sub.X, f.sub.Y, a skew s (which takes into consideration a potential deviation of the image plane 4 from the right angle) and the coordinates of a main point C.sub.X and C.sub.Y. In the pinhole camera model an optical axis is drawn through the hole (center of projection) perpendicular to the image plane 4. The main point C is located where the optical axis intersects with the image plane 4. This easy connection is also used in an actual camera 2 with a lens 7 although the optical axis is determined by the lens 7. If the lens 7 is not perfect, it may be possible that this optical axis does not stand exactly vertically in the image plane 4. This results in an affine shearing of the image coordinate system (deviation of 90) and is modeled in the calibration matrix K by the parameter skew s which should be zero in the ideal case. The calibration matrix K describes all linear, intrinsic parameters of the camera 2, also referred to as the inner orientation of a camera 2. The rotation matrix R and the translation vector C describe the extrinsic parameters, the outer orientation, i.e., the translation and rotation between the camera coordinates in the image plane 4 of the camera 2 and the world-coordinates of the features in the plane on the calibration plate (X, Y-axis) and/or in space (Z-axis). The projection matrix P therefore assigns a unique image point P.sub.Bi(X,Y) to a world-point P.sub.Wi(X,Y,Z). It should be noted, however, that this is not the case in the reverse. An image point P.sub.Bi(X,Y) always represents a ray. In the case of a calibrated camera 2, it is possible to measure the directions of rays and determine the angle between rays, but it is not possible to determine the actual distance of the respective world-point P.sub.Wi(X,Y,Z) from the camera 2. Since the pinhole camera model is known from prior art, we will not address it in further detail here but reference the publication [R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2.sup.nd edition, 2003].

(31) In the example below, the following radial-tangential correction model according to Brown-Conrady is used for the correction of the distortion, but it is possible to use a different suitable model as well. X.sub.d=(X.sub.d;Y.sub.d).sup.T refers to the coordinates of the recorded image point, P.sub.Bi, X.sub.u=(X.sub.u;Y.sub.u).sup.T to the coordinates of the unrecorded image point P.sub.Bi and X.sub.c=(C.sub.x; C.sub.y).sup.T to the coordinates of the main point C in the image plane 4. The calculation is performed by means of a radius r, radial parameters r.sub.1, r.sub.2, r.sub.3 and tangential parameters t.sub.1 and t.sub.2. First, the origin of the image coordinate system is moved into the main point C. There is no distortion in the main point C (and no chromatic aberration either). The distortion is now modeled to the main point C (radius r) by means of the distance. The radial parameters r.sub.i model a radial displacement of an image point P.sub.Bi. The image point P.sub.Bi is depicted either too close or too far away from the main point C. The corrected undistorted image point P.sub.Bi is then precisely in the right place. In the same way, the tangential parameters t.sub.i model a tangential displacement of an image point P.sub.Bi. It would also be possible to add higher orders both for the radial parameters r.sub.i and for the tangential parameters t.sub.i, but due to the insignificant influence, this was refrained from.
r={square root over ((X.sub.uC.sub.X).sup.2+(X.sub.uC.sub.Y).sup.2))}
X.sub.d=X.sub.u(1+r.sub.1r.sup.2+r.sub.2r.sup.4+r.sub.3r.sup.6)+2t.sub.1X.sub.uY.sub.u+t.sub.2(r.sup.2+2X.sub.u).sup.2
Y.sub.d=Y.sub.u(1+r.sub.1r.sup.2+r.sub.2r.sup.4+r.sub.3r.sup.6)+t.sub.1(r.sup.2+2Y.sub.u).sup.2+2t.sub.2X.sub.uY.sub.u

(32) A complete, geometrically correct determination of all camera parameters (calibration matrix K, radial parameters r.sub.i, tangential parameters t.sub.i) requires an initial estimation followed by an iterative minimization of a degree of error, here the reprojection error. When the camera 2 is calibrated and the location of feature M.sub.i on the calibration object 3 is known (world-point P.sub.Wi(X,Y,Z)), these world-points P.sub.Wi(X,Y,Z) can mathematically be projected in the image plane 4. No matter how good the calibration is, however, a deviation between a world-point P.sub.Wi(X,Y,Z) projected in the image plane 4 (image point P.sub.Bi) and the actual depiction of the world-point P.sub.Wi(X,Y,Z) in the real camera image will occur. The distance between the real point and the projected point in space-time P.sub.Wi(X,Y,Z) (image point P.sub.Bi) is the reprojection error.

(33) In the iterative minimization, the error for many points is minimized as a whole, whereby the calibration of the camera 2 is iteratively improved. To avoid a reciprocal influencing between the coordinates of the main point C (C.sub.x, C.sub.y) and the tangential parameters t.sub.1 of the lens distortion, it is advantageous to omit the tangential parameters t.sub.i. On the one hand, the influence of the tangential parameters t.sub.i on the geometric distortion is much less than any of the radial parameters r.sub.i, and on the other hand, a robust estimation of the main point C is required as well for a correction of the chromatic aberration, the vignetting, and for an interpolation of the parameters in relation to a setting specification that deviates from the defined setting specification of a camera setting (in the specific example, these are the wavelength of the light L of the illumination and the focal distance F). The influence of the skew parameter s is generally low, but its consideration is conceivable and would only require an additional multiplication.

(34) To correct the chromatic aberration, the calibration plate is illuminated in the example shown with monochromatic red, green, and blue light (wave length .sub.1, .sub.2, .sub.3). The knowledge about the monochromatic lighting can be used for the correction of the chromatic aberration. This can be done for example by means of the point correspondences obtained from the model according to Hartley & Zisserman or by means of the correction model of geometric distortion (here the radial-tangential model according to Brown-Conrady), i.e., by calculating three independent sets of the inner camera parameters (K.sub.i, r.sub.i and optionally t.sub.i) each for red, green, and blue lighting (wavelength .sub.1, .sub.2, .sub.3). Since this method is generally known, reference is made here to the publication [Ryuji Matsuoka, Kazuyoshi Asonuma, Genki Takahashi, Takuya Danjo, and Kayoko Hirana. Evaluation of correction methods of chromatic aberration in digital camera images. ISPRS Photogrammetric image analysis, 3:25, 2012].

(35) The effect of the vignetting is caused by various influences. A separation is generally made between natural vignetting (due to the incidence angle), pixel vignetting (due to the camera sensor), optical vignetting (due to blocked light paths within the optic), and mechanical vignetting (blocked light paths due to other camera elements such as filters). The vignetting has a radial characteristic and can be addressed by a radial correction model that starts from the main point C. This makes it possible to develop a vignetting function V(r), which is dependent on the radius r. The radius r is determined in the same way as in the distortion. The new corrected pixel intensity I.sub.korr for the correction of the vignetting is obtained by multiplying the intensity I of a pixel with the result of the vignetting function V(r).
V(r)+1+.sub.1r.sup.2+.sub.2r.sup.4+.sub.3r.sup.6 . . .
I.sub.korr=V(r)*I

(36) From the point correspondences that are determined, a calibration matrix K can be obtained for each feature M.sub.i at every setting specification of every camera setting and every camera distance l.sub.K, in the example shown therefore a calibration matrix K for each of the twenty features M.sub.i at each of the three camera distances l.sub.K1, l.sub.K2, l.sub.K3, each of the three wavelengths .sub.1, .sub.2, .sub.3 of the monochromatic lighting, and each of the three focal distances F.sub.1, F.sub.2, F.sub.3. The calibration matrix K may, for example, be determined by means of the known Direct Linear Transform (DLT) algorithm, whereby preferably, in order to improve the result, an iterative optimization of the calibration matrix K is performed, for example by means of the known Levenberg-Marquardt algorithm. Here, the determination of the nonlinear parameters r.sub.1 and r.sub.2 of the distortion must here be added to the parameters of the calibration matrix K.

(37) As a consequence of the use of monochromatic lighting, a wavelength .sub.1, .sub.2, .sub.3 can clearly be assigned to the parameters that were determined. By correcting the geometric distortion of each wavelength .sub.1, .sub.2, .sub.3, the implicit result is a correction of the chromatic aberration. Generally, the measurable error is, due to the chromatic aberration, much smaller than the error of the geometric distortion, which is why the third term (r.sub.3*r.sup.6) is not necessary. Errors of the chromatic aberration are generally, however, much more visible, and foregoing the third term (r.sub.3*r.sup.6) would have a more significant effect here. Preferably, the correction occurs in a first step without the first term, but if a higher correction precision is desired, an adaptation by the third term or a suitable optimization method may be used which minimizes the various point distances between the chosen wavelengths .sub.i.

(38) For the correction of the vignetting, the parameters .sub.i are determined from the formula above. These parameters change with the modification of the camera settings such as the aperture B. In the example shown, the aperture B is constant, which is why images taken at different camera distances l.sub.K1-l.sub.K3 are necessary. For the capturing of the image, a feature M.sub.i must be illuminated with bright, homogeneous, monochromatic light. Should the lighting not be even, several images may be captured and the average value formed thereafter. Theoretically, it would also be possible to calculate the parameters .sub.i from three pixel intensities l.sub.1-l.sub.3 with known radii r.sub.1-r.sub.3 from the main point C and the pixel intensity l.sub.C at the main point C. Since, because of this, small errors may have a significant influence on the result, the correction is performed, as in the present case, preferably by means of a strongly overdetermined system of equations.

(39) The individual correction models of the various aberrations described may be stored separately, for example in the computing unit 5 of the camera 2, or joined and stored as a total correction model in the computing unit 5. This mainly depends on the specific configuration of the computing unit 5 and of the implementation, which is preferably in the form of suitable software.

(40) Each correction of an aberration depends on the modifiable camera settings. The correction parameters K.sub.i, r.sub.i, t.sub.i, .sub.i determined at a specific camera setting with defined setting specifications are therefore only valid for precisely this combination of camera setting and setting specification. If a single set of correction parameters K.sub.i, r.sub.i, t.sub.i, .sub.i were used for all other setting specifications of one or more camera settings, this would lead to extreme aberrations. The camera distance l.sub.K is, as already mentioned, not a modifiable camera setting in the context of the invention because it has no influence on the aberration. The modification of the camera distance l.sub.K in the determination of the correction model is still preferable, however, to obtain a correction model that makes it possible to capture sharp images with the camera 2 in addition to the correction of the aberration.

(41) Since it is impossible, however, to determine the correction parameter K.sub.i, r.sub.i, t.sub.i, .sub.i for each setting specification of each camera setting and optionally for each possible camera distance l.sub.K, or since this would be associated with an unreasonably high expenditure of time, the correction parameters K.sub.i, r.sub.i, t.sub.i, .sub.i for a deviating setting specification of a camera setting and optionally for a camera distance l.sub.K deviating from the chosen camera distances l.sub.K is calculated from the previously determined correction parameters K.sub.i, r.sub.i, t.sub.i, .sub.i. Preferably, the determined correction parameters K.sub.i, r.sub.i, t.sub.i, .sub.i for the chosen setting specifications and optionally for the chosen camera distances l.sub.K are stored in the computing unit 5 of the camera 2, for example when the camera 2 is manufactured in the context of a manufacturing process and/or during a calibration that follows the manufacturing process. When the camera 2 is used, for example by a user, the correction parameters required for the correction of an aberration at a specific setting specification of a camera setting are calculated by the computing unit 5 from the stored correction parameters K.sub.i, r.sub.i, t.sub.i, .sub.i.

(42) An interpolation is preferably used for the calculation of the correction parameters, whereby the correction parameters are preferably determined by means of a hyperbolic function

(43) y = a x + b
and a linear interpolation y=b.sub.1*x+b.sub.0 from the stored correction parameters K.sub.i, r.sub.i, t.sub.i, .sub.i. If more than two points are available in an area to be linearly interpolated, it is preferable to determine a line by means of linear regression. The linear regression differs from the linear interpolation in that the line is arranged in such a way that an error (generally the method of the sum of the smallest squares of the normal distances) is minimized. Preferably, the hyperbolic function is used for the focal width f; linear interpolation is used for all other parameters.

(44) It should be noted as well, however, that not all cameras 2, especially camera lenses 7, act in the same fashion. Some lenses 7 may have a significantly different behavior in the closer focal area than in the further area. Every model of a lens 7 should therefore be examined for this behavior in the intended working area to design the interpolation ranges that are used in a sensible manner.

(45) The method according to the invention for the development of the correction model was explained in the example shown with the help of two modifiable camera settings (wavelength , focal distance F) and three camera distances l.sub.K, but obviously more or less modifiable camera settings and camera distances l.sub.K may be used. If, for example, the aperture B were to be used as an additional modifiable camera setting, at least two different setting specifications would have to be used for the aperture B (different aperture openings) and for each setting specification of the two other modifiable camera settings (wavelength , focal distance F) and the chosen camera distances l.sub.K, an image of feature M.sub.i arranged on the calibration plate would have to be captured. In the case of two modifiable camera settings with three setting specifications and three camera distances l.sub.K each, this would mean 27 images of the calibration plate, as described, with the features M arranged on it, and in the case of three modifiable camera settings and three camera distances l.sub.K 81 images, etc. In general, the number b of the images is b=s.sup.K.Math.L, scustom character>1, Kcustom character, Lcustom character, whereby K is the number of the modifiable camera settings (e.g., focal distance F, aperture B, etc.), s is the number of setting specifications, and L the number of camera distances l.sub.K. As already described, at least two setting specifications are used, whereby three setting specifications (s=3) have been found to be advantageous. The minimum number b.sub.min of images is therefore two, i.e., with only one modifiable camera setting (K=1), two setting specifications (s=2), and one camera distance (L=1).

(46) FIG. 4 shows an example in which a correction model is used for the correction of aberrations when using a camera 2 which was first calibrated.

(47) FIG. 4 shows an industrial image processing system 1 for the measuring of features Mi in a measuring plane E.sub.1 of an object O.sub.1. A camera 2 with an adjustable aperture B has a stationary arrangement in space, for example on a room ceiling 11 or on another suitable retention means. The camera 2 is arranged above the object O.sub.1 so that the measuring plane E.sub.1 with the features M.sub.i that are located in it and that are to be measured lie in the capture range A of the camera 2. The image plane 4 of the camera 2 is located at a certain known camera distance l.sub.Kx from the measuring plane E.sub.1 of the object O.sub.1 and preferably oriented parallel to the measuring plane E.sub.1. A lighting unit 6 illuminates the capture area A with a light L, which has a known wavelength .sub.x. A specific aperture B.sub.x is chosen as the aperture setting. A correction model for the correction of aberrations is stored in a storage unit 5 of the camera 2 which was previously generated by means of the method according to the invention, for example in the context of a calibration during the manufacturing of the camera 2.

(48) In the specific example, it is assumed that the correction mode was generated, as described, for a modifiable camera distance l.sub.K, a modifiable aperture B, and light L with a modifiable wavelength , for example with a calibration plate with fifty features M.sub.i and three setting specifications of the aperture B.sub.1-B.sub.3 each and the wavelength .sub.1-.sub.3 as well as three camera distances l.sub.K1-l.sub.K3. The setting specifications (values of the aperture B.sub.x, the focal distance F.sub.x, and of the camera distance l.sub.Kx) of the application shown in FIG. 4 differs from the setting specifications (B.sub.1-B.sub.3, .sub.1-.sub.3, I.sub.K1-K.sub.K3) of the calibration now; i.e., they substantially have a value that lies between the setting specifications of the calibration (e.g., B.sub.1<B.sub.x<B.sub.3; B.sub.2B.sub.x).

(49) To correct aberrations that are the result of the setting specifications of the application in FIG. 4 deviating from the setting specifications of the calibration, the correction parameters of the correction model stored in the camera 2 are quickly and easily adapted. This is done, for example, in the computing unit 5 of the camera 2, but could also be performed in an external computing unit. To this purpose, the known setting specifications (in the specific case the wavelength .sub.x and the aperture B.sub.x) as well as the camera distance l.sub.Kx are transmitted to the computing unit 5, for example by means of a suitable interface 10. The computing unit 5 then calculates the correction parameters of the correction model for the new setting specifications (wavelength .sub.x and the aperture B.sub.x) as well as the camera distance l.sub.Kx based on the correction parameters that were determined in the context of the calibration. As described, this calculation is preferably performed by means of a hyperbolic function, linear interpolation, or linear regression from the known correction parameters.

(50) This way, the industrial image processing system 1 can quickly and easily be adapted to changing overall conditions. When, for example, the setting of the aperture B changes in the application in FIG. 4, it is not necessary to recalibrate the camera 2 again, as this would be the case in prior art systems, but the new setting of the aperture B is transmitted to the computing unit 5 of the camera 2 by means of the interface 11 and the computing unit 5 calculates the respective correction parameters of the correction model.