APPARATUS AND METHOD FOR COMPENSATING IMAGE DISTORTION

Abstract

Provided is an apparatus for compensating an image distortion and an apparatus for compensating an image distortion according to exemplary embodiments of the present invention, which compensates distortion of an image including a plurality of image division units includes: a compensation rate setting unit setting a variable distortion compensation rate so that the plurality of respective image division units are compensated at different ratios; and a compensation unit compensating the plurality of image division units according to the variable distortion compensation rate set by the compensation rate setting unit.

Claims

1. An apparatus for compensating an image distortion, which compensates distortion of an image including a plurality of image division units, the apparatus comprising: an image center setting unit configured to set a center image division unit among the plurality of image division units; a compensation rate setting unit configured to set a variable distortion compensation rate so that the plurality of respective image division units are compensated at different ratios based on the center image division unit; and a compensation unit configured to compensate the plurality of image division units according to the variable distortion compensation rate set by the compensation rate setting unit.

2. The apparatus of claim 1, wherein the variable distortion compensation rate corresponding to the plurality of image division units is expressed by a polynomial function for a distance up to a corresponding image division unit from the center image division unit, and the compensation rate setting unit sets compensation rate function coefficients of the polynomial function in order to set the variable distortion compensation rate.

3. The apparatus of claim 2, wherein the compensation unit compensates the plurality of image division units according to the variable distortion compensation rate, and as a result, the plurality of respective image division units move as large as a variable ratio and have image information values converted with the movement.

4. The apparatus of claim 3, further comprising: an interpolation unit configured to insert the interpolated image division units into the generated space by compensating the plurality of image division units according to the variable distortion compensation rate by the compensation unit.

5. The apparatus of claim 4, wherein the interpolation unit inserts the interpolation image division unit separately in a horizontal direction and a vertical direction based on the center image division unit.

6. The apparatus of claim 4, wherein the image information value of the interpolation image division unit is set according to the image information values of adjacent image division units.

7. The apparatus of claim 1, further comprising: an image input unit configured to receive the image including the plurality of image division units.

8. The apparatus of claim 4, further comprising: an image output unit configured to output the image interpolated by the interpolation unit.

9. A method for compensating an image distortion, which compensates distortion of an image including a plurality of image division units, the method comprising: setting a center image division unit among the plurality of image division units; setting a variable distortion compensation rate so that the plurality of respective image division units are compensated at different ratios based on the center image division unit; and compensating the plurality of image division units according to the variable distortion compensation rate set in the setting of the compensation rate.

10. The method of claim 9, wherein the variable distortion compensation rate corresponding to the plurality of image division units is expressed by a polynomial function for a distance up to a corresponding image division unit from the center image division unit, and the setting of the compensation rate includes setting compensation rate function coefficients of the polynomial function in order to set the variable distortion compensation rate.

11. The method of claim 10, wherein in the compensating, the plurality of image division units is compensated according to the variable distortion compensation rate, and as a result, the plurality of respective image division units move as large as a variable ratio and have image information values of respective image division units converted with the movement.

12. The method of claim 11, further comprising: interpolating of inserting the interpolated image division units into the generated space by compensating the plurality of image division units according to the variable distortion compensation rate in the compensating.

13. The method of claim 12, wherein in the interpolating, the interpolation image division unit is inserted separately in the horizontal direction and the vertical direction based on the center image division unit.

14. The method of claim 12, wherein the image information value of the interpolation image division unit is set according to the image information values of adjacent image division units.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0031] FIG. 1 is a diagram illustrating a process in which a general image distortion compensating device compensates an image by using a mathematical model.

[0032] FIG. 2 is a diagram illustrating a process in which the general image distortion compensating device compensates the image by using a lookup table.

[0033] FIG. 3 is a block diagram of an apparatus for compensating an image distortion according to an exemplary embodiment of the present invention.

[0034] FIG. 4 is an explanatory diagram illustrating a process in which the apparatus for compensating an image distortion applies a variable distortion compensation rate according to the exemplary embodiment of the present invention.

[0035] FIG. 5 is an explanatory diagram schematically illustrating a plurality of image division units of an input image.

[0036] FIG. 6 is an explanatory diagram illustrating a process in which the apparatus for compensating an image distortion compensates and interpolates the image division units in a horizontal direction according to the exemplary embodiment of the present invention.

[0037] FIG. 7 is an explanatory diagram illustrating a process in which the apparatus for compensating an image distortion compensates and interpolates the image division units in a vertical direction according to the exemplary embodiment of the present invention.

[0038] FIG. 8 is an explanatory diagram illustrating that a distorted image is compensated by the apparatus for compensating an image distortion according to the exemplary embodiment of the present invention.

[0039] FIG. 9 is a flowchart sequentially illustrating a method for compensating an image distortion of the apparatus for compensating an image distortion according to an exemplary embodiment of the present invention.

[0040] It should be understood that the appended drawings are not necessarily to scale, presenting a somewhat simplified representation of various features illustrative of the basic principles of the invention. The specific design features of the present invention as disclosed herein, including, for example, specific dimensions, orientations, locations, and shapes will be determined in part by the particular intended application and use environment.

[0041] In the figures, reference numbers refer to the same or equivalent parts of the present invention throughout the several figures of the drawing.

DETAILED DESCRIPTION

[0042] Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First, when reference numerals refer to components of each drawing, it is to be noted that although the same components are illustrated in different drawings, the same components are denoted by the same reference numerals as possible. Further, in describing the present invention, a detailed explanation of known related configurations and functions may be omitted to avoid unnecessarily obscuring the subject matter of the present invention. Further, hereinafter, the preferred exemplary embodiments of the present invention will be described, but the technical spirit of the present invention is not limited thereto or restricted thereby and the exemplary embodiments can be modified and variously executed by those skilled in the art.

[0043] Hereinafter, an apparatus for compensating an image distortion according to an exemplary embodiment of the present invention will be described with reference to FIGS. 3 to 8.

[0044] FIG. 3 is a block diagram of an apparatus for compensating an image distortion according to an exemplary embodiment of the present invention.

[0045] Referring to FIG. 3, an apparatus 300 for compensating an image distortion according to an exemplary embodiment of the present invention includes an image input unit 310, an image center setting unit 320, a compensation rate setting unit 330, a compensation unit 340, an interpolation unit 350, and an image output unit 360.

[0046] The image input unit 310 may be implemented to receive an image photographed by photographing equipment. The image center setting unit 320 may be implemented to set a center image division unit among a plurality of image division units. The compensation rate setting unit 330 may be implemented to set a variable distortion compensation rate so that the plurality of respective image division units are compensated at different ratios. The compensation unit 340 may be implemented to compensate the plurality of image division units according to the variable distortion compensation rate which is set in the compensation rate setting unit 330. The interpolation unit 350 may be implemented to insert the interpolated image division units into a generated space by compensating the plurality of image division units according to the variable distortion compensation rate by the compensation unit 340. The image output unit 360 may be implemented to output the interpolated image in the interpolation unit 350.

[0047] The image input unit 310 receives the image photographed from the photographing equipment. The photographing equipment includes all devices capable of photographing the image, which include a camera, a CCTV, and the like. In particular, the photographing equipment may include cameras mounted at front, rear, left, and right sides of a vehicle. In this case, the image input into the image input unit 310 from the photographing equipment may include a photograph or a moving picture. Further, the image input into the image input unit 310 includes the plurality of image division units. The image division unit means a unit which may divide the image with a predetermined size. For example, the image division unit may mean a pixel.

[0048] The image center setting unit 320 sets a center image division unit among the plurality of image division units. The image center setting unit 320 may set the image division unit at the center with respect to horizontal and vertical directions of the image as the center image division unit. Further, the image center setting unit 320 may set the image division unit in a part having a most crude distortion in the image as the center image division unit. The image center setting unit 320 may set the center image division unit by various other methods.

[0049] The compensation rate setting unit 330 may set the variable distortion compensation rate so that the plurality of respective image division units are compensated at different ratios. In this case, the compensation rate setting unit 330 may set the variable distortion compensation rate so that the plurality of respective image division units are compensated at different ratios based on the center image division unit set by the image center setting unit 320. For example, the variable distortion compensation rate may be set by the mathematical expression such as the following polynomial equation.

1k.sub.1r.sup.2+k.sub.2r.sup.4+k.sub.3r.sup.6+k.sub.4r.sup.1+k.sub.2r.sup.3+k.sub.3r.sup.5   [Equation 1]

[0050] In this case, r means a distance up to the compensated image division unit in the center image division unit when it is assumed that the image is not distorted and each of k.sub.1, k.sub.2, k.sub.3, and k.sub.4 means a compensation rate function coefficient, that is, a distortion coefficient. The compensation rate setting unit 330 may set the compensation rate function coefficient by considering a lens characteristic, a camera mounting error, a camera monitoring area, and the like. The variable distortion compensation rate shown in Equation 1 is just an example and the compensation rate setting unit 330 may set the variable distortion compensation rate unlike Equation 1. Hereinafter, a process of applying the variable distortion compensation rate to the image will be schematically described with reference to FIG. 4.

[0051] FIG. 4 is an explanatory diagram illustrating a process in which the apparatus for compensating an image distortion applies a variable distortion compensation rate according to the exemplary embodiment of the present invention. In this case, both FIGS. 4A and 4B illustrate an image acquired by applying the distortion compensation rate to an image before a leftmost part is compensated, an image after a center part is compensated, and an image before a rightmost part is compensated.

[0052] FIG. 4A illustrates a process of applying a fixation distortion compensation rate to the image. Referring to the rightmost part in FIG. 4A, it can be seen that the image is continuously enlarged toward an outer periphery from the center image division unit. Therefore, there is a problem that the image positioned in an outer peripheral part of the image before revision is removed from the image after revision.

[0053] FIG. 4B illustrates a process of applying the variable distortion compensation rate. Referring to the rightmost part in FIG. 4B, it can be seen that the image is repeatedly enlarged and reduced toward the outer periphery from the center image division unit. Therefore, it can be seen that the image positioned in the outer peripheral part of the image before revision remains in the image after revision.

[0054] The compensation unit 340 compensates the plurality of image division units according to the variable distortion compensation rate which is set in the compensation rate setting unit 330. In this case, the compensation unit 340 may compensate the plurality of image division units separately in the horizontal direction and the vertical direction based on the center image division unit. The compensation unit 340 compensates the plurality of image division units according to the variable distortion compensation rate, and as a result, the plurality of respective image division units move as large as a variable ratio and image information values of respective image division units are converted with the movement. In this case, the image information value means a pixel value when the image division unit is a pixel. This will be described below with reference to FIGS. 5 to 7.

[0055] The interpolation unit 350 inserts the interpolated image division units into the generated space by compensating the plurality of image division units according to the variable distortion compensation rate by the compensation unit 340. The interpolation unit 350 may insert the interpolation image division unit separately in the horizontal direction and the vertical direction based on the center image division unit. In this case, the image information value of the interpolation image division unit is set according to the image information values of adjacent image division units. In this case, as described above, the image information value means the pixel value when the image division unit is the pixel. Hereinafter, a process of compensating and interpolating the plurality of image division units will be described with reference to FIGS. 5 to 7.

[0056] In the following description, the description is made by premising that the image division unit is the pixel.

[0057] FIG. 5 is an explanatory diagram schematically illustrating a plurality of image division units of an input image.

[0058] Referring to FIG. 5, it can be seen that an image 501 input into the image input unit 310 includes the plurality of image division units. In this case, for easy description, the image division unit at the center of the image 501 input into the image input unit 310 is premised as a center image division unit 502. Further, reference numeral 502 which is displayed in the center image division unit 502 means a position of the image division unit, a reference numeral 50 means a pixel value of the center image division unit 502, and it is premised that other image division units are also similar.

[0059] FIG. 6 is an explanatory diagram illustrating a process in which the apparatus for compensating an image distortion compensates and interpolates the image division units in a horizontal direction according to the exemplary embodiment of the present invention.

[0060] The compensation unit 340 compensates the image division units at left and right sides based on the center image division unit 502 according to the variable distortion compensation rate, and as a result, the respective image division units at the left and right sides based on the center image division unit 502 move as large as the variable ratio and the resulting pixel value is converted.

[0061] Referring to FIG. 6, a first image division unit 515 at the right side in the center image division unit 502 before revision moves to the right side as large as a variable ratio 610 to move to a position of an image division unit 516 which is positioned at a second position to the right side in the center image division unit 502 before revision. In this case, in the image division unit 515 which is positioned at a first position to the right side in the center image division unit 502 before revision, the pixel value is converted from 60 to 70. That is, the image division unit 515 positioned at the first position to the right side in the center image division unit 502 before the revision moves as large as the variable ratio 610 and the pixel value is thus converted not to have values before the revision, substantially resulting in regenerating the image division unit.

[0062] Referring to FIG. 6, an image division unit 516 at the second position to the right side in the center image division unit 502 before the revision moves to the right side as large as a variable ratio 620 to move to a position of an image division unit 519 which is positioned at a fifth position to the right side in the center image division unit 502 before revision. In this case, in the image division unit 516 which is positioned at the second position to the right side in the center image division unit 502 before revision, the pixel value is converted from 70 to 100. That is, the image division unit 516 positioned at the second position to the right side in the center image division unit 502 before revision moves as large as the variable ratio 620 and the resulting pixel value does not have values before revision, substantially resulting in regenerating the image division unit.

[0063] Meanwhile, in the example, only the process in which the respective image division units positioned at the left and right sides based on the center image division unit 502 move according to an increased ratio and the resulting pixel value is converted is described, but the image division unit moves as large as the variable ratio and a resolution is converted, and as a result, it is apparent that the respective image division units at the left and right sides based on the center image division unit 502 may move according to a reduced ratio and the result pixel value may be converted.

[0064] In the example, only the image division unit 515 positioned at the first position to the right side and the image division unit 516 positioned at the second position to the right side in the center image division unit 502 before the revision are described, but the example may be similarly applied to residual image division units at the left and right sides based on the center image division unit 502.

[0065] Thereafter, the interpolation unit 350 may insert interpolation image division units 531, 532, and 533 into spaces generated as the respective image division units at the left and right sides based on the center image division unit 502 move as large as the variable ratio. In this case, the pixel value of the interpolation image division unit is set according to the pixel values of adjacent image division units. This means that the pixel value of the interpolation image division unit is set to have a value to minimize the distortion of the image by considering the pixel values of the adjacent image division units. In detail, the pixel value of the interpolation image division unit may be set to have a predetermined value which is most influenced by the pixel values of image division units which are most adjacent to the interpolation image division unit.

[0066] For example, an interpolation image division unit 531 inserted between the center image division unit 502 and the image division unit 515 positioned at the first position to the right side in the center image division unit 502 after the revision is most influenced by 50 which is the pixel value of the center image division unit 502 and 70 which is the pixel value of the image division unit 515 positioned at the first position to the right side in the center image division unit 502 after the revision to have 62 which is a predetermined value.

[0067] The interpolation image division units 532 and 533 inserted between the image division unit 515 at the first position to the right side in the center image division unit 502 after the revision and the image division unit 516 at the second position to the right side in the center image division unit 502 after revision are most influenced by 70 which is the pixel value of the image division unit 515 at the first position to the right side in the center image division unit 502 after revision and 100 which is the pixel value of the image division unit 516 at the second position to the right side in the center image division unit 502 after the revision to have 83 and 94 which are predetermined values, respectively.

[0068] In this case, in the example, only the case where the pixel values of the interpolation image division units 531, 532, and 533 have values among the pixel values of the adjacent image division units is illustrated, but since the corresponding pixel values have predetermined values for minimizing the distortion of the image, the corresponding pixel values may have values other than the values among the pixel values of the adjacent image division units.

[0069] FIG. 7 is an explanatory diagram illustrating a process in which the apparatus for compensating an image distortion compensates and interpolates the image division units in a vertical direction according to the exemplary embodiment of the present invention.

[0070] The compensation unit 340 compensates the image division units at upper and lower sides based on the center image division unit 502 according to the variable distortion compensation rate, and as a result, the respective image division units at the upper and lower sides based on the center image division unit 502 move as large as the variable ratio and the resulting pixel value is converted. A detailed description thereof is described with reference to FIG. 6, and as a result, the detailed description is omitted.

[0071] Thereafter, the interpolation unit 350 may insert interpolation image division units 531, 532, and 533 into spaces generated as the respective image division units at the upper and lower sides based on the center image division unit 502 move as large as the variable ratio. In this case, the pixel value of the interpolation image division unit may be set according to the pixel values of adjacent image division units. A detailed description thereof is described with reference to FIG. 6, and as a result, the detailed description is omitted.

[0072] Hereinafter, an advantage generated by compensating the distorted image by the apparatus for compensating an image distortion according to the exemplary embodiment of the present invention will be described with reference to FIG. 8.

[0073] FIG. 8 is an explanatory diagram illustrating that a distorted image is compensated by the apparatus for compensating an image distortion according to the exemplary embodiment of the present invention. In this case, FIG. 8A is a diagram illustrating the image before revision, FIG. 8B is a diagram illustrating the image compensated by the image distortion compensating apparatus in the related art, and FIG. 8C is a diagram illustrating the image compensated by the apparatus for compensating an image distortion according to the present invention.

[0074] Referring to FIG. 8B, it can be seen that the image distortion compensating apparatus in the related art compensates the image according to the fixation distortion compensation rate to remove the outer periphery part in the image before revision. Further, it can be seen that the image is compensated to seem to be closer than the actual distance, and as a result, the perspective error also occurs.

[0075] However, referring to FIG. 8C, it can be seen that the image distortion compensating apparatus according to the present invention compensates the image according to the variable distortion compensation rate to conserve a distorted part in the image before revision. Further, it can be seen that the image is compensated to seem to be similar to the actual distance, and as a result, the perspective error is also minimized. That is, when the image is compensated by the apparatus for compensating an image distortion according to the present invention, the blind spot is minimized and the perspective error is minimized.

[0076] Hereinafter, a method for compensating an image distortion according to an exemplary embodiment of the present invention will be described with reference to FIG. 9. In this case, the description of a part which is duplicated with the part described with reference to FIGS. 3 to 8 is omitted.

[0077] FIG. 9 is a flowchart sequentially illustrating a method for compensating an image distortion of an apparatus for compensating an image distortion according to an exemplary embodiment of the present invention.

[0078] Referring to FIG. 9, first, the image input unit 310 receives an image including a plurality of image division units (S101).

[0079] Thereafter, the image center setting unit 320 sets a center image division unit among the plurality of image division units (S103).

[0080] Thereafter, the compensation rate setting unit 330 sets the variable distortion compensation rate so that the plurality of respective image division units are compensated at different ratios based on the center image division unit (S105).

[0081] Thereafter, the compensation unit 340 compensates the plurality of image division units according to the variable distortion compensation rate (S107).

[0082] Thereafter, the interpolation unit 350 inserts the interpolated image division units into the generated space by compensating the plurality of image division units according to the variable distortion compensation rate (S109).

[0083] Thereafter, the image output unit 360 outputs the image interpolated in step S109 (S111).

[0084] As described above, the exemplary embodiments have been described and illustrated in the drawings and the specification. The exemplary embodiments were chosen and described in order to explain certain principles of the invention and their practical application, to thereby enable others skilled in the art to make and utilize various exemplary embodiments of the present invention, as well as various alternatives and modifications thereof. As is evident from the foregoing description, certain aspects of the present invention are not limited by the particular details of the examples illustrated herein, and it is therefore contemplated that other modifications and applications, or equivalents thereof, will occur to those skilled in the art. Many changes, modifications, variations and other uses and applications of the present construction will, however, become apparent to those skilled in the art after considering the specification and the accompanying drawings. All such changes, modifications, variations and other uses and applications which do not depart from the spirit and scope of the invention are deemed to be covered by the invention which is limited only by the claims which follow.