Moving flying object for scanning an object, and system for analyzing damage to the object

Abstract

An aircraft that includes a helicopter drone on which a 3D scanner is mounted via an actively rotatable joint is provided. The 3D scanner has at least one high-resolution camera for recording a multiplicity of overlapping images of the object from different recording positions and recording directions, so that comparison of the images allows a position and orientation of the 3D scanner relative to the object to be ascertained. In addition, the aircraft has a coordination device for coordinated control of the 3D scanner, the joint and the helicopter drone. The system for damage analysis has an aircraft and an image processing module generating a data representation of a surface profile of the object on the basis of the recorded images. In addition, the system includes a rating device for checking the surface profile and for outputting a damage statement on the basis of the check.

Claims

1. A system for analyzing damage comprising: a) a helicopter drone for scanning an object; b) a three-dimension (3-D) scanner which is mounted on the helicopter drone via an actively rotatable joint and has at least one high-resolution camera for recording a multiplicity of overlapping images of the object from different recording positions and recording directions, with a result that a position and an orientation of the 3-D scanner relative to the object is determined by comparing the multiplicity of overlapping images wherein the 3-D scanner has a projector for projecting structured light onto the object and the at least one high-resolution camera is designed to resolve light structures projected onto the object; c) a coordination device for controlling the 3-D scanner the actively rotatable joint and the helicopter drone in a coordinated manner, wherein the coordination device is set up to determine a position and/or an orientation of the moving flying object relative to the object on the basis of the recorded images and, on the basis thereof, to transmit flight instructions to the helicopter drone rotation instructions to the actively rotatable joint scanning instructions to the 3-D scanner and/or recording instructions to the at least one camera; d) an image processing module for generating a data representation of a surface profile of the object on the basis of the recorded images; e) an assessment device for checking the surface profile and for outputting a statement of damage on the basis of the check; and f) a simulation device for simulating a static and/or dynamic behavior of the object on the basis of the surface profile to determine an effect on a function of the object, and in that the assessment device is set up to compare the simulated behavior with a predefined desired behavior of the object and to output the statement of damage on the basis of the comparison result.

2. The system for analyzing damage as claimed in claim 1, wherein the 3-D scanner is a mobile 3-D scanning system having a plurality of spatially offset cameras.

3. The system for analyzing damage as claimed in claim 1, further comprising a marking device for optically marking specific points of a surface of the object.

4. The system for analyzing damage as claimed in claim 1, further comprising a battery to be jointly used by the helicopter drone and the 3-D scanner.

5. The system for analyzing damage as claimed in claim 1, wherein the image processing module is set up to capture common image patterns in the overlapping region in different overlapping images to assign the different images to one another with respect to the common image pattern, and to determine a surface profile across images on the basis of the images assigned to one another.

6. The system for analyzing damage as claimed in claim 5, wherein the image processing module is set up to capture a geometrical structure and/or texture of the object surface and/or a light structure projected onto the object as image patterns.

7. The system for analyzing damage as claimed in claim 1, wherein the simulation device is set up to generate a volume model of the object on the basis of the surface profile and to simulate the behavior on the basis of the volume model.

Description

BRIEF DESCRIPTION

(1) Some of the embodiments will be described in detail, with references to the following Figures, wherein like designations denote like members, wherein:

(2) FIG. 1A shows a front view of a moving flying object according to embodiments of the invention;

(3) FIG. 1B shows a view of the moving flying object from below, in accordance with embodiments of the present invention; and

(4) FIG. 2 shows a block diagram of a system for analyzing damage to an object, in accordance with embodiments of the present invention.

DETAILED DESCRIPTION

(5) FIGS. 1A and 1B each show a schematic illustration of a moving flying object FM according to embodiments of the invention for scanning an object. Whereas FIG. 1A shows a front view of the moving flying object FM, FIG. 1B illustrates a view of the same moving flying object FM from below.

(6) The moving flying object FM comprises a helicopter drone which can be remotely controlled in an interactive manner and on which a 3-D scanner SC is mounted via an actively rotatable joint G. The helicopter drone has, by way of example, four uplift units AE each with an electric motor which drives a vertically acting propeller. Alternatively, it is also possible to use a helicopter drone having a different number of uplift units, for example a so-called octocopter drone having eight uplift units. The helicopter drone also has four support legs SB.

(7) A mobile, high-precision 3-D scanning system, for example with white light/blue light/flashlight technology, is used as the 3-D scanner SC. Such mobile 3-D scanning systems have only been recently available and are often used in handheld 3-D scanners. The mobile 3-D scanning systems can achieve scanning accuracies of approximately 1/30 mm even in the case of moderate movement fluctuations, which is within the drawing tolerances of many components produced with high precision. In addition, mobile 3-D scanners may weigh less than one kilogram and their largest dimension may remain under 30 cm. Such a compact design enables transport by helicopter drone for the first time. The scanning distance of such 3-D scanners may reach approximately one meter, with the result that it is generally not difficult to avoid collisions between the moving flying object FM and an object to be scanned. A spatial offset of the helicopter drone as a result of gusts of wind can be corrected using contemporary mobile 3-D scanning technology since both geometrical and texture information relating to the scanned object and a projection of structured light can be used to merge scanning sections. A mobile 3-D scanner can output an accurate geometrical description of a surface of the scanned object in the form of a triangulation, for example in the so-called stl format.

(8) The joint G has a horizontal axis of rotation and a vertical axis of rotation which can each be rotated using an electric motor. As a result, the 3-D scanner SC can be rotated both about the horizontal drone axis and about the vertical drone axis, with the result that the object can also be scanned from above by suitably controlling the joint G.

(9) The 3-D scanner SC comprises a plurality of high-resolution cameras C (illustrated only in FIG. 1A). In the present exemplary embodiment, the 3-D scanner SC has three spatially offset, high-resolution cameras C having a different viewing direction for recording a multiplicity of overlapping images of the object to be scanned from different recording positions and recording directions. The cameras C have such a high resolution that a scanning accuracy of fractions of a millimeter, for example 1/30 mm, can be achieved, and a position and an orientation of the 3-D scanner SC relative to the surface of the object to be scanned are possible by identifying and comparing image patterns contained in different images.

(10) In addition, the 3-D scanner SC has a projector P (illustrated only in FIG. 1A) for projecting structured light onto the object to be scanned. In the present exemplary embodiment, the projector P is annularly arranged around a central one of the three cameras C.

(11) The moving flying object FM also has a controller CTL for controlling the moving flying object FM. The controller CTL is surrounded with a housing for protecting against precipitation and other weather effects.

(12) FIG. 2 shows a block diagram of a system according to embodiments of the invention for analyzing damage to an object OBJ. The system comprises a moving flying object FM according to embodiments of the invention, a remote control RC and an analysis device AN. The moving flying object FM is implemented as described in connection with FIGS. 1A and 1B and is used to scan and analyze the damage to the object OBJ. The object OBJ to be analyzed may be a rotor blade of a wind power plant, for example.

(13) The moving flying object FM comprises a helicopter drone HD having a rechargeable battery BAT which supplies the drive of the helicopter drone with energy. As already stated above, a 3-D scanner SC is mounted on the helicopter drone HD via a joint G. The 3-D scanner SC and the joint G are implemented as described in connection with FIGS. 1A and 1B.

(14) The moving flying object FM also has a marking device M, a memory MEM, a wireless transceiving device TX/RX and a controller CTL. The 3-D scanner SC and the controller CTL are also supplied with energy by the battery BAT. The joint use of the battery BAT is advantageous in comparison with a use of separate batteries in so far as it is possible to avoid the situation in which a first battery is empty and the mission is thus terminated if another battery still has energy reserves. This applies, in particular, since the helicopter drone HD and the 3-D scanner SC often each have a greatly fluctuating energy requirement independently of one another.

(15) As indicated in FIG. 2 by means of a dotted double-headed arrow, the 3-D scanner SC projects structured light onto the object OBJ to be analyzed and, during this, records a multiplicity of overlapping high-resolution images IMG of the object OBJ from different recording positions and recording directions by means of the cameras C. In particular, the images IMG are recorded in a spatially and temporally offset manner. The recorded images IMG are initially stored by the 3-D scanner SC in the memory MEM in order to reduce a bandwidth required for radio communication with the remote control RC or possibly with the analysis device AN.

(16) The marking device M is used to optically mark specific points of a surface of the object OBJ. Markings can be applied, for example by spraying on ink, at specifically predefined and/or exposed points of a surface of the object OBJ and/or at points with low visual structuring, for example.

(17) The transceiving device TX/RX is used to remotely control the moving flying object FM and to transmit recorded images. The high-resolution images IMG recorded by the 3-D scanner SC are preferably transmitted with a reduced resolution or lower-resolution images from a camera provided for this purpose are transmitted in order to reduce the required radio transmission bandwidth. The resolution of the images to be transmitted is preferably selected in such a manner that the moving flying object FM can still be safely remotely controlled by an operator of the moving flying object FM on the basis of the transmitted images.

(18) The remote control RC is accordingly used for interactive remote control of the moving flying object FM by the operator and to receive and display the transmitted images.

(19) The controller CTL comprises a coordination device CO for controlling the 3-D scanner SC, the joint G, the helicopter drone HD and the marking device M in a coordinated manner. The coordination is carried out, in particular, on the basis of the recorded images IMG which are transmitted from the 3-D scanner SC to the coordination device CO for this purpose. On the basis of the recorded images IMG, the coordination device CO determines the position and orientation of the moving flying object FM relative to the object OBJ. On the basis of this, the coordination device CO then transmits flight instructions FA to the helicopter drone HD, specific rotation instructions for the axes of rotation of the joint G to the joint G, scanning instructions SA to the 3-D scanner SC and/or marking instructions MA to the marking device M in a coordinated manner. In this case, the scanning instructions SA may comprise recording instructions for a respective camera C.

(20) The analysis device AN evaluates the recorded high-resolution images IMG in order to carry out a damage analysis. The analysis device AN can be implemented as a separate system or may be completely or partially integrated in the moving flying object FM or the remote control RC. The analysis device AN comprises one or more processors PROC for carrying out all analysis steps.

(21) In order to carry out the damage analysis, the recorded high-resolution images IMG are read from the memory MEM and are transmitted to an image processing module IP of the analysis device AN. The image processing module IP generates a data representation of a surface profile OBV of the scanned object OBJ on the basis of the recorded images IMG. The data representation preferably describes a profile of a two-dimensional surface of the object OBJ in three-dimensional space, for example in the form of a triangulation. Such a triangulation can be represented in the so-called stl format, in particular.

(22) In order to generate the surface profile OBV, the image processing module IP attempts to identify and capture common image patterns in the overlapping region in different images of the overlapping images IMG using a pattern recognition method. Geometrical structures and/or textures of the object surface and/or a light structure projected onto the object OBJ or markings applied thereto can be captured in this case as image patterns. If a common image pattern is identified in different images, these images can be assigned to one another with respect to the common image pattern, with the result that the image patterns of these images are imaged onto one another with imaging fidelity. A surface profile across images can then be determined on the basis of the images assigned to one another. Such assignment and combination of different images with imaging fidelity or in a manner true to the image pattern to form a surface profile across images is often also referred to as “stitching”.

(23) The position and orientation of the 3-D scanner SC relative to the object OBJ can also be determined on the basis of the images assigned to one another.

(24) The image processing module IP can be separately integrated in the moving flying object FM or in the 3-D scanner SC independently of other components of the analysis device AN. This allows preprocessing of the high-resolution images IMG in the moving flying object FM or in the 3-D scanner SC.

(25) The image processing module IP transmits the generated data representation of the surface profile OBV to a simulation device SIM for simulating a static or dynamic behavior V of the object OBJ on the basis of the surface profile OBV. In this case, the simulation device SIM first of all generates a volume model VM of the object OBJ on the basis of the surface profile OBV and finally simulates the behavior V on the basis of the volume model VM. The structure and fluid-mechanical effects of damage and therefore a severity of the damage can be automatically assessed using the simulation.

(26) The simulated behavior V is transmitted, in the form of a suitable data representation, from the simulation module SIM to an assessment device EV of the analysis device AN. Furthermore, a predefined desired behavior SV of the object OBJ is read in by the assessment device EV. The latter then compares the simulated behavior V with the predefined desired behavior SV and outputs a statement of damage DAM on the basis of the comparison result. In this case, it is possible to predefine a distance dimension for a discrepancy between the desired behavior SV and the simulated behavior V, which distance dimension is compared with a threshold value. If the threshold value is exceeded, existing or imminent damage can then be indicated by means of a corresponding statement of damage DAM. On the basis of this, it is possible to decide whether or not an affected component should be replaced.

(27) The surface profile OBV is checked with respect to its effects on a function of the object OBJ by means of the simulation and the comparison of the simulated behavior V with the desired behavior SV. Alternatively or additionally, the surface profile OBV can also be directly compared with a predefined desired profile in order to output the statement of damage DAM on the basis thereof.

(28) The embodiment makes it possible to inspect even components which are difficult to access, those of for example wind power plants, ships or aircraft, in situ without complicated removal. On account of the simulation of the effects of visible damage, it is immediately possible to decide in many cases whether or not damage is acceptable.

(29) Although the invention has been illustrated and described in greater detail with reference to the preferred exemplary embodiment, the invention is not limited to the examples disclosed, and further variations can be inferred by a person skilled in the art, without departing from the scope of protection of the invention.

(30) For the sake of clarity, it is to be understood that the use of “a” or “an” throughout this application does not exclude a plurality, and “comprising” does not exclude other steps or elements.