METHOD FOR SELECTION OF CAMERA IMAGE SECTIONS

Abstract

A method for monitoring the process in laser material processing and provides a corresponding method, comprising the steps of taking a real-time image comprising the position and surrounding of the process where material processing occurs by a camera that is arranged in or on a laser material processing head; determining at least one image section in the real-time image and its position on a camera sensor; determining an actual position of the process in the material processing, and a nominal position of the relevant image detail using a projection of programmed path data for controlling the laser material processing head in the section of the real-time image, and the transfer of the at least one image section from the camera to a computer.

Claims

1. A method of monitoring the process of laser material processing, comprising the steps of: a. recording a real-time image comprising the position and surroundings of the process during material processing by a camera arranged in or on a laser material processing head; b. determining at least one image section in the real-time image and its location on a camera sensor, including the determination of: i. a current position of the process in material processing; and ii. a nominal position of the relevant image section using a projection of programmed path data for controlling the laser material processing head in the section of the real-time image; and c. transferring the at least one image section from the camera to a computer.

2. The method of claim 1, comprising calculating deviations between future actual and nominal positions.

3. The method of claim 2, further comprising allocation of the determined deviations with the programmed orbit data for predicting future image excerpts.

4. The method of claim 1, wherein the to a camera transmitted at least one image section is edited.

5. The method of claim 1, wherein the at least one image section recorded before or after the process of material processing is used to determine the processing speed.

6. The method of claim 1, comprising the recording of real-time images or a sequence when joining or separating workpieces.

7. The method of claim 1, wherein the camera is calibrated prior to performing the method.

8. The method of claim 1, wherein the calibration comprises the focus on the position of the workpiece to be machined.

9. The method of claim 1, wherein the path data additionally comprise predefined points of interest.

10. The method of claim 1, wherein the real-time images or the sequence of realtime images are stored.

11. The method of claim 1, wherein the relevant image section and/or the sequence of image sections can be stored for documentation.

12. The method of claim 1, wherein the data are derived from a selected section and compared with data stored in a database.

13. The method of claim 1, wherein data are derived from the at least one image section and are stored.

14. The method of claim 1, wherein the laser material processing head controls other devices based on determined deviations between future actual and nominal values.

15. The method of claim 1, wherein the laser material processing head and/or the workpiece is guided depending on determined deviations between future actual and nominal positions.

16. The method of claim 1, wherein the laser power is adjusted according to the determined deviations between the actual and nominal values.

17. The method of claim 1, wherein an actuator is set within the laser material processing head on the basis of determined deviations between actual and nominal values.

18. A method for selecting sections from camera images, comprising the steps of a. recording of a real-time image and/or a sequence of real-time images before, during or after material processing by a camera arranged on a laser material processing head; b. projecting the path data for controlling the laser material processing head in the material processing in the real-time image and/or the sequence of real-time images; c. selection of at least one image section in the real-time image and/or a sequence of real-time images; wherein the method is performed in laser material processing.

Description

BRIEF DESCRIPTION OF THE FIGURES

[0040] The invention will be described based on figures. It will be understood that the embodiments and aspects of the invention described in the figures are only examples and do not limit the protective scope of the claims in any way. The invention is defined by the claims and their equivalents. It will be understood that features of one aspect or embodiment of the invention can be combined with a feature of a different aspect or aspects of other embodiments of the invention, in which:

[0041] FIG. 1 shows in its left part a seam to be welded (line, 1), the working area of the remote welding head (large rectangle, 2) and the camera image (small square, 5). The middle part shows the camera image (large square, 5), the seam to be welded (line, 1) and the image section (area of interest, AOI, small rectangle, 10). The right part of the FIGURE shows the image section (large Square, 10), the seam to be welded (Line, 1) and the center of the picture (point in the square, 12)

DETAILED DESCRIPTION OF THE INVENTION

[0042] The above-stated object of the invention is achieved by the features of the independent claims. The dependent claims cover further specific embodiments of the invention.

[0043] The invention provides a method by which the material processing of a workpiece before, during or after the joining or cutting process can be monitored or even corrected. In this case, the future position of the position of the material processing is calculated beforehand by the combined use of the pathe data on which the processing head is to be guided together with a section of a real-time image of the material processing.

[0044] By means of the method according to the invention, it is possible to monitor prior to the process, that is to say where welding is going to take place soon. Thus, the actual state of the nominal position of the position of the material processing can be detected and corrected. Thus, the position of the (future) process can already be corrected and not the current process or the current position of the material processing process. Time is needed for such a correction. The method according to the invention advantageously makes it possible to look ahead a few millimeters (ie into the future). The approximate location of the future location can be deduced, in particular in the remote welding process, from the current welding position in combination with the known desired position from the programmed path.

[0045] A position may also be considered at which the process itself took place within the meaning of that welding occurred. In this case, quality control is usually the aim. The relevant position can be deduced from the position where welding took place, i.e. from the data that are available to the remote welding head, possibly including the correction discussed in the previous paragraph.

[0046] It is still possible to look at the ongoing process, i.e. the position at which welding is currently being carried out. This variant offers the possibilities to regulate the process itself. However, this location is also well known, both in the real space and on the camera.

[0047] Due to the use of the planned and known path data of the laser material processing head, the method of the present invention allows not only to match the actual state with a nominal state or accurately reproduce the position of the process of material processing, but on the basis of using of previously known data for path guidance of the laser processing head even directly upcoming events may be taken into account. Thus, the selection of the image area can already be planned in advance, wherein the processing of the image is faster because less data due to the reduction of the pixels to be transmitted and processed. As a result, relatively complex algorithms can be used, and it is nevertheless ensured to edit or determine the relevant image sections fast enough.

[0048] In the method according to the invention, the image area can be selected freely within the search range of a camera at runtime. In connection with the method according to the invention, it should be emphasized that the selection of the image area is accompanied by a reduction of the pixels. A calculation of the measured deviations from the programmed path takes place and based the relevant section in the camera image is predicted on that basis. In the method according to the invention, it is also possible to use only the programmed path for prediction, that is to say completely without seam guidance.

[0049] FIG. 1 shows in the left part the seam 1 to be welded, the working space 2 of the remote welding head and the camera image 5. In the center of FIG. 1, the camera image 5, the seam 1 to be welded and the relevant area of interest (AOI) are shown. The image section 10 shows the necessary area of the entire camera compartment 5, which is sufficient for the method according to the invention.

[0050] In the right part of FIG. 1, the image section 10 is shown, which can be seen to be welded seam 1 and the image center 12. The image center 12 corresponds to the position at which the remote welding head predicts the seam.

[0051] The remote welding head can weld seams anywhere in its working space 2 (FIG. 1, left part of the image). Also, there are no restrictions on the orientation of the seams to the workspace and thus to the remote weld head.

[0052] The seams are preprogrammed, so the remote welding head knows the course of the seams in the three-dimensional space. However, there may be small deviations in the space during processing, because the work piece has a different than planned, the preparation of the work piece was less accurate, or the welding head is differently orientated in space. In order to ensure that welding takes place exactly where welding should take place, according to the invention, a point is considered which is to be welded in immediate proximity, i.e. a few milimeter before the position of the actual welding process. Because this can be everywhere in principle, a camera takes up the entire spatial area around the position of the welding process (see FIG. 1, Middle).

[0053] According to the present invention, it is intended not to use the entire camera image, since too many pixels would be included in the calculation, making the calculation more complex resulting in more computing time that will be needed. Furthermore, using the entire image, many different details are seen in the image which are not relevant, and which may interfere with seam detection algorithms.

[0054] According to the invention, therefore, a small image section (=AoI, Area of Interest) is selected. It is intended to weld in this image section at time T2. However, this is in the future, so there is still time for correction. Thus, already at time T1, the current time of processing, it has to be determined where image section time T2 will lie exactly. This is calculated from the current (T1) position of the welding process and the programmed path, ultimately from the course of the nominal seam. Since the determination takes place in close spatial proximity, a few millimeters before the position of the welding process, the deviation between the nominal and actual seam is small and the actual seam is still located in the selected image section (FIG. 1, right part of the image).

[0055] FIG. 1 and the text above describe the method of selecting a patch if it is to be used for seam tracking. A similar process can be used to look into the welding process itself or to take the pictures of the already welded seam, e.g. for quality control. These positions can be calculated exactly from the available data. Likewise, these methods can be applied to other laser material processing processes, such as e.g. laser cutting.

[0056] The foregoing description of the preferred embodiment of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and modifications and variations are possible in light of the above teachings or may be acquired from practice of the invention. The embodiment was chosen and described in order to explain the principles of the invention and its practical application to enable one skilled in the art to utilize the invention in various embodiments as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims appended hereto, and their equivalents. The entirety of each of the aforementioned documents is incorporated by reference herein.

REFERENCE NUMERALS

[0057] 1 seam (to be welded) [0058] 2 Workspace remote welding head [0059] 5 camera image [0060] 10 image section [0061] 12 image center