FULL-AUTOMATIC CALIBRATION METHOD AND APPARATUS ORIENTED TO STRUCTURED LIGHT 3D VISION SYSTEM

Abstract

A full-automatic calibration method and apparatus oriented to a structured light 3D vision system are disclosed. For an erected 3D vision system, full-automatic calibration can be completed without moving the 3D vision system; and for an unfixed 3D vision system, full-automatic calibration can be completed without manual operation. By using the full-automatic calibration method oriented to the structured light 3D vision system, on one hand, non-professionals can easily complete calibration of structured light 3D imaging; and on the other hand, a problem of calibrating a large number of 3D cameras can also be solved.

Claims

1. A full-automatic calibration method oriented to a structured light 3D vision system, comprising the following steps of: erecting a 3D vision system and a manipulator; mounting a calibration target and a controllable lighting system on the manipulator; initializing a position of the manipulator; and running an automatic calibration system, and outputting calibration results.

2. The full-automatic calibration method oriented to a structured light 3D vision system of claim 1, wherein the running an automatic calibration system comprises the following steps of: 1) taking 20 sets of pictures, with 45 pictures in each set; 2) inputting the 20 sets of pictures into a calibration algorithm of Zhang Zhengyou, and detecting results; 3) adding one set of recorded results; 4) if a number of sets of “recorded results” is less than 2, returning to step 1); otherwise, going to step 5); 5) if the number of sets of “recorded results” is equal to 2, going to step 6); 6) if a result difference is less than a set threshold, going to step 7); otherwise, returning to step 1); and 7) averaging, and outputting results.

3. The full-automatic calibration method oriented to a structured light 3D vision system of claim 2, wherein the taking 20 sets of pictures comprises the following steps of: 1) starting single-picture taking; 2) if a picture is obtained, continuing next step; and if no picture is obtained, searching for a picture; 3) performing hexagonal shift in a Z plane, taking a picture at each position, and judging a number of angular points and sorting the angular points; 4) if no picture is obtained, expanding a search range; 5) if no picture is obtained yet, returning to an original point, adjusting a direction of the Z plane by 45 degrees, and repeating operations; 6) if a position of a largest angular point is found, adjusting a direction and a brightness of the 3D vision system to obtain a first complete front picture, and recording the position; 7) adjusting an angle to obtain a set of pictures; 8) adjusting a distance to obtain a set of pictures; and 9) obtaining 20 sets of pictures in total, with 50 pictures in each set.

4. The full-automatic calibration method oriented to a structured light 3D vision system of claim 1, wherein the running an automatic calibration system is performed for calibration for twice or three times.

5. (canceled)

6. A full-automatic calibration device oriented to a structured light 3D vision system, comprising: at least one processor; and a memory in communication with the at least one processor; wherein, the memory is configured to store an instruction executable by the at least one processor, and the instruction, when executed by the at least one processor, causes the at least one processor to perform a full-automatic calibration method comprising the following steps of: erecting a 3D vision system and a manipulator; mounting a calibration target and a controllable lighting system on the manipulator; initializing a position of the manipulator; and running an automatic calibration system, and outputting calibration results.

7. A computer-readable storage medium, wherein the computer-readable storage medium stores a computer-executable instruction, and the computer-executable instruction is configured for enabling a computer to perform a full-automatic calibration method comprising the following steps of: erecting a 3D vision system and a manipulator; mounting a calibration target and a controllable lighting system on the manipulator; initializing a position of the manipulator; and running an automatic calibration system, and outputting calibration results.

8. The full-automatic calibration device oriented to a structured light 3D vision system of claim 6, wherein the running an automatic calibration system comprises the following steps of: 1) taking 20 sets of pictures, with 45 pictures in each set; 2) inputting the 20 sets of pictures into a calibration algorithm of Zhang Zhengyou, and detecting results; 3) adding one set of recorded results; 4) if a number of sets of “recorded results” is less than 2, returning to step 1); otherwise, going to step 5); 5) if the number of sets of “recorded results” is equal to 2, going to step 6); 6) if a result difference is less than a set threshold, going to step 7); otherwise, returning to step 1); and 7) averaging, and outputting results.

9. The full-automatic calibration device oriented to a structured light 3D vision system of claim 8, wherein the taking 20 sets of pictures comprises the following steps of: 1) starting single-picture taking; 2) if a picture is obtained, continuing next step; and if no picture is obtained, searching for a picture; 3) performing hexagonal shift in a Z plane, taking a picture at each position, and judging a number of angular points and sorting the angular points; 4) if no picture is obtained, expanding a search range; 5) if no picture is obtained yet, returning to an original point, adjusting a direction of the Z plane by 45 degrees, and repeating operations; 6) if a position of a largest angular point is found, adjusting a direction and a brightness of the 3D vision system to obtain a first complete front picture, and recording the position; 7) adjusting an angle to obtain a set of pictures; 8) adjusting a distance to obtain a set of pictures; and 9) obtaining 20 sets of pictures in total, with 50 pictures in each set.

10. The full-automatic calibration device oriented to a structured light 3D vision system of claim 6, wherein the running an automatic calibration system is performed for calibration for twice or three times.

11. The computer-readable storage medium of claim 7, wherein the running an automatic calibration system comprises the following steps of: 1) taking 20 sets of pictures, with 45 pictures in each set; 2) inputting the 20 sets of pictures into a calibration algorithm of Zhang Zhengyou, and detecting results; 3) adding one set of recorded results; 4) if a number of sets of “recorded results” is less than 2, returning to step 1); otherwise, going to step 5); 5) if the number of sets of “recorded results” is equal to 2, going to step 6); 6) if a result difference is less than a set threshold, going to step 7); otherwise, returning to step 1); and 7) averaging, and outputting results.

12. The computer-readable storage medium of claim 11, wherein the taking 20 sets of pictures comprises the following steps of: 1) starting single-picture taking; 2) if a picture is obtained, continuing next step; and if no picture is obtained, searching for a picture; 3) performing hexagonal shift in a Z plane, taking a picture at each position, and judging a number of angular points and sorting the angular points; 4) if no picture is obtained, expanding a search range; 5) if no picture is obtained yet, returning to an original point, adjusting a direction of the Z plane by 45 degrees, and repeating operations; 6) if a position of a largest angular point is found, adjusting a direction and a brightness of the 3D vision system to obtain a first complete front picture, and recording the position; 7) adjusting an angle to obtain a set of pictures; 8) adjusting a distance to obtain a set of pictures; and 9) obtaining 20 sets of pictures in total, with 50 pictures in each set.

13. The computer-readable storage medium of claim 7, wherein the running an automatic calibration system is performed for calibration for twice or three times.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The disclosure is further described hereinafter with reference to the accompanying drawings and the embodiments.

[0046] FIG. 1 is a brief flow chart of a full-automatic calibration method oriented to a structured light 3D vision system in a first embodiment of the disclosure;

[0047] FIG. 2 is a flow chart of running an automatic calibration system in the full-automatic calibration method oriented to the structured light 3D vision system in the first embodiment of the disclosure;

[0048] FIG. 3 is a flow chart of taking pictures in the full-automatic calibration method oriented to the structured light 3D vision system in the first embodiment of the disclosure;

[0049] FIG. 4 is a brief structural diagram of a full-automatic calibration apparatus oriented to a structured light 3D vision system in a second embodiment of the disclosure; and

[0050] FIG. 5 is a brief structural diagram of a full-automatic calibration device oriented to a structured light 3D vision system in a third embodiment of the disclosure.

DETAILED DESCRIPTION

[0051] To make the objectives, the technical solutions, and the advantages of the disclosure clearer, the disclosure is further described in detail hereinafter with reference to the accompanying drawings and the embodiments. It should be understood that the specific embodiments described herein are only used for explaining the disclosure and are not intended to limit the disclosure.

[0052] It should be noted that, the various features in the embodiments of the disclosure may be combined with each other to derive other embodiments not explicitly described in the disclosure, and all such embodiments are included in the scope of protection of the disclosure. In addition, although the functional modules are divided in the apparatus diagram and the logical sequence is shown in the flow chart, the steps shown or described may be performed according to different module division in the apparatus or different sequence in the flow chart in some cases.

[0053] The embodiments of the disclosure are further described hereinafter with reference to the accompanying drawings.

[0054] As shown in FIG. 1, a first embodiment of the disclosure provides a full-automatic calibration method oriented to a structured light 3D vision system, which includes the following steps of:

[0055] S100: erecting a 3D vision system and a manipulator;

[0056] S200: mounting a calibration target and a controllable lighting system on the manipulator;

[0057] S300: initializing a position of the manipulator; and

[0058] S400: running an automatic calibration system, and outputting calibration results.

[0059] It should be pointed out that for an erected 3D vision system, full-automatic calibration can be completed without moving the 3D vision system; and for an unfixed 3D vision system, full-automatic calibration can be completed without manual operation. In the above two cases, the 3D vision system should be erected to be fixed first, and then the manipulator drives the calibration target to operate according to steps set by the automatic calibration system.

[0060] As shown in FIG. 2, in step S400, the running an automatic calibration system specifically includes the following steps of:

[0061] 1) taking 20 sets of pictures, with 45 pictures in each set, and storing the pictures into a folder with a specified path;

[0062] 2) inputting the 20 sets of pictures into a calibration algorithm of Zhang Zhengyou, and detecting results;

[0063] 3) adding one set of recorded results;

[0064] 4) if a number of sets of “recorded results” is less than 2, returning to step 1); otherwise, going to step 5);

[0065] 5) if the number of sets of “recorded results” is equal to 2, going to step 6);

[0066] 6) if a result difference is less than a set threshold, going to step 7); otherwise, returning to step 1); and

[0067] 7) averaging, and outputting results.

[0068] As shown in FIG. 3, the taking 20 sets of pictures specifically includes the following steps of:

[0069] 1) starting single-picture taking;

[0070] 2) if a picture is obtained, continuing next step; and if no picture is obtained, searching for a picture;

[0071] 3) performing hexagonal shift in a Z plane, taking a picture at each position, and judging a number of angular points and sorting the angular points;

[0072] 4) if no picture is obtained, expanding a search range;

[0073] 5) if no picture is obtained yet, returning to an original point, adjusting a direction of the Z plane by 45 degrees, and repeating the operations;

[0074] 6) if a position of a largest angular point is found, adjusting a direction and a brightness of an illuminating camera in the 3D vision system to obtain a first complete front picture, and recording the position;

[0075] 7) adjusting an angle to obtain a set of pictures;

[0076] 8) adjusting a distance to obtain a set of pictures; and

[0077] 9) obtaining 20 sets of pictures in total, with 50 pictures in each set.

[0078] In the whole process of taking the pictures, the 3D vision system sends patterns when the camera captures the pictures. One set of 45 pictures should be captured each time, and the 45 pictures are stored in the folder with the specified path. The calibration is performed once after taking 15 to 20 sets of pictures, and the calibration should be performed twice or three times in total.

[0079] In addition, non-professionals can perform the calibration by executing the following steps of:

[0080] step 1: rotating the calibration target in a small range;

[0081] step 2: searching for a front plane;

[0082] step 3: changing far and near;

[0083] step 4: rotating;

[0084] step 5: trying to calibrate;

[0085] step 6: circulating; and

[0086] step 7: outputting a calibration file.

[0087] Through the above steps, non-professionals can also obtain high-quality calibration results quickly.

[0088] To sum up, compared with the prior art, the full-automatic calibration method oriented to the structured light 3D vision system has the advantages as follows: for the erected 3D vision system, full-automatic calibration can be completed without moving the 3D vision system; and for an unfixed 3D vision system, full-automatic calibration can be completed without manual operation. By using the calibration method, on one hand, non-professionals can easily complete calibration of structured light 3D imaging; and on the other hand, a problem of calibrating a large number of 3D cameras can also be solved.

[0089] In addition, as shown in FIG. 4, a second embodiment of the disclosure provides a full-automatic calibration apparatus oriented to a structured light 3D vision system, which includes:

[0090] an erecting module 110, configured for erecting a 3D vision system and a manipulator;

[0091] a mounting module 120, configured for mounting a calibration target and a controllable lighting system on the manipulator;

[0092] an initializing module 130, configured for initializing a position of the manipulator; and

[0093] a calibrating module 140, configured for running an automatic calibration system, and outputting calibration results.

[0094] The full-automatic calibration apparatus oriented to the structured light 3D vision system in the embodiment is based on the same inventive concept as the full-automatic calibration method oriented to the structured light 3D vision system in the first embodiment. Therefore, the full-automatic calibration system oriented to the structured light 3D vision system in the embodiment has the same beneficial effects as follows: for the erected 3D vision system, full-automatic calibration can be completed without moving the 3D vision system; and for the unfixed 3D vision system, full-automatic calibration can be completed without manual operation. By using the apparatus, on one hand, non-professionals can easily complete calibration of structured light 3D imaging; and on the other hand, a problem of calibrating a large number of 3D cameras can also be solved.

[0095] As shown in FIG. 5, a third embodiment of the disclosure provides a full-automatic calibration device oriented to a structured light 3D vision system, which includes:

[0096] at least one processor; and

[0097] a memory in communication with the at least one processor;

[0098] wherein, the memory is configured to store an instruction executable by the at least one processor, and the instruction, when executed by the at least one processor, causes the at least one processor to perform the full-automatic calibration method oriented to the structured light 3D vision system in the first embodiment above.

[0099] The memory, as a non-transient computer-readable storage medium, may be configured for storing a non-transient software program, a non-transient computer-executable program and a module, such as a program instruction/module corresponding to a virtual image control method in the embodiment of the disclosure. The processor executes various functional applications and data processing of a stereoscopic imaging processing apparatus by operating the non-transient software program, instruction and module stored in the memory, that is, to implement the full-automatic calibration method oriented to the structured light 3D vision system in any one of method embodiments above.

[0100] The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function, and the data storage area may store data created according to use of the stereoscopic imaging processing apparatus. In addition, the memory may include a high-speed random access memory, and may further include a non-transient memory, such as at least one disk memory device, flash memory device, or other non-transient solid-state memory devices. In some embodiments, the memory optionally includes memories remotely arranged relative to the processor, and these remote memories may be connected to the stereoscopic projection apparatus through a network. Examples of the above network include but are not limited to the Internet, the Intranet, the local area network, the mobile communication network and a combination thereof.

[0101] The one or more modules are stored in the memory, and when executed by the one or more processors, the full-automatic calibration method oriented to the structured light 3D vision system in any method embodiment above is executed, such as executing the method steps S100 to S400 in the first embodiment.

[0102] A fourth embodiment of the disclosure further provides a computer-readable storage medium. The computer-readable storage medium stores a computer-executable instruction, and the computer-executable instruction is executed by one or more control processors, so that the above one or more processors may execute the full-automatic calibration method oriented to the structured light 3D vision system in the method embodiment above, such as executing the method steps S100 to S400 in the first embodiment.

[0103] The device embodiment described above is only illustrative, wherein the units described as separate components may or may not be physically separated, which means that the units may be located in one place or distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions in the embodiments.

[0104] From the description of the above embodiments, those of ordinary skills in the art may clearly understand that each embodiment may be implemented by means of software plus a general hardware platform, or by means of hardware. Those of ordinary skills in the art may understand that all or partial flows in the method of the above embodiments may be implemented by instructing related hardware through a computer program, and the program may be stored in a computer-readable storage medium. The program may implement the flows of the above method embodiments when executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM) or a Random Access Memory (RAM).

[0105] The foregoing describes the preferred embodiments of the disclosure in detail, but the disclosure is not limited to the above embodiments. Those of ordinary skills in the art may further make various equivalent modifications or substitutions without violating the gist of the disclosure, and these equivalent modifications or substitutions are included in the scope defined by the claims of the present application.