Reflection object position calculating device, reflection object position calculating method, and reflection object position calculating program

Abstract

Point cloud data that is missed due to an optical reflection object in measuring point cloud data using a laser scanner is used. A reflection object position calculating device includes a point cloud data receiving unit, a three-dimensional point cloud model generating unit, a missing data part searching unit, a missing data part determining unit, and a reflection object position calculator. The point cloud data receiving unit receives point cloud data. The three-dimensional point cloud model generating unit generates a three-dimensional point cloud model from the received point cloud data. The missing data part searching unit searches for a missing data part of the generated three-dimensional point cloud model. The missing data part determining unit determines whether the found missing data part has a predetermined specific shape. The reflection object position calculator calculates three-dimensional coordinates of the missing data part that is determined as having the specific shape.

Claims

1. A reflection object position calculating method for calculating a position of a reflection prism disposed on a surveying target having a structure selected from the group consisting of a hexahedral structure, a triangular structure, a pyramid structure, a quadrangular pyramid structure, and a pentagonal pyramid structure, the reflection prism disposed so that a position of an optical center of the reflection prism coincides with a position of an apex of the surveying target, the method comprising: obtaining point cloud data of the surveying target, the point cloud data being obtained by performing laser scanning on the surveying target; generating a three-dimensional point cloud model of the surveying target based on the point cloud data; searching for a missing data part of the three-dimensional point cloud model; determining whether the missing data part has a key shape; and calculating a point of intersection of three or greater planes of the surveying target adjacent to the missing data part having the key shape, as a position of the optical center of the reflection prism, based on the point cloud data, the missing data part being generated due to saturation of a light receiving element that receives light reflected back from the reflection prism in performing laser scanning on the reflection prism, the key shape being a shape that is relatively large around the optical center of the reflection prism and extends thinly from the position of the optical center of the reflection prism along a scanning direction of scanning light of the laser scanning, in such a manner as to have a width narrower than at the optical center of the reflection prism.

2. A non-transitory computer recording medium storing computer executable instructions for calculating a position of a reflection prism disposed on a surveying target having a structure selected from the group consisting of a hexahedral structure, a triangular structure, a pyramid structure, a quadrangular pyramid structure, and a pentagonal pyramid structure, the reflection prism disposed so that a position of an optical center of the reflection prism coincides with a position of an apex of the surveying target, the computer executable instructions, when executed by a computer processor, causing the computer processor to: obtain point cloud data of the surveying target, the point cloud data being obtained by performing laser scanning on the surveying target; generate a three-dimensional point cloud model of the surveying target based on the point cloud data; search for a missing data part of the three-dimensional point cloud model; determine whether the missing data part has a key shape; and calculate a point of intersection of three or greater planes of the surveying target adjacent to the missing data part having the key shape, as a position of the optical center of the reflection prism, based on the point cloud data, the missing data part being generated due to saturation of a light receiving element that receives light reflected back from the reflection prism in performing laser scanning on the reflection prism, the key shape being a shape that is relatively large around the optical center of the reflection prism and extends thinly from the position of the optical center of the reflection prism along a scanning direction of scanning light of the laser scanning, in such a manner as to have a width narrower than at the optical center of the reflection prism.

Description

BRIEF DESCRIPTION OF DRAWINGS

(1) FIG. 1 is a conceptual diagram of an embodiment.

(2) FIG. 2 is a block diagram of a laser scanner.

(3) FIG. 3 is a block diagram of a reflection object position calculating device.

(4) FIG. 4 shows a part with a key shape due to missing pieces of point cloud data.

(5) FIG. 5 is a flowchart showing an example of processing.

(6) FIG. 6 is a flowchart showing an example of the processing.

(7) FIG. 7 is a flowchart showing an example of the processing.

DETAILED DESCRIPTION

1. First Embodiment (Overview)

(8) This embodiment shows a technique of calculating a position of an optical reflection object by determining existence of the optical reflection object from a characteristic shape of a missing data part of the optical reflection object. The missing data part is generated in the case of scanning the optical reflection object with laser light by a laser scanner for measuring point cloud data. This embodiment is illustrated herein by using a reflection prism as the optical reflection object.

(9) FIG. 1 is a conceptual diagram of this embodiment. FIG. 1 shows a situation in which, after a laser scanner 100 scans a measurement object 200 with laser light to obtain point cloud data, a reflection object position calculating device 300 processes the obtained point cloud data. The measurement object 200 is an object having a reflection prism 201 and is to be measured by the laser scanner 100.

Structure of Laser Scanner

(10) The laser scanner 100 emits pulsed laser light to a measurement object and thereby scans the measurement object. The laser scanner 100 detects light reflected back from the measurement object to obtain an outline of the measurement object in terms of point cloud data added with three-dimensional coordinates.

(11) FIG. 2 is a block diagram of the laser scanner 100 shown in FIG. 1. The laser scanner 100 includes a laser scanning controlling unit 101, a storage 102, a communicating unit 103, and a control signal receiving unit 104.

(12) The laser scanning controlling unit 101 controls operation of the laser scanner 100 for obtaining point cloud data of the measurement object. The storage 102 stores point cloud data obtained by laser scanning, a control program necessary to operate the laser scanner 100, various kinds of data, and other information. The communicating unit 103 transmits and receives a signal to and from an external device and enables transmission and reception of various kinds of data. The control signal receiving unit 104 receives a signal from an external device via the communicating unit 103 as a control signal and makes each functional unit of the laser scanner 100 operate accordingly. In this embodiment, a laser scanning operation instruction and a point cloud data transmission instruction are received from the reflection object position calculating device 300.

(13) Techniques relating to the laser scanner are disclosed in Japanese Unexamined Patent Applications Laid-Open Nos. 2010-151682 and 2008-268004 and U.S. Pat. No. 8,767,190, for example. In addition, one that electronically scans, as disclosed in U.S. Patent Application Publication No. 2015/0293224, may also be used as the laser scanner.

Structure of Measurement Object

(14) The measurement object 200 is to be subjected to laser scanning by the laser scanner 100 and is a surveying target, for example. In this embodiment, the measurement object 200 is a stationary object and includes a reflection prism 201 as an optical reflection object. The present invention as in this embodiment may use a stationary measurement object or a moving measurement object.

(15) In this embodiment, the measurement object 200 is a cube or a hexahedron and includes the reflection prism 201 that is fixed at an apex of the cube. The position of the apex and the position of an optical center or a reflection center of the reflection prism 201 are made to coincide with each other. Alternatively, the measurement object 200 may use a polyhedron such as a triangular pyramid, a quadrangular pyramid, or a pentagonal pyramid, and the reflection prism 201 may be disposed at the position of the apex of the polyhedron. Also in this case, the position of the apex of the polyhedron is made to coincide with the position of the optical center of the reflection prism 201.

Structure of Reflection Object Position Calculating Device

(16) The reflection object position calculating device 300 calculates a position of the reflection prism, which is an optical reflection object, from point cloud data obtained in laser scanning performed by the laser scanner 100. The reflection object position calculating device 300 is constructed of each type of a central processing unit (CPU), a memory, and an interface. The reflection object position calculating device 300 may be constructed as a part of a general-purpose computer or a tablet or may be constructed as a dedicated device.

(17) FIG. 3 is a block diagram of the reflection object position calculating device 300 shown in FIG. 1. The reflection object position calculating device 300 includes a point cloud data receiving unit 301, a three-dimensional point cloud model generating unit 302, a missing data part searching unit 303, a missing data part determining unit 304, a reflection object position calculator 305, a storage 306, a communicating unit 307, and a laser scanner controlling unit 308.

(18) For example, each of the functional units of the reflection object position calculating device 300 is constructed of an electronic circuit such as a CPU, an application specific integrated circuit (ASIC), or a programmable logic device (PLD) represented by a field programmable gate array (FPGA). Additionally, some functions may be implemented by dedicated hardware, and the rest may be implemented by a general-purpose microcomputer.

(19) Whether each of the functional units of the reflection object position calculating device 300 is to be constructed of dedicated hardware or is to be constructed of software so that programs are executed by a CPU is determined in consideration of necessary operating speed, cost, amount of electricity consumed, and other factors. Constructing the functional unit by dedicated hardware and constructing the functional unit by software are equivalent to each other from the point of view of implementing a specific function.

(20) The reflection object position calculating device 300 may be equipped on the laser scanner 100 or may be integrated as a functional unit to the laser scanner 100. Alternatively, the reflection object position calculating device 300 may be separated from the laser scanner 100. None of these cases prevents implementing the present invention.

(21) The point cloud data receiving unit 301 receives point cloud data of the measurement object 200 from the laser scanner 100. The three-dimensional point cloud model generating unit 302 generates a three-dimensional point cloud model of the measurement object 200 from the point cloud data received by the point cloud data receiving unit 301. The three-dimensional point cloud model generated in this case is a polyhedron obtained by connecting points of the point cloud data.

(22) The missing data part searching unit 303 searches for a missing data part of the three-dimensional point cloud model generated by the three-dimensional point cloud model generating unit 302. The missing data part determining unit 304 determines whether the missing data part, which is found by the missing data part searching unit 303, has a “key” shape due to light reflected back from the reflection prism 201.

(23) An example of a part with missing point cloud data having a “key” shape is shown in FIG. 4. FIG. 4 shows a shape of a missing data part in the case of scanning the measurement object 200, which is a measurement object in this embodiment, using laser light. As shown in FIG. 4, point cloud data of a position that is scanned by the laser light after the laser light scans a center of the reflection prism 201 is missed as well as the position at which the reflection prism 201 exists. The reason for this is that the laser scanning is performed to an optical center existing at the center of the reflection prism 201. The optical center is positioned at an apparent center of the prism due to optical refraction and is a part that reflects light with highest intensity. Thus, laser scanning the vicinity of the optical center causes saturation of the light receiving element, resulting in taking a time to recover the light receiving element. As a result, point cloud data at the position at which the reflection prism 201 exists as well as at the position at which the laser light subsequently scans are not measured. That is, point cloud data is missed at the position at which the reflection prism 201 exists and at a position under the center of the reflection prism 201, whereby a “key”-shaped part with missing point cloud data is generated.

(24) This embodiment is exemplified by a case in which missing of point cloud data occurs in the shape of a “key” due to light reflected back from the reflection prism 201. However, the shape may not be a “key” shape in some cases, depending on factors such as the kind and operation conditions of the light receiving element, the type of the reflection prism, and the manner and speed of laser scanning. For example, there may be cases in which missing of point cloud data occurs in the shape of a rectangular, an inverted triangle, a spindle, or another shape. From this point of view, the shape of a part with missing point cloud data, which occurs in using a combination of a reflection object and laser scanning, is preliminarily examined and determined.

(25) The reflection object position calculator 305 calculates three-dimensional coordinates of the missing data part, which is determined as having a “key” shape by the missing data part determining unit 304. The three-dimensional coordinates of the missing data part is calculated as follows: three or more simultaneous equations are prepared using at least three points per one plane of the point cloud data around the missing data part, the prepared simultaneous equations are solved to obtain a plane equation of each plane, and the plane equations of the planes are solved as simultaneous equation to obtain common results (x, y, z) as three-dimensional coordinates. The calculated three-dimensional coordinates at the missing data part are coordinates of an optical reflection object such as a reflection prism.

(26) The measurement object 200 may be a cube or a hexahedron, and an optical center of the reflection prism 201 and a position of an apex of the measurement object 200 may be made to coincide with each other, as in the case of this embodiment. In such a case, point cloud data is missed at a part centering at the apex of the measurement object 200. Thus, in this case, plane equations of three planes around a key-shaped part with missing point cloud data are prepared, and an intersection point of the three planes is obtained to calculate three-dimensional coordinates of the optical center of the reflection prism 201.

(27) Instead of the method using the plane equation, the reflection object position calculator 305 may use any other method for calculating the three-dimensional coordinates of the missing data part, which is determined as having a “key” shape by the missing data part determining unit 304. In one example, multiple points of point cloud data normally measured in proximity to the part with missing point cloud data may be assumed to be points positioned at outermost parts of the part with missing point cloud data, and the optical center of the reflection prism or of another object may be calculated from a positional relationship between each of the multiple assumed points. In addition, this case may also use the plane equation.

(28) The reflection object position calculator 305 may approximately calculate the position of the optical center of the reflection prism or of another object instead of exactly calculating it. In this case, the reflection object position calculating device 300 can provide information of an approximate position of the optical reflection object to another device, for example, a total station. The device that receives the information of the approximate position of the optical reflection object may perform processing based on this information, for example, precise measurement primarily for the approximate position of the reflection prism.

(29) The reflection object position calculating device 300 includes the storage 306 and the communicating unit 307. The storage 306 stores point cloud data received from the laser scanner 100, a control program necessary to operate the reflection object position calculating device 300, various kinds of data, and other information. The communicating unit 307 transmits and receives a signal to and from an external device and enables transmission and reception of various kinds of data.

(30) The laser scanner controlling unit 308 generates a control signal for operating each functional unit of the laser scanner 100 to control the laser scanner 100. For example, the laser scanner controlling unit 308 generates a control signal that causes the laser scanner 100 to perform operations such as laser scanning and transmitting point cloud data.

Example of Processing

(31) FIG. 5 shows an example of processing that is performed by the reflection object position calculating device 300 in this embodiment. Before starting the processing shown in FIG. 5, the laser scanner 100 performs laser scanning on the measurement object 200 having the reflection prism 201, and point cloud data of the measurement object 200 is obtained. In addition, the reflection prism 201 is fixed so that the optical center of the reflection prism 201 will coincide with the position of the apex of the measurement object 200.

(32) First, the reflection object position calculating device 300 receives point cloud data of the measurement object 200 from the laser scanner 100 via the point cloud data receiving unit 301 (step S101). The laser scanner 100 is made to perform laser scanning and transmit point cloud data by the function of the laser scanner controlling unit 308.

(33) Next, the three-dimensional point cloud model generating unit 302 generates a three-dimensional point cloud model from the point cloud data of the measurement object 200, which is received in step S101 (step S102). The missing data part searching unit 303 searches for a part with missing point cloud data from the three-dimensional point cloud model of the measurement object 200, which is generated in step S102 (step S103).

(34) Thereafter, the missing data part determining unit 304 determines whether the part with missing point cloud data, which is found in step S103, has a “key” shape (step S104). Finally, the reflection object position calculator 305 calculates three-dimensional coordinates of the part with missing point cloud data, which is determined as having a “key” shape in step S104, as three-dimensional coordinates of the reflection prism 201 (step S105). Then, the processing is completed.

(35) In step S105, coordinates of the position of the apex of the measurement object 200, at which the reflection prism 201 is disposed, are calculated from the point cloud data around the part with missing point cloud data, whereby position data of the optical center of the reflection prism 201 is obtained.

Modification Example 1

(36) The processing in steps S101 to 105 is performed on the condition that the measurement object 200 includes the reflection prism 201. However, there may be cases in which the measurement object 200 does not include the reflection prism 201, and in which the measurement object 200 does not exist in a point cloud data obtaining area. An example of the processing for these cases is shown in FIG. 6. As shown in FIG. 6, if no part is found to have missing point cloud data in step S103, the missing data part searching unit 303 determines that no reflection prism exists in the point cloud data obtaining area, and the processing is finished. Even if there is found a part with missing point cloud data due to a factor other than existence of the reflection prism 201 in step S103, unless this part is determined as having a “key” shape in step S104, the missing data part determining unit 304 determines that no reflection prism exists in the point cloud data obtaining area, and the processing is finished. This is because this part with missing point cloud data occurs due to a factor other than existence of the reflection prism 201.

(37) The processing of this modification example may also be performed in a case in which no part is found to have missing point cloud data or a part with missing point cloud data does not have a “key” shape, due to other causes, even though the measurement object 200 includes the reflection prism 201.

Modification Example 2

(38) An example of the processing in this modification example is shown in FIG. 7. In this modification example, as shown in FIG. 7, if the reflection prism 201 is not found in the measured point cloud data obtaining area in step S103 or S104, the reflection object position calculating device 300 makes the laser scanner controlling unit 308 inquire whether there is another point cloud data obtaining area, other than the point cloud data obtaining area that is measured by the laser scanner 100. If there is such another area, the reflection object position calculating device 300 makes the laser scanner 100 change the point cloud data obtaining area and perform laser scanning (step S106). Thus, the processing is performed again from step S101. Otherwise, if there is no other point cloud data obtaining area, it is determined that the reflection prism does not exist in the point cloud data obtaining area, and the processing is finished.

(39) As described above, inquiring the point cloud data obtaining area to the laser scanner 100, and making the laser scanner 100 change the point cloud data obtaining area and perform laser scanning are implemented by the function of the laser scanner controlling unit 308. More specifically, the laser scanner controlling unit 308 generates a control signal to inquire a point cloud data obtaining area to the laser scanner 100 and generates a control signal to cause the laser scanner 100 change the point cloud data obtaining area and perform laser scanning. The laser scanner controlling unit 308 transmits the generated control signal from the communicating unit 307 to the laser scanner 100 to make the laser scanner 100 answer the inquiry or operate as instructed. To make the laser scanner 100 change the point cloud data obtaining area, for example, an irradiation distance of pulsed laser light may be changed.

(40) The processing of this modification example enables searching for the optical reflection object even when the position of the optical reflection object is completely unknown. In a case in which the reflection prism is not found after the point cloud data obtaining area is changed, the processing similar to those in the modification example 1 may be performed.

2. Second Embodiment

(41) The first embodiment enables estimation of existence of the reflection prism 201 on the basis of point cloud data that is missed in laser scanning. This embodiment employs this function and performs laser scanning on the reflection prism 201 again to obtain point cloud data of the reflection prism 201. The following describes an example of the processing.

(42) In this embodiment, in the case in which there is found a specific shaped part with missing point cloud data in step S104 in FIG. 5, the direction of this part as viewed from the laser scanner 100 is obtained. Thus, an approximate direction of the reflection prism 201 is estimated.

(43) After the direction of the reflection prism 201 is estimated on the basis of the missing point cloud data, laser scanning is performed again only in this direction. At this time, the laser scanning is performed again by narrowing the point cloud data obtaining area primarily in the direction in which missing of the point cloud data occurs, in the condition in which emission intensity is decreased or a neutral-density filter is inserted in a light receiving path. This other laser scanning provides point cloud data relating to the reflection prism 201.

(44) This method can also be employed when the reflection prism 201 is used alone, without using the measurement object 200.

3. Third Embodiment

(45) This embodiment relates to another technique for detecting missing of point cloud data. This embodiment uses a photodiode as a light receiving element for laser scanning light that is reflected back from a target object. In this case, upon receiving light, a photocurrent flows in the photodiode functioning as the light receiving element, whereby reception of light is detected.

(46) At this time, output of the photodiode is monitored to determine missing of point cloud data due to light reflected back from an optical reflection object, such as a reflection prism. Specifically, laser scanning light that is reflected back from an optical reflection object overloads the photodiode, whereby a photocurrent corresponding to incident light is not obtained. This state is detected to determine missing point cloud data due to a high intensity light reflected back from the optical reflection object. This method may be used alone, or it may be used in combination with the technique of determining the shape of the part with missing point cloud data.

4. Other Matters

(47) The present invention may be employed in a surveying device having a laser scanner and a total station in a combined manner to automatically search for and track a mobile body with an optical reflection object. The mobile body is, for example, a UAV.

Advantages

(48) The present invention enables determining three-dimensional coordinates of an optical reflection object by laser scanning using a laser scanner. This provides a position of the optical reflection object at the same time as the laser scanning for measuring point cloud data.

(49) The present invention can be used in a surveying technique using point cloud data.