System for Tracking Earthmoving Progress

Abstract

Disclosed is an integrated sensing device for determining information about a work site where earthmoving and excavation may be taking place. In one embodiment, the integrated sensing device includes optical sensors, variable range detection, and a position sensor. The sensing device may be mounted to an earth moving machine, and the methods for use include making measurements of excavated trenches, excavated soil volume, and location of potential worksite hazards. The data collected by the integrated sensing device can be synchronized with external databases. This allows for improved productivity tracking and worksite safety compliance at earth moving work sites.

Claims

1. An integrated sensing device comprising: a. an imaging sensor; b. a networking interface; c. a digital variable range detection system; and d. a processing circuit, and a memory circuit; and e. wherein said processing circuit is configured i. to receive output signals from said imaging sensor, and said range detection system.

2. The integrated sensing device of claim 1, wherein said digital variable range detection sensor comprises a light ranging and detection system (LIDAR).

3. The integrated sensing device of claim 1, wherein said imaging sensor comprises an optical stereo imaging camera.

4. The integrated sensing device of claim 1, wherein said networking interface comprises a cellular modem.

5. The integrated sensing device of claim 1, further comprising a position sensor.

6. The integrated sensing device of claim 1, further comprising a housing wherein: a. said imaging sensor, said networking interface, said digital variable range detection system, said processing circuit, and said memory circuit are all installed with said housing; and b. said integrated sensing device is mounted to an earthmoving machine.

7. The integrated sensing device of claim 6, wherein said position sensor comprises a Global Navigation Satellite System (GNSS) receiver.

8. The integrated sensing device of claim 1, wherein said networking interface is further configured: a. to receive output signals from the processing circuit; and b. to provide output data to an external database via an event handler.

9. The integrated sensing device of claim 6, wherein said processing circuit is further configured to receive outputs from said position sensor.

10. A method of using an integrated sensing device, said method comprising: a. providing an integrated sensing device, having: i. an imaging sensor; ii. a digital variable range detection system; iii. a processing circuit; iv. a memory circuit; and v. a networking interface; b. directing said sensing device toward an excavator bucket, and said imaging sensor and said variable range detection system provide outputs to said processing circuit; c. said processing circuit and said memory circuit determine the position of excavator arms attached to said bucket and creates a surface model of said bucket; and d. said processing circuit and said memory circuit determines the volume of the contents of the bucket by comparing the surface model against previously gathered data.

11. The method of claim 11 further comprising the steps of: a. said processing circuit and said memory circuit determining the approximate material composition of the bucket contents from data input from said imaging sensor.

12. The method of claim 11 further comprising the steps of: a. Transmitting data from said processing circuit and said memory circuit through said networking interface to a cloud database through an event handler.

13. A method of using an integrated sensing device, said method comprising: a. providing an integrated sensing device, having: i. an imaging sensor; ii. a digital variable range detection system; iii. a processing circuit; iv. a memory circuit; and v. a networking interface; b. directing said sensing device toward a work site, and said imaging sensor and said variable range detection system provide outputs to said processing circuit; and c. creating a surface model of said work site using said processing and memory circuit.

14. The method of claim 13 further comprising the steps of: a. determining the critical dimensions of a trench present within said surface model using said processing and memory circuit; b. determining if said critical dimensions are within a programmed acceptable limit using said processing and memory circuit.

15. The method of claim 13 further comprising the steps of: a. identifying the critical dimensions of a trench present within said surface model using said processing and memory circuit.

16. The method of claim 13 further comprising the steps of: a. determining if electrical power transmission lines are present within said surface model and their location relative to sensing device using said processing and memory circuit; and b. determining if suspended loads are present within said surface model, then determining their location relative to sensing device using said processing and memory circuit.

17. The method of claim 13 further comprising the steps of: a. identifying and determining if a pipe segment is present within said surface model using said processing and memory circuit; and b. determining the composition, length, width of said pipe segment using said processing and memory circuit.

18. The method of claim 13 further comprising the steps of: a. Transmitting data from said processing circuit and said memory circuit through said networking interface to a cloud database through an event handler.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0017] FIG. 1 is a schematic diagram of a representative sensor system

[0018] FIG. 2 is a schematic diagram of an illustrative network with a representative sensor system.

[0019] FIG. 3 is an illustration of a method for using the disclosed system with an excavator for soil measurement.

[0020] FIG. 3A illustrates a method for system calculation of a loaded excavator bucket

[0021] FIG. 3B depicts a method for the creating a model of an empty excavator bucket

[0022] FIG. 3C depicts a method for updating a model of an empty bucket to account for changes in the apparent capacity

[0023] FIG. 4 is an illustration of a method for using the disclosed system for detecting objects placed in the ground.

[0024] FIG. 5 is an illustration of a method for using the disclosed system for assessing worksite safety risks.

[0025] FIG. 6 is an illustration of a method for using the disclosed system to create and update a survey model.

[0026] FIG. 7 is a flow chart of some of the important steps performed by the disclosed system in example methods of using said system

DETAILED DESCRIPTION OF THE INVENTION

[0027] Note that the specific embodiments given in the drawings and following description do not limit the disclosure. On the contrary, they provide the foundation for one of ordinary skill to discern the alternative forms, equivalents, and modifications that are contemplated by the inventors and encompassed in the claim scope.

[0028] FIG. 1 discloses one embodiment of an integrated sensing device 1 comprising image sensors 2, a processor 3, a networking interface 4, a local storage database 5, a GPS receiver 35, and LiDAR sensors 36, contained in a housing 28. The sensors 2 may comprise an optical stereo imaging camera.

[0029] FIG. 2 is a schematic of a network configuration for the sensor system 1 in context. If the sensor system 1 detects an unsafe configuration at the worksite, the system can trigger an audible alarm 6. The sensor system collects data and syncs data and events with a cloud database 8 through an event handler 7. The cloud database 8 is referenced via an application programming interface 9 to a client portal or user interface 10.

[0030] FIG. 3 depicts the disclosed sensor system 1 mounted on top of the cab portion 28 of an excavator. The sensor system 1 scans the area in front of its field of view 11. To measure the contents 12 of an excavator bucket 30, the sensor system first detects the positions of the excavator arms 29 and bucket 30. Once said positioning is recognized, the sensor system scans the contents 12 of the bucket 30 and determines whether the bucket is in a loaded or empty state. If the empty state is detected, the system creates surface models 31 of the empty bucket interior 14 using data from the image sensors 2 and the LiDAR sensors 36. The surface models 31 are then updated in the local database 5. When the system determines the bucket is empty or unloaded, system creates a new model of the bucket interior 14 and overlays the new model to looks for outliers 15 such as material that is stuck to the back of the bucket as shown in FIG. 3C. A living model of the bucket interior is thus updated with each scan of the unloaded bucket.

[0031] If the sensor system detects the bucket 30 is loaded with contents 12, the system creates a volumetric model of the loaded bucket 13 (FIG. 3A) from image sensor 2 and LiDAR sensor 36 data then and compares the loaded bucket model 13 against the living model of the empty bucket interior 31 to isolate and determine the volume of the bucket contents 12. The system can use the data from the image sensors 2 to identify the composition of the bucket contents 12 by comparing the apparent texture and color of the contents against database information. The volume calculation and composition of the contents are read and stored to the local database 5.

[0032] FIG. 4 depicts the sensor system 1 scanning a pipe installation 16. The system uses object detection-based data from the image sensors 2 and LiDAR sensors 36 including reflectivity, color, measured width to length ratio, and dynamic apparent stiffness of the pipe to recognize pipe segments. Once the pipe 16 is placed at its installation location 32 the system records the length of the pipe, type of pipe, and depth of the pipe installation 33 to the local database 5.

[0033] FIG. 5 depicts how the sensor system 1 detects various safety hazards while operating at a worksite 27. The system can measure worksite trench 34 dimensions such as trench width 17, slope angle 19, trench depth 18, benching width 22, benching height 21, trench lower portion depth 20 and lower portion width 21. The system can detect the distance 23 excavated spoils 24 are located relative to the edge of a worksite trench 34. The system also detects “struck-by” hazards including suspended loads 25 and identifies the location of power lines 26. In the event an unsafe worksite condition is detected, the system writes an event to the local database 5 and can issue an audible alarm 6.

[0034] FIG. 6 depicts how the sensor system 1 creates and updates a survey model of the worksite 27. The system 1 uses its onboard image sensors 2, LiDAR 36 and GPS 35, combined based on image object detection to create measurements of terrain elevations 37 and positions 38 relative to system. This measurement data is stored and uploaded to the cloud database for further processing into living survey models, allowing for site progress to be realized in real time.

[0035] Numerous alternative forms, equivalents, and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the claims be interpreted to embrace all such alternative forms, equivalents, and modifications where applicable.