Crane motion control
09776838 · 2017-10-03
Assignee
Inventors
Cpc classification
B66C13/06
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
Methods of detection and prevention for snags or off center lifts, and auto-centering a crane over a load. Snag detection includes monitoring angular deflection of the load with respect to an at-rest position, and halting movement of the crane in a direction of increasing angular deflection. Controlling off center lifting includes detecting a side load condition for a load, and preventing a hoist operation when the side load condition is detected. Auto-centering a load includes determining a position of a block coupled to the load with respect to a trolley of the crane, and centering the trolley over the block prior to a moving operation. Centering includes comparing a position of a block marker using a trolley camera to a known centered position of the marker with respect to the camera, and moving the trolley to match the determined position of the marker to its known centered position.
Claims
1. A crane motion detection system, comprising: a camera configured to mount on a trolley of a crane; a marker configured to mount on a block of the crane within a field of view of the camera; and a controller coupled to the camera to receive data from the camera, and coupled to the crane to control operation of the crane in response to camera data; wherein the controller is configured to control operation of at least one of detecting and preventing off center lifts with the block, detecting and preventing snagging of a block, and auto-centering the crane over a block.
2. The crane motion detection system of claim 1, wherein the marker is a fiducial marker.
3. The crane motion detection system of claim 1, wherein the marker is a reflective marker.
4. The crane motion detection system of claim 1, wherein the marker is a pattern.
5. The crane motion detection system of claim 1, wherein the controller is configured to control detecting and preventing off-center lifts with the block by: detecting a side load condition on a block of the crane; and preventing a hoist operation when the side load condition is detected.
6. The crane motion detection system of claim 5, wherein the controller is further configured to detect a side load condition by determining a displacement of the block of the crane between a known at-rest position of the block and a current position of the block of the crane.
7. The crane motion detection system of claim 6, wherein the controller is further configured to determine a displacement by capturing, with the camera, an image of the block in its current position, and comparing the current position to a known at-rest position of the block.
8. The crane motion detection system of claim 6, wherein the controller is configured to estimate a known at-rest position by determining a distance of the block from the camera by comparing a size of a fiducial marker image associated with the block with results of a mathematical function or functions that relate the distance of the block from the camera to the size of a fiducial marker image associated with the block.
9. The crane motion detection system of claim 6, wherein the controller is configured to estimate the known at-rest position by determining a distance of the block from an image capture element by comparing a size of a fiducial marker image associated with the block with results of a calibration that relates the distance of the block from the image capture element to the size of a fiducial marker image associated with the block.
10. The crane motion detection system of claim 9, wherein the calibration is obtained using a mathematical function or functions related to a size of the fiducial marker image at two known distances from the image capture element.
11. The crane motion detection system of claim 1, wherein the controller is configured to prevent a hoist operation when a displacement of a block of the crane between a known at-rest position of the block and a current position of the block exceeds a predetermined threshold.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
DETAILED DESCRIPTION
(9) Embodiments of the present disclosure provide motion control systems for industrial cranes including, for example only and not by way of limitation, heavy equipment production cranes, primary metals coil cranes, general purpose single and double girder bridge cranes, and the like. Side load detection, auto load centering, and snag detection are some of the motion controls provided by embodiments of the present disclosure.
(10) Camera-based crane manipulation and control may increase safety and may simplify hoisting tasks. Embodiments of the disclosure include a camera mounted to a crane in a position to be able to image a fiducial marker having a fiducial pattern thereon that is mounted to a hook/bottom block of the crane in a position so as to be visible in the field of view of the camera. With the image of the hook/bottom block of the crane, a controller, such as a programmable logic controller (PLC) is used to interpret data from the image to detect and in some cases correct issues with crane loading. Such issues include by way of example only and not by way of limitation, side load detection, auto load centering, and snag detection. In general, adverse cable angles may be detected against a threshold, such as an angular deflection of a fixed value, a hoist length, a distance of the block from an image capture element mounted on a trolley of the crane, or the like. A control response may be initiated, or a warning may be issued, following the detection.
(11) Sensory information about hook position is obtained using the camera, such as an industrial machine vision digital camera in one embodiment, together with software, firmware and/or hardware such as a programmable logic controller (PLC) to control operation of a crane, specifically, of the motion of a crane. The camera is in one embodiment mounted on a crane trolley, near a cable drum, oriented downward toward a typical at-rest position for the hook. In this configuration, the hook is visible to the camera. The camera captures and analyzes in one embodiment 20 images of the hook including the fiducial marker per second. Hook position information is determined by the controller using the images and known functions relating to the fiducial marker, as described further below. In this disclosure, the terms hook and bottom block may be used interchangeably, as known in the field.
(12) To facilitate reliable hook tracking, in one embodiment, the fiducial marker comprises a pattern of retro-reflective fiducial markers fastened to the hook. Fiducial markers are easily discernable from the other features in the workspace. They permit the camera to track the hook consistently and accurately. While retro-reflective fiducial markers are described herein, it should be understood that any fiducial marker capable of being imaged by the camera is amenable to use with the embodiments of the present disclosure without departing from the scope of the disclosure.
(13) Embodiments of the present disclosure mount an industrial camera to a crane, mount fiducial markers on a bottom block or hook of the crane within the field of view of the camera, and determine with a controller an angular or horizontal displacement of the hook from its at-rest position, using images taken by the camera of the fiducial markers. With that information, the controller may be used in some embodiments to implement control restrictions on the crane or implement crane movement to correct the angular displacement, or issue warning(s) to the crane operator.
(14) Referring to
(15) Fiducial marker 116 in one embodiment comprises a fiducial with a plurality of retro-reflective fiducial markers 202 thereon, as shown in top view in
(16) Referring also to
(17) Referring now also to
(18) Normally, operations of a crane such as crane 100 are controlled by an operator in a cab or operator location 118 using controls 120 (simplified for purposes of this disclosure). The crane operator uses the controls 120 to perform operations including hoist operations, traverse operations, and the like, as are known in the art. Typically, an operator and another person or persons responsible for a load on the crane work in combination to rig the load in preparation for crane operations. Rigging can be difficult, especially for very large loads, or for loads that are not uniform or symmetric. Despite experience and skill of riggers and crane operators, nevertheless, loads can be improperly rigged, leading to potentially very dangerous situations in which loads can shift, be side pulled, tip, or the like.
(19) For example, when bottom block 104 (and hook 106) are coupled to a load such as load 110 as shown in
(20) Referring now also to
(21) In one embodiment, when the controller 300 determines that a load (such as load 110) on the hook is side-loaded by an angle greater than a determined, settable and adjustable threshold, the controller 300 disallows any hoisting operation. That is, even if a crane operator uses the controls 120 to initiate a hoist operation, the controller 300 disables the hoisting operation. In one embodiment, a signal is sent from the controller 300 to crane controls 120 that disables the hoisting operation. Hoisting operation may be re-enabled when the side-loading is corrected to an angle below the threshold. The threshold angle of acceptable side-loading may be set based on the load, the crane, the conditions, or some combination thereof.
(22) When camera 114 captures an image of the bottom block 104 in its field of view, the image may be transmitted to the controller 300, and the controller 300 uses that image, along with the known function and base images of the bottom block 104 in its at-rest position for the distance between the camera 114 and the bottom block 104 (described in detail below), to determine an angular displacement of the bottom block 104 from its at-rest position. Alternatively, the camera may capture the image and process it internally to determine the current angular displacement. Then, this value is transmitted to the controller. The angular displacement threshold at which hoisting is prevented may be in one embodiment a function of one or more of the load characteristics and the distance between the camera and the bottom block. In one embodiment, when the bottom block 104 is higher, that is, when the distance between the camera 114 and the bottom block 104 is smaller, the allowable angular displacement may be larger than when the distance between the camera 114 and the bottom block 104 is larger. In one embodiment, the controller 300 is programmed to determine the distance between the camera 114 and the bottom block 104 (described below with reference to
(23) Referring again to
(24) To accomplish this, the component pixel distances used for determining an angle α of side-loading may be used for auto-centering. Specifically,
(25) If the bottom block 104 is off center with respect to its at-rest position in either or both of the x- or y-directions beyond a certain threshold, in an auto-centering operation, the crane 100 automatically moves the bottom block 104 to center the bottom block 104 on its at-rest position. Movement of the crane provides independent movement in each of the x- and y-directions. In one embodiment, the controller 300 determines the number of pixels 604 from the at-rest position the bottom block 104 is in the x-direction, and determines the number of pixels 606 from the at-rest position the bottom block 104 is in the y-direction, and initiates movement of the crane toward the at-rest position in each of the x- and y-directions. To move the bottom block 104 toward its at-rest position in one embodiment, the controller 300 initiates control of the crane to move the bottom block 104 toward its at-rest position in the x-direction, and initiates control of the crane to move the bottom block 104 toward its at-rest position in the y-direction. In one embodiment, the movement of the crane is at its minimum speed to avoid, or at a speed suitable to prevent or reduce, unnecessary oscillation or swaying (i.e., overshoot) of the bottom block 104 and hook 106. For each axis of motion, in this embodiment along the x-direction of movement and along the y-direction of movement, the pixel difference between the off-center position (as shown in image 600) and the at-rest position (as shown in image 400) is determined by subsequent images in the same fashion as described above. Once the displacement of the bottom block 104 changes sign on a particular axis, motion in that direction is stopped by the controller 300. Additionally, motion may also be stopped when the angular displacement is less than a predetermined, settable amount, or when auto-centering has been active for a specified duration.
(26) One corrective motion for each axis is used in one embodiment so as to avoid potential oscillation of the bottom block 104 and hook 106 that might be caused by multiple corrections or continuous corrections. One motion is enabled as follows. Once a position 404′,406′ is determined, motion toward the at-rest position 404,406 is initiated in auto-centering. In the x-direction, a number of pixels 604 is the difference between 404′ and 404. Movement of the crane in the x-direction is performed while the controller monitors the current position with respect to the at-rest position. As the determined difference 604 between 404′ and 404 shrinks, it eventually gets to 0 and then to −1 pixel. At this point, the displacement is considered to have changed signs, and motion on the x-axis is stopped. The same operation occurs for the corrective motion in the y-direction. Corrective action along the axes is independent. Alternatively, auto-centering is stopped in another embodiment when the angle is less than a specified threshold for a finite duration, or if auto-centering action has been active for a specified duration. This is especially useful in systems where the angle may not change sign. These methods may be implemented independently or simultaneously.
(27) Oscillation may also be induced when motion of the crane is at a variable speed, such as proportional control. In a proportional control scheme, a high velocity is used at a start of a corrective motion, and as the distance to be corrected decreases, the speed of motion also decrease. Embodiments of the present disclosure may use proportional control for corrective motion, but motion at a constant minimum speed of the crane with only one corrective motion per axis is used in one embodiment. If more than one corrective motion is used, that may induce limit cycling and constant correction that may make a situation worse.
(28) A distance from the camera 114 to the retro-reflective marker 116 may be determined in one embodiment without distance sensors using a known distance function determined by a size of the retro-reflective marker at various known distances from the camera such as may be determined in calibration of the camera. A closed form function may be determined allowing the controller 300 to determine where in the field of view of the camera the at-rest position of the bottom block 104 is for all distances from the camera 114 to the bottom block 104.
(29) For example, the closer the retro-reflective marker 116 is to the camera, the larger it appears in an image taken by the camera. So, once the function of distance from the camera 114 to retro-reflective marker 116 is determined, the controller 300 simply determines the size of the retro-reflective marker 116, compares it to the function or known size parameters, and determines the distance of the retro-reflective marker 116 from the camera 114. From that distance, the at-rest position for the hook is known at any distance from the camera 114, without using distance sensors. In another embodiment, a hoist length sensor may be used. In such a configuration, hoist length data from the hoist length sensor may be used directly with the closed form functions for determining the at-rest position of the hook.
(30) Referring now also to
(31) One embodiment of the present disclosure determines when a snag condition occurs. A snag condition may occur, as described above, when a hook catches on a load, an obstruction of some sort, infrastructure, rigging, or the like, or when the hook is not fully disconnected from a load that has been moved, for example. In a snag detection operation, embodiments of the present disclosure determine, based on a comparison in the controller 300 of images of the bottom block 104 in its at-rest position to its current position, whether a traverse operation of the crane is displacing the hook 106 from its at-rest position by more than a particular angular displacement. In snag detection, once a difference in position between the at-rest position and the current position of the hook 106 exceeds a certain, settable, angle, traverse motion of the crane in the direction of motion that increases the angular deflection is stopped by the controller. Movement to alleviate the snag, that is, in the direction of motion that decreases the angular deflection, is still allowed. In another embodiment, the controller 300 may, using known functions, determine a velocity or acceleration of displacement from an at-rest position to identify a snag or potential snag condition. In one embodiment, the controller 300 issues an emergency stop command to the crane when a snag condition is detected. Then, once the crane has stopped motion, correction of the snag may be initiated.
(32) Snag detection operation can mitigate but not necessarily completely eliminate hazards associated with snagging, and cannot in all instances prevent a snag. This is, in part, because whether a load is dragged and causes damage depends on a number of factors including but not limited to load height, mass, capability of drives and brakes on the crane, how heavy crane is, and the like.
(33) While a bottom block and hook are shown in the various figures, it should be understood that additional hoisting devices such as magnets, balls, and the like known in the art are amenable for use with the embodiments described herein without departing from the scope of the disclosure.
(34) Embodiments of the present disclosure are compatible with existing variable frequency drives for cranes. Enabling and disabling embodiments of the present disclosure may be accomplished with existing wired or radio pendants. Embodiments of the present disclosure are configured to be retrofitted onto existing hardware platforms, including but not limited to heavy equipment production cranes, primary metals coil cranes, and general purpose single & double girder bridge cranes. Embodiments of the present disclosure may be used in standalone form, or in conjunction with other crane control technology, for example only and not by way of limitation, with Expertoperator™, Safemove™, and Automove™ offered by PaR Systems of Shoreview, Minn.
(35) The system controller such as PLC 300 shown in
(36) The computer 370 comprises a conventional computer having a central processing unit (CPU) 372, memory 374 and a system bus 376, which couples various system components, including memory 374 to the CPU 372. The system bus 376 may be any of several types of bus structures including a memory bus or a memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. The memory 374 includes read only memory (ROM) and random access memory (RAM). A basic input/output (BIOS) containing the basic routine that helps to transfer information between elements within the computer 370, such as during start-up, is stored in ROM. Storage devices 378, such as a hard disk, a floppy disk drive, an optical disk drive, etc., are coupled to the system bus 376 and are used for storage of programs and data. It should be appreciated by those skilled in the art that other types of computer readable media that are accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, random access memories, read only memories, and the like, may also be used as storage devices. Commonly, programs are loaded into memory 374 from at least one of the storage devices 378 with or without accompanying data.
(37) Input devices such as a keyboard 380 and/or pointing device (e.g. mouse, joystick(s)) 382, or the like, allow the user to provide commands to the computer 370. A monitor 384 or other type of output device can be further connected to the system bus 176 via a suitable interface and can provide feedback to the user. If the monitor 384 is a touch screen, the pointing device 382 can be incorporated therewith. The monitor 384 and input pointing device 382 such as mouse together with corresponding software drivers can form a graphical user interface (GUI) 386 for computer 370. Interfaces 388 on the system controller 300 allow communication to other computer systems if necessary. Interfaces 388 also represent circuitry used to send signals to or receive signals from the actuators and/or sensing devices mentioned above. Commonly, such circuitry comprises digital-to-analog (D/A) and analog-to-digital (A/D) converters as is well known in the art.
(38) Without limitation, some aspects of the disclosure include, snag detection, auto-centering, and hoist prevention on side loading. Further aspects include a crane motion detection system comprising a camera, a fiducial marker, and a controller to process images from the camera to control operation of a crane in side-loading, snagging, and auto-centering situations; and a controller aspect configured to execute computer executable instructions for performing methods of snag detection, auto-centering and side load detection as shown and described herein.
(39) Although the subject matter has been described in language directed to specific environments, structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not limited to the environments, specific features or acts described above as has been held by the courts. Rather, the environments, specific features and acts described above are disclosed as example forms of implementing the claims.