Reclaimer 3D volume rate controller
09637887 ยท 2017-05-02
Assignee
Inventors
Cpc classification
E02F9/262
FIXED CONSTRUCTIONS
E02F9/265
FIXED CONSTRUCTIONS
E02F3/18
FIXED CONSTRUCTIONS
International classification
G06F7/70
PHYSICS
E02F3/46
FIXED CONSTRUCTIONS
E02F3/18
FIXED CONSTRUCTIONS
G06G7/00
PHYSICS
Abstract
A 3D volume rate control method and apparatus (10) for a slewing bucket-wheel stockpile reclaimer 16 is described. The apparatus (10) comprises four 3D image sensors (12) mounted adjacent a bucket-wheel (14) of the (reclaimer 16), which are adapted to provide 3D images of a stockpile bench face. The apparatus includes a data processor (20) for: (i) processing the 3D images produced by the 3D image sensors (12) to generate a 3D stockpile bench face profile, (ii) calculating a reclaim cut volume rate at which material is being cut from the stockpile face based on a measured change in volume of the 3D stockpile bench face profile in the area abutting the excavation tool, (iii) calculating a reclaim cut volume of material that will be cut from the stockpile face based on the shape of the excavation tool and the 3D stockpile bench face profile to determine a feed forward reclaim cut volume rate profile, and (iv) calculating an operating parameter for the reclaimer based on a desired reclaim cut volume rate compared to the measured reclaim cut volume rate and the feed forward reclaim cut volume rate profile. The method and apparatus provide accurate reclaim volume measurement so that the reclaim volume rate becomes independent of the product characteristics, stockpile bench face shape and bucket-wheel cutting parameters.
Claims
1. A three-dimensional (3D) volume rate control apparatus for a stockpile reclaimer, the apparatus comprising: a plurality of 3D image sensors mounted adjacent to an excavation tool of the stockpile reclaimer and that provide 3D images of a stockpile bench face; and, a data processor that: processes the 3D images provided by the 3D image sensors to generate a 3D stockpile bench face profile, calculates a reclaim cut volume rate at which material is being cut from the stockpile bench face based on a measured change in volume of the 3D stockpile bench face profile in an area abutting the excavation tool, calculates a reclaim cut volume of material that will be cut from the stockpile bench face based on a shape of the excavation tool and the 3D stockpile bench face profile to determine a feed forward reclaim cut volume rate profile, and calculates an operating parameter for the stockpile reclaimer based on a desired reclaim cut volume rate compared to the calculated reclaim cut volume rate and the feed forward reclaim cut volume rate profile; a machine controller that is connected to the data processor and the excavation tool and that controls a motion pathway of the excavation tool by controlling at least one of: a travel speed of the excavation tool or a slew speed of the excavation tool.
2. A 3D volume rate control apparatus as defined in claim 1, wherein respective 3D image sensors are mounted on each side and adjacent to the excavation tool to provide 3D images of a complete cutting arc of the excavation tool on the stockpile bench face.
3. A 3D volume rate control apparatus as defined in claim 2, wherein the 3D image sensors provide 3D images extending along a swing arc of the complete cutting arc for a distance to cover areas of the stockpile bench face that may flow or collapse around the excavation tool.
4. A 3D volume rate control apparatus as defined in claim 2, wherein two of the 3D image sensor are located on each side of the excavation tool respectively.
5. A 3D volume rate control apparatus as defined in claim 1, wherein the 3D image sensors are 3D time-of-flight cameras which measure a distance to an object in front of the cameras by analysing the time for a light pulse to travel from an illumination source to the object and back.
6. A 3D volume rate control apparatus as defined in claim 1, wherein the stockpile reclaimer is a bucket-wheel reclaimer and the excavation tool is a bucket-wheel.
7. A 3D volume rate control apparatus as defined in claim 6, wherein the bucket-wheel reclaimer is a slewing bucket-wheel reclaimer.
8. A method of three-dimensional (3D) volume rate control for a stockpile reclaimer, the method comprising: obtaining 3D images of a stockpile bench face; processing the 3D images to generate a 3D stockpile bench face profile; calculating a reclaim cut volume rate based on a measured change in volume of the 3D stockpile bench face profile in an area abutting an excavation tool of the stockpile reclaimer; calculating a reclaim cut volume of material that will be cut from the stockpile bench face based on a shape of the excavation tool and the 3D stockpile bench face profile to determine a feed forward cut volume rate profile; calculating an operating parameter for the stockpile reclaimer based on a desired reclaim cut volume rate compared to the calculated reclaim cut volume rate and the feed forward reclaim cut volume rate profile; sending the operating parameter to a machine controller connected to the excavation tool, and controlling, based on the operating parameter, at least one of: a travel speed of the excavation tool, or a slew speed of the excavation tool.
9. A method of 3D volume rate control as defined in claim 8, wherein calculating the reclaim cut volume of material is performed by producing an excavation tool cut height map, wherein the excavation tool cut height map is a two dimensional array of distance values measured from a reference on the excavation tool to an edge of the excavation tool where it cuts into the stockpile bench face.
10. A method of 3D volume rate control as defined in claim 9, wherein the stockpile reclaimer is a bucket-wheel reclaimer, the excavation tool is a bucket-wheel, and the excavation tool cut height map is a bucket-wheel cut height map.
11. A method of 3D volume rate control as defined in claim 10, wherein the bucket-wheel reclaimer is a slewing bucket-wheel reclaimer.
12. A method of 3D volume rate control as defined in claim 11, wherein the reference on the excavation tool is a bench arc formed by a point at the center of the bucket-wheel as it is slewed outwards across the stockpile bench face.
13. A method of 3D volume rate control as defined in claim 12, wherein the distance values are the distance from the bench arc measured along a series of cut arc rays running perpendicular to a bucket-wheel axle.
14. A method of 3D volume rate control as defined in claim 13, wherein the series of cut arc rays extend from a ray pointing vertically down to a ray pointing towards center face of the bucket-wheel.
15. A method of 3D volume rate control as defined in claim 14, wherein an angular separation between the rays matches a sensor target point size at the center face of the bucket-wheel.
16. A method of 3D volume rate control as defined in claim 10, wherein calculating a reclaim cut volume rate comprises calculating a volume of material at the stockpile bench face.
17. A method of 3D volume rate control as defined in claim 16, wherein calculating a reclaim cut volume of material at the stockpile bench face comprises calculating a sum of the volumes for each point of the 3D stockpile bench face profile in an area abutting the bucket-wheel.
18. A method of 3D volume rate control as defined in claim 10, wherein calculating the reclaim cut volume rate comprises comparing a stockpile bench face volume at two points in time as the bucket-wheel cuts the stockpile bench face.
19. A method of 3D volume rate control as defined in claim 15, further comprising creating a profile map and storing the 3D stockpile bench face profile in the profile map, the 3D stockpile bench face profile includes a plurality of profile points, and each profile point is defined by a distance from the bench arc along a cut arc ray.
20. A method of 3D volume rate control as defined in claim 19, further comprising calculating a bucket-wheel face height map from the 3D stockpile bench face profile.
21. A method of 3D volume rate control as defined in claim 20, further comprising calculating a bucket-wheel cut volume per meter of bench arc length at intervals along a bench arc of the stockpile bench face based on a known cut radius of the bucket-wheel and the bucket wheel face height map.
22. A method of 3D volume rate control as defined in claim 21, further comprising calculating a bucket-wheel slew speed at all points along the bench arc of the stockpile bench face based on the reclaim cut volume rate, the bucket wheel cut volume per meter and a desired reclaim volume rate.
23. A method of 3D volume rate control as defined in claim 22, wherein the bucket-wheel slew speed is published to a reclaimer slew speed control system.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The nature of the invention will be better understood from the following detailed description of several specific embodiments of 3D volume rate control method and apparatus, given by way of example only, with reference to the accompanying drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
(15) A preferred embodiment of the 3D volume rate control apparatus 10 in accordance with the invention, as illustrated in
(16) Typically four 3D image sensors 12 are provided, two on each side of the bucket-wheel 14 respectively. Advantageously the four 3D image sensors 12 are located immediately adjacent to the bucket-wheel 14 and orientated such that the complete cutting arc of the bucket-wheel 14 is measured, as shown in
(17) The 3D volume rate control apparatus 10 further comprises a data processor 20 (see
(18) The 3D volume rate control apparatus 10 provides improved reclaimer performance in comparison to existing State of the Art Implied Rate systems. This improved performance is achieved by the accurate and dynamic measurement of the reclaimed volume using the change in volume around the bucket-wheel 14 to control the reclaim volume rate. Accurate reclaim volume measurement is achieved by capturing the changing volume of the area abutting each side of the bucket-wheel 14. The high speed 3D image sensors (cameras 12) are used to measure the volume which is being removed from the stockpile face area abutting the bucket-wheel 14.
(19) The stockpile face area abutting the bucket-wheel 14 is subject to change in profile due to product flow, face collapses and product being thrown out of the buckets. The flow and collapse characteristics are unpredictable and product may also flow and the face collapse, even when the bucket-wheel is not slewing. By providing accurate reclaim volume measurement the reclaim volume rate becomes independent of the product characteristics, stockpile face shape and bucket-wheel cutting characteristics.
(20) Whilst measurement and calculation of the reclaim volume is complex, the application of the bucket-wheel speed control is simplified as there is no longer any requirement to apply the customised correction parameters that are typically required to improve performance of power based controllers.
(21) The measured stockpile face shape is also used to provide improved machine safety and bucket-wheel position control that operate in unison with the 3D volume rate controller to provide reclaimer performance improvements.
(22) A preferred method of 3D volume rate control for a stockpile reclaimer 16, using the apparatus of
(23) The area in which stockpiles reside is called a stockyard. The stockyard area in which the reclaimer 16 is operating is defined as a horizontal plane extending for the full length and width of the stockyard and being parallel to the machine rails. The Stockyard North direction is defined as the direction of positive travel along the machine rails.
(24) The preferred 3D volume rate control method uses a local (right-hand) Cartesian coordinate system (x, y, and z, as shown in
(25) The component positions and orientations on the reclaimer 16 are defined with reference to the reclaimer local reference point and with all motions are their home positions. The reclaimer 16 local reference position is typically defined as the center of slew and at rail height. Forward kinematic methods are used to transform the component local coordinates to stockyard area co-ordinates, based on the current motion positions.
(26) The reclaimer motion pivots and components (bucket-wheel 14 and cameras 12) are modelled, (step 104 in
(27) In the case where the bucket-wheel 14 is not tilted or skewed, then the cut of the bucket-wheel is described as a torus with a circular cross section. Where the bucket-wheel 14 is tilted and/or skewed, then the cut of the bucket-wheel is a torus with an elliptical cross-section.
(28) The method further comprises the step 114 (in
(29) Accurate cut volume calculation is achieved, irrespective of the bucket-wheel tilt and/or skew, by calculating the volume along the direction of the bucket-wheel face cut. That is, the cut direction is along the line that runs around the tilted/skewed bucket-wheel 14.
(30) Target position data supplied by each camera is mapped from the Camera Coordinates to Stockyard Area Coordinates. The 3D time of flight cameras 12 return a target distance for each pixel in the field of view (FOV), as shown in
(31) The depth distance (Z) produced by each camera 12 is the perpendicular distance from the target point to the lens entrance pupil plane (the entrance pupil plane is behind the front glass of the camera). The depth distance is different from the range distance which is the straight line distance from the target point to the corresponding pixel in the lens entrance pupil plane. Note that for the target point lying on the optical axis of the camera 12, the depth and range distances are the same. The camera coordinate reference point (x=0, y=0 and z=0) is located where the optical axis intersects the lens entrance pupil plane.
(32) The position of each target point is described by the target distance along the z axis and the angular offset along the camera x and y axis. The target point data from the multiple 3D cameras 12 is combined to create a stockpile bench face profile expressed in terms of the stockyard coordinate system.
(33) Each camera is capable of providing target point data at a high frame rate (typically up to 30 frames per second). A high frame rate is not essential for stockpile face profiling as the reclaimer moves relatively slowly. For stockpile bench face profiling, a frame rate of 10 Hz is adequate. For a camera 12 with a pixel array size of 160120, the number of target values returned by each camera is 192,000 per second (16012010 Hz).
(34) In creating the stockpile face profile from the camera target values, it is important to: Preserve the accuracy of the measured face position with respect to the reclaimer bucket-wheel cutting arc. Store the stockpile face data in a format that facilitates accurate calculation of the bucket-wheel cut volume. Maintain data storage space requirements within manageable boundaries.
(35) As the objective is to calculate the cut reclaim volume of the bucket-wheel 14, the target points from all cameras 12 are mapped into a reclaim face point map. The reclaim face point map is a two dimensional array of points coordinates. One dimension of the array extends along the length of the reclaim arc (90 degrees) whilst the second dimension wraps around the arc. The number of elements in each dimension is selected to match the available resolution of the cameras 12.
(36) The stockpile bench face profile is stored as a height map wrapped around the bench arc. This format provides maximum resolution for rate control. The bench arc is defined as the center of the bucket-wheel 14. The bench base level and hence the arc level may vary due to any east/west slope of the stockpile base level. Distance height is stored as a UINT (unsigned int16) with a scaling factor of 0.5 mm. The bench arc length for a bench radius of 60 m is 94.75 m (0.5*60.0). The height map wraps around the bench arc from the base to a point above bench arc. The cutting arc length for a 5.0 m radius bucket-wheel 14 is 7.85 m. A height map of 12 m is required for a profile that extends 2 m above the bench arc and 2 m behind the bench arc.
(37) The storage requirements for a bench height map with horizontal scale of 200 mm and a vertical scale of 100 mm is 60,000 words (500120UINT). The height map above the bench arc level is referenced to a line running vertically up from the bench arc. The height map may be wrapped back behind the bucket-wheel base to provide for product detected behind the bucket-wheel center. The level of the height map behind the bench arc is referenced to the line running horizontally to the bench arc.
(38) The reclaim arc is the path of the bucket-wheel center as it is slewed across the face of the stockpile. The reclaim arc center point is nominally located at the X and Y axis positions of the reclaimer reference position (slew pivot) and at the level of the bucket-wheel center point. The arc reference point is maintained at one location for the duration of a complete slew cut and then moves forward (along the X axis) in unison with the reclaimer on consecutive bench cuts. At the completion of each bench face cut, the current Reclaim Face Point Map is processed to determine the reclaimer travel target position for the next bench face cut, based on the required bucket-wheel cut depth.
(39) Finally, the 3D volume rate control method comprises calculating a control parameter for the reclaimer 16 based on a desired reclaim volume rate 120 (see
(40) Preferably the reclaimer 3D volume rate control method provides both the travel target position and travel target speed in order to control the reclaim rate during the step advance motion of the reclaimer 16. The method provides reclaim rate control during the forward motion (step advance) by determination of the volume for meter (cubic meter per meter), similarly to the control strategy for slew motion.
(41) On each occasion that the reclaimer steps forward, the current Reclaim Face Point Map is processed to create a new Reclaim Face Point Map where the bench arc pivot is located at the new reclaimer slew pivot position.
(42) Mapping the camera target points (expressed in terms of the camera coordinates) to the stockyard area coordinate system is accomplished by rotation and translation of the target points via a camera to area Transform Matrix. The Transform Matrix is composed of a Local Transform Matrix and an Area Transform Matrix. The Local Transform Matrix provides mapping of target points from camera coordinates to reclaimer local coordinates based on the position and orientation of the camera in the local coordinate system. The Area Transform Matrix provides mapping of target points from the reclaimer local coordinates to stockyard area coordinates based on the position of each reclaimer motion.
(43) The Local Transform Matrix for mapping the camera target points to the machine local coordinate system is calculated as follows. The position and orientation of each camera 12 in relation to the reclaimer local coordinate system is known by accurate measurement. The camera position is described by the translation of the camera coordinate reference point with respect to the reclaimer coordinate system reference point. Thus for a camera mounted 50 m from the slew pivot point, 10 m to the left of the reclaimer x axis and 15 m above the rail, the translation is x=50.0, y=10.0 and z=15.0.
(44) The camera orientation can be described by the direction (rotation) of the optical axis (z axis) with reference to the machine x axis and the direction (rotation) of the camera y axis with reference to the reclaimer y axis. The camera orientation is expressed as a Quaternion but can also be expressed as Euler Angles or a Rotation Matrix. The orientation quaternion and position translation are combined to provide the Local Transform Matrix.
(45) The steps of composing the camera transform matrix, and subsequently transforming the camera image to the stockyard coordinate system is shown in
(46) Mapping of points expressed in terms of the reclaimer local coordinates to the stockyard area coordinate system is accomplished by transformation (rotation and translation) of the points using an Area Transform Matrix. The transformation is described by the translation of the points based on the position of the reclaimer coordinate reference position within the stockyard area (x=south/north, y=east/west, z=level) and the rotation of the points based on the positions of the linked axis between the reclaimer local reference point and the point to be transformed.
(47) The apparatus and method of reclaimer volume rate control controls the reclaim volume rate (cubic meter per second) based on the directly measured 3D stockpile bench face profile. The stockpile bench face profile is measured by the four 3D cameras 12 mounted on each side of the reclaimer bucket-wheel 14.
(48) The individual 3D camera images are combined to provide a high resolution stockpile bench face map. The resolution of the stockpile face map depends on the camera pixel resolution and the distance from the camera to the stockpile. Typically, the stockpile face target point size is less than 40 mm in both the vertical and horizontal planes.
(49) Parts of the bucket-wheel 14 and reclaimer boom structure 24 may encroach into the camera field of view. Image points corresponding to reclaimer structural elements are ignored when mapping the composite image to the stockpile bench face profile array. This is accomplished by provision of 3D models of the bucket-wheel 14 and boom structure 24. Target points falling within the 3D model space are ignored. Culling of the bucket-wheel image points is shown at step 132 in
(50) A profile map is created to store the stockpile bench face profile, with each profile point defined in terms of the distance from the bench arc, along a cut arc ray. The stockpile bench face profile obtained at 118 is mapped onto the buckle-wheel cut height profile to provide a bucket-wheel cut height profile at 113. The step of calculating the cut volume profile (115) of material at the stockpile bench face is performed by calculating at step 114 the sum of the volumes for each point of the stockpile bench face profile in the area abutting the bucket-wheel.
(51) The bucket-wheel cut height profile 113 is a two dimensional array of distance values. The distance values are defined as the distance (in meter) from an arc formed by the point at the center of the bucket-wheel 14 as it is slewed outwards across the stockpile face. The distances are measured along a series of rays running perpendicular to the bucket-wheel axle. The series of rays extends from a ray pointing vertically down to a ray pointing forward to center face of the bucket-wheel 14. Where the ray extends above the center of the bucket-wheel 14, then the ray will be horizontal and the origin will lie on a line extending vertically upwards from the center of the bucket-wheel. Where the ray extends behind the center of the bucket-wheel 14, then the ray will be vertical and the origin will lie on a line extending horizontally backwards from the center of the bucket-wheel. This is illustrated in
(52) The bench cut height profile 113 is used to calculate at step 117 the bench face cut volume in the area abutting the bucket-wheel excavation tool. The reclaim cut volume rate 119 is then calculated at step 123 as the change in volume of the stockpile bench face between two points in time. The time interval between volume sampling is chosen to provide continuous update of the reclaim volume rate 119.
(53) The bench cut height profile 113 is also used to calculate at step 114 the cut volume profile (115 in
(54) The bucket-wheel cut volume per meter (cut volume profile 115) is also used to calculate, at step 122 (in
(55) Due to compaction, the bulk density of stacked material will be higher than the reclaimed material bulk density. Fines material has a higher compaction factor than lump material. Material excavated by the bucket-wheel 14 will be made up of a mixture of compacted and loose material. The mix depends on the product flow characteristics and the presence of collapsed material. Compensation for the change in bulk density may be provided by a Material Volume Compensation factor which is defined as the ratio of the Reclaimed Material Volume to the Stacked Material Volume. This factor may be provided by a lookup table which contains a factor for each material type, or optionally by measurement of the reclaimed volume and subsequent calculation of the Material Volume Compensation for the current stockpile product.
(56) Calculation of the Material Volume Compensation is achieved by a software routine which tracks the Stacked Material Volume from the bucket-wheel to a position on the reclaimer boom conveyor where the Reclaimed Material Volume is measured. Measurement of the Reclaimed Material Volume is typically provided by a belt profile scanner, using a 2D laser line scanner or a 3D image capture instrument.
(57) It is normally necessary to ensure that the bucket-wheel power (or torque) is maintained within the drive operating power limits. The reclaim rate is limited in high power scenarios to control both the instantaneous peak power and longer term thermal power limits of the bucket-wheel drive. This is accomplished in step 124 (see
(58) The 3D volume rate control apparatus and method preferably also provides both the travel target position and travel target speed in order to control the reclaim rate during the step advance motion. The apparatus and method provide reclaim rate control during the forward motion (step advance) by determination of the volume for meter (cubic meter per meter), similarly to the control strategy for slew motion.
(59) Now that preferred embodiments of the 3D volume rate control method and apparatus have been described in detail, it will be apparent that the described embodiments provide a number of advantages over the prior art, including the following: (i) Providing accurate reclaim volume measurement the reclaim volume rate becomes independent of the product characteristics, stockpile face shape and bucket-wheel cutting characteristics. (ii) Whilst measurement and calculation of the reclaim volume is complex, the application of the bucket-wheel speed control is simplified as there is no longer any requirement to apply the customised correction parameters that are typically required to improve performance of power based controllers. (iii) Providing machine collision protection by detecting when the end target of a bench lies below the face of the next higher bench to avoid undermining; detecting stockpile face collapse; and, continuously monitoring the space on each side of the boom and stopping the machine motion to avoid stockpile and machine collisions. (iv) Providing improved reclaim production rates: by using the highly accurate 3D bucket-wheel to stockpile distance to provide automatic bench face up control with optimum cut depth on the first slew; by using the accurate edge detection and optimised cut depth at all stockpile positions, including complete compensation for the end cone shape to produce optimum cut depth every time; by optimising slew turn around based on the correct determination of the face edge position; by maintaining accurate volume based slew speed control throughout the entire bench arc to optimise the slew turn around; by avoiding the reclaim conditions that lead to stockpile creep based on accurate edge detection; by maintaining the cut depth at the optimum values independent of the inner slew turnaround position, end cone shape and bench height and thus reclaiming with the minimum number of slew cuts; by removing the dependence on product characteristics (density, moisture content etc. . . . ) to achieve maximum route volume rate; by providing measured rate control in both cutting directions and therefore not being affected by changes in bucket-wheel cutting efficiency caused by the tilt and skew in relation to the bench face; and, by using the scanned bench face profile to detect face collapses the controller is able to respond to the collapse and avoid bucket-wheel overload, and the collapsed volume is measured so the production rate is maintained. (v) Providing reduced maintenance and improved production without driving the machine harder. The tighter reclaim control provides several maintenance benefits, including reduced bucket-wheel wear (optimised bucket-wheel cut depth), improved belt tracking (less fluctuation in reclaim rate), and reduced chute blockages (peak volume rate controlled).
(60) It will be readily apparent to persons skilled in the relevant arts that various modifications and improvements may be made to the foregoing embodiments, in addition to those already described, without departing from the basic inventive concepts of the present invention. For example, other suitable types of 3D image sensors may be employed apart from the time-of-flight 3D cameras described. Therefore, it will be appreciated that the scope of the invention is not limited to the specific embodiments described.