METHOD FOR CONTROLLING THE OPERATION OF A MACHINE FOR HARVESTING ROOT CROP
20210378167 · 2021-12-09
Inventors
Cpc classification
G06V10/255
PHYSICS
A01D2033/005
HUMAN NECESSITIES
International classification
Abstract
A method is provided for controlling the operation of a machine for harvesting root crop. At least one optical image-capturing unit captures at least one test image of harvested material comprising root crop which is moved along relative to a machine frame by means of at least one conveyor element. A conveying speed of the conveyor element is set on the basis of a test data set which is generated using the test image or formed by means of the latter. An evaluation device generates, on the basis of the test data set, a conveying speed signal, independent of a speed of the harvested material, for setting the conveying speed.
Claims
1. A method for controlling the operation of a machine for harvesting root crop, the method comprising the steps of: Capturing, via at least one optical image-capturing unit, at least one test image of harvested material comprising root crop which is moved along relative to a machine frame by at least one conveyor element; generating a test data set formed using the test image or by the test image; generating, via an evaluation device, a conveying speed signal based on the test data set, independent of a speed of the harvested material, for setting the conveying speed; and setting a conveying speed of the conveyor element based on the conveying speed signal.
2. The method as claimed in claim 1, wherein the conveying speed signal is also determined independently of the speed of the conveyor element.
3. The method as claimed in claim 1, wherein the evaluation device compares the test data set with an initial data set which is generated on the basis of an initial image or formed from the initial image.
4. The method as claimed in claim 3, wherein the test data set from a first execution of the method serves as an initial data set for a further execution of the method.
5. The method as claimed in claim 3, wherein the evaluation device determines the conveying speed signal on the basis of an evaluation of the optical flow of the harvested material which is obtained from the test data set and the initial data set.
6. The method as claimed in claim 3, wherein the evaluation device calculates at least one movement characteristic data set which characterizes a movement of at least one object which is at least partially represented by the test image, wherein the conveying speed signal is generated on the basis of the movement characteristic data set.
7. The method as claimed in claim 6, wherein the evaluation device generates in each case a movement characteristic data set for different objects which are represented with the test image or different, first partial image areas.
8. The method as claimed in claim 7, wherein the evaluation device calculates, in a first calculation step for a multiplicity of partial image areas comprising at least a first number of pixels, in each case a movement characteristic data set, and calculates in a later calculation step, taking into account the movement characteristic data sets calculated in the first calculation step, in each case a further movement characteristic data set for a relatively high number of different partial image areas, which comprise a relatively low number of pixels.
9. The method as claimed in claim 6, wherein the evaluation device calculates a capacity utilization characteristic value (LS) on the basis of at least one movement characteristic value, characterizing a direction of movement, of the at least one movement characteristic data set.
10. The method as claimed in claim 9, wherein the evaluation device statistically evaluates a plurality of movement characteristic values, which are included in different movement characteristic data sets, in order to calculate the capacity utilization characteristic value (LS).
11. The method as claimed in claim 9, wherein the capacity utilization characteristic value (LS) is determined by a deviation, calculated by the evaluation device, of the first portion (A1) from a threshold value (R).
12. The method as claimed in claim 9, wherein the conveying speed signal is calculated using a multiplicity of capacity utilization characteristic values (LS), or at least one previously calculated capacity utilization characteristic value (LS) is input into the calculation of the capacity utilization characteristic value (LS).
13. The method as claimed in claim 1, wherein the evaluation device calculates at least one first portion (A1), formed by at least one image area, of the test image, wherein the at least one image area represents at least partially a defined component of the harvested material or of the machine.
14. The method as claimed in claim 13, wherein the at least one image area, which forms the first portion (A1), is identified, on the basis of a test data subset which is generated using the image area, as the defined component of the harvested material or the machine.
15. The method as claimed in claim 13, wherein the test data subset is classified by an statistical classification method, and an image area is classified as being associated with the first portion (A1).
16. The method as claimed in claim 13, wherein the at least one test value of the test data subset is compared with at least one reference value, and an image area is classified as being associated with the first portion (A1).
17. The method as claimed in claim 15, wherein when exemplary image areas, which can be classified as being associated with the first portion (A1), of a reference image are input, the evaluation device automatically further develops a model on which the classification method is based and/or automatically calculates or changes the at least one reference value range.
18. The method as claimed in claim 13, wherein different image areas are weighted differently during the calculation of the first portion (A1).
19. The method as claimed in claim 13, wherein the entire test image or a coherent test image part is divided into partial image areas.
20. The method as claimed in claim 13, wherein the test image comprises a plurality of test image parts for which the evaluation device respectively calculates a first portion (A1).
21. The method as claimed in claim 13, wherein the image areas which form the first portion (A1) show root crop or parts thereof and image areas which form a second portion show extraneous materials or parts thereof.
22. The method as claimed in claim 1, wherein at least one sensor transmits sensor data to the evaluation device, which data is input into the calculation of the conveying speed signal.
23. The method as claimed in claim 1, wherein the evaluation device triggers either an increase or a reduction in the conveying speed of at least individual conveyor elements by different conveying speed signals.
24. The method as claimed in claim 23, wherein a conveying speed gradient which is triggered by the conveying speed signal and/or the difference between the conveying speeds upstream and downstream of an acceleration or deceleration is dependent on the capacity utilization characteristic value (LS).
25. The method as claimed in claim 23, wherein after the triggering of a change in the conveying speed no further change in the conveying speed is triggered for a defined time period or a defined conveying distance.
26. The method as claimed in claim 1, wherein the conveying speed signal is transmitted in a wired fashion or in a wireless fashion, to a conveying speed control unit.
27. The method as claimed in claim 1, wherein the evaluation device evaluates the test data sets locally on the machine or on a directly connected tractor vehicle.
28. A machine for harvesting root crop, the machine comprising: at least one machine frame, at least one conveyor element, at least one optical image-capturing unit and one evaluation device; wherein the machine is operable to perform the method recited in claim 1.
29. The machine as claimed in claim 28, wherein the evaluation device comprises a graphic processor unit.
30. The machine as claimed in claim 28, further including at least one sensor which is coupled to the evaluation device.
31. The machine as claimed in claim 28, further including a plurality of image-capturing units which during operation each capture at least one test image of the same conveyor element or of different conveyor elements.
32. The machine as claimed in claim 28, wherein the conveyor element is embodied as a screening belt or hedgehog web, or a screening star (10P, 10Q, 10S) or conveyor roller.
33. The machine as claimed in claim 28, wherein the image-capturing unit is arranged in such a way that the test image shows at least two alternative conveying paths for different components of harvested material.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0080] Reference is now made more particularly to the drawings, which illustrate the best presently known mode of carrying out the invention and wherein similar reference characters indicate the same parts throughout the views.
[0081]
[0082]
[0083]
[0084]
[0085]
[0086]
[0087]
[0088]
[0089]
[0090]
[0091]
[0092]
[0093]
[0094]
[0095]
[0096]
[0097]
[0098]
[0099]
DETAILED DESCRIPTION OF THE DRAWINGS
[0100] Identically or similarly acting parts are, where expedient, provided with identical reference symbols. Individual technical features of the exemplary embodiments described below can also be combined with the features of the exemplary embodiments described above to form developments according to the invention, but always at least in combination with the features in one of the independent claims. The subject matters specified in the list of the figures are in some cases only illustrated partially in individual figures.
[0101] The method according to the invention serves to control the operation of a machine 2 for harvesting root crop 4 (cf.
[0102] The test image 8 is transmitted to an evaluation device which generates, on the basis of a test data set which is generated on the basis of the test image 8 or formed thereby, a separating device setting signal for setting at least one operating parameter of a separating device of the machine 2. The representations which are illustrated as test images or initial images merely show schematically the parts which are relevant for the invention without any borders or limitations. Images, in particular digital images, which are captured by a camera, comprise, under certain circumstances, further information which is not illustrated in the representations. This information can, for example, already be masked or filtered at the camera or when a test data set is produced or processed.
[0103] In one exemplary embodiment according to the invention, a crop flow 1.1 of a separating device is captured by means of a first image-capturing unit 6 (block 1.2,
[0104] The determination of the conveying speed signal is illustrated in
[0105] A low-pass filter for smoothing the acquired values subsequently passes via the continuously evaluated statistic (block 13.5). A predefined and in particular predefinable filter time constant is used for this (block 13.6), which specifies the degree of smoothing.
[0106] A capacity utilization characteristic value, generally denoted by LS, of the conveying line area which is represented in the test image is acquired on the basis of the filtered or smoothed statistic of the deviations described above (block 13.7). Said value represents the movement situation of the harvested material or of the crop flow in the region of the separating device, in particular on the conveyor element or in the transition region between two conveyor elements.
[0107] Referring to the second supplementary or alternative path, the relevant test image parts are also firstly extracted (block 2.1). For this purpose, a mask or region of interest (ROI) can be predefined on the basis of the position of the image-capturing unit 6 (block 2.2) and is used to differentiate distances in the test image 8 which are to be taken into account and ones which are not to be taken into account. The calculation of portions of the individual image areas showing components of the harvested material is now performed on the basis of the relevant image section of the test image 8 and of the test data set which is provided for processing (block 2.3). In particular the color information can be evaluated for this purpose. These values can be obtained from a reference table or else specified by an operator (block 2.4).
[0108] The deviations of the calculated portions from the threshold value are calculated (block 2.6) on the basis of a threshold value definition (block 2.5). The threshold value is, for example, an ideal value for the respectively considered portion (e.g. root crop, amount of extraneous material 1, amount of extraneous material 2). Subsequently, low-pass filtering is carried out for the purpose of smoothing the acquired deviations (block 2.7). In this context, a filter time constant which is defined according to block 2.8 is used. Subsequently, a further capacity utilization characteristic value LS or the capacity utilization characteristic value LS is calculated on the basis of the smoothed values of the deviations for the individual positions along the conveying line and the respective portions (block 2.9).
[0109] Subsequently, the conveying speed signal will be generated on the basis of the capacity utilization characteristic value or values LS, for example by means of a three-point controller, described below (block 2.10).
[0110]
[0111] If the capacity utilization characteristic value has a value of −1, a capacity utilization characteristic value which is input into the memory 14.2 is in turn interrogated (block 14.8), and in accordance with the differentiation described above it is decided whether a conveying speed signal for accelerating the conveying speed is output or has been already output. The program sequence can optionally be optimized by virtue of the fact that an acceleration is triggered only a specific sequence of a number of capacity utilization characteristic values which indicate an underload or insufficient loading. Therefore, for example for the respective areas of the conveying line it is monitored whether an underload is present (block 14.9), and only then is an acceleration pulse emitted (block 14.10).
[0112]
[0113] The conveying speed increment or decrement is converted by the evaluation device into a speed specification for a separating device drive (block 17.5). The resulting conveying speed signal is transmitted to the separating device drive (block 17.6). This results in a conveying speed of the separating device (17.4).
[0114]
[0115] In one preferred embodiment of the method according to the invention, the evaluation device compares the initial image 9 with the test image 8 insofar as directions of movement of objects illustrated in the images are determined. An object does not necessarily characterize a coherent body but rather in the test image 8 merely constitutes an area which can be identified in respect of its movement and which is in particular of the size of an area which is represented by means of one pixel of the test image 8. In particular, in this way the evaluation device therefore calculates a direction of movement for each pixel of the test image 8, assesses its deviation from a reference direction which is known for each area—in particular for each pixel—and evaluates these deviations statistically.
[0116] The movement characteristic values 20 are evaluated statistically for the calculation of the capacity utilization characteristic value LS. In this context, the movement characteristic values 20 merely comprise a direction of movement, and not a movement distance, indicated for example by the length of the arrow.
[0117] In order to calculate a capacity utilization characteristic value LS, indicated by the line 14, in particular a standard deviation of these movement characteristic value deviations from the reference characteristic value 22 is formed. For this purpose, in particular the deviations can in particular be respectively squared and then summed. This sum is then divided by the number of movement characteristic values 20, and the square root of the quotient resulting therefrom is formed. The value which is obtained in this way is the capacity utilization characteristic value LS, which is indicated by way of example in the illustrated histogram.
[0118] In order to calculate the movement characteristic values 20, first image areas 16 of the test image 8 are advantageously compared with further image areas 18 of the initial image 9, wherein each image area 16, 18 comprises the same number of pixels and is in particular rectangular. For the purpose of simplified illustration, only a few exemplary image areas 16, 18 are illustrated in
[0119] Depending on the conveying line area, it is possible to determine in the evaluation device which capacity utilization brings about a reduction or an increase in the conveying speed. It is therefore possible for example to increase the speed when there is a standard deviation of less than 10°, to maintain the speed when there is a standard deviation of 10° to 20°, and to reduce the conveying speed when there is a larger standard deviation. Accordingly, for the conveyor elements 10A and 10B, embodying a drop step between two screening belts, it is possible to determine, on the basis of the evaluation solely of the detected directions and their standard deviation, whether a blockage of harvested material occurs on the conveyor element 10B which is located below. If a corresponding state, owing for example to a threshold value R indicating a blockage being exceeded, is detected, a conveying speed signal for accelerating the conveyor element 10B is output by the evaluation device, as an alternative to or in addition to a reduction in the conveying speed of the inwardly conveying conveyor element 10A.
[0120]
[0121] An arrangement of the optical image-capturing units 6 is disclosed in
[0122] The positions of image-capturing units 6 which are indicated in
[0123] An evaluation device can be positioned at any desired centrally accessible location, but preferably in the vicinity of the sorting table. Information relating to the setting of the separating devices can be sent to an operator on a tractor vehicle from the evaluation device, for example via a cable 12.1 which can be seen in
[0124] The machine 2 which is illustrated in the side view in
[0125]
[0126] A height H of the stripping device 32 above the conveying plane of the conveyor element 10B can also be set. The conveying speeds of the conveyor elements 10A and 10B can be set by means of the method according to the invention.
[0127] A test image 8 which is obtained from the field of vision of the optical image-capturing unit 6, which is shown by means of dashes in
[0128] The harvested material which is still present is transferred from the conveyor element 10B to a further conveyor element 10C with a conveying direction 1C. A separating device in the form of a plurality of rotating deflection rollers 24 which are positioned one above the other is assigned to said further conveyor element 10C. The harvested material is transported in the direction of the conveyor element 10D (
[0129] A distance H between a conveyor element 10C and the lower deflection roller 24 can be set by the operating personnel for the purpose of varying a separating performance. The speeds of at least the inward conveying conveyor element 10C and outward conveying conveyor element 10D, which are embodied as screening belts, can be varied by means of the method according to the invention. In addition, according to one advantageous development the separating performance or deflection can be varied by virtue of the adjustability of the circulation speeds of the deflection rollers 24.
[0130] The image-capturing unit 6 illustrated in
[0131] Insofar as an associated setpoint value for the test image part 8A reveals accumulation of material upstream of the deflection rollers 24, the conveying speed of the conveyor element 10C is increased.
[0132] Alternatively, the evaluation can be based only on the areas 8A and 8C which are located upstream of the deflection rollers 24, are surrounded by dashed lines and are adjacent to another. Permissible densities of portions can be defined for these two areas, for example by means of the respective threshold values R. Starting from the upward transgression of e.g. a portion of, for example, root crop 4 which is associated with excessive accumulation directly upstream of the deflection rollers, the inward conveying belt 10C can be made to run more quickly, and alternatively or additionally an outward conveying belt can be made to run more quickly.
[0133] A height H of the lower ends of fingers 26 of a separating device which is embodied as a finger web 26.1 can also be settable as one of a plurality of operating parameters by the operating personnel. The height H describes the distance between the fingers 26 and the upper edge of the conveyor element which is embodied as a hedgehog web. Moreover, an attitude angle of the finger web 26.1 can be configured in such a way that it can be set with respect to a vertical to the conveying plane of the conveyor element. The same applies to the circulation speed of the finger web 26.1.
[0134] A further optical image-capturing unit 6, which is arranged in the area of the conveyor belts 10C and 10D is illustrated in
[0135] A further optical image-capturing unit 6 is arranged with an associated light source 7 above a sorting table with a view of a conveyor element 10E and a conveyor element 10F (
[0136]