Devices, Systems, And Methods For Sensing The Cross-Sectional Area Of Stalks
20210318118 · 2021-10-14
Inventors
Cpc classification
G01B21/06
PHYSICS
G08B21/182
PHYSICS
G01B5/04
PHYSICS
A01D41/127
HUMAN NECESSITIES
G08B5/00
PHYSICS
International classification
Abstract
Disclosed herein are various devices, systems, and methods for use in agricultural, particularly for use in harvesting agricultural crop such as corn. Various implementations relate to methods and devices for measuring plant stalk cross-sectional area during harvest and providing additional methods of predicting and displaying yield on a row-by-row level in real time.
Claims
1. A method for counting and measuring stalks comprising: generating displacement signals from one or more sensing members when a stalk passes through a sensor; correlating the displacement signals with velocity data; generating stalk perimeter data; and determining stalk cross sectional area from the stalk perimeter data.
2. The method of claim 1, further comprising using one or more of rectangular integration, trapezoidal integration, and best fit curve algorithms for determining stalk cross-sectional area from the stalk perimeter data.
3. The method of claim 1, wherein the sensor comprises one or more of an electromagnetic sensor, a non-contact inductive position sensor, an inductance sensor, a capacitive sensor, an optical sensor, a flexible resistance sensor, a load cell, and an ultrasonic distance sensor.
4. The method of claim 1, further comprising generating velocity data via one or more of a radar sensor, a lidar sensor, a time-of-flight sensor, an ultrasonic sensor, and a vehicle ground speed sensor.
5. The method of claim 1, further comprising identifying and excluding outlier displacement signals.
6. The method of claim 5, further comprising establishing an outlier threshold wherein an outlier displacement signal is identified when the outlier threshold is exceeded.
7. The method of claim 1, wherein stalk cross-sectional area is determined in real-time or near real-time.
8. A system for measuring a cross-sectional area of a stalk at a row unit, comprising: (a) at least one senor assembly disposed on the row unit, the at least one sensor assembly configured to generate width measurements as the stalk traverses the at least one sensor assembly; and (b) at least one stalk velocity sensor, wherein the width measurements are processed by the system to generate stalk perimeter data from which stalk cross-sectional area is determined.
9. The system of claim 8, wherein width measurements are taken in real-time or near real-time as the stalk passes through the row unit.
10. The system of claim 8, wherein the at least one sensor assembly comprises one or more of an electromagnetic sensor, a non-contact inductive position sensor, an inductance sensor, a capacitive sensor, an optical sensor, a flexible resistance sensor, a load cell, and an ultrasonic distance sensor.
11. The system of claim 10, wherein the at least one sensor assembly comprises an electromagnetic sensor.
12. The system of claim 11, wherein the at least one sensor assembly comprises one or more contact sensing members.
13. The system of claim 12, wherein the at least one sensor assembly comprises two contact sensing members.
14. The system of claim 12, wherein the at least one stalk velocity sensor comprises one or more of a radar sensor, a lidar sensor, a time-of-flight sensor, an ultrasonic sensor, and a vehicle ground speed sensor.
15. A system for measuring stalks on a row unit comprising: (a) a sensor assembly disposed on the row unit, the sensor assembly comprising at least one stalk measuring sensor; and (b) a processor in operative communication with the sensor assembly, the processor configured to process data generated by the sensor assembly to estimate a stalk perimeter.
16. The system of claim 15, wherein the stalk measuring sensor is configured to generate a plurality of width measurements in a time series and wherein the plurality of width measurements are correlated to an estimated stalk perimeter.
17. The system of claim 16, wherein the sensor assembly further comprises a velocity sensor.
18. The system of claim 17, wherein the velocity sensor comprises one or more of a radar sensor, a lidar sensor, a time-of-flight sensor, an ultrasonic sensor, and a vehicle ground speed sensor.
19. The system of claim 16, wherein the sensor assembly further comprises one or more sensing members.
20. The system of claim 16, wherein the stalk measuring sensor comprises one or more of an electromagnetic sensor, a non-contact inductive position sensor, an inductance sensor, a capacitive sensor, an optical sensor, a flexible resistance sensor, a load cell, and an ultrasonic distance sensor.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
DETAILED DESCRIPTION
[0049] Disclosed herein are various devices, systems, and methods for measuring plant stalks during harvest. In certain implementations, a system to constructed and arranged to sense multiple widths as a stalk passes through a sensor, the width measurements may then be combined with velocity data to determine widths along a stalk. These data points may then be used with various mathematical techniques to determine a cross sectional area of a stalk.
[0050] Certain of the disclosed implementations can be used in conjunction with any of the devices, systems or methods taught or otherwise disclosed in U.S. Pat. No. 10,684,305 issued Jun. 16, 2020, entitled “Apparatus, Systems and Methods for Cross Track Error Calculation From Active Sensors,” U.S. patent application Ser. No. 16/445,161, filed Jun. 18, 2019, entitled “Agricultural Systems Having Stalk Sensors and/or Data Visualization Systems and Related Devices and Methods,” U.S. patent application Ser. No. 16/800,469, filed Feb. 25, 2020, entitled “Vision Based Stalk Sensors and Associated Systems and Methods,” U.S. patent application Ser. No. 17/013,037, filed Sep. 4, 2020, entitled “Apparatus, Systems and Methods for Stalk Sensing,” U.S. patent application Ser. No. 16/918,300, filed Jul. 1, 2020, entitled “Apparatus, Systems, and Methods for Eliminating Cross-Track Error,” U.S. patent application Ser. No. 16/921,828, filed Jul. 6, 2020, entitled “Apparatus, Systems and Methods for Automatic Steering Guidance and Visualization of Guidance Paths,” U.S. patent application Ser. No. 16/939,785, filed Jul. 27, 2020, entitled “Apparatus, Systems and Methods for Automated Navigation of Agricultural Equipment,” U.S. Patent Application 63/048,797, filed Jul. 7, 2020, entitled “Apparatus, Systems, and Methods for Grain Cart-Grain Truck Alignment and Control Using GNSS and/or Distance Sensors,” U.S. Patent Application 63/074,737, filed Sep. 4, 2020, entitled “Apparatus, Systems and Methods for an Electric Corn Head,” U.S. Patent Application 63/137,946, filed Jan. 15, 2021, entitled “Apparatus, Systems, and Methods for Row Crop Headers,” U.S. patent application Ser. No. 17/225,586, filed Apr. 8, 2021, and entitled “Devices, Systems, and Methods for Corn Headers,” and U.S. patent application Ser. No. 17/226,002 filed Apr. 8, 2021 and entitled “Apparatus, Systems and Methods for Stalk Sensing,” each of which are incorporated herein by reference.
[0051] Various methods and associated devices are known in the art for detecting and measuring plant stalk size during harvest. For example, known methods include measuring the displacement of stripper/deck plates as a measurement of stalk diameter.
[0052] In another example, a known method includes measuring maximum rotation/displacement of sensing members. These known methods and devices do not account for the elliptical nature of many plant stalks. Due to their elliptical nature plant stalks may have varying diameters depending on the particular orientation of the stalk as it enters a harvester row unit. The elliptical nature is such that a diameter may not be an accurate predictor of stalk size, because diameter does not accurately reflect the area of a non-circular object. As would be appreciated stalk diameter can vary by around 20-30% across different orientations. Measurement of the cross-sectional area of a plant stalk is a more accurate measure of stalk size, and therefore the plant's health, when compared to diameter-based measurements.
[0053] In various implementations, the disclosed measurement system 100 and associated methods and devices improve upon the prior art by allowing for the design principles and technologies for the cross-sectional measurement of stalks in real- or near-real-time as they pass through a row unit such as via a harvester row unit.
[0054] Turning now to
[0055] In various implementations of the system 100, and as shown in
[0056] That is, in certain implementations, the operations unit 26 comprises a processor or central processing unit (“CPU”) 27 that is in communication with memory 30 and an operating system (“O/S”) 25 and/or software and sufficient media to effectuate the described processes, and can be used with an operating system 25, memory 30, and the like, as would be readily appreciated by those of skill in the art. It is appreciated that in certain implementations, the memory 30 can be local, as shown in
[0057] In various implementations, the system 10 operations unit 26 can comprise a circuit board, a microprocessor, a computer, or any other known type of processor or central processing unit (CPU) 27 that can be configured to assist with the operation of a system, such as the device disclosed or contemplated herein. In further embodiments, a plurality of CPUs 27 can be provided and operationally integrated with one another and the various components, as utilized in other applications including the contemporaneously filed applications incorporated by reference herein. Further, it is understood that one or more of the operations units 26 and or its processors can be configured via programming or software to control and coordinate the recordings from and/or operation of the various sensor components, such as the sensing members 12A, 12B, as would be readily appreciated.
[0058] In certain implementations, the system 10 and/or operations unit 26 may utilize GPS 28 and a database 30 or other storage device such as the cloud 32, shown in
[0059] Further, the system 100 may be configured to numerically display the observed data, such as via the display 34, shown in
[0060] As shown in
[0061] Continuing with the implementations of
[0062] Continuing with the implementations shown in
[0063] In alternative implementations, the sensor assembly 10 may not include sensing member 12A, 12B but instead generate distance or width data via other known techniques such as optical or other non-contact sensors, as would be appreciated and has be previously disclosed.
[0064] As noted above, in one exemplary implementation, the sensor assembly 10 may generate a plurality of width measurements over time for each stalk 2 that passes through the sensor assembly 10. The plurality of width measurements may be combined with measurements of stalk 2 velocity relative to the sensor assembly 10 to generate a stalk perimeter value for the stalk 2. These generated stalk perimeter values can be used to calculate stalk cross-sectional areas via various known methods, algorithms, and mathematical formulas, including but not limited to rectangular integration, trapezoidal integration, geometric area calculation of best fit ellipse to the measured perimeter, piecewise ellipse approximation using circular arcs, and others as would be appreciated by those of skill in the art.
[0065] In some implementations and/or configurations, the sensing members 12A, 12B may be overlapping in the sensor assembly 10. In these implementations, to measure the stalk 2 width the deflection values of both sensing members 12A, 12B may be added together and the amount of overlap subtracted, such that when the sensing members 12A, 12B are overlapping a negative width or distance is recorded and when the tips of the sensing members 12A, 12B are touching the recorded distance is zero. It is readily appreciated that further configurations are of course possible.
[0066] In any event, in various implementations, on the basis of the movement of the sensing members or other individual stalk sensor readings, there are a number of ways to estimate or measure stalk velocity past the sensing members 12A, 12B or other sensors.
[0067] It is appreciated that vehicle ground speed may be used as one implementation for the approximation of stalk 2 velocity through the sensor assembly 10. However, stalks 2 frequently must exert force to open mechanical sensing members 12A, 12B, like those described above. The resistance created by mechanical sensing members 12A, 12B may causes the stalks to flex to some degree before passing through the sensor assembly 10. This stalk 2 and sensor assembly 10/sensing member 12A, 12B interaction often causes the stalk velocity to vary from recorded vehicle ground speed.
[0068] Further, in various implementations, stalks 2 can also be captured and pushed past through the sensor assembly 10 and/or the sensor members 12A, 12B by gathering chain/fingers, as would be understood, again imparting a velocity that is different from vehicle ground speed. Accordingly, vehicle ground speed may serve as an imperfect proxy for establishing actual stalk velocity at the time the stalk 2 passes through the sensor assembly 10.
[0069] To improve stalk velocity accuracy, alternate measurement techniques may be employed in certain implementations of the system 100. Distance measuring sensors such as radar, lidar, time-of-flight, or ultrasonic ranging may be used to record the rate of change in distance over time while a stalk 2 is passing through the sensing members 12A, 12B, and thereby provide a more accurate stalk velocity for the system 100.
[0070] In various implementations, a video camera may be used in conjunction with image recognition to identify the corn stalk, 2 track its progress through the camera's field of view, and estimate its velocity based on the known distance between the camera and the sensing members 12A, 12B. One or more light gates may be placed near the sensing members 12A, 12B and used to estimate stalk velocity based on the elapsed time between breaking each light gate's beams.
[0071]
[0072]
[0073] Continuing with the implementation of
[0074] It is readily understood by those of skill in the art that thinner stalks likely have decreased yields when compared to full size stalks. For example, unproductive stalks—often caused by late plant emergence compared to neighbor plants—can significantly impact yield. Corn plants that emerge later than adjacent plants within a row typically do not match the size of the adjacent plants. Estimates used among those of skill in the art is about a 50% yield loss for plants behind by one leaf and about a 100% yield loss for plants behind two or more leaves. These unproductive plants have characteristic thin stalks and very small ears. Empirically, unproductive plants are about half the size of thriving plants. For example, unproductive plants typically have about a 50% thinner stalk size than productive plants. For example, in the implementation of
[0075] Turning to
[0076]
[0077] in various implementations, a machine learning algorithm trained to identify these characteristics by collecting displacement data on a large set of corn stalks and annotating the data to indicate the desirable data segments. Alternately, a range of ellipses could be compared to portions of the displacement data until a sufficiently good fit is found. For example, in the illustrated example, an ellipse may provide a better fit for X′ than for the displacement that also includes the initial impact and flex of the stalk. One of skill in the art would be readily able to facilitate the machine learning process. Further, in one exemplary implementation, the system 100 utilizes only the second diameter peak when either sensing member 12A or 12B records two or more peaks before dropping below a predetermined threshold value. Further implementations are of course possible and would be readily appreciated.
[0078] Turning now to
[0079] Accordingly, in use in these situations, there can be recorded perimeter regions 16 as well as gaps (shown generally at 17), which can make establishing an estimated perimeter 21 and therefor stalk cross-sectional area 116 more challenging.
[0080] In one example, shown in
[0081] However, as shown in
[0082] In another example, shown in
[0083] However, in certain implementations of the system 100 like that of
[0084] That is, the system 100 according to these implementations can utilize the measured points to estimate the shape for the missing points to complete the stalk 2 perimeter, and therefore measure or establish the stalk 2 cross-sectional area. In some implementations, the system 100 utilizes known curve-fitting methods and techniques to calculate an ellipse that best fits the measured collection of points shown generally at 18 around the perimeter 20 on a 2-D plane, such as shown in
[0085] In further implementations, the system 100 may be constructed and arranged to disregard or otherwise neutralize errors due to, among other things, sensor noise, plant debris, and other environmental effects. In some implementations, the system 100 may utilize a curve fitting algorithm such that various outlying data points 18A significantly affect the fitted curve are eliminated, as shown in
[0086] That is, the inclusion of an outlying data point 18 can skew or otherwise distort the estimated perimeter 21 drawn by the system 100, such that it does not accurately fit with the ground truth actual perimeter 20. In the example of
[0087] In certain implementations, the system 100 may be constructed and arranged to detect outlying points 18A via mathematical and statistical techniques, as would be appreciated. That is, outlying points 18A may be detected by determining the data points 18 that have a residual error greater than a given defined outlier threshold. These outlying data points 18A can then be rejected, and a new estimated perimeter 21 curve fitted to the remaining points 18, as shown in
[0088] One such example employs algebraic graph theory using proximity information of the data points in addition to a model-based outlier detection algorithm. in this example, the algebraic graph is constructed by connecting adjacent data points 18. The graph Laplacian is constructed and the eigenvalues and eigenvectors are calculated. Data points are classified as outliers if the associated eigenvalues are close to zero, for example 0.1, and are data points that correspond to the non-zero elements of binary eigenvectors with very few l's in the vector. After these outliers have been removed from the data set additional outliers may be identified by employing a random sample consensus algorithm (RANSAC). This algorithm fits a model to a random selection of data points and tests it against the remaining data using a cost function. Remaining points that fit the model well, based on the cost function, are included in the consensus set. If there are a sufficient number of points in the consensus set the model is considered valid. Otherwise a new, random set of data points is selected and the process is repeated. Certain approaches are discussed in Yu, H. Zheng, S. R. Kulkarni, H. V. Poor, “Outlier elimination for robust ellipse and ellipsoid fitting,” in Proc. 3rd IEEE Int. Workshop Comput. Adv. Multi-Sensor Adapt. Process. (CAMSAP), Aruba, Dutch Antilles, December 2009, pp. 33-36, which is hereby incorporated by reference. Further examples are of course possible and would be readily appreciated by those of skill in the art.
[0089] In one implementation, and as shown in
[0090] Turning now to
[0091] In the above-described implementations, a measurement of stalk 2 speed/velocity relative to the sensor assembly 10 is required for determining the points that make up the stalk 2 perimeter. In an alternative implementation, multiple stalk width measurements may be taken simultaneously, thereby eliminating the need to know the individual stalk 2 speed/velocity. In these implementations, the system 100 may utilize multiple contact sensors, such as those shown above at 12A, 12B, structured light, time-of-flight sensors, laser profile sensors, and/or any other known appropriate sensor type as would be appreciated by those of skill in the art. In one specific example, the system 100 may utilize an Omron ZG-WDS8T sensor, shown in
[0092] Although the disclosure has been described with references to various embodiments, persons skilled in the art will recognized that changes may be made in form and detail without departing from the spirit and scope of this disclosure.