System For Conducting An Agricultural Operation Using An Autonomous Vehicle
20170311534 · 2017-11-02
Inventors
- Adam Rusciolelli (Chicago, IL, US)
- Tyson Dollinger (Mazon, IL, US)
- John Posselius (Ephrata, PA, US)
- Christopher A. Foster (Mohnton, PA, US)
- Brian Ray (Chicago, IL, US)
Cpc classification
A01B79/02
HUMAN NECESSITIES
G05D1/0088
PHYSICS
International classification
G05D1/00
PHYSICS
Abstract
The present invention provides a system for conducting agricultural operations in a field using one or more autonomous vehicles in which the agricultural operations may be optimized during run time. The system includes providing a mission plan for an autonomous vehicle, receiving progress updates from the vehicle as it conducts an agricultural operation according to the mission plan, and monitoring for event conditions which may he reported by the vehicle. Event conditions may include, for example, detection of an obstacle, or an oncoming vehicle, or a disablement of the vehicle. Upon receiving an event condition, the system may revise the mission plan to resolve the event condition while providing an optimization based on current agricultural conditions.
Claims
1. A method for conducting an agricultural operation using an autonomous vehicle comprising: (a) providing a mission plan for an autonomous vehicle, the mission plate including a path for the autonomous vehicle to travel while performing an agricultural operation; (b) receiving with a base station, via wireless transmission, progress information from the autonomous vehicle indicating progress with respect to the agricultural operation; (c) monitoring for an event condition with the base station; (d) upon receiving an event condition, revising the mission plan for the autonomous vehicle with the base station without real time user input to optimize the mission plan based on current agricultural conditions; (e) transmitting the revised mission plan from the base station to the autonomous vehicle; and (f) adjusting the path of the autonomous vehicle in accordance with the revised mission plan so as to resolve the event condition.
2. The method for conducting the agricultural operation using the autonomous vehicle of claim 1, wherein the progress information includes a position of the autonomous vehicle with respect to the path.
3. The method for conducting the agricultural operation using the autonomous vehicle of claim 1, wherein the progress information includes at least one of an amount of product collected and an amount of product dispensed.
4. The method for conducting the agricultural operation using the autonomous vehicle of claim 1, wherein the event condition is reported by an autonomous vehicle, and wherein the event condition is an obstacle detected by the autonomous vehicle in the path.
5. The method for conducting the agricultural operation using the autonomous vehicle of claim 1, wherein the event condition is an oncoming vehicle detected by the autonomous vehicle.
6. The method for conducting the agricultural operation using the autonomous vehicle of claim 5, wherein the oncoming vehicle is detected in an adjacent path.
7. The method for conducting the agricultural operation using the autonomous vehicle of claim 1, further comprising determining the revised mission plan according to at least a first weight indicating an importance of completion time and a second weight indicating an importance of agricultural efficiency.
8. The method for conducting, the agricultural operation using the autonomous vehicle of claim 1, further comprising determining the revised mission plan according to a constraint requiring a maximum speed for the autonomous vehicle while performing the agricultural operation.
9. The method for conducting the agricultural operation using the autonomous vehicle of claim 1, wherein step (c) includes monitoring with the base station for an event condition reported by a second autonomous vehicle, and step (d) includes providing the revised mission plan for the autonomous vehicle upon receiving an event condition reported by the second autonomous vehicle.
10. The method for conducting the agricultural operation using the autonomous vehicle of claim 9, wherein the event condition reported by the second autonomous vehicle is a disablement of the second autonomous vehicle.
11. A system for managing an agricultural operation using an autonomous vehicle, the system comprising: a processor executing a program stored in a non-transient medium operable to: (a) provide a mission plan for an autonomous vehicle, the mission plan including a path for the autonomous vehicle to travel while performing an agricultural operation; (b) receive via wireless transmission progress information from the autonomous vehicle indicating progress with respect to the agricultural operation; (c) monitor for an event condition; (d) upon receiving an event condition, revise the mission plan for the autonomous vehicle without real time user input to optimize the mission plan based on current agricultural conditions (e) transmit the revised mission plan to the autonomous vehicle; and (e) cause the path of the autonomous vehicle to adjust in accordance with the revised mission plan so as to resolve the event condition.
12. The system for managing the agricultural operation using the autonomous vehicle of claim 11, further comprising to determine the revised mission plan according to at least a first weight indicating an importance of completion time and a second weight indicating an importance of agricultural efficiency.
13. The system for managing the agricultural operation using the autonomous vehicle of claim 11, further comprising to determine the revised mission plan according to a constraint requiring a maximum speed for the autonomous vehicle while performing the agricultural, operation.
14. A method for conducting agricultural operations in a field using first and second autonomous vehicles comprising: (a) providing a mission plan for the first and second autonomous vehicles, the mission plan including first and second paths for the first and second autonomous vehicles to travel while performing first and second agricultural operations, respectively; (b) receiving progress information with a base station, via wireless transmission, from the first and second autonomous vehicles indicating progress with respect to the first and second agricultural operations, respectively; (c) monitoring for an event condition with the base station; (d) upon receiving an event condition, revising with the base station the mission plan without real time user input to optimize the mission plan based on current agricultural conditions for at least one of the first and second autonomous vehicles; (e) transmitting the revised mission plan from the base station to the at least one of the first and second autonomous vehicles; and (f) adjusting at least one of the first and second paths for the at least one of the first and second autonomous vehicles, respectively, in accordance with the revised mission plan so as to resolve the event condition.
15. The method for conducting agricultural operations in the field using first and second autonomous vehicles of claim 14, wherein the event condition is an obstacle detected by at least one of the first and second autonomous vehicles in at least one of the first and second paths, respectively.
16. The method for conducting agricultural operations in the field using first and second autonomous vehicles of claim 14, wherein the event condition is reported by the first autonomous vehicle, and wherein the event condition is the second autonomous vehicle being detected as an oncoming vehicle by the first autonomous vehicle.
17. The method for conducting agricultural operations in the field using first and second autonomous vehicles of claim 14, further comprising determining the revised mission plan according to at least a first weight indicating an importance of completion time and a second weight indicating an importance of agricultural efficiency.
18. The method for conducting agricultural operations in the field using first and second autonomous vehicles of claim 14, further comprising determining the revised mission plan according to constraints requiring first and second maximum speeds for the first and second autonomous vehicles while performing the first and second agricultural operations, respectively.
19. The method for conducting agricultural operations in the field using first and second autonomous vehicles of claim 14, further comprising the mission plan including conducting the first agricultural operation in an area of the field before conducting the second agricultural operation in the area.
20. The method for conducting agricultural operations in the field using first and second autonomous vehicles of claim 19, wherein the first autonomous vehicle is a harvester and the second autonomous vehicle is a tiller.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Preferred exemplary embodiments of the invention are illustrated in the accompanying drawings in which like reference numerals represent like parts throughout.
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
DETAILED DESCRIPTION OF THE DRAWINGS
[0028] Referring now to
[0029] The vehicle 10 may also include a long range antenna 16 for communicating with abase station (which may be >1 mile) and a short range antenna 18 for communicating with other vehicles and/or a localized base station in the field (which may be <1 mile). Such communications may be accomplished via radio communications transmitted and received on varying bands.
[0030] Referring now to
[0031] The control system 20 may also be in communication with a communication system 34, a drive system 36, and an agricultural operation control system 38. The communication system 34 may allow communication with the base station via the long range antenna 16 and/or communication with other vehicles and/or a localized base station via the short range antenna 18. The drive system 36 may allow for general operation of the vehicle 10 by the control system 20 without the physical presence of a human operator, such as braking, accelerating, steering, shifting, and the like. The agricultural operation control system 38 may allow for general operation of the agricultural machinery 14 by the control system 20, such as collecting an agricultural product (such as for harvesting), dispensing an agricultural product (such as for planting or spraying), actuating an agricultural product (such as for cutting or raking) and the like.
[0032] Referring now to
[0033] For conducting agricultural operations in the field 50, vehicles 10, labeled “A,” “B,” “C” and “D” in
[0034] Each vehicle 10 may autonomously travel a path 60 in the field 50 while performing an agricultural operation according to the mission plan. The paths 60 may be bounded be a field line 62 (which may also include a fence) and/or demarcated sections of the field 50, such as a first section 64 for the first team 56 to operate, and a second section 66 for the second team 58 to operate. In one aspect, the vehicles 10 may operate systematically in rows, hack and forth, each row having a width “W” determined to accommodate the vehicles 10 for maximum fanning production. The mission plan may take into account known or expected obstacles in the field 50, such as trees 70, a local base station 72, or a water formation 74, such that the paths 60 may be arranged in advance with turns 76 to avoid such obstacles in completing rows of a section.
[0035] While the vehicles 10 are conducting their agricultural operations, they may each provide progress information to the base station 52. The progress information may indicate progress with respect to the agricultural operation the vehicle 10 has been assigned. Accordingly, such progress information may include reporting a current position of the vehicle 10 with respect to the path 60, reporting an amount of agricultural product collected, reporting an amount of agricultural product dispensed, and so forth. For example, vehicle A may report its precise GPS location corresponding to nearing completion of the third row of the first section 64 with a specific amount of crop harvested, and vehicle B may report its precise GPS location corresponding to a distance behind vehicle A, nearing completion of the first row of the first section 64, with tilling in progress. Upon completion of the agricultural operations, the vehicles 10 may exit the field 50 at one or more predetermined egress points 78.
[0036] Referring now to
[0037] In one aspect of the invention, the base station 52 may conduct agricultural operations in the field 50 via the computer processing system 100. The computer processing system 100 may store multiple data structures 110 in a computer readable non-transient medium, such as a Random Access Memory (RAM). Flash memory or disk for conducting the agricultural operations. The computer processing system 100 may also execute a program 112 stored in the same or different computer readable non-transient medium to provide the mission plan for the vehicles 10, receive progress information from the vehicles 10, monitor for event conditions, which may be reported by the vehicles 10, and provide revised mission plans for the vehicles 10 as necessary.
[0038] All relevant data for mission planning and construction may be initially collected in the data structures 110. The data structures 110 may include: one or more maps 120, which may include (31S maps of the field 50, yield maps, soil maps, nutrient maps, prescription maps/rates (such as for fertilizer, seed, manure, herbicide, and the like), radio coverage maps, satellite images, and the like; weather maps 122, which may include weather forecast data received over the WAN; an inventory record 124 of the vehicles 10 and/or other equipment available in the system, which may include for each vehicle 10 an equipment break-down, such as a unique identifier 126, a selected agricultural operation 128, an equipment type 130, a relative hierarchy or rank 132 with respect to other vehicles 10, and/or a maintenance status 134 or service schedule; an equipment library 136, including information providing equipment geometries and/or specifications for each type of vehicle 10 in the inventory record 124 corresponding to the equipment type 130; and historical data 138, which may include mission reports reported by vehicles 10 from previous agricultural operations.
[0039] The data structures 110 may also include data structures which may receive user input for generating mission plans (such as via the I/O terminal 106) including, for example, an operation selection field 140, weights 142 and constraints 144. The operation selection field 140 may allow a user to select desired one or more desired agricultural operations to complete for accomplishing a particular mission plan, such as spraying, tilling, harvesting, baling, raking and/or planting. A user may also select a desired order for such agricultural operations, such as harvesting (selected as “1”) to be completed in areas first followed by tilling (selected as “2”), with inapplicable operations left unselected.
[0040] The weights 142 and the constraints 144 may be used in the mission planning and construction to control the optimization of the mission plan. Values for each of the weights 142 may be assigned. The weights 142 may include, for example: an importance of completion time (or overall time for mission execution) (“Time”); an importance of agricultural efficiency of a mission goal (such as planting accuracy, harvest losses or spraying accuracy) (“Efficiency”); an importance of power/torque reserve during operation (“Power”); and so forth. The sum of all of the weights 142 will normally be equal to one.
[0041] The constraints 144 could include, for example: requiring a maximum speed while performing a field operation (such as harvesting, planting, tillage or unloading on-the-go) (“Speed 1”); requiring a maximum speed during headland turns (areas at each end of the, field) (“Speed 2”); requiring a maximum harvest loss limit (“Loss”); requiring a maximum force exertion (“G1”) and/or maximum force duration (“G2”) for motion of the vehicles 10 (such as for management of a power hop or working on rough ground); requiring a minimum turning radius on headlands (“Turn”); requiring a maximum power/torque limit (“Power”); and so forth.
[0042] The data structures 110 may also include data structures to be communicated to the vehicles 10 and/or to be updated based on information received by the vehicles 10 including, for example, a mission plan 150, progress monitors 152, an event log 154, mission revisions 156 and mission reports 158. The mission plan 150 providing a mission plan for an autonomous vehicle, the mission plan may provide the paths, for each of the vehicles 10 and/or other equipment to travel while performing particular agricultural operations in the field, including as described above by way of example in
[0043] One or more mission revisions 156 may be provided by the system from time to time to update one or more portions of the mission plan 150 (such as specific paths for specific vehicles) and/or to replace all of the mission plan 150. Mission revisions 156 may typically be provided, for example, upon receiving an event condition being tracked in the event log 154. Mission revisions 156 may typically adjust paths of one or more vehicles 10 to resolve event conditions being monitored, though mission revisions 156 may be provided for other reasons.
[0044] Each of the aforementioned data structures 110 may be updated from time to time, such as via the gateway 104 and the WAN, to provide updated information, such as current weather reports, updated equipment data, and the like.
[0045] Referring now to
[0046] Next, in block 182, the mission plan is transmitted to the vehicles 10 required to complete the mission plan at the appropriate times. The vehicles 10 then deploy in the field and travel their assigned paths while performing their assigned agricultural operations.
[0047] When there are multiple vehicles 10 in the same, field performing different operations, it may be important that certain field operations be performed in a specific order. Accordingly, a vehicle 10 performing a first field operation may be required to cover an area before a vehicle performing a second field operation covers the same area. The field map for the second field operation may have, for example, three operational regions: no coverage; covered by the first field operation only; and covered by both the first and second field operations. The operational field shape and size for the vehicle performing the second field operation may evolve as the vehicle performing the first field operation covers the field. The mission plan for the second field operation may consider, for example: total field area, area covered by first field operation, planned future path(s) for first field operation, pass width(s) of first field operation, pass width(s) of second field operation, work rate (acres/hour) of first field operation, work rate of second field operation, and so forth.
[0048] Next, in block 184, while the vehicles 10 are deployed, the vehicles 10 may report progress information to the base station, which may include, for example, a position of each vehicle 10 with respect to its assigned path, an amount of agricultural product collected, an amount of agricultural product dispensed, and so forth. The base station receiving the progress information may track the progress information for providing optimizations in subsequent mission revisions.
[0049] Next, while monitoring for event conditions, in decision block 186 the base station determines if an event condition has been reported. During execution of a mission, there may be events which cause deviations from the initial mission plan, such as equipment break down, an obstacle detected that stops a vehicle, a grain tank being full on harvester, and so forth. When such a deviation from the current mission plan occur the current mission may need to be re-constructed and re-optimized with an updated set of constraints, such as an area already covered, a particular piece of equipment unavailable due to a break-down, and so forth. Event conditions may typically be reported by vehicles 10, though other mechanisms may be provided for reporting event conditions, such as the local base station 72, or a weather update via the gateway 104 and the weather map 122.
[0050] If an event condition has been reported, the process may proceed to block 188 in which a revised mission plan may be provided. The revised mission plan may adjust the path of one or more of the vehicles 10 to resolve the event condition. The revised mission plan may also provide an optimization based on current agricultural conditions, such as those reported by the progress information in block 184. The revised mission plan may be communicated to only the vehicles 10 necessary to implement the revised mission plan or may he communicated to all of the vehicles 10 for greater consistency.
[0051] Next, in block 190, as part of the optimization, the base station may also, execute a collision avoidance process. To avoid a collision, the collision avoidance process may analyze a current pass of each vehicle and a next planned pass of each vehicle, and may compare this analysis to the current pass and next planned passes of all vehicles performing operations in the same field. If it discovers that any vehicles may pass in opposite directions on the same or adjacent paths, the collision avoidance process may re-plan the path for one of the vehicles involved in the potential collision. When a potential collision is identified, a vehicle with a lower rank in the hierarchy may execute one of several possible avoidance strategies, such as moving to a new path/pass that will avoid the collision, or stopping and waiting at the end of a current pass. Having provided a mission revision to resolve the event condition and having verified collision avoidance, the process may return again to block 184 for receiving progress information, then decision block 186 for determining if an event condition has been reported.
[0052] However, following decision block 186, if an event condition has not been reported, the process may proceed to decision block 190 in which the base station determines if the mission has been completed. The base station may make this determination by applying one or more factors, including comparing progress information received from the vehicles 10 to the current mission plan, monitoring a completion time and/or monitoring for mission reports from the vehicles 10. If the mission has been completed, in block 192, the base station may receive mission reports from the vehicles 10, each mission report indicating completion of the mission by a particular vehicle 10. Mission reports may include final progress information, a date/time stamp and/or a report of sensor, readings from sensors described above with respect to
[0053] Referring now to
[0054] Referring now to
[0055] Multiple mission revisions may be presented as options and/or adjustments may be made before communicating to vehicles 10 for execution, similar to providing a mission plan as described above with respect to
[0056] Referring now to
[0057] Referring now to
[0058] Referring now to
[0059] Next, in block 262, to avoid a collision, the collision avoidance process, may analyze a current pass of each vehicle, and in block 264, a next planned pass of each vehicle. The passes may be analyzed and compared to determine if any vehicles may pass in opposite directions on the same or adjacent paths. In decision block 266, if it is discovered that any vehicles may pass in opposite directions on the same or adjacent paths, the collision avoidance process may proceed to block 268 in which the path for a lower ranked vehicle in the hierarchy may be redirected to avoid the potential collision in a revised mission. Redirection of the vehicle with lower rank in the hierarchy may include, for example, moving to the vehicle to a new path/pass that will avoid the collision, or stopping the vehicle and waiting at the end of a current pass. Next, in block 270, remaining portions of the mission plan may he analyzed for re-construction and re-optimization, which may be based on current agricultural conditions such as those provided by the progress information of vehicles in the system. If an optimization may be realized, the revision plan may be further updated.
[0060] The present invention may be part of a “safety system” used to protect human life and limb in a field, construction or other environment. Nevertheless, the term “safety,” “safely” or “safe” as used herein is not a representation that the present invention will make the environment safe or that other systems will produce unsafe operation. Safety in such systems depends on a wide variety of factors outside of the scope of the present invention including: design of the safety system, installation and maintenance of the components of the safety system, and the cooperation and training of individuals using the safety system. Although the present invention is intended to be highly reliable, all physical systems are susceptible to failure and provision must be made for such failure.
[0061] Although the best mode contemplated by the inventors of carrying out the present invention is disclosed above, practice of the above invention is not limited thereto. It will he manifest that various additions, modifications and rearrangements of the features of the present invention may be made without deviating from the spirit and the scope of the underlying inventive concept.