Agriculture methods using stick images of plants
09861038 ยท 2018-01-09
Assignee
Inventors
Cpc classification
A01B79/02
HUMAN NECESSITIES
A01G3/00
HUMAN NECESSITIES
International classification
A01G3/08
HUMAN NECESSITIES
A01B79/02
HUMAN NECESSITIES
A01G3/00
HUMAN NECESSITIES
Abstract
A dual function tree pruner and fruit harvester that uses the same equipment for pruning and for harvesting. The Fruit Tree Pruner and Harvesting Machine features: a Self-Propelled-Vehicle (SPV), computer controlled robotic arms, a Digital Imaging System (DIS), a Radar Ranger System (RRS), Global Positioning Satellite (GPS) Guidance System, Geographic Information System (GIS), a Power Pruner or Power Stem Cutter as appropriate, a fruit vacuum system, a fruit catcher, a fruit handling system, and a fruit bin loader. The operation is automated and the operator monitors and sets parameters. The Fruit Tree Pruner and Harvesting Machine can prune a tree to a predetermined profile. The tree can be shaped per the orchard's requirements. The Fruit Tree Pruner and Harvesting Machine utilizes data obtained during the pruning process to find the fruit, and to remove the fruit while maintaining the fruit quality suitable for the fresh market.
Claims
1. An agriculture method comprising: providing a mobile vehicle in a field of plants; electronically developing stick images of the plants; based on the stick images, having the mobile vehicle perform operations on the plants; and relying upon the stick images, electronically developing exclusion zones around structures of the plants, the exclusion zone comprising a volume around the structures that the mobile vehicle is prevented from entering.
2. The method of claim 1 wherein the operation comprises performing harvesting.
3. The method of claim 1 wherein the operation comprises performing pruning.
4. The method of claim 1 wherein the exclusion zones comprise tubular images.
5. The method of claim 1 further comprising, relying upon the stick images, electronically developing data representing proposed locations on the plant where produce will develop.
6. The method of claim 5 wherein the operation comprises performing harvesting relying upon the data representing the proposed locations of the produce.
7. The method of claim 1 wherein the stick images comprise first images, and further comprising developing second images comprising the first images having regions around portions of the stick images that pruning is not to occur.
8. The method of claim 7 further comprising: pruning the plants based on the second images; and after the pruning, obtaining and storing third images of the plants.
9. The method of claim 8 wherein the pruning occurs to allow the desired fruit spacing in the future based on the present location of fruit buds of the plants.
10. The method of claim 8 further comprising utilizing the third images to harvest fruit from the plants.
11. The method of claim 7 wherein the first images comprise vector-based images.
12. The method of claim 7 wherein the developing of the first images comprises first acquiring dual digital images of the plants.
13. The method of claim 7 further comprising: pruning a first portion of the plants utilizing a first arm; pruning a second portion of the plants utilizing a second arm; and pruning a third portion of the plants utilizing a third arm.
14. The method of claim 1 further comprising providing a fruit collector on the mobile vehicle, and wherein the performing of the operations on the plants involves the fruit collector.
15. The method of claim 14 wherein the fruit collector comprises: a suction inlet in fluid communication with a vacuum outlet; and a water inlet in fluid communication with a water outlet.
16. The method of claim 1 further comprising providing a fruit catcher on the mobile vehicle, and wherein the performing of the operations on the plants involves the fruit catcher.
17. The method of claim 16 wherein the fruit catcher comprises an elongated cup configuration.
18. The method of claim 1 wherein the performing of the operations on the plants comprises: utilizing a first robotic arm operational from a first side of the mobile vehicle; and utilizing a second robotic arm operational from a second side of the mobile vehicle opposite from the first side, and wherein from a top plan view, the first robotic arm is staggered from the second robotic arm.
19. An agriculture method comprising: providing a mobile vehicle in a field of plants; electronically developing stick images of the plants; based on the stick images, having the mobile vehicle perform operations on the plants; and relying upon the stick images, electronically developing data representing proposed locations on the plant where produce will develop.
20. The method of claim 19 wherein the operation comprises performing harvesting relying upon the data representing the proposed locations of the produce.
21. An agriculture method comprising: providing a mobile vehicle in a field of plants; electronically developing stick images of the plants; based on the stick images, having the mobile vehicle perform operations on the plants; and wherein the stick images comprise first images, and further comprising developing second images comprising the first images having regions around portions of the stick images that pruning is not to occur.
22. The method of claim 21 further comprising: pruning the plants based on the second images; and after the pruning, obtaining and storing third images of the plants.
23. The method of claim 22 wherein the pruning occurs to allow the desired fruit spacing in the future based on the present location of fruit buds of the plants.
24. The method of claim 22 further comprising utilizing the third images to harvest fruit from the plants.
25. The method of claim 21 wherein the first images comprise vector-based images.
26. The method of claim 21 wherein the developing of the first ages comprises first acquiring dual digital images of the plants.
27. The method of claim 21 further comprising: pruning a first portion of the plants utilizing a first arm; pruning a second portion of the plants utilizing a second arm; and pruning a third portion of the plants utilizing a third arm.
28. An agriculture method comprising: providing a mobile vehicle in a field of plants; electronically developing stick images of the plants; based on the stick images, having the mobile vehicle perform operations on the plants; providing a fruit collector on the mobile vehicle, and wherein the performing of the operations on the plants involves the fruit collector; and wherein the fruit collector comprises: a suction inlet in fluid communication with a vacuum outlet; and a water inlet in fluid communication with a water outlet.
29. An agriculture method comprising: providing a mobile vehicle in a field of plants; electronically developing stick images of the plants; based on the stick Images, having the mobile vehicle perform operations on the plants; and wherein the performing of the operations on the plants comprises: utilizing a first robotic arm operational from a first side of the mobile vehicle; and utilizing a second robotic arm operational from a second side of the mobile vehicle opposite from the first side, and wherein from a top plan view, the first robotic arm is staggered from the second robotic arm.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
(19) The methods of the invention allow for individual removal of fruit that will meet the standards for the commercial fresh-market fruit requirements and will not require the fruit to be handled or removed by human hands. The harvesting process is automated and only requires the oversight and interactive control adjustments to the harvesting system.
(20) This invention also relates to methods and apparatus for pruning of grape vines, and the harvesting of grapes that will meet the standards for the commercial fresh market fruit requirements.
(21) The pruning and harvesting of tree fruits for the premium fruit market has been a labor intensive process utilizing hand picking and careful handling of fruits. The proper pruning of the tree determines the access and location of the fruit that is harvested and are closely related. This pruner and harvester takes into consideration of the relationship between pruning and the position of fruit on a limb. Also many fruit trees are pruned during the winter season when the trees are free of leaves and allow the trunks and major branches of the tree to be determined as to their location in three-dimensional space. The fruit is located along these major branches and depending on the fruit, the location can be determined within inches. A graphical image of the tree is stored in a geographic information system identified by its global location. The harvester is mounted on a low motorized Self Propelled Vehicle (SPV) that moves between the tree rows. The SPV will have the appropriated number of robotic arms on each side. The harvester will harvest the fruit by cutting the fruit stem and the fruit will be removed by a vacuum hose that will handle the fruit without bruising or bumping the fruit against each other or against the branches of the trees. The fruit will be removed from the half of the tree nearest the fruit harvester. The fruit will be sorted and packaged to prevent further damage. The harvester will be driven between the rows of fruit trees during harvesting.
(22) The present invention relates to both tree pruning and fruit harvesting in that the functions are closely related in determining the location of the fruit on the tree.
(23) For the pruning operation the pruner and harvester utilizes the Self Propelled Vehicle (SPV), the robotic arms, Global Positioning System (GPS) and Digital Imaging Systems (DIS). It also uses a heavier duty branch power cutter mounted on the end effecter of the robotic arm. Each tree will be located by its GPS location, imaged from the machine and the machine will then prune the tree based on software pruning algorithms. The pruning algorithms will allow the trunk, a selected number of major branches, and a selected number of fruit bearing limbs to remain as part of the tree. The remainder will be pruned from the tree. There are on the order of ten to fifteen major branches in most commercial fruit bearing trees today. The limbs will be pruned to allow the desired fruit spacing based on the fruit buds at the time of pruning. The tree will be pruned from the bottom up. The pruner will cut up the limbs until they fall to the ground. Once the tree is pruned the digital image of the tree is obtained and stored in a Geographic Information System (GIS) including the GPS global location as the identifier of the tree, and the GPS location of the machine. This will be key information that will be utilized by the harvester during the harvesting phase.
(24) For the fruit harvesting operation the pruner and harvester utilizes the SPV, the robotic arms, GPS, GIS, and DIS that are utilized during the pruning operation. During fruit harvesting the pruner and harvester also uses a power stem cutter, a fruit catcher, a vacuum hose mounted on the end effectors of the robotic arm, a fruit collector system, and a Radar Ranging System (RRS) to help locate the trunk and major branches. The location of the fruit and the order of picking will be predetermined based on the barren tree image at pruning that is stored in the GIS data base. Between pruning and harvesting, the picking algorithms for each tree will be generated utilizing a computer program that will build a 3-D stick image of each fruit tree. A 3-D profile for the tree half facing the harvester is generated, and picking algorithms are generated that will move the end effecter along the limbs and branches and utilize the imaging system on the end effecter to home in on the fruit to cut the stems. The fruit catcher will be held just under the fruit and when the fruit stem is cut the fruit will drop a very short distance and directed into the vacuum hose that will suck the fruit into the fruit collector. The fruit collector will catch the fruit and convey each piece of fruit to the fruit handling system, which will pack the fruit in fruit bins or fruit trays that will be placed on pallets.
(25) The present invention relates to fruit harvesting generally as configured in the
(26) The Global Positioning System Guidance System (GPS) is indicated as 16 (
(27) A DIS cameras, indicated as 18a,b,c,d, (
(28) The RRS is indicated as 18e, f, (
(29) All of these sensing systems are utilized in the tree pruning process and the fruit harvesting process. There are two duplicate systems one on the right side and one on the left side of the SPV that are mirror-imaged and each system operates independent of the other system. The speed of the machine is controlled by the operator.
(30) The tree pruning process is described in detail with the machine setup in the pruning configuration as shown in
(31) The operator uses the GPS 16 to align the machine to the center of two tree rows, or in the case of an edge row one sets the distance of the machine from the tree row. The operator initializes each of the robotic arms 10, 11, 12 to the start pruning position. The operator will then locate the first tree trunk on each side of the SPV 3 by guiding the most forward right robotic arm 10 until the end effecter just touches the trunk of the first tree. The operator will do this task by operating the joystick 15. Then the operator will locate the second tree on the left side of the SPV 3 by guiding the most forward robotic arm 10 until the end effecter just touches the trunk of the second tree. Note: the left side robotic arms are staggered ahead of the right side robotic arms on the machine. Once the machine is aligned and initialized the operator the checks that all interlocks are good and selects the auto-pruning operation.
(32) The CBCS 14
(33) The fruit harvesting process is described in detail with the machine setup in the fruit harvesting configuration as shown in
(34) The time between the pruning and harvesting is utilized to process the pruned tree images; generate a vector stick image of the tree trunk, major branches, and limbs; and generate an algorithm for locating the fruit in the tree based on the knowledge that the fruit sets on buds from the previous year. The computation time for generating the Pick Path Algorithm for the robotic arms 10, 11, 12 will not impact the harvesting speed since it can be completed between pruning time and harvest time. The algorithm will consist of a specific pick path for each robot arm 10, 11, 12, respectively, with the stem cutter assembly 19 (
(35) The operator will use the GPS 16 (
(36) The CBCS 14 (
(37) Once the stem cutter 19 (
(38) The fruit collector 22 (
(39) The Stem Cutter 19 and Fruit Catcher 20 are detailed in
(40) The Power Pruner Assembly 26 is detailed in
(41) 1. A pruning apparatus for pruning fruit trees that are grown in rows, and may be free standing or grown on trellises. The mechanical pruner travels between the rows of trees and can prune each tree half facing the SPV to a 3-D profile that is desired for the best growth of fruit desired by the growers. The pruner can prune trees on the right and left side of the machine as well as only on the right or left side. The pruner can remove cross branches, and branches on the order of one-half inches in diameter to two inches in diameter. The pruner works best when the trees are dormant and without leaves, but may also be used for trees such as avocadoes and citrus with the addition of radar tagging of the major limbs and branches. The brush removed is allowed to drop to the ground to be removed with current brush cleanup equipment. The SPV is outfitted with the Power Pruner Assemblies sized for the type of growth.
(42) 2. A pruning machine apparatus for pruning grapes, fruit bearing bushes and other crops that are grown in rows and the pruning configuration can be defined in a 3-D profile. A different SPY SPV will be required to adjust for the difference in row heights and widths for these types of crops then is depicted as 3 (
(43) 3. A fruit harvesting apparatus for harvesting fruit from trees grown in rows, and may be free standing or grown on trellises. The mechanical harvester travels between the rows of trees and can harvest the fruit from each tree half facing the SPV on the right side and left side of the harvesting SPV, as will as just on the right side or the left side as desired by the operator. The fruit is harvested by a stem cutter that cuts the stem of the fruit and allows the fruit to drop a very short distance into a fruit catcher that directs the fruit to the vacuum hose that conveys the fruit individually to the fruit collector. The fruit collector catches the fruit in flowing water and quickly moves the fruit out of the way of the next fruit that comes through the fruit vacuum system. The fruit is not bruised or damaged by contacting other fruit. The vacuum hose protects the fruit from hitting limbs and branches that also can damage the fruit. The result is a high quality premium fruit that is desirable for the fresh-fruit market.
(44) 4. A grape harvesting apparatus for harvesting grapes that are on trellises or other berry or fruit bearing bushes that are planted in rows held up right by trellises. A different SPV will be required to adjust for the difference in row heights and widths for these types of crops then is depicted as 3 (
(45) 5. The pruner and harvester as set forth in claim 1, 2, 3, and 4, requires a single operator, to operate the machine. The machine is self guided using a GPS Guidance Systems. This frees the operator to better monitor the mechanical pruning or harvesting processes that operate in an automatic mode. The operation is automatic but the operator can interactively interface with the CBCS 14 (
(46) 6. The pruner and harvester as set forth in claim 3 and 4 provides a fruit catcher 20 (
(47) 7. The pruner and harvester as set forth in claim 3 and 4 provides for a vacuum blower 28 (
(48) 8. The pruner and harvester as set forth in claim 3 and 4 provides for a fruit collector 22 (
(49) 9. The pruner and harvester as set forth in claim 3 and 4 provides for a fruit stem cutter 19 (
(50) 10. The pruner and harvester as set forth in claim 1, and 2 provides for a Power Pruner Assembly 26 (
HARVESTER GLOSSARY
(51) 1. Harvester Machine 2. Pruner Machine 3. Self Powered Vehicle (SPV) 4. Structural Frame 5. Hydrostatic Drive 6. Low Profile Wheels 7. Operator Platform 8. Motor & Hydrostatic Transmission 9. Electric Generator 10. Forward Robotic Ann 11. Middle Robotic Ann 12. Rear Robotic Arm 13. Hydraulic Cylinder 14. Compliter Based Control System (CBCS) 15. Manual Joystick 16. Global Positioning Satellite Guidance System (GPS) 17. GPS Antenna 18. Digital Imaging System (DIS) a. DIS Camera b. DIS Camera c. DIS Camera d. DIS Camera e. DIS Range Camera f. DIS Range Camera g. DIS Close-up Camera h. DIS Close-up Camera DIS camera i. Blank j. DIS Close-up Camera 19. Stem Cutter Assembly 20. Fruit Catcher 21. Fruit Vacuum Hose 22. Fruit Collector 23. Fruit handling System 24. Elevator 25. Bin Loader 26. Power Pruner Assembly 27. Pruner Shear Blade 28. Pruner Knife Blade 29. Stem Cutter Shear Blade 30. Stem Cutter Knife Blade 31. Hydraulic Motor 32. Fruit Bin 33. Blower