IMAGE ACQUISITION DEVICE AND PROCESSING METHOD FOR AGRICULTURAL HARVESTING OPERATION MACHINE
20220167555 · 2022-06-02
Inventors
- YONG-QUAN SHEN (Xiangyang, CN)
- BO WANG (Xiangyang, CN)
- SHUN FAN (Xiangyang, CN)
- Di Wu (Nanjing, CN)
- Yuan Yao (Nanjing, CN)
- XIAO ZHANG (Xiangyang, CN)
- RUI CHEN (Xiangyang, CN)
Cpc classification
A01B69/001
HUMAN NECESSITIES
A01D41/127
HUMAN NECESSITIES
International classification
Abstract
An image acquisition device and image processing method for an agricultural harvesting operation machine. The agricultural harvesting operation machine comprises a body and an image acquisition device; the image acquisition device comprises an image capturing component and a communication machine; the image acquisition device is mounted on the body; the communication machine is communicatably connected to the image capturing component so as to obtain acquired image information from the image capturing component, thereby assisting in adjusting the working position and operation speed of the body. Also provided is an image processing method. Information required by harvesting operation is taken into full consideration, images of the position of an agricultural harvesting operation machine are acquired, and multiple acquired images are efficiently processed.
Claims
1. An agricultural harvesting operation machine, comprising: a machine body and an image capturing assembly; wherein the image capturing assembly is arranged on a surface of the machine body; wherein an operation area is formed in front of the machine body in response that the machine body is activated for performing harvesting operations; wherein an acquiring range of the image capturing assembly is arranged on the machine body in a covering manner, and the image capturing assembly acquires images toward the operating area; wherein the machine body comprises a body frame, a harvesting frame, and at least one wheel frame, the harvesting frame is arranged in front of the body frame, the at least one wheel frame is supported on a bottom of the body frame; and wherein the at least one wheel frame is operated to drive the harvesting frame and the body frame forward to cut and transport crops in front.
2. The agricultural harvesting operation machine according to claim 1, wherein the image capturing assembly comprises: a plurality of acquisition devices and a processor; wherein the plurality of acquisition devices are arranged on a front and sides of the body frame with predetermined orientations; and wherein images acquired by the plurality of acquisition devices are processed, summarized, and analyzed by the processor.
3. The agricultural harvesting operation machine according to claim 2, wherein at least one of the plurality of acquisition devices is implemented as a panoramic camera.
4. The agricultural harvesting operation machine according to claim 2, wherein at least one of the plurality of acquisition devices is implemented as a wide-angle camera.
5. The agricultural harvesting operation machine according to claim 2, wherein the image capturing assembly comprises at least three acquisition devices, the at least three acquisition devices of the image capturing assembly are arranged on the front and the sides of the body frame with the predetermined orientations.
6. The agricultural harvesting operation machine according to claim 5, wherein the processor processes the images according to arranged positions of the plurality of acquisition devices.
7. The agricultural harvesting operation machine according to claim 5, wherein the plurality of acquisition devices comprises: a distant view acquisition device, at least one close view acquisition device, and at least two side view acquisition devices; wherein the distant view acquisition device and the at least one close view acquisition device are adapted to be arranged on the body frame forward facing, and face above and below the harvesting frame respectively; and wherein the side view acquisition devices are respectively arranged on both sides of the body frame, and face away from both sides of the machine body.
8. The agricultural harvesting operation machine according to claim 7, wherein the distant view acquisition device keeps an orientation along an upper side of the at least one wheel frame, and the close view acquisition device keeps an orientation along positions between the at least one wheel frame.
9. The agricultural harvesting operation machine according to claim 7, wherein the distant view acquisition device, the close view acquisition device, and the side view acquisition device are respectively numbered according to the arranged positions, the processor acquires position of each of the acquisition devices according to each number, and processes the images according to the positions acquired by the images.
10. The agricultural harvesting operation machine according to claim 7, wherein a plurality of distant view acquisition devices are arranged at a certain interval, and a plurality of close view acquisition devices are arranged at another certain interval.
11. The agricultural harvesting operation machine according to claim 7, wherein the processor processes the images according to the arranged positions of the plurality of acquisition devices, the images acquired by the close view acquisition devices are preferentially spliced, and the images acquired by other acquisition devices are further spliced.
12. The agricultural harvesting operation machine according to claim 7, wherein the processor processes the images according to the arranged positions of the acquisition devices, the images acquired by the distant view acquisition devices are preferentially spliced, and the images acquired by other acquisition devices are further spliced.
13. The agricultural harvesting operation machine according to claim 7, wherein the images acquired by the plurality of acquisition devices which are adjacent to each other are preferentially spliced, and the images acquired by other acquisition devices are further spliced.
14. The agricultural harvesting operation machine according to claim 13, wherein the images acquired by the distant view acquisition devices and the close view acquisition devices located above and below the harvesting frame are preferentially spliced.
15. The agricultural harvesting operation machine according to claim 13, wherein the images acquired by the distant view acquisition devices located below an end of the harvesting frame and the side view acquisition devices located at an edge of the end are preferentially spliced.
16. An agricultural harvesting operation machine, comprising: a machine body and an image acquisition device; wherein the image acquisition device comprises an image capturing assembly and a communication device; wherein the image capturing assembly is arranged on a surface of the machine body; and wherein the communication device is communicatively connected with the image capturing assembly, acquires image information from the image capturing assembly, and assists in adjusting an operation position and an operation speed of the machine body.
17. The agricultural harvesting operation machine according to claim 16, wherein the communication device uploads information provided by the image capturing assembly.
18. The agricultural harvesting operation machine according to claim 16, wherein the communication device transmits the image information of the images acquired by the image capturing assembly to a remote control terminal.
19. The agricultural harvesting operation machine according to claim 17, wherein the image capturing assembly comprises: a plurality of acquisition devices and a processor; wherein the plurality of acquisition devices are arranged on a front and sides of the body frame with predetermined orientations; and wherein the images acquired by the plurality of acquisition devices are processed, summarized, and analyzed by the processor.
20. The agricultural harvesting operation machine according to claim 19, wherein the image capturing assembly comprises three acquisition devices, the three acquisition devices of the image capturing assembly are arranged on the front and the sides of the body frame with the predetermined orientations.
21. The agricultural harvesting operation machine according to claim 19, wherein the processor processes the images according to arranged positions of the plurality of acquisition devices.
22. An image processing method for an agricultural harvesting operation machine comprising: acquiring a plurality of images of a front and sides of a machine body; splicing the plurality of images according to positions acquired by the plurality of images; and acquiring state information around the machine body according to the spliced image.
23. The image processing method according to claim 22, the method further comprising: transmitting the state information of the machine body remotely.
24. The image processing method according to claim 22, wherein splicing the plurality of images comprises: processing the plurality of images according to arranged positions of a plurality of acquisition devices of the machine body.
25. The image processing method according to claim 24, wherein splicing the plurality of images further comprises: splicing preferentially the images acquired by the plurality of acquisition devices with similar orientations.
26. The image processing method according to claim 24, wherein splicing the plurality of images further comprises: splicing preferentially the images acquired by the plurality of acquisition devices which are adjacent to each other.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
DETAILED DESCRIPTION
[0064] The following description is used to disclose the present disclosure so that one skilled in the art can implement the present disclosure. The preferred embodiments in the following description are only examples, and one skilled in the art can think of other obvious variations. The basic principles of the present disclosure defined in the following description can be applied to other embodiments, modified embodiments, improvement embodiments, equivalent embodiments, and other technical solutions that do not deviate from the spirit and scope of the present disclosure.
[0065] One of ordinary skill in the art should understand that, according to the present disclosure, the orientation or position relationship indicated by the terms “longitudinal”, “lateral”, “upper”, “lower”, “front”, “rear”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inner”, “outer”, etc., is the orientation or position relationship shown in the drawings, which is convenient for describing the present disclosure and simplifying the description, rather than indicating or implying that the referred device or component must have a specific orientation, be constructed and operated in a specific orientation, the above terms should not be understood as limiting the present disclosure.
[0066] It can be understood that, the term “a” should be understood as “at least one” or “one or more”, that is, in one embodiment, the number of a component may be one, and in another embodiment, the number of the component may also be multiple, the term “one” cannot be understood as a restriction on the number.
[0067] The present disclosure provides an image acquisition device and an image processing method for an agricultural harvesting operation machine, to acquire and process state information in agricultural harvesting operations in real time, provide a direct data source for subsequent control and supervision, and provide basis for optimization of operation efficiency.
[0068] A preferred embodiment of the present disclosure is illustrated in
[0069] The image capturing assembly 20 is installed on the machine body 10 in a covering manner, and acquires images toward the operating area 100. In other words, an acquiring range of the image capturing assembly 20 covers a front and sides of the machine body 10. It is worth mentioning that, the harvested operations have been saved by the machine body 10. The image capturing assembly 20 acquires the images of the operation area 100 including the crops being harvested and the crops to be harvested. Preferably, in the preferred embodiment, the image capturing assembly 20 is installed on the front and both sides of the machine body 10. That is, the image capturing assembly 20 acquires the images of the operation area 100 in a manner around front of the operation area 100.
[0070] It is worth mentioning that, the images acquired by the image capturing assembly 20 basically covers the operating area 100. The images acquired from the image capturing assembly 20 can reflect images around the machine body 10, and after being further processed, the acquired images can express the state information of the operating area 100.
[0071] Preferably, the images acquired by the image capturing assembly 20 may be multiple copies, and the images provided by output of the image capturing assembly 20 are one of the multiple copies. More preferably, the output of the image capturing assembly 20 is the state information of the operation area 100. The state of the machine body 10 in operation is acquired according to the images acquired by the image capturing assembly 20.
[0072] Referring to
[0073] In the preferred embodiment, the image capturing assembly 20 is distributed on the front and the sides of the machine body 10. The multiple copies of images acquired by the image capturing assembly 20 are spliced, and then transmitted through the communication device 30.
[0074] In detail, as illustrated in
[0075] Further, in the preferred embodiment, the image capturing assembly 20 includes a number of acquisition devices and a processor 24. The number of acquisition devices of the image capturing assembly 20 are pre-installed on the front and sides of the body frame 11 in a predetermined orientation. The images acquired by the acquisition devices are processed, summarized, and analyzed by the processor 24. Preferably, the processor 24 performs image processing according to the positions where the acquisition devices are installed.
[0076] In detail, the acquisition devices may be implemented as a number of wide-angle cameras, or may be implemented as a panoramic camera. In the preferred embodiment, The acquisition devices, as illustrated in
[0077] That is, the images acquired by the distant view acquisition device 21 are related to the state of the crops to be harvested, and the images acquired by the close view acquisition device 22 are related to the crops being harvested. The images acquired by the side view acquisition device 23 are related to the position of the operation area 100.
[0078] Preferably, the distant view acquisition device 21, the close view acquisition device 22, and the side view acquisition device 23 are respectively numbered according to the installed positions. The processor 24 acquires the position of the corresponding acquisition device according to each different number, and processes the images according to the acquired positions of the images. Since the processing is based on a position source of the image, the processing speed is increased. Especially for image splicing processing, based on the installed positions of the distant view acquisition device 21, the close view acquisition device 22, and the side view acquisition device 23, the images around the machine body 10 can be acquired quickly, thereby acquiring the state of the operating area 100. In particular, based on different position types of the distant view acquisition device 21, the close view acquisition device 22, and the side view acquisition device 23, the body frame 11, the wheel frame 12, and the harvesting frame 13 in the acquired images can be omitted by default. For example, a lower edge of the image acquired by the distant view acquisition device 21 may be regarded as the harvesting frame 13, and the lower edge is pre-cut or omitted in the processing process. For example, an upper edge of the image acquired by the close view acquisition device 22 can be regarded as the harvesting frame 13, and a lower edge can be regarded as the wheel frame 12, so as to acquire state information of the crop being harvesting. For example, a lower edge of the image acquired by the side view acquisition device 23 can be regarded as the wheel frame 12, so that part of the machine body 10 can be excluded. Therefore, the images acquired by the distant view acquisition device 21, the close view acquisition device 22, and the side view acquisition device 23 are quickly and preliminarily processed and spliced by the processor 24, to acquire the state information of the operation area 100.
[0079] In detail, an image processing method of the preferred embodiment is shown in
[0080] I. Acquire a number of copies of images of the front and sides of the machine body 10;
[0081] II. Splice the images according to positions in the acquired images; and
[0082] III. Acquire state information around the machine body 10 according to the spliced image.
[0083] In detail, as illustrated in
[0084] Then, according to the installed positions of the number of distant view acquisition devices 21, the acquired images are sequentially spliced, so that the images of the crops to be harvested in front of the harvesting frame 13 are acquired. It is worth mentioning that, unlike the existing image splicing, there is no need to recognize each image to determine content of the image, but to splice a number of images directly according to the installed positions or the harvesting frame 13 in each image. Thus, an overall image of the front of the machine body 10 is acquired, which is the step II.
[0085] Then in step III, according to the overall image of the front of the machine body 10 acquired by the distant view acquisition device 21, the operating area 100 in front of the machine body 10 is acquired in real time and state information is represented. Preferably, the acquired images can be further analyzed in detail later.
[0086] In detail, as illustrated in
[0087] Then, according to the installed positions of the number of close view acquisition devices 22, the acquired images are sequentially spliced, so that the images of the crops being harvested under the harvesting frame 13 are acquired. It is worth mentioning that, unlike the existing image splicing, there is no need to recognize each image to determine content of the image, but to splice a number of images directly according to the installed positions or the harvesting frame 13 in each image. Thus, an overall image of the working machine body 10 is acquired, which is step II.
[0088] Then, according to the overall image of the working machine body 10 acquired by the close view acquisition devices 22, a harvesting state of the machine body 10 in the operation area 100 is acquired and represented in real time, which is step III. Preferably, the acquired images can be further analyzed in detail later.
[0089] In detail, as illustrated in
[0090] Then, according to the installed positions of the number of side scene acquisition devices 23, the acquired images are sequentially spliced, so that the images of the field that has been harvested and the field to be harvested are acquired. It is worth mentioning that, unlike existing image splicing, there is no need to recognize each image to determine content of the image, but to directly acquire the state of the crops that have been harvested according to the installed positions, such as the side view acquisition devices 23 installed on the left side of the machine body 10, and to acquire the state of the crops to be harvested according to the side view acquisition devices 23 installed on the right side of the machine body 10, so as to acquire the state of the crops on the left and right sides of the working machine body 10, the position of the machine body 10 is thus determined, which is step II.
[0091] Then in step III, according to the images of the sides of the machine body 10 acquired by the side view acquisition devices 23, a forward direction and a speed of the machine body 10 can be acquire, thereby ensuring accuracy of the forward direction of harvesting, and helping improve harvesting efficiency.
[0092] Furthermore, the images acquired by the distant view acquisition devices 21, the close view acquisition devices 22, and the side view acquisition devices 23 are finally spliced together, to acquire the image of the machine body 10 in the operation area 100. As illustrated in
[0093] Further, the image processing method, after step III, further includes the steps:
[0094] Transmit the state information of the machine body 10 remotely.
[0095] As illustrated in
[0096] Of course, operation adjustments of the machine body 10 can be manually operated remotely, or can be adjusted by a predetermined program, and the images acquired by the image acquisition device can help control so as to realize unmanned agricultural production.
[0097] An image acquisition device for an agricultural harvesting operation machine of another feasible way of the above-mentioned preferred embodiment of the present disclosure is set forth, as illustrated in
[0098] The difference from the above-mentioned embodiment is that,
[0099] The images acquired by the distance view acquisition device 21A and the close view acquisition device 22A located at the upper side and the lower side of the harvesting frame 13A are spliced first. As illustrated in
[0100] Then, according to the installed positions of the distant view acquisition device 21A and the close view acquisition device 22A located above and below the harvesting frame 13A, the acquired images are sequentially spliced, so that the images of the upper side and the lower side of the harvesting frame 13A are acquired. It is worth mentioning that, unlike the existing image splicing, there is no need to recognition each image to determine content of the image, but directly to acquire an overall image of the crops before and after being cut at a certain position of the machine body 10A according to the installed positions, which is the step II.
[0101] Then in step III, according to an image of a certain position of the machine body 10A, the operation area 100A in front of the machine body 10A is acquired in real time and the state information is represented. Preferably, the acquired images can be further analyzed in detail later, which are similar to a viewing angle of traditional manual cutting.
[0102] In addition, The images acquired by the close view acquisition device 22A located below an end of the harvesting frame 13A and the side view acquisition device 23A located at an edge of the end of the harvesting frame 13A are spliced first. As illustrated in
[0103] Then, according to the installed positions of the close view acquisition device 22A located below the end of the harvesting frame 13A and the side view acquisition device 23A located at the edge of the end, the acquired images are sequentially spliced, so that the images of the end of the harvesting frame 13A are acquired. It is worth mentioning that, unlike the existing image splicing, there is no need to recognize each image to determine content of the image, but to directly acquire an overall image of the crops before and after being cut at a certain position of the machine body 10A according to the installed positions, which is the step II.
[0104] Then in step III, according to the overall image of the certain position of the machine body 10A, the operating area 100A in front of the machine body 10A is acquired in real time and the state information is represented. Preferably, the acquired images can be further analyzed in detail later, which are similar to the viewing angle of traditional manual cutting. In the embodiment, an edge working state of the machine body 10A is further acquired, which is convenient for assisting in adjusting the operation position and the operation speed of the machine body 10A.
[0105] It is worth mentioning that, the images acquired by all the acquisition devices, including the distant view acquisition device 21A, the close view acquisition device 22A, and the side view acquisition device 23A, are finally spliced together, so as to acquire an image of the operation area 100A of the machine body 10A. As illustrated in
[0106] As illustrated in
[0107] One of ordinary skill in the art should understand that, the above description and the embodiments of the present disclosure shown in the drawings are only examples and do not limit the present disclosure. The purpose of the present disclosure has been completely and effectively achieved. The functions and structural principles of the present disclosure have been shown and explained in the embodiments. Without departing from the principles, the embodiments of the present disclosure may have any deformation or modification.