SORTING DEVICE FOR AGRICULTURAL PRODUCTS AND CORRESPONDING METHOD
20220379348 · 2022-12-01
Inventors
- Damien DUBRULLE (Cassel, FR)
- Hugo SERRAT (Gentilly, FR)
- Thomas DESCHODT (Sainte Marie Cappel, FR)
- Guillaume JOURDAIN (Gentilly, FR)
- Duc-Anh LUU (Gentilly, FR)
Cpc classification
B07C5/342
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
A sorting device for sorting agricultural products coming from a bulk flow and a corresponding method are described. A sorting device includes an image acquisition unit; an image processing unit configured to identify and analyze each product in the bulk flow; a decision unit configured to determine the products to be separated; a separation unit arranged to separate at least some of the products coming from the bulk flow; and a unit for conveying the agricultural products in the form of bulk flow. The sorting device may further include means for turning over the agricultural products on themselves, mounted in the conveying unit facing the image acquisition unit, and configured to allow an exposure to the image acquisition unit, of the different parts of the conveyed agricultural products.
Claims
1. A sorting device configured to sort agricultural products coming from a bulk flow, comprising: an image acquisition unit configured to record images of said bulk flow, an image processing unit receiving as inputs the images recorded by said image acquisition unit, said image processing unit being configured to identify each product and analyze the products in said bulk flow from said recorded images, a decision unit connected to said image processing unit and configured to determine, from the visual appearance of the products, the products to be separated and to provide a corresponding control signal, a separation unit receiving as input the control signal and arranged to separate at least some of said products coming from the bulk flow according to the control signal, and a conveying unit configured to convey the agricultural products in the form of bulk flow, from the image acquisition unit to the separation unit, wherein the sorting device also comprises a turning device configured to turn over the agricultural products on themselves, mounted in the conveying unit facing the image acquisition unit, and configured to allow an exposure to the image acquisition unit, of the different parts of the conveyed agricultural products.
2. The sorting device according to claim 1, wherein the processing unit is also configured to monitor each product on the conveying unit, in said bulk flow, including during its turning over on the turning device.
3. The sorting device according to claim 1, wherein the conveying unit also comprises an intermediate portion disposed downstream of the turning device, and conveying the agricultural products to the separation unit.
4. The sorting device according to claim 3, wherein the intermediate portion is configured to maintain the relative position of the agricultural products in the bulk flow during their conveying through the intermediate portion to the separation unit.
5. The sorting device according to claim 3, wherein the intermediate portion is also positioned facing the acquisition unit.
6. The sorting device according to claim 1, wherein the acquisition unit comprises at least one camera.
7. The sorting device according to claim 1, wherein the separation unit comprises fingers, each having a deployed position to deflect a path of an agricultural product, and a retracted position to allow a passage of the agricultural products.
8. The sorting device according to the preceding claim, wherein the separation unit is also configured to position one or several fingers from the retracted position to the deployed position during or before the passage of the agricultural product facing said finger(s), so as to deflect the path of the agricultural product with or without impetus.
9. The sorting device according to claim 1, wherein the acquisition unit is configured to record several images per second.
10. The sorting device according to claim 1, wherein the processing unit comprises a convolutional neural network.
11. A sorting method for sorting agricultural products coming from a bulk flow, comprising: performing image acquisition by recording images of the bulk flow; performing an image processing by receiving as inputs the recorded images, and identifying and analyzing each product in the bulk flow; determining, from the visual appearance of the products, the products to be separated; performing a separation by separating at least some the products coming from the bulk flow; conveying the products in the form of bulk flow from the image acquisition to the separation; turning over the agricultural products on themselves, during the image acquisition, to allow an exposure of the different parts of the agricultural products.
12. The sorting method according to claim 11, wherein, while maintaining the relative position of the agricultural products in the bulk flow, the agricultural products are conveyed from the turning device to a separation unit that performs the separation of the products.
13. The sorting method according to claim 11, wherein during the image processing step, a visual appearance of each product is analyzed.
14. The sorting device according to claim 1, wherein the agricultural products are chosen among potatoes, carrots or onions.
15. The sorting device according to claim 1, wherein the image processing unit is configured to analyze a visual appearance of the products.
16. The sorting device according to claim 2, wherein the processing unit is configured to monitor in real time, each product on the conveying unit, in the bulk flow, including during its turning over on the turning device.
17. The sorting device according to claim 6, wherein the acquisition unit further comprises at least one light source, mounted above a portion of the conveying unit.
18. The sorting device according to claim 17, wherein the at least one light source is mounted in line with a portion of the conveying unit.
19. The sorting device according to claim 16, wherein the acquisition unit further comprises a casing covering the at least one camera, the at least one light source, and the portion of the conveying unit.
20. The sorting device according to claim 7, wherein the fingers of the separation unit are uniformly distributed over a width of the conveying unit.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0044]
[0045]
DETAILED DESCRIPTION
[0046] In
[0047] The sorting device 1 thus includes a conveying unit 2 and a separation unit 4.
[0048] The conveying unit 2 allows conveying the bulk flow of agricultural products, in this case potatoes P, from a supply point 2a to several outlets 2b, 2c, 2d between which the potatoes P are sorted by the separation unit 4.
[0049] In order to allow the separation unit 4 to perform the sorting of the potatoes P, the sorting device 1 also comprises an acquisition unit 6, an image processing unit 8 and a decision unit 10.
[0050] The acquisition unit 6 is intended to capture images of the potatoes P during their travel on the conveying unit 2, and more particularly of the external visual appearance of the potatoes P. To this end, the acquisition unit 6 includes at least one camera 12 positioned facing at least a portion of the conveying unit 2 in order to be able to take a photo of or film the potatoes P driven by the conveying unit 2.
[0051] Furthermore, and in order to obtain uniform and comparable images of the potatoes P, whatever the external brightness of the sorting device 1, the acquisition unit also comprises a casing 14. The casing 14 covers the portion of the conveying unit 2 located in the field of the camera 12, and thus allows blocking the light outside the field of the camera 12. The acquisition unit also includes light sources 16 mounted inside the casing 14 and making it possible to create, in the field of the camera 12, a uniform and constant lighting of the potatoes P.
[0052] To allow the complete analysis of the potatoes P, and more particularly the analysis of the different sides of the potatoes P, the conveying unit 2 comprises, at least partly in the portion located in the field of the camera 12, a means for turning over 18 the potatoes P. The turning means 18 comprises for example a succession of rollers 20 forming a plane inclined towards the portion in the field of the camera 12, and rotating in the opposite direction. The turning means 18 thus allows turning over the potatoes P on themselves in order to expose the different parts thereof to the camera 12 for analysis.
[0053] The images recorded by the camera 12 are then transmitted to analysis means configured to categorize the potatoes P according to different criteria, in particular aesthetic criteria based on the appearance, size, shape and/or color of the potatoes P. Thus, the images recorded by the camera 12 are transmitted to the image processing unit 8. The image processing unit 8 is configured to identify the different potatoes P in the bulk flow conveyed by conveying unit 2, and to analyze the visual appearance of said potatoes P.
[0054] To this end, the processing unit 8 can comprise a convolutional neural network, that is to say a network of neurons, allowing the analysis of the potatoes P based on the criteria determined during a preliminary learning phase. In other words, the processing unit 8 has “learned”, during a preliminary learning phase during which different potatoes were presented to the processing unit 8 with the criteria corresponding thereto, in order to allow the processing unit 8 to be able to assign the same criteria to identical or similar potatoes.
[0055] Even if the preliminary learning phase can be tedious, the use of a convolutional neural network allows great freedom and a wide choice of criteria to categorize the agricultural products. The sorting device 1 can thus adapt to a change in the sorting criteria.
[0056] Finally, in order to assign to the same agricultural product P the different views recorded by the image acquisition unit 6 during the phase of turning over the agricultural product P by the turning means 18, the processing unit 8 can also be configured to monitor, optionally in real time, each agricultural product P on the conveying unit 2. In other words, the processing unit 8 is also capable of identifying the different agricultural products P in the bulk flow and of monitoring them during their turning over and/or conveying through the conveying unit 2.
[0057] The processing unit 8 then outputs a signal representative of the visual appearance of the potatoes P to the decision unit 10. The decision unit 10 allows deciding, according to the visual appearance provided by the processing unit and as a function of determined quantities or thresholds, in which category to direct the agricultural products, that is to say deciding towards which outlets 2b, 2c or 2d to direct the agricultural products. The decision unit 10 then outputs a control signal to the separation unit 4 corresponding to the category of the agricultural products P arriving at the level of the separation unit 4.
[0058] The separation unit 4 is configured to modify the path of the agricultural products P in order to direct them towards one of the outlets 2b, 2c or 2d of the conveying unit 2. To this end, the separation unit 4 includes a plurality of fingers 22 distributed over the width of the conveying unit 2 and configured either to let the agricultural product P pass or to deflect the agricultural product P towards one or several outlets of the conveying unit 2. The fingers 22 each include a retracted position in which they do not come into contact with the agricultural product P, and a deployed position in which they intersect the path of the agricultural products P. Thus, it is possible to sort the agricultural products P into two categories by deflecting or not their path with the fingers 22 of the separation unit 4. In the case illustrated in
[0059] Furthermore, in order to be able to perform a sorting into at least three categories, the fingers 22 are also configured to deflect, in the deployed position, the agricultural products P with or without impetus. More specifically, the separation unit 4 is configured to allow deploying the fingers 22 before the passage of the agricultural product P or during the passage of the agricultural product P. Thus, by deploying the finger 22 when the agricultural product P is in front of it, the separation unit 4 is capable of giving an impetus to said agricultural product P, that is to say to “hit” it, in order to make it move towards the outlet 2b. The separation unit 4 is thus configured either to deflect the agricultural products P, for example the agricultural products P unfit for consumption or the foreign bodies such as clods of earth or stones, towards the outlet 2c by controlling the fingers 22 in a deployed position before the passage of the agricultural product P in front of the separation unit 4, or to deflect the agricultural products P, for example the agricultural products P that do not have the desired visual appearance, towards the outlet 2b by controlling the fingers 22 in a deployed position during the passage of the agricultural product P in front of the separation unit 4 in order to launch it beyond the outlet 2c.
[0060] The separation unit 4 thus allows sorting the agricultural products P, using fingers 22 similar to those used currently, into three categories thanks to the control of the triggering of the deployment of the fingers 22 in order to deflect the agricultural products P with or without impetus.
[0061] However, in order to be able to process the images recorded by the acquisition unit 6 and decide on the sorting to be performed by the separation unit 4, a time delay is necessary between the acquisition of the images and the separation made by the fingers 22. Thus, the conveying unit 2 can comprise an intermediate portion 24 located between the turning means 18 and the separation unit 4. The intermediate portion 24 aims to leave time for the image processing 8 and decision 10 units before the agricultural products P arrive at the separation unit 4. In order to ensure that the relative position of the agricultural products P in the conveying unit 2 is not modified at the level of the intermediate portion 24, the latter can be configured to maintain said relative position of the agricultural products P when they are conveyed through the intermediate portion 24.
[0062] Alternatively, the intermediate portion 24 can be mounted in the field of the image acquisition unit 6. In this case, the agricultural products P conveyed through the intermediate portion 24 remain in the field of view of the image acquisition unit 6 and can therefore be monitored, optionally in real time, by the processing unit 8 until they are conveyed to the separation unit 4, so as to allow the decision unit 10 and the separation unit 4 to know exactly when each agricultural product P will pass in front of the separation unit 4.
[0063]
[0064] Thus, in a first step 28, a bulk flow of agricultural products P to be sorted is provided.
[0065] Then, in a second step 30, images of said bulk flow are recorded while said agricultural products P are turned over. Such a step then allows having a view of the different sides of the agricultural products of the bulk flow.
[0066] In a third step 32, each product is identified and analyzed in said bulk flow, and each agricultural product is monitored in real time in said bulk flow.
[0067] In a step 34, the products to be separated are then determined, optionally during the monitoring of the agricultural products in real time.
[0068] Finally, in a step 36, the agricultural products determined during the step 34 are separated.
[0069] Thus, thanks to the sorting device according to the disclosure, it becomes possible to sort agricultural products according to different visual criteria which will have been learned by the processing unit, and according to thresholds which will have been indicated to the decision unit. Such a device can thus replace human intervention during the sorting step, and allow increasing the sorting speed while maintaining a reliable or, where appropriate, an adjustable result according to the user's wishes. In addition, such a device also allows sorting the products into more than two categories, while keeping a finger separation unit, thanks to the timing of triggering of said fingers, which allows deflecting the agricultural product towards a first outlet, or hitting it towards a second outlet. The sorting device thus offers a wide choice of options and adaptations to the user for the analysis and sorting of the agricultural products.