Determining measure of gaping in fish fillet item
11992020 ยท 2024-05-28
Assignee
Inventors
Cpc classification
A22C17/0086
HUMAN NECESSITIES
International classification
Abstract
A method of determining a measure of gaping in a fish fillet item, involves the steps of obtaining three-dimensional profile data of a first area of the fish fillet item, obtaining optical imaging data of a second area of the fish fillet item, wherein the first area and the second area are overlapping at least within an overlap area; and determining the measure of gaping in the fish fillet item based on the three-dimensional profile data within the overlap area and the optical imaging data within the overlap area.
Claims
1. A method of determining a measure of gaping in a fish fillet item, the method comprising the steps of: obtaining three-dimensional profile data of a first area of the fish fillet item; obtaining optical imaging data of a second area of the fish fillet item, wherein the first area and the second area are overlapping at least within an overlap area; determining a measure of gaping in the fish fillet item based on the (i) three-dimensional profile data within the overlap area, and the (ii) optical imaging data within the overlap area.
2. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein the method comprises the step of: determining a candidate gaping area set based on the (i) three-dimensional profile data of the fish fillet item; and/or the (ii) optical imaging data of the fish fillet item; and wherein determining the measure of gaping in the fish fillet item is based on the candidate gaping area set.
3. A method of determining a measure of gaping in a fish fillet item, the method comprising the steps of: obtaining optical imaging data of a second area of the fish fillet item, wherein the first area and the second area are overlapping at least within an overlap area; determining a measure of gaping in the fish fillet item based on the (i) three-dimensional profile data within the overlap area, and the (ii) optical imaging data within the overlap area; obtaining three-dimensional profile data of a first area of the fish fillet item; wherein determining the measure of gaping in the fish fillet item comprises determining a candidate gaping area set of the fish fillet item, in which each candidate gaping area passes each of: a test where pass or failure is based on the three-dimensional profile data, based exclusively on the three-dimensional profile data, of the fish fillet item; and a test where pass or failure is based on the optical imaging data, based exclusively on the optical imaging data, of the fish fillet item.
4. The method of determining a measure of gaping in a fish fillet item according to claim 3, wherein the test where pass or failure is based on the optical imaging data of the fish fillet item comprises comparing an actual value of the optical imaging data of the fish fillet item in a position in or adjacent to the candidate gaping area with one or more expected values of the optical imaging data of the fish fillet item in the position in or adjacent to the candidate gaping area.
5. The method of determining a measure of gaping in a fish fillet item according to claim 3, wherein the test where pass or failure is based on the optical imaging data of the fish fillet item comprises comparing an actual value of the optical imaging data of the fish fillet item in a position adjacent to the candidate gaping area, with one or more expected values of the optical imaging data of the fish fillet item in the position adjacent to the candidate gaping area.
6. The method of determining a measure of gaping in a fish fillet item according to claim 3, wherein the test where pass or failure is based on the three-dimensional profile data of the fish fillet item comprises comparing an actual value of the three-dimensional profile data of the fish fillet item in a position adjacent to the candidate gaping area, with one or more expected values of the three-dimensional profile data of the fish fillet item in the position adjacent to the candidate gaping area.
7. The method of determining a measure of gaping in a fish fillet item according to claim 3, wherein determining the measure of gaping in the fish fillet item is based on the candidate gaping area set.
8. The method of determining a measure of gaping in a fish fillet item according to claim 1, arranged for allowing, at least under certain circumstances, depending on the optical imaging data, that an area of the fish fillet item contributes to the measure of gaping even if it is not considered a gaping area based on the three-dimensional profile data.
9. The method of determining a measure of gaping in a fish fillet item according to claim 1, arranged for allowing, at least under certain circumstances, depending on the optical imaging data, that an area of the fish fillet item does not contribute to the measure of gaping even if it is considered a gaping area based on the three-dimensional profile data.
10. The method of determining a measure of gaping in a fish fillet item according to claim 1, arranged for allowing, at least under certain circumstances, depending on the three-dimensional profile data, that an area of the fish fillet item contributes to the measure of gaping even it is not considered a gaping area based on the optical imaging data.
11. The method of determining a measure of gaping in a fish fillet item according to claim 1, arranged for allowing, at least under certain circumstances, depending on the three-dimensional profile data, that an area of the fish fillet item does not contribute to the measure of gaping even it is considered a gaping area based on the optical imaging data.
12. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein the measure of gaping is representative of an amount or degree of gaping, and/or wherein the measure of gaping is qualified or quantified on a one-dimensional scale, exclusively on a one-dimensional scale.
13. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein determining the measure of gaping in the fish fillet item comprises simultaneously employing the (i) three-dimensional profile data within the overlap area, and the (ii) optical imaging data within the overlap area.
14. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein the method comprises obtaining: the three-dimensional profile data; and/or the optical imaging data; while at least a part of the fish fillet item is placed on a non-planar surface.
15. The method of determining a measure of gaping in a fish fillet item according to claim 14, wherein the non-planar surface, a conveyor, upon which the fish fillet item, comprises a protrusion having a point being at least 0.5 cm, away from a straight line connecting points on the surface on either side of the protrusion and being within 1 cm to 100 cm from each other.
16. The method of determining a measure of gaping in a fish fillet item according to claim 14, wherein the fish fillet item is placed on a protrusion, which protrusion is elongated, having an aspect ratio being higher than 1, and wherein a smallest angle between a longitudinal axis of the protrusion and an axis of the fish fillet item parallel with a centreline and/or a backbone of the fish had it been present is equal to or smaller than 60?.
17. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein the method is an automated and/or inline method.
18. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein said fish fillet item originates from a fish within the order of salmoniformes, is an item of any one of trout and salmon.
19. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein determining the measure of gaping in the fish fillet item comprises determining a candidate gaping area set of the fish fillet item, wherein: in a step A, determining a candidate gaping area set of the fish fillet item based on at least the three-dimensional profile data of the fish fillet item; in a step B, (i) subjecting each candidate gaping area to a test where pass or failure is based on the optical imaging data of the fish fillet item; and (ii) removing from the set any candidate gaping area failing the test.
20. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein the method further comprises: determining one or more positions of one or more candidate gaping areas of the fish fillet item on the basis of at least the (i) three-dimensional profile data of the fish fillet item; and the (ii) optical imaging data of the fish fillet item.
21. The method of determining a measure of gaping in a fish fillet item according to claim 20, wherein the method further comprises determining a distribution of fish fillet item portion cuts over the fish fillet item dividing the fish fillet item into fish fillet item portions on the basis of at least the determined one or more positions of the one or more candidate gaping areas and at least one fish portion feature.
22. The method of determining a measure of gaping in a fish fillet item according to claim 21, wherein the method further comprises cutting the fish fillet item into fish fillet item portions according to the determined distribution of fish fillet item portion cuts.
23. The method of determining a measure of gaping in a fish fillet item according to claim 1, wherein the method further comprises providing a parameter based on the measure of gaping to an upstream station and/or to a downstream station, including adjusting processing at an upstream station and/or at a downstream station based on said parameter.
24. A fish fillet item processing apparatus for determining a measure of gaping in a fish fillet item comprising: a three-dimensional profile determining device, including a camera and a line laser, for generating three-dimensional profile data of a first area of the fish fillet item; an optical imaging device, including a camera, for generating optical imaging data of a second area of the fish fillet item, wherein the second area is at least partially overlapping with the first area; and a processing unit, including a computer, operatively coupled to the three-dimensional profile determining device and the optical imaging device.
25. A non-transitory computer readable medium storing a computer program, comprising instructions which, when the program is executed by a computer, cause the computer to carry out a method comprising the steps of: obtaining three-dimensional profile data of a first area of a fish fillet item; obtaining optical imaging data of a second area of the fish fillet item, wherein the first area and the second area are overlapping at least within an overlap area; determining a measure of gaping in the fish fillet item based on the (i) three-dimensional profile data within the overlap area, and the (ii) optical imaging data within the overlap area, and/or comprising instructions to cause a fish fillet item processing apparatus for determining a measure of gaping in a fish fillet item comprising: a three-dimensional profile determining device, including a camera and a line laser, for generating three-dimensional profile data of a first area of the fish fillet item; an optical imaging device, including a camera, for generating optical imaging data of a second area of the fish fillet item, wherein the second area is at least partially overlapping with the first area; and a processing unit, including a computer, operatively coupled to the three-dimensional profile determining device and the optical imaging device; wherein said apparatus is arranged to execute the steps of said method.
Description
BRIEF DESCRIPTION OF THE FIGURES
(1) The method, apparatus, computer program product and use of an apparatus or computer program product for determining a measure of gaping in a fish fillet item according to the invention will now be described in more detail with regard to the accompanying figures. The figures show one way of implementing the present invention and is not to be construed as being limiting to other possible embodiments falling within the scope of the attached claim set.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
DETAILED DISCLOSURE OF THE INVENTION
(15)
(16) The method 100 shown in
(17) In the specific embodiment depicted in
(18) The step of obtaining 102, 104 the two types of data, determining 106 the measure of gaping and determining 108 a distribution of fish fillet item portion cuts might be carried out on the same processing unit, such as in the same algorithm.
(19)
(20)
(21)
and additionally comprises the step of: determining a candidate gaping area set based on the i. three-dimensional profile data of the fish fillet item; and/or the ii. optical imaging data of the fish fillet item;
and wherein determining 306 the measure of gaping in the fish fillet item is based on the candidate gaping area set, and more particularly in the specific method of
(22)
and wherein the method comprises simultaneously employing the i. three-dimensional profile data within the overlap area, and the ii. optical imaging data within the overlap area.
(23) The figure furthermore shows pre-processing being carried out 418 on the three-dimensional profile data within the overlap area and carried out 420 on the optical imaging data within the overlap area. Simultaneously employing the two data types may be realized by providing 422 a derived version of either of the three-dimensional profile data or the optical imaging data where the other data type has been employed to refine details, such as wherein the derived version of data may comprise data in a non-binary format and/or a format of an interval or ratio type. The method can then comprise determining 406 the measure of gaping in the fish fillet item based on derived version of the data, i.e., simultaneously based on both data types.
(24) In an alternative embodiment, there is provided a function, such as G(input)=(measure of gaping), which takes an input and directly converts it to a measure of gaping, wherein the input may be a set of data (such as a vector), comprising spatial coordinates (x, y, z) and/or image data, such as monochrome intensity (I) or colour values (e.g., R, G, B). Directly may be understood that no intermediate steps, such as generation of initial candidate gaping area set, are created.
(25)
(26)
(27)
(28)
(29) The candidate gaping area 28B in
with one or more expected values (such as salmon coloured) of the optical imaging data of the fish fillet item in the position in or adjacent to the candidate gaping area
wherein the comparison might for example comprise checking if a colour channel, such as the blue B channel in a set of red-green-blue (RGB) channels, exceeds a threshold value.
(30) In another approach a revised candidate gaping area set of the fish fillet item may be provided wherein only candidate gaping areas identified in both modalities are included, such as wherein each candidate gaping area in the revised candidate gaping area set passes each of: a test where pass or failure is based on the three-dimensional profile data, such as based exclusively on the three-dimensional profile data, of the fish fillet item; and a test where pass or failure is based on the optical imaging data, such as based exclusively on the optical imaging data, of the fish fillet item.
(31)
(32) By cutting the fish item along dash-dotted line 36 the result is three pieces 34A-C without gaping areas, and only one piece 34D with gaping areas. Thus, the three pieces 34A-C have high value and are applicable for a wide range of purposes, even if the original fish fillet item had a low value due to gaping and little or no applicability. A less intelligent cutting could have resulted in, e.g., a single cut through the gaping areas, which would result in both the resulting cut portions having gaping areas.
(33)
(34) The fish fillet item processing apparatus in
(35) The processing unit may be operatively connected to a storage device comprising a computer program, such as a computer program product, comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of according to the first aspect.
(36) The fish item processing apparatus may be arranged for carrying out an automated and inline method for determining a measure of gaping in a fish fillet item (and for cutting, such as cutting the fish fillet item into fish fillet item portions according to a determined distribution of fish fillet item portion cuts, and for sorting).
(37)
at least a part of the fish fillet item is placed on a non-planar surface (952).
(38)
(39)
(40) The non-planar surface comprises an elongated convex feature arranged so that at least a portion of the fish fillet item is bent around an axis being substantially parallel with a direction of a spine (if the spine would still have been present), which direction in
(41)
(42)
(43)
(44)
(45)
(46)
(47)
(48)
(49)
(50)
(51)
(52)
(53)
(54)
(55)
(56)
(57)
(58)
(59)
(60) Although the present invention has been described in connection with the specified embodiments, it should not be construed as being in any way limited to the presented examples. The scope of the present invention is set out by the accompanying claim set. In the context of the claims, the terms comprising or comprises do not exclude other possible elements or steps. Also, the mentioning of references such as a or an etc. should not be construed as excluding a plurality. The use of reference signs in the claims with respect to elements indicated in the figures shall also not be construed as limiting the scope of the invention. Furthermore, individual features mentioned in different claims, may possibly be advantageously combined, and the mentioning of these features in different claims does not exclude that a combination of features is not possible and advantageous.