Spectroscopic characterization of seafood
10401284 ยท 2019-09-03
Assignee
Inventors
- Nada A. O'Brien (Santa Rosa, CA)
- Charles A. Hulse (Sebastopol, CA, US)
- Heinz W. Siesler (Essen, DE)
- Changmeng Hsiung (Redwood City, CA, US)
Cpc classification
G01N21/27
PHYSICS
International classification
G01J3/26
PHYSICS
G01N21/27
PHYSICS
Abstract
A method and apparatus for field spectroscopic characterization of seafood is disclosed. A portable NIR spectrometer is connected to an analyzer configured for performing a multivariate analysis of reflection spectra to determine qualitatively the true identities or quantitatively the freshness of seafood samples.
Claims
1. A system comprising: one or more devices to: receive information associated with a first type of seafood and a second type of seafood; determine a first plurality of spectra for the first type of seafood and a second plurality of spectra for the second type of seafood; perform a first operation on the first plurality of spectra to generate a modified first plurality of spectra; perform a second operation on the second plurality of spectra to generate a modified second plurality of spectra; and generate, based on performing the first operation and the second operation, a model, information associated with the model being used to identify a seafood sample based on a reflection spectrum obtained by a spectrometer, and the spectrometer being separate from the one or more devices.
2. The system of claim 1, where the first type of seafood and the second type of seafood have similar visual features, the first type of seafood is a first species, and the second type of seafood is a second species.
3. The system of claim 1, where the first plurality of spectra includes a first quantity of spectra for a first characteristic of the first type of seafood and a second quantity of spectra for a second characteristic of the first type of seafood, and the second plurality of spectra includes a third quantity of spectra for a first characteristic of the second type of seafood and a fourth quantity of spectra for a second characteristic of the second type of seafood.
4. The system of claim 1, where the one or more devices are further to: receive information associated with a plurality of additional types of seafood, each additional type of seafood, of the plurality of additional types of seafood, being different than the first type of seafood and being different than the second type of seafood; generate a plurality of spectra for each additional type of seafood; and perform an operation on the plurality of spectra for each additional type of seafood to generate a modified plurality of spectra for each additional type of seafood, information associated with the modified plurality of spectra for each additional type of seafood being included in the model.
5. The system of claim 1, where the one or more devices are further to: perform, using the information associated with the model, multivariate pattern recognition analysis on the seafood sample; and transmit, based on performing the multivariate pattern recognition analysis, a result of the multivariate pattern recognition analysis to another device for display.
6. The system of claim 1, where information associated with the seafood sample is obtained using the spectrometer.
7. The system of claim 1, where the one or more devices are further to: identify, using the information associated with the model, a type of seafood associated with the seafood sample.
8. A method comprising: receiving, by a device, information associated with a first type of seafood and a second type of seafood; determining, by the device, a first plurality of spectra for the first type of seafood and a second plurality of spectra for the second type of seafood; performing, by the device, a first operation on the first plurality of spectra to generate a modified first plurality of spectra; performing, by the device, a second operation on the second plurality of spectra to generate a modified second plurality of spectra; and generating, by the device, and based on performing the first operation and the second operation, a model, information associated with the model being used to identify a seafood sample based on a reflection spectrum obtained by a spectrometer, and the spectrometer being separate from the device.
9. The method of claim 8, where the first type of seafood and the second type of seafood have similar visual features, the first type of seafood is a first species, and the second type of seafood is a second species.
10. The method of claim 8, where the first plurality of spectra includes a first quantity of spectra for a first characteristic of the first type of seafood and a second quantity of spectra for a second characteristic of the first type of seafood, and the second plurality of spectra includes a third quantity of spectra for a first characteristic of the second type of seafood and a fourth quantity of spectra for a second characteristic of the second type of seafood.
11. The method of claim 8, further comprising: receiving information associated with a plurality of additional types of seafood, each additional type of seafood, of the plurality of additional types of seafood, being different than the first type of seafood and being different than the second type of seafood; generating a plurality of spectra for each additional type of seafood; and performing an operation on the plurality of spectra for each additional type of seafood to generate a modified plurality of spectra for each additional type of seafood, information associated with the modified plurality of spectra for each additional type of seafood being included in the model.
12. The method of claim 8, further comprising: performing, using the information associated with the model, multivariate pattern recognition analysis on the seafood sample; and providing, based on performing the multivariate pattern recognition analysis, a result of the multivariate pattern recognition analysis for display.
13. The method of claim 8, where information associated with the seafood sample is obtained using the spectrometer.
14. The method of claim 8, further comprising: identifying, using the information associated with the model, a type of seafood associated with the seafood sample.
15. A non-transitory computer readable medium storing instructions, the instructions comprising: one or more instructions which, when executed by a processor of a device, cause the processor to: receive information associated with a first type of seafood and a second type of seafood; determine a first plurality of spectra for the first type of seafood and a second plurality of spectra for the second type of seafood; perform a first operation on the first plurality of spectra to generate a modified first plurality of spectra; perform a second operation on the second plurality of spectra to generate a modified second plurality of spectra; and generate, based on performing the first operation and the second operation, a model, information associated with the model being used to identify a seafood sample based on a reflection spectrum obtained by a spectrometer, and the spectrometer being separate from the device.
16. The non-transitory computer readable medium of claim 15, where the first plurality of spectra includes a first quantity of spectra for a first characteristic of the first type of seafood and a second quantity of spectra for a second characteristic of the first type of seafood, and the second plurality of spectra includes a third quantity of spectra for a first characteristic of the second type of seafood and a fourth quantity of spectra for a second characteristic of the second type of seafood.
17. The non-transitory computer readable medium of claim 15, where the instructions further include: one or more instructions to receive information associated with a plurality of additional types of seafood, each additional type of seafood, of the plurality of additional types of seafood, being different than the first type of seafood and being different than the second type of seafood; one or more instructions to generate a plurality of spectra for each additional type of seafood; and one or more instructions to perform an operation on the plurality of spectra for each additional type of seafood to generate a modified plurality of spectra for each additional type of seafood, information associated with the modified plurality of spectra for each additional type of seafood being included in the model.
18. The non-transitory computer readable medium of claim 15, where the instructions further include: one or more instructions to perform, using the information associated with the model, multivariate pattern recognition analysis on the seafood sample; and one or more instructions to provide, based on performing the multivariate pattern recognition analysis, a result of the multivariate pattern recognition analysis for display.
19. The non-transitory computer readable medium of claim 15, where information associated with the seafood sample is obtained using the spectrometer.
20. The non-transitory computer readable medium of claim 15, where the instructions further include: one or more instructions to identify, using the information associated with the model, a type of seafood associated with the seafood sample.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
(2) Exemplary embodiments will now be described in conjunction with the drawings, in which:
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
DETAILED DESCRIPTION OF THE INVENTION
(19) While the present teachings are described in conjunction with various embodiments and examples, it is not intended that the present teachings be limited to such embodiments. On the contrary, the present teachings encompass various alternatives and equivalents, as will be appreciated by those of skill in the art.
(20) Referring to
(21) Referring to
(22) In operation, the incandescent lamps 24 illuminate the seafood sample 11. The TLP 25 collects the diffusely reflected light 36 and direct it towards the LVF 31. The LVF 31 separates the diffusely reflected light 36 into individual wavelengths, which are detected by the photodetector array 31. The measurement cycle can be initiated by pressing the pushbutton 21, or by an external command from the analyzer 14.
(23) The compact size of the NIR spectrometer 12 is enabled by the construction of its light detection subassembly 29. Referring to
(24) Referring to
(25) Using the LVF 31 and the TLP 25 allows a considerable size reduction of the NIR spectrometer 12. The NIR spectrometer 12 is free of any moving parts for wavelength scanning. Small weight of the NIR spectrometer 12, typically less than 100 g, allows a direct placement of the NIR spectrometer 12 onto the seafood sample 11. Small weight and size also makes the NIR spectrometer 12 easily transportable e.g. in a pocket of a food inspector. The size of the NIR spectrometer 12 is illustrated in
(26) Many variants of the NIR spectrometer are of course possible. For instance, the incandescent bulbs 24 can be replaced with broadband light emitting diodes or LEDs. The TLP 25 can be replaced with another optical element, such as a fiber optic plate or a holographic beam shaper. The LVF 31 can be replaced with another suitable wavelength-selective element such as a miniature diffraction grating, an array of dichroic mirrors, a MEMS device, etc.
(27) Referring to
(28) Herein, the term matching spectrum does not of course denote an exact match. Instead, it denotes an identity spectrum of the library, carrying the most similar spectral pattern, as compared to the measured reflection spectrum 13. Thus, the match does not have to be exact, only the closest match of those available. The proximity of the match can be calculated based on the particular matching evaluation method used.
(29) The multivariate pattern recognition analysis 43 is performed to extract seafood species information from the reflection spectrum 13. Due to multitude of overtones of vibrational frequencies of characteristic molecular bonds, the reflection spectrum 13 can be very complex, so that individual spectral peaks cannot be visually identified. According to the invention, the multivariate pattern recognition analysis 43, also known as chemometric analysis, is performed to identify or authenticate species of the seafood sample 11.
(30) The measuring step 42 preferably includes performing repetitive spectral measurements at different locations on the seafood sample 11, and averaging the repetitive measurements, to lessen a dependence of the obtained reflection spectrum on a texture of the seafood sample 11. Extended Multiplicative Scatter Correction (EMSC) of the reflection spectrum 13 can be used to reduce dependence of the measured reflection spectrum 13 on scattering properties of the seafood sample 11.
(31) The reflection spectrum 13 can also be pre-processed using other known statistical methods, e.g. a Standard Normal Variation (SNV) of the reflection spectrum 13 can be computed before proceeding to the multivariate pattern recognition analysis step 43. The slope and/or inflection of the spectral features in the reflection spectrum 13 can be accounted for by performing Savitzky-Golay filtering of the reflection spectrum 13, and computing a first and/or second derivative of the reflection spectrum 13 to be accounted for in the multivariate pattern recognition analysis step 43. Other statistical methods, such as sample-wise normalization and/or channel-wise auto-scaling of the reflection spectrum 13, can be used to facilitate the multivariate pattern recognition analysis step 43, and to provide more stable results.
(32) The multivariate pattern recognition analysis 43 is usually performed in two stages. By way of example, referring to
(33) In view of proliferation of computerized mobile communication devices such as smartphones, it is advantageous to use a mobile communication device to perform the multivariate pattern recognition analysis step 43 (
(34) Turning now to
(35) Experimental Verification
(36) A number of experiments were performed to verify that similarly looking, but differently priced fish species can be identified using a combination of NIR spectroscopy and multivariate regression (chemometric) analysis. Referring to
(37) Turning to
(38) Referring now to
(39) Thus, the total of thirty spectra have been obtained for each fish skin type 60A and 60B; 71A and 71B; 81A and 81B in steps 104A and 104B, respectively. The total of thirty spectra have been obtained for each fish meat type 72A and 72B; 82A and 82B in steps 105A and 105B, respectively. The spectra have been averaged in groups of five for each of the three samples of each type in respective steps 106A, 107A; and 106B, 107B, resulting in two averaged spectra for each sample, and six averaged spectra for each sample type, including skin and meat. The averaging was done to lessen a dependence of the obtained reflection spectrum on a texture of respective the seafood samples 60A; 60B; 71A; 71B; 72A; 72B; 81A; 81B; 82A; and 82B. Then, PCA models have been established in steps 108A, 108B for the respective A and B samples. A SIMCA analysis was performed to identify the type of each fish sample. The results were presented in form of Coomans plots for each fish type.
(40) Red Mullet/Mullet Pair
(41) Referring to
(42) Turning to
(43) Referring now to
(44) Only one of the two parameters Distance to Red Mullet and Distance to Mullet can be used by comparing the parameter to a threshold. For example, if Distance to Mullet is used, the threshold is about 0.01. If Distance to Red Mullet is used, the threshold is approximately 0.0008. One can see from
(45) Winter Cod/Cod Pair
(46) Referring to
(47) Turning to
(48) Referring now to
(49) Samlet/Salmon Pair
(50) Referring to
(51) Turning to
(52) Referring now to
(53) Meerbarbe Filets Freshness
(54) A numerical study of reflection spectra of meerbarbe filets has been performed, in which various known multivariate analysis methods were used to differentiate between meerbarbe filet (both skin and skinless meat) freshness conditions.
(55) Table 1 below summarizes successful prediction rate with alternate matching methods of the mullet and red mullet performed on a typical desktop computer. The spectra were auto-scaled before being sent to multivariate pattern classifiers. The last column of Table 1 provides the time it takes to build the predictive models. The time to perform prediction based on existing models are typically in the range of milliseconds. The time to build model can become important factors when one needs to do in-situ models updating. In field, point-of-use applications, the speed of measurement and the speed of obtaining the results are important to be as short as possible. In addition, the accuracy of the results is important. From Table 1, one can see that methods such as SVM (with linear kernel) provide the best accuracy at the shortest time.
(56) TABLE-US-00001 TABLE 1 Prediction Models Method Name Success Rate building Time Naive Bayes classifier 83.3% <0.1 sec Classification and Regression .sup.75% <0.1 sec Trees (CART) TreeBagger implementation of 83.3% 0.3 sec bagged decision trees LIBLINEAR linear classifier 81.7% <0.1 sec Support Vector Machine (SVM) 93.3% <0.1 sec with Linear Kernel Support Vector Machine Radial 81.7% <0.1 sec Basis Function (SVM-RBF) Linear Discriminant Analysis .sup.85% <0.1 sec (LDA) Quadratic Discriminant Analysis .sup.85% <0.1 sec (QDA) Partial Least Squares Discriminant 86.7% .sup.44 sec Analysis (PLS-DA) SIMCA 88.3% .sup.1 sec
(57) Below, the numerical methods of Table 1 are discussed only briefly, since the methods themselves are known in the art. Each of the methods has its advantages. In the Nave Bayes method, it is assumes that all features are independent on each other, and the results can be easily interpreted. The CART method is also easy to understand and interpret; however, trees created from numeric datasets can be complex, and the method tends to have over-fitting problems. The TreeBagger Analysis and Random Forest Analysis methods usually gave very good results, and the training step of the method was relatively quick. LIBLINEAR method was very efficient in distinguishing seafood species and conditions. The SVM method with Linear Kernel, including Support Vector Classification (SVC) for qualitative analysis, and Support Vector Regression (SVR) for quantitative analysis, resulted in the prediction success rate of over 93%. In LDA method, it is assumed that all classes have identical covariance matrix and are normally distributed, and Discriminant functions are always linear. In QDA method, the classes do not necessarily have identical covariance matrix, but the normal distribution is still assumed. Partial Least Square (PLS) is a statistical method that bears some relation to principal components regression; instead of finding hyperplanes of minimum variance between the response and independent variables, it finds a linear regression model by projecting the predicted variables and the observable variables to a new space. Partial least squares Discriminant Analysis (PLS-DA) is a variant used when the Y is categorial. PLS-DA methods resulted in moderate prediction rates of 85-87%.
(58) The results show that NaiveBayes, TreeBagger, SVM-linear, LDA, QDA, PLS-DA, and SIMCA can be used in the multivariate analysis for the purpose of correlating the NIR reflection spectra with seafood samples. First and second derivatives of the obtained spectra can also be used in place of, or in addition to the pretreatments of spectra, as an input data strings for the multivariate analysis.
(59) The hardware used to implement the various illustrative logics, logical blocks, modules, and circuits described in connection with the aspects disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
(60) The foregoing description of one or more embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.