Monitoring device, a system and a method for monitoring a status of fruits
10837901 · 2020-11-17
Assignee
Inventors
Cpc classification
G01N21/31
PHYSICS
G01N21/6486
PHYSICS
G01N2021/3177
PHYSICS
G01N21/474
PHYSICS
International classification
G01J3/44
PHYSICS
Abstract
A monitoring device for monitoring a status of fruits, the monitoring device comprising: a flexible strip configured to be introduced into a cluster of fruits allowing the flexible strip being embedded in the cluster, the flexible strip comprising a plurality of spatially separated sensing nodes, wherein each of the plurality of sensing nodes comprises a sensing node light source configured to emit light and a sensing node light detector configured to detect light, a read out circuitry configured to read out data pertaining to the detected light detected at each of the plurality of sensing nodes, a body comprising a wireless communication module configured to transmit the data pertaining to the detected light, wherein the flexible strip is attached to the body. A system comprising a plurality of monitoring devices and a method for monitoring a status of fruits are further provided.
Claims
1. A monitoring device, comprising: a flexible strip that contorts in shape when embedded into a cluster of fruit; a plurality of sensing nodes spatially separated and mounted on the flexible strip, wherein each sensing node of the plurality of sensing nodes comprises a sensing node light source configured to emit light and a sensing node light detector configured to detect light; read out circuitry configured to read out data pertaining to the light detected at each of the plurality of sensing nodes; and a transceiver configured to transmit the data pertaining to the detected light.
2. The monitoring device according to claim 1, wherein each of the sensing node light detectors comprises a photodetector.
3. The monitoring device according to claim 2, wherein at least one of the sensing node light detectors further comprises an optical filter arranged in front of the corresponding photodetector.
4. The monitoring device according to claim 3, wherein the optical filter is monolithically integrated with the photodetector.
5. The monitoring device according to claim 1, wherein each of the sensing node light sources comprises a solid-state light source.
6. The monitoring device according to claim 1, further comprising control circuitry configured to control each of the sensing node light sources to emit light with a predetermined spectral distribution.
7. The monitoring device according to claim 6, wherein the control circuitry is configured to control a first and a second of the sensing node light sources such that the spectral distribution emitted by the first sensing node light source is different from the spectral distribution emitted by the second sensing node light source.
8. The monitoring device according to claim 1, wherein each of the sensing node light detectors is configured to detect light pertaining to the spectral signature of the phenols of the fruit.
9. A system comprising a plurality of monitoring devices according to claim 1.
10. The system according to claim 9, further comprising a server configured to: receive the data transmitted by the transceiver of each monitoring device of the plurality of monitoring devices; and analyze the received data.
11. The system according to claim 9, wherein each monitoring device of the plurality of monitoring devices further comprises a geotag associated with a geographical position.
12. A method, comprising: embedding a flexible strip, of a monitoring device into a cluster of fruit, the flexible strip contorting in shape when embedded in the cluster; monitoring a status of the fruit by a plurality of sensing nodes spatially separated and mounted on the flexible strip, each sensing node of the plurality of sensing node including a sensing node light, source that emits light and a sensing node light detector that detects light; reading out data, by read out circuitry of the monitoring device, pertaining to the light detected at each of the plurality of sensing nodes, and transmitting the data pertaining to the detected light.
13. The method according to claim 12, wherein the monitoring is performed over a period of time.
14. The method according to claim 12, wherein the monitoring comprises: emitting light from each sensing node light source at a first time and at a second time; and reading out data pertaining to light detected at each sensing node light detector in accordance with the light emitted at the first and second time.
15. The method according to claim 14, wherein a time period between the first and the second time is in the order of hours.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and other aspects of the present invention will now be described in more detail, with reference to appended drawings showing embodiments of the invention. The figures should not be considered limiting the invention to the specific embodiment; instead they are used for explaining and understanding the invention.
(2) As illustrated in the figures, the sizes of layers and regions are exaggerated for illustrative purposes and, thus, are provided to illustrate the general structures of embodiments of the present invention. Like reference numerals refer to like elements throughout.
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION
(7) The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which currently preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided for thoroughness and completeness, and to fully convey the scope of the invention to the skilled person.
(8)
(9) The flexible strip 102 may further be reusable.
(10) The monitoring device 100 may be placed in the proximity of a fruit 104 pertaining to a cluster of fruits. The fruit may be of any kind, for example a grape.
(11) The monitoring device may be placed in contact with a fruit, such as a grape in a cluster of fruits.
(12) The cluster of fruits may be an assembly of fruits.
(13) The cluster of fruits may be a bunch of fruits such as a grape bunch.
(14) The flexible strip 102 may be introduced into a cluster of fruits allowing the flexible strip 102 to be embedded in the cluster as will be described below.
(15) The flexible strip 102 comprises a plurality of sensing nodes 106. The sensing nodes 106 are not limited to points, rather, a sensing node 106 may constitute an area or a volume as illustrated in
(16) At least one of the sensing node light detectors may further comprise an optical filter arranged in front of the corresponding photodetector as will be described further below.
(17) Each of the plurality of sensing nodes 106 may comprise a sensing node light source 108. The sensing node light source 108 is configured to emit light 107. Each of the sensing node light sources 108 may be formed by a solid-state light source. Non-limiting examples of solid-state light sources are light-emitting diodes, LEDs, organic light-emitting diodes, OLEDs, and polymer light-emitting diodes, PLEDs. A sensing node 106 may further comprise a plurality of sensing node light sources 108. The sensing node light source 108 may more generally be understood as a region in space emitting light. The sensing node light source 108 may be referred to as a point source of light. The sensing node light source 108 may be construed as a node or point in space from which light is emitted. The sensing node light source 108 may therefore be formed by a light out coupling element such as the opening of an optical fiber or the end of a waveguide element. Hence, light may efficiently be coupled out at the light out coupling element such that a light source is provided at the sending node. To this end, light from a single light source or a plurality of light sources 108 may be coupled into the optical fiber or waveguide.
(18) The monitoring device 100 further comprises a controller 109. The controller 109 may be configured to control each of the sensing node light sources 108 to emit light with a predetermined spectral distribution. For example, the controller may control a sensing node light source 108 to emit light. The controller 109 may further be configured to control the wavelength of the light emitted by the sensing node light source, by for instance tuning the voltage applied to the sensing node light source 108.
(19) The controller 109 may be configured to control the light intensity of the light emitted by the sensing node source.
(20) The sensing node light source may be solid state light source.
(21) The sensing node light source may be a light emitting diode.
(22) The sensing node light source may be a laser diode.
(23) The sensing node light source may be a monochromatic light source.
(24) The sensing node light source may comprise more than one light emitting structure. The light emitting structure may be a light emitting diode or a laser diode dye.
(25) The sensing node light source may thereby be configured to emit light at different wavelengths or wavelength ranges.
(26) The controller 109 may be configured to select the wavelength or wavelength range of light that should be emitted by the sensing node light source 108.
(27) The sensing node light source may be configured to emit light within a spectral range. The sensing node light source may be construed as a broad band light source.
(28) The light emitted may be in the UV-VIS range. Other ranges include IR ranges, such as NIR and MIR. The sensing node light source may emit white light.
(29) The controller 109 may further control specific sensing node light sources 108 separately. For example, a first sensing node light source 108 may emit light of a first wavelength, while a second sensing node light source 108 may be emitting light of a second wavelength. The monitoring device 100 may therefore emit light of different wavelengths from different sensing node light sources 108. Subsequently, the monitoring device 100 may emit light of different wavelengths at different sensing nodes 106. Furthermore, the monitoring device 100 may emit light of different wavelengths from different sensing node light sources 108 placed in a single sensing node 106. In an embodiment, a sensing node 106 comprises sensing node light sources 108 that are each arranged to emit light of a specific wavelength.
(30) Each of the plurality of sensing nodes 106 may further comprise a sensing node light detector 110. The sensing node light detector 110 is configured to detect light 111. The detected light may pertain to light emitted by or reflected by a fruit in the cluster of fruits.
(31) Read out circuitry 112 may further be configured to read out data pertaining to the detected light detected at each of the plurality of sensing nodes 106.
(32) The read out circuitry 112 may be positioned on the flexible strip 102 of the monitoring device 100. The read out circuitry may further be positioned on the body 114 of the monitoring device 100.
(33) Each of the sensing node light detectors 110 may comprise a photodetector 113a. The photodetector 113a may be of any type, such as photoemission, photoelectric and/or photovoltaic based detector.
(34) A photodetector 113a may detect light having a certain wavelength.
(35) This may be achieved by the sensing node light detector 110 further comprising an optical filter 113b arranged in front of the corresponding photodetector 113a.
(36) The optical filter 113b may be configured to transmit light in a predetermined spectral wavelength range. Hence predominately light within the predetermined spectral wavelength may be transmitted to a corresponding photodetector 113a.
(37) The optical filter 113b may thus have a pass band.
(38) The optical filter 113b may be configured to transmit at least a portion of light having a spectral distribution falling within the predetermined spectral wavelength range.
(39) The optical filter 113b may be configured to reflect light having a spectral distribution falling within a predetermined spectral wavelength range.
(40) The optical filter 113b may be monolithically integrated with the photodetector 113a. A more compact sensing node light detector may thereby be provided.
(41) The photodetector may form part of an array of photodetectors.
(42) The array of photodetectors may comprise a plurality of integrated optical filters arranged in front of the individual photodetectors. Each optical filter may be processed on top of the respective photodetectors in the array of photodetectors. The optical filter may be monolithically integrated with the photodetector.
(43) The sensing node in the monitoring device comprises a sensing node light source and a sensing node light detector as described above. As a non-limiting example, the sensing node light source may comprise a plurality of light sources, such as light emitting diodes. The sensing node light sources may be arranged to emit light at different wavelength ranges with respect to each other.
(44) The sensing node light detector may further comprise a plurality of photodetectors. Each photodetector may comprise an optical filter arranged in front of the photodetector. The optical filters may be arranged on the photodetector.
(45) The optical filters may be configured to transmit light within the different wavelength ranges at which the sensing node light sources emit light.
(46) The optical filter may alternatively be configured to reflect light within the different wavelength ranges at which the sensing node light sources emit light.
(47) The sensing node light detector 110 may more generally be understood as a region in space at which light may be detected. The sensing node detector 110 may therefore be construed as a node or point in space from which light is collected and detected. It should be noted that the detection may occur at a location spatially separated from the point of collection. As an example, the sensing node light detector 110 may comprise light in-coupling element such as the opening of an optical fiber, a lens or an end of a waveguide. Light may further be guided from the light in-coupling element to a spatially separated light detector. The light in-coupling element and the detector may form the sensing node light detector 110.
(48) The sensing node light source 110 may be construed as a point source or a collection of point sources. The sensing node 106 may comprise a spectrometer.
(49) The flexible strip 102 may further comprise a set of spectrometers. A spectrometer may be construed as an instrument for measure properties of light such as the wavelength distribution of light. The spectrometer may comprise a wavelength dispersive element such as a grating or a prism.
(50) Spectrometers are available in the component market have reached a considerable level of miniaturization but most of them are still based in gratings dispersion with optics. Such small size spectrometers may be fitted with fiber optics for the measurements using a slit, rectangular, or round, and a photodetector such as a silicon based detector, e.g. a CCD or linear photodiode array.
(51) The optical filter may be an interference filter arranged to block light within a predetermined spectral range. An interference filter, also referred to as a dichroic filter, is an optical filter configured to reflect one or more spectral bands or lines and transmits others. The interference filter may be a high-pass, a low-pass, a bandpass, or a band-rejection optical filter. The interference filter may, for example, be configured to block light emitted by a sensing node light source within the same sensing node. The interference filter may further be configured to transmit light in a spectral wavelength range of interest. Thus, weaker light signals pertaining to emission or scattering processes at or in a fruit may be detected while blocking the stronger light emitted by the sensing node light source. The interference filter thereby offers efficient light background subtraction. The interference filter allows, for example, for Raman spectroscopy.
(52) The light emitted and/or detected at the sensing node may be within the visible range, the infra-red range or in the ultra-violet range.
(53) The monitoring device 100 may further comprise a read-out circuitry 112.
(54) Furthermore, the monitoring device 100 may further comprise a body 114. The body 114 may comprise a wireless communication module 116. The flexible strip 102 may be attached to the body 114. The flexible strip 102 may further be releasable attached to the body 114.
(55) The flexible strip 102 may comprise a protecting casing such as a silicon housing. The protective casing may be transparent or translucent such that light may enter or leave the sensing nodes.
(56) A wireless communication module 116 may further be positioned on or in the body 114. The wireless communication module 116 may be configured to transmit the data pertaining to the detected light. The data may be a sign of the status of the fruit, such as PH, Brix and titratable acidity levels. The data may further be electrical signals relating to the received light. The wireless communication module 116 may comprise radiofrequency communications to support transmitting of acquired data. For example, the wireless communication module 116 may use a low-power wide-area network, LPWAN, to transmit data. The data may be transmitted to a server. The analysis of the data may be done on the monitoring device 100. The analysis of the data may further be performed on a server, remote from the monitoring device 100.
(57) Now referring to
(58) As a non-limiting example, the monitoring device 100 may be arranged on a branch 201 of grapes, for example wine grapes.
(59) Now referring to
(60) The flexible strip 102 may also, for example, be introduced into a plurality of fruits stacked, such as apples or oranges stacked in a crate. Efficient monitoring of the status of a fruit or fruits may thereby be provided, for example when transporting fruits or when the fruits are provided in a supermarket. An improved assessment of the quality or maturity of a fruit may thereby be provided.
(61) Next the operation of the monitoring device 100 will be described with reference to
(62) The interaction of light with different compounds of the first fruit 206 may alter the properties of the light that is reflected or emitted by the first fruit 206. The emitted and/or reflected light from the first fruit 206 may be detected by a sensing node light detector 110 of the first sensing node 106a. The detected light may therefore pertain to the spectral signature of the compounds of the first fruit 206. The detected light may further pertain to the spectral signature of the phenols of the first fruit 206. Reflectance and fluorescence measurements may be used at various wavelengths to probe the spectral signatures for phenols. For example, anthocyanins have a maximum absorption band around 540 nm, while flavonols have an absorption band at 370 nm. A further example is chlorophylls that fluorescence at 680-750 nm. pH, Brix and titratable acidity may be correlated to the reflectance and fluorescence measurements.
(63) A second sensing node 106b may further analyze a second fruit 208. The data obtained by the emission and detection at the two sensing nodes 106a and 106b may be compared. Different sensing nodes, positioned on different positions on the flexible strip, may therefore analyze different parts of the cluster of fruits. For example, each part of the bunch of grapes may be analyzed individually and compared.
(64) The monitoring device 100 may further comprise additional components such as light component drivers, energy harvesters, batteries, and microcontrollers.
(65) The light component drivers may power the sensing node light sources. The light component drivers may further regulate the current flowing through the sensing node light sources. Batteries may power the monitoring device 100. There are further many types of power sources available to the skilled person. The power sources may also be situated anywhere on the monitoring device 100, such as on the body 114.
(66) The microcontrollers may contain one or more CPUs to handle automatic functionalities of the monitoring device 100.
(67) It should be noted that the monitoring device may be placed on other parts of the plant as well as on other types of plants. The monitoring device 100 may further be placed directly on a fruit or in between fruits in a cluster of fruits.
(68) Now referring to
(69) The method 300 comprises the steps of introducing 302 the flexible strip 102 of the monitoring device 100 into a cluster of fruits allowing the flexible strip being embedded in the cluster. The strip may in some embodiments be attached to a branch before fruits have grown on the branch, allowing the flexible strip 102 to be embedded in fruits over time.
(70) The status of the fruits is monitored 304 by emitting light from the plurality of sensing node light sources 108.
(71) Data pertaining to light detected at each of the plurality of sensing nodes 106 is read out 306.
(72) Furthermore, the method 300 comprises transmitting 308 the data pertaining to the received light.
(73) The steps of the method 300 may collectively be described as an analyzing event of the status of a fruit. A multitude of analyzing events as the one described above may occur simultaneously. A plurality of analyzing events may furthermore occur in parallel at different sensing nodes 106. The read-out circuitry 112 may therefore read out data from a plurality of sensing nodes 106 simultaneously.
(74) Analyzing events may be performed continuously, providing over time monitoring of the status of the fruits.
(75) For example, light may be emitted from a plurality of sensing node light sources 108 at a first time and at a second time and data may be read out from light detected in connection with the first and second time.
(76) Time intervals between analyzing events may for example be in the order of hours and/or days.
(77) The monitoring of a status of fruits may be continuous.
(78) A further non-limiting example is that data and readings could be collected every day, week or at any other frequency to be stored on a memory. A data processor of the monitoring device may further transmit data stored on the memory to a server when the memory is full or at a parametrized duty cycle.
(79) The monitoring device 100 may comprise a positioning unit. The positioning unit enabling the status of the fruits to be monitored in correspondence to the geographical position of the monitoring device. The positioning unit may be referred to as a position determining unit. The positioning unit may be connected to the data processor. The positioning unit may be configured to determine the local position of the monitoring device via a signal from a positioning system. The signals may comprise geo-referenced position data.
(80) To this end, the positioning unit may comprise a receiver and/or a transmitter to receive a position signal from the positioning system. The positioning unit may, for example, comprise a global positioning system, GPS, module configured to receive the GPS signal. The positioning unit may further be configured to calculate the location as position coordinate based on the received position signal. The position coordinate may comprise longitude and latitude.
(81) The monitoring device may comprise a position beacon, e.g. a GPS beacon, configured to push, i.e. send, the position of the monitoring device as at regular intervals, to a server.
(82) The monitoring device 100 may further comprise a geotag, enabling the status of the fruits to be monitored in correspondence to their geographical position.
(83) The geotag may be provided by a positioning system.
(84) The geotag may be provided by a position determining unit.
(85) The positioning system may be a global or local positioning system.
(86) The positioning system may be a combination of global systems and local systems. Non-limiting examples of global positioning systems comprise GPS, Galileo, and GLONASS. Non-limiting examples of local positioning systems comprise GPRS, LTE, Wi-Fi, Bluetooth, RFID, and NFC. It should be noted that the monitoring device may comprise more than one flexible strip. Multiple flexible strips allow for improved assessment of the status of different fruits within the cluster of fruits may thereby be provided. A better total evaluation of the maturity of the cluster of fruits may thereby be provided.
(87) The wireless communication module 116 may be a transceiver, for communicating data pertaining to the detected light to or from the monitoring device 100. The transceiver may use electromagnetic fields to send or receive data from within a communication network.
(88) The monitoring device 100 may further comprise a data processor and/or a memory. The data processor may, for example, be arranged to process data obtained by the sensing node light detector. The obtained data may be stored in the memory. The obtained data may further, for example, be compared to reference data stored in the memory.
(89) The data processor may be configured to send an alarm based on the comparison of the obtained data and the reference data.
(90) Alternatively, data resulting from sensing node light detector and/or data pertaining to analysis of detected light may be compared to externally stored reference data within a communication network which is accessible for the monitoring device by use of the transceiver.
(91) The data pertaining to the detected light may further be sent from the monitoring device to an external device such as a computer via the communication network. An external data processor may be arranged outside the monitoring device but located within the communication network may further be used to process data obtained by the sensing node light detector. The external data processor may for example be arranged in an external computer. The requirements of the monitoring device to process data are thereby reduced. The communication network may be a local area network, a LAN, an internet, or a telecommunication network.
(92) Now referring to
(93) A monitoring device 100 of the system 400 may communicate with other devices of the system 400 via a network 402. The other devices may e.g. comprise other monitoring devices 100, one or more servers 404, and/or one or more user clients (not shown). Each of the devices of the system 400 may comprise one or more data processors (not shown).
(94) Post processing of data gathered by a monitoring device 100 may be performed by one or more of the data processors of the devices of the system 400. A single one of the devices may be configured for processing of data gathered by a monitoring device 100. Alternatively, the processing of data gathered by a monitoring device 100 may be distributed over a plurality of the devices in the system 400.
(95) Further, monitoring devices 100 of the system 400 may be configured to establish a direct communication between each other. For example, a first and a second monitoring device may be configured to establish a direct communication between each other. In case the first monitoring device has access to the network 402 and the second does not, the second monitoring device 100 may relay data through the first monitoring device 100, in order to transfer data to and/or from other devices of the system 400.
(96) A monitoring device 100 may further be associated with a geoposition.
(97) A server functionality as described above allows for remote handling and analysis of data. Data from a plurality of devices and subsequently a plurality of cluster of fruits may be compared, evaluated, and examined remotely. Furthermore, associating each of the monitoring devices with a geoposition allows for connecting cluster of fruits to spatial positions of which the status of a fruit may, for example, be evaluated based on its position in the field.
(98) The person skilled in the art realizes that the present invention by no means is limited to the preferred embodiments described above. On the contrary, many modifications and variations are possible within the scope of the appended claims.
(99) For example, various systems may be implemented using the device, such as alarm functions for when properties reach or go below certain thresholds.
(100) Additionally, variations to the disclosed embodiments can be understood and effected by the skilled person in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.