METHOD AND APPARATUS FOR SMART IRRIGATION CONTROLLER
20170238484 · 2017-08-24
Inventors
Cpc classification
A01G25/167
HUMAN NECESSITIES
International classification
Abstract
Water is a precious resource in the world, and hence it is imperative to find solutions for an effective use of water, including an efficient irrigation system. A method and apparatus is disclosed that effectively processes the images of the vegetation, determines the optimum weather conditions and the soil moisture conditions, controls irrigation schedules of vegetation to efficiently conserve water while maintaining vegetation health, and predicts the nutrition stress in plants for optimum application of fertilizer when necessary.
Claims
1. An irrigation control system comprising: one or more cameras configured to capture images of vegetation; and at least one processor configured to: receive a set of images of the vegetation from the one or more cameras; determine a health status of the vegetation based on the received set of images; determine whether to irrigate the vegetation at a first point in time based on the determined health status of the vegetation; and when it is determined to irrigate the vegetation at the first point in time, send instructions to one or more irrigation dispensing elements to irrigate the vegetation.
2. The system of claim 1, wherein: the at least one processor is further configured to receive user input including at least one of a preferred irrigation plan; and the determination of whether to irrigate the vegetation at the first point in time is further evaluated on the received user input.
3. The system of claim 1, wherein the at least one processor is configured to determine the health status of the vegetation based on the received images by: determining a Dark Green Color Index (DGCI) for each of the received set of images, and determining whether the DGCI satisfies a predetermined baseline criterion for the vegetation.
4. The system of claim 3, wherein the at least one processor is further configured to: determine a quality value of a given image of the number of images; compare the determined DGCI to an expected range of DGCI values for the vegetation; and when the quality value of the given image is below a quality level or the determined DGCI is below the expected range of DGCI values, replace the given image with another image captured by the camera.
5. The system of claim 4, wherein when qualities of two consecutive images are determined to be below the quality level, the at least one processor is configured to provide a notification to check the camera.
6. The system of claim 1, wherein the at least one processor is further configured to determine when to capture, using the camera, each of the images of the vegetation using a look up table, the look up table including recommended timings for when to capture an image for one or both of a given day of the year and a given weather condition.
7. The system of claim 6, wherein the at least one processor is configured to determine when to capture each of the images using the look up table by: receiving a current weather condition from a weather monitoring and forecast system; accessing a weather condition threshold stored in the look up table based on a day of the year, comparing the current weather condition to the weather condition threshold, determining that the current weather condition is appropriate for capturing an image when the current weather condition satisfies the weather condition threshold.
8. The system of claim 1, wherein the at least one processor is further configured to determine an irrigation requirement based on the determined health status of the vegetation, the irrigation requirement including an amount of irrigation and a duration of irrigation.
9. The system of claim 8, wherein the irrigation requirement is further determined according to at least one of a history of irrigation or a history of vegetation health status for the vegetation.
10. The system of claim 1, wherein the at least one processor is further configured to: receive a weather condition or a weather forecast from a weather monitoring and forecast system; wherein the determination of whether to irrigate the vegetation at the first point in time is further based on the weather condition or weather forecast.
11. The system of claim 10, wherein the weather condition or the weather forecast includes at least one of wind speed data or temperature data.
12. The system of claim 10, wherein the at least one processor is configured to receive an updated weather condition or an updated weather forecast at a set interval.
13. The system of claim 10, further comprising the weather monitoring and forecast system.
14. The system of claim 1, wherein the at least one processor is further configured to: determine whether to fertilize the vegetation at a second point in time based on the received data; and when it is determined to fertilize the vegetation at the second point in time, provide instructions regarding the fertilization of the vegetation to a fertilizer control system based on the received data.
15. The system of claim 14, wherein: the at least one processor is further configured to receive user input including at least one of a preferred fertilizer plan; and the at least one processors is configured to determine whether to fertilize the vegetation at the second point in time in accordance with the received user input.
16. The system of claim 14, wherein the at least one processor is configured to determine whether to fertilize the vegetation at the second point in time based on the received data by: determining a Dark Green Color Index (DGCI) for each of the set of images, and determining a health status of the vegetation based on the determined DGCI, wherein the determination of whether to fertilize the vegetation at the second point in time is based at least on whether the determined health status of the vegetation satisfies a predetermined health criterion.
17. The system of claim 14, further comprising the fertilizer control system; wherein the provided instructions include instructions for operating the fertilizer control system.
18. The system of claim 1, further comprising a soil moisture sensor configured to detect a soil moisture level; wherein the at least one processor is further configured to: receive the soil moisture level; and determine whether to irrigate the vegetation at the first point in time further based on the receive soil moisture level.
19. The system of claim 1, wherein the at least one processor is configured to determine the health status of the vegetation further based on a type of the vegetation.
20. A method comprising: receiving, by at least one processor, a set of images of vegetation from one or more cameras; determining, by the at least one processor, a health status of the vegetation based on the received set of images; determining, by the at least one processor, whether to irrigate the vegetation at a first point in time based on the determined health status of the vegetation; and when it is determined to irrigate the vegetation at the first point in time, sending, by the at least one processor, instructions to one or more irrigation dispensing elements to irrigate the vegetation.
21. The method of claim 20, wherein the health status of the vegetation is determined by: determining a Dark Green Color Index (DGCI) for each of the received set of images, and determining whether the DGCI satisfies a predetermined baseline criterion for the vegetation.
22. The method of claim 21, further comprising: determining, by the at least one processor, a quality value of a given image of the number of images; comparing, by the at least one processor, the determined DGCI to an expected range of DGCI values for the vegetation; and when the quality value of the given image is below a quality level or the determined DGCI is below the expected range of DGCI values, replacing, by the at least one processor, the given image with another image captured by the camera.
23. The method of claim 20, further comprising: determining, by the at least one processor, whether to fertilize the vegetation at a second point in time based on the received data; and when it is determined to fertilize the vegetation at the second point in time, providing, by the at least one processor, instructions regarding the fertilization of the vegetation to a fertilizer control system based on the received data.
24. The method of claim 23, further comprising: receiving, by the at least one processor, user input including at least one of a preferred fertilizer plan; and determining, by the at least one processor, whether to fertilize the vegetation at the second point in time in accordance with the received user input.
25. The method of claim 23, wherein whether to fertilize the vegetation at the second point in time is determined by: determining a DGCI for each of the set of images, and determining a health status of the vegetation based on the determined DGCI, wherein the determination of whether to fertilize the vegetation at the second point in time is based at least on whether the determined health status of the vegetation satisfies a predetermined health criterion.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0022]
[0023]
[0024]
[0025]
DETAILED DESCRIPTION
[0026] The foregoing aspects, features and advantages of the present disclosure will be further appreciated when considered with reference to the following description of exemplary embodiments and accompanying drawings, wherein like reference numerals represent like elements. In describing the exemplary embodiments of the present disclosure illustrated in the appended drawings, specific terminology will be used for the sake of clarity. However, the present disclosure is not intended to be limited to the specific terms used.
[0027] According to an aspect of the present disclosure, the Smart Irrigation Controller is based on image processing, pattern recognition, and control algorithms to efficiently control the irrigation system and nutrient deficiency detection in plants.
[0028] According to an aspect of the present disclosure, as shown in
[0029] According to the aspects of the present disclosure, the processor subsystem 104 may take inputs from the user, from the camera subsystem 108, from the weather monitor and forecast subsystem 112, and from the soil moisture sensor subsystem 116. According to another aspects of the present disclosure, the processor subsystem can be a dedicated processing unit, or part of any computing and communication device such as a smart phone, cellular phone, tablet, computer, server, etc.
[0030] According to another aspect of the present disclosure, the user input may include but is not limited to the following: a user's preferred irrigation plan, such as a conservative plan or a balanced plan or an optimal vegetation health plan. For example, a conservative plan limits irrigation such that the vegetation would survive but not have optimal health, a balanced plan allows for vegetation to have a balance between vegetation health and water conservation. An optimal plan allows for vegetation to have superior health irrespective of the water use. The user may simply override the Smart Irrigation Controller algorithms temporarily or permanently. For example, while testing the system, the user may temporarily override the controller to stop irrigation. Permanent usage is not limited to the following, a user may permanently override a zone or multiple zones in order to deliver the amount of water the user feels best.
[0031] According to another aspect of the present disclosure, the user input may also include but is not limited to the following: a user's preferred fertilizer plan, such as a conservative plan or a balanced plan or an optimal vegetation health plan. For example, a conservative plan limits fertilizer such that the vegetation would survive but not have optimal health, a balanced plan allows for healthier vegetation. An optimal plan allows for vegetation to have superior health irrespective of the fertilizer use. The user input may simply override the Smart Irrigation Controller algorithms temporarily or permanently. For example, while testing the system, the user may temporarily override the controller to stop the fertilizer. Permanent usage is not limited to the following, a user may permanently override a zone in order to deliver the amount of fertilizer the user feels best.
[0032] According to another aspect of the present disclosure, the processing unit may interface with other subsystems such as the camera subsystem, weather monitor and forecast subsystem, soil moisture subsystem, irrigation control subsystem, fertilizer control subsystem by methods not limited to the following, cables, wireless connections, cellular communications, a web interface, a mobile app, or the combination of multiple means.
[0033] According to another aspect of the present disclosure, the processing unit gets images from the camera or by the input from the user, or by both. The camera can be any device with the ability to take images of vegetation that needs to be irrigated and/or fertilized. The images may also include the images from the satellites. According to another aspect of the present disclosure, the user may input images by the means of a serial port, cables, a wireless connection, a web interface, a mobile app, or the combination of multiple means.
[0034] According to another aspect of the present disclosure, the processing unit may get input about current weather conditions from weather services such as but not limited to the following, Yahoo Weather, Accuweather, Intellicast, or Weather.com, or from the user, or dedicated instruments sending weather data to the processing unit, through means not limited to the following, serial port, cables, a wireless connection, or a combination of two or more sources.
[0035] According to another aspect of the present disclosure, the processing unit may get input about weather forecasts for a preset or configurable amount of time from either weather services such as but not limited to the following, Yahoo Weather, Accuweather, Intellicast, or Weather.com, or from the user, or with dedicated instruments measuring weather data, or a combination of two or more sources which may not be mentioned previously. The processing unit may get input about weather forecast for a preset or configurable amount of time by means of cables, wireless connections, cellular communications, etc.
[0036] According to another aspect of the present disclosure, the processing unit may get soil moisture data by means not limited to the following: a soil moisture sensor, a device alike in function to the former, by the input from the user, or by a combination of two or more such inputs. The soil moisture sensor is connected to the processing unit by means not limited to the following, cables, wireless connections, cellular communications, or a combination of two or more means of connection. The soil moisture sensor can be any device with the ability to measure soil moisture in any forms of measurement. The user may input soil moisture data by the means of a serial port, cables, a wireless connection, a web interface, a mobile app, or the combination of multiple means.
[0037] According to another aspect of the present disclosure, the smart irrigation controller takes a preset or configurable number of images of the vegetation at a preset or configurable time or time interval, checks the quality of the images with a preset or configurable standard, and executes image processing by any known image processing techniques. For example, the processing unit may take five images starting at 8:00 AM with a time interval of two hours. A known image processing technique with the result of a Dark Green Color Index (DGCI) may be used to process turf grass color, for example. The DGCI is used to calculate the health of vegetation. This method is described in the following academic paper: Douglas E. Karcher, and Michael D. Richardson. “Quantifying Turfgrass Color Using Digital Image Analysis.” Crop Sci. 43:943-951 (2003), the disclosure of which is incorporated herein by reference.
[0038] According to another aspect of the present disclosure, a lookup table is formed and trained based on the images obtained by any of the following means described in this disclosure.
[0039] According to another aspect of the present disclosure, the images and their image processing results, such as DGCI values, lookup tables, may be stored in the following ways but not limited to the following, such as a hard drive, non-volatile memory, volatile memory, the cloud, a network drive, or stored in the memory of the processing unit. The processing unit may receive images and their image processing results by the means of a serial port, cables, a wireless connection, a web interface, a mobile app, or the combination of multiple means, and store that information in such memory.
[0040] According to another aspect of the present disclosure, if it is time for irrigation, the device will check the weather conditions and the weather forecast and the soil moisture level, and will decide to irrigate at the time or at a later time. If irrigation is required, it will determine an optimal time for irrigation based on weather conditions, weather forecasts, and soil moisture levels. For example, if the current weather condition is windy, causing an open irrigation system to lose effectiveness and waste water, the smart irrigation controller shall irrigate at a later time when the irrigation system can be utilized for optimal effectiveness. If the time of irrigation is not optimal, the smart irrigation controller shall check continuously or at a preset or configured interval until it has determined a time in which irrigation will be most effective. The user may control or override this setting by setting a specific time or a time range.
[0041] The overall DGCI calculation, an exemplary example of image processing, according to aspects of the present disclosure is illustrated in the exemplary flow diagram 200 of
R′=R/255
G′=G/255
B′=B/255
C.sub.max=max(R′,G′,B′)
C.sub.min=min(R′,G′,B′)
Δ=C.sub.max−C.sub.min
Hue (H) is calculated as follows:
Saturation (S) is calculated as follows:
Value (V) also known as brightness is calculated as follows:
V=C.sub.max
Finally, DGCI is calculated as follows:
[0042] Next the processing continues to processing stage 232. At processing stage 232, a determination is made whether the quality of the images is good, for instance satisfying a predetermined quality threshold, and the DGCI value is reliable. The quality of the images may be determined based on a histogram-based Image Quality Index (HQI). The predetermined quality threshold may be a HQI value. For example, the predetermined quality threshold may be for a given type of vegetation where the predetermined quality threshold is a HQI value that the given type of vegetation is identifiable in a given image. The HQI value for a given type of vegetation may be determined by experimentation. The predetermined quality threshold is then met when the HQI value of the given image meets or exceeds the predetermined quality threshold value.
[0043] To determine reliability of the DGCI value, the DGCI value is compared against the expected range of values for that vegetation. The expected range of DGCI values may be determined in the lab or through separate experiments. For example, for turf grass, the expected range of DGCI values is 0-1. In another implementation, the reliability may be determined based on the largest difference between DGCI values for images collected over the period of time. When the largest difference between DGCI values is less than a set value. The period of time may be two days, or more or less, and the set value may be a percentage less than 50% the greatest DGCI value, such as 25% of the greatest DGCI value. If the quality of the images is good and the DGCI value is reliable, the processing continues to next processing stage 236. Otherwise, the processing returns to processing stage 224.
[0044] At processing stage 236, the images and the DGCI values are stored. Next the processing continues to processing stage 240. At processing stage 240, the number of set of images and the DGCI value count is incremented. Next the processing continues to processing stage 244. At processing stage 244, a determination is made whether the DGCI value counter reached the threshold value. If the DGCI value counter is less than the configured threshold N.sub.T, the processing returns to the processing stage 224. Otherwise, when the threshold N.sub.T is met, the processing stage continues to processing stage 248. At processing stage 248, the average of the DGCI values is calculated. Next the processing continues to the processing stage 252. At processing stage 252, the average DGCI value DGCI.sub.AVE of the set of images is stored. The determining of the average DGCI suitably terminates the process at stage 256.
[0045] According to the aspects of the disclosure, an alternate means of image processing may be performed at the processing stage 228, such as pattern recognition. According to this aspect, the images of similar vegetation are taken at different vegetation health conditions and a pattern is determined. A database of image patterns is created, trained and stored for different vegetation conditions and/or for different vegetation types. The images taken at processing stage 224 can be processed and compared against the stored image pattern to determine current vegetation health conditions. According to another aspect of the disclosure, the database may be adapted with new set of images and trained continuously.
[0046] According to an aspect of the present disclosure, a periodic delay may be introduced if, for two or more consecutive images, the image quality is not meeting the predetermined threshold. For example, the delay may be 30 minutes. According to an aspect of the disclosure, the delay may be progressively increased.
[0047] According to another aspect of the present disclosure, if the quality of images is not good for a programmed number of images, a notification or warning message is provided to the user to check the camera subsystem. According to an aspect of the present disclosure, a periodic notification or warning message may be provided if there is no acknowledgement from the user. According to aspect of the present disclosure, the notification or warning message may be of any form. For example, text messages, an audio indication, a visual indication, an email notification, etc.
[0048] According to aspects of the present disclosure the overall irrigation control is illustrated in the exemplary flow diagram 300 of
[0049] According to an aspect of the disclosure, the amount and duration of irrigation can be split into multiple durations and the irrigation time can be dynamically spread for optimum irrigation. For example, if the amount to irrigate is 90% of the normal level and the duration of irrigation is 10 minutes, the irrigation duration can be split two 5 minutes duration at one hour apart. In an another example, if the amount to irrigate is 50% of the normal level and the duration of irrigation is 10 minutes, then there is no split in the irrigation duration. In an yet another example, if the amount to irrigate is 50%, duration of irrigation is 10 minutes, the weather conditions is windy and the soil moisture is below the threshold, then the irrigation duration can be split into two 5 minutes duration and one for at the schedule time and the second one at one hour apart or when the weather condition is favorable whichever is sooner. Likewise the irrigation may be adapted to the various conditions and the user preferences.
[0050] According to aspects of the present disclosure, the optimum fertilizer control of the smart irrigation controller is illustrated in the exemplary flow diagram 400 contained
[0051] At processing stage 404, the vegetation health is analyzed for the fertilizer requirement for the type(s) of vegetation to be fertilized. The set of images taken, processed and stored at processing stages 224, 228, 236 and 252 contained in the flow diagram 200 can be analyzed. The image analysis may include, but is not limited to, pattern of changes over a period of time, the latest pattern and compare the pattern against the look up table that has predefined pattern for lack of specific set of nutrition and determine the amount and type of fertilizer required for the user preference. For example, while processing the images of turf grass, the deficiency of nitrogen may be detected when the symptom shows the turf grass color changed to light green or yellow green from dark green. The change in color may be detected at the tip of a leaf blade, where leaves may start showing signs of death. When this change to light green or yellow green is detected, the type of fertilizer to use may be determined to be a nitrogen-rich type. In another example, while processing the images of turf grass, deficiency of phosphorus may be detected when the symptom shows the turf grass having a reddish-purple at the tip of the leaf blades, dull blue-green color, and/or poor growth. Other factors, such as cold temperature, may also be used in conjunction with the detected characteristics of the turf grass to determine there is a phosphorus deficiency. When the detected characteristics and any other relevant factors indicate a phosphorus deficiency, a type of fertilizer to use may be determined to be a phosphorus-rich type. The type of fertilizer may be either organic or inorganic in accordance with a default setting or a user preference. If the set of images available is not appropriate to analyze the lack of nutrition, according to the aspects of the present disclosure, one or more new sets of images may be taken as per the various processing stages in the exemplary flow diagram 200 contained in
[0052] At processing stage 408, a check is made whether it is time to fertilize as per the standard maintenance schedule. If it is time to fertilize as per the standard maintenance schedule, the processing continues to processing stage 416. Otherwise, the processing continues to processing stage 412. At processing stage 412, check is made to determine whether fertilizer is required based on the determination done at processing stage 404 for preventive maintenance. If fertilizer is required because of preventive maintenance, processing continues to processing stage 416. Otherwise, the processing continues to processing stage 432, where the processing to fertilize the vegetation suitably terminates. Returning to processing stage 416, the irrigation controller checks whether the current weather conditions are optimal to fertilize the vegetation. For example, to fertilize a turf grass, optimum weather condition may include a cool temperature, such as less than 85° F., with rain in the forecast later in the day, such as chance of precipitation over 50%. Alternatively, the optimum weather condition is just a cool day, and the irrigation system is set to water the vegetation immediately after the application of fertilizer. If the weather conditions are optimum, e.g., by falling within predetermined criteria as set forth above, the processing continues to processing stage 428. Otherwise, the processing continues to processing stage 424. At processing stage 424, the smart irrigation controller may delay to fertilize the vegetation when the weather conditions do not satisfy one or more of the predetermined criteria. For example, if the weather forecast is above 85° F., the fertilization is delayed. The delay may be a preconfigured period of time, for example one day. According to an aspect of the present disclosure, the delay can be dynamically configured based on the weather forecast information obtained at processing stage 416. After the delay, the processing continues to processing stage 416. Returning to processing stage 428, the smart irrigation controller configures the fertilizer control subsystem to fertilize the vegetation. Next the processing continues to processing stage 432, where the processing to fertilize the vegetation suitably terminates.
[0053] According to the aspects of the present disclosure, the smart irrigation control may not have a fertilizer control mechanism. In such a case, at the processing stage 428, notification may be sent to the user on the amount and type of fertilizer and the time to fertilize. According to an aspect of the present disclosure, a periodic notification may be provided if there is no acknowledgement from the user. According to aspect of the present disclosure, the notification may be of any form. For example, a text messages, an audio indication, a visual indication, an email notification, etc.
[0054] According to an aspect of the present disclosure a single controller can control many sectors/zones and stations. For example a single smart irrigation controller can control N number of sectors and M number of stations per sector/zone. N and M may be selected depending on the type(s) of vegetation, irrigation area, amount of fluid to be dispensed, climate, etc. For example, the number of sectors N may be 5 and each sector may have 2 stations. In another example, the number of sectors may be 3 and sector 1 may have two stations, sector 2 may have 3 stations and sector 3 may have one station. In general, each sector may have different number of stations.
[0055] According to an aspect of the present disclosure the smart irrigation controller can control different vegetation. Some sectors may have one or more types of vegetation and each type of vegetation may warrant a different set of thresholds and configurations. In such case the smart irrigation controller can control sector or portion of a sector.
[0056] According to an aspect of the present disclosure the smart irrigation controller may not have one or more subsystems represented in
[0057] Although the present disclosure herein has been described with reference to particular embodiments, it is to be understood that these embodiments are merely illustrative of the principles and applications of the present disclosure. It is therefore to be understood that numerous modifications may be made to the illustrative embodiments and that other arrangements may be devised without departing from the spirit and scope of the present disclosure as defined by the appended claims. Aspects of each embodiment may be employed in the other embodiments described herein.