SYSTEM, METHOD, AND APPARATUS FOR ACTIVE PEST DENIAL, APIARY MONITORING AND MANAGEMENT
20240008458 ยท 2024-01-11
Inventors
Cpc classification
A01K47/06
HUMAN NECESSITIES
International classification
Abstract
Aspects of this disclosure include a system, method and apparatus providing automated audio and vision based pest detection and entry denial for a beehive. The apparatus may include multiple video classification sensors that transmit a signal of the dorsal and lateral aspect of the insects to a computer running a video processing algorithms that classify all insects attempting to enter a beehive. Additionally, the apparatus may include multiple audio classification sensors that transmit audio signals to the computer for audio analysis to assist in classification. Insects classified as pests (not-a-bee) are actively excluded from the beehive.
Claims
1. A system for identifying and actively denying pests entry to a beehive, comprising: one or more visual classification sensors configured to collect real-time data and classify insects attempting to enter the beehive by monitoring a dorsal view of the entrance; one or more audio classification sensors configured to collect real-time data and classify insects attempting to enter the beehive by monitoring ambient sounds; an apparatus configured to mount on an existing hive box, said apparatus comprising means for mounting the visual and audio classification sensors and restricting entry to individual entry points that are monitored with the visual classification sensors; a classification and control computer configured to process data collected by the visual and audio classification sensors using specialized classification algorithms, including traditional algorithms and artificial intelligence (AI) algorithms employing trained neural networks, to establish the identity of the insects in real-time based on factors including size, sound, shape, speed, coloration, and direction of movement; means for declaring a beehive species, either Apis cerana or Apis mellifera, upon initialization of the classification and control computer, with all other bee species being considered pests and excluded from the beehive; means for selecting a library of images and audio files typical for the declared species for positive training of the neural network, as well as a library of images and audio files of pests for negative training of the neural network; one or more automated kill mechanisms associated with each entry point, said kill mechanisms being configured to prevent pest entry based on classifications determined by the classification and control computer; and a secure, remote communication link configured to provide the beekeeper with access to statistics related to insect classifications, notifications of limit conditions, and the ability to set thresholds for specific insect types.
2. The system of claim 1, wherein the visual classification sensors are selected from the group consisting of visible light cameras, infrared cameras, LIDAR, laser scanners, and combinations thereof.
3. The system of claim 1, wherein the audio classification sensors comprise one or more microphones configured to convert sound into electrical signals that can be analyzed to differentiate honey bees from flying pests.
4. The system of claim 1, wherein the classification and control computer classifies every insect as either a bee corresponding to the declared beehive species or a pest and logs the counts of insects entering or exiting the beehive based on their classification.
5. The system of claim 1, wherein the automated kill mechanisms are triggered upon classification of an insect as a pest to exclude the insect from the beehive by killing or seriously injuring the insect.
6. The system of claim 1, wherein the beekeeper can set limit conditions for each insect type that will trigger a notification message to be transmitted to the beekeeper, allowing for proactive management of potential invasive species or other threats to the beehive.
7. The system of claim 1, wherein the beehive entrance further comprises an automated closure gate controlled by the classification and control computer, allowing for regulation of entry to the beehive based on the classifications of insects attempting to enter.
8. The system of claim 1, wherein a cover with a restricted entry is employed to force insects to crawl rather than fly to the control entry mechanism, providing an additional layer of control over access to the beehive and potentially increasing the effectiveness of the automated kill mechanisms in managing pests.
9. The system of claim 1, wherein the kill mechanism employs a variable energy delivery mechanism under the direction of the control computer, allowing for the adjustment of kill energy levels based on the physical attributes of the insect, thereby optimizing the effectiveness and efficiency of the pest exclusion process.
10. The system of claim 1, further comprising integrated consistent intensity and color lighting to aid in consistent insect classification, enhancing the accuracy and reliability of the visual classification sensors in identifying and differentiating between bees and pests.
11. The system of claim 1, wherein the classification components and kill mechanisms may be integrated into the standard beehive components, streamlining the overall design and minimizing the need for additional external equipment.
12. The system of claim 1, further comprising remote temperature and air composition sensors integrated into the internal beehive frames, with these remote sensors configured to communicate temperature and air composition data periodically to the main apparatus control computer, enabling monitoring of internal hive conditions.
13. The system of claim 1, wherein a remote temperature and air composition measurement apparatus is used in conjunction with the main apparatus, providing increased flexibility in sensing hive conditions and allowing for standalone operation without the main apparatus, while still communicating temperature and air composition data periodically to the main apparatus control computer.
14. The system of claim 1, further comprising solar panels configured to provide energy to charge batteries that power the electronic components of the system, promoting a sustainable and environmentally friendly power source for the beehive monitoring system.
15. The system of claim 1, further comprising controlled heating elements implemented to reduce the wintertime energy requirements of the bee colony and enhance colony viability, with heating controlled by monitoring both temperature and bee behavior to optimize energy usage and hive conditions.
16. The system of claim 1, further comprising controlled ventilation implemented to reduce the summertime energy requirements of the bee colony and enhance colony viability, with ventilation controlled by monitoring both temperature and bee behavior to optimize energy usage and hive conditions.
17. The system of claim 1, further comprising a chemical sensor configured to characterize potentially harmful substances within the hive, including viruses, bacteria, decay, and molds, enabling proactive measures to maintain hive health.
18. The system of claim 1, wherein the chemical sensor is employed to identify types of nectar and pollen being returned to the hive by foragers, assisting the beekeeper in understanding the current availability of flowering species in the vicinity of the apiary and distance foragers travel.
19. The system of claim 1, wherein the visual classification sensor is employed to identify the color and quantity of pollen being returned to the hive by foragers, further assisting the beekeeper in understanding the current availability of flowering species in the vicinity of the apiary and distance foragers travel.
20. The system of claim 1, further comprising an automated door added to the cover to restrict entry and increase the thermal isolation of the hive, enhancing hive temperature control.
21. The system of claim 1, further comprising a box alignment and stabilization device with an integrated load cell, configured to align and stabilize multi-box hives as well as monitor hive weight.
22. The system of claim 1, further comprising a hive leveling device with an integrated load cell, configured to align, level, and stabilize a hive as well as monitor hive weight.
23. The system of claim 1, further comprising a front-facing motion detector configured to characterize non-insect pests such as bears, skunks, anteaters, armadillos, and other insectivorous animals that may endanger an apiary. The detection may trigger visual and auditory alarms as well as send priority notifications to the beekeeper, enabling rapid response to potential threats.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0055] The novel features believed characteristic of the invention are set forth in the appended claims; however, the invention itself, as well as a preferred mode of use, further objectives and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075]
[0076]
[0077]
[0078]
[0079]
[0080]
[0081]
[0082]
[0083]
[0084]
[0085]
[0086]
[0087]
[0088]
[0089]
[0090]
DETAILED DESCRIPTION OF THE INVENTION
[0091] With reference now to the figures, and in particular with reference to
[0092] The beehive body is typically constructed of wood and serve as the living quarters for a bee colony and sits directly on top of the bottom board 102. Hive bodies hold either eight or 10 frames (not shown) where the queen lays her eggs and workers store pollen and honey for food. Each hive body has enough space to house between 50,000 and 60,000 workers.
[0093] The beehive depicted is a single box (brood box), however in an apiary, a hive is typically constructed of one or two brood boxes and several supers (additional honey storage boxes) stacked on top. Other standard beehive components not shown, are queen excluder, honey supers, and inner cover.
[0094] The beehive depicted is an example of one popular type and construction, however, the invention may be implemented on other designs as well
[0095] With reference now to
[0096] With reference now to
[0097] With reference now to
[0098] Sensor data is provided for computer analysis by the sensor system compromising a visual classification sensor 403, an internal temperature, humidity, and chemical sensor 404, an external temperature, humidity, and chemical sensor 405, a front facing audio classification sensors (s) 406, a rear facing audio classification sensor 407 and load cells 408.
[0099] The primary classification sensor is visual classification sensor 403, a high resolution auto-focus color sensor providing sub-millimeter resolution images of insects attempting to enter the beehive. The frame rate and resolution are sufficient to detect, track and classify all potential insect threats that are able to enter the entry ports as shown in
[0100] The internal and external temperature, humidity, and chemical sensors 404 and 405 respectively, provide environment data for computer analysis. The temperature and humidity data are analyzed to determine if auxiliary heat or ventilation of the hive is necessary. The chemical sensor data is analyzed using artificial intelligence (AI) algorithms that have been trained to recognize chemical and biological signatures, including pathogens, rot, mildew, and fungus.
[0101] The audio classification sensors, 406 and 407 are digital microelectromechanical systems (MEMS) sensors convert sounds to electrical signals that can be analyzed to differentiate bees from flying pests such as wasps and hornets by providing high sensitivity wide-band audio data for analysis. The front facing audio classification sensor 406 provides early warning of pests that have unique audio signatures such as the Asian Giant Hornet as well as general environmental noise that may be used to detect intruders in the vicinity of the apiary. The rear facing audio classification sensor 407 data is analyzed to determine the health of the colony where both the frequency distribution and volume are used to develop a baseline and then compare current data to historical data for the hive at the same time of day and year. Deviations from the baseline are used to notify the beekeeper that a physical hive inspection may be necessary.
[0102] The load cell 408 data is used to determine the actual weight of the entire hive or the honey supers and may be monitored during the year.
[0103] A wireless interface 409 provides communication to either a central station (not shown) via LAN that allows management of multiple beehives, or via WAN that allows direct communication to the beekeeper.
[0104] Data and code are stored in local storage comprising volatile storage 410, non-volatile storage 411 and removable storage such as a Secure Digital (SD) card 412.
[0105] Physical input and output is controlled through a General Purpose Input Output (GPIO) Interface 413, coupled to apparatus control blocks comprising heat and ventilation control 414, kill zone drivers 415, air pump driver 416, LED lighting drivers 417, and door driver 418.
[0106] The heat and ventilation control 414 is used to maintain the beehive temperature and humidity within the correct levels, optimizing beehive productivity and survivability.
[0107] Kill zone drivers 415 deliver high voltage to each of the port kill mechanisms under control of algorithms executing on compute module A 401 and compute module B 402.
[0108] The air pump driver 416 controls the operation of an air pump used to extract air from the beehive for measurement by the temperature, humidity, and chemical sensors 404 and 405.
[0109] The LED lighting drivers 417, control LEDs providing interior illumination color and intensity for optimized image capture by the visual classification sensor 403. Active control is achieved using an embedded light sensor monitoring the interior light level.
[0110] The door driver 418 controls a stepper motor that opens and closes an internal door mechanism under control of algorithms executing on compute module A 401 and compute module B 402.
[0111] With reference now to
[0112] Additionally, the power source selector 509 provided automatic switching between external and internal sources which is then fed to a multi-output power regulator 510. The multi-output regulator provides regulated 3.3V and 5.0V power that is monitored for voltage level and current usage by the respective power monitors, 511 and 512. The 150V power output 513 provided high voltage to the kill zone drivers (
[0113] With reference now to
[0114] The main processing chain is comprised of main 603 and the send and receive interface 602. Main 603 is responsible for basic functions including boot, process startup, configuration, test, diagnostics and interface to the beekeeper via the send and receive interface 602. The receive and send interface 602 may be configured as a local area network (LAN) if a central station (not pictured) is present, or as a wide area network (WAN) if not present. The receive and send interface 602 relies on antenna 604 for signal transmission.
[0115] The video processing chain 605 is comprised of the get frame process 606, the detect movement process 607, the track insect process 608, the analyze insect 609, and the kill insect process 610. The get frame process 606 captures high speed data from the visual classification sensor hardware and loads each frame of data into memory, The detect movement process 607 compares frame to frame changes to detect movement within the visual classification sensor field of view. When movement is detected, the data is passed to the track insect process 608 which records the size, shape, and coloration of each object from frame to frame. After multiple frames of consistent data (size, shape and coloration) has been tracked, the object which represents an insect, is assigned a number and the data is passed to the analyze insect process 609 where it is characterized as a bee or not-a-bee. If the insect is characterized not-a-bee (based on size, shape and coloration), the data is passed to the kill insect process 610 which is responsible for timing the insect entry into the kill zone and applying the correct energy level to kill but not scatter the insect. If the insect is characterized as a bee, additional algorithms break the data into regions representing the dorsal and lateral views of the head, thorax, and abdominal segments of a bee. This data is then passed to algorithms to detect if varroa mites are present. If the algorithm does not detect varroa mites, the bee is allowed to pass through the kill zone unimpeded, however, if the algorithm detects one or more varroa, actions preset by the beekeeper are initiated. Possible actions include, [0116] 1. record total number of varroa mites detected and make available to beekeeper but allow bee enter the hive unimpeded, [0117] 2. record total number of varroa mites attempting to enter hive, make available to beekeeper and kill bee and varroa mite, and [0118] 3. simply kill bee and varroa mite.
[0119] The audio chain 611 comprises the get audio process 612, the process audio process 613, the analyze audio process 614, an the take actions process 615.
[0120] The get audio process 612 receives a pulse-density modulated (PDM) digital signal from the front and rear MEMS Audio classification sensors via digital serial communications interface (SCI) and passed to the process audio process 613 where it is demodulated into a usable digital data stream and stored in memory. The data stream is organized into blocks and the analyze audio process 614 is called which performs special audio processing including the fast Fourier transform (FFT) which transforms the data from time to frequency domain. The resulting data is sorted into a histogram that is used to analyze the distribution. This distribution may be used to detect certain flying predatory species like the Asian Giant Hornet which have a distinctive wing-beat noise. This distribution may also be useful identifying other predators including bears, skunks, anteaters, and other insectivorous. When a specific predatory species is detected, notification is passed to the take action process 615 which follows preset instructions. Possible actions include, [0121] 1. record total number and length of detection and make available to beekeeper, and [0122] 2. close hive using automated door mechanism and notify beekeeper [0123] 3. trigger external audible and visual alarms
[0124] With reference now to
[0125] With reference now to
[0126] The solar panel 801, replaces the beehive top (depicted in
[0127] The size (in ampere-hours) of the batteries 802 and 803 depicted are design dependent, i.e., how many hours is the apparatus required to operate with minimal sunlight, what are the heating and ventilation requirements in the beehive environment.
[0128] With reference now to
[0129] With reference now to
[0130] With reference now to
[0131] The beehive 1101 is also shown with apparatus 1102 mounted.
[0132] With reference now to
[0133] With reference now to
[0134] The outer cover 1301 prevents bees flying directly to the entrance as well as provides weather protection for all internal components. The solar panel 1302 provides charging for the internal emergency batteries that is independent of the external solar panels. The back case 1305 provides primary structural integrity and houses the electronics bay (not shown) covered by the electronics bay cover 1306. The visual classification sensor 1307 is mounted on the apparatus center line and provides high resolution video and static images to the classification software. The visual classification sensor mount 1308, which is mounted on cover 1306, provides a stable platform for the visual classification sensor 1307.
[0135] With reference now to
[0136] With reference now to
[0137] With reference now to
[0138] LED lighting board PCB 1608 mounts on the main PCB 1505 at a right angle to extend through the electronics bay cover (not shown) and includes both LED illumination and light level sensor. The light level sensor is monitored by the control computer and is used to set the light level, ensuring uniform intensity of the input port and lane structure 1602 for consistent insect classification.
[0139] Under control of the control computer, the air pump 1604 extracts air from the beehive, first passing through the chemical sensor sample chamber 1603, before entering the pump to avoid contamination. Outputs from the chemical sensor (not shown) are transmit to the control computer via SCI and fed to specialized AI algorithms that have been trained to recognize specific chemical signatures. These chemical signatures may include: American foulbrood (Paenibacillus larvae=Bacillus larvae), European foulbrood (Melissococcus pluton), Chalkbrood (Ascophaera apis), Sacbrood, fungus, and other bacteria, all of which emit specific, distinct odors.
[0140] The chemical sensor may also be trained to recognize the fragrance that the flowers impart to the nectar and pollen collected by foraging bees, aiding the beekeeper better manage the apiary.
[0141] Additionally, the sensor may be trained to recognize the odors imparted by other chemicals the foraging be comes in contact, including insecticides, herbicides and pesticides.
[0142] After testing, air pump 1604 reverses and floods the chemical sensor sample chamber 1603 with clean air for a specified time to ensure contamination is minimized.
[0143] With reference now to
[0144] With reference now to
[0145] Depicted are the port entrance bar 1801, six (6) entrance ports, door mechanism 1803, door drive point 1805, and six (6) ports 1804. In the open position, the door ports 1804 align with the entrance bar ports 1802 and allow entry and exit from the beehive. To close the door, the control computer turns on a stepper motor (not shown) to drive the door forward into the entrance bar approximately 8 mm, which completely misaligns the the door ports 1804 and entrance ports 1802. To reopen the door, the stepper motor reverses and pulls the door approximately 8 mm, again aligning the ports. The depiction of six ports is for example only, the actual number implemented in products may vary as required.
[0146] The door drive point 1805 is threaded, or has a captured threaded insert, to translates the stepper motor's rotary motion into linear motion to drive and pull the door open and closed.
[0147] With reference now to
[0148] The stepper motor comprising both motor and gear box that multiplies the torque of the motor substantially. The motor is engaged periodically by the control computer, moving the door less than a millimeter back and forth, to remove any propolis buildup that may hinder door movement. Door movement is also monitored by the control computer to ensure continuous operation. The door may be closed at the beekeepers option on an automated schedule at preset times such as dusk, and reopened at dawn. The beekeeper may also command the door closed for any activities that require bees remain in hive. Additionally, the door may be automatically closed in response to certain predatory species that would otherwise decimate the colony, such as the Asian Giant Hornet, skunks, or anteaters.
[0149] With reference now to
[0150] Prior to an insect entering the energized kill zone, the current limiting resistors 2004 and 2005 have no effect and the potential across the electrodes E1 2003, E2 2005, and E3 2007 are equal to the potential applied to inputs 2001 and 2002. An insect entering the kill zone will short electrodes E3 2007, E2 2005, and E1 2003 progressively, however, smaller insects will be killed as it shorts electrode E1 2003, where resistors 2004 and 2005 will limit the current, thereby reducing the energy available. This reduced energy will kill small insects without scattering the body parts.
[0151] Additionally, the control computer will analyze the energy necessary to kill each insect based on the insect classification and adjust the input duty cycle of the voltage applied to 2001 and 2002.
[0152] With reference now to
[0153] PCB 2101 comprises six (6) identical pattern, each forming the wired parts of the circuit schematic shown in
[0154] With reference now to
[0155] The lane structure form a barrier so the insects tend to walk in a single line path into the hive.
[0156] With reference now to
[0157] In order to inspect the lateral surfaces of the insects the inside face of each of the triangular lane structures 2305 are mirrored, reflecting a view of the lateral surfaces to the visual classification sensor. Each of these surfaces is manufactured at the proper angle to view the lateral surface without distortion, optimally, this would result in each mirror being slightly curved, however, an adequate approximation is a planar mirror that is easily and inexpensively manufactured. The mirrored surfaces may be implemented by any means that produces a distortion free image of the lateral surfaces to the visual classification sensor 2303, in the preferred embodiment, thin planar glass mirrors are attached to the lane structures which are manufactured at the correct angle.
[0158] Shown in the diagram is the apparatus base 2301, the back case 2302, visual classification sensor 2303, port entrance bar 2304, entrance ports and lane structures (mirrored) 2305 and the ray traces 2306.
[0159] With reference now to
[0160] With reference now to
[0161] With reference now to
[0162] With reference now to
[0163] With reference now to
[0164] With reference now to
[0165] With reference now to
[0166] With reference now to
[0167] With reference now to
[0168] With reference now to
[0169] With reference now to
[0170] With reference now to
[0171] Under control of the control computer, the air pump 3504 extracts air from the beehive, first passing through the chemical sensor sample chamber 3509, before entering the pump to avoid contamination. Outputs from the chemical sensor (not shown) mounted on PCB 3505 are transmit to the control computer via SCI and fed to specialized AI algorithms that have been trained to recognize specific chemical signatures. These chemical signatures may include: American foulbrood (Paenibacillus larvae=Bacillus larvae), European foulbrood (Melissococcus pluton), Chalkbrood (Ascophaera apis), Sacbrood, fungus, and other bacteria, all of which emit specific, distinct odors.
[0172] The chemical sensor may also be trained to recognize the fragrance that the flowers impart to the nectar and pollen collected by foraging bees, aiding the beekeeper better manage the apiary.
[0173] Additionally, the sensor may be trained to recognize the odors imparted by other chemicals the foraging be comes in contact, including insecticides, herbicides and pesticides.
[0174] After testing, air pump 3504 reverses and floods the chemical sensor sample chamber 3509 with clean air for a specified time to ensure contamination is minimized.
[0175] As those of ordinary skill in the art will understand a source of power must be provided for all embodiments of the present invention, usually comprising a battery with a solar energy recharging.
[0176] The descriptions of the present invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the invention in the form disclosed. The embodiment was chosen and described in order to best explain the principles of the invention, the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.