LIVESTOCK AND POULTRY BODY TEMPERATURE MONITORING SYSTEM AND METHOD USING WEARABLE SENSOR AND INFRARED CAMERA

Abstract

The invention discloses a livestock and poultry body temperature monitoring system and method in which a wearable sensor and an infrared camera cooperate. Different breeding region blocks are disposed in a three-dimensional space of a livestock and poultry house, wherein each of the breeding region blocks has a plurality of livestock and poultry individuals, all of the plurality of livestock and poultry individuals in each of the breeding region blocks randomly wear the wearable temperature sensors in a fixed proportion to form sentinel livestock and poultry individuals, the infrared camera obtains group infrared image in an unit of the breeding region blocks, the communication terminal is disposed in the livestock and poultry house, the wearable temperature sensors and the infrared camera are in communication connection with the local server through the communication terminal and the local server is in communication connection with the client through the cloud server.

Claims

1. A livestock and poultry body temperature monitoring system in which a wearable sensor and an infrared camera cooperate, comprising a plurality of wearable temperature sensors, an infrared camera, a communication terminal, a local server, a cloud server and a client; a livestock and poultry house in which different breeding region blocks are disposed within its own three-dimensional space, wherein each of the breeding region blocks has a plurality of livestock and poultry individuals, all of the plurality of livestock and poultry individuals in each of the breeding region blocks randomly wear the wearable temperature sensors in a fixed proportion to form sentinel livestock and poultry individuals, the infrared camera obtains group infrared image in an unit of the breeding region blocks, the communication terminal is disposed in the livestock and poultry house, the wearable temperature sensors and the infrared camera are in communication connection with the local server through the communication terminal and the local server is in communication connection with the client through the cloud server.

2. The livestock and poultry body temperature monitoring system in which the wearable sensor and the infrared camera cooperate as claimed in claim 1, wherein the infrared camera performs patrol inspection between the breeding region blocks in the livestock and poultry house along a preset infrared camera patrol inspection route.

3. The livestock and poultry body temperature monitoring system in which the wearable sensor and the infrared camera cooperate as claimed in claim 1, wherein each of the wearable temperature sensors has a battery voltage collecting circuit and a wireless communication module for battery replacing notification, and collected data is transmitted to the communication terminal 7 through wireless data transmission protocol.

4. The livestock and poultry body temperature monitoring system in which the wearable sensor and the infrared camera cooperate as claimed in claim 1, wherein the method comprises following steps: S1: data obtaining obtaining continuous body temperature data of an appropriate number of the sentinel livestock and poultry individuals in the breeding region blocks through the wearable temperature sensors, and collecting location of the breeding area blocks and infrared thermal images of all of the livestock and poultry individuals in each of the breeding area blocks through patrol inspection of the infrared cameras; S2: data transmission and preprocessing the communication terminal transmitting the continuous body temperature data and infrared thermal imaging data collected in step S1 to the local server, the local server respectively performing screening and image segmentation preprocessing on the data to obtain a body temperature value, and the body temperature value after preprocessed is used for processing to obtain a body temperature monitoring curve of each of the livestock and poultry individuals changing over time; S3: database building and model training building a growth stage-temperature database by using the body temperature monitoring curve changing over time which is obtained in step S2 under different breeds, different growth stages and different monitoring manners, and obtaining a normal body temperature change zone through processing the growth stage-temperature database; S4: state determination and data review determining whether the temperature state is abnormal or not by using timing match and outlier identification to the temperature values collected in real time combining with the normal temperature change zone, and determining the breeding region blocks where the livestock and poultry with the abnormal temperature state are located as an abnormal region, and moving the infrared camera to the abnormal area for rechecking to realize complete monitoring.

5. The livestock and poultry body temperature monitoring system in which the wearable sensor and the infrared camera cooperate as claimed in claim 4, wherein the step S2 is: comparing the continuous temperature data collected by the wearable temperature sensors with a fluctuation range threshold to determine an abnormal value, removing the abnormal value appearing as an individual but retaining the abnormal value appearing continuously, and retaining each of the temperature values that is obtained as the body temperature values of the livestock and poultry individuals; for the infrared thermal image collected by the infrared camera, performing instance segmentation on the infrared thermal image of each of the breeding region blocks by using a deep learning method to identify each of the livestock and poultry individuals, renumbering each of the livestock and poultry individuals in the breeding region blocks, and retrieving key pixel points and temperature information thereof in the image where each of the livestock and poultry individuals is located as the body temperature values of the livestock and poultry individuals; the body temperature values T.sub.s and T.sub.c directly monitored by the wearable temperature sensors and the infrared camera being respectively processed according to the following formula to obtain core body temperature values T.sub.sc and T.sub.cc, the formula is as follows: $T_{\mathrm{sc}}=a_s{T}_s+b_s{T}_{\mathrm{cc}}=a_c{T}_c+b_c$ wherein a.sub.s, b.sub.s are respectively a weight and a correction constant of the wearable temperature sensors, a.sub.c, b.sub.c are respectively the weight and a correction constant of the infrared camera.

6. The livestock and poultry body temperature monitoring system in which the wearable sensor and the infrared camera cooperate as claimed in claim 4, wherein step S3 comprises the following steps: under conditions of different breeds, different growth stages and different monitoring manners, collecting the body temperature values through the wearable temperature sensors and the infrared camera, and building the normal body temperature change zone at different growth stages under the same breeds and various monitoring manners.

7. The livestock and poultry body temperature monitoring system in which the wearable sensor and the infrared camera cooperate as claimed in claim 4, wherein in step S4, the abnormality determination comprises two steps: Step 1: comparing the temperature value collected in real time with the normal body temperature change zone, and determining whether the temperature value falls into the normal body temperature change zone: if not, a body temperature state of a livestock and poultry corresponding to the temperature value is abnormal, and step 2 is performed; if so, the body temperature state of the livestock and poultry corresponding to the temperature value is not abnormal, and step 3 is performed; Step 2: comparing the temperature value with a range [3, +3] determined by the following formula: $=\frac{{.Math.}_{i=1}^n{T}_{\mathrm{cci}}}{n}=\sqrt{\frac{{.Math.}_{i=1}^n{\left(T_{\mathrm{cci}}-\right)}^2}{n-1}}$ Wherein is an average value of a group temperature, is a standard deviation of the group temperature, T.sub.cci is the body temperature values of the group monitored by the wearable temperature sensors and the infrared camera, and n is the number of the group; the group is divided into two conditions of all of the livestock and poultry individuals in a single breeding region block and all of the livestock and poultry individuals in all of the breeding region blocks, comparison and determining are respectively performed between the temperature values of the livestock and poultry individuals and the group formed by all of the livestock and poultry individuals in the single breeding region block, and between the temperature values of the livestock and poultry individuals and the group formed by all of the livestock and poultry individuals in all of the breeding region blocks: if the temperature value is within the range [3, +3], the body temperature state of the livestock and poultry corresponding to the temperature value is not abnormal; if the temperature value is not within the range [3, +3], the body temperature state of the livestock and poultry corresponding to the temperature value is abnormal; Step 3: selecting the livestock and poultry with abnormal body temperature state, moving the infrared camera to the breeding region block where the livestock and poultry with the abnormal body temperature state are located, rechecking the livestock and poultry, and further monitoring the abnormal condition.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0047] FIG. 1 is a process flow according to an embodiment of the present invention.

[0048] FIG. 2 is a schematic structural view of the system according to the embodiment of the present invention.

[0049] FIG. 3 is a schematic diagram of the comprehensive body temperature assessment workflow according to the embodiment of the present invention.

[0050] FIG. 4 is a comparison diagram between the embodiment of the present invention and the traditional body temperature monitoring method.

DESCRIPTION OF THE EMBODIMENTS

[0051] The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

[0052] As shown in FIG. 2, the system includes a plurality of wearable temperature sensors 6, an infrared camera 3, a communication terminal 7, a local server 8, a cloud server 9 and a client 10;

[0053] A livestock and poultry house is configured with different breeding region blocks 4 within its own three-dimensional space, wherein each of the breeding region blocks 4 has a plurality of livestock and poultry individuals 5, all of the plurality of livestock and poultry individuals in each of the breeding region blocks 4 randomly wear the wearable temperature sensors 6 in a fixed proportion to form sentinel livestock and poultry individuals, the infrared camera 3 obtains group infrared image in an unit of the breeding region blocks, the communication terminal 7 is disposed in the livestock and poultry house 1, the wearable temperature sensors (6) and the infrared camera 3 are in communication connection with the local server (8) through the communication terminal 7 and the local server 8 is in communication connection with the client 10 through the cloud server 9.

[0054] The infrared camera 3 performs patrol inspection between the breeding region blocks 4 in the livestock and poultry house 1 along a preset infrared camera patrol inspection route 2.

[0055] The data collected by the wearable temperature sensors 6 and the infrared camera 3 are uploaded to the local server 8. The local server 8 or cloud server 9 performs preprocessing on the data and then enters a normal body temperature change zone to perform state determination of livestock and poultry body temperatures, quickly locates the breeding region block where the livestock and poultry with abnormal body temperature is, and then the infrared camera 3 is configured to photograph and review the breeding region block where the livestock and poultry with abnormal body temperature is to complete the monitoring.

[0056] After review, the body temperature health status of individuals and groups can be comprehensively assessed based on temperature data, and the results and warning information are transmitted to the user through client 10.

[0057] The livestock and poultry house is divided into a specific number of breeding region blocks according to the three-dimensional space structure. Each of the breeding region blocks corresponds to a specific serial number. The specific number of the livestock and poultry individuals in each of the breeding region blocks is defined as sentinel livestock and poultry individuals, the sentinel livestock and poultry individuals wear wearable temperature sensors to continuously monitor individual body temperature changes, directly and indirectly reflect group state, and provides functions of body temperature monitoring and early warning in the region.

[0058] The infrared patrol inspection camera moves in the livestock and poultry house along the preset slide rails or tracks in the livestock and poultry house, and takes at least one thermal image of each of the breeding region blocks to collect the body temperature data of the livestock and poultry. The image information also includes positioning data of the breeding region blocks and timing information.

[0059] The wearable temperature sensor 5 has a battery voltage collecting circuit and a wireless communication module for battery replacement notification. The collected data is transmitted to the communication terminal 7 through the wireless data transmission protocol.

[0060] The wearable temperature sensor 5 is coin-shaped and adopts a modular design. It can incorporate with customized accessories such as silica gel strap, silica gel earrings and stably wear at a position that can be used to stably characterize the body temperature of the individual, including but not limited to the underwings of chickens, ears of pigs, etc.

[0061] The wearable temperature sensors 5 continuously collects data. Sampling frequency can be set according to actual needs. The collected information includes timing characteristics and location information. The data collected by the infrared camera 3 includes regional information and corresponds to the timing characteristics of the data collected by the wearable temperature sensors 5.

[0062] The wearable temperature sensor monitors 24 hours a day at a certain sampling frequency, and the sampling data also includes timing characteristics and location information; the wearable temperature sensor is an additional accessory worn on the corresponding livestock and poultry at a position that can be used to stably characterize the body temperature of the individual, including but not limited to the underwings of chickens, ears of pigs, etc.; [0063] Preset the track for the patrol inspection infrared camera in the livestock and poultry house, set patrol inspection program of the patrol inspection infrared camera according to the previously divided regions, stay in the corresponding area during the patrol inspection, and take more than one infrared thermal image that meets the requirements in the region, wherein the shooting angle reduces blocking as possible; [0064] The wearable temperature sensor and infrared camera transmit the collected data to the communication terminal through the wireless data transmission protocol. The data contains timing characteristics and location information. The communication terminal uploads the data to the server at a certain time frequency; the collected data can be processed by a locally deployed server or directly uploaded to the cloud server for processing. It can be flexibly arranged according to the actual situation.

[0065] When the system is actually deployed, the local servers and the cloud servers can be flexibly arranged to facilitate localized processing and offline processing, and solutions can be flexibly selected to improve computing efficiency and reduce costs. When the local server 8 has sufficient computing power, the collected data can be processed directly offline. Otherwise, the data can also be processed directly on the cloud server 9.

[0066] When the system is actually applied, based on the temperature sensor, the infrared camera and multi-source temperature data, after preprocessing, abnormal individuals are tracked based on two abnormal determination methods, and the infrared camera data is used for verification, and the comprehensive expert system further diagnoses the abnormal objects and feeds them back to user;

[0067] The system can continuously optimize the body temperature model based on the collected data during actual application to improve the stability of the system.

[0068] The implementation process of the present invention is as follows: [0069] S1: data obtaining

[0070] The continuous high-precision body temperature data of an appropriate number of sentinel livestock and poultry individuals in the breeding region block 4 are obtained respectively through the wearable temperature sensors 6, and the infrared thermal image and infrared thermal image of all of the livestock and poultry individuals in each of the breeding region block 4 are collected through patrol inspection of the infrared camera 3, so that infrared thermal imaging data and positioning data of more livestock and poultry are covered; [0071] S2: data transmission and preprocessing

[0072] The communication terminal 7 respectively transmits the continuous body temperature data and infrared thermal imaging data collected in step S1 to the local server 8. The local server 8 performs screening and preprocessing of image segmentation on the data to obtain the body temperature value. The image segmentation specifically comprises the segmentation of the heads of the livestock and poultry, and the body temperature monitoring curves of each of the livestock and poultry individuals, which change over time, are obtained by processing the preprocessed body temperature values. [0073] S3: database building and model training

[0074] A growth stage-temperature database is built by using the body temperature monitoring curve changing over time which is obtained in step S2 under different breeds, different growth stages and different monitoring manners, and a normal body temperature change zone is obtained through processing the growth stage-temperature database; [0075] S4: state determination and data review

[0076] Whether the temperature state is abnormal or not is determined by using timing match and outlier identification to the temperature values collected in real time combining with the normal temperature change zone, and the breeding region blocks 4 where the livestock and poultry with the abnormal temperature state are located is determined as an abnormal region, and the infrared camera 3 is moved to the abnormal area for rechecking to realize complete monitoring.

[0077] Finally, the temperature data can be integrated to provide assessment and feedback on the group body temperature and health state of each of the breeding region blocks of the livestock and poultry house.

[0078] Step S2 is: comparing the continuous temperature data collected by the wearable temperature sensors with a fluctuation range threshold to determine an abnormal value, removing the abnormal value appearing as an individual but retaining the abnormal value appearing continuously, and retaining each of the temperature values that is obtained as the body temperature values of the livestock and poultry individuals; the retaining of the abnormal values which appear continuously means that the abnormal values appear continuously for more than 5 times or more than 15 min.

[0079] For the infrared thermal image collected by the infrared camera, instance segmentation is performed on the infrared thermal image of each of the breeding region blocks by using a deep learning method to identify each of the livestock and poultry individuals, each of the livestock and poultry individuals in the breeding region blocks are renumbered, and key pixel points and temperature information thereof in the image where each of the livestock and poultry individuals is located are retrieved as the body temperature values of the livestock and poultry individuals;

[0080] The body temperature values T.sub.s and T.sub.c directly monitored by the wearable temperature sensor and the infrared camera are respectively processed according to the following formula to obtain core body temperature values T.sub.sc and T.sub.cc, the formula is as follows:

[00003]$T_{\mathrm{sc}}=a_s{T}_s+b_s{T}_{\mathrm{cc}}=a_c{T}_c+b_c$

[0081] wherein a.sub.s, b.sub.s are respectively a weight and a correction constant of the wearable temperature sensors, a.sub.c, be are respectively the weight and a correction constant of the infrared camera. The values of a and b are preset according to the monitored object and the monitoring mode.

[0082] Step S3 is: under conditions of different breeds, different growth stages and different monitoring manners, the body temperature values are collected through the wearable temperature sensors 6 and the infrared camera 3, and the normal body temperature change zone is built at different growth stages under the same breeds and various monitoring manners, and the normal body temperature change zone includes an upper curve and a lower curve and serve as a model of body temperature changing over time.

[0083] specifically is: [0084] Step 1: comparing the temperature value collected in real time with the normal body temperature change zone, and determining whether the temperature value falls into the normal body temperature change zone: [0085] if not, a body temperature state of a livestock and poultry corresponding to the temperature value is abnormal, and step 2 is performed; [0086] if so, the body temperature state of the livestock and poultry corresponding to the temperature value is not abnormal, and step 3 is performed; [0087] Step 2: comparing the temperature value with a range [3, +3] determined by the following formula:

[00004]$=\frac{{.Math.}_{i=1}^n{T}_{\mathrm{cci}}}{n}=\sqrt{\frac{{.Math.}_{i=1}^n{\left(T_{\mathrm{cci}}-\right)}^2}{n-1}}$

[0088] Wherein is an average value of a group temperature, is a standard deviation of the group temperature, T.sub.cci is the body temperature values of the group monitored by the wearable temperature sensors and the infrared camera, and n is the number of the group; [0089] The group is divided into two conditions of all of the livestock and poultry individuals in a single breeding region block and all of the livestock and poultry individuals in all of the breeding region blocks, comparison and determining are respectively performed between the temperature values of the livestock and poultry individuals and the group formed by all of the livestock and poultry individuals in the single breeding region block, and between the temperature values of the livestock and poultry individuals and the group formed by all of the livestock and poultry individuals in all of the breeding region blocks according to the range [3, 3]. [0090] if the temperature value is within the range [3, +3], the body temperature state of the livestock and poultry corresponding to the temperature value is not abnormal; [0091] if the temperature value is not within the range [3, +3], the body temperature state of the livestock and poultry corresponding to the temperature value is abnormal;

[0092] As shown in the embodiment in FIG. 4, compared with the traditional body temperature monitoring method of setting a fixed threshold, this method can determine abnormal individuals at least 10 hours in advance.

[0093] Step 3: selecting the livestock and poultry with abnormal body temperature state, moving the infrared camera to the breeding region block 4 where the livestock and poultry with the abnormal body temperature state are located, rechecking the livestock and poultry, and further monitoring the abnormal condition.

[0094] It can be seen that the present invention sets up a breeding region block and sentinel livestock and poultry individuals, uses two methods to monitor and evaluate the body temperature state of livestock and poultry individuals and groups, can stably characterize and monitor their core temperature, and helps to quickly positioning and analysis of group status; the method of body temperature monitoring and abnormality determination is optimized, timing features are introduced, and a model of body temperature changing over time of growth stage-temperature is built. At the same time, a big data-based outlier abnormality determination method is proposed, which can effectively lock in possible abnormal individuals; multi-source data collection and infrared camera review can obtain more stable and accurate body temperature data, greatly reducing the possibility of system misjudgment; real-time body temperature monitoring can provide timely understanding of livestock and poultry abnormalities and early prevention to avoid large-scale losses.