DETECTING FLUID FLOW
20210372832 · 2021-12-02
Assignee
Inventors
Cpc classification
G01F1/684
PHYSICS
G01F1/688
PHYSICS
International classification
G01F1/64
PHYSICS
G01F1/688
PHYSICS
Abstract
An apparatus (10) for detecting flow of a fluid (11) in a conduit (12) is disclosed. The apparatus comprises means (44) for inferring the flow of fluid based on a change in temperature of the conduit over time. The means for inferring the flow of fluid may comprise a neural network model. One or more other environmental parameters may be used in addition to temperature. The disclosed embodiments can allow an estimate of the flow of fluid in the conduit to be obtained using a low-cost, low-power and/or non-invasive device.
Claims
1-6. (canceled)
7. Apparatus according to claim 66, wherein the neural network model is pre-trained with data extracted from existing temperature sensors, together with actual flow data.
8. Apparatus according to 66, wherein the neural network model is one of a Recursive Neural Network and a long short-term memory neural network.
9. (canceled)
10. Apparatus according to claim 66, wherein the processor is arranged to execute a sliding window algorithm which slides over continuous temperature data and feeds slices of the data to the neural network model.
11. Apparatus according to claim 66, further comprising a sensor arranged to sense at least one other environmental parameter, wherein the neural network model is arranged to infer the rate of flow of fluid based further on the at least one other environmental parameter.
12. Apparatus according to claim 11, wherein the other environmental parameter is at least one of: ambient temperature; motion of the conduit; sound in the conduit; ambient temperature adjacent to the apparatus; vibration of the conduit; sound generated by, or within, the conduit; and electromagnetic radiation emitted by the conduit.
13. Apparatus according to claim 66, wherein the neural network model is arranged to infer the rate of flow of fluid based further on at least one parameter of the conduit.
14. Apparatus according to claim 13, wherein the parameter of the conduit is at least one of a resistivity of the conduit, a size of the conduit, a heat conductivity of the conduit, and a material from which the conduit is made.
15-26. (canceled)
27. Apparatus according to claim 66, further comprising at least one of: a resistivity sensor arranged to sense a resistivity of the conduit and a size determination unit arranged to determine a size of the conduit, wherein the neural network model is arranged to infer the flow of fluid based further on at least one of the sensed resistivity and the size of the conduit.
28-31. (canceled)
32. Apparatus according to claim 66, wherein the sensor device comprises a main body, and a connecting component for connecting the main body to the conduit.
33. Apparatus according to claim 32, wherein the main body is separable from the connecting component.
34. (canceled)
35. Apparatus according to claim 32, wherein the sensor device comprises a radiation sensor located in the main body, and a transfer tube arranged to transfer radiation from the conduit to the radiation sensor.
36. (canceled)
37. Apparatus according to claim 35, wherein the sensor device comprises a vibration sensor, and the transfer tube is arranged to transfer vibration from the conduit to the vibration sensor.
38-44. (canceled)
45. Apparatus according to claim 66, wherein the processor is provided in the sensor device, and the sensor device is in communication with a separate concentrator device.
46. Apparatus according to claim 66, wherein the processor is provided in a separate concentrator device in communication with the sensor device.
47-52. (canceled)
53. Apparatus according to claim 46, wherein the concentrator device is arranged to receive temperature data from a plurality of sensor devices, and to infer the flow of fluid in a plurality of conduits based on a change in the temperature data over time for each conduit.
54-57. (canceled)
58. Apparatus according to claim 66, wherein the neural network model is arranged to take a plurality of inputs, and from those inputs synthesize a sensor output.
59. (canceled)
60. Apparatus according to claim 66, wherein the conduit is a water pipe and the fluid is water.
61-62. (canceled)
63. A method of detecting flow of a fluid in a conduit, the method comprising sensing a temperature of the conduit using a temperature sensor; and using a neural network model executing on a processor to infer a rate of flow of the fluid in the conduit based on a change in a sensed temperature of the conduit over time.
64. (canceled)
65. A water flow detecting system arranged to detect water flow through a water pipe in a building, the system comprising: a sensor device arranged to be attached to the pipe, the sensor device comprising a temperature sensor arranged to sense a temperature of the pipe; and a processor executing a neural network model arranged to infer a rate of flow of water in the pipe based on a change in a sensed temperature of the pipe over time.
66. Apparatus arranged to detect flow of a fluid in a conduit, the apparatus comprising: a sensor device arranged to be attached to the conduit, the sensor device comprising a temperature sensor arranged to sense a temperature of the conduit; and a processor executing a neural network model, wherein the neural network model is arranged to infer a rate of flow of fluid in the conduit based on a change in a sensed temperature of the conduit over time.
Description
[0071] Preferred embodiments of the present invention will now be described, purely by way of example, with reference to the accompanying drawings, in which:
[0072]
[0073]
[0074]
[0075]
[0076]
[0077]
[0078]
[0079]
[0080]
[0081]
[0082]
[0083]
[0084]
[0085] Sensor information from the sensors 14, 16, 18, 20, 22 is passed to a processor 26. The processor 26 comprises a central processing unit (CPU) and associated memory, and is arranged to execute computer code in order perform functions such as determining fluid flow in the pipe.
[0086] Flow may be determined in the pipe by observing changes in the temperature of the pipe. For example, if a tap is turned on, water flowing in the pipe will cause a temperature change and this temperature change over time can be used to infer that water flow is occurring. In addition, a change in vibration or audio data may provide an additional indication that liquid is flowing.
[0087] The temperature sensor 14 may have an integrated ADC (analogue-to-digital converter) and may be connected to the processor 26 using a bus such as an I2C (Inter-Integrated Circuit) bus. A typical resolution would be 12-bit, and typical temperature resolution would be 0.0625° C. Temperature measurements need only be made when there is a change in temperature on the pipe. This processing may take place in the temperature sensor 14 itself.
[0088] To save power, the processor 26 may enter sleep mode when no data is received. The temperature sensor may wake up the processor 26 on temperature changes. When the processor 26 is alerted of a temperature change, the time at which the change occurred is recorded, together with the amount of change, and in this way a temperature gradient over time is constructed.
[0089] The accelerometer 16 is a low power, low-g acceleration sensor which may be connected to the processor 26 for example over an I2C bus. A typical resolution would be 0.98 mg, with a maximum frequency response of >8 Hz. To save power, the acceleration sensor 16 may wakeup the processor 26 when vibration of interest is detected.
[0090] The microphone 18 is a low-power MEMS (micro-electro-mechanical system) microphone. The microphone may be connected to the processor 26 for example on an 12S bus. A typical frequency response would be in the range of 20 Hz-20 KHz, with a typical sample rate of between 32 and 64 kHz and a precision of 16-bits. To save power, the processor 26 may wake up the microphone 18 only when temperature change or vibration change is detected. The samples may be applied to a Discrete Fourier transform (DFT) algorithm via a windowing function, for example a Hamming or Blackmann-Harris window. The audio data is thus distributed across a set of frequency bins which may be used to gain extra knowledge about the state of the liquid flow in the pipe.
[0091] The processor 26 may also have knowledge of the diameter of the pipe 12 on which the device 10 is fitted. For example, the diameter of the pipe may be pre-programmed into the processor, or may be programmed in when the device is installed, or may be set by a switch on the device, or may be detected by the device.
[0092] The processor 26 is connected to a user interface 28. The user interface 28 is arranged to provide information and/or warning signals to a user of the device. For example, the user interface 28 may provide a visual indication of whether fluid is flowing and/or the rate of fluid flow in the pipe, and/or a visual or audible alarm if certain flow conditions are exceeded or not met.
[0093] In the arrangement of
[0094] Processor 26 may also receive updates, for example from the concentrator 40 (see
[0095] Optionally a Peltier element 32 is used to harvest energy from the pipe 12. In this case the Peltier element 32 may be used to recharge a battery 34 which powers the device 10, and/or to power the device directly.
[0096] If desired, two or more temperature sensors may be provided in the sensor device 10 to sensor the temperature of the pipe 12. This may be done for a variety of reasons, for example: as a means of providing temperature sensor redundancy; to allow self-calibration by comparing the temperatures recorded by each temperature sensor; to allow the accuracy of the temperature reading to be improved by calculating the average temperature recorded by each temperature sensor; or to allow the accuracy of the calculation of flow to be improved by spacing the temperature sensors along the conduit and comparing the temperatures of each sensor over time.
[0097] The rate at which the pipe temperature changes over time is a function of the water temperature, ambient temperature, water flow, pipe conductivity and pipe diameter. It follows that the water flow is a function of pipe temperature changes over time, ambient temperature, pipe conductivity, and pipe diameter. All of these parameters are known to the processor 26, and thus the processor is able to use these parameters to infer water flow. This data may be optionally augmented with vibration and audio data.
[0098] The processor 26 may be able to infer water temperature based on historical temperature data. For example, if the temperature increases at a slow rate, hot water is flowing at a low rate or the water temperature is only slightly above ambient. However, if the water continues to flow the new pipe temperature will stabilize at the water temperature and when the flow ceases the pipe temperature will return to ambient. Thus the processor is able to infer that the water temperature is the temperature of the pipe when the temperature has stabilized following a period in which the temperature has increased. The processor may also take into account the heat conductivity of the pipe. This may be inferred from the resistivity of the pipe, which may indicate whether the pipe is metal or plastic.
[0099] In one embodiment, an algorithm on the processor 26 is used to infer fluid flow. This algorithm may take the form of a function programmed into the processor 26. The algorithm takes as inputs the pipe temperature, ambient temperature, water temperature, pipe conductivity (or resistivity) and pipe diameter, and outputs an estimate of rate of water flow. In another arrangement, the algorithm compares the temperature changes over time to predetermined patterns of temperature change for that particular pipe conductivity, pipe diameter and water temperature which are stored in memory, in order to infer rate of flow. In either case the processor may also augment the temperature data with vibration and/or audio data. For certain applications, a simple flow or no flow indication may be all that is required, but more precision may be obtained by more sophisticated algorithms.
[0100] Alternatively or in addition, the multiplicity of sensor information described above may be passed, by means of a low power radio link using wireless module 30, to another more powerful device or concentrator, which is capable of extracting the flow information for one or more sensor devices. In order to reduce the amount of traffic passed over the radio network and thus reduce power consumption, the sensor data from the sensor device may be compressed and sent in discrete blocks at intervals, for example every minute.
[0101]
[0102] The concentrator 40 may receive updates from the cloud service 48, including for example new neural network models, algorithms or operating code for the processor 44.
[0103] The concentrator 40 may also transmit flow data to the cloud service 48 using the wireless module 46. This service maintains a globally available record of the flow state of the sensors, which is maintained in a database 50. The database 50 can be queried at any location from a processing device 52, which may provide a graphical user interface (GUI). Optionally device 52, which may for example be a mobile device, may receive alerts indicating for example a leak detection or over/under temperature condition.
[0104] The processor 44 comprises a central processing unit (CPU) and associated memory, and is arranged to execute computer code in order to perform functions such as determining fluid flow in the pipe. In this embodiment the processor 44 may be a more powerful processor which is capable of running a more sophisticated sensor fusion algorithm than the processors in the individual sensor devices. The concentrator may use an explicit algorithm, for example as described above, in order to infer fluid flow. However, in a preferred embodiment, the processor 44 uses a trained deep recurrent neural network model in order to infer the flow of fluid in a pipe.
[0105] A neural network is a network of nodes organised in layers. In a multilayer feed-forward network, each layer of nodes receives inputs from the previous layers. The inputs to each node are combined using a weighted linear combination. The result is then modified by a nonlinear function before being output to the next layer. A backpropagation algorithm is used to calculate the weights in each layer. Neural networks are capable of identifying non-linear patterns, such as temperature change to flow mapping, where there is not a simple one-to-one relationship between the two. Rather, a neural network uncovers the pattern or function linking a number of inputs with a known output. In this case, the algorithm is in the form of hidden nodes within the neural network.
[0106] Convolutional neural networks (CNNs) are a class of deep, feed-forward artificial neural network. CNNs are biologically inspired models and have been used for image pattern recognition problems such as hand-written digit recognition and face recognition. They can also be applied to time-series data by use of a windowing mechanism and/or using a variation of the CNN known as a Recurrent Neural Network (RNN). The RNN is a neural network which has not only feedforward networks but also allows recurrent connections. In this way the network is able to refer to previous states and can therefore make use of previous inputs to model new outputs. Details of RNNs can be found in the document “Recurrent Neural Networks—Combination of RNN and CNN” by Lukas Wiest, https://wiki.turn.de/display/lfdv/Recurrent+Neural+Networks+-+Combination+of+RNN+and+CNN, the subject matter of which is incorporated herein by reference.
[0107] In one embodiment, the processor 44 may employ a Recursive Neural Network (RNN), or more specifically a Long Short-Term Memory (LSTM) network, which retains a knowledge of previous states of the sensors, in order to infer a flow value from current sensor values. In the latter case, the algorithm is in the form of hidden nodes within a neural network.
[0108] The RNN may be pre-trained by providing samples of a multiplicity of sensor data to a neural network together with corresponding flow data. The flow data may be obtained using for example an impeller or ultrasonic based flow sensor and gathered from a large body of test sites.
[0109]
[0110] In embodiments of the present invention the neural network model 36 is a RNN which has been pre-trained on data extracted from a large set of existing environmental sensors. The training process is performed in advance on a separate machine. In order to train the model, data is collected from environmental sensors together with actual flow data obtained from traditional invasive flow sensors. This allows the RNN to learn how the environmental data relates to the actual flow data, and thus generate a model. The model is trained over time such that the outputs of the model match the actual flow data as closely as possible. This training process is computationally intensive, but need only be performed once in order to generate the model. Once the model has been generated, it can be loaded onto other devices such as the processor 44 in the concentrator device 40, or alternatively the processor 26 in the flow sensor device 10. These models may be updated over the WAN and/or radio link 45.
[0111] In the present embodiment the environmental data is continuous, and is applied to a sliding window algorithm that slides over the extracted time series data and feeds slices of it to the RNN. The RNN detects flow from the environmental data slices using the pre-trained model.
[0112] The environmental data may be encoded, for example using the Fourier series, specifically time-frequency analysis which combines concepts of time and frequency domains. Short-time Fourier transforms (STFT) and Wigner-Vile distributions are known methods which could be used for this. These methods are used to handle non-stationary waveform signals or to inspect trend information over time.
[0113] The environmental data may also be encoded using a cryptographic algorithm to prevent unauthorised access to the environmental data
[0114] The neural network model runs on the (on premise) concentrator device to avoid issues of communication latency, Wide Area Network bandwidth constraints and other connectivity problems.
[0115] Furthermore, by employing low-power radio communication between the sensor device(s) and the concentrator device, flow can continue to be detected even when there is no available Internet- or local WiFi-connectivity.
[0116] The enablement of low-power radio communication in the concentrator device also provides the potential of communication with other devices utilising the same low-power radio technology. An example of this is a scenario where an unexpected flow of water is detected by the sensor device and the concentrator device, indicating a burst pipe or leak; which is then communicated to an actuated water isolation valve, which shares the same low-power radio network, to instruct the valve to close, preventing the further loss of water.
[0117]
[0118] An LSTM network, is a recurrent neural network that is trained using Backpropagation Through Time and overcomes the vanishing gradient problem because nodes are able to retain data internally in a gated cell. Relative insensitivity to time lags of unknown size and bound between important events typical in time series data gives an advantage to LSTM over alternative RNNs, hidden Markov models and other sequence learning methods. Details of LSTM networks may be found in the document “Long Short-term Memory” by Hochreiter and Schmidhuber, Neural Computation, 9(8):1735-1780, 1997, the subject matter of which is incorporated herein by reference.
[0119] The LSTM may be trained by providing samples of a multiplicity of sensor time-series data to the neural network together with corresponding flow time-series data. The flow data may be obtained using for example an impeller or ultrasonic based flow sensor and gathered from a large body of test sites.
[0120] LSTMs are sensitive to the scale of the input data, specifically when the sigmoid or tanh activation functions are used. For this reason the data is normalized in the range of 0-to-1.
[0121] With time series data, the sequence of input values is important, so the sample data from test sites is split into an ordered dataset of train and test datasets, for example in the range 66% training data, 33% test data. The time-series data may become very large, and so is fed into the LSTM in chunks, the size of which is determined by the typical temperature gradient curves (see
[0122] The number of hidden layer nodes is carefully selected to avoid underfitting or overfitting which causes loss of generality in the neural network output node. Depending on the training data used, three hidden layers has been found to be a minimum.
[0123] The trained model is run on the concentrator processor 44, which is provided with sufficient memory and resources to service a multiplicity of flow sensor nodes 10.sub.1, 10.sub.2.
[0124] In the arrangement shown in
[0125] One possible implementation is that the processor 26 may measure steady-state pipe temperature using the temperature sensor 14. The processor 26 then enters sleep mode and awaits a wakeup signal from the temperature sensor 14 which is generated when the temperature varies from the steady-state.
[0126]
[0127] By measuring the rate of change of temperature with respect to time, together with measurements of the current pipe and ambient temperatures, a measurement of the relative flow may be deduced by processor 26. Alternatively, the processor 26 may use a neural network model such as that described above in order to infer the flow of fluid in the pipe.
[0128] The system may alert or inform a user directly by means of a warning device, such as an audible alarm, or by connection to another device by means of a radio network using transmitter module 30.
[0129] Since pipe temperature is being measured, the same system is also able to provide freeze or over temperature warnings using the above-mentioned mechanism.
[0130] The same system may also be used to provide occupancy alerting based on water usage patterns.
[0131]
[0132] In
[0133]
[0134] The main body 61 of the sensor device includes an interface portion 66 which is used to connect the main body to the clip component 62. The interface portion 66 includes a flat annular surface 67, and a crown of attachment barbs 68. When the main body 61 and the clip component 62 are brought together, the attachment barbs 68 engage with a corresponding annular lip on the underside of the base portion 65 of the clip component 62. This can allow the main body 61 to rotate freely about the clip component 62. The main body 61 may be made from plastic or any other suitable material.
[0135] In the arrangement shown in
[0136] Still referring to
[0137]
[0138] The main body 61 of the sensor device 60 includes an infrared electromagnetic radiation sensor 72 and an accelerometer 73. The infrared electromagnetic radiation sensor 72 may be, for example, a photodetector with a p-n junction that converts infrared radiation into current. The radiation sensor 72 and the accelerometer 73 are both in contact with the transfer tube 70. The transfer tube 70 provides a direct mechanical connection between the conduit 12 and the accelerometer 73, enabling the transmission of vibration from the conduit 12 to the accelerometer 73. Furthermore, the inside of the transfer tube 70 enables the transmission of infrared electromagnetic radiation 74 from the conduit 12 to the infrared electromagnetic radiation sensor 72.
[0139] Still referring to
[0140] Also mounted on the printed circuit board 75 are a processor 76, an ambient temperature sensor 77, and a low power sub-GHz radio module 78. The processor 76 is arranged to execute computer code in order perform functions such as pre-processing of the sensor data, or determining fluid flow in the conduit 12. The ambient temperature sensor 77 measures the temperature of the surroundings. The radio module 78 provides a means of communicating with a concentrator device, and is attached to a high-gain antenna 79 enabling the transmission and reception of sub-GHz radio signals. An energy source, for example a battery 80, is contained within a battery chamber 81 accessible via battery chamber cover 63. The various components of the main body 61 are accommodated within a housing 82.
[0141]
[0142] In the arrangement of
[0143] Each clip component 62 may confer information about the pipe, such as pipe diameter and/or pipe material, to the processor 76 in the main body 61 through a communication mechanism. For example, passive Near Field Communication (NFC) tags may be embedded in the clip component 62, which can be read by an NFC device within the main body 61. Alternatively, a series of depressions and ridges could be provided in the clip components at the interface with the main body. In another example, the clip components may have different colours depending on the type of conduit with which they are to be used, and the main body may be arranged to identify the colour using a simple optical reader. This information may be used in inferring fluid flow. Other possible ways for conferring information will be apparent to the skilled person.
[0144] In the arrangement of
[0145]
[0146] The concentrator device 40 runs a neural network model in order to infer the flow of fluid in each of the pipes to which the sensor devices 60 are attached. In the present embodiment, the neural network model takes a plurality of disparate sensor inputs, such as conduit temperature, vibration, sound, electromagnetic radiation, resistivity, self-capacitance, conduit diameter, ambient temperature; and from those inputs synthesises a sensor output, in this case being a measure of fluid flow. This ‘virtual sensor’ reading is sent to the cloud 48 (see
[0147] In this arrangement, the neural network model used to infer fluid flow is implemented in the local concentrator device 40, rather than in the cloud. The local neural network's function is distinct from a cloud-based solution in that it: [0148] a) is an inherent and inseparable part of the flow sensor function, but for cost and power reasons is not part of the sensor device; [0149] b) takes a number of sensor inputs and synthesises a different type of sensor output (for example, inferring fluid flow from both temperature and vibration); it is this ‘virtual sensor’ reading that is sent to the cloud; [0150] c) runs on the gateway/concentrator to avoid issues of latency, bandwidth and connectivity; this can allow it, for example, to detect flow when there is no Internet connectivity.
[0151] The existence of a local neural network does not however preclude the transfer of the raw environmental data to the cloud where it can be used improve trained models over time.
[0152] Whilst embodiments of the present invention have been described in relation to the flow of water in a pipe, the invention can be applied to any fluids flowing in any conduits. For example, the invention may be used to measure the flow of liquids such as oil or coolant. Whilst the invention has particular application in buildings, it may be used in any environment where it is desired to determine the flow of fluid through a conduit.