APPARATUS, SYSTEM, AND METHOD FOR PROVIDING INCREASED DETECTION ACCURACY
20230316797 · 2023-10-05
Assignee
Inventors
- Goran Stojcevski (Malmo, SE)
- Peter Sven Anders Lindgren (Bunkeflostrand, SE)
- Pierre François Veuillet (Voiron, FR)
Cpc classification
H04N7/188
ELECTRICITY
G06V20/52
PHYSICS
International classification
G06V40/10
PHYSICS
H04N7/18
ELECTRICITY
G06V20/52
PHYSICS
Abstract
Apparatuses, systems, and methods are described for providing increased detection accuracy. A system for may include a management system, a network, and a sensor device. The sensor device may include a first sensor which captures baseline data and current data associated with the space, a second sensor which detects motion within the space, and a processor which causes the first sensor to capture the baseline data based at least in part upon a predetermined time period having elapsed since detected motion by the second sensor, and further configured to cause the second sensor to capture the current data and perform a comparison operation on the current data and the baseline data.
Claims
1. A sensor device for monitoring a space, comprising: a first sensor configured to capture baseline data and current data associated with the space; a second sensor configured to detect motion within the space; and a processor configured to cause the first sensor to capture the baseline data based at least in part upon a predetermined time period having elapsed since detected motion by the second sensor, the processor further configured to cause the second sensor to capture the current data and to perform a comparison operation on the current data and the baseline data.
2. The sensor device of claim 1, wherein the first sensor is a thermal imager.
3. The sensor device of claim 1, wherein the second sensor is a Passive Infrared (PIR) sensor.
4. The sensor device of claim 1, wherein the first sensor is a thermal imager and the second sensor is a PIR sensor.
5. The sensor device of claim 1, wherein the comparison operation is configured to perform people counting to determine a number of people within the space.
6. The sensor device of claim 1, wherein the comparison operation includes comparing a reference background image as the baseline data to the current data.
7. The sensor device of claim 6, wherein the reference background image is a baseline background thermal image captured by the first sensor, and wherein the second sensor is a Passive Infrared (PIR) sensor.
8. A system for monitoring a space, comprising: a management system; a network; and a sensor device, comprising: a first sensor configured to capture baseline data and current data associated with the space; a second sensor configured to detect motion within the space; and a processor configured to cause the first sensor to capture the baseline data based at least in part upon a predetermined time period having elapsed since detected motion by the second sensor, the processor further configured to cause the second sensor to capture the current data and to perform a comparison operation on the current data and the baseline data.
9. The system of claim 8, wherein the first sensor is a thermal imager.
10. The system of claim 8, wherein the second sensor is a Passive Infrared (PIR) sensor.
11. The system of claim 8, wherein the first sensor is a thermal imager and the second sensor is a PIR sensor.
12. The system of claim 8, wherein the comparison operation is configured to perform people counting to determine a number of people within the space.
13. The system of claim 8, wherein the comparison operation includes comparing a reference background image as the baseline data to the current data.
14. The system of claim 13, wherein the reference background image is a baseline background thermal image captured by the first sensor, and wherein the second sensor is a Passive Infrared (PIR) sensor.
15. A method for providing improved people counting, comprising: obtaining baseline data relating to a space; selectively replacing the baseline data with new baseline data based at least in part upon a parameter of the space; obtaining current data relating to the space; comparing the current data to the baseline data; and determining a number of people within the space based at least in part upon the comparison between the current data to the baseline data.
16. The method of claim 15, further comprising: performing one or more of a correction or a stabilization operation on the current data.
17. The method of claim 15, wherein the comparing the current data to the baseline data includes comparing a baseline background thermal image to the current data.
18. A non-transitory computer-readable storage medium having stored thereon sequences of instructions which when executed by a processor cause the processor to: obtain baseline data relating to a space; selectively replace the baseline data with new baseline data based at least in part upon a parameter of the space; obtain current data relating to the space; compare the current data to the baseline data; and determine a number of people within the space based at least in part upon the comparison between the current data to the baseline data.
19. The non-transitory computer-readable storage medium of claim 18, further comprising causing the processor to: perform one or more of a correction or a stabilization operation on the current data.
20. The non-transitory computer-readable storage medium of claim 18 wherein the comparing the current data to the baseline data includes comparing a baseline background thermal image to the current data.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027] A more detailed description of the disclosure, briefly summarized above, may be had by reference to various embodiments, some of which are illustrated in the appended drawings. While the appended drawings illustrate select embodiments of this disclosure, these drawings are not to be considered limiting of its scope, for the disclosure may admit to other equally effective embodiments.
[0028] Identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. However, elements disclosed in one embodiment may be beneficially utilized on other embodiments without specific recitation.
DETAILED DESCRIPTION
[0029]
[0030]
[0031] The communication module 210 may provide at least one wired and/or wireless interface for transmitting data or information from the sensor device 100 and/or for receiving data or information at the sensor device 100. The communication module 210 may be configured to communicate via at least one communication network, such as network 310 described herein with reference to
[0032] In an example embodiment, the first sensor 130 is a thermal imager. The thermal imager is configured to capture a thermal image profile of a space associated with the sensor device 100. A baseline thermal image (e.g., a thermal background profile or baseline data) may be generated by the thermal imager and may be selectively stored at the storage 230. Additionally or alternatively, the thermal background profile, representation thereof, or parameter associated therewith may be transmitted from the sensor device 100 via the communication module 210 (for example, to one or more external device(s) 320 as described herein with reference to
[0033] The second sensor 150 may be a sensor configured to detect motion within a space associated with the sensor device 100. The second sensor 150 may be, for example but not limited to, a Passive Infrared (PIR) sensor, a radar sensor, a Time of Flight sensor, or any other sensor or sensing element configured to detect motion within the space associated with the sensor device 100 or to provide information capable of use in detecting motion within the space associated with the sensor device 100. The sensor device 100 may be configured to obtain a current thermal image (e.g., current data) via the first sensor 130. The current thermal image may be obtained at a periodic time and/or at a dynamically determined time. In various embodiments, the new baseline thermal image may be obtained after a predetermined time has lapsed since motion was detected within the space by the second sensor 150. The predetermined time may include for example, a time of two minutes, five, minutes, or ten minutes, although longer or shorter periods of time may be used without departing from the spirit and scope of the present disclosure. The predetermined time may be selected, for example, based upon at least one operational characteristic of one or more of the sensor device 100 and/or the space. For example, the predetermined time may be determined based at least upon a size of the space, an activity level of the space, a lighting or heat parameter associated with the space, or any other factor(s). The current thermal image may be stored at the storage 230 of the sensor device 100.
[0034] The sensor device 100 may be configured to obtain a current thermal image of the space at a predetermined time. The predetermined time may be two minutes in an example embodiment, although any period of time may be used consistent with the present disclosure. The current thermal image may be compared against the baseline thermal image to perform at least one operation (for example, using the processor 220). The at least one operation may include a people counting operation configured to determine the number of people currently within the space. An example of a people counting operation associated with a sensor device 100 is illustrated and described herein with reference to
[0035] The communication module 210 may be configured to transmit at least one set of information relating to a current people count, for example via the network 310. The at least one set of information may include, but is not limited to, the current thermal image, a parameter of the current thermal image, the baseline thermal image, a parameter of the baseline thermal image, a people count number, coordinate information relating to one or more of the current thermal image and/or baseline thermal image, and/or any other data or information associated with the sensor device 100, the current thermal image, and/or the baseline thermal image. The transmitted at least one set of information may be obtained by an external device 320, selectively associated with a management system. Before taking a background image the application can make sure that no people are present in the area by using the PIR function.
[0036]
[0037] The network 310 may include one or more wired and/or wireless communication mediums communicatively coupleable to one or more of the sensor devices 100A, 100B, . . . , 100N, and optionally to one or more external devices 320A, 320B, . . . , 320N. The one or more external devices 320A, 320B, . . . , 320N may be any electronic device capable of communicating with the network 310 and configured to perform at least one operation, store one or more sets of data or information, or to assist in the performance and/or storage of one or more sets of data or information used by or useable by one or more of the sensor devices 100A, 100B, . . . , 100N. The one or more external devices 320A, 320B, . . . , 320N may be configured to operate as or otherwise in conjunction with a distributed system, such as a cloud-based storage and/or processing network or system. The network 310 may be any public and/or private network(s), and my include, for example, a local area network (LAN), wide area network (WAN), the Internet, or any other network type or protocol.
[0038] In various embodiments, at least one external device 320 may be configured to perform one or more operations or to assist in performing one or more operations of a management server. For example, at least one external device 320 may be configured to receive information from one or more sensor device 100. This may include a sensor device 100 providing information relating to a monitored space, such as a people count number, coordinate information relating to the monitored space, or any other information relating to the sensor device 100, to a space associated with the sensor device 100, or to any other data or information relating to the sensor device 100 and/or space. In one example, the sensor device 100 is configured to transmit to at least one external device 320 a people count value and coordinate information relating to one or more detected people within a monitored space. Additionally or alternatively, other types of data or information associated with the sensor device 100 and/or space may be transmitted from the sensor device 100 to at least one external device 320, including a baseline thermal image, a current thermal image, an updated baseline thermal image, and/or any other data or information associated with the sensor device 100 and/or space associated with the sensor device 100.
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045] Implementations consistent with the present disclosure may include a sensor device for monitoring a space. The sensor may include a first sensor configured to capture baseline data and current data associated with the space, a second sensor configured to detect motion within the space, and a processor configured to cause the first sensor to capture the baseline data based at least in part upon a predetermined time period having elapsed since detected motion by the second sensor, the processor further configured to cause the second sensor to capture the current data and to perform a comparison operation on the current data and the baseline data. The first sensor may be a thermal imager. The second sensor may be a Passive Infrared (PIR) sensor. In various embodiments, the first sensor may be a thermal imager and the second sensor may be a PIR sensor. The comparison operation may perform people counting to determine a number of people within the space. The comparison operation may include comparing a reference background image as the baseline data to the current data. The reference background image may be a baseline background thermal image captured by the first sensor.
[0046] Further implementations according to aspects of the present disclosure may provide a system for monitoring a space. The system may include a management system, a network, and a sensor device. The sensor device may include a first sensor configured to capture baseline data and current data associated with the space, a second sensor configured to detect motion within the space, and a processor configured to cause the first sensor to capture the baseline data based at least in part upon a predetermined time period having elapsed since detected motion by the second sensor, the processor further configured to cause the second sensor to capture the current data and to perform a comparison operation on the current data and the baseline data. The first sensor may be a thermal imager. The second sensor may be a Passive Infrared (PIR) sensor. In various embodiments, the first sensor may be a thermal imager and the second sensor may be a PIR sensor. The comparison operation may perform one or more people counting operations to determine a number of people within the space. The comparison operation may include comparing a reference background image as the baseline data to the current data. The reference background image may be a baseline background thermal image captured by the first sensor.
[0047] According to further aspects of the present disclosure, provided is a method for providing improved people counting. The method includes obtaining baseline data relating to a space, selectively replacing the baseline data with new baseline data based at least in part upon a parameter of the space, obtaining current data relating to a space, comparing the current data to the baseline data, and determining a number of people within the space based at least in part upon the comparison between the current data to the baseline data. The method may further include performing one or more of a correction or a stabilization operation on the current data. The e comparing the current data to the baseline data may include comparing a baseline background thermal image to the current data.
[0048] Further implementations according to aspects of the present disclosure may include a non-transitory computer-readable storage medium having stored thereon sequences of instructions which when executed by a processor cause the processor to obtain baseline data relating to a space, selectively replace the baseline data with new baseline data based at least in part upon a parameter of the space, obtain current data relating to the space, compare the current data to the baseline data, and determine a number of people within the space based at least in part upon the comparison between the current data to the baseline data. The processor may further perform one or more of a correction or a stabilization operation on the current data. The e comparing the current data to the baseline data may include comparing a baseline background thermal image to the current data.
[0049] A sensor device 100 may include one or more zone-based (e.g., segment-based) people count inputs. A clock of the sensor device 100 may be configured to be synchronized by a controller such as an RP-C controller, which may be configured, for example, by a building management system server in various embodiments. The first sensor 130 of a sensor device 100 may be configured to obtain an image every two minutes and that image may be compared to a baseline (e.g., background) image to allow people counting operations described herein. A sensor device 100 may be associated with a particular zone (e.g., segment) and a people count value may be associated with both the sensor device 100 and/or zone. A people count operation consistent with the present disclosure may be configured to be performed at a predetermined time, for example every two minutes (although any other time may be specified or determined in accordance with the present disclosure). An image obtained by the first sensor 130 may be associated with a camera mode. The camera mode may include a normal mode or a degraded mode. The normal mode may indicate that the image was obtained at a proper time and that the background image has been properly refreshed. The degraded mode may indicate that the baseline image is not reliable for one or more reasons, such as no longer being current or that the image was not taken at the proper time.
[0050] In various exemplary embodiments, a user may trigger or force a new background image, for example using an interface associated with the sensor device 100 and/or building management system. This may be true regardless of whether the sensor device 100 operates in a manual or automatic configuration. If the refresh background mode is set to Automatic, the background (e.g., baseline data) may be automatically refreshed at the time specified in the refresh background time configuration (or by using the Refresh background image command). If the refresh background mode is set to Manual, the background (e.g., baseline data) may only be refreshed when a refresh background image command is executed. In degraded mode, the sensor device 100 may be configured to still count people. However, there is no guaranteed that the count will be correct. As a result, implementations consistent with the present disclosure while operating in the manual configuration may include determining that no one is present when the background image picture is taken. For example, a user may request a manual background update to refresh the picture at a time when a monitored space is believed to be empty, or the sensor device 100 may be configured in an automatic mode to update background data at midnight under the assumption that the monitored space will be unoccupied.
[0051] Implementations consistent with the present disclosure may include a minimum no motion time property. The Minimum no motion time property may permit specification of a time that no motion is detected by the second sensor 150 (e.g., the PIR sensor) before a refresh background is triggered. If the PIR sensor does not detect motion in the last Minimum no motion time seconds, the background image refresh may occur directly on executing the command. The default for the Minimum no motion time property may be set to ten minutes, although additional or alternative times may be used without departing from the spirit and scope of the present disclosure.
[0052] In the preceding, reference is made to various embodiments. However, the scope of the present disclosure is not limited to the specific described embodiments. Instead, any combination of the described features and elements, whether related to different embodiments or not, is contemplated to implement and practice contemplated embodiments. Furthermore, although embodiments may achieve advantages over other possible solutions or over the prior art, whether or not a particular advantage is achieved by a given embodiment is not limiting of the scope of the present disclosure. Thus, the preceding aspects, features, embodiments, and advantages are merely illustrative and are not considered elements or limitations of the appended claims except where explicitly recited in a claim(s).
[0053] The various embodiments disclosed herein may be implemented as a system, method, or computer program product. Accordingly, aspects may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects may take the form of a computer program product embodied in one or more computer-readable medium(s) having computer-readable program code embodied thereon.
[0054] Any combination of one or more computer-readable medium(s) may be utilized. The computer-readable medium may be a non-transitory computer-readable medium. A non-transitory computer-readable medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the non-transitory computer-readable medium can include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
[0055] Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages. Moreover, such computer program code can execute using a single computer system or by multiple computer systems communicating with one another (e.g., using a local area network (LAN), wide area network (WAN), the Internet, etc.). While various features in the preceding are described with reference to flowchart illustrations and/or block diagrams, a person of ordinary skill in the art will understand that each block of the flowchart illustrations and/or block diagrams, as well as combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer logic (e.g., computer program instructions, hardware logic, a combination of the two, etc.). Generally, computer program instructions may be provided to a processor(s) of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus. Moreover, the execution of such computer program instructions using the processor(s) produces a machine that can carry out a function(s) or act(s) specified in the flowchart and/or block diagram block or blocks.
[0056] The flowchart and block diagrams in the Figures illustrate the architecture, functionality and/or operation of possible implementations of various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
[0057] It is to be understood that the above description is intended to be illustrative, and not restrictive. Many other implementation examples are apparent upon reading and understanding the above description. Although the disclosure describes specific examples, it is recognized that the systems and methods of the disclosure are not limited to the examples described herein but may be practiced with modifications within the scope of the appended claims. Accordingly, the specification and drawings are to be regarded in an illustrative sense rather than a restrictive sense. The scope of the disclosure should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.