Electronic Monitoring System with Activity Zone Alignment Tool

Abstract

An area monitoring system is provided that allows flexible definitions of activity zones for activating a camera by using articulated motion detectors. An alignment tool is provided allowing independently positionable fields-of-view of the motion detectors to be aligned to produce a contiguous sensing region when desired. The camera and motion detectors may be part of a camera/floodlight assembly. The monitoring system could include two or more such assemblies and/or other monitoring and/or imaging devices or assemblies such as a stand-alone surveillance camera, a video doorbell, smoke detectors, etc.

Claims

1. An electronic monitoring system comprising: a first and second motion detector configured to detect motion, the first and second motion detectors having respective first and second fields-of-view and providing respective first and second electronic motion signals upon a detection of motion in the respective first and second fields-of-view; a first and second articulated joint communicating respectively with the first and second motion detectors and allowing independent angular adjustment of the first and second fields-of-view, an electronic processor executing a stored program and receiving the electronic motion signals from the first and second motion detectors and operating to: (a) in response to a target moving along a continuous path through the first and second fields-of-view, monitor the first and second electronic motion signals to determine times of detection of the target by the first and second motion detectors; and (b) provide an output to a user indicating a gap in detection by the first and second motion detectors of the target on the continuous path imputed from the times of detection, the output indicating a necessary adjustment for providing gapless detection.

2. The electronic monitoring system of claim 1, further including: a third motion detector having a respective third field-of-view and providing a third electronic motion signal upon a detection of motion in the third field-of-view; a third articulated joint communicating with the third motion detector allowing independent angular adjustment of the third field-of-view, and wherein the electronic processor further executes the stored program to receive the third electronic motion signal from the third motion detector and operates to: (a) in response to the target moving on the continuous path through the third field-of-view, monitor the third electronic motion signals to determine times of detection of the target by the third motion detector; and (b) provide an output to a user indicating a gap in detection of the target on the continuous path imputed from the times of detection of the target by the first, second, and third motion detectors, the output indicating a necessary adjustment for providing gapless detection.

3. The electronic monitoring system of claim 2, further including a camera attached to the third motion detector and having a field-of-view containing the third field-of-view.

4. The electronic monitoring system of claim 3, wherein the camera communicates with the first, second, and third motion detectors to obtain and transmit video data captured by the camera when the camera receives an electronic motion signal from each or any of the first, second, and third motion detectors.

5. The electronic monitoring system of claim 1, further including a wireless link communicating between the electronic processor and a portable device adapted to be carried by the target moving on a continuous path and wherein the output is an indication on the portable device of a detection of the target by each or any of the first or second motion detectors.

6. The electronic monitoring system of claim 1, wherein the output provides a visual display indicating the gap.

7. The electronic monitoring system of claim 1, further including a camera having a field-of-view encompassing at least a portion of the first and second fields-of-view, and wherein the output indicates detection regions in an image from the camera indicating locations where an electronic motion signal is received.

8. The electronic monitoring system of claim 1, wherein the joints are associated with include angle increment markings.

9. The electronic monitoring system of claim 1, wherein at least one of the first and second motion detectors further includes a floodlight controllable by the electronic motion signal of the associated motion detector.

10. The electronic monitoring system of claim 1, further including a camera having a field-of-view, and wherein the camera field-of-view is larger in area than the field-of-view of each of the first and second motion detectors.

11. A method of area monitoring, comprising: positioning first and second motion detectors to detect motion within respective first and second fields-of-view, and providing respective first and second electronic motion signals upon a detection of motion in the respective first and second fields-of-view; in response to a target moving on a continuous path through the first and second fields-of-view, monitoring the first and second electronic motion signals to determine times of detection of the target by the first and second motion detectors; and providing an output to a user indicating a gap in detection by the first and second motion detectors of the target on the continuous path imputed from the times of detection, the output indicating a necessary adjustment for providing gapless detection.

12. The method of claim 11, further including: positioning the third motion detector having a respective third field-of-view providing a third electronic motion signal upon a detection of motion in the third field-of-view; in response to the target moving on the continuous path through the third field-of-view, monitoring the third electronic motion signals to determine times of detection of the target by the third motion detector; and providing an output to a user indicating a gap in detection of the target on the continuous path imputed from the times of detection of the target by the first, second, and third motion detectors, the output indicating a necessary adjustment for providing gapless detection.

13. The method of claim 12, further including a camera attached to the third motion detector and having a field-of-view moving with the third field-of-view.

14. The method of claim 13, further including activating the camera to obtain and transmit video data captured by the camera when the camera receives an electronic motion signal from each or any of the first, second, and third motion detectors.

15. The method of claim 11, further including a wireless link communicating between the electronic processor and a portable device adapted to be carried by the target moving on a continuous path and outputting an indication on the portable device of a detection of the target by each or any of the first or second motion detectors.

16. The method of claim 11, wherein the output provides a visual display indicating the gap.

17. The method of claim 11, further including a camera having a field-of-view encompassing at least a portion of the first and second fields-of-view, and wherein the output indicates detection regions in an image from the camera meeting locations where an electronic motion signal is received.

18. The method of claim 11, wherein at least one of the first and second motion detectors further includes a floodlight, and further including controlling the floodlight with an electronic motion signal of the associated motion detector.

19. The method of claim 11, further including a camera having a field-of-view, and wherein the camera field-of-view is larger in area than the field-of-view of the first and second motion detectors.

20. A system comprising: a plurality of monitoring devices that communicate with an external server and with a user-controlled portable wireless device via a router, wherein at least one of the monitoring devices includes a camera/floodlight assembly including a first and second motion detector configured to detect detecting motion, the first and second motion detectors having respective first and second fields-of-view and providing respective first and second electronic motion signals upon a detection of motion in the respective first and second fields-of-view; a first and second articulated joint communicating respectively with the first and second motion detectors and allowing independent angular adjustment of the first and second fields-of-view, first and second floodlights, each of which is responsive to a respective one of the first and second motion detectors; a third motion detector having a respective third field-of-view and providing a third electronic motion signal upon a detection of motion in the third field-of-view, the third field-of-view being positioned, at least in part, between the first and second fields-of-view; a third articulated joint communicating with the third motion detector allowing independent angular adjustment of the third field-of-view; a camera which is responsive to the third motion detector; an electronic processor executing a stored program and receiving the electronic motion signals from the first, second and third motion detectors and operating to: (a) in response to a target moving along walking on a continuous path through the first, second, and third fields-of-view, monitor the first, second, and third electronic motion signals to determine times of detection of the target by the first, second and third motion detectors; and (b) provide an output to a user indicating a gap in detection by some combination of the first, second and second motion detectors of the target on the continuous path imputed from the times of detection, the output indicating a necessary adjustment for providing gapless detection.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Exemplary embodiments of the invention are illustrated in the accompanying drawings in which like reference numerals represent like parts throughout, and in which:

[0011] FIG. 1 is a top plan view of a wall-mountable escutcheon providing independently articulated floodlights and a camera, each incorporating a motion detector and generally showing the fields-of-view of the motion detector and the camera;

[0012] FIG. 2 is a front elevational view of the escutcheon of FIG. 1, showing the sensing regions of the motion detectors, the camera lens and floodlight elements, and camera illumination, and showing an electronic controller that may execute a stored program and wireless transceiver for communication with one or more remote portable devices;

[0013] FIG. 3 is an electronic block diagram showing the circuitry controlling and associated with the motion detectors, cameras, and floodlights of FIGS. 1 and 2

[0014] FIG. 4 is a fragmentary view of an articulated joint allowing motion in elevation, azimuth, and rotation and providing indicia delineating such positioning;

[0015] FIG. 5 is a simplified view of an installation of the escutcheon of FIGS. 1 and 2 showing the ability to define activity zones that vary in azimuth and elevation;

[0016] FIG. 6 is a flowchart showing execution of the stored program by the computer of FIG. 3 for implementing an alignment of motion detectors according to one embodiment of the present invention;

[0017] FIG. 7 is a display of a portable device that may be used during the alignment process of FIG. 6 to indicate adjustments necessary for gap-less activity zones;

[0018] FIG. 8 is a simplified representation of the field-of-view of the motion sensors and the camera showing the ability to define activity zones within the field-of-view of the camera; and

[0019] FIG. 9 is a graphical display showing activity zones superposed on a camera image to assist in adjustment of those regions.

DETAILED DESCRIPTION

[0020] Referring now to FIGS. 1 and 2, in accordance with an aspect of the invention, an electronic system 10 for real-time monitoring may include a camera/floodlight assembly 12 configured to monitor an area of interest. The system 10 may additionally include more than one such assembly 12 and/or other monitoring and/or imaging devices or assemblies such as a stand-alone surveillance camera, a video doorbell, smoke detectors, etc. These devices and assemblies may communicate wirelessly with each other and also may communicate wirelessly with an external server and one or more user devices via a gateway router or simply router, possibly with the assistance of a base station as described below.

[0021] Still referring to FIGS. 1 and 2, the camera/floodlight assembly 12 has escutcheon 14, for example, that may mount against a building wall 16, a soffit, a fence, a light pole, or the like and which provides a support plate for the camera/floodlight assembly 12. The escutcheon 14 may have a hollow rear face to receive and cover electrical connections to an electrical main or the like as well as physical connections of the escutcheon 14 to the wall 16 by screws or bolts as is generally understood in the art.

[0022] The front surface of the escutcheon 14 may support three articulated joints 18a-18c extending forward therefrom to attach respectively to rear surfaces of a first motion detector floodlight 20a, an imaging device or camera module 22, and a second motion detector floodlight 20b, respectively. Unless otherwise specified, the presence of a numerical reference character such as 20, unaccompanied by an alphabetical designator such as a or b, should be understood to refer to any or all of the devices designated by the a combination of the numerical and alphabetical components. Hence, 20 standing alone should be understood to refer to either or both of 20a and 20b and 18 standing alone should be understood to refer to any or all of 18a, 18b, and 18c.

[0023] Referring momentarily to FIG. 4, each articulated joint 18 may provide for a fixed portion 24 attached to the escutcheon 14 and a movable portion 26 attached to the rear surfaces of the motion detector, floodlights 20 and camera module 22. In one embodiment, the movable portion 26 may be positioned with respect to the escutcheon 14 at various angles in elevation 28 and azimuth 30 and may pivot 32 about a central axis 34 generally aligned with the axes of sensitivity of the motion detector, floodlights 20 and camera module 22. In a typical orientation shown in FIG. 2, the elevation 28 will be vertical, the azimuth 30 will be horizontal, and central axis 34 will extend generally in a horizontal direction when the articulated joint 18 is centered in azimuthal and elevational movement. Indicia 36, for example, molded embossments or printed markings, may be provided on the fixed portion 24 to guide the setting of the angles of azimuth and elevation, and similar indicia 38 may be placed on the movable portion 26 to guide pivoting motion.

[0024] Referring again to FIGS. 1 and 2, each of the motion detector floodlights 20 will include an upper floodlight assembly 40 that typically has multiple LED emitters directed forwardly to emit in excess of 500 lm generally along the central axis 34 when the motion detector floodlight 20 is centered in azimuth and elevation. Positioned beneath the floodlight assembly 40 is a forward facing passive infrared (PIR) detector 42. The floodlight assembly 40 will generally have a greatest extent along a width 44 (typically horizontally oriented) matching a greatest width of its illumination pattern 46 and also matching a greatest width of the field-of-view (FOV) 48 of the associated PIR detector 42.

[0025] Referring still to FIGS. 1 and 2, the camera module 22 includes at least a video camera 70 (FIG. 3), and may additionally include other components found in imaging devices of monitoring systems, including one or more of a motion sensor, a microphone, a speaker, and an alarm. The camera 70 has a forward facing wide-angle lens 72 providing a camera field-of-view (FOV) 52 that may, for example, be greater than 100 and typically greater than 160 in azimuth. The camera module 22 will also include an integrated PIR detector 53 having a field-of-view width 56 centered on the field-of-view 58. This FOV may be smaller than that field-of-view 58. It may also define a fixed or user-settable activity zone. A light source 57 is provided on a front face of the camera module 22 emitting infrared or visible light to provide light for the camera 70, but at an intensity generally much lower than the light provided by the floodlight assembly 40. An indicator light 54 may be provided indicating activation of the PRI detector 53 by motion of an infrared emitting body such as an individual passing within the field-of-view 56. An ambient light sensor 71, (FIG. 3) is provided, for example, to suppress operation of the floodlight assembly during daylight hours.

[0026] Referring now to FIG. 3, in one embodiment, the camera module 22 may provide for a camera 70 with a lens assembly 72 for obtaining video images, for example, at 2K HDR using a CMOS sensor or other sensing technology. A housing 74 of the camera module 22 holding the camera may also hold the PIR detector 53 with both the PIR detector 53 and camera 70 communicating with an internal microcontroller 80. The microcontroller 80, for example, may provide for a processor 82 and a non-transient electronic memory 84 holding a stored program 86 to be executed by the microcontroller at least in part, as will be discussed below. As is generally understood in the art, the microcontroller 80 may also include one or more interface lines for communicating with the camera 70, the PIR detector 53, the ambient light detector 71, and an interface 88 (for example, the I.sup.2C protocol) allowing communication with other elements of the camera/floodlight assembly 12. In particular, the interface 88 may communicate with floodlight assemblies 40 of each of the motion detector floodlights 20a and 20b to provide signals independently turning the floodlight assemblies 40 on and off, and with the PIR detectors 42 of each of the motion detector floodlights 20a and 20b to receive signals therefrom. As will be discussed below, the floodlight assemblies 40 generally will include necessary driver circuitry so that they can be activated by the camera module 22 by remote command or be dependent on the receipt of electrical signals indicating motion from the PIR detectors 42 or 53.

[0027] Importantly, the microcontroller 80 may also communicate with a wireless transceiver 92, for example, using the IEEE 802.11 standards in accordance with the Wi-Fi communication protocol. The wireless transceiver 92 may communicate with a base station 93 or wireless router 94, for example, in the user's home, and via either of these devices, through the Internet 96 with remote server 98 including one or more computer processors. The remote server 98, which may be a cloud-based server, may in turn communicate with the cellular network 103 providing communication with user devices, typically in the form of portable wireless devices 105 such as a smart phone, tablet, or laptop. It also could provide communications with one or more stationary devices such as a PC. As is understood in the art, such wireless portable devices 105 may include one or more internal processors, a computer memory holding stored programs in the form of applications, a wireless transceiver, and a display such as a touchscreen or the like allowing for inputs from a user and the display of graphical or text information, as well as a speaker and microphone for delivering and receiving voice commands. Such portable wireless devices 105 are typically battery-powered so as to be carried by a user if desired during the processing be described herein.

[0028] Generally, it will be understood that the logic to be described with respect to the operation of the system 10 may be distributed among multiple processors variously within the camera module 22, a base station 93 and/or a router 94 in the user's house, or the central server 98.

[0029] An internal battery 90, provided with recharging capabilities from charger unit 95 connected to line voltage 97, may provide power to each of the floodlight assemblies 40, the circuitry of the PIR detectors 42, and the circuitry associated with the camera module 22 within housing 74.

[0030] Referring now to FIG. 5, when the camera/floodlight assembly 12 is attached to a structure 99 such as a home, building, post, fence or the like, the PIR detectors 42 and 53 in the respective individual motion detector floodlights 20a, 20b and camera module 22 may be independently positioned and aligned to define multiple activities zones 100a, 100b, and 100c. These multiple activities zones 100a, 100b, and 100c may be located freely at different elevational and azimuthal positions, being generally left and right positions with respect to the structure 99. They also may extend different distances from the structure 99. This is in contrast to a conventional camera-attached, wide-angle PIR which can provide only a linear contiguous activity zone at a fixed elevation and azimuth with respect to the camera module 22. While the activities zones 100 are shown as approximately square, in practice they may be much wider than tall. The ability to swivel the PIR detectors 42 in their respective motion detector floodlights 20 using the pivoting of joint 18 allows these elongated zones to be flexibly oriented, for example, angled paths or regions.

[0031] This freedom of positioning of the motion detector floodlights 20 independent of the camera module 22 allows additional flexibility in locating the activity zones 100 (and thus triggering of the camera module 22) permitting the activity zones 100 to be discontinuous or at different elevations in areas of interest where there is no concern about undesirable background motion. This flexibility is accommodated, while preserving the ability to define contiguous activities zones 100 producing a continuous perimeter border, by providing a tool allowing the user to properly identify and locate these activities zones 100 and to ensure that they are contiguous when so desired.

[0032] Referring now to FIGS. 3, 5, 6, and 7, this tool may be activated by the user as indicated by process block 102, for example, using a portable wireless device 105, and may execute any of the processors described above with respect to FIG. 2, for example, implemented by an application program 110 held, in part, on the portable wireless device 105 and, in part, on the server 98, the microcontroller 80, and a processor associated with a base station 93.

[0033] As indicated by process block 112 of FIG. 6, the program 110 may instruct the user to walk a trajectory 114 selected to pass through desired activity zones 100 determined by the user. This instruction may be by text, a tone or series of tones, or voice message, for example, output on the portable wireless device 105. The program 110 then waits at process block 115 to receive a signal from the camera module 22 indicating detection of the user by one of the PIR detectors 42 or 53. A first detection event generally indicates the direction of the trajectory 114. For example, if the first detection event is the leftmost PIR detector 42, a trajectory from left to right will be inferred, otherwise a right to left trajectory will be inferred. If the first detection event is the PIR detector 53 on the camera module 22, or at any time if the inferred sequence is violated, the user is so notified that one or both of the motion detector floodlights 20 is not providing a detection signal and instructed to adjust the angle of the particular motion detector floodlights 20 (or both) where no signal was detected during the trajectory 114 and to try the trajectory again.

[0034] If no sequence error has occurred, as determined at process block 115 discussed above, then at process block 116 the program 110 times the on-time and off-time intervals and records the sequence of activation of each of the three PIR detectors 42 and 53. This timing process is concluded when a third PIR detector in the imputed sequence indicates an activation at decision block 118 or optionally after activation has been detected and then no longer detected or continuously detected within a period of time, for example, 30 seconds. Otherwise, an error condition is indicated at block 119 and the user is given instructions to start over at process block 112.

[0035] As shown in FIG. 8, these measurements yield a timing profile 120 having a set of on-times 122 each identified to a particular PIR detector 42 or 53, typically but not necessarily separated by off-times 124. At process block 130, this timing profile 120 is reviewed and if the off-times 124 between on-times exceed a predetermined value (e.g., one second) per decision block 132, the user is informed at block 134 that there is a gap between detected activity zones 100 along the trajectory 114. The user then is provided with instructions for adjusting the articulated joints 18 to eliminate that gap and then instructed to repeat this process after adjustment is made, per process block 134. When no gaps indicated by off-times 124 are detected, the program 110 concludes, as indicated by process block 136, and the user is instructed that a gap-less sensing region has been established.

[0036] Referring now to FIG. 7, in one embodiment these instructions to the user with respect to eliminating gaps may be text, tones or other sounds, or spoken instructions 140 delivered, for example, by the user's portable wireless device 105 or on a stationary display screen referred to by the user. When the user can carry the wireless device 105 during this process, the portable wireless device 105 may also display a representation 142 of the PIR detectors 42 and 53 and indicate the times when each one is in a sensing or on-time 122 to further help the user visualize the region of the activities zones 100 on the ground. Alternatively, this function may be provided by the indicator light 54 or momentary activation of the floodlight assemblies 40. In addition or as an alternative to the representation 142 of the timing profile 120, the display may instruct the user as to a direction (e.g., up, down, left, right) of movement of a particular motion detector floodlight 20 (left or right) necessary to close the gap and optionally may estimate the amount of articulation (e.g., 10 deg.) necessary with respect to the indicia 36 and 38 described with respect to FIG. 4. The display may offer the user the option, for example, between moving the camera module 22 or moving a motion detector floodlights 20 in order to reduce that gap.

[0037] Referring now again to FIGS. 6 and 9, in one embodiment, the camera module 22 may be activated to acquire video imagery during process blocks 115-118 as indicated by process block 158 displaying visually the activity zones 100 as visualized activity zones 162 on a display 166. This image may be generated using the timing profile 120 to produce the visualized activity zones 162 by highlighting any motion in the acquired video image during the on-times 122 and marking that motion (for example, with a number) according to the particular device responsible for the on-time being either a motion detector floodlight 20 or camera module 22. In this way, the user can obtain a camera view of each activity zone 100.

[0038] Referring again to FIG. 3, it will be appreciated that the communication between the camera module 22 and each of the detectors 42 and 53 allows flexible operation of the floodlight assemblies 40 For example, each floodlight assembly 40a or 40b may only be activated during the detection of motion in its associated activity zones 162, or, alternatively, in two or even all activity zones 162. Likewise particular detectors 42 or 53 may be deactivated, for example, when only one or two activity zones are desired.

[0039] While the above-described embodiment shows only three field-of-view motion sensors 42 and 53 and the camera 70, it will be appreciated that the principles of the present invention can be expanded to multiple such units coordinated together to provide for continuous multizone regions of greater than three activity zones 100 and that the individual units in some cases can be separated for separate mounting using different housings while inter-communicating. Generally, it will be appreciated that the camera module 22 may flexibly control the relationship between detection of motion signals from various motion sensors 42 and 53 and activation of the floodlight assemblies 40 so that a given floodlight assembly 40 may or may not be activated in time with its associated motion detector 42 or floodlight assemblies 40 may be activated at other times. Generally the floodlight assemblies 40 will include driver circuitry for switching the necessary currents for the LEDs as triggered by low-level communication signals. While the above description uses the portable wireless device 105 in communication with the user, it will be appreciated that other devices can provide this interface including the camera module 22 which may include a microphone for receiving voice commands and a speaker for providing audible cues and instructions.

[0040] The target that moves along the continuous path typically will be a person walking along the path. It is conceivable, however, that the target could be an autonomous or remote controlled moving object, such as a drone flying along the path or a vehicle moving along the path under control of a user operating a portable device.

[0041] As is generally understood to those of ordinary skill in the art, the various processors described including those in the server 98, the camera module 22, and in the portable wireless device 105 may employ any standard architecture and may include but are not limited to: a central processing unit (CPU), an array processor, a vector processor, a digital signal processor (DSP), a field-programmable gate array (FPGA), a programmable logic array (PLA), an application-specific integrated circuit (ASIC), programmable logic circuitry, and a controller. The memory associated with any of these processors can store instructions of the program 110 and/or program data as well as video data and the like. The memory can include volatile and/or non-volatile memory. Examples of suitable memory include RAM (Random Access Memory), flash memory, ROM (Read Only Memory), PROM (Programmable Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), registers, disks, drives, or any other suitable storage medium, or any combination thereof.

[0042] An exemplary camera module 22 capable of implementing aspects of the invention is commercially available under the Arlo Ultra brand from Arlo Technologies, Inc. in Carlsbad, California, US. An exemplary base station 93 capable of incorporating aspects of the invention is commercially available under the Arlo SmartHub brand from Arlo Technologies in Carlsbad, California, US. Alternatively, base station 93 may be omitted, and its circuitry and functionality may be provided at least in part the router 94, and in other devices such as the server 98 and/or the camera module 22.

[0043] Although the best mode contemplated by the inventors of carrying out the present invention is disclosed above, practice of the above invention is not limited thereto. It will be manifest that various additions, modifications, and rearrangements of the features of the present invention may be made without deviating from the spirit and the scope of the underlying inventive concept.