MONITORING APPARATUS, MONITORING SYSTEM, MONITORING METHOD, AND COMPUTER-READABLE STORAGE MEDIUM
20210174517 · 2021-06-10
Assignee
Inventors
Cpc classification
G06T7/246
PHYSICS
G06V20/52
PHYSICS
G08B13/19613
PHYSICS
International classification
G06T7/246
PHYSICS
Abstract
A monitoring apparatus 10 includes: a monitoring line setting unit 11 that sets a monitoring line in an image acquired from the image capturing unit; and an overlapping detection unit 12 that detects overlapping between an object in the image and the monitoring line. If overlapping is detected by the overlapping detection unit 12, the monitoring line setting unit 11 sets a new monitoring line according to the object.
Claims
1. A monitoring system comprising: at least one memory storing instructions; and at least one processor coupled to the at least one memory and configured to execute the instructions to: set a monitoring line in an image acquired from an image capturing unit; and detect overlapping between an object in the image and the monitoring line, wherein if overlapping is detected a new monitoring line according to the object is set.
2. The monitoring system according to claim 1, wherein the at least one processor is configured to: set, if overlapping is detected the new monitoring line on a pre-designated side according to an outer edge of the object.
3. The monitoring system according to claim 1, wherein the at least one processor is configured to: set, if overlapping is detected the new monitoring line in a pre-designated region according to an outer edge of the object.
4. The monitoring system according to any one of claims 1, wherein the at least one processor is further configured to, display an image acquired from a monitoring camera and the monitoring line on a screen of a display apparatus, wherein, erase, if overlapping is detected the portion of the monitoring line that overlaps with the object from the screen and displays a new monitoring line on the screen.
5. The monitoring system according to any one of claims 1, further wherein the at least one processor is further configured to, a notification unit configured to, perform, if a new line is set notification to that effect to an external device.
6. The monitoring system according to claim 1, wherein the at least one processor is configured to: move, wherein if overlapping is detected the monitoring line such that it does not overlap with the object.
7. A monitoring method comprising: setting a monitoring line in an image acquired from an image capturing device, detecting overlapping between an object in the image and the monitoring line; and setting a new monitoring line according to the object if overlapping is detected.
8. The monitoring method according to claim 7, wherein if overlapping is detected, the new monitoring line is set on a pre-designated side according to an outer edge of the object.
9. The monitoring method according to claim 7, wherein if overlapping is detected, the new monitoring line is set in a pre-designated region according to an outer edge of the object.
10. The monitoring method according to claim 7, further comprising: displaying an image acquired from a monitoring camera and the monitoring line on a screen of a display apparatus; and erasing the portion of the monitoring line that overlaps with the object from the screen and displaying a new monitoring line on the screen if overlapping is detected in the (b) step.
11. The monitoring method according to claim 7, further comprising if a new monitoring line is set, performing notification to that effect to an external device.
12. The monitoring method according to claim 7, wherein if overlapping is detected, move the monitoring line such that it does not overlap with the object.
13. A computer-readable storage medium storing a program that includes commands for causing a computer to execute: setting a monitoring line in an image acquired from an image capturing device, detecting overlapping between an object in the image and the monitoring line; and setting a new monitoring line according to the object if overlapping is detected.
14. The non-transitory computer-readable storage medium according to claim 13, wherein if overlapping is detected, the new monitoring line is set on a pre-designated side according to an outer edge of the object.
15. The non-transitory computer-readable storage medium according to claim 13, wherein if overlapping is detected, the new monitoring line is set in a pre-designated region according to an outer edge of the object.
16. The non-transitory computer-readable storage medium according to claim 13, further including commands for causing a computer to execute: rendering the monitoring line on the image acquired from the image capture unit to generate an image for monitoring and displaying the generated image for monitoring on a screen of a display apparatus; and if overlapping is detected, erasing the portion of the monitoring line that overlaps with the object from the image for monitoring, rendering a new monitoring line, and displaying the acquired image for monitoring on the screen.
17. The non-transitory computer-readable storage medium according to claim 13, further including commands for causing a computer to execute if a new monitoring line is set, performing notification to that effect to an external device.
18. The non-transitory computer-readable storage medium according to claim 13, further including commands for causing a computer to execute: if overlapping is detected, moving the monitoring line such that it does not overlap with the object.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
DESCRIPTION OF EMBODIMENT
Embodiment
[0070] Hereinafter, a monitoring apparatus, a monitoring system, a monitoring method, and a program according to an embodiment of the present invention will be described with reference to
[0071] Configuration of Apparatus
[0072] First, a schematic configuration of a monitoring apparatus according to the present embodiment will be described with reference to
[0073] The monitoring line setting unit 11 sets a monitoring line in an image acquired from an image capturing unit (not shown in
[0074] Also, the overlapping detection unit 12 detects overlapping between an object in the image and the monitoring line. Also, if overlapping is detected by the overlapping detection unit 11, the monitoring line setting unit 12 sets a new monitoring line according to the object in the image.
[0075] Thus, in the present embodiment, a new monitoring line is set away from the object in the case where the monitoring line and the object overlap in the image due to an object such as a vehicle existing between a facility or the like being monitored and the image capturing unit.
[0076] For this reason, according to the present invention, it is possible to detect an intruder even if a pre-set monitoring line overlaps with an object.
[0077] Here, a configuration of a monitoring system according to the present embodiment will also be described in addition to the monitoring apparatus 10 with reference to
[0078] As shown in
[0079] The image acquisition unit 13 acquires image data of an image (denoted hereinafter as “captured image”) captured by the monitoring camera 20 from the monitoring camera 20. Also, the image acquisition unit 13 transfers the acquired image data (hereinafter denoted as “captured image data”) to the monitoring line setting unit 11. Also, in the present embodiment, there is no particular limitation on the number of monitoring cameras 20, and multiple monitoring cameras 20 may be used. In this case, the image acquisition unit 13 acquires captured image data from each monitoring camera 20.
[0080] In the present embodiment, as shown in
[0081] In the present embodiment, upon receiving the monitoring image data from the monitoring line setting unit 11, the overlapping detection unit 12 specifies a region (hereinafter denoted as a “change region”) that changes in the monitoring image data by contrasting the received monitoring image data and image data serving as a reference. Since the change region corresponds to a newly-existing object, the overlapping detection unit 12 detects overlapping between the change region and the region in which the monitoring line is set in the monitoring image data.
[0082] For example, as shown in
[0083] Also, if overlapping is detected by the overlapping detection unit 12, the monitoring line setting unit 11 erases the region of the region in which the monitoring line 15 is set that overlaps with the change region from the monitoring image data and sets a new monitoring line. Accordingly, the monitoring image data is updated. Note that in this case, the monitoring line setting unit 11 may set the new monitoring line without erasing the region that overlaps with the change region.
[0084] In the present embodiment, if a new monitoring line is to be set, the monitoring line setting unit 11 can set the new monitoring line in a pre-designated region in the captured image data and the monitoring image data according to the outer edge of the object. Specifically, for example, in the example shown in
[0085] Also, if overlapping is detected by the overlapping detection unit 12, as shown in
[0086] Also, upon receiving the monitoring image data in which the monitoring line 15 is set from the monitoring line setting unit 11, the display unit 14 inputs it to the display apparatus 30. Accordingly, the captured image on which the monitoring line 15 is rendered is displayed on the screen of the display apparatus 30. Furthermore, if overlapping is detected by the overlapping detection unit 12, the display unit 14 receives monitoring image data in which the monitoring line 16 is newly set from the monitoring line setting unit 11. In this case, in the present embodiment, the display unit 14 erases the portion of the monitoring line 15 that overlaps with the object and displays the new monitoring line 16 on the screen (see
[0087] Also, the intrusion detection unit 18 executes intrusion detection processing based on the monitor image data generated by the monitor line setting unit 11. Specifically, after the monitoring line 15 or 16 is set, the intrusion detection unit 18 detects a moving body based on the monitoring image data and determines whether or not the detected moving body has come into contact with the monitoring line 15 or 16. If it is determined that the moving body has come into contact with the monitoring line 15 or 16, it is detected that intrusion has occurred.
[0088] If the new monitoring line 16 (see
Operations of Apparatus
[0089] Next, operations performed by the monitoring apparatus 10 according to an embodiment of the present invention will be described with reference to
[0090] First, as shown in
[0091] Next, the monitoring line setting unit 11 sets the monitoring line 15 at a pre-designated position in the captured image data (step A2). Then, the monitoring line setting unit 11 transfers the monitoring image data in which the monitoring line 15 has been set to the overlapping detection unit 12, the intrusion detection unit 18, and the display unit 14.
[0092] Next, the overlapping detection unit 12 contrasts the monitoring image data received from the monitoring line setting unit 11 and the image data used as a reference, to specify a change region in the monitoring image data, and thereby determine whether or not an object overlapping with the monitoring line 15 exists (step A3). If it is determined in step A3 that no object overlapping with the monitoring line exists, step A5 is executed.
[0093] If it is determined in step A3 that an object overlapping with the monitoring line 15 exists, the overlapping detection unit 12 detects the portion (overlapping region) of the monitoring line 15 that overlaps with the object and transfers it to the monitoring line setting unit 11. Accordingly, the monitoring line setting unit 11 erases the portion of the monitoring line 15 that overlaps with the object from the monitoring image data and further sets a new monitoring line 16 (step A4). Accordingly, the monitoring image data is updated, and therefore the monitoring line setting unit 11 transfers the updated monitoring image data to the overlapping detection unit 12 and the intrusion detection unit 18.
[0094] If step A4 is executed and if it is determined in step A3 that no object exists, the intrusion detection unit 18 executes intrusion detection processing based on the monitoring image data generated by the monitoring line setting unit 11 (step A5).
[0095] Due to the execution of step A5, the series of processes ends, but when the monitoring camera 20 outputs a new captured image, step A1 is executed once again. In the present embodiment, steps A1 to A5 are executed each time a captured image is output by the monitoring camera 20.
[0096] Effect of the Embodiment
[0097] As shown in
MODIFIED EXAMPLES
[0098] Here, modified examples of the present embodiment will be described with reference to
Modified Example 1
[0099] As shown in
Modified Example 2
[0100] As shown in
[0101] In this way, in the case of using Modified Examples 1 and 2 as well, the new monitoring line 16 is set such that the intruder cannot intrude by hiding in the shadow of the buildings that overlap with the monitoring line. The present Modified Examples 1 and 2 are also useful.
Program
[0102] A program of the present embodiment need only be a program for causing a computer to execute steps A1 to A5 shown in
[0103] Also, a computer that realizes the monitoring apparatus 10 by executing the program according to the present embodiment will be described with reference to the drawings.
[0104] As shown in
[0105] The CPU 111 carries out various calculations by expanding programs (codes) according to the present embodiment, which are stored in the storage apparatus 113, to the main memory 112 and executing them in a predetermined sequence. The main memory 112 is typically a volatile storage device such as a DRAM (Dynamic Random Access Memory). Also, the program according to the present embodiment is provided in a state of being stored in a computer-readable storage medium 120. Note that the program according to the present embodiment may be distributed over the Internet, which is connected to via the communication interface 117.
[0106] Also, specific examples of the storage apparatus 113 include a semiconductor storage device such as a flash memory, in addition to a hard disk drive. The input interface 114 mediates data transmission between the CPU 111 and an input device 118 such as a keyboard or a mouse. The display controller 115 is connected to a display device 119 and controls display on the display device 119.
[0107] The data reader/writer 116 mediates data transmission between the CPU 111 and the storage medium 120, reads out programs from the storage medium 120, and writes results of processing performed by the computer 110 in the storage medium 120. The communication interface 117 mediates data transmission between the CPU 111 and another computer.
[0108] Also, specific examples of the storage medium 120 include a general-purpose semiconductor storage device such as CF (Compact Flash (registered trademark)) and SD (Secure Digital), a magnetic storage medium such as a flexible disk, and an optical storage medium such as a CD-ROM (Compact Disk Read Only Memory).
[0109] The above-described embodiment can be partially or entirely expressed by, but is not limited to, the following Supplementary Notes 1 to 24.
Supplementary Note 1
[0110] A monitoring apparatus including:
[0111] a monitoring line setting unit configured to set a monitoring line in an image acquired from an image capturing unit; and
[0112] an overlapping detection unit configured to detect overlapping between an object in the image and the monitoring line,
[0113] wherein if overlapping is detected by the overlapping detection unit, the monitoring line setting unit sets a new monitoring line according to the object.
Supplementary Note 2
[0114] The monitoring apparatus according to Supplementary Note 1, wherein if overlapping is detected by the overlapping detection unit, the monitoring line setting unit sets the new monitoring line on a pre-designated side according to an outer edge of the object.
Supplementary Note 3
[0115] The monitoring apparatus according to Supplementary Note 1, wherein if overlapping is detected by the overlapping detection unit, the monitoring line setting unit sets the new monitoring line in a pre-designated region according to an outer edge of the object.
Supplementary Note 4
[0116] The monitoring apparatus according to Supplementary Note 1, further including a display unit that displays an image acquired from a monitoring camera and the monitoring line on a screen of a display apparatus,
[0117] wherein if overlapping is detected by the overlapping detection unit, the display unit erases the portion of the monitoring line that overlaps with the object from the screen and displays a new monitoring line on the screen.
Supplementary Note 5
[0118] The monitoring apparatus according to Supplementary Note 1, further including a notification unit configured to, if a new line is set by the monitoring line setting unit, perform notification to that effect to an external device.
Supplementary Note 6
[0119] A monitoring apparatus including:
[0120] a monitoring line setting unit configured to set a monitoring line in an image acquired from an image capturing unit; and
[0121] an overlapping detection unit configured to detect overlapping between an object in the image and the monitoring line,
[0122] wherein if overlapping is detected by the overlapping detection unit, the monitoring line setting unit moves the monitoring line such that it does not overlap with the object.
Supplementary Note 7
[0123] A monitoring apparatus including:
[0124] a monitoring line setting unit configured to set a monitoring line in an image acquired from an image capturing unit; and
[0125] an overlapping detection unit configured to detect overlapping between an object in the image and the monitoring line,
[0126] wherein if overlapping is detected by the overlapping detection unit, the monitoring line setting unit sets a new monitoring line at a position that does not overlap with the object in a pre-designated region.
Supplementary Note 8
[0127] A monitoring system including:
[0128] a monitoring camera and a monitoring apparatus,
[0129] wherein the monitoring apparatus includes:
[0130] a monitoring line setting unit configured to set a monitoring line in an image acquired from the monitoring camera; and
[0131] an overlapping detection unit configured to detect overlapping between an object in the image and the monitoring line, and
[0132] if overlapping is detected by the overlapping detection unit, the monitoring line setting unit sets a new monitoring line according to the object.
Supplementary Note 9
[0133] A monitoring system including:
[0134] a monitoring camera and a monitoring apparatus,
[0135] wherein the monitoring apparatus includes:
[0136] a monitoring line setting unit configured to set a monitoring line in an image acquired from the monitoring camera; and
[0137] an overlapping detection unit configured to detect overlapping between an object in the image and the monitoring line, and
[0138] if overlapping is detected by the overlapping detection unit, the monitoring line setting unit moves the monitoring line such that it does not overlap with the object.
Supplementary Note 10
[0139] A monitoring system including:
[0140] a monitoring camera and a monitoring apparatus,
[0141] wherein the monitoring apparatus includes:
[0142] a monitoring line setting unit configured to set a monitoring line in an image acquired from the monitoring camera; and
[0143] an overlapping detection unit configured to detect overlapping between an object in the image and the monitoring line, and
[0144] if overlapping is detected by the overlapping detection unit, the monitoring line setting unit sets a new monitoring line at a position that does not overlap with the object in a pre-designated region.
Supplementary Note 11
[0145] A monitoring method including:
[0146] (a) a step of setting a monitoring line in an image acquired from an image capturing unit;
[0147] (b) a step of detecting overlapping between an object in the image and the monitoring line; and
[0148] (c) a step of setting a new monitoring line according to the object if overlapping is detected in the (b) step.
Supplementary Note 12
[0149] The monitoring method according to Supplementary Note 11, wherein if overlapping is detected in the (b) step, in the (c) step, the new monitoring line is set on a pre-designated side according to an outer edge of the object.
Supplementary Note 13
[0150] The monitoring method according to Supplementary Note 11, wherein if overlapping is detected in the (b) step, in the (c) step, the new monitoring line is set in a pre-designated region according to an outer edge of the object.
Supplementary Note 14
[0151] The monitoring method according to Supplementary Note 11, further including:
[0152] (d) a step of displaying an image acquired from a monitoring camera and the monitoring line on a screen of a display apparatus; and
[0153] (e) a step of erasing the portion of the monitoring line that overlaps with the object from the screen and displaying a new monitoring line on the screen if overlapping is detected in the (b) step.
Supplementary Note 15
[0154] The monitoring method according to any one of Supplementary Notes 11 to 14, further including
[0155] a step of, if a new monitoring line is set in the (c) step, performing notification to that effect to an external device.
Supplementary Note 16
[0156] A monitoring method including:
[0157] (a) a step of setting a monitoring line in an image acquired from an image capturing unit;
[0158] (b) a step of detecting overlapping between an object in the image and the monitoring line; and
[0159] (c) a step of moving the monitoring line such that it does not overlap with the object if overlapping is detected in the (b) step.
Supplementary Note 17
[0160] A monitoring method including:
[0161] (a) a step of setting a monitoring line in an image acquired from an image capturing unit;
[0162] (b) a step of detecting overlapping between an object in the image and the monitoring line; and
[0163] (c) a step of setting a new monitoring line at a position such that it does not overlap with the object in a pre-designated region if overlapping is detected in the (b) step.
Supplementary Note 18
[0164] A computer-readable storage medium storing a program that includes commands for causing a computer to execute:
[0165] (a) a step of setting a monitoring line in an image acquired from an image capturing unit;
[0166] (b) a step of detecting overlapping between an object in the image and the monitoring line; and
[0167] (c) a step of setting a new monitoring line according to the object if overlapping is detected in the (b) step.
Supplementary Note 19
[0168] The computer-readable storage medium according to Supplementary Note 18, wherein if overlapping is detected in the (b) step, in the (c) step, the new monitoring line is set on a pre-designated side according to an outer edge of the object.
Supplementary Note 20
[0169] The computer-readable storage medium according to Supplementary Note 18, wherein if overlapping is detected in the (b) step, in the (c) step, the new monitoring line is set in a pre-designated region according to an outer edge of the object.
Supplementary Note 21
[0170] The computer-readable storage medium according to Supplementary Note 18, further including a command for causing a computer to execute:
[0171] (d) a step of rendering the monitoring line on the image acquired from the image capture unit to generate an image for monitoring and displaying the generated image for monitoring on a screen of a display apparatus; and
[0172] (e) a step of, if overlapping is detected in the (b) step, erasing the portion of the monitoring line that overlaps with the object from the image for monitoring, rendering a new monitoring line, and displaying the acquired image for monitoring on the screen.
Supplementary Note 22
[0173] The computer-readable storage medium according to Supplementary Note 18, further including a command for causing a computer to execute
[0174] a step of, if a new monitoring line is set in the (c) step, performing notification to that effect to an external device.
Supplementary Note 23
[0175] A computer-readable storage medium storing a program that includes commands for causing a computer to execute:
[0176] (a) a step of setting a monitoring line in an image acquired from an image capturing unit;
[0177] (b) a step of detecting overlapping between an object in the image and the monitoring line; and
[0178] (c) a step of moving the monitoring line such that it does not overlap with the object if overlapping is detected in the (b) step.
Supplementary Note 24
[0179] A computer-readable storage medium storing a program that includes commands for causing a computer to execute:
[0180] (a) a step of setting a monitoring line in an image acquired from an image capturing unit;
[0181] (b) a step of detecting overlapping between an object in the image and the monitoring line; and
[0182] (c) a step of setting a new monitoring line at a position such that it does not overlap with the object in a pre-designated region if overlapping is detected in the (b) step.
[0183] Although the present invention has been described with reference to an embodiment, the present invention is not limited to the above-described embodiments. Various modifications that a person skilled in the art can understand may be applied to the configuration and the details of the present invention within the scope of the present invention.
[0184] This application claims priority to Japanese Patent Application No. 2015-059782, filed on Mar. 23, 2015, the disclosure of which is incorporated in its entirety herein by reference.
INDUSTRIAL APPLICABILITY
[0185] According to the present invention, an intruder can be detected even if a pre-set monitoring line overlaps with an object on an image from a monitoring camera. The present invention is useful in a monitoring system.
DESCRIPTIONS OF REFERENCE NUMERALS
[0186] 10 Monitoring apparatus
[0187] 11 Monitoring line setting unit
[0188] 12 Overlapping detection unit
[0189] 13 Image acquisition unit
[0190] 14 Display unit
[0191] 15, 16 Monitoring line
[0192] 17 Notification unit
[0193] 18 Intrusion detection unit
[0194] 20 Monitoring camera
[0195] 21 Building being monitored
[0196] 22 Vehicle
[0197] 23 Region corresponding to street
[0198] 24 Region between buildings
[0199] 30 Display apparatus
[0200] 100 Monitoring system
[0201] 110 Computer
[0202] 111 CPU
[0203] 112 Main memory
[0204] 113 Storage apparatus
[0205] 114 Input interface
[0206] 115 Display controller
[0207] 116 Data reader/writer
[0208] 117 Communication interface
[0209] 118 Input device
[0210] 119 Display apparatus
[0211] 120 Storage medium
[0212] 121 Bus