OBJECT DETECTION METHOD
20230005293 · 2023-01-05
Assignee
Inventors
Cpc classification
G06V10/267
PHYSICS
G06V10/22
PHYSICS
International classification
G06V10/22
PHYSICS
Abstract
An object detection apparatus according to the present invention includes an object detecting unit configured to perform, for each region in an image set based on a size of a specific object detected in the image, a process of detecting the specific object on a new image.
Claims
1. An object detection method comprising performing, for each region in an image set based on a size of a specific object detected in the image, a process of detecting the specific object on a new image.
2. The object detection method according to claim 1, comprising changing an overall size of the new image and performing, for each overall size of the new image, the process of detecting the specific object in the region in the new image.
3. The object detection method according to claim 2, comprising performing the process of detecting the specific object in one region for each overall size of the new image.
4. The object detection method according to claim 2, comprising performing, for each region in the new image, the process of detecting the specific object having a specific size.
5. The object detection method according to claim 1, comprising: associating the region set based on the size of the specific object with information specifying an image size of the new image to be a processing target; and changing an overall size of the new image and performing, for each overall size of the new image, the process of detecting the specific object in the region in the new image associated with the information specifying the image size identical to the overall size.
6. The object detection method according to claim 1, comprising: detecting the size of the specific object in the image and setting the region in the image based on the size of the specific object; and thereafter performing, on the new image, the process of detecting the specific object for each region.
7. The object detection method according to claim 6, comprising setting, for each size determined to be identical to the size of the specific object according to a preset criterion, the region in the image including the specific object having the size determined to be identical.
8. The object detection method according to claim 6, comprising generating, for each division region obtained by dividing the image into a plurality of regions, a distribution of the size of the specific object located in the division region, and setting the region based on the distribution.
9. The object detection method according to claim 8, comprising generating, based on the distribution, a connection region obtained by connecting the division regions including the specific object having a size determined to be identical according to a preset criterion, and setting the region based on the connection region.
10. The object detection method according to claim 6, comprising setting the region so as to exclude a non-detection region that is a region where the specific object is not detected in the image.
11. The object detection method according to claim 6, comprising: performing detection of the size of the specific object in the image on a plurality of images; and setting the region in the image based on the size of the specific object detected from the plurality of images.
12. The object detection method according to claim 6, comprising detecting a size of a face of a person as the specific object.
13. An object detection apparatus comprising: at least one memory configured to store instructions; and at least one processor configured to execute the instructions to perform, for each region in an image set based on a size of a specific object detected in the image, a process of detecting the specific object on a new image.
14. The object detection apparatus according to claim 13, wherein the at least one processor is configured to execute the instructions to change an overall size of the new image and perform, for each overall size of the new image, the process of detecting the specific object in the region in the new image.
15. The object detection apparatus according to claim 13, wherein the at least one processor is configured to execute the instructions to: detect the size of the specific object in the image; set the region in the image based on the size of the specific object; and after the region is set, perform the process of detecting the specific object for each region on the new image.
16. The object detection apparatus according to claim 15, wherein the at least one processor is configured to execute the instructions to set, for each size determined to be identical to the size of the specific object according to a preset criterion, the region in the image including the specific object having the size determined to be identical.
17. The object detection apparatus according to claim 15, wherein the at least one processor is configured to execute the instructions to generate, for each division region obtained by dividing the image into a plurality of regions, a distribution of the size of the specific object located in the division region, and set the region based on the distribution.
18. The object detection apparatus according to claim 15, wherein the at least one processor is configured to execute the instructions to: associate the region set based on the size of the specific object with information specifying an image size of the new image to be a processing target; and change an overall size of the new image and perform, for each overall size of the new image, the process of detecting the specific object in the region in the new image associated with the information specifying the image size identical to the overall size.
19. The object detection apparatus according to claim 15, wherein the at least one processor is configured to execute the instructions to set the region so as to exclude a non-detection region that is a region where the specific object is not detected in the image.
20. A non-transitory computer-readable medium having a computer program stored thereon, the computer program comprising instructions for causing a processor of an information processing apparatus to execute performing, for each region in an image set based on a size of a specific object detected in the image, a process of detecting the specific object on a new image.
21. (canceled)
Description
BRIEF DESCRIPTION OF DRAWINGS
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
EXAMPLE EMBODIMENTS
First Example Embodiment
[0026] A first example embodiment of the present invention will be described with reference to
[0027] An information processing system according to the present invention is used for detecting the face of a person P who is in a place where many persons gather such as an airport, a station, a commercial facility and an event venue. For example, the information processing system detects the face of a person P who is in a target place to check the number of persons P and the degree of congestion in the place and to perform a process of matching with previously registered persons such as criminals. However, the information processing system according to the present invention is not limited to detecting the face of a person P for the abovementioned purpose, and may be used for detecting the face of a person P for any purpose. Moreover, the information processing system according to the present invention is not limited to detecting the face of a person P, and may detect any object.
[0028] [Configuration]
[0029] As shown in
[0030] The detection apparatus 10 includes, as shown in
[0031] The image acquiring unit 11 first accepts a captured image of a target place captured by the camera C at regular time intervals. For example, as shown in
[0032] It is desirable for a target place captured by the camera C to be a place where, for each region in the captured range, that is, in the captured image, the position and size of the face of an appearing person are within certain ranges. For example, it is desirable to capture a place where many persons whose face sizes are within a certain range appear in the upper right region of the captured image and many persons whose face sizes are within a different certain range appear in the lower left region of the captured image. However, a target place captured by the camera C may be a place where the position and size of the face of an appearing person in each region are not known in advance.
[0033] The size detecting unit 12 (a size detecting unit) extracts a person P in a captured image based on the movement, shape, color and so on of an object shown in the captured image, and also detects the size of the face (a specific object) of the extracted person P. Specifically, in this example embodiment, the size detecting unit 12 detects the eye distance of a person P as the face size of the person P. For example, as mentioned above, the size detecting unit 12 detects an eye of a person P based on the movement, shape, color and so on of an object in a captured image, and detects the distance between the two eyes of a single person. As one example, the size detecting unit 12 calculates, for each of persons Pa, Pb and Pc shown in a captured image, an eye distance on image of each of the persons as shown in
[0034] Then, the size detecting unit 12 stores so as to associate the detected eye distance of the person P and the position of the detected eyes of the person P on the captured image in the image storing unit 15. At this time, the size detecting unit 12 sets division regions r obtained by dividing an entire captured image G into a plurality of regions as indicated by dotted line in
[0035] The size detecting unit 12 detects the eye distance of a person P and stores so as to associate with a division region r in the same manner as described above for a plurality of captured images. Therefore, for each division region r, the eye distance of a person P located in the division region r is associated and stored in the image storing unit 15. As a result, no eye distance is associated with a division region r where no person P is detected, and a plurality of eye distances are associated with a division region r where a plurality of persons P are detected.
[0036] The region setting unit 13 (a region setting unit) sets a detection region R that is a region where a process of detecting the face of a person P is detected as will be described later on a captured image G, by using the eye distance of the person P detected as described above. At this time, the region setting unit 13 sets, for each reference eye distance, a detection region R so as to include a position where an eye distance determined to be identical to the value of the reference eye distance is detected. For example, the region setting unit 13 in this example embodiment sets reference eye distances to 100 pix, 150 pix and 200 pix, and sets detection regions Ra, Rb and Rc corresponding to the respective reference eye distances. The eye distances determined to be identical to the reference eye distances each have a range. As an example, the reference eye distance 100 pix has a range of 75 to 124 pix, the reference eye distance 150 pix has a range of 125 to 174 pix, for example, and the reference eye distance 200 pix has a range of 175 to 224 pix.
[0037] Specifically, the region setting unit 13 sets a detection region R in the following manner. First, the region setting unit 13 generates, for each division region r obtained by dividing a captured image G, a distribution d of eye distance associated with the division region r. For example, as shown in
[0038] Then, the region setting unit 13 sets, for the respective reference eye distances 100 pix, 150 pix and 200 pix, planes Fa, Fb and Fc representing the height positions of the respective eye distances as shown in
[0039] Then, the region setting unit 13 includes a division region r determined to pass through each of the planes Fa, Fb and Fc into a detection region R of a reference eye distance corresponding to each of the planes Fa, Fb and Fc. As an example, for a predetermined reference eye distance, a division region r where an eye distance within a range determined to be an identical value to the given reference eye distance is located is indicated by a gray region in
[0040] An example of the detection regions Ra, Rb and Rc set by the region setting unit 13 so as to correspond to the respective cases where a reference eye distance is 100 pix, 150 pix and 200 pix is shown in
[0041] The region setting unit 13 may exclude a no-detection region R′ where the face of a person P, that is, an eye distance is not detected in a captured image from the detection regions Ra, Rb and Rc set as described above and then set final detection regions Ra, Rb and Rc. At this time, the region setting unit 13 may exclude not a unit of a division region r but a predetermined range around coordinates at which an eye distance is not detected in a captured image as a no-detection region and then set detection regions Ra, Rb and Rc.
[0042] Then, the region setting unit 13 stores region information that specify positions on captured image of the detection regions Ra, Rb and Rc set as described above into the region information storing unit 16. At this time, the region setting unit 13 stores so as to associate each of the region information of the detection regions Ra, Rb and Rc and information that specifies the image size of a new captured image to be the target of a process of detecting the face of a person P as will be described later with each other. The later face detection process is performed by detecting a face having a preset eye distance (for example, 100 pix). For this, information that specifies the image size of a new captured image is determined in accordance with a preset magnification of an eye distance at the time of performing the later face detection process with reference to the reference eye distance corresponding to each of the detection regions Ra, Rb and Rc.
[0043] For example, a case where detection of a face having an eye distance of 100 pix in a later face detection process is previously set will be described. In the case of an eye distance at the face detection process of 100 pix with reference to the reference eye distance of 100 pix, the magnification is 1 time, so that the face detection process can be performed by determining the image size of a new captured image to be 1 time as well. Therefore, information of “1 time” is associated with the detection region Ra corresponding to the reference eye distance of 100 pix as information that specifies the image size of a new captured image. Moreover, in the case of an eye distance at the face detection process of 100 pix with reference to the reference eye distance of 150 pix, the magnification is about 0.7 times, so that the face detection process can be performed by determining the image size of a new captured image to be 0.7 times as well. Therefore, information of “0.7 times” is associated with the detection region Rb corresponding to the reference eye distance of 150 pix as information that specifies the image size of a new captured image. Moreover, in the case of an eye distance at the face detection process of 100 pix with reference to the reference eye distance of 200 pix, the magnification is 0.5 times, so that the face detection process can be performed by determining the image size of a new captured image to be 0.5 times as well. Therefore, information of “0.5 times” is associated with the detection region Rc corresponding to the reference eye distance of 200 pix as information that specifies the image size of a new captured image.
[0044] The region setting unit 13 is not limited to associating the magnification of a new captured image as described above as information that specifies the image size of the new captured image to be associated with each of the region information of the detection regions Ra, Rb and Rc. For example, the region setting unit 13 may associate the image size of a new captured image, or may associate any other information.
[0045] The region setting unit 13 is not necessarily limited to setting the detection region R by the abovementioned method, and may set the detection region R by any method. Moreover, the abovementioned detection region R is not necessarily limited to being set by the region setting unit 13, and may be set beforehand by any method and stored into the region information storing unit 16.
[0046] The object detecting unit 14 (an object detecting unit) performs a process of detecting the face of a person P on a new captured image after a detection region R is set as described above. Specifically, the object detecting unit 14 acquires a new captured image captured by the camera C from the image acquiring unit 11, and changes the overall image size of the new captured image to a predetermined image size. For example, the object detecting unit 14 sequentially changes the overall image size of the new captured image to 1 time, 0.7 times, and 0.5 times. Then, the object detecting unit 14 acquires information of a detection region R associated with each of the magnifications of the changed overall image sizes of the new captured image from the region information storing unit 16. Furthermore, the object detecting unit 14 performs, on the new captured image of the changed image size, a process of detecting a face having an eye distance of 100 pix in the detection region R associated with the image size. The face detection process is performed by detecting an eye of a person in a captured image based on the movement, shape, color and so on of an object shown in the captured image, detecting the two eyes of a single person having a distance of 100 pix, and detecting a face region based on the position of the eyes. In the face detection process, a face region of an eye distance within a predetermined range before and after the eye distance of 100 pix is also detected. For example, a face region of an eye distance from 75 to 124 pix is also detected in a captured image.
[0047] Here, an example of the face detection process by the object detecting unit 14 will be described with reference to
[0048] Further, the object detecting unit 14 changes the overall image size of the new captured image G to 0.7 times as shown in
[0049] Although the object detecting unit 14 performs a detection process on a new captured image by using a detection region R set by the region setting unit 13 as described above, a detection region R is not necessarily limited to being set by the region setting unit 13. For example, information of a detection region R as described above set by any means may be previously stored in the region information storing unit 16, and the object detecting unit 14 may retrieve and use the information of the detection region R to perform the detection process in the detection region R on a new image.
[Operation]
[0050] Next, an operation of the above information processing system will be described majorly with reference to a flowchart of
[0051] First, the information processing system captures an image of a target place by a camera C, and the detection apparatus 10 acquires the captured image (step S1). Then, the detection apparatus 10 detects the size of the face of a person P in the captured image (step S2). Here, as shown in
[0052] Subsequently, the detection apparatus 10 generates the distribution of the detected eye distance of the face of the person P (step S3). For example, as shown in
[0053] After that, every time a new captured image is captured by the camera C, the detection apparatus 10 acquires the new captured image (step S5) and performs a person detection process on the new captured image. At this time, the detection apparatus 10 changes the overall image size of the new captured image to 1 time, 0.7 times, and 0.5 times (step S6). Then, the detection apparatus 10 performs, in the captured image whose magnification has been changed to each of the magnifications, detection of a face having a specific eye distance (for example, 100 pix) only in any of the detection regions Ra, Rb and Rc associated with the magnification (step S7).
[0054] For example, as shown in
[0055] As described above, in this example embodiment, the eye distance of a person P appearing in a captured image is detected first, and a detection region R is set for each eye distance in accordance with the appearing position. Then, at the time of a face detection process on a new captured image, the overall image size is changed, and the face detection process is performed only in a detection region R set in accordance with the changed image size. Consequently, there is no need to repeatedly perform the face detection process on the entire region of each new captured image whose image size has been changed. That is to say, it is sufficient to perform the face detection process only in one detection region for each changed image size of a new captured image. As a result, it is possible to increase the speed of the face detection process and reduce the load.
[0056] Although a case where the detection apparatus 10 detects the face of a person P in a captured image is illustrated above, a target to be detected may be any object. In this case, the detection apparatus 10 detects a predetermined size of an object to be a detection target instead of the eye distance of a person P, and sets a region in an image for each reference size in accordance with the predetermined size. Then, the detection apparatus 10 changes the magnification of a new image, and performs an object detection process only in a region set for each image whose magnification has been changed.
<Second Example Embodiment>
[0057] Next, a second example embodiment of the present invention will be described with reference to
[0058] First, a hardware configuration of an object detection apparatus 100 in this example embodiment will be described with reference to
[0068] Then, the object detection apparatus 100 can structure and include an object detecting unit 121 shown in
[0069]
[0070] Then, the object detection apparatus 100 executes an object detection method shown in the flowchart of
[0071] As shown in
[0072] In this example embodiment, with the configuration as described above, the size of an object appearing in a captured image is detected first, and a region is set for each size in accordance with the appearing position. Then, a process of detecting the object is performed only in the set region on a new image. Consequently, there is no need to repeatedly performing the object detection process on the entire region of a new image. As a result, it is possible to increase the speed of the object detection process and reduce the load.
<Supplementary Notes>
[0073] The whole or part of the example embodiments disclosed above can be described as the following supplementary notes. The outline of the configurations of an object detection apparatus, an object detection method and a program according to the present invention will be described below. However, the present invention is not limited to the following configurations.
(Supplementary Note 1)
[0074] An object detection method comprising [0075] performing, for each region in an image set based on a size of a specific object detected in the image, a process of detecting the specific object on a new image.
(Supplementary Note 2)
[0076] The object detection method according to Supplementary Note 1, comprising [0077] changing an overall size of the new image and performing, for each overall size of the new image, the process of detecting the specific object in the region in the new image.
(Supplementary Note 3)
[0078] The object detection method according to Supplementary Note 2, comprising [0079] performing the process of detecting the specific object in one region for each overall size of the new image.
(Supplementary Note 4)
[0080] The object detection method according to Supplementary Note 2 or 3, comprising [0081] performing, for each region in the new image, the process of detecting the specific object having a specific size.
(Supplementary Note 5)
[0082] The object detection method according to any of Supplementary Notes 1 to 4, comprising: [0083] associating the region set based on the size of the specific object with information specifying an image size of the new image to be a processing target; and [0084] changing an overall size of the new image and performing, for each overall size of the new image, the process of detecting the specific object in the region in the new image associated with the information specifying the image size identical to the overall size.
(Supplementary Note 6)
[0085] The object detection method according to any of Supplementary Notes 1 to 5, comprising: [0086] detecting the size of the specific object in the image and setting the region in the image based on the size of the specific object; and [0087] thereafter performing, on the new image, the process of detecting the specific object for each region.
(Supplementary Note 7)
[0088] The object detection method according to Supplementary Note 6, comprising [0089] setting, for each size determined to be identical to the size of the specific object according to a preset criterion, the region in the image including the specific object having the size determined to be identical.
(Supplementary Note 8)
[0090] The object detection method according to Supplementary Note 6 or 7, comprising [0091] generating, for each division region obtained by dividing the image into a plurality of regions, a distribution of the size of the specific object located in the division region, and setting the region based on the distribution.
(Supplementary Note 9)
[0092] The object detection method according to Supplementary Note 8, comprising [0093] generating, based on the distribution, a connection region obtained by connecting the division regions including the specific object having a size determined to be identical according to a preset criterion, and setting the region based on the connection region.
(Supplementary Note 10)
[0094] The object detection method according to any of Supplementary Notes 6 to 9, comprising [0095] setting the region so as to exclude a non-detection region that is a region where the specific object is not detected in the image.
(Supplementary Note 11)
[0096] The object detection method according to any of Supplementary Notes 6 to 10, comprising: [0097] performing detection of the size of the specific object in the image on a plurality of images; and [0098] setting the region in the image based on the size of the specific object detected from the plurality of images.
(Supplementary Note 12)
[0099] The object detection method according to any of Supplementary Notes 6 to 11, comprising [0100] detecting a size of a face of a person as the specific object.
(Supplementary Note 13)
[0101] An object detection apparatus comprising [0102] an object detecting unit configured to perform, for each region in an image set based on a size of a specific object detected in the image, a process of detecting the specific object on a new image.
(Supplementary Note 14)
[0103] The object detection apparatus according to Supplementary Note 13, wherein [0104] the object detecting unit is configured to change an overall size of the new image and perform, for each overall size of the new image, the process of detecting the specific object in the region in the new image.
(Supplementary Note 14.1)
[0105] The object detection apparatus according to Supplementary Note 14, wherein [0106] the object detecting unit is configured to perform the process of detecting the specific object in one region for each overall size of the new image.
(Supplementary Note 14.2)
[0107] The object detection apparatus according to Supplementary Note 14 or 14.1, wherein [0108] the object detecting unit is configured to perform, for each region in the new image, the process of detecting the specific object having a specific size.
(Supplementary Note 15)
[0109] The object detection apparatus according to any of Supplementary Note 13 to 14.2, comprising [0110] a size detecting unit configured to detect the size of the specific object in the image; and [0111] a region setting unit configured to set the region in the image based on the size of the specific object, [0112] wherein the object detecting unit is configured to, after the region is set, perform the process of detecting the specific object for each region on the new image.
(Supplementary Note 16)
[0113] The object detection apparatus according to Supplementary Note 15, wherein [0114] the region setting unit is configured to set, for each size determined to be identical to the size of the specific object according to a preset criterion, the region in the image including the specific object having the size determined to be identical.
(Supplementary Note 17)
[0115] The object detection apparatus according to Supplementary Note 15 or 16, wherein [0116] the region setting unit is configured to generate, for each division region obtained by dividing the image into a plurality of regions, a distribution of the size of the specific object located in the division region, and set the region based on the distribution.
(Supplementary Note 17.1)
[0117] The object detection apparatus according to Supplementary Note 17, wherein [0118] the region setting unit is configured to generate, based on the distribution, a connection region obtained by connecting the division regions including the specific object having a size determined to be identical according to a preset criterion, and setting the region based on the connection region.
(Supplementary Note 18)
[0119] The object detection apparatus according to any of Supplementary Notes 15 to 17.1, wherein: [0120] the region setting unit is configured to associate the region set based on the size of the specific object with information specifying an image size of the new image to be a processing target; and [0121] the object detecting unit is configured to change an overall size of the new image and perform, for each overall size of the new image, the process of detecting the specific object in the region in the new image associated with the information specifying the image size identical to the overall size.
(Supplementary Note 19)
[0122] The object detection apparatus according to any of Supplementary Notes 15 to 18, wherein [0123] the region setting unit is configured to set the region so as to exclude a non-detection region that is a region where the specific object is not detected in the image.
(Supplementary Note 20)
[0124] A computer program comprising instructions for causing a processor of an information processing apparatus to execute [0125] performing, for each region in an image set based on a size of a specific object detected in the image, a process of detecting the specific object on a new image.
(Supplementary Note 21)
[0126] The computer program according to Supplementary Note 20, comprising instructions for causing the processor of the information processing apparatus to further execute: [0127] detecting the size of the specific object in the image and setting the region in the image based on the size of the specific object; and [0128] thereafter performing, on the new image, the process of detecting the specific object for each region.
[0129] The abovementioned programs can be stored by using various types of non-transitory computer-readable mediums and supplied to a computer. The non-transitory computer-readable mediums include various types of tangible storage mediums. Examples of the non-transitory computer-readable mediums include a magnetic recording medium (for example, a flexible disk, a magnetic tape, a hard disk drive), a magnetooptical recording medium (for example, a magnetooptical disk), a CD-ROM (Read Only Memory), a CD-R, a CD-R/W, and a semiconductor memory (for example, a mask ROM, a PROM (Programmable ROM), an EPROM (Erasable PROM), a flash ROM, a RAM (Random Access Memory). The programs may also be supplied to a computer by various types of transitory computer-readable mediums. Examples of the transitory computer-readable mediums include an electric signal, an optical signal, and an electromagnetic wave. The transitory computer-readable mediums can supply the programs to a computer via a wired communication path such as an electric wire and an optical fiber or via a wireless communication path.
[0130] Although the present invention has been described above with reference to the example embodiments and the like, the present invention is not limited to the above example embodiments.
[0131] The configurations and details of the present invention can be changed in various manners that can be understood by one skilled in the art within the scope of the present invention.
DESCRIPTION OF NUMERALS
[0132] 10 detection apparatus
[0133] 11 image acquiring unit
[0134] 12 size detecting unit
[0135] 13 region setting unit
[0136] 14 object detecting unit
[0137] 15 image storing unit
[0138] 16 region information storing unit
[0139] C camera
[0140] P person
[0141] 100 image processing apparatus
[0142] 101 CPU
[0143] 102 ROM
[0144] 103 RAM
[0145] 104 programs
[0146] 105 storage device
[0147] 106 drive device
[0148] 107 communication interface
[0149] 108 input/output interface
[0150] 109 bus
[0151] 110 storage medium
[0152] 111 communication network
[0153] 121 object detecting unit