DEVICE AND METHOD FOR DISTINGUISHING AND COUNTING PERSONS AND OBJECTS
20210397875 · 2021-12-23
Assignee
Inventors
Cpc classification
G01S17/58
PHYSICS
G06V10/145
PHYSICS
G06V10/60
PHYSICS
G01S7/4802
PHYSICS
G06V40/10
PHYSICS
G06T7/521
PHYSICS
G06V10/22
PHYSICS
International classification
G06T7/521
PHYSICS
Abstract
The invention relates to a method for distinguishing, detecting and counting persons and/or objects in facilities and/or vehicles for conveying persons and/or goods, with the method steps: emitting radiation from a radiation source, deflecting the radiation with an element for deflecting the radiation, generating a light pattern in a detection region, detecting the radiation backscattered by persons and/or objects situated in the detection region in a radiation detector, and counting the persons and/or objects in a counting region, wherein the counting region is arranged in a region between 30 cm in front of and 30 cm behind an entrance to facilities and/or to the vehicle for conveying persons and/or objects. The invention also relates to a corresponding device for performing the method.
Claims
1. A method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods with the following method steps: Emitting radiation (S) from a radiation source (10) Deflecting the radiation (S) with an element for deflecting the radiation (30) Generating a light pattern (50) in a detection region (40) Detecting the radiation (S) backscattered by persons and/or objects situated in the detection region (40) in a radiation detector (20) Counting the persons and/or objects in a counting region (70) wherein the counting region (70) is arranged in a region between 30 cm in front of and 30 cm behind an entrance (150) to the facilities and/or to the vehicle for conveying persons and/or objects.
2. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 1 characterized in that the counting region (70) is arranged in a region 20 cm in front of and/or 20 cm behind entrance (150) to the facilities and/or to the vehicle for conveying persons and/or objects and preferably between 10 cm in front of and/or 10 cm behind the entrance (150) to the facilities and/or to the vehicle for conveying persons and/or objects.
3. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 1 characterized in that the counting region (70) comprises a counting volume (90), wherein a counting event occurs when a person and/or an object enters the counting volume (90) and/or exits the counting volume (90).
4. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 1 characterized in that the counting region (70) comprises a counting area (80, 81), wherein a counting event occurs when a person and/or an object enters the counting area (80, 81) and/or exits the counting area (80, 81).
5. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 1 characterized in that the counting region (70) comprises two counting areas (80, 81), wherein a counting event occurs when a person and/or an object enters one of the counting planes (80, 81) and/or exits one of the counting areas (80, 81).
6. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 5 characterized in that a first counting area (80) faces a vehicle interior and a second counting area (81) faces the vehicle exterior, wherein a counting event occurs when a person and/or an object enters the first counting area (80) and/or exits the second counting area (81).
7. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to e claim 1 characterized in that the location of the counting region (78) and/or of the counting area (81, 80) is chosen depending on the type of detected object.
8. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 7 characterized in that a light pattern (50) is detected in the detection region (40).
9. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 8 characterized in that a shift of the light pattern (50) is detected in the detection region (40).
10. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 9 characterized in that the length of the shift is calculated and a depth value is determined from the length of the shift.
11. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 10 characterized in that the detected synchronously shifted light patterns (50) are compared with characteristic known patterns.
12. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 8 characterized in that the light pattern (50) is assigned to an object type.
13. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 1 characterized in that the counting event is triggered by the entrance and/or the exiting of the counting region (70) and/or of the counting area (80, 81) of the light pattern (50).
14. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 1 characterized in that the method is suitable for distinguishing, detecting and/or counting persons and objects in facilities and/or vehicles for conveying persons and/or goods.
15. The method for distinguishing, detecting and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 1 characterized in that the light pattern (50) has a beam density ρ.sub.s of 5*10.sup.2/4*π sr.sup.−1≤ρ.sub.s≤10.sup.6/4*π sr.sup.−1 preferably at least 1*10.sup.3/4*π sr.sup.−1 and particularly preferably at least 5*10.sup.3/4*π sr.sup.−1 and/or preferably maximally 5*10.sup.5/4*π sr.sup.−1 and particularly preferably maximally 1*10.sup.5/4*π sr.sup.−1.
16. A person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying passenger and/or goods, comprising: a radiation source (10), a radiation detector (20), an element (30) for deflecting the radiation (S) leaving the radiation source (10) wherein the element (30) for deflecting the radiation (S) leaving the radiation source (10) is suitable for generating a light pattern (50) in a detection region (40), and wherein the person- and/or object-counting device is suitable for counting in a counting region (70) persons and/or objects situated therein, wherein the counting region (70) comprises a sub-region of the detection region (40) and is arranged in a region between 30 cm in front of and 30 cm behind an entrance (150) to the facilities and/or to the vehicle for conveying persons and/or objects.
17. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 16 characterized in that the counting region (70) is arranged in a region 20 cm in front of and/or 20 cm behind an entrance (150) of the facility and/or of the vehicle for conveying persons and/or objects and preferably between 10 cm in front of and/or 10 cm behind the entrance (150) to the facilities and/or to the vehicle for conveying persons and/or objects.
18. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 16 characterized in that the counting region (70) comprises a counting volume (90), wherein a counting event occurs when a person and/or an object enters the counting volume (90) and/or exits the counting volume (90).
19. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 16 characterized in that the counting region (70) comprises a counting area (80, 81), wherein a counting event occurs when a person and/or an object enters the counting area (80, 81) and/or exits the counting area (80, 81).
20. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 16 characterized in that the counting region (70) comprises two counting areas (80, 81), wherein a counting event occurs when a person and/or an object enters one of the counting planes (80, 81) and/or exits one of the counting areas (80, 81).
21. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 20 characterized in that a first counting area (80) faces the vehicle interior and a second counting area (81) faces the vehicle exterior, wherein a counting event occurs when a person and/or an object enters the first counting area (80) and/or exits the second counting area (81).
22. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 16 characterized in that the location of the counting region (70) and/or of the counting area (80, 81) is chosen depending on the type of detected object.
23. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 19 characterized in that the location of the counting areas (80, 81) is predefined.
24. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 16 characterized in that the person- and/or object-counting device (1) has an interface to a control and/or evaluation apparatus (60).
25. The person- and/or object-counting device (1) for detecting, categorizing and counting persons (170) and/or objects (171) in facilities and/or vehicles (160) for conveying persons and/or goods according to claim 16 characterized in that the light pattern (50) has a beam density ρ.sub.s of 5*10.sup.2/4*π sr.sup.−1≤ρ.sub.s≤10.sup.6/4*π sr.sup.−1 preferably at least 1*10.sup.3/4*π sr.sup.−1 and particularly preferably at least 5*10.sup.3/4*π sr.sup.−1 and/or preferably maximally 5*10.sup.5/4*π sr.sup.−1 and particularly preferably maximally 1*10.sup.5/4*π sr.sup.−1.
Description
[0071] The figures show:
[0072]
[0073]
[0074]
[0075]
[0076]
[0077]
[0078]
[0079]
[0080]
[0081]
[0082]
[0083]
[0084]
[0085]
[0086]
[0087]
[0088]
[0089]
[0090]
[0091]
[0092]
[0093]
[0094]
[0095]
[0096]
[0097]
[0098] The device for detecting, categorizing and counting persons and/or objects 1 has a radiation source 10, an element for deflecting the radiation 30, and a radiation detector 20. In addition, an electronic control and evaluation apparatus 60 is installed in or within communication range of the device for detecting, categorizing and counting persons and/or objects 1, which are connected to one another by means of interfaces.
[0099] The device for detecting, categorizing and counting persons and/or objects 1 is situated, in all the exemplary embodiments shown here, in the upper region of the region for getting into and getting out of the facility or the vehicle.
[0100] To describe the location of the device for detecting, categorizing and counting persons and/or objects 1 in space, the central projection point of the radiation source 10 is used and the location of the optical axis of the radiation source 10, meaning the straight line which is perpendicular to the element for deflecting the radiation 30 and contains the central projections point. If the elements of the device for detecting, categorizing and counting persons and/or objects 1 are firmly connected to one another, the geometric location of the device for detecting, categorizing and counting persons and/or objects 1 is thus also clearly defined in space. In order to ensure the functionality of the device for detecting, categorizing and counting persons and/or objects 1, the projection point lies between 1.7 m (minimum) and 20 m (maximum) vertically above the floor of the vehicle. In typical vehicles, the projection point lies between 1.8 m to 3 m vertically above the floor of the vehicle.
[0101] To distinguish, detect and count persons and/or objects in vehicles for conveying persons and/or goods, the radiation source 10 of the device for detecting, categorizing and counting persons and/or objects 1 emits radiation S in the first method step. The ambient light can contain sunlight or light from artificial illumination sources. It is therefore to be expected that radiation from the near infrared wavelength range is contained in the ambient light. Such ambient light can overlay the light that is emitted by the radiation source 10. As a solution, monochromatic laser radiation and a spectrally selective detector is used. The wavelength is chosen such that the radiation is invisible to the human eye. When choosing the wavelength, it must be ensured that the image sensor of the radiation detector 20 has a sufficiently high quantum efficiency to generate enough photoelectrons. For the realization of the invention, light of the wavelength from 780 nm to 1000 nm is suitable. The invention thus works reliably under the ambient conditions in the mobile range.
[0102] The laser radiation S is collimated by a lens and guided perpendicularly onto the element for deflecting the radiation 30. The element for deflecting the radiation 30 is usually a diffractive optical element (DOE), which is structured such that, in the second method step for distinguishing, detecting and counting persons and/or objects in vehicles for conveying persons and/or goods, a suitable detection region 40 having a counting area 80 is created behind the DOE 30. In the context of the invention, however, any optical arrangement which generates a light pattern 50 can also be used. In this exemplary embodiment, the counting area 80 is chosen such that it coincides with the door cut-out of the region for getting in and getting out.
[0103]
[0104] The device for detecting, categorizing and counting persons and/or objects 1 has a radiation source 10, an element for deflecting the radiation 30, and a radiation detector 20. In addition, an electronic control and evaluation apparatus 60 is installed in or within communication range of the device for detecting, categorizing and counting persons and/or objects 1, which are connected to one another by means of interfaces. The radiation source 10 generates continuous monochromatic laser radiation S with a wavelength in the range from 780 nm to 1000 nm.
[0105] In the third method step for distinguishing, detecting and counting persons and/or objects in facilities and/or vehicles for conveying persons and/or goods, the device for detecting, categorizing and counting persons and/or objects 1 generates a light pattern 50. The projected light pattern 50 consists of small, delimited, illuminated regions and of dark, i.e. non-illuminated, regions. The illuminated regions can be abstracted in a good approximation as light points. The location of the light points can be described assuming the model of light beams originating from a central projection point in the radiation source 10.
[0106] The generation of 3D depth data from a spatial region is central to the invention. In order to obtain such 3D data, the triangulation principle is expanded into the third spatial dimension. In order to obtain clear depth data, the correspondence problem between features of the detected images from the radiation detector 20 and the features that are projected into the space must be solved. The light pattern 50 provides the features required to solve the correspondence problem.
[0107] The light pattern 50 is designed in this case such that the projected light pattern 50 in small image sections along the direction of shift of the persons and/or objects is unique at any possible position.
[0108] The density of the pattern points determines the resolution of the detected persons and objects. Since the pattern points are created through central projection, the number of the light beams per spatial angle is a measure for the resulting point density. The spatial angle Ω is defined as the area content A of a sub-area of a sphere surface, divided by the square of the radius r of the sphere Ω=A/r.sup.2. Here, the center point of the sphere lies in the central projection point. N is the number of light beams that fall into the detection region. These light beams penetrate a sphere surface with the radius 1 m and the spatial angle 4π sr. Thus, the beam density in the detection region 40 of ρ.sub.s=N/4π sr.sup.−1 results. In the simplest case, two light beams are sufficient for counting persons. The beam density is then ½π sr.sup.−1. In order to obtain more data, up to 10.sup.6 points in the detection region 40 can be used. The beam density is then 10.sup.6/4π sr.sup.−1.
[0109] The light pattern has a code which establishes uniqueness. This is ensured here by a specific arrangement of the light points of the light pattern, in which each point of the light pattern has an environment (submatrix) of light points uniquely assigned to it.
[0110]
[0111] In the fourth method step for distinguishing, detecting and counting persons and/or objects in facilities and/or vehicles for conveying persons and/or goods, the backscattered radiation from persons and/or objects situated in the detection region 40 is detected in the radiation detector 20. The imaginary line between the optical axis of the radiation source 10 and the optical axis of the radiation detector 20 is referred to as the baseline. If a person enters the detection region 40 over time, the radiation detector 20 observes a shift of parts of the light pattern 50 along the baseline. That program that is executed on the control and evaluation apparatus 60 compares the detected images from the radiation detector 20 with the projected light patterns 50. For small image regions which have experienced a shift in relation to the known light pattern 50, the program calculates the length of the shift, known as the disparity. Since the light pattern 50 on small image regions along the baseline is unique, exactly one disparity is found for each image region. A depth value can be calculated for a small image region from the disparity on the basis of the geometric relationships. In the result, a 3D point cloud 190 is now provided for further evaluation. Optionally, a coded light pattern (see
[0112]
[0113] Information about the scene in the detection region 40, including persons and objects present, is represented by the depth values of the 3D point cloud 190 (
[0114] Over time, a series of such characteristic points 200, which form a trajectory with a known directional progression (
[0115]
[0116] It has been shown that, for typical operation in vehicles for conveying persons and/or goods, the most favorable point density of the light pattern 50 is one that corresponds to a beam density ρ.sub.s of at least 1*10.sup.3/4*π sr.sup.−1 and maximally 5*10.sup.4/4*π sr.sup.−1, depending on the distance of the device for detecting, categorizing and counting persons and/or objects 1 from the persons and objects to be detected or the detection region 40. Illustrations of these point densities of the light pattern 50 are shown in
[0117]
[0118] The device for detecting, categorizing and counting persons and/or objects 1 has a radiation source 10, an element for deflecting the radiation 30, and a radiation detector 20. In addition, an electronic control and evaluation apparatus 60 is installed in or within communication range of the device for detecting, categorizing and counting persons and/or objects 1, which are connected to one another by means of interfaces. The radiation source 10 generates continuous monochromatic laser radiation S with a wavelength in the range from 780 nm to 1000 nm.
[0119] An Important feature of the invention is the monitoring of a spatial region. The light of the light pattern projector 100 falls from a central projection point into this spatial region. The radiation detector 20 is oriented such that its spatial field of vision is largely identical to the illuminated spatial region. The common spatial region is the detection region 40 of the device for detecting, categorizing and counting persons and/or objects 1.
[0120] The detection region 40 is described by the spatial angle of the central projection. Depending on the choice of the aperture, the detection region 40 is described by suitable geometric figures, the geometric origins of which lie in the central projection point of the device for detecting, categorizing and counting persons and/or objects 1. With a rectangular aperture, it is the pyramid with a rectangular and even outline; with a round aperture, it is the straight circular cone. The spatial angle of the straight circular cone is: Ω=4π sin 2 (φ/4), wherein φ is the full beam angle. The spatial angle of the pyramid is: Ω=4 Arcsin (sin(φx/2) sin(φy/2)), wherein φx and φy are the two full beam angles. For the use of the invention with the requirement of direction recognition, two light beams are sufficient. The two beams are slightly divergent from one another but detect predominantly the same spatial region. With this geometry, a spatial angle of at least Ω=0.006 sr can be detected. By using additional beams, the detection region 40 can be extended up to the hemisphere. The spatial half below the plane of installation of the device for detecting, categorizing and counting persons and/or objects 1 is then completely monitored; the spatial angle is 2π sr. To carry out the invention, it is sufficient to choose the detection region 40 such that at least one part of the human body of a person and/or one part of an object is detected in the defined detection region 40.
[0121] The orientation and location of the counting areas 80, 81 or of the counting volume 90 is shown in
[0122] A counting area 80 is a defined area in the detection region 40 (
[0123] In the context of the invention, distances of the counting plane 80 of maximally 250 cm in front to 250 cm behind the opening of the door portal are also possible. In the general case of curved door portal areas and curved counting areas 80, 81, the distance refers to the shortest distance between the areas. In the context of the invention, at least one counting area 80 which intersects the detection region 40 is defined. Moving persons and/or objects must at least partially pass through the counting area 80 in order to trigger a counting event.
[0124] In order to increase the reliability of the counting, two (
[0125]
[0126] In the simplest case, the characteristic point 200 having the smallest distance from the device for detecting, categorizing and counting persons and/or objects 1 is determined from the points of the 3D point cloud 190 for representing a person or an object (
[0127] The characteristic point 200 can also be determined by a center of gravity method (
[0128]
[0129] The counting region (70) can also be configured as a counting volume 90 (
[0130] When the person enters (
[0131] When the person exits (
[0132] The program of the control and evaluation apparatus 60 follows the trajectory of the 3D point cloud 190 over time and thus recognizes whether a person enters or exits the facility or the vehicle.
[0133] The counting region (70) can also be defined by two counting areas 80, 81 (
[0134] When the person enters (
[0135] When the person exits (
[0136] The program of the control and evaluation apparatus 60 follows the penetration of the sequence of the counting areas 80, 81 over time and thus recognizes whether a person enters or exits the facility or the vehicle.
[0137] The counting region (70) can also be defined by one counting area 80 (
[0138] When the person enters (
[0139] The program of the control and evaluation apparatus 60 follows the trajectory of the characteristic point 200 over time and thus recognizes whether a person enters or exits the facility or the vehicle.
[0140]
[0141] Along with the objective 110 and the bandpass filter 120, the image sensor 130 forms the radiation detector 20. The bandpass filter 120 is only permeable to light in a narrow spectral window. The central wavelength of the bandpass filter 120 corresponds to the wavelength of the light emitted by the radiation source 10. This prevents light of other wavelengths from exposing the image sensor 130. The image data are processed by the control and evaluation apparatus 60 and evaluated by means of a suitable program. The device for detecting, categorizing and counting persons and/or objects 1 is connected for this purpose via an interface to the control and evaluation apparatus 60. The carrier structure 140 brings the radiation detector 20 and the light pattern projector 100 into a defined position and thus realizes what is known as the baseline.
[0142] By using the light pattern projector 100, the device for detecting, categorizing and counting persons and/or objects 1 actively provides light and can also work in dark environments. Since the illumination is not over a large area, but rather only light is guided in pattern regions, a smaller light power is necessary than with large-area illumination. Accordingly, less energy is consumed and less waste heat is created.
LIST OF REFERENCE SIGNS
[0143] 1 Device for detecting, categorizing and counting persons and/or objects [0144] 10 Radiation source [0145] 20 Radiation detector [0146] 30 Element for deflecting the radiation [0147] 40 Detection region [0148] 50 Light pattern [0149] 60 Control and evaluation apparatus [0150] 70 Counting region [0151] 80, 81 Counting area [0152] 90 Counting volume [0153] 100 Light pattern projector [0154] 110 Objective [0155] 120 Bandpass filter [0156] 130 Image sensor [0157] 140 Carrier structure [0158] 150 Door portal [0159] 160 Facility or vehicle for conveying persons and/or goods [0160] 170 Person [0161] 171 Object [0162] 190 Point of the 3D point cloud [0163] 200 Characteristic point [0164] S Emitted radiation