VEHICLE MONITORING SYSTEM AND METHOD OF MONITORING VEHICLES

Abstract

A vehicle monitoring system configured to detect and localise an anomaly in or on a vehicle. The system includes a detector configured to detect an invisible indicator originating from or emitted by the anomaly and generate a detection signal associated with the invisible indicator, a camera configured to capture an image of the vehicle, and a controller configured to process the detection signal generated by the detector and the image of the vehicle captured by the camera. The controller is further configured to, based on processing of the image and the detection signal, generate a visualisation of the detection signal overlaid onto the image of the vehicle for localisation of the anomaly in or on the vehicle.

Claims

1-25. (canceled)

26. A vehicle monitoring system configured to identify a vehicle carrying an anomaly within a stream of traffic, the system comprising: a detector configured to detect an invisible indicator originating from or emitted by the anomaly and generate a detection signal associated with the invisible indicator; a camera configured to capture an image of the vehicle; and a controller configured to process the detection signal generated by the detector and the image of the vehicle captured by the camera, to determine whether the detection signal exceeds a threshold, and to, based on processing of the image and the detection signal, generate a visualization of the detection signal overlaid onto the image of the vehicle, wherein the visualization of the detection signal overlaid onto the image of the vehicle allows localization of the anomaly in or on the vehicle.

27. The vehicle monitoring system of claim 26, wherein the detector is configured to detect at least one invisible indicator from a group consisting of magnetic fields, ionizing radiation, alpha particles, beta particles, gamma rays, hazardous or harmful radiation, and invisible electromagnetic radiation.

28. The vehicle monitoring system of claim 26, wherein the detector and the camera are configured to monitor the vehicle via the same face of the vehicle.

29. The vehicle monitoring system of claim 28, further comprising an under vehicle module configured to house the detector and the camera to monitor the vehicle via an underside of the vehicle.

30. The vehicle monitoring system of claim 26, wherein the camera is configured to capture the image as a scan of the vehicle.

31. The vehicle monitoring system of claim 26, wherein the controller is further configured to obtain vehicle information associated with the vehicle from a database and dynamically set the threshold based on the vehicle information.

32. The vehicle monitoring system of claim 26, wherein the controller is further configured to generate an alarm signal when the detection signal exceeds the threshold, the system further comprising an alarm module configured to receive the alarm signal from the controller and output a warning.

33. The vehicle monitoring system of claim 26, wherein the controller is further configured to log the detection signal in a memory.

34. The vehicle monitoring system of claim 26, further comprising a display configured to show output of the system and/or at least one of: the vehicle information; the warning; the image of the vehicle; and the visualization of the detection signal overlaid onto the image of the vehicle.

35. The vehicle monitoring system of claim 26, wherein the detector comprises an array of sensors configured to detect the invisible indicator or a sweeping sensor configured to detect the invisible indicator.

36. A method of monitoring vehicles for identifying a vehicle carrying an anomaly within a stream of traffic, the method comprising: detecting an invisible indicator originating from or emitted by the anomaly; generating a detection signal associated with the invisible indicator; determining whether the detection signal exceeds a threshold; capturing an image of the vehicle; generating a visualization of the detection signal overlaid onto the image of the vehicle, based on processing of the image and the detection signal, wherein the visualization of the detection signal overlaid onto the image of the vehicle allows localization of the anomaly in or on the vehicle.

37. The method of claim 36, wherein detecting an invisible indicator of the anomaly comprises detecting at least one invisible indicator from a group consisting of magnetic fields, ionizing radiation, alpha particles, beta particles, gamma rays, hazardous or harmful radiation, and invisible electromagnetic radiation.

38. The method of claim 36, wherein the detecting of the invisible indicator and the capturing of the image are performed by monitoring the vehicle via the same face of the vehicle.

39. The method of claim 38, wherein the detecting of the invisible indicator and the capturing of the image are performed by monitoring the vehicle via an underside of the vehicle.

40. The method of claim 36, wherein the step of capturing an image of the vehicle comprises capturing a scan of the vehicle as the image.

41. The method of claim 36, further comprising obtaining vehicle information associated with the vehicle and dynamically setting the threshold based on the vehicle information.

42. The method of claim 36, further comprising outputting a warning when the detection signal exceeds the threshold.

43. The method of claim 36, further comprising logging the detection signal.

44. The method of claim 36, further comprising showing at least one of: vehicle information, a warning, the image of the vehicle, and the visualization of the detection signal overlaid onto the image of the vehicle.

45. A computer-readable storage medium comprising instructions which, when executed by computer, causes the computer to carry out the method of claim 36.

Description

[0023] Based on the above indications of features of the present disclosure in terms of the appended claims, below an embodiment description is provided with reference to the appended drawing, where the scope of protection of the present disclosure according to the appended claims is by no means limited to any specific aspect or feature of the below discussed and in the drawing shown embodiments. Such exemplary embodiments are shown in the accompanying drawing, which shows distinct embodiments wherein the same or similar elements, components and/or aspects can be designated with the same or a similar reference numeral, and in which:

[0024] FIG. 1 schematically depicts an embodiment of the vehicle monitoring system,

[0025] FIG. 2 schematically depicts an under vehicle module of an embodiment of the vehicle monitoring system in which a detector and a camera are integrated,

[0026] FIGS. 3A and 3B schematically depicts an embodiment of the detector of the vehicle monitoring system,

[0027] FIG. 4 diagrammatically depicts an embodiment of the method, and

[0028] FIG. 5 depicts visualising the detection signal overlaid onto the image of the vehicle.

[0029] The following reference signs are used: [0030] 1 vehicle monitoring system, [0031] 2 detector, [0032] 3 detection signal, [0033] 4 controller, [0034] 5 database, [0035] 6 alarm module, [0036] 7 warning, [0037] 8 memory, [0038] 9 camera, [0039] 10 image, [0040] 11 display, [0041] 12 under vehicle module, [0042] 13 sensor, [0043] 14 light source, [0044] 15 mirror, [0045] 16 connector, [0046] 17 housing, [0047] 30 vehicle, [0048] 31 anomaly, [0049] 32 invisible indicator, [0050] S1 detecting invisible indicator, [0051] S2 generating detection signal, [0052] S3 determining whether detection signal exceeds threshold, [0053] S4 obtaining vehicle information, [0054] S5 setting threshold, [0055] S6 outputting warning, [0056] S7 logging, [0057] S8 capturing image, [0058] S9 visualising detection signal overlaid onto image of vehicle, [0059] S10 showing output.

[0060] In the figures and following detailed description of the figures, the exemplary embodiment of a vehicle monitoring system as an under vehicle monitoring system is presented to illustrate the present disclosure in a coherent manner. Although this configuration of the system is advantageous, the present disclosure should not be understood to be limited to this particular configuration, and other configurations are equally possible within the scope of protection of the present disclosure, as defined in the appended claims.

[0061] FIG. 1 schematically shows a vehicle monitoring system 1 in an advantageous embodiment of the present disclosure. The vehicle monitoring system 1 is configured to detect an anomaly 31 in or on a vehicle 30 and comprises a detector 2 which is configured to detect an invisible indicator 32 of the anomaly 31. The vehicle monitoring system 1 of FIG. 1 is an advantageous example comprising additional features which are optional. Here, the detector 2 is configured to detect an invisible indicator 32 originating from or emitted by the anomaly 31 as indicated schematically by field lines. In this example, the detector 2 may in particular be configured to detect a magnetic field, ionizing radiation, alpha particles, beta particles, gamma rays, hazardous or harmful radiation and electromagnetic radiation outside of the human visible range.

[0062] As illustrated in FIG. 1, the detector 2 is also configured to generate a detection signal 3 associated with the invisible indicator 32. The detection signal 3 is supplied to a controller 4 which is configured to process the detection signal 3. In this example, the detection signal 3 is transferred via a cable, although a wireless connection is also envisaged. The controller 3 may be integrated with the detector 2, for example as illustrated in FIG. 2.

[0063] In FIG. 1, the controller 4 may further be configured to determine whether the detection signal 4 exceeds a threshold, for example to distinguish detected radiation from background noise, to obtain vehicle information associated with the vehicle 30 from a database 5 and/or to dynamically set the threshold based on the vehicle information. In the illustrated example, the database 5 is a cloud-based service which may be accessed wirelessly by the controller 4 to consult and/or download the vehicle information. Alternatively or additionally, the database 5 may be stored on a memory 8, and/or relevant entries of the database 5 may be downloaded to said memory 8 for access by the controller 4.

[0064] Vehicle information may encompass any one or more than one of the following types of information. The vehicle information may comprise an image of a vehicle, for example an under-vehicle image, of the same type of vehicle as one under review or inspection, shortly after production thereof, on the basis of which the image may be assumed to be of a safe vehicle. This allows visual detection of anomalies by comparison of an instantaneously acquired image with the downloaded image, while the downloaded image serves as a reference. When the invisible indicator 32 is a magnetic field or harmful radiation, the downloaded vehicle information may additionally or alternatively comprise a map of locations in a safe vehicle where magnets or radioactive radiation is to be expected. By comparison of the downloaded map with a detection result, unexpected magnets and/or radiation sources can be identified and possibly localised.

[0065] The controller 4 is further configured to generate an alarm signal in case of a positive detection result, for instance when the detection signal exceeds the threshold. As illustrated in FIG. 1, the vehicle monitoring system 1 further comprises an alarm module 6. The alarm module 6 is configured to receive the alarm signal from the controller 4 and to output a warning 7 in FIG. 4. The warning may be in the form of any of a sound, an image, a tactile signal, or the like.

[0066] As a further optional feature included with the vehicle monitoring system 1 of FIG. 1, the controller 4 is configured to log the detection signal 3 in the memory 8. Said vehicle monitoring system 1 also includes a camera 9 configured to capture an instantaneous image 10 of the vehicle 30. The controller 4 is further configured to process the image 10 of the vehicle 30 captured by the camera 9. Advantageously, the controller may further be configured to visualise the detection signal 3 overlaid onto the image 10 of the vehicle 30, as shown in FIG. 4. A display 11 may further be included with the vehicle monitoring system 1 in order to show an output of said system, for example as shown in FIG. 4. The display 11 is connected to the controller 4 in the illustrated example, although display 11 may alternatively be coupled to the detector 2 directly. The output of the system can additionally or alternatively include the detection signal 3, the threshold, the vehicle information, the alarm signal, the warning 7, the image 10 of the vehicle 30 and combinations of the foregoing. An example is presented in FIG. 4.

[0067] The display 11 may in particular be configured to show the vehicle information, the warning 7 and/or the instantaneously acquired image 10 of the vehicle 30. Preferably, the display 11 is configured to show the visualisation of the detection signal 3 overlaid onto the image 10 of the vehicle 30.

[0068] FIG. 2 shows an embodiment of the vehicle monitoring system 1 comprising a detector 2 as well as a camera 9. The detector 2 and the camera 9 are here integrated into an under vehicle module 12 of the vehicle monitoring system 1. The under vehicle module 12 is particularly suitable for positioning on a ground, such as a road or track, over which the vehicle 30 may pass so that the under vehicle module 12 may monitor the vehicle 30 via an underside of the vehicle 30.

[0069] The detector 2 of this embodiment comprises sensors 13, each configured to detect the invisible indicator 32 of the anomaly 31. Although the sensors 13 are illustrated in the form of an array of stationary sensors, any number of sweeping sensors 13 may be employed additionally or alternatively. In this example, the sensors 13 are configured to detect ionizing radiation, such as gamma rays, and preferably comprise scintillators and/or Geiger-Müller tubes. Alternatively or additionally, the sensors 13 may be configured to detect magnetic fields, alpha particles, beta particles, gamma rays, hazardous or harmful radiation and/or electromagnetic radiation outside of the human visible range. Various sensors 13 may thus be integrated for detection of multiple invisible indicators 32.

[0070] The camera 9 of this embodiment captures an image 10 of the underside of the vehicle 30. To that end, it is configured to collect frames in a time-gated fashion as the vehicle passes over the under vehicle module 12, although any relative movement between the vehicle 30 and the under vehicle module 12 is likewise possible. Light sources 14 are optionally provided to ensure sufficient lighting for capturing the image 10 while an angled mirror 15 is arranged to reflect light coming from the vehicle 30 into the camera 9. An angle of view of the camera 9 and a scanning frame thereof on the mirror 15 are schematically indicated in the figure with dashed lines.

[0071] In the vehicle monitoring system 1 of FIG. 2, the detector 2 is arranged at one end of the under vehicle module 12 near the mirror 15. This is advantageous for localisation of the anomaly 31 because the detection signal 3 is thus coupled to the image 10 captured by the camera 9. Other arrangements are also contemplated, including at the other end or sides of the under vehicle module 12. Alternatively, the under vehicle module 12 may comprise the camera 9 and related optical elements while the detector 2 is arranged distant from the under vehicle module 12, that is, the detector 2 is not integrated into the under vehicle module 12.

[0072] The under vehicle module 12 of FIG. 2 further comprises connectors 16 through which cables may be drawn to couple the detector 2 and camera 9 to a distal or remote controller 4, an alarm module 6, a memory 8 and/or a display 11 of the vehicle monitoring system 1. However, more of these parts of the system outside of the under vehicle module 12 may be arranged in or on the under vehicle module 12, as well. The connectors 16 are preferably dust and water tight, preferably to the IP67 standard. Alternatively, any of these components may be included with the under vehicle module 12 and/or mutually couple in a wireless way.

[0073] FIG. 3A shows an embodiment of the detector 2 in a top view and FIG. 3B shows a corresponding cross sectional view along the line A - A in FIG. 3A. In this embodiment, the detector 2 comprises five sensors 13, two connectors 16 and a housing 17. The sensors 13 are arranged in the housing 17 and may be mutually connected, for example as illustrated via wires and plugs. The sensors 13 are preferably arranged in an array in order to localise the anomaly. Here, five sensors 13 are arranged in a linear array, though different numbers of sensors 13 and/or different arrangements are possible. Each sensor 13 may comprise a scintillator, a Geiger-Müller counter or both. Preferably, the scintillator is configured for lower dose measurements and the Geiger-Müller counter is configured for higher dose measurements, for example 0.01 .Math.Sv/h – 50 .Math.Sv/h and 50 .Math.Sv/h - 1.0 Sv/h, respectively. This is particularly advantageous when the sensor 13 comprises both the scintillator and the Geiger-Müller counter. Each scintillator is preferably coupled to a photomultiplier. The foregoing configurations of the sensor 13 may also be applied in any other embodiment of the detector 2 of the vehicle monitoring system 1. In advantageous embodiments of the vehicle monitoring system 1, a total sensitivity of said system is not less than 6000 cps for .sup.137 Cs at 1.0 .Math.Sv/h. Alternatively or additionally, a minimum detectable activity of said system for .sup.137 Cs is 5 • 10.sup.5 Bq at a vehicle speed of 5 km/h and an anomaly distance of 1 m, 2 • 10.sup.5 Bq at a vehicle speed of 5 km/h and an anomaly distance of 0.5 m and 1 • 10.sup.5 Bq at a vehicle speed of 5 km/h and an anomaly distance of 0.2 m. Further alternatively or additionally, an energy range of said system is 50 keV to 3.0 MeV. With the foregoing sensitivity, detectable activity and/or energy range, the vehicle monitoring system 1 is particularly favourably configured to detect ionizing radiation as the invisible indicator 32 of the anomaly 31 in or on the vehicle 30.

[0074] The detector 2 of FIG. 3A/3B may be configured to couple to an under vehicle module 12 of, for or in any embodiment of the vehicle monitoring system 1. The detector 2 may be configured as a retrofit for existing under vehicle modules 12 and/or vehicle inspection systems 1. The detector 2 may be thus configured as under vehicle detector 2 for placement on the ground over which the vehicle 30 is drivable as explained above in relation to FIG. 2.

[0075] The detector 2 of any embodiment of the vehicle monitoring system may be configured to detect the invisible indicator relative to at least one face of the detector 2. That is, the detector 2 may be configured for directional detection of the invisible indicator 32 of the anomaly 31. In such case, the housing 17 is preferably configured to selectively shield ionizing radiation, for example by comprising shielding material such as lead in a face of the housing 17 while another face of the housing 17 does not comprise shielding material. In the form of the under vehicle detector 2, a bottom and sides of the housing 17 may comprise the shielding material while a top is free from said shielding material. This configuration is an example in which the invisible indicator is selectively detected, that is, invisible indicators not originating from the anomaly 31 are shielded or at least mitigated.

[0076] FIG. 4 shows a flow diagram of an embodiment of the method of monitoring vehicles for detecting an anomaly 31 in or on a vehicle 30. The method comprising the essential step S1 of detecting an invisible indicator 32 of the anomaly 31. The step S1 comprises detecting an invisible indicator 32 originating from or emitted by the anomaly 31 and may comprise detecting at least one invisible indicator 32 from a group, the group comprising magnetic fields, ionizing radiation, alpha particles, beta particles, gamma rays, hazardous or harmful radiation and invisible electromagnetic radiation. Further steps are indicated in FIG. 4, although some of these are optional.

[0077] The method of FIG. 4 further comprises the step S2 of generating a detection signal 3 associated with the invisible indicator 32 and the optional step S3 of determining whether the detection signal 3 exceeds a threshold. Furthermore, the optional step S4 of obtaining vehicle information associated with the vehicle 30 and the optional step S5 of dynamically setting the threshold based on the vehicle information also provide input for step S3. In step S3, it is then determined whether the detection signal 3 exceeds the dynamically set threshold based in the vehicle information associated with the vehicle 30 currently being monitored. When it is determined in step S3 that the threshold is exceeded, the optional step S6 of outputting a warning 7 is executed.

[0078] Another optional feature is the step S7 of logging the detection signal 3.

[0079] Additionally, the method of FIG. 4 includes the step S8 of capturing an image 10 of the vehicle 30. As is illustrated, the captured image 10 is also logged. Here, the step S7 thus comprises logging both the detection signal 3 as well as the image 10 of the vehicle 30. In general, any output of the vehicle monitoring system 1 may be logged, including the detection signal 3, the threshold, the vehicle information, the alarm signal, the warning 7, the image of the vehicle 10 and combinations thereof.

[0080] Further, the method of FIG. 4 comprises the step S9 of visualising the detection signal 3 overlaid onto the image 10 of the vehicle 30. In suitable combinations of the above steps, the method may further comprise the optional step S10 of showing at least one of the vehicle information, the warning 7, the image 10 of the vehicle 30 and the visualisation of the detection signal 3 overlaid onto the image 10 of the vehicle 30. For example, the step S10 may involve showing the warning 7 as well as the visualisation of the detection signal 3 overlaid onto the image 10 of the vehicle 30, an example of which is illustrated in FIG. 5. In other words, visualisation of the warning 7 associated with the detection signal 3 and overlay thereof onto the image 10 of the vehicle thereby actually points to a localisation in the vehicle 30, at which the anomaly 31 is located. This greatly facilitates subsequent searching for the anomaly 31, which may have to be performed under considerable time pressure, for instance when the anomaly is a bomb which could explode at any time.

[0081] FIG. 5 further illustrates embodiments of the method of the present disclosure with particular emphasis on steps S9 and S10. The detection signal 3, captured in step S2, is visualised in step S9 and overlaid on the image 10 of the vehicle 30, captured in step S8.

[0082] In FIG. 5, step 10 involves showing the detection signal 3 overlaid on the image 10 of the vehicle 30 and showing the warning 7. Here, the image 10 is an under vehicle scan as can be obtained by, for example, the under vehicle module 12 of FIG. 2. Further, the detection signal 3 is illustrated as a data grid, as can be collected by, for example, a sweeping sensor 13 or an array of sensors 13 by time-gated data collection. The warning 7 is shown on top of the visualisation of the detection signal, which in turn is laid over the image 10 of the vehicle 30. More in particular, the warning 7 is shown at a location where the detection signal 3 exceeds the threshold as determined in step S3. This allows localisation of the anomaly in or on the vehicle.

[0083] The controller 4 may be configured in various ways to generate the visualisation of the detection signal 3 overlaid onto the image 10 of the vehicle 30. For example, by time gating or synchronising of the detection signal 3 with capturing of the image 10 of the vehicle 30 by the camera 9, wherein the image 10 is preferably collected in the form of a scan of a face of the vehicle 30. These forms of processing may depend on relative placement of the detector 2 and the camera 9, which are preferably arranged to receive the detection signal 3 and the image 10 from the same face of the vehicle 30 and / or are preferably arranged nearby to improve synchronisation between the detection signal 3 and the image 10, for example as illustrated in and explained in relation to FIG. 2.

[0084] Although the illustrated embodiments present the vehicle monitoring system 12 as a system for under vehicle monitoring, any detection orientation relative to the vehicle 30 may be chosen, including adjustable or movable orientations. Other configurations of the vehicle monitoring system include above vehicle monitoring, archway constructions and movable or even portable probes. Furthermore, elements of the vehicle monitoring system 1 may be mutually coupled by cabling and/or by wireless connectivity. It is thus understood that the scope of protection of the present disclosure is defined in the following claims.