Presence And Vitals Detection Of Living Subject Using LWIR And RADAR Systems

Abstract

A method and system for presence and vitals detection of a living subject is disclosed herein. The system comprises a passive long wave infrared (“LWIR”) sensor, a radar, a processor and a user interface. The LWIR sensor is utilized to detect block-body radiation originating from a living subject. The processor is configured to run an algorithm to perform digital signal processing on data provided by the radar and the LWIR sensor to generate presence and vitals information for the living subject for communication to the user interface.

Claims

1. A system for presence and vitals detection of a living subject, the system comprising: a passive long wave infrared low-resolution (“LWIR”) sensor; a Doppler radar; a processor; and a user interface; wherein LWIR sensor is utilized to detect block-body radiation originating from a living subject; wherein the Doppler radar emits a radiofrequency at a specific frequency, and detects the frequency change of reflections of a plurality of targets which have subtle movements caused by the respiration and/or ballistocardiography from the living subject; wherein the processor is configured to run an algorithm to perform digital signal processing on data provided by the Doppler radar and the LWIR sensor to generate presence and vitals information for the living subject for communication to the user interface.

2. The system according to claim 1 wherein the Doppler radar is a pulsed Doppler radar or a continuous wave Doppler radar.

3. The system according to claim 1 wherein the user interface presents data using a LED, a display or a speaker.

4. The system according to claim 1 wherein the user interface comprises a second communication module for receiving data from a first communication module in communication with the processor.

5. The system according to claim 1 further comprising a memory configured to store sensor output from the LWIR sensor.

6. The system according to claim 1 wherein the LWIR sensor is an imaging sensor presence detector.

7. The system according to claim 1 wherein the LWIR sensor is a single pixel presence detector.

8. A system for presence and vitals detection of a living subject, the system comprising: a monitoring device comprising a passive long wave infrared low-resolution (“LWIR”) sensor, a Doppler radar, a processor, and a first communication module; and an interface device comprising a second communication module and a user interface module; wherein LWIR sensor is utilized to detect block-body radiation originating from a living subject; wherein the Doppler radar emits a radiofrequency at a specific frequency, and detects the frequency change of reflections of a plurality of targets which have subtle movements caused by the respiration and/or ballistocardiography from the living subject; wherein the processor is configured to run an algorithm to perform digital signal processing on data provided by the Doppler radar and the LWIR sensor to generate presence and vitals information for the living subject for communication to the interface device.

9. The system according to claim 8 wherein the Doppler radar is a pulsed Doppler radar or a continuous wave Doppler radar.

10. The system according to claim 8 wherein the first communication module is configured to transmit data to the second communication module.

11. The system according to claim 8 wherein the monitoring device further comprises a memory configured to store sensor output from the LWIR sensor.

12. The system according to claim 8 wherein the LWIR sensor is an imaging sensor presence detector or a single pixel presence detector.

13. A method for presence and vitals detection of a living subject, the method comprising: detecting at a LWIR sensor of a monitoring device block-body radiation originating from a living subject; emitting from a Doppler radar of the monitoring device a radiofrequency at a specific frequency, and detecting the frequency change of reflections of a plurality of targets which have subtle movements caused by the respiration and/or ballistocardiography from the living subject; receiving at a processor of the monitoring device the data from the Doppler radar and the LWIR sensor; running on the processor an algorithm to perform digital signal processing on the data provided by the Doppler radar and the LWIR sensor to generate presence and vitals information for the living subject; communicating from a first communication module of the monitoring device the presence and vitals information for the living subject to a second communication module of an interface device; and presenting on a user interface module of the interface device the presence and vitals information for the living subject.

14. The method according to claim 13 wherein the Doppler radar is a pulsed Doppler radar or a continuous wave Doppler radar.

15. The method according to claim 13 wherein the monitoring device further comprises a memory configured to store sensor output from the LWIR sensor.

16. The method according to claim 13 wherein the LWIR sensor is an imaging sensor presence detector.

17. The method according to claim 13 wherein the LWIR sensor is a single pixel presence detector.

18. The method according to claim 13 wherein the living subject is an infant.

19. The method according to claim 13 wherein the first communication module and the second communication module operate on a WiFi communication protocol.

Description

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

[0021] FIG. 1 is an illustration of an antenna pattern.

[0022] FIG. 2 is a block diagram of one embodiment of a system for presence and vitals detection of a living subject.

[0023] FIG. 3 is a block diagram of a process for presence and vitals detection of a living subject.

[0024] FIG. 4 is a flow chart of a method for presence and vitals detection of a living subject.

DETAILED DESCRIPTION OF THE INVENTION

[0025] The present invention is a system which consists of a LWIR camera or detector bore-sighted with a radar sensor, and a set of algorithms which operate internally on the system, which determine and transmit presence and vitals information remotely to an observer.

[0026] A sensor consists of a passive long wave infrared low-resolution single-detector or imaging sensor is used to detect black body radiation originating from a warm blooded living subject (all of which naturally radiate black body heat). A radar emits RF at a specific frequency, and detects the frequency change of reflections of targets which have subtle movements caused by the respiration and/or ballistocardiography from a living subject.

[0027] The field of view of the LWIR sensor and the transmit and receive antenna main lobe sensitivity are roughly collocated, with similar attitude (azimuth and zenith angle). The radar pattern is at least partially sensitive in 4π sr surrounding the radar antenna. An LWIR sensor such as a thermal imager, PIR, or other LWIR detector, is used In order to ensure the spatial sensitivity required to identify the presence of targets, greatly increasing the confidence of a radar system in determining presence of a target.

[0028] FIG. 1 is an illustration of an antenna pattern 100 showing the target of interest 10 (the living subject), the LWIR sensor's field of view 15, the radar sensitivity pattern 20, and the Azimuth angle 25.

[0029] Digital sensor data from these sensor modules are provided for ingestion by a processor unit, which runs an algorithm internally to perform digital signal processing, feature extraction, decision logic, and preparation for communication with user's module. Data is then transmitted from sensor system communication module to the corresponding user interface system's communication module.

[0030] A user interface system consists of a communication module which receives data from its corresponding sensor system. This data is presented to the user via a user interface such as an LED, a display, a speaker, or any other manner of interface.

[0031] A long wave infrared detector determines a presence of living subject by detecting black body radiation at 8 μm to 14 μm (8,000 to 14,000 nm) for example. An example of a commercial product is a FLIR Boson 320, Seek Contact.

[0032] A radar detects the vitals of living subject by detecting reflected RF. An example of a commercial product is a Xethru X4, Miku Smart Monitor.

[0033] A compute module with memory and communication module performs the entirety of the presence and vitals detection within the sensing system.

[0034] A user interface system with a communication module receives data and presents information to a user.

[0035] A single pixel presence detector performs the following function: monitor sensor output x[n] with sample rate S Hz and store measurement in system memory, a sample rate S could be 1 Hz for example; Apply high pass filter y[n]=x[n]−x[n−k] for time constant k, time constant k could be 10 to represent 10 second delay; and search for y[n]>a & x[n]>b, change threshold a, to detect sudden changes, temperature threshold b, to select temperatures which exceed a threshold.

[0036] An imaging sensor presence detector performs the following function: (1) monitor sensor output X=x.sub.1[i,j], x.sub.2[i,j], . . . x.sub.n[i,j] with sample rate S Hz, (a) i, j represent row and column dimension of sensor image and could be (320, 240) for example, (b) sample rate S could be 1 Hz for example; (2) Compute aggregated background value m[n] of image to estimate background temperature, (a) Aggregated background value could be median of all pixels, image pooling, image segmentation, or other; (3) Subtract background from image using bk[n] and segment result, (a) Threshold-and-mask for example: (i) Threshold image based on bk[n] to generate image mask, (j) y.sub.n[i,j]=x.sub.n[i,j]>bk[n] for all i,j in range; (ii) Perform morphological denoise transformation on mask such as erosionl (iii) Sum all values of y.sub.n to calculate mask area a[n]; (iv) If a[n]>k for area threshold k: (1) Apply mask y.sub.n to x.sub.n to generate z.sub.n; (2) Sum pixel values of z.sub.n to generate v[n]l; (3) Divide v[n] by a[n] to get mean value of segment m[n] (4) Compare m[n] mean value to temperature threshold b.

[0037] An imaging sensor presence detector performs the following function: (1) monitor sensor output X=x.sub.1[i,j], x.sub.2[i,j], x.sub.n[i,j] with sample rate S Hz, (a) i, j represent row and column dimension of sensor image and could be (320, 240) for example, (b) sample rate S could be 1 Hz for example; (2) Compute aggregated background value m[n] of image to estimate background temperature, (a) Aggregated background value could be median of all pixels, image pooling, image segmentation, or other; (3) Subtract background from image using bk[n] and segment result, (a) Threshold-and-mask for example: (i) Threshold image based on bk[n] to generate image mask, (j) y.sub.n[i,j]=x.sub.n[i,j]>bk[n] for all i,j in range; (ii) Perform morphological denoise transformation on mask such as erosionl (iii) Sum all values of y.sub.n to calculate mask area a[n]; (iv) If a[n]>k for area threshold k: (1) Apply mask y.sub.n to x.sub.n to generate z.sub.n; (2) Sum pixel values of z.sub.n to generate v[n]l; (3) Divide v[n] by a[n] to get mean value of segment m[n] (4) Compare m[n] mean value to temperature threshold b.

[0038] FIG. 2 is a block diagram of one embodiment of a system 200 for presence and vitals detection of a living subject 10. As shown in FIG. 2, the system 200 for presence and vitals detection of a living subject 10 comprises a sensor system 30 (monitoring device) and a user interface device 40. The monitoring device 30 comprises a passive long wave infrared low-resolution (“LWIR”) sensor 32, a radar 34, a processor 36, and a first communication module 38. The interface device 40 comprises a second communication module 42 and a user interface module 44. The LWIR sensor 32 is utilized to detect block-body radiation originating from a living subject 10. The radar 34 emits a radiofrequency at a specific frequency, and detects the frequency change of reflections of a plurality of targets which have subtle movements caused by the respiration and/or ballistocardiography from the living subject 10. The processor is configured to run an algorithm to perform digital signal processing on data provided by the radar 34 and the LWIR sensor 32 to generate presence and vitals information for the living subject 10 for communication to the interface device 40.

[0039] The radar can be a pulsed Doppler radar, FMCW radar, a continuous wave radar, or any other type of radar.

[0040] The user interface preferably presents data using a LED, a display or a speaker. The user interface preferably comprises a second communication module for receiving data from a first communication module in communication with the processor.

[0041] The memory is preferably configured to store sensor output from the LWIR sensor.

[0042] The LWIR sensor is preferably an imaging sensor presence detector or a single pixel presence detector.

[0043] The living subject is preferably an infant.

[0044] The first communication module and the second communication module preferably operate on a WiFi communication protocol.

[0045] FIG. 3 is a block diagram of a process 300 for presence and vitals detection of a living subject. As shown in FIG. 3, a passive long wave infrared low-resolution (“LWIR”) sensor 332 determines a presence of living subject 10 by detecting black body radiation. A radar 334 detects the vitals of a living subject 10 by detecting reflected RF. The sensor system 330 processes the data and communicates the data from a communication module 338 to a communication module 342 of the user interface system 340, which displays the data.

[0046] FIG. 4 is a flow chart of a method 400 for presence and vitals detection of a living subject. Step 401 starts at a LWIR sensor of a monitoring device, detecting black-body radiation originating from a living subject. Step 402 is emitting from a radar of the monitoring device a radiofrequency at a specific frequency, and detecting the frequency change of reflections of a plurality of targets which have subtle movements caused by the living subject. Step 403 is receiving at a processor of the monitoring device the data from the radar and the LWIR sensor. Step 404 is running on the processor an algorithm to perform digital signal processing on the data provided by the radar and the LWIR sensor to generate presence and vitals information for the living subject. Step 405 is communicating from the monitoring device's communication module 38 the presence and vitals information for the living subject to an interface device's communication module 42. And step 406 is presenting on an interface device the presence and vitals information for the living subject.

[0047] White et al., U.S. Pat. No. 10,825,314 for a Baby Monitor, is hereby incorporated by reference in its entirety.

[0048] From the foregoing it is believed that those skilled in the pertinent art will recognize the meritorious advancement of this invention and will readily understand that while the present invention has been described in association with a preferred embodiment thereof, and other embodiments illustrated in the accompanying drawings, numerous changes modification and substitutions of equivalents may be made therein without departing from the spirit and scope of this invention which is intended to be unlimited by the foregoing except as may appear in the following appended claim. Therefore, the embodiments of the invention in which an exclusive property or privilege is claimed are defined in the following appended claims.