Abstract
A physiological information detection system includes an image-capturing unit, an image-processing unit and a data-transmitting unit. The image-capturing unit is provided to capture a series of images of head portions and connects with the image-capturing unit to receive the captured images. The image-processing unit is operated to process the captured images and to trace a head portion area and a neck portion area thereof in the processed images. The image-processing unit is further operated to process the captured images to retrieve temperature data from the selected head portion area and the selected neck portion area. The image-processing unit is further operated to convert variations of the temperature data into estimated pulse data. The data-transmitting unit connects with the image-processing unit to transmit the estimated pulse data to a predetermined device.
Claims
1. A physiological information detection system comprising: an image-capturing unit provided to capture a series of images of head portions; an image-processing unit connected with the image-capturing unit to receive the captured images, with operating the image-processing unit to process the captured images and to seek or trace at least one first head portion area and at least one first neck portion area thereof in the processed images, with further operating the image-processing unit to process the captured images to retrieve first temperature data from the selected first head portion area and the selected first neck portion area of the processed images, with further operating the image-processing unit to convert variations of the first temperature data into estimated first pulse data; and a data-transmitting unit connected with the image-processing unit to transmit the estimated first pulse data to a predetermined device.
2. The system as defined in claim 1, wherein the image-capturing unit is a digital camera or an infrared camera.
3. The system as defined in claim 1, wherein the image-processing unit is further operated to trace at least one first arterial portion area in the selected first neck portion area.
4. The system as defined in claim 1, wherein the image-processing unit further includes a facial recognition module.
5. The system as defined in claim 4, wherein the facial recognition module is operated to process a procedure of live detection step, wavelet frame representation step and facial candidate selection step with the captured images.
6. The system as defined in claim 1, wherein the predetermined device is a wearable device, a mobile device, a STB device, a display device or a computer device.
7. The system as defined in claim 1, wherein the predetermined device further includes a multiple recognition system.
8. The system as defined in claim 7, wherein the multiple recognition system includes a RFID reader module and a 2D bar code reader module.
9. The system as defined in claim 1, wherein the data-transmitting unit connects with a heterogeneous network via the predetermined device.
10. The system as defined in claim 1, wherein the image-processing unit is further operated to trace a second head portion area and a second neck portion area thereof in the processed images.
11. A physiological information detection method comprising: providing an image-capturing unit to capture a series of images of head portions; providing an image-processing unit to connect with the image-capturing unit to receive the captured images, with operating the image-processing unit to process the captured images and to seek or trace at least one first head portion area and at least one first neck portion area thereof in the processed images, with further operating the image-processing unit to process the captured images to retrieve first temperature data from the selected first head portion area and the selected first neck portion area of the processed images, with further operating the image-processing unit to convert variations of the first temperature data into estimated first pulse data; and providing a data-transmitting unit to connect with the image-processing unit to transmit the estimated first pulse data to a predetermined device.
12. The method as defined in claim 11, wherein the image-processing unit is further operated to trace at least one first arterial portion area in the selected first neck portion area.
13. The method as defined in claim 11, wherein the image-processing unit is further operated to trace a second head portion area and a second neck portion area thereof in the processed images.
14. The method as defined in claim 13, wherein the image-processing unit is further operated to trace a second arterial portion area in the second neck portion area.
15. The method as defined in claim 11, wherein the image-processing unit further includes a facial recognition module to recognize at least one first facial portion area in the first head portion area.
16. The method as defined in claim 15, wherein the facial recognition module is operated to process a procedure of live detection step, wavelet frame representation step and facial candidate selection step for facial recognition.
17. The method as defined in claim 11, wherein the predetermined device is a wearable device, a mobile device, a STB device, a display device or a computer device.
18. The method as defined in claim 11, wherein the predetermined device further includes a multiple recognition system to execute a recognition procedure for identifying personals to allow operating the predetermined device.
19. The method as defined in claim 18, wherein the multiple recognition system includes a RFID reader module and a 2D bar code reader module for executing the recognition procedure the multiple recognition system includes a RFID reader module and a 2D bar code reader module for executing the recognition procedure.
20. The method as defined in claim 11, wherein the first head portion area is a round-shaped head portion area or an oval-shaped head portion area.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0034] The present invention will become more fully understood from the detailed description given hereinbelow and the accompanying drawings which are given by way of illustration only, and thus are not limitative of the present invention, and wherein:
[0035] FIG. 1 is a block diagram of a video on demand (VOD) system applied to a thermal video-image physiological information detection system in accordance with a first preferred embodiment of the present invention.
[0036] FIG. 2 is a block diagram of a multimedia on demand (MOD) system applied to the thermal video-image physiological information detection system in accordance with a second preferred embodiment of the present invention.
[0037] FIG. 3 is a block diagram of the thermal video-image physiological information detection system in accordance with a third preferred embodiment of the present invention.
[0038] FIG. 4 is a series of images (a)-(d) generated from a captured image preprocessed by the thermal video-image physiological information detection system in accordance with a preferred embodiment of the present invention.
[0039] FIG. 5 is a processed image generated from the erosion image and the dilation image calculated by a connected component labeling algorithm applied in the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention.
[0040] FIG. 6 is another processed image generated from the bounded image to seek or trace a head portion area by the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention.
[0041] FIG. 7 is a chart diagram illustrating grayscale values in relation to temperatures applied in the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention.
[0042] FIG. 8 are image views (a)-(c) of head portion area from three different angles and three chart diagrams of temperatures versus time thereof processed by the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention.
[0043] FIG. 9 are image views (a)-(c) of head portion area from three different angles, three images of corresponding selected neck portion area and three chart diagrams of temperatures versus time and estimated pulse rate thereof processed by the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
[0044] FIG. 1 shows a block diagram of a video on demand (VOD) system applied to a thermal video-image physiological information detection system in accordance with a first preferred embodiment of the present invention. Referring now to FIG. 1, the thermal video-image physiological information detection system in accordance with the first preferred embodiment of the present invention includes a digital STB 3, a multiple recognition system 30 and a physiological information detection system 3a. The multiple recognition system 30 and the physiological information detection system 3a connect and communicate with the digital STB 3.
[0045] With continued reference to FIG. 1, the digital STB 3 connects with a heterogeneous network 2 via a video on demand (VOD) system 1 for receiving digital video/audio data. The digital STB 3 connects with a computer system or a smart TV system for storing the digital video/audio data. In a preferred embodiment, the heterogeneous network 2 includes a Wireless LAN system and a 3G/WiMAX system or other equivalent system. The digital STB 3 further connects with a plurality of display devices 4 for displaying the digital video/audio data.
[0046] With continued reference to FIG. 1, the digital STB 3 is suitable for processing TV signals, cable signals, satellite signals or broadcast and IP/DSL signals. In a preferred embodiment, the digital STB 3 has a function of bidirectional digital communication or digital multiple-media network communication. The digital STB 3 is also suitable for ATSC system, DVB system, ISDB system, DMT-T system or ADTB-T system.
[0047] With continued reference to FIG. 1, the digital STB 3 connects between the heterogeneous network 2 and the display devices 4 and other peripherals. Users can operate the digital STB 3 for internet accessing (e.g. e-mailing), website surfing or online shopping via the heterogeneous network 2. In a preferred embodiment, the display device 4 can be a monitor device, a TV device or other peripheral.
[0048] With continued reference to FIG. 1, the multiple recognition system 30 connects between the heterogeneous network 2 and the display devices 4 and other peripherals for executing a recognition procedure for identifying personals to allow operating the digital STB 3 or the display device 4. In a preferred embodiment, the multiple recognition system 30 includes at least two recognition units with various recognition technologies for accomplishing multiple recognition steps.
[0049] FIG. 2 shows a block diagram of a multimedia on demand (MOD) system applied to the thermal video-image physiological information detection system in accordance with a second preferred embodiment of the present invention corresponding to that shown in FIG. 1. Referring now to FIG. 2, in comparison with the first preferred embodiment, the thermal video-image physiological information detection system of the second preferred embodiment includes a digital STB 3 and a multiple recognition system 30 incorporated therein.
[0050] With continued reference to FIG. 2, the multiple recognition system 30 includes a RFID reader module 301 and a 2D bar code reader module 302 or other equivalent reader module (e.g., magnetic card reader or password input). Accordingly, users can be authorized to access one of VOD systems 1, MOD systems 1a, e-learning systems, medical management systems, bank account systems and online-game systems via the heterogeneous network 2 by operating the multiple recognition system 30.
[0051] FIG. 3 shows a block diagram of the thermal video-image physiological information detection system in accordance with a third preferred embodiment of the present invention. Referring now to FIG. 3, in comparison with the first preferred embodiment, the physiological information detection system 3a of the third preferred embodiment includes an image-capturing unit, an image-processing unit and a data-transmitting unit. In a preferred embodiment, the physiological information detection system 3a further connects or online connects with a monitoring system 3b for receiving other images therefrom.
[0052] With continued reference to FIG. 3, the image-capturing unit is a camera device or a plurality of camera devices and is provided to capture a series of images of human head portions and peripheral portions thereof. In a preferred embodiment, the images of human head portions are live images while the image-capturing unit is provided in a public place or the like. The image-capturing unit is a digital camera, an infrared camera or other equivalent device (e.g., CCD component installed in a video camera).
[0053] FIGS. 4(a)-4(d) show a series of images generated from a captured image preprocessed by the thermal video-image physiological information detection system in accordance with a preferred embodiment of the present invention. Referring to FIGS. 3 and 4(a), the image-processing unit connects with the image-capturing unit to receive at least one of the captured images.
[0054] In operation, the image-processing unit is operated to preprocess the captured images to obtain a series of four processed images, as best shown in FIG. 4(a)-4(d). By way of example, FIG. 4(a) shows a gray scale image generated from an original color image; FIG. 4(b) shows a binary image binary-converted from the gray scale image; FIG. 4(c) shows an erosion image generated from the binary image by morphological operation; and FIG. 4(d) shows a dilation image generated from the binary image by morphological operation.
[0055] Referring back to FIG. 3, in operation, the image-processing unit is further operated to seek or trace at least one first head portion area and at least one first neck portion area thereof in the processed images. By way of example, FIG. 5 shows a processed image generated from the erosion image and the dilation image, as best shown in FIGS. 4(c) and 4(d), calculated by a connected component labeling (CCL) algorithm applied in the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention. Referring to FIGS. 3, 4(d) and 5, pixels of the dilation image are initially scanned from up to down and from left to right to obtain a plurality of blocks. Finally, the blocks are further processed by a CCL algorithm to obtain a bounding box in the bounded image, as best shown in FIG. 5.
[0056] FIG. 6 shows another processed image generated from the bounded image, as shown in FIG. 5, to seek or trace a head portion area by the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention. By way of example, the head portion area is a round-shaped head portion area, an oval-shaped head portion area or an elliptic head portion area. Referring to FIGS. 3 and 6, the thermal video-image physiological information detection method includes the step: tracing the elliptic head portion area in the processed images. The elliptic head portion area is s=(x.sub.c, y.sub.c, b), where (x.sub.c, y.sub.c) is a center point position and b is a length of minor axis of ellipse. A summation of normalized gradient of elliptic periphery can be calculated by
[00001]
[0057] where φ.sub.g(si) is a mean value of gradient of elliptic periphery, N.sub.h is a total number of pixels at elliptic periphery, g.sub.s(i) is a gradient of pixel i at elliptic periphery and *s is a maximum weight in peripheral space.
[0058] Furthermore, a tracing position s can be calculated by
S={s:|x−x.sub.c|≦|x.sub.r′|y−y.sub.c|≦y.sub.r′|b−b.sub.c|≦b.sub.r}
[0059] where x.sub.r and y.sub.r are coordinates of a range for tracing a center point position (x.sub.c, y.sub.c) and b.sub.r is a maximum length of minor axis of ellipse.
[0060] Accordingly, the physiological information detection system 3a is successful in tracing pixels of the head portion area (or neck portion area), thereby determining the elliptic head portion area, as best shown in FIG. 6. In a preferred embodiment, at least one arterial portion area is further traced in the neck portion area. In the next step, the image-processing unit is further operated to convert variations of the temperature data into estimated pulse data.
[0061] Referring back to FIG. 3, the image-processing unit is further operated to process the captured images to retrieve temperature data from the head portion area and the neck portion area of the processed images. By way of example, FIG. 7 shows a chart illustrating grayscale values in relation to temperatures applied in the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention. Referring to FIGS. 3 and 7, the physiological information detection system 3a is operated to calculated temperatures of pixels of the elliptic head portion area by equation
Temperature=(260−grayscale pixels)×calibration constant+T.sub.b
[0062] where calibration constant is 0.02326 and T.sub.b is a systematical lowest temperature.
[0063] FIGS. 8(a)-8(c) show (live) image views of head portion area from three different angles (i.e., front view, right view and left front view of three peoples) and three chart diagrams of temperatures versus time thereof processed by the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention. As best shown in left portions of FIGS. 8(a)-8(c), the head portion area and neck portion area has a preferred bounding box with a ratio of 7:3 for calculating temperatures of the head portion and the neck portion. As best shown in right portions of FIGS. 8(a)-8(c), three chart diagrams of temperatures versus time are calculated from the head portion area and neck portion area.
[0064] FIGS. 9(a)-8(c) show (live) image views of head portion area from three different angles (i.e., front view, right view and left view of three peoples), three images of corresponding selected neck portion area and three chart diagrams of temperatures versus time and estimated pulse rate thereof processed by the thermal video-image physiological information detection system in accordance with the preferred embodiment of the present invention. As best shown in left portions of FIGS. 9(a)-9(c), the head portion areas and neck portion areas are successfully traced in the processed images. As best shown in middle portions of FIGS. 9(a)-9(c), the arterial portion areas are further successfully traced in the neck portion areas, as indicated at an ellipse region in FIGS. 9(a)-9(c). As best shown in upper right waveforms of FIGS. 9(a)-9(c), three chart diagrams of temperatures versus time are calculated from the head portion area and neck portion area. As best shown in lower right waveforms of FIGS. 9(a)-9(c), three chart diagrams of estimated pulse rate are automatically converted from the temperatures of head portion area and neck portion area by a Fourier transform method or other equivalent transform method.
[0065] In another embodiment, the image-processing unit is further operated to trace another head portion area and another neck portion area thereof in the processed images synchronously, as best shown in FIGS. 8(a)-8(c) and 9(a)-9(c). Moreover, the image-processing unit is further operated to trace another arterial portion area in another neck portion area.
[0066] Referring back to FIG. 3, the data-transmitting unit is a short-range communication device or other equivalent device. In a preferred embodiment, the short-range communication device is a Zigbee module, a Bluetooth module, a near field communication (NFC) or high-frequency RFID module or other equivalent module. The data-transmitting unit connects with the image-processing unit to transmit the estimated pulse (or pulse rate) data to a predetermined device.
[0067] With continued reference to FIG. 3, the image-processing unit further connects with a facial recognition module to recognize a facial portion area in the head portion area. In a preferred embodiment, image-processing unit is operated to trace a middle portion or a T portion in the facial portion area. In recognition operation, the facial recognition module is operated to process a procedure of live detection step, wavelet frame representation step and facial candidate selection step for facial recognition.
[0068] Although the invention has been described in detail with reference to its presently preferred embodiment, it will be understood by one of ordinary skills in the art that various modifications can be made without departing from the spirit and the scope of the invention, as set forth in the appended claims.
