Apparatus and method for analyzing component of object, and image sensor
11204276 · 2021-12-21
Assignee
Inventors
- Hyeong Seok Jang (Seoul, KR)
- Hyun Seok Moon (Seoul, KR)
- Jae Wook Shim (Yongin-si, KR)
- Kun Sun Eom (Yongin-si, KR)
- Myoung Hoon Jung (Bucheon-si, KR)
Cpc classification
G01N21/4795
PHYSICS
G01J3/0205
PHYSICS
A61B5/0075
HUMAN NECESSITIES
A61B2562/04
HUMAN NECESSITIES
A61B5/14532
HUMAN NECESSITIES
G01J3/10
PHYSICS
G01N21/474
PHYSICS
A61B5/1455
HUMAN NECESSITIES
G01N21/4785
PHYSICS
International classification
G01J3/10
PHYSICS
G01J3/44
PHYSICS
Abstract
A method and an apparatus for analyzing a component of an object are provided. The apparatus includes an image sensor including an optical module, and the optical module includes a light source configured to emit a source light, a first detector configured to detect a first light that is scattered or reflected from the object on which the emitted source light is incident, and a second detector configured to detect a second light that is emitted by the light source but is not incident on the object. The apparatus further includes a processor configured to calculate a scattering coefficient and an absorption coefficient, based on the detected first light and the detected second light, and analyze the component of the object, based on the calculated scattering coefficient and the calculated absorption coefficient.
Claims
1. An apparatus for analyzing a component of an object, the apparatus comprising: an image sensor comprising an optical module, wherein the optical module comprises: a light source configured to emit a source light; a first detector configured to detect a first light that is scattered or reflected from the object on which the emitted source light is incident; and a second detector configured to detect a second light that is emitted by the light source but is not incident on the object; and a processor configured to: calculate a scattering coefficient and an absorption coefficient, based on the detected first light and the detected second light; and analyze the component of the object, based on the calculated scattering coefficient and the calculated absorption coefficient, wherein the image sensor further comprises a substrate on which the optical module is disposed at each of nodes to form a network structure, wherein a first portion of the emitted source light is emitted from a first surface of the light source, is incident on the object, is scattered or reflected from the object, passes through a first hole disposed through the substrate, and is directed toward the first detector, and wherein a second portion of the emitted source light is emitted from a second surface of the light source, passes through a second hole disposed through the substrate, and is directly directed toward the second detector.
2. The apparatus of claim 1, wherein the processor is further configured to control the light source to emit simultaneously the first portion and the second portion of the source light, from the first surface and the second surface.
3. An image sensor comprising: a substrate; and an optical module disposed on the substrate, wherein the optical module comprises: a light source configured to emit a source light; a first detector configured to detect a first light that is emitted from a first surface of the light source and is scattered or reflected from an object; and a second detector configured to detect a second light that is emitted from a second surface of the light source but is not incident on the object, wherein the light source is disposed on a first surface of the substrate, wherein the first detector and the second detector are disposed on a second surface of the substrate, and wherein the substrate comprises: a first hole through which the first light reflected or scattered from the object passes; and a second hole through which the second light passes.
4. The image sensor of claim 3, further comprising a light concentrator disposed at a side of the first hole of the substrate, and is configured to direct the first light scattered or reflected from the object toward the first detector.
5. The image sensor of claim 4, wherein the light concentrator comprises any one or any combination of a waveguide, a condensing lens, a reflection mirror, and a grating.
6. An image sensor comprising: a substrate comprising a plurality of holes; one or more optical modules disposed on the substrate, wherein each of the one or more optical modules comprises: a light source disposed on a first surface of the substrate and disposed over a first side of a first hole among the plurality of holes; a first detector disposed on a second surface of the substrate and disposed over a second hole among the plurality of holes; and a second detector disposed on the second surface of the substrate and disposed over a second side of the first hole, wherein the light source is configured to emit a source light, wherein the first detector is configured to detect a first light that is reflected or scattered from an object on which the emitted source light is incident and that passes through the second hole toward the first detector, and wherein the second detector is configured to detect a second light that is a portion of the emitted source light passing through the first hole toward the second detector.
7. An apparatus for analyzing a component of the object, the apparatus comprising: the image sensor of claim 6; and a processor configured to control a light intensity of the light source of each of the one or more optical modules, based on a light pattern corresponding to the object.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
DETAILED DESCRIPTION
(11) Details of embodiments are included in the following detailed description and drawings. Advantages and features of the embodiments, and a method of achieving the same will be more clearly understood from the following embodiments described in detail with reference to the accompanying drawings. Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals will be understood to refer to the same elements, features, and structures.
(12) It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements may not be limited by these terms. These terms are only used to distinguish one element from another. Any references to singular may include plural unless expressly stated otherwise. In addition, unless explicitly described to the contrary, an expression such as “comprising” or “including” will be understood to imply the inclusion of stated elements but not the exclusion of any other elements. Also, the terms, such as ‘part’ or ‘module’, etc., may be understood as a unit that performs at least one function or operation and that may be embodied as hardware, software, or a combination thereof.
(13) Hereinafter, embodiments of an image sensor will be described in detail with reference to
(14)
(15) Referring to
(16) The image sensor 100 is formed to have a predetermined network structure, such that optical modules may be disposed one by one at each node of the substrate 120 having a network structure. The pre-defined network structure may have a square shape as illustrated in
(17) The substrate 120 may be a Printed Circuit Board (PCB). Two holes 121 and 122 are formed on the substrate 120: a first hole 121 is formed on an area of the substrate 120 where a first detector 112 is disposed; and a second hole 122 is formed on an area of the substrate 120 where a second detector 113 is disposed.
(18) The optical module includes a light source 111 configured to emit light, and at least two detectors 112 and 113 configured to detect light emitted by the light source 111. The constituent parts 111, 112, and 113 of the optical module may be formed in a partition wall 130. Each optical module includes a plurality of light sources 111 to emit light of different wavelengths. In this case, each of the light sources may be driven sequentially in a time-division manner.
(19) The light source 111 may include any one or any combination of a light emitting diode (LED), a laser diode, and a fluorescent body.
(20) The first detector 112 may detect a first light that is emitted by the light source 111 and is scattered or reflected from an object OBJ. The second detector 113 may detect a second light that is emitted by the light source 111 but is not incident on the object OBJ. The first detector 112 and the second detector 113 may include any one of a photo diode and a photo transistor (PTr).
(21) The light source 111 may be disposed on a first surface of the substrate 120, and the first detector 112 and the second detector 113 may be disposed on a second surface, e.g., an opposite surface to the first surface, on the substrate 120.
(22) The light source 111 may emit the first light from the first surface toward the object OBJ. The first light, incident on the object OBJ, is absorbed into, or scattered or reflected from, the object OBJ according to characteristics of the object OBJ. The absorbed, scattered, or reflected light passes through the first hole 121 formed at the substrate 120, to enter the first detector 112.
(23) Further, at the same time when emitting the first light from the first surface toward the object OBJ, the light source 111 may emit the second light from the second surface toward the second detector 113. The second light, emitted from the second surface, passes through the second hole 122 formed at the substrate 120, to directly enter the second detector 113.
(24) The image sensor 100 may further include a light concentrator 130 that directs the first light, scattered or reflected from the object OBJ, toward the first detector 112. The light concentrator 130 may include any one or any combination of a waveguide, a condensing lens, a reflection mirror, and a grating.
(25) Referring to
(26) Referring to
(27) Referring to
(28) The image sensors 100, 200, and 300 according to embodiments of the disclosure may be disposed so that a plurality of optical modules may form a pre-defined network structure 400, as illustrated in
(29) Referring to
(30) When the image sensors 100, 200, and 300 according to embodiments of the disclosure analyze components of an object, the first detector 112 measures a quality of light scattered/reflected from the object at the same time when the second detector 113 measures a reference quantity of light, such that image distortion caused by light source drift may be prevented, and the components of the object may be monitored continuously. By contrast, to monitor components of an object, a reference 610 is measured beforehand every time an object, e.g., skin 620, is measured, such that it is not easy to continuously measure components from the skin 620.
(31) Embodiments of an object component analyzing apparatus and object component analyzing method will be described below with reference to
(32) Various embodiments of the object component analyzing apparatus that will be described below may be embedded in various devices such as a mobile wearable device, a smart device, and the like. Examples of the various devices may include, but are not limited to, a wearable device of various types such as a smart watch worn on the wrist, a smart band-type wearable device, a headphone-type wearable device, a hairband-type wearable device, and the like, a mobile device such as a smartphone, a tablet PC, and the like.
(33)
(34) Referring to
(35) The image sensor 710 may be image sensors 100, 200, and 300 described in the above embodiments, and may include a plurality of optical modules 711 as illustrated in
(36) Referring to
(37) The first detector 812 may detect a first light, which is scattered or reflected from the object OBJ after being emitted from the first surface of the light source 811 and is incident on the object OBJ. Further, the second detector 813 may directly detect a second light emitted by the light source 811 form the second surface. In this case, the first light, scattered or reflected from the object OBJ, passes through a first hole formed at a substrate of the image sensor 710 to enter the first detector 812; and the second light, emitted by the light source 811 from the second surface, passes through a second hole formed at the substrate of the image sensor 710 to enter the second detector 812.
(38) Referring to
(39) For example, referring to
(40) Referring to
(41) Referring to
(42) Referring again to
(43) For example, the processor 720 may calculate scattering reflectance based on the quantity of the first light and the quantity of the second light that are detected by the first detector 812 and the second detector 813 with respect to two or more light patterns. In this case, the processor 720 may calculate a first scattering reflectance based on a ratio of the first quantity of light to the second quantity of light, which are measured by the first detector 812 and the second detector 813 according to the first light pattern. Further, the processor 720 may calculate a second scattering reflectance based on a ratio of the first quantity of light to the second quantity of light that are detected according to the second light pattern.
(44) The processor 720 may calculate the scattering coefficient μ′.sub.s and the absorption coefficient μ.sub.a by substituting, in the following Equation 1, each scattering reflectance and each spatial frequency that are calculated with respect to each light pattern. Alternatively, the processor 720 may calculate the scattering coefficient μ′.sub.s and the absorption coefficient μ.sub.a by using a lookup table representing a correlation between the scattering coefficient μ′.sub.s and the absorption coefficient μ.sub.a.
(45)
(46) Herein, R.sub.d (k, μ.sub.a, μ′.sub.s) denotes the scattering reflectance at each spatial frequency k, and A denotes a pre-defined constant value. Generally, as the spatial frequency is increased, the scattering reflectance is reduced. In this case, the relationship between the scattering reflectance and the spatial frequency has characteristics of a low pass filter.
(47) Further, the processor 720 may separately generate a scattering image and an absorption image by using the calculated scattering coefficient μ′.sub.s and absorption coefficient μ.sub.a, and may analyze components of an object by using each of the generated images. In this case, the components of an object may include one or more of triglycerides, blood glucose, calories, cholesterol, proteins, uric acid, water, and chromophore. The chromophore may include hemoglobin, carotenoid, melanin, antioxidant, water, melanoma, and the like, but is not limited thereto.
(48) Referring to
(49) Referring again to
(50) For example, referring to
(51) Referring to
(52) Referring again to
y=ax+b [Equation 2]
(53) Herein, y denotes the concentration of a component, x denotes the scattering coefficient or the absorption coefficient, and a and b denote predefined constant values.
(54)
(55) Referring to
(56) The image sensor 1110 is formed to have a predefined network structure, of which each node includes respective optical modules 1111. Each optical module 1111 may include a light source, a first detector for measuring the quantity of light scattered/reflected from an object, and a second detector for measuring a reference quantity of light at the same time as measurement of the first detector.
(57) The processor 1120 may sequentially drive each optical module 1111 of the image sensor 1110 according to predefined two or more light patterns. The processor 1120 may drive a light source by controlling a light intensity or a phase of each light source defined according to a light pattern.
(58) The processor 1120 may calculate each scattering reflectance based on a quantity of light scattered/reflected from an object and a reference quantity of light that are detected according to two or more light patterns, and may calculate a scattering coefficient and an absorption coefficient based on each scattering reflectance and each spatial frequency. Further, the processor 1120 may separately generate a scattering image and an absorption image based on the calculated scattering coefficient and absorption coefficient.
(59) The processor 1120 may analyze components of an object more accurately based on an absorption image, from which scattering characteristics are removed. In addition, the processor 1120 may obtain a component concentration of an object based on the absorption coefficient or the scattering coefficient. The processor 1120 may monitor a user's health condition based on the component concentration of an object.
(60) The output interface 1130 may output a processing result of the processor 11120 to a user. For example, the output interface 1130 may visually display information on a light pattern, which is currently in use, by using, for example, the same method as
(61) The storage 1140 may store various types of reference information. For example, the reference information may include light pattern information, a function equation for measuring a component of a user, and user information including a user's age, gender, health condition, and the like. Further, the storage 1140 may store the processing result of the processor 1120. For example, the storage 1140 may store the calculated scattering coefficient and absorption coefficient, the generated scattering image and absorption image, and component concentration information of an object, and the like.
(62) In this case, the storage 1140 may include at least one storage medium of a flash memory type memory, a hard disk type memory, a multimedia card micro type memory, a card type memory (e.g., an SD memory, an XD memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, and an optical disk, and the like.
(63) The communication interface 1150 may communicate with an external device 1160 to receive various types of reference information from the external device 1160. The received reference information may be stored in the storage 1130. Further, the communication interface 1150 may transmit the calculated scattering coefficient and absorption coefficient, the generated scattering image and absorption image, and an analysis result of components of an object, and the like to the external device 1160. In this case, examples of the external device 1160 may include an information processing apparatus such as a smartphone, a tablet PC, a desktop computer, and the like, and a component measuring apparatus for measuring a component of an object in an invasive manner.
(64) In this case, the communication interface 1150 may perform communication by using Bluetooth communication, Bluetooth Low Energy (BLE) communication, Near Field Communication (NFC), WLAN communication, Zigbee communication, Infrared Data Association (IrDA) communication, Wi-Fi Direct (WFD) communication, Ultra-Wideband (UWB) communication, Ant+ communication, WIFI communication, Radio Frequency Identification (RFID) communication, 3G communication, 4G communication, 5G communication, and the like. However, this is an example and is not intended to be limiting.
(65)
(66) The method of analyzing components of an object (hereinafter referred to as an object component analyzing method) of
(67) Referring to
(68) In this case, the request for analyzing a component of an object may be input by a user. However, the request is not limited thereto, and may be preset to be automatically input into the object component analyzing apparatus repeatedly at predetermined intervals. Further, the light pattern may be defined as two or more different patterns to discretely emit sinusoidal waves by controlling spatial frequency and phase. Further, an order of setting each light pattern may be predefined.
(69) Then, the object component analyzing apparatus may drive a light source according to a set light pattern in 1212, and each light source may emit light in 1213.
(70) Subsequently, the first detector may detect a first light scattered/reflected from an object in 1214. After being emitted by the light source toward the object, light is incident on the object, and is scattered or reflected according to tissue components in the object, to enter the first detector.
(71) Further, at the same time, the second detector may detect a second light that is emitted by the light source but is not incident on the object in 1215. Most of the light emitted by the light source is emitted toward the object, and some of the light is emitted toward the second detector.
(72) Next, once the first light and the second light are detected in 1214 and 1215 respectively according to the set light patterns, the object component analyzing apparatus confirms whether there is a next light pattern to be set in 1216; and in the case in which there is a next light pattern to be set, the object component analyzing apparatus sets the next light pattern in 1217, and may perform again the operation 1212 and the operations subsequent thereto.
(73) Then, once the first light and the second light are detected in 1214 and 1215 respectively according to two or more different light patterns, the object component analyzing apparatus may calculate the scattering coefficient and the absorption coefficient based on the first light and the second light in 1218. For example, the object component analyzing apparatus may calculate first scattering reflectance based on a ratio between a first quantity of light and a second quantity of light that are detected according to the first light pattern among the two or more light patterns, and may calculate second scattering reflectance based on a ratio between a first quantity of light and a second quantity of light that are detected according to a second light pattern. Further, the object component analyzing apparatus may calculate a scattering coefficient and an absorption coefficient based on the spatial frequency according to the first scattering reflectance and the first light pattern, and the spatial frequency according to the second scattering reflectance and the second light pattern.
(74) Subsequently, the object component analyzing apparatus may analyze a component of an object based on the calculated scattering coefficient and absorption coefficient in 1219. For example, the object component analyzing apparatus may separately generate a scattering image and an absorption image based on the scattering coefficient and the absorption coefficient. The object component analyzing apparatus may correct an absorption image of a component to be measured based on an absorption image of other components affecting the object component to be analyzed, and may analyze the object component by analyzing the corrected image. Alternatively, upon calculating the scattering coefficient and the absorption coefficient, the object component analyzing apparatus may measure a component concentration of the object by using either one or both of the scattering coefficient and the absorption coefficient. For example, the object component analyzing apparatus may measure a component concentration of the object by using a component measurement equation, which represents a correlation between the absorption coefficient and the component concentration.
(75) Next, the object component analyzing apparatus may output an analysis result of components of an object to a user in 1220. For example, the object component analyzing apparatus may visually or non-visually provide concentration information of an object component to a user. Further, the object component analyzing apparatus may output information on the monitored health condition of a user.
(76) Embodiments can be realized as a computer-readable code written on a computer-readable recording medium. The computer-readable recording medium may be any type of recording device in which data is stored in a computer-readable manner.
(77) Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, an optical data storage, and a carrier wave (e.g., data transmission through the Internet). The computer-readable recording medium can be distributed over a plurality of computer systems connected to a network so that a computer-readable code is written thereto and executed therefrom in a decentralized manner. Functional programs, codes, and code segments for realizing embodiments can be easily deduced by one of ordinary skill in the art.
(78) Embodiments have been described herein. However, it will be obvious to those skilled in the art that various changes and modifications can be made without changing technical ideas and features of the disclosure. Thus, it is clear that the above-described embodiments are illustrative in all aspects and are not intended to limit the disclosure.