Focusing mechanism for biosignals measurement with mobile devices
20200073055 ยท 2020-03-05
Inventors
Cpc classification
H04M2250/12
ELECTRICITY
G02B6/325
PHYSICS
International classification
G02B6/32
PHYSICS
Abstract
A focusing mechanism or module is designed to reduce the size of an optical lens-based focusing system that would be otherwise used in a portable device. According to one aspect of the present invention, the focusing mechanism includes a light guide with first and second sides. The light guide includes a plurality of light passages slanted inwardly formed evenly from the first side towards a center of the second side, wherein the light guide, disposed on top of the image sensor, collects a reflected light from a human body part and focuses the reflected light onto the image sensor, each of photosensors generates an proportional charge from the reflected light.
Claims
1. A focusing module for acquiring sensing signals, the focusing module comprising: a light guide with first and second sides, including a plurality of light passages slanted inwardly formed evenly from the first side towards a center of the second side, wherein the light guide, disposed on top of an array of photosensors, collects a reflected light from a human body part and focuses the reflected light through the light passages onto the photosensors, each of photosensors generates a charge, wherein the light guide is made with a plurality of sheets, each of the sheets includes a transparent patch forming part of one of the light passages.
2. (canceled)
3. The focusing module as recited in claim 1, wherein transparent patches on each of the sheets have their own diameters and centers of the transparent patches.
4. The focusing module as recited in claim 3, wherein all of the sheets are stacked to form the light passages slanted inwardly formed evenly from the first side towards the center of the second side.
5. The focusing module as recited in claim 4, wherein the first side of the light guide is larger than the array of photosensors in size, and the centers of the transparent patches on the plurality of sheets are progressively moving towards the center of the second side.
6. The focusing module as recited in claim 4, wherein the transparent patches are round in shape and formed by blackening each of the sheets except for areas of the transparent patches.
7. The focusing module as recited in claim 4, wherein each of the sheets is painted to form the transparent patches.
8. The focusing module as recited in claim 1, wherein the light guide is disposed under a display screen to collect the reflected light from the human body part via the display screen, and wherein the human body part is placed against the display screen.
9. The focusing module as recited in claim 8, wherein the display screen is part of a mobile device.
10. The focusing module as recited in claim 1, wherein the light guide is disposed next to a display screen to collect the reflected light from the human body part, and wherein the human body part is placed upon the second side of display screen.
11. A system for acquiring sensing signals via a focusing module, the system comprising: an image sensor including an array of photosensors; a light guide with first and second sides, including a plurality of light passages slanted inwardly formed evenly from the first side towards a center of the second side, wherein the light guide, disposed on top of the image sensor, collects a reflected light from a human body part and focuses the reflected light through the light passages onto the image sensor, each of photosensors generates a charge, and wherein the light guide is made with a plurality of sheets, each of the sheets includes a transparent patch forming part of one of the light passages.
12. (canceled)
13. The focusing module as recited in claim 11, wherein transparent patches on each of the sheets have their own diameters and centers of the transparent patches.
14. The focusing module as recited in claim 13, wherein all of the sheets are stacked to form the light passages slanted inwardly formed evenly from the first side towards the center of the second side.
15. The focusing module as recited in claim 14, wherein the first side of the light guide is larger than the image sensor in size, and the centers of the transparent patches on the plurality of sheets are progressively moving towards the center of the second side.
16. The focusing module as recited in claim 14, wherein the transparent patches are round in shape and formed by blackening each of the sheets except for areas of the transparent patches.
17. The focusing module as recited in claim 14, wherein each of the sheets is painted to form the transparent patches.
18. The focusing module as recited in claim 10, wherein the light guide is disposed under a display screen to collect the reflected light from the human body part via the display screen, and wherein the human body part is placed against the display screen.
19. The focusing module as recited in claim 18, wherein the image sensor is part of a mobile device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0020] These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where:
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
DETAILED DESCRIPTION OF THE INVENTION
[0041] The detailed description of the present invention is presented largely in terms of procedures, steps, logic blocks, processing, or other symbolic representations that directly or indirectly resemble the operations of devices or systems contemplated in the present invention. These descriptions and representations are typically used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art.
[0042] Reference herein to one embodiment or an embodiment means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in one embodiment in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
[0043] Embodiments of the invention are discussed below with reference to
[0044]
[0045]
[0046] Referring now to the drawings, in which like numerals refer to like parts throughout the several views,
[0047] In one embodiment, the sensing elements 202 form an array of predefined shape (e.g., square, rectangular or round).
[0048]
[0049] Referring now to
[0050] According to one embodiment, the readouts from the array 302 are preprocessed in a preprocessing circuit 304 to produce required sensing signals. For finger print application, all of the MN sensing element need to readout to form an image pattern. Only a few frames may be needed for finger print recognition. For biometrics application, more frames are required to obtain the necessary PPG waveform. In this case, it is not necessary to read out all of the sensing elements. For example, there are five areas (as shown in
[0051] An image processing unit 305 is provided to process the readouts from the preprocessing circuit 304. Depending on an implementation, some of the functions that are described above for the preprocessing circuit 304 may be implemented in the image processing unit 305, such as filtering out those sensing signals that seem to be too extreme. An extreme signal could happen from several sensing signals obtained from multiple areas, where one of the areas happens to be undesirable (e.g., dirt, scare, or discolored skin). The removal of an extreme signal among several sensing signals in a group may improve the accuracy of the readings on a body part.
[0052] A processing unit 306 is provided to perform some additional signal process and may be referred to as enhancer to enhance the signals per the control signal. In one example, readouts from several pixels are combined to enhance the sensitivity of the measurement around an area covered by these pixels. In another example, readouts from several pixels are accumulated to enhance or increase the signal-to-noise ratio for an area being sensed. According to one embodiment, a DC component is removed from the signals from the preprocessing circuit 304.
[0053] It should be noted that preprocessing circuit 304, image processing unit 305 and data processing unit 306 are not necessarily separate circuits. Depending on an implementation, they can be implemented in one or more ICs. The processed signals are then digitized at 307 and the data from the digitizer 307 is then sent to a different processor 308 or 309 to derive a specific measurement.
[0054] Not specifically shown in
[0055] According to one embodiment, a sensing element is implemented as an active-pixel sensor (APS). As shown in
[0056] The correlated double sampling, or CDS, circuitry is a method employed to improve the signal to noise ratio (S/N) of an image sensor by reading out the pixel 310 twice. The first readout happens right after the exposure of the sensor to a scene. The second readout happens without the sensor is exposed to the scene but soon after the first readout has successfully occurred. Accordingly, the first readout is herein referred to as actual light-induced signal while the second readout is referred to as a reference signal. The reference signal is largely coming from internal dark or reference output level in the pixel. By subtracting the reference output signal from the actual light-induced signal, static fixed pattern noise (FPN) and several types of temporal noise are effectively removed from the output of the sensor. In operation, the first readout of the signal from the photo detector 316 is stored on a capacitor 318 and the second readout the signal from the photo detector 316 is stored on a capacitor 320. The final readout of the signal is the difference between the signals on the capacitors 318 and 320. Depending on an implementation, the APS pixel can be selected to capture what is being focused on (e.g., a point of a finger) or read out the final charge. When used in a group to capture biological changes in an area of a body part, final charges from a group of ADS pixels can be read out and further processed in a pre-processing circuit 304 of
[0057]
in readout mode: the charges are transferred to Cf, thus
Qf=(VrVo)Cf
In one embodiment, Qf=Qt, the output Vo is expressed as follows:
Vo=[(V1Vr)Ch1+(V2Vr)Ch2+ . . . +(VnVr)Chn]/Cf+Vr
It is supposed that V1=V2= . . . =Vn=Vi, and Ch1=Ch2= . . . =Chn=Ch, the output Vo can be rewritten as follows:
Vo=nCh/Cf(ViVr)+Vr
Thus it can be concluded that the signal of a sensor area with n pixels is read out with gain of nCh/Cf, where n is the number of the inputs to the CDS.
[0058] Referring now to
[0059] At 352, sensing signals from an array of MN are collected. As described above, a sensor is used to sense a plurality of areas of a body part, several sensing elements are combined to form a large size of a sensing area so as to form a MN of array 354 (less resolution than the array of MN). This process will reduce the noise and increase the SNR to biometrics measurement. Accordingly, the received signals are elected per the predefined areas. It is assumed that a group of 49 (e.g., 77) pixels is designated to sense an area, sensing signals from these 49 pixels will be selected and added up, as if there was one captured signal from the area. The signal was captured for a period of time, hence a waveform. It is further assumed that the signal was captured for measuring a heart rate at 356, where the waveform is a PPG. At 358, the DC component is removed.
[0060] The selected sensing signals are digitized at 360 to generate a set of or sets of data. The data can now be processed in digital or by a dedicated module being executed by a processor at 364. The result of the data processing at 364 is shown to a display screen at 366, were the user sees the result right after the measurements were took.
[0061] Referring now to
[0062]
[0063] It may be appreciated to those skilled in the art that the slanted inward passages represent the optical characteristics of a focal lens or a set of focal lenses. These slanted inward passages allow reflected lights from an object placed upon the glass 404 to fall on the sensors 402 mounted under the light guide 408. As a comparison,
[0064]
[0065] There are display screens that won't allow lights to pass through, the package including the light guide 504 has to be placed or exposed to surface of a portable.
[0066]
[0067] The input interface 608 includes one or more input mechanisms. A user may use an input mechanism to interact with the device 600 by entering a command to the microcontroller 602. Examples of the input mechanisms include a microphone or mic to receive an audio command and a keyboard (e.g., a displayed soft keyboard) to receive a click or texture command. Another example of an input mechanism is a camera provided to capture a photo or video, where the data for the photo or video is stored in the device for immediate or subsequent use with other module(s) or application(s). The driver 610, coupled to the microcontroller 602, is provided to take instructions there from to drive the display screen 612. In one embodiment, the driver 610 is caused to drive the display screen 612 to display an image or images (e.g., an ad banner) or play back a video (e.g., an ad video). The network interface 614 is provided to allow the device 600 to communicate with other devices via a designated medium (e.g., a data network).
[0068] According to one implementation, the client module 606 is loaded in the memory 604 and executed by the controller 602 to receive. The client module 606 is designed to cause the display screen 612 to display an interface to receive some input (e.g., name, age or gender). The client module 606 is also designed to acquire other information automatically from the device 600, for example, the time, location, or temperature. In one embodiment, a display is shown to allow a user to choose what to measure (a selection), for example, a heart rate, a blood pressure, a blood flow, blood oximeter or other biological measurement. When a selection is made, the display shows an instruction how and where to have the sensor 609 in close contact with a body part, for example, a finger. Once all is ready, the client module 606 initiates the measurement via the microcontroller 602.
[0069] As described above, the sensing signals are generated, read out, preprocessed and digitized in accordance with the selection in one embodiment. The client module 606 deals now with sensing data or simply data. Algorithms for deriving corresponding logical measurements are implemented in the client module 606. Per the selection, one of the algorithms is activated to receive the data. The data is further selected from a set of predefined pixels corresponding to respective areas of a body part. The selected data is used with the activated algorithm to derive the logical measurement. In one embodiment, the measurement may be repeated with different sets of data corresponding to different areas of the body part, when the measurement derived is way off from a previous measurement. The final result is shown on the screen 612 and sent to a designated part with the permission of the user.
[0070] The present invention has been described in sufficient detail with a certain degree of particularity. It is understood to those skilled in the art that the present disclosure of embodiments has been made by way of examples only and that numerous changes in the arrangement and combination of parts may be resorted without departing from the spirit and scope of the invention as claimed. While the embodiments discussed herein may appear to include some limitations as to the presentation of the information units, in terms of the format and arrangement, the invention has applicability well beyond such embodiment, which can be appreciated by those skilled in the art.
[0071] Modifications, additions, or omissions may be made to the systems, apparatuses, and methods described herein without departing from the scope of the disclosure. For example, the components of the systems and apparatuses may be integrated or separated. Moreover, the operations of the systems and apparatuses disclosed herein may be performed by more, fewer, or other components and the methods described may include more, fewer, or other steps. Additionally, steps may be performed in any suitable order. As used in this document, each refers to each member of a set or each member of a subset of a set. Accordingly, the scope of the present invention is defined by the appended claims rather than the forgoing description of embodiments.
[0072] To aid the Patent Office and any readers of any patent issued on this application in interpreting the claims appended hereto, applicants wish to note that they do not intend any of the appended claims or claim elements to invoke 35 U.S.C. 112(f) unless the words means for or step for are explicitly used in the particular claim.