Face Based Door Entry and Confirmation of Authenticity of Biological Sample
20210295627 · 2021-09-23
Inventors
Cpc classification
G06V40/15
PHYSICS
G06V40/70
PHYSICS
G06V10/75
PHYSICS
H04L63/0861
ELECTRICITY
G06V40/10
PHYSICS
G06V40/173
PHYSICS
G06Q20/208
PHYSICS
G07C2009/00746
PHYSICS
International classification
G07C9/25
PHYSICS
H04L9/32
ELECTRICITY
Abstract
In some embodiments, a method for confirming that a biological sample provided by an individual and sent to a testing facility was obtained from the individual includes obtaining a sample collection unit containing the biological sample and a video of the individual providing the biological sample. The individual provides the biological sample by recording a video of himself or herself: opening the sample collection unit; depositing the biological sample into the sample collection unit; and closing the sample collection unit. The method further includes analyzing the biological sample for one or more of at least one pathogen and at least one antibody to a pathogen; analyzing the video to ensure that the individual in the video provided the sample; and performing facial recognition on the video to correlate the sample collection unit and the biological sample to the individual.
Claims
1. A method for confirming that a biological sample provided by an individual and sent to a testing facility was obtained from the individual, comprising: obtaining a sample collection unit containing the biological sample and a video of the individual providing the biological sample, wherein the individual provides the biological sample by: recording a video of himself or herself: opening the sample collection unit; depositing the biological sample into the sample collection unit; and closing the sample collection unit; analyzing the biological sample for one or more of at least one pathogen and at least one antibody to a pathogen; analyzing the video to ensure that the individual in the video provided the sample; and performing facial recognition on the video to correlate the sample collection unit and the biological sample to the individual.
2. The method of claim 1, wherein the sample collection unit comprises a visual indicator indicating when it has been opened for the first time.
3. The method of claim 1, wherein the sample collection unit comprises a unique visual indicator enabling correlation of the biological sample to the individual.
4. The method of claim 1, wherein the sample collection unit comprises a visual indicator indicating when it has been closed.
5. The method of claim 1, wherein the sample collection unit comprises a locking mechanism configured to prevent re-opening of the sample collection unit without damaging the sample collection unit or creating a visual indicator.
6. The method of claim 1, wherein the biological sample is a saliva sample.
7. The method of claim 6, wherein the sample collection unit comprises a visual indicator indicating the presence of saliva.
8. The method of claim 1, wherein the individual recording the video of himself or herself further comprises the individual providing video of a photo ID of the individual.
9. The method of claim 8, further comprising correlating the identity of the individual to the provided video of the photo ID of the individual.
10. The method of claim 1, further comprising uploading the results of the analyzing the biological sample for the one or more of the at least one pathogen and the at least one antibody to the pathogen to a database in association with the identity of the individual for use at a facial recognition enabled entry system to provide access to a restricted area.
Description
DETAILED DESCRIPTION OF THE DRAWINGS
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
DETAILED DESCRIPTION OF THE INVENTION
[0018] While the invention is amenable to various modifications and alternative forms, specifics thereof are shown by way of example in the drawings and described in detail herein. It should be understood, however, that the intention is not to limit the invention to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
[0019] Facial recognition technology has become increasingly accurate and fast. PopID, for example, is a two-sided marketplace that allows merchants to authenticate customers in retail transactions at the point of sale. Consumers register for PopID and can then use the service to pull up loyalty accounts and make payments using a camera to scan the consumer's face. The present invention is related to use of facial recognition to authenticate an individual seeking to enter through a digitally-controlled door, make payments, and/or access reserved goods or services.
[0020]
[0021] As discussed herein, the entry system 10 may be configured for operation in different environments in addition to or instead of environment 12. Thus, it should be understood that the entry system 10 may include one or more features described herein as being optional, as appropriate to the environment in which an embodiment of the entry system 10 is intended to operate. For example, although the entry system 10 is illustrated as being mounted to a wall adjacent the door 14 in
[0022] In the embodiment illustrated in
[0023] In applications where a non-touch responsive graphical user interface 20 is desired; e.g., where it is desirable to reduce transmission of surface-borne pathogens (e.g., viruses or bacteria), the entry system 10 may be configured to trigger the process of unlocking the digital door lock when an individual seeking to gain access to an area secured by the digital door lock positions himself or herself within a sensing zone of the camera 22. In some such applications such as those in which the individual is required to answer one or more questions (e.g., pertaining to the health of the individual) presented on the graphical user interface 20 as part of the process of unlocking the digital door lock, the camera 22 may be a 3D camera configured to track eye gaze or other gestures of the individual and identify a selected answer among answer choices presented to the individual on the graphical user interface 20. Additionally, or alternatively, the entry system 10 in some such applications may include a microphone (shown in
[0024]
[0025] As shown in panel 32 of
[0026] In some applications, the processing circuitry may compare the image of the individual's face to a database of authorized entrants stored in a memory of the entry system 10. In some other applications, the processing circuitry may access a remote database via communication circuitry of the entry system 10 and the network 26 to enable comparison of the image of the individual's face to the remote database. If the comparison of the image of the individual's face to those in the database does not produce a match, the entry system 10 does not instruct the digital door lock to unlock. If a match for the individual's face is found, the entry system 10 determines the individual's identity and instructs the door access panel controller 16 to unlock the door striker 18 as shown at panel 34A. If no match for the individual's face is found, the entry system 10 determines that the individual is not authorized to gain entry and may display a message via the graphical user interface 20 indicating that access is denied and/or prompting the individual to re-attempt the process as shown at panel 34B. The process of
[0027]
[0028] The described circuitry may be implemented together on a common hardware component or separately as discrete but interoperable hardware or software components. Depiction of different features as circuitry is intended to highlight different functional aspects and does not necessarily imply that such circuitry must be realized by separate hardware or software components. Rather, functionality associated with one or more circuitry may be performed by separate hardware or software components, or integrated within common or separate hardware or software components.
[0029] Memory 46 includes computer-readable instructions that, when executed by processing circuitry 42, cause the entry system 10 and processing circuitry 42 to perform various functions attributed to the entry system 10 and processing circuitry 42 herein (e.g., receiving signals from other components, determining an identity, health status, and/or reservation status of an individual, and/or causing communication circuitry 44 to communicate with an external computing device). Memory 46 may include any volatile, non-volatile, magnetic, optical, or electrical media, such as a random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), electrically-erasable programmable ROM (EEPROM), flash memory, or any other digital or analog media.
[0030] Processing circuitry 42 may include any one or more of a microprocessor, a controller, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or equivalent discrete or analog logic circuitry. In some examples, processing circuitry 42 may include multiple components, such as any combination of one or more microprocessors, one or more controllers, one or more DSPs, one or more ASICs, or one or more FPGAs, as well as other discrete or integrated logic circuitry. The functions attributed to processing circuitry 42 herein may be embodied as software, firmware, hardware or any combination thereof.
[0031]
[0032]
[0033] According to the embodiment of
[0034] After receiving the signals corresponding to the infrared radiation, the individual's answers to the one or more questions, and the image of the face of the individual, the processing circuitry 42 of determines the identity of the individual based on the image of the face (54). As discussed above, the processing circuitry 42 may determine the identity of the individual by comparing the image of the individual's face to a database of authorized entrants stored in memory 46 of the entry system 10 in some embodiments. In other embodiments, the processing circuitry 42 may access a remote database via communication circuitry 44 of the entry system 10 and the network 26 to enable comparison of the image of the individual's face to images in the remote database. In either case, if the processing circuitry 42 finds a match for the image of the individual's face in the database, the processing circuitry 42 determines the identity of the individual as being the identity associated with the facial image in the database. If the processing circuitry 42 does not find a match for the image of the individual's face in the database, the processing circuitry 42 may identify/designate the identity of the individual as “unknown,” “unauthorized,” or the like, and the entry system 10 will not cause the digital door lock to unlock.
[0035] Next, the processing circuitry 42 determines the health status of the individual based on the body temperature of the individual and the individual's responses to the one or more questions (56). For example, with respect to the body temperature of the individual, the processing circuitry 42 may compare the determined body temperature value to a predetermined range of body temperature values and determine whether the individual has an elevated body temperature that may be a symptom of the one or more infectious diseases. The range of body temperature values may be generally applicable to humans past infancy or may be specific to the individual, if the individual is known to the database.
[0036] In instances in which the individual is known to the database (i.e., has a profile in the database, such as a PopID profile), the body temperature determined by the processing circuitry 42 may be stored in the individual's profile with an associated time/date stamp, along with the individual's facial image and/or voice information. In this manner a range of normal body temperatures specific to the individual may be established and/or a health status record of the individual may be maintained. A range of normal values for other physiological parameters, particularly those that may be affected by infectious disease, such as heart rate and/or respiratory rate, also may be established and stored in the database. For example, the camera 22 of the entry system 10 may be an RBG camera capable of detecting the individual's heart rate and/or respiratory rate. In such instances, the processing circuitry 42 may be configured to detect values of such other physiological parameters of the individual based on the signal received from the camera 22. Similarly, in instances in which the individual is known to the database, the individual's responses to the one or more questions may be stored in the individual's profile with an associated time/date stamp.
[0037] Additionally, or alternatively, immunity status of the individual to one or more infectious diseases may be stored in the individual's profile and may comprise part of the individual's health status as determined by the processing circuitry 42. For example, the individual's health profile may indicate whether the individual has been immunized against the disease(s) and/or has tested negative for the disease(s) within a preceding time period. In some embodiments, a laboratory that processes a biological sample from the individual to determine whether the individual is positive or negative for one or more types of disease-causing pathogens, such as viruses and/or bacteria, may securely upload the test results to a database where they are stored in the individual's profile (e.g., PopID profile).
[0038] In some instances in which the individual is known to the database (i.e., has a profile in the database, such as a PopID profile), the individual's profile may be used in a system of ensuring that a particular biological sample obtained by the individual (e.g., at the individual's home) and sent to a testing facility was indeed obtained from the particular individual. For example, the system may be used to verify that the individual has provided a biological sample by the individual taking a video of himself providing the sample and uploading the video to the database in addition to sending the sample to the testing facility. Such a system advantageously may reduce the administration cost of tests for immunity to and/or infection of the individual with one or more infectious diseases. For example, such a system may make it easier and cheaper for the individual to take a saliva-based test for antibodies to the SARS-CoV-2 virus that causes the disease COVID-19. Moreover, the result of such tests may be linked to the entry system 10, as further described below.
[0039] In some embodiments in which the system may be used to verify that the individual has provided a biological sample by the individual taking a video of himself providing the sample and uploading the video to the database, the individual may use a camera, such as a camera on a mobile phone, to record a video of an individual providing a biological sample into, such as spitting into, a sample collection unit for the subsequent test, where the test is a saliva-based test. The system likewise may be used with other types of tests, such as a nasal-swab test or others. One or more methods may be used to ensure that the individual in the video is the person who actually provided the saliva sample rather than a different individual. For example, facial recognition techniques, such as those described herein, may be used to verify the identity of the individual in the video. In another example, the individual may provide a picture or video footage of a photo ID, such as a driver's license or passport, to confirm his or her identity. In such examples, the video (including any additional video or pictures) may be analyzed to determine if it has been altered in any way. Such analysis of the video may be performed using algorithms commonly described as artificial intelligence, such as where at least one convolutional neural network is used to analyze the video.
[0040] In some embodiments in which the system may be used to verify that the individual has provided a biological sample by the individual taking a video of himself providing the sample and uploading the video to the database, the individual may use a sample collection unit comprising a vial with a screw on cap. In such examples, the video taken by the individual includes footage of the individual opening the container for the first time and then spitting into the sample collection unit. In such embodiments, the sample collection unit may include a compound that indicates that the sample collection unit has been opened for the first time via a visual indicator that can be recorded by the camera. By analyzing the video to confirm that the sample collection unit is being opened for the first time and then analyzing the video to confirm the individual spit into the sample collection unit, it is possible to increase the likelihood that the individual shown in the video spitting into the sample collection unit is the individual who provided the sample.
[0041] Various compounds and associated methods can be used to indicate when a sample collection unit has been opened for the first time, including chemicals that react with other chemicals or compounds that are present in the air, such as oxygen. Additionally, or alternatively, the sample collection unit may contain a chemical or chemicals that prevent a reaction among another chemical or chemicals in the sample collection unit. When the sample collection unit is opened, these reactions can proceed thereby providing the visual indicator. A sample visual indicator is a colorimetric oxygen indicator, such as a redox dye indicator an example of which is Ageless Eye, a product by Mitsubishi Gas Chemical Company.
[0042] In some embodiments, a sample collection unit contains a mechanism that provides an indicator of when the sample collection unit is closed. Such a mechanism may include a visual indicator that is activated when the sample collection unit is closed. Such an indicator may be accomplished in various ways. In one implementation, the sample collection unit includes a threaded top and cap. When the sample collection unit is closed, the twisting of the cap past a predefined point creates a visual indicator via the mechanical action of the twisting. In some embodiments, the sample collection unit cannot be reopened once it has been closed without damaging it or creating a visual indicator.
[0043] In some embodiments, a sample collection unit may be marked with an identifier that is visible to the camera. The identifier may be invisible to the individual but still visible to the camera. The identifier may be a unique identifier that can be captured on video and which is difficult to reproduce, such as certain types of holographic images, a QR code, a combination thereof, or the like.
[0044] In some embodiments, a sample collection unit may include a substance that visually indicates that it has come into contact with saliva. The use of such a system can help to confirm that the individual spitting into the sample collection unit is the person who is providing the sample. There are many options for visual indicators for saliva. For example, the enzyme α-amylase is found in very high levels in saliva and a range of products are able to use α-amylase as an indicator for the presence of saliva.
[0045] In some embodiments, a sample collection unit may be configured such that it enables or effectively enables one way flow of liquid, such as saliva, into the sample collection unit. In embodiments, a straw with a one way valve is one part of the apparatus used to collect the individual's saliva
[0046] In a method comprising some or all of the previously described embodiments, an individual wishing to demonstrate that he or she has specific antibodies (and hence, some level of resistance) to a specific illness may acquire a saliva-based test for such antibodies and wish to take the test in a way that ensures that he can prove that he is the person who provided the biological sample. Such a method alternatively may be used to test for a current infection status of the individual. In an example method of testing for antibodies, such a method may comprise the following steps, which may be performed in the following order or another suitable order:
[0047] (a) The individual sets up a cameras (such as the one on his mobile phone) and records a video of the following of himself performing the following actions:
[0048] (b) The individual opens the sample collection unit, which may provide a visual indicator that it has been opened for the first time and may contain a visual identifier so that it can be later identified and correlated to the individual when it is analyzed;
[0049] (c) The individual spits or otherwise deposits his or her saliva into the sample collection unit, which may provide a visual indicator to show the presence of saliva;
[0050] (d) The individual closes the sample collection unit, which may provide a visual indicator showing that it has been closed;
[0051] (e) Optionally, the individual may provide video or photo of a photo ID of the individual;
[0052] (f) The individual provides the sample collection unit and the video to one or more labs;
[0053] (g) The one or more labs analyze the sample for the presence of certain antibodies;
[0054] (h) The one or more labs analyze the video to ensure that the individual in the video provided the sample;
[0055] (i) The one or more labs perform facial recognition on the video to correlate the sample collection unit and provided sample to the individual;
[0056] (j) Optionally, the one or more labs correlate the identity of the individual to the provided image in the photo ID.
[0057] In some embodiments of such methods for antibody or infection testing, the steps of the sequence are shot such that the individual is always present in the video.
[0058] In any such embodiments, the results of the sample are connected to the individuals face and the individual's face is then used at a facial recognition enabled entry system to provide access to those with desired sample test results.
[0059] In other embodiments, the individual may have access to testing equipment that enables him or her to test himself or herself for the one or more disease(s) at home, such as via a loop-mediated isothermal amplification (LAMP), reverse-transcription LAMP (RT-LAMP), microfluidic chip, or polymerase chain reaction (PCR) assay and upload the test results to the database for storage in his or her profile. Given recent developments in simple, cost effective assays, the individual may test himself or herself and upload the results in this manner on a daily or other frequent basis. For example, the results of such at-home assays may include a unique identifier specific to a given test run, such as a bar code, alphanumeric code, or other suitable identifier, that the individual scans with a camera on a personal electronic device. The unique identifier then may be authenticated by an algorithm in an application on the electronic device and sent to the database, thereby validating the test results in association with the individual.
[0060] In any such embodiments, uploaded negative test result(s) may provide the individual with a temporary health passport that lasts for a predetermined duration (e.g., a day) after which the individual must again test negative for the pathogen(s). Alternatively, uploaded test results indicating that the individual has tested positive for antibodies to one or more pathogens may provide the individual with a temporary or permanent health passport, depending upon the nature of the pathogen(s). The temporary or permanent health passport may be associated with the individual's profile so that when the camera 22 captures the individual's facial image and the processing circuitry 42 finds a match for the image of the individual's face in the database, the processing circuitry 42 may identify the individual as having a valid health passport and the entry system 10 will cause the digital door lock to unlock.
[0061] Data pertaining to the health status and status history of the individual stored in the individual's profile may be accessed by certain authorized users, particularly if the database is accessible remotely from the entry system 10. For example, where the entry system 10 controls access to a workplace and the individual is an employee of the workplace, human resources personnel may be authorized to obtain data pertaining to the individual's health status and status history from the database as desired. In this manner the health statuses of employees may be monitored, such as for indications that an infectious disease outbreak is occurring among employees. In some embodiments, the data associated with the health statuses of one or more employees over time may be fed to an artificial intelligence (AI) algorithm capable of learning which symptoms are likely to be indicative of a particular disease, which may be particularly advantageous for detecting whether an individual has one or more of any number of diseases that can be identified by the parameters detected by the entry system 10.
[0062] Next, the processing circuitry 42 determines whether or not to cause the communication circuitry 44 to transmit a signal to the digital door lock instructing the digital door lock to unlock based on the determined identity and the health status of the individual (58). In either case, the processing circuitry 42 optionally may cause the graphical user interface 20 to display a message to the individual indicating whether access has been granted, and if not, may display a reason why; e.g., “individual unauthorized/unknown,” “health status suggests presence of infectious disease,” or the like.
[0063]
[0064] According to the embodiment of
[0065] Next, if the processing circuitry 42 has determined the identity of the individual as being an identity associated with a facial image in the database, the processing circuitry 42 then determines whether the individual has a valid reservation to access the restricted area regulated by the digital door lock at the current time (64). For example, the processing circuitry 42 may access a user profile (e.g., a PopID profile) associated with the identity of the individual in the database, which may include data pertaining to reservation(s) that the individual has made to access a given area at a particular time. The processing circuitry 42 may search the individual's user profile to determine whether the individual has a valid reservation to access the area regulated by the digital door lock at the current time. In some examples, the area regulated by the digital door lock may be a retail establishment providing goods for a monetary fee.
[0066] Upon determining that the individual has a valid reservation to access the area regulated by the digital door lock at the current time, the processing circuitry 42 causes the communication circuitry to transmit a signal to the digital door lock instructing the digital door lock to unlock (66). Alternatively, if the processing circuitry 42 determines that the individual does not have a valid reservation to access the regulated area at the current time, the processing circuitry 42 does not cause the communication circuitry 44 to transmit a signal to the digital door lock instructing the digital door lock to unlock, thereby preventing the individual from accessing the regulated area at the current time. In either case, the processing circuitry 42 optionally may cause the graphical user interface 20 to display a message to the individual indicating whether access has been granted, and if not, may display a reason why; e.g., “individual unauthorized/unknown,” “reservation invalid/expired/not yet available,” or the like.
[0067] Optionally, a system for use in the technique of
[0068] Optionally, a system for use in the technique of
[0069] In some such embodiments, the processing circuitry of the payment apparatus may be configured to communicate with the remote computing device to the process payment by transmitting, via the communication circuitry, the identity of the individual and the monetary value owed by the individual. The remote computing device may be configured to then charge the monetary value to a payment account, e.g., a credit card account, bank account, or other payment account, linked to the individual's profile. In this manner, the technique of
[0070]
[0071] According to the embodiment of
[0072] Next, if the processing circuitry 42 has determined the identity of the individual as being an identity associated with a facial image in the database, the processing circuitry 42 then determines whether the individual has a valid reservation to access reserved goods or services at the establishment at the current time (74). For example, the processing circuitry 42 may access a user profile (e.g., a PopID profile) associated with the identity of the individual in the database, which may include data pertaining to reservation(s) that the individual has made to access reserved goods or services at a particular time, such as a table at a restaurant or a room in a hotel. The processing circuitry 42 then may search data associated with the individual's user profile to determine whether the individual has a valid reservation at the current time.
[0073] Upon determining that the individual has a valid reservation to access the access reserved goods or services at the current time, the processing circuitry 42 causes the graphical user interface 20 to display instructions for the individual to access the reserved goods or services based on a determination that the individual has a valid reservation (76). For example, in a restaurant setting, the graphical user interface 20 may display a table number and/or table map indicating which table the individual should proceed to, optionally with any other relevant information. In a hotel, the graphical user interface 20 may display a room number and/or building map indicating which room the individual may proceed to, optionally with any other relevant information. In the example of a hotel the entry system 10 may be operatively connected to a system for dispensing room key cards upon determining that the individual has a valid reservation, or the hotel may be equipped with another entry system 10 at each room for use instead of a key card.
[0074] Alternatively, if the processing circuitry 42 determines that the individual does not have a valid reservation to access the goods or services at the current time, the processing circuitry 42 may cause the graphical user interface 20 to display a message to the individual indicating that no valid reservation is available and may display a reason why; e.g., “individual unauthorized/unknown,” “reservation invalid/expired/not yet available,” or the like.
[0075] Optionally, a system for use in the technique of
[0076] The description of the invention and its applications as set forth herein is illustrative and is not intended to limit the scope of the invention. Features of various embodiments may be combined with other embodiments within the contemplation of this invention. Variations and modifications of the embodiments disclosed herein are possible, and practical alternatives to and equivalents of the various elements of the embodiments would be understood to those of ordinary skill in the art upon study of this patent document. These and other variations and modifications of the embodiments disclosed herein may be made without departing from the scope and spirit of the invention.