SUPPORTING A MEASUREMENT OF A LIQUID SAMPLE

Abstract

It is provided an arrangement and method for supporting a measurement of a liquid sample contained in a container, the arrangement comprising: a measurement support equipment; a camera system adapted to acquire images of a region of interest in which the container is arrangeable; and a processor adapted: to analyze at least one image of the images, in order to obtain an analysis result; and to control the measurement support equipment based on the analysis result, wherein the measurement support equipment is in particular controlled without requiring touching anything except the container.

Claims

1. An arrangement for supporting a measurement of a liquid sample contained in a container, the arrangement comprising: a measurement support equipment; a detection system adapted to acquire object information of an object in a region of interest in which the container is arrangeable, in order to acquire information about the container; and a processor adapted: to analyze the object information, in order to obtain an analysis result; and to control the measurement support equipment based on the analysis result, wherein the detection system comprises: a camera system adapted to acquire images of the region of interest as at least a part of the object information, wherein the processor is adapted to analyze at least one image of the images, in order to obtain at least partly the analysis result, wherein the measurement support equipment comprises a sample input system adapted to allow input of the sample for the measurement, wherein to control the measurement support equipment based on the analysis result comprises controlling the sample input system.

2. Arrangement according to claim 1, wherein the measurement support equipment is controlled without requiring a user touching anything except the container.

3. Arrangement according to claim 1, the sample input system including at least one of: a sample input opening; a sample aspirator including a sample aspirator tube having a lumen through which the sample can be conveyed towards a measurement chamber.

4. Arrangement according to claim 1, wherein the measurement support equipment comprises at least one of: an optical and/or acoustical output device; a sample aspirator positioner configured to adjust the sample aspirator tube in at least one of a position and an orientation; a sample input port closure configured to open and close an input port through which the sample aspirator tube is traversable to be accessible in the region of interest.

5. Arrangement according to claim 3, wherein to control the measurement support equipment based on the analysis result comprises at least one of: indicating information on the optical and/or acoustical output device; actuating the sample aspirator; actuating the sample aspirator positioner; actuating the sample input port closure.

6. Arrangement according to claim 1, wherein to analyze the at least one image includes in real time: object detection, using methods of at least one of unsupervised and supervised machine learning configured to identify in the image at least one object type from a group of candidate object types; wherein the measurement support equipment is controlled based on the identified object type.

7. Arrangement according to claim 1, wherein to analyze the at least one image includes in real time, at least one of: detecting a type of the container, including one of a syringe and a sample tube and a capillary and a sampling device; detecting at least one of a position and an orientation of the container.

8. Arrangement according to claim 1, wherein to analyze the at least one image includes in real time, at least one of: detecting a type of the sample including at least one of whole blood and plasma and serum and urine and a calibration solution and a quality control solution and pleural fluid and dialysate solution; detecting at least one of a condition and characteristic of the sample, including at least one of a homogeneity and a presence of bubbles and a density and a characteristic of a volume and a characteristic of a filling and a piston position of a syringe; detecting a type of an anticoagulant, by detecting at least one of a color of the sample and recognizable features of the sample container.

9. Arrangement according to claim 1, wherein the analysis result includes: an error related to at least one of the container and the sample; an incompatibility of the detected type of at least one of the container and the sample with an intended measurement; an incorrect arrangement of the container, including at least one of an incorrect positioning and an incorrect orientation of the container.

10. Arrangement according to claim 4, wherein the information indicated by the optical and/or acoustical output device comprises at least one of: the image; information regarding at least one of the container and the sample; an error message; a warning message; a waiting message; an information message; information regarding a state of a measurement workflow.

11. Arrangement according to claim 4, wherein the information indicated by the optical and/or acoustical output device comprises a demand to the user, including at least one of: indicating that the container should be moved to allow loading the sample into a measurement chamber; indicating that the container should by moved such that the sample aspirator tube is connected with the container; indicating that the container should be moved such that the sample aspirator tube is arranged in contact with the sample inside the container; and indicating that the container should be removed.

12. Arrangement according to claim 4, wherein to actuate the sample aspirator positioner comprises at least one of: controlling the sample aspirator positioner to move the sample aspirator tube to a predetermined loading position; controlling the sample aspirator positioner to move the sample aspirator tube to a parking position.

13. Arrangement according to claim 3, wherein to actuate the sample aspirator comprises at least one of: controlling the sample aspirator to aspirate a part of the sample through the sample aspirator tube; wherein to actuate the sample input port closure comprises: to control the sample input port closure to close or to open.

14. Arrangement according to claims 1, wherein to analyze the image includes at least one of detecting and decoding at least one label on at least one of the container and on a container cap, wherein the measurement support equipment is controlled further based on the detected at least one label.

15. Arrangement according to claims 14, wherein the label comprises information regarding at least one of: a patient; a date; a user; an information regarding the sample.

16. Arrangement according to claims 14, the label being configured as at least one of: text; bar code; QR code; color coded information.

17. Arrangement according to claim 1, wherein at least one of the following is satisfied: the measurement support equipment is controlled further based on at least one of a predetermined measurement configuration and a measurement workflow; to control the measurement support equipment includes at least one of to perform an action and to prohibit an action; the detection system further includes at least one of: a Laser scanning system; a RADAR-system; an infrared detection system; an ultrasonic system; the camera system includes at least one 2D detector array sensitive for at least one of infrared and visible and ultraviolet light.

18. Measurement apparatus, comprising: an arrangement according to claim 3; a sample input port through which the sample aspirator tube is traversable; a measurement chamber adapted to be filled with the sample through a lumen of the sample aspirator tube and comprising at least one sensor unit adapted to measure at least one analyte in the sample.

19. Method of supporting a measurement of a liquid sample contained in a container, the method comprising: acquiring, by a camera system, images of a region of interest in which the container is arrangeable, in order to acquire information about the container; analyzing at least one image of the images, in order to obtain an analysis result; and controlling measurement support equipment based on the analysis result, wherein the measurement support equipment comprises a sample input system adapted to allow input of the sample for the measurement, wherein to control the measurement support equipment based on the analysis result comprises controlling the sample input system.

20. Method according to claim 19, wherein the measurement support equipment is controlled based on the analysis result without requiring a user touching anything except the container.

Description

BRIEF DESCRIPTION OF THE DRAWING

[0067] FIG. 1 schematically illustrates a measurement apparatus according to an embodiment of the present invention comprising an arrangement for supporting a measurement of a liquid sample according to an embodiment of the present invention;

[0068] FIG. 2A to FIG. 2H schematically illustrate different container types which may be detected and determined by image analysis of images taken by the arrangement for supporting a measurement of a liquid sample according to an embodiment of the present invention; and

[0069] FIG. 3A to FIG. 3C illustrate images acquired by a camera system of an arrangement according to an embodiment of the present invention.

DETAILED DESCRIPTION

[0070] It is noted that structures or elements in different figures are labelled with reference signs differing only in the first digit. A description of one electric not explicitly described with respect to one embodiment may be taken from the description of the corresponding unit or structure or element as described with reference to another embodiment.

[0071] The measurement apparatus 150 schematically illustrated in FIG. 1 according to an embodiment of the present invention comprises an arrangement 100 for supporting a measurement of a liquid sample contained in a container 101 according to an embodiment of the present invention. In the illustrated embodiment, the sample 103 is contained in a syringe 101. The measurement apparatus 150 further comprises a sample input port 105 through which a sample aspirator tube 107 is traversable. In the embodiment illustrated in FIG. 1 the sample aspirator tube 107 is connected to a measurement chamber 109 comprising not illustrated sensor regions for measuring the sample 103 to detect at least one analyte, for example ions or gases or metabolites within the sample 103. The measurement chamber 109 is adapted to be filled with the sample 103 through a lumen of the sample aspirator tube 107 and comprises at least one sensor unit, in particular an electrode and/or an optical sensor to measure at least one analyte.

[0072] The arrangement 100 for supporting a measurement of the liquid sample 103 contained in the container 101 comprises measurement support equipment collectively labeled with reference sign 111 which may comprise one or more elements or devices as will be explained in detail below.

[0073] The arrangement 100 further comprises a camera system 113 which is adapted to acquire images of a region of interest 115 in which the container 101 is arrangeable, in particular by a hand 117 of a user.

[0074] The arrangement 100 further comprises a processor 119 which is adapted to analyze at least one image of the images in order to obtain an analysis result and to control the measurement support equipment 111 based on the analysis result. Thereby, as is depicted in FIG. 1, the processor is communicatively connected to the camera system 113 to receive digital signals representing at least one image from the camera system 113. The processor 119 analyzes at least one image, in particular plural images continuously in real time to obtain the analysis result and control the measurement support equipment 111.

[0075] The measurement support equipment 111 may comprise for example an optical and/or acoustical output device 121 for example comprising a display screen 123 and/or a loudspeaker 125. Thus, the processor can control the output device 121 depending on the analysis result which has been obtained by analyzing the images acquired by the camera system 113. By the optical and/or acoustical output device 121 different kinds of information may be indicated to a user, in order to facilitate the preparation of a measurement and ensure that the sample and/or container complies with requirements of the intended measurement process.

[0076] Additionally or alternatively, the measurement support equipment 111 comprises a sample aspirator 127, in the illustrated embodiment comprising the measurement chamber 109 as well as the aspirator tube 107. The sample aspirator further comprises not illustrated equipment for applying under-pressure or over-pressure for sucking or expelling the sample from the sample aspirator tube 107.

[0077] The measurement support equipment 111 may alternatively or additionally further comprise a sample aspirator positioner 129 which is configured to adjust the sample aspirator tube 107 in position and/or orientation. Also this sample aspirator positioner 129 may be controlled by the processor 119 based on the analysis result.

[0078] Other embodiments do not comprise a sample aspirator tube or a needle, but a sample input opening, into which e.g. a needle or a tip of a syringe may be inserted.

[0079] Further, the processor 119 may control a sample input port closure 131 based on the analysis result, to open or close the sample input port 105. The sample input port closure 131 may for example be configured as a sliding door which may slide to the right or to the left in FIG. 1 for closing or opening the sample input port 105.

[0080] For loading the sample for example from a syringe, the sample aspirator tube 107 may be oriented to point out of the image plane of FIG. 1, for example having an angle between the image plane of FIG. 1 and the sample tube between 20° and 90°. The sample aspirator tube 107 may be brought in a position and/or orientation depending on a type of container which has been detected by analysis of the images taken by the camera system by the processor 119.

[0081] The processor 119 is configured (in particular by loaded image-processing software) to perform object detection in the images as acquired by the camera system 113.

[0082] FIG. 2A to FIG. 2H illustrate other types of containers which are detectable by the processor 119 by analyzing the image taken from the camera system 113.

[0083] The container 201a illustrated in FIG. 2A is a syringe having a syringe body 202a, filled with sample 203 and being closed by a cap 204a and having a piston 214.

[0084] The container 201b illustrated in FIG. 2B is a sample tube having a sample compartment 202b being closed by a cap 204b. The processor 119 may also detect a type or color or label of the cap 204b.

[0085] The container 201c illustrated in FIG. 2C is a capillary also detectable by image detection or object detection by the processor 119.

[0086] The processor 119 not only is configured to detect different types of containers but is also configured to detect characteristics of the sample contained in one of the different types of containers. Examples are illustrated in FIG. 2D to FIG. 2H.

[0087] In the example illustrated in FIG. 2D, the sample comprises bubbles 206d. The sample is contained in a syringe 201d. The presence of bubbles 206d may interfere with an intended measurement process. The presence of those bubbles 206d may be indicated to a user for example by or on the optical and/or acoustical output device 121 illustrated in FIG. 1.

[0088] FIG. 2E illustrates a container showing a syringe 201e having only little amount of sample 203 filled into the syringe body 202e. The low filling level may also be detected by the processor and a warning message or an error message may be indicated to the user using for example the output device 121 illustrated in FIG. 1.

[0089] FIG. 2F illustrates a container showing a syringe 201f in which a sample is contained which is not sufficiently filled within the lumen of the syringe 201f. This low or insufficient filling may also be indicated to the user.

[0090] FIG. 2G illustrates a container showing a syringe 201g filled with fragmented samples having a sample fraction 203a and a sample fraction 203b being of different composition. This kind of sample may also not be compatible with an intended measurement process. Therefore, this problem of fragmented sample may be indicated to the user for example using the output device 121 of the arrangement 100 for supporting a measurement.

[0091] FIG. 2H illustrates a container showing a syringe 201h filled with sample having varying density as illustrated by different regions 208 and 210 in which the sample has different density. The problem of different density sample may also be indicated to the user using the output device 121.

[0092] The sample container 101 may comprise a label with information attached or printed directly on the outer surface of the container. An example is illustrated in the sample tube 201b in FIG. 2B, wherein a label 212 is attached to an outside of the container. The label 212 may comprise information regarding the patient, the date, the user information regarding the sample. The information may be in text form, in form of a bar-code or a QR-code, for example. Such a label 212 may in similar or different configuration also be attached or comprise in one of the other containers illustrated in FIG. 2A to FIG. 2H. The information on the label is decoded by the processor 119 by analyzing images taken by camera system 113.

[0093] FIGS. 3A, 3B and 3C illustrate images as taken by the camera system 113 illustrated in FIG. 1 during different steps for preparing a measurement. In the image of FIG. 3A the container 301 (held by a user's hand 317) is moved into the region of interest 315 (in which an sample input port 305 for loading the sample is arranged) and an image is captured by the camera system 113. The processor 119 receives the image data and analyzes the image in order to detect a type of the container 301 as well as a type and characteristics of the sample 303. In the illustrated embodiment the processor correctly determines that the container is a syringe and that the sample is whole blood.

[0094] In the next step illustrated in FIG. 3B the syringe is moved such that the sample aspirator tube 307, in particular a aspirator supply needle, is inserted through the tip opening of the syringe to be immersed into the sample.

[0095] In the next step illustrated in FIG. 3C, the syringe is further moved such that the end of the aspirator tube is fully inserted or immersed into the sample. Then the sample aspirator is controlled by the processor 119 to apply an under-pressure such that the sample is sucked into the lumen of the sample aspirator tube 307 to be conveyed to a not illustrated measurement chamber (for example similar as measurement chamber 109 illustrated in FIG. 1).

[0096] Embodiments of the present invention enable a touchless control of systems in in-vitro diagnostics. Automatic identification of the user is enabled by for example acquiring the image, and analyzing for example a label on the container. Furthermore, a user tag may be recognized, for example 1D or 2D bar-code may be recognized or a QR-code may be recognized or a text on the sample may be recognized.

[0097] In other embodiments, the user may not necessarily be associated or indicated on the container or the container cap. In these embodiments, the user may identify himself by another reading process or analysis step, in which the user for example presents an ID, a bar-code in the region of interest to be imaged by the camera system and to be analyzed by the processor to extract the user ID. The patient identification may also be recognized by reading or decoding a label on the container. The patient tag may for example be represented by a 1D or 2D bar-code or a QR-code or by simple text. Furthermore, the processor may recognize the type of the sample container, the type of the sample (for example whole blood, plasma, serum, urine) and type of the anticoagulant, if applicable, in particular via color-coding.

[0098] Furthermore, the arrangement 100 may be configured to automatically identify pre-analytic errors such as (lack of) homogeneity of the sample, air-bubbles within the sample, too low sample volume, not sufficient filling, erroneous handling (for example positioning of the piston of a syringe). Furthermore, the processor may be configured to automatically recognize erroneous operation of the device, in particular the measurement apparatus 150. By indicating errors to the user, the user is enabled to correct the detected errors before conducting the measurement itself. Furthermore, embodiments of the present invention reduce the risk of a contamination of the user by portions of the sample, since the control may be performed in a touchless manner.

[0099] The camera system may comprise a wide-angle lens or a panorama lens and may comprise several cameras having respective camera lenses. When several cameras are provided for the camera system, those cameras may be positioned at different positions, such that different viewing angles are realized to image the respective container from different viewing angles. Thereby a three-dimensional reconstruction of the container may be possible also simplifying the detection of the type of the container as well as the detection of the sample characteristics. Optionally, an illumination source may be provided for appropriately illuminating the region of interest including the container.

[0100] Object detection and recognition may employ detection, tracking and classification of objects, for example by deep learning supported computer vision system. The result may for example be an object which may be associated to a predefined class of objects and which at least two-dimensional position may be known. Those kinds of information may be utilized to extract particular objects from the image and in order to examine the sample container regarding the above described properties.

[0101] The position of the detected and classified object (for example type of container) may then be utilized for touchless controlling of the measurement support equipment. Thereby, an interface may be employed which may take over the control over the measurement workflow. Device actions may be triggered upon recognition of a predefined sample container or those device actions may be interrupted or prohibited. In combination with the information which may be extracted from the object, different actions may be distinguished and situations may be assessed.

[0102] For example, the FIG. 3A to FIG. 3C illustratess different steps of an exemplary preparation workflow. In FIG. 3A the sample container is presented for classification. Furthermore, patient data or other relevant information are read-in from the sample container. Then a particular action is triggered in that the sample input is moved into a position corresponding to the detected type of the sample container.

[0103] In FIG. 3B the syringe is attached to the sample needle. In FIG. 3C the state that the syringe is attached to the needle is recognized by the system and thereupon the sample is aspirated. The removing of the sample container may correspond to the reversed sequence of FIG. 3C, FIG. 3B, FIG. 3A.

[0104] Embodiments of the present invention may enable an automatic identification of user, patient, type of container, type or probe, type of anticoagulant. Furthermore, embodiments provide a method and an apparatus for automatically identifying or pre-analytic errors for example homogeneity of the sample.