Cellphone based tissue oxygenation measuring device
11464453 · 2022-10-11
Assignee
Inventors
Cpc classification
A61B5/447
HUMAN NECESSITIES
A61B5/14546
HUMAN NECESSITIES
A61B5/6898
HUMAN NECESSITIES
International classification
A61B5/1455
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
A61B5/145
HUMAN NECESSITIES
Abstract
A cellphone-based oxygenation tool can include a circuitry housing unit, a light emitting diode (LED) box disposed on the circuitry housing unit, a plurality of LEDs disposed in the LED box, a diffuser sheet or lens disposed on the LED box, a lens holder disposed on the circuitry housing unit and configured to be movable with respect to the circuitry housing unit, a near-infrared (NIR) filter disposed on the lens holder, and a cellphone disposed on the circuitry housing unit and having an NIR sensitive camera. Each of the plurality of LEDs can have different wavelengths, and application software of the cellphone can be configured to acquire data from the NIR sensitive camera and process the data before storing the data.
Claims
1. A cellphone-based tool for measuring tissue oxygenation of a sample, the cellphone-based tool comprising: a circuitry housing; a light source case disposed on the circuitry housing; a lens holder disposed on the circuitry housing; and a light source disposed in the light source case and configured for emitting light on the sample; a near-infrared (NIR) filter disposed on the circuit housing; a cellphone disposed on the circuitry housing, the cellphone comprising a camera that is NIR sensitive, the cellphone configured for receiving an image of the sample through the NIR filter, processing a pixel intensity of the image, and converting the pixel intensity into a plurality of hemoglobin concentration maps comprising a first hemoglobin concentration map based on oxygenated hemoglobin concentration, a second hemoglobin concentration map based on deoxygenated hemoglobin concentration, a third hemoglobin concentration map based on total hemoglobin concentration, and a fourth hemoglobin concentration map based on oxygen saturation, the cellphone further configured for generating a tissue oxygenation map of the sample based on the plurality of hemoglobin concentration maps.
2. The cellphone-based tool according to claim 1, further comprising at least one of a diffuser sheet, a diffuser lens, a polarizer lens, and a polarizer sheet on the light source case.
3. The cellphone-based tool according to claim 2, the NIR filter comprising at least one of a longpass filter, a bandpass filter, a holographic filter, a polarizer lens, and a polarizer sheet.
4. The cellphone-based tool according to claim 2, the light source comprising a plurality of light emitting diodes (LEDs), each LED of the plurality of LEDs being a multi-wavelength LED capable of emitting light at multiple wavelengths.
5. The cellphone-based tool according to claim 4, the circuitry housing comprising a first housing having the cellphone disposed thereon and a second housing including the light source case.
6. The cellphone-based tool according to claim 5, further comprising an adjustable mount disposed between the first housing and the second housing.
7. The cellphone-based tool according to claim 6, the adjustable mount comprising a horizontal adjuster and a vertical adjuster.
8. The cellphone-based tool according to claim 6, further comprising a handle disposed on the first housing.
9. The cellphone-based tool according to claim 1, the cellphone-based tool configured for performing fluorescence imaging.
10. A method of measuring tissue oxygenation of a sample using a cellphone-based tool, the method comprising: providing a circuitry housing comprising a light source case, a lens holder, and a near-infrared (NIR) filter disposed thereon, the light source case comprising a light source disposed therein; connecting a cellphone to the circuitry housing, the cellphone comprising a camera that is NIR sensitive, the cellphone being connected to the circuitry housing such that the camera of the cellphone is aligned with the NIR filter; emitting, by the light source, light on the sample; receiving, by the cellphone, an image through the NIR filter; processing, by the cellphone, a pixel intensity based on the image; converting, by the cellphone, the pixel intensity into a plurality of hemoglobin concentration maps comprising a first hemoglobin concentration map based on oxygenated hemoglobin concentration, a second hemoglobin concentration map based on deoxygenated hemoglobin concentration, a third hemoglobin concentration map based on total hemoglobin concentration, and a fourth hemoglobin concentration map based on oxygen saturation; generating, by the cellphone, a tissue oxygenation map of the sample based on the plurality of hemoglobin concentration maps; and storing the tissue oxygenation map and the plurality of hemoglobin concentration maps on the cellphone.
11. The method according to claim 10, the emitting light by the light source comprising selecting a single wavelength mode or a multiple wavelength mode.
12. The method according to claim 11, the emitting light by the light source comprising outputting light at multiple wavelengths with or without multiplexing under the multiple wavelength mode.
13. The method according to claim 11, the emitting light by the light source comprising outputting a single wavelength continuously.
14. The method according to claim 10, further comprising positioning a calibration paper.
15. The method according to claim 14, the image comprising a video file, the video file being separated into calibration frames and data frames of each multiplexed wavelength of a plurality of multiplexed wavelengths, and the positioning of the calibration paper comprising positioning the calibration paper such that it aligns with the calibration frames.
16. The method according to claim 10, the image comprising at least one of a video file and an image file.
17. The method according to claim 11, further comprising comparing parameters or contrast of the stored tissue oxygenation map or plurality of hemoglobin concentration maps.
18. A cellphone-based tool for measuring tissue oxygenation of a sample, the cellphone-based tool comprising: a circuitry housing; a light emitting diode (LED) box disposed on the circuitry housing; a plurality of LEDs disposed in the LED box and configured for emitting light on the sample; a diffuser sheet or diffuser lens disposed on the LED box; a lens holder disposed on the circuitry housing and configured to be movable with respect to the circuitry housing; a near-infrared (NIR) filter disposed on the circuit housing; and a cellphone disposed on the circuitry housing, the cellphone comprising a camera that is NIR sensitive, the cellphone configured for receiving an image of the sample through the NIR filter, processing a pixel intensity of the image, and converting the pixel intensity into a plurality of hemoglobin concentration maps comprising a first hemoglobin concentration map based on oxygenated hemoglobin concentration, a second hemoglobin concentration map based on deoxygenated hemoglobin concentration, a third hemoglobin concentration map based on total hemoglobin concentration, and a fourth hemoglobin concentration map based on oxygen saturation, the cellphone further configured for generating a tissue oxygenation map of the sample based on the plurality of hemoglobin concentration maps, the circuitry housing comprising a first housing having the cellphone disposed thereon and a second housing connected to the first housing, the cellphone-based tool further comprising: a handle disposed on the first housing; and an adjustable mount disposed between the first housing and the second housing, the adjustable mount comprising a horizontal adjuster and a vertical adjuster, and each LED of the plurality of LEDs being a multi-wavelength LED capable of emitting light at multiple wavelengths.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
(24)
(25)
(26)
(27)
(28)
(29)
(30)
(31)
(32)
(33)
(34)
(35)
DETAILED DESCRIPTION
(36) Embodiments of the subject invention provide novel and advantageous mobile (e.g., cellphone-based or smartphone-based) oxygenation tools that comprise a light source having multi-wavelength illumination, application software acquiring data and processing the data, and a cellphone with camera, thereby allowing a user to detect the amount of tissue oxygenation (TO) and/or the hemoglobin concentration contained in a region of interest and to store the data.
(37) In an embodiment, a hand-held near-infrared optical scanner (NIROS) that uses near-infrared (NIR) light (e.g., between 650-950 nm) is configured to (and used to) obtain spectroscopic (or physiological) information from beneath the tissue surface. As NIR light is minimally absorbed and preferentially scattered by tissues, it allows deep tissue imaging. NIROS can be used in multiple clinical sites to map TO changes in DFUs across days/weeks of treatment. Oxygenation maps acquired across days/weeks of treatment differentiate healing from non-healing wounds. Preliminary TO-based dynamic analysis demarcates regions of poor oxygen flow around DFUs. The oxygenation changes with healing and provides objective assessment to augment clinicians' visual assessment of wound healing, with a potential to dynamically alter treatment approach for improved standard of care. Based on NIROS, embodiments of the subject invention provide the smartphone-based SmartPhone Oxygenation Tool (SPOT) NIR device or cellphone-based oxygenation tool (CBOT) as a low-cost, easy to use alternative to measure TO and/or hemoglobin concentration(s).
(38) Smartphone based technology for health care can be categorized into four generations as shown in
(39) CBOT is a smartphone-based NIR spectrometer for non-contact area imaging developed using Gen-D based smartphone technology. To date, NIR spectroscopic imaging has been developed into smartphone attached spectrometers for various applications (e.g., brain imaging, skin cancer). However, these devices acquire discrete point-based physiological information of tissues via contact imaging (not appropriate for wound imaging). CBOT is the only area based spectrometer that can obtain physiological (TO and/or hemoglobin concentration) information of large tissues (e.g., wounds) without contact.
(40) CBOT is a smartphone-based device to physiologically assess wounds. Smartphone-based wound image analysis approach has been recently developed by researchers to: (a) capture 2D digital images of wound and determine its size via image segmentation algorithms; (b) determine the wound depth in 3D; (c) select appropriate wound dressing based on symptoms; and/or (d) track wound healing status of patients. Considering the prevalence of smartphones, these smartphone-based approaches to digitize wound images and determine depth is important to make clinical assessments objective. Assessing wounds from a subclinical physiological perspective is a novel addition to smartphone-based technologies that augments wound care management with a potential to predict serious complications early on. To date, there is no smartphone-based imaging technology that physiologically assesses the wound bed (as TO and/or hemoglobin concentration-based measurements). CBOT devices according to embodiments of the subject invention are innovatively developed to obtain non-contact, non-invasive TO measurements in wound care management.
(41) CBOT is a low cost add-on imaging tool with user-friendly app. The CBOT device is a low-cost add-on imaging tool to any smartphone (e.g., Android platform, Apple platform, other cellphone platforms) with a custom-app that synchronizes data acquisition, analysis, storage, and secured Wi-Fi transfer to electronic medical record systems (if required). The device is designed to be compatible with at least 4 generations of Android-based smartphones, allowing its plug-n-use from multiple phones. Integration of CBOT device's data to hospital electronic clinical records and its ease of use by staff will allow sustainability of the technology. Other advantages include the ability to use a secured cloud account or remote server (e.g., FTP server) for the data and the ability to download the data directly from the cellphone (e.g., using USB or other data transfer methods).
(42) Technology associated with embodiments of the subject invention emerges from the last (fourth) generation and includes an external device+a mobile detector+a software application for the purpose of assessing tissue oxygenation. With this combination, embodiments of the subject invention provide a device capable of detecting subcutaneous TO changes that has a wide variety of applications. The device is intended to be a form of unofficial self-testing. Devices of a similar type have proven useful in saving lives when a user noticed irregularities in heartbeat or breathing patterns. Observing changes in TO may serve as an equally useful biomarker, especially for many patients who require daily treatment plans. The device, used in combination with the cellphone app, allows the user to detect the amount of TO (and/or the hemoglobin concentration) contained in a region of interest and stores the data to be compared over time. Additional dynamic assessment features can be added to enhance the capabilities to obtain real-time hemodynamic changes of the imaged regions.
(43) Some main features of embodiments the subject invention include: (i) a simple clip-on or add-on light source that allows multi-wavelength illumination of tissues for static as well as dynamic imaging; (ii) application software that performs both data acquisition as well as data processing to obtain tissue oxygenation maps (both static and dynamic images); (iii) the ability of the add-on tool to adapt to any smartphone with camera features; and (iv) the ability to provide dynamic and/or perfusion maps apart from tissue oxygenation maps (or any hemoglobin concentration-based parameter maps, or even simple diffuse reflectance, absorption, or fluorescence maps) of tissues imaged.
(44)
(45) Collected information is processed internally by the cellphone application or externally (e.g., using a laptop or desktop computer). The device provides the user with the ability to compare tissue oxygenation in and around a region of interest. Data can be collected and compared through time to determine if oxygenation to the affected area is changing. Oxygenation trends can be a predictor in terms of tissue viability and with the ability to self-monitor can better treat patients experiencing less than normal tissue function. In addition to the potential to self-monitor, it is also possible for a technician, clinician, or other health care professional to monitor.
(46)
(47) The cellphone add-on tool 20 of the cellphone-based oxygenation tool comprises the circuitry housing unit 100, a light emitting diode (LED) box (or light source case) 122 disposed on the circuitry housing unit 100, a lens holder 140 disposed on the circuitry housing unit 100, and at least one NIR filter 142 (e.g., a long pass filter, bandpass filter, holographic filter, or a combination thereof) disposed on the lens holder 140.
(48) The circuitry housing unit 100 comprises a first housing 110 corresponding to a cellphone and a second housing 120 including the LED box 122. The first housing 110 is used for a first PCB of the two PCBs and includes a start button 112, an ON button 114 controlling the on/off operation, and an indicator light 116 corresponding to each wavelength of a light source. In addition, a handle 160 (e.g., a removable handle) can be attached to the first housing 110 for easy grip handle.
(49) The second housing 120 is used for a second PCB of the two PCBs and includes the LED box 122 for a light source. The LED box 122 includes a diffuser sheet (or lens) slot 124, and a diffuser sheet is disposed in the diffuser sheet (or lens) slot 124 of the LED box 122. The diffuser sheet (or lens) 126 can be a diffuser lens or sheet, and/or a polarizer lens or sheet.
(50) The lens holder 140 is disposed on the second housing 120, and the longpass filter 142 is disposed on the lens holder 140. For example, the longpass filter 142 is a 645 nm filter, wherein NIR passes through the longpass filter 142 and UV and visible is blocked by the longpass filter 142 based on the 645 nm wavelength.
(51) The cellphone add-on tool 20 further comprises an adjustable mount 130 disposed between the first housing 110 and the second housing 120. The adjustable mount 130 comprises a horizontal adjuster 132 allowing horizontal adjustment and a vertical adjuster 134 allowing vertical adjustment (such that it can be adjusted to any smartphone and respective camera location), thereby allowing the lens holder 140 and the second housing 120 to move with respect to the first housing 110.
(52)
(53) The device operates with multi wavelength LED's in a common anode orientation, powered by power source (e.g., a battery, such as a 3.7 V rechargeable lithium ion battery). The light source 150 is placed to correspond to the diffuser sheet 126 (or diffuser lens) and/or polarizer lens or polarizer sheet), apart from a reflective surface for the LED box 122 to maximize the output optical power of the light source.
(54)
(55) Referring to
(56)
(57) The application software 30 operates a cellphone camera and the LED driver and also synchronizes them during data acquisition, saves external data obtained by the cellphone camera, streams/receives images into/from external data processing software (e.g., Matlab), and stores timestamped data. In addition, the application software 30 can operate video recorder, process images entirely within the App, and perform data analysis to acquire diffuse reflectance, absorption, and/or hemoglobin concentration maps (in terms of oxy-hemoglobin, deoxy-hemoglobin, total hemoglobin, oxygen saturation, and other relevant tissue physiological parameters such as melanin and water). This analysis can be for a single time stamp image (i.e., static) or for a continuous stream of time stamp (i.e., dynamic) images. The application software 30 is also able to record and track weekly or periodically acquired data from the same subject or across subjects.
(58)
(59) As the background ambient lighting of the cellphone 40 can interfere, the medium indoor lighting can be used. The cellphone 40 can include video recorder using 60 fps option (or other speeds available in the cellphone). In addition, the cellphone 40 can be configured for the application software to control all modes (single wavelength or multi-wavelength imaging) before opening the video recorder, and use raw detected NIR images.
(60)
(61) The hardware portion of the device can be an attachable unit that can be secured to any cellphone for the purpose of supplying light signals (in multiple wavelengths), using the cellphone for detection.
(62)
(63)
(64) The resulting light multiplexing will continue for 4 seconds in which 2 cycles will revolve. At the end of the light multiplexing, the user can either terminate the video file in the application by pushing the stop button, or allow the application to terminate the video file after a predetermined time interval (less than 10 seconds).
(65)
(66) The cellphone is attached to measure the diffuse reflected signal at each wavelength. The circuitry allows for the LED sequence to be pulsed only for a short period of time (about 2 cycles), after delaying for 5 seconds.
(67)
(68)
(69)
(70) The device collects data across all wavelengths of interest by multiplexing across the chosen wavelengths. If the data is collected appropriately, recorded video will be saved when prompted by the application.
(71) Embodiments of the subject invention include low-cost CBOTs that have an add-on imaging tool along with an integrated smartphone-app to allow automated data acquisition, analysis and storage.
(72) Multiple LEDs can be used to increase field of illumination (FOI). The CBOT according to an embodiment of the subject invention can incorporate Bluetooth and/or z wave technology (wireless radio frequency-based communications) that can deliver high quality networking while operating at low energy (compared to Wi-Fi), to allow for hardware control from smart phone app.
(73) The App of the CBOT is developed for design of a custom, user-friendly app on a cloud based platform providing user interface (UI) development tools and backend services built with appropriate software (e.g., jQuery Mobile/Bootstrap/Ionic, JavaScript) for the purpose of storing de-identified subject information, data recording/saving/retrieval, and data analysis/processing to acquire absorption contrast. The data can also be retrieved from the cellphone via for example Bluetooth, Wi-Fi, or via USB from a remote server (e.g., cloud or FTP server). The information can be initially stored within the device's internal memory, but can then be uploaded to a remote server, or retrieved on an external memory source, if the cellphone offers this capability.
(74) The CBOT device can be controlled using Bluetooth and/or z-wave technology by an external trigger in a source-routed mesh network topology connecting devices (one or more) to the smartphone, while the native device features or internal hardware (such as the digital camera) will be controlled and synced by the custom-app resulting in a 3-part device (add on imaging tool+smartphone+app CBOT). Hardware modifications can be made to multiplex wavelengths and synchronize illumination and detection by smartphone (using Bluetooth and/or z wave technology). Image stabilizing tools can be used to reduce noise and movement during imaging. The software app can be modified to process hemodynamic analysis using modified Beer Lambert's law or other light propagation models that mimic transport of diffused light.
(75) NIR imaging studies were performed using the CBOT in response to venous occlusion studies. Occlusion causes changes in blood flow, which relates to physiological changes of the tissue region occluded. Because NIR-based optical imaging techniques can determine physiological changes, occlusions studies are widely used as a validation study. Singular value decomposition (SVD) is a widely used image processing technique that is implemented to medical imaging data to reduce the image dimensionality. It extracts relevant details by reducing the dimensionality of the data via a simple implementation. SVD has been used extensively in the past for image compression and noise removal. SVD was implemented to the diffuse reflectance data at each wavelength. Reconstructed images of diffuse reflectance at a given wavelength (here only 690 nm data was used during preliminary assessment of the device) were compared across the three time stamps (rest, occlusion, and release) and SVD was applied for noise removal. The optical images varied across the time stamps (i.e., rest, occlusion, and relax) when Eigen values (EVs) between 3:15, 4:15, and/or 5:15 were used and further removal of EVs diminished that difference.
(76)
(77) The methods and processes described herein can be embodied as code and/or data. The software code and data described herein can be stored on one or more machine-readable media (e.g., computer-readable media), which may include any device or medium that can store code and/or data for use by a computer system. When a computer system and/or processer reads and executes the code and/or data stored on a computer-readable medium, the computer system and/or processer performs the methods and processes embodied as data structures and code stored within the computer-readable storage medium.
(78) It should be appreciated by those skilled in the art that computer-readable media include removable and non-removable structures/devices that can be used for storage of information, such as computer-readable instructions, data structures, program modules, and other data used by a computing system/environment. A computer-readable medium includes, but is not limited to, volatile memory such as random access memories (RAM, DRAM, SRAM); and non-volatile memory such as flash memory, various read-only-memories (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic/ferroelectric memories (MRAM, FeRAM), and magnetic and optical storage devices (hard drives, magnetic tape, CDs, DVDs); network devices; or other media now known or later developed that are capable of storing computer-readable information/data. Computer-readable media should not be construed or interpreted to include any propagating signals. A computer-readable medium of embodiments of the subject invention can be, for example, a compact disc (CD), digital video disc (DVD), flash memory device, volatile memory, or a hard disk drive (HDD), such as an external HDD or the HDD of a computing device, though embodiments are not limited thereto. A computing device can be, for example, a laptop computer, desktop computer, server, cell phone, or tablet, though embodiments are not limited thereto.
(79) It should be understood that the examples and embodiments described herein are for illustrative purposes only and that various modifications or changes in view thereof will be suggested to persons skilled in the art and are to be included within the spirit and purview of this application.
(80) All patents, patent applications, provisional applications, and publications referred to or cited herein are incorporated by reference in their entirety, including all figures and tables, to the extent they are not inconsistent with the explicit teachings of this specification.