SYSTEM AND METHOD FOR ENHANCED IMAGING OF BIOLOGICAL TISSUE
20200288965 ยท 2020-09-17
Inventors
Cpc classification
A61B3/10
HUMAN NECESSITIES
A61B3/1241
HUMAN NECESSITIES
G06T5/94
PHYSICS
A61B3/0025
HUMAN NECESSITIES
G06V40/15
PHYSICS
A61B3/14
HUMAN NECESSITIES
H04N25/13
ELECTRICITY
G06V30/18114
PHYSICS
International classification
A61B3/00
HUMAN NECESSITIES
A61B3/12
HUMAN NECESSITIES
Abstract
A system and method are presented for use in angiographic imaging. The system comprises: a light source unit, and at least one imaging unit comprising a detector array, wherein the detector array comprises at least first and second types of detector cells having corresponding first and second different spectral response functions defining respectively first and second spectral peaks; and the light source is unit configured for emitting light formed of at least first and second discrete wavelength ranges which are selected to be aligned with said first and second spectral peaks of said first and second types of detector cells.
Claims
1. A system, comprising: a light source unit; at least one imaging unit comprising a detector array, wherein the detector array comprises at least first and second types of detector cells having corresponding first and second different spectral response functions defining respectively first and second spectral peaks; and a light source unit configured for emitting light forming illumination including at least first and second discrete wavelength ranges, said at least first and second discrete wavelength ranges being aligned with said first and second spectral peaks of said first and second types of detector cells.
2. The system of claim 1, wherein said light source unit is adapted to provide the illumination within said at least first and second discrete wavelength ranges simultaneously, and at least partially concurrently with operation of said at least one imaging unit for acquisition of image data, such that exposure time of the at least one imaging unit at least partially overlaps with a time period of said illumination.
3. The system of claim 1, wherein said detector array is adapted for collecting image data using said at least first and second types of detector arrays simultaneously.
4. The system of claim 1, wherein said detector array comprises wavelength selective filter array filtering collected light and defining at least a portion of said first and second spectral response functions of said at least first and second types of detector cells.
5. The system of claim 1, wherein said detector array comprises said at least first and second types of detector cells arranged in an interlaced order within a common plane of the detector array, such that image data generated by said detector array comprises at least first and second image portions of a common field of view and associated with said first and second different spectral response functions.
6. The system of claim 1, wherein said detector array comprises three or more different types of detector cells comprising at least said first and second types of detector cells and at least a third type of detector cells selected from detector cell having spectral response functions having spectral peak corresponding to red, green and blue light.
7. The system of claim 1, wherein said at least first and second discrete wavelength ranges in the emitted light are spectrally substantially non-overlapping.
8. The system of claim 1, wherein said at least one imaging unit further comprises a wavelength blocking filter configured for blocking selected input radiation.
9. The system of claim 1, wherein said light source unit comprises at least first and second light sources configured for respectively emitting said light formed of said at least first and second discrete wavelength ranges.
10. The system of claim 1, further comprising a processing unit adapted for receiving image data from said detector array associated with image acquisition by said imaging unit of light collected from a region of interest subjected to said illumination, and for processing said image data to extract therefrom first and second image data pieces corresponding to collected light in the at least two different wavelength ranges and generate output data indicative of an enhanced image of the region of interest; said output data is indicative of an image map based on a relation between selected functions of the at least first and second image data pieces, providing enhancement to contrast of a selected portion of the region of interest over surrounding portions of said region of interest.
11. The system of claim 10, wherein said processing unit comprises an intensity calibration module adapted for operating in calibration mode defining an intensity calibration condition according to which intensity of illumination, generated by said light source unit in at least first and second discrete wavelength ranges, provides for obtaining substantially similar intensity response by said first and second types of detector cells.
12. The system of claim 11, wherein said intensity calibration module is adapted for operating said light source unit and said imaging unit for collecting image data under illumination of said at least first and second discrete wavelength ranges, determining saturation level for said first and second types of detector cells, and calibrating the intensity of illumination for said at least first and second discrete wavelength ranges in accordance with selected saturation level.
13. The system of claim 1, wherein said at least one imaging unit further comprises an optical lens arrangement adapted for selectively varying a focusing state for imaging in accordance with data on light collected by selected one of said at least first and second types of detector cells individually; and wherein said imaging unit is adapted for determining the focusing state in accordance with light of said first or second wavelength ranges selectively.
14. The system of claim 1, wherein said detector array is selected in accordance with said first and second spectral peaks for obtaining enhanced image data associated with blood vessels of a biological tissue in the region of interest.
15. The system of claim 14, configured for obtaining enhanced image data associated with blood vessels in at least one of retina and sclera of a patient's eye.
16. A method for acquiring image of biological tissue, the method comprising: providing image data, which corresponds to a light response of a region of interest to illumination of at least first and second different wavelength ranges, and is collected by a detector array comprising at least first and second different types of detector cells having corresponding first and second different spectral response functions defining respectively first and second spectral peaks aligned with said at least first and second different wavelength ranges, respectively; processing said image data by extracting therefrom at least first and second image data pieces associated with the collected light response by said at least first and second different types of detector cells, and generating output data indicative of an image map in accordance with a relation between said at least first and second image data pieces, said image map thereby providing enhanced contrast image of the region of interest.
17. The method of claim 16, wherein said image data is collected during an exposure time of said detector array at least partially overlaps with a time period of said illumination, and wherein said image data corresponds to simultaneous illumination of the region of interest by said at least first and second different wavelength ranges.
18. The method of claim 16, further comprising determining a focusing state of an optical arrangement for collection of said image data in accordance with collection of light of one of said at least first and second different wavelength ranges.
19. The method of claim 16, further comprising: determining an initial focusing state providing a relatively sharp image, varying a focusing state by a selected amount to provide a relatively blurred image, returning a focusing state toward said initial focusing state in a plurality of small focus steps, for each of said plurality of small focus steps determining a focusing level indicative of sharpness of the collected image is at least one of said at least first and second wavelength ranges, and determining the focusing state in accordance with a focus step having a maximal value of the focusing level.
20. The method of claim 16, further comprising calibrating illumination intensity for said first and second wavelength ranges; said calibration comprising determining initial intensity level for illumination with said first and second wavelength ranges, collecting first image data, determining saturation levels for detector cells of said first and second types of detector cells, and adjusting intensity level for illumination with one or more of said first and second wavelength ranges to provide predetermined saturation levels.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0053] In order to better understand the subject matter that is disclosed herein and to exemplify how it may be carried out in practice, embodiments will now be described, by way of non-limiting example only, with reference to the accompanying drawings, in which:
[0054]
[0055]
[0056]
[0057]
[0058]
DETAILED DESCRIPTION OF EMBODIMENTS
[0059] As indicated above, the present technique provides a system and corresponding method for use in enhanced angiographic imaging of biological tissue. Reference is made to
[0060] The system 100 is associated with (i.e. includes or is connectable to) a processing unit 500 configured for providing operational data for operating the imaging unit 110 and light source unit 120. In some embodiments, the processing unit 500 is also configured for processing image data, generated by the imaging unit, as described in detail below.
[0061] The imaging unit 110 includes a detector array 112 and an optional corresponding optical arrangement 114 configured and positioned for defining a selected field of view FOV for light collection therefrom onto the detector array 112 during an imaging session. The detector array 112 includes a plurality of detector cells, e.g. typically arranged in a two-dimensional array, including detector cells of two or more types having different spectral response functions defining respectively first and second spectral peaks, two such types of detector cells, generally at 112A and 112B, being exemplified in the non-limiting example of
[0062] More specifically, the detector array 112 includes detector cells of different response functions. This can be achieved by either using the detector cells of the same type equipped with suitable filter(s), or using the detector cells of different types, i.e. having different spectral sensitivity. The detector cells of different response functions are thus configured for collecting light components of selected different wavelengths (wavelength ranges) in accordance with their spectral response functions. This allows the detector array 112 to collect color image data by separating the collected light to spectral portions.
[0063] For example, typical color detector arrays include three types of detector cells (generally using monochromatic detector cells and Bayer filter array) configured for collection of light of three different colors such as primary colors RGB, i.e. red, green and blue. The present technique may utilize such detector configuration and may also use a detector configuration having an arrangement of detector cells of two or more different types.
[0064] For simplicity, the detector array 112 is described herein as including first and second different types of detector cells 112A and 112B having corresponding first and second different spectral response functions. It should however be understood that the principles of the present invention are not limited to this specific example, as well as not limited to any specific number n2 of the different types of the detector cells.
[0065] As also shown in
[0066] The light source unit 120 is configured to provide illumination having at least two discrete and different wavelengths (or wavelength ranges) directed toward a region of interest within the field of view FOV of the imaging unit. The light source unit 120 may typically include two or more light sources 122 and 124 (e.g. LED light sources) configured for emitting light of at least first and second different wavelength ranges selected in accordance with spectral response function of the first and second types of detector cells. For example, the light source(s) may emit two or more beams, including beams including light beam(s) of the first wavelength range and light beam(s) of the second wavelength range.
[0067] The light source unit 120 is preferably configured to provide narrow band illumination, such that the at least two wavelength ranges do not overlap in spectral bandwidth, providing illumination with light of two different colors. In some configurations, the at least two wavelengths of illumination correspond to at least two wavelength ranges having partial overlap, while being aligned with spectral peaks in the response functions of the detector cells of different types. More specifically, the at least two wavelengths of illumination are distinguishable when illumination thereof is collected by the detector cells of the detector array 112.
[0068] According to the present technique, the at least two wavelengths (wavelength ranges) of illumination are selected in accordance with spectral response functions of the first and second types of detector cells of the detector array 112.
[0069] As indicated above, the first and second wavelength ranges used for illumination are selected in accordance with wavelengths of the first and second spectral peaks of the respective first and second spectral response functions corresponding to the first and second types of detector cells. More specifically, according to some embodiments of the present technique, the first and second types of detector cells include detector cells configured for collection of blue light components and for collection of red-light components. In accordance with the example of
[0070] Light source unit 120 may include two or more light sources 122 and 124 configured for providing illumination in the discrete wavelength ranges aligned with the spectral peaks of two or more types of detector cells of the detector array 112. More specifically, for use with typical detector array 112 configured for collecting light in three different wavelength ranges by respective three different types of detector cells, the light source unit 120 may include two or three different light sources for emitting light in two or three different wavelength ranges (being non-overlapping). For example, a typical RGB detector may have detector cells having maximal response for wavelengths of 450 nm (blue), 550 nm (green) and 650 nm (Red). For use with such a detector array, the light source unit may include light sources (e.g. LED light sources) configured for emitting light in narrow bands around at least two from wavelengths of 450 nm, 550 nm and 650 nm.
[0071] In some examples, the light source unit 120 is configured to provide two or more discrete wavelength ranges of illumination including a first wavelength range being a relatively narrow band within the range of 400-570 nm and a second wavelength range being a relatively narrow band within the range of 580-770 nm. The first and second different wavelength ranges may correspond to wavelength ranges having a bandwidth of 10-50 nm within the ranges 400-480 nm and 580-700 nm.
[0072] In some examples, the first and second different wavelength ranges may include light within the ranges of 405-420 nm and 630-670 nm or within the ranges 410-420 nm and 640-660 nm.
[0073] Additionally, in some configurations, the imaging unit 110 may also include a spectral blocking filter 116 configured for blocking collection of selected spectral range. For example, the imaging unit 110 may utilize an infrared blocking filter configured for filtering out infrared illumination. As shown in
[0074] Turning back to
[0075] The illumination controller 500B of the processing unit 500 may operate the light source unit 120 to emit light having the first and second wavelength ranges (e.g. using light sources 122 and 124) and illuminate a region of interest within the field of view FOV of the detector. The detector controller 500C of the processing unit 500 is configured for operating the imaging unit 110 to perform one or more imaging sessions for collection of image data during a time period (exposure time) at least partially overlapping with the illumination time period. The light source unit 120 may be operated in flash mode, i.e. providing high intensity illumination for a short time, or in continuous illumination mode to provide illumination for a period substantially longer with respect to exposure time of the detector array 112. The detector array 112 is operated for collecting light components from the field of view FOV and generating corresponding image data associated with at least first and second wavelength ranges of light arriving from the field of view FOV.
[0076] The use of at least first and second wavelength ranges is based on the inventors' understanding that a relation between collected image data in at least two different wavelength ranges enables contrast enhancement for imaging of blood vessels over background of biological tissue. More specifically, using at least two image portions of a tissue sample, where one image is collected at a first (e.g. blue) wavelength range and another image is collected at a second (e.g. red) wavelength range, allows determining an image map based on a relation (e.g. ratio) between selected functions of the at least two image portions. Such an image map provides enhancement to contrast of blood vessels over surrounding biological tissue. To this end, the present technique utilizes processing image data received from the detector array 112 for extracting at least two image portions associated with image collected by the first type of detector cells (e.g. blue detector cells) and image portions associated with image collected by the second type of detector cells (e.g. red detector calls). For example, the detector array 112 generates image data in the form of RGB image (e.g. bitmap or compressed color image), and processing of the image data may comprise extraction of Red image portion and of Blue image portion of the image data and determination of a contrast enhanced image corresponding to a selected ratio between the red and blue image portions.
[0077] Thus, the present invention utilizes image portions collected by a common detector array, collected in a common instance of image acquisition, to avoid the need for registration between pixels of different images.
[0078] In this connection, reference is made to
[0079] Under this illumination condition, the technique includes collecting image data using a detector array having the at least first and second types of detector cells 3020. This image data may generally be a color image of the field of view, while being affected by illumination condition of the first and second wavelength ranges. In some embodiments, one or more so-collected image data pieces may be used for further processing 3030. The processing may include extracting at least first and second image portions 3040 associated with the first and second types of detector cells. For example, using an RGB color image detector, an image data piece may be formed by three-pixel maps indicating the intensity of light collected by the three types of detector cells. More specifically, the three-pixel maps may indicate the intensity of light collected by the red detector cells, green detector cells and blue detector cells. It should be noted that certain actions indicated herein with reference to
[0080] The processing includes determining a map of relations between the at least first and second image portions for generating an enhanced contrast image 3050, and generating output data 3060 indicative of the enhanced contrast image. For example, the enhanced contrast image may be determined in accordance with a ratio between detected light intensity by the detector cells of different types (e.g. red and blue types) for each pixel.
[0081] For example, the output image may be in the form of:
where Im(i,j) is the enhanced contrast image pixel (i,j), Im.sup.R(i,j) is pixel (i,j) of the red image portion and Im.sup.B(i,j) is pixel (i,j) of the blue image portion, n and m are real numbers. It should be noted that in some configurations the enhanced contrast image may be determined in accordance with the relation between green and blue image portions, or red and green image portion. In some additional examples, the output image may be in the form of:
Where Im.sup.1(i,j), Im.sup.2(i,j) and Im.sup.3(i,j) relate to pixel (i,j), in the red, green or blue image portions and , and are selected coefficients. In some configurations, the summation of pixels may be performed in the readout stage to simplify processing.
[0082] The present technique utilizes illumination with at least two different and non-overlapping wavelength ranges and collection of image data using a detector array having at least two different types of detector cells (detector cells sensitive to different wavelength ranges) for providing image portions in a common image acquisition using common optics. This enables processing of the image data while avoiding the need to apply registration process where pixels of one image portion need to be aligned with pixels of one other image portion. This is advantageous for obtaining angiographic images of biological tissues that tend to move at high speed. For example, angiographic images of tissue in a patient's eye may typically require high speed image acquisition for compensating high speed eye movement.
[0083] To enable further enhancing of image contrast, allowing improved angiography, the present technique may utilize an illumination calibration process. More specifically, the calibration procedure is aimed at adjusting illumination intensity of different wavelength ranges to sensitivity of the detector cells of different types (i.e. having different spectral response functions). To this end, the system of the present the present invention includes a calibration module (510 in
[0084] Generally, initial first and second intensity levels are determined (step 4010) for operating the light source to provide illumination with the at least first and second wavelength ranges. Such initial intensity levels may be similar or different for the different wavelengths of illumination and may be predetermined or selected by an operator. An imaging session is performed, and an image is acquired by illuminating the field of view with the different wavelength ranges of selected intensity levels (step 4020) and collecting light response of the illuminated region of interest by a detector array having two or more types of detector cells having different spectral response functions (step 4030), as described above. The so-detected light response provides collected color image data sensitive to at least the first and second wavelengths.
[0085] The image data is processed by extracting therefrom image portions corresponding to the two different types of detector cells and determining intensity levels (saturation levels) of the collected image portions 4040.
[0086] For example, using 8-bit digital detector cells, the intensity levels of the acquired image portions may range between 0 and 255. A high number of pixels measuring intensity at 255 may indicate saturation of the detector, while if there are no pixels measuring at high intensities (e.g. no pixels measuring above 250) the range of detection is limited.
[0087] It should be noted that the light intensity may be determined by any known suitable technique e.g. using wavelets and determining amplitude at high spatial frequencies, using analysis of contrast of the first and second image portions, etc.
[0088] Generally, to provide high quality improved contrast, the intensity levels in the different image portions are preferably substantially similar, while utilizing the dynamic range of the detector cells.
[0089] In accordance with the intensity levels of the image portions corresponding to the two different types of detector cells, the calibration module 510 operates together with the illumination controller 500B for adjusting intensity of illumination in one or more of the wavelength ranges (step 4050), and the calibration procedure (steps 4020, 4030 and 4040) is repeated (step 4060) until a condition of substantially similar intensity levels in the different image portions is provided. Generally, when intensity levels of detected light in the at least two different image portions are sufficiently close, the so-acquired image may be used for processing (step 4070).
[0090] Adjusting the illumination intensity levels can further enhance contrast for angiographic imaging by utilizing the full dynamic range of the detector cells. Considering imaging of a region of interest on a subject's body, the above-described calibration of illumination intensities enables enhancing detection of blood vessels within the image data of the region of interest in accordance with variation in reflective properties to different wavelength ranges.
[0091] Reference is made to
[0092] The image data reader 500A is configured and operable for processing and analyzing image data provided by the detector array. To this end, the image data reader 500A includes an image portion extraction module 514 configured for receiving polychromatic image data (e.g. RGB image data) from the detector array and extracting image portions associated with the different two or more types of detector cells; and an enhanced image generating module 516 configured for using two of more image portions received from the mage portion extraction module 514 and predetermined or selected parameters pre-stored in the memory utility 800 for determining an enhanced contrast image of a region of interest in the field of view.
[0093] The processing unit 500 may also include the autofocusing module 520 and/or the illumination calibration module 510. The operation of the illumination calibration module 510 is described above. It should be understood that the illumination calibration module 630 may be a component of the illumination controller 510.
[0094] The autofocusing module 520 is configured and operable for tuning the focusing state of the imaging unit based on one or more of the image portions extracted by the extraction module from the detected image data. Generally, the autofocusing module 520 may operate for determining optimal focusing state of the optical lens arrangement (114 in
[0095] The above technique allows to utilize a difference in penetration depths of light of the respective wavelength ranges into different tissue portions (biological tissues) with the region of interest being imaged, for imaging the tissue portions (blood vessels) at selected depths.
[0096] More specifically, in the example of typical RGB imaging, i.e. using a standard industrial color camera with three color channels R (Red), G (Green) and B (Blue) with peak responses at 650 nm, 550 nm and 450 nm correspondingly, and providing illumination in at least two of the peak response levels (e.g. illumination in 650 nm and 450 nm, and possible also in 550 nm), light components of different wavelengths have slightly different penetration depths into biological tissue. More specifically, light of a wavelength around 450 nm may have penetration depth within the range of 200-400 micrometers, while light components at wavelength of 650 nm may penetrate deeper into the tissue, and provide penetration depth of 500 micrometer or more. Accordingly, depending on depth of focus of the optical lens arrangement, determining focusing based on input of blue detector cells may result in imaging of a plane at 200-400 micrometers penetration depth into the tissue, and determining focusing using red detector cells may provide imaging of deeper layers of the tissue (generally 500-1000 micrometers). It should be noted that selection of the wavelength used for illumination is performed in accordance with the peak response of the detector cells, and may also be selected in accordance with variation in reflection properties of the tissue being imaged.
[0097] The autofocusing module 520 may utilize any known suitable technique for determining the level of focusing. For example, in some configurations, the autofocusing module 520 may be configured for determining contrast between sub-groups of detector cells of a selected type, selected from one or more regions of a collected image. Contrast between neighboring pixels may provide indication to sharpness of the image. Additional autofocusing technique may utilize phase detection. In these configurations, light components arriving from a common location in the inspected tissue (sample) and passing through different regions of the optical lens arrangement are compared at the detector plane. When the optical arrangement is properly focused, such light components overlap at the detector plane, while if the optical lens arrangement is out of focus, two or more not overlapping image regions may be identified.
[0098] As indicated, the focusing state/level is preferably determined using selected one type of detector cells. However, an initial focusing level may be determined based on monochromatic imaging or combination of the different wavelength ranges. This configuration of the focusing detection, combined with illumination of two or more different wavelength ranges aligned with maximal response to the different types of detector cells, enables focusing on object planes being in selected penetration depth(s) of light of selected wavelength range(s) into the biological tissue.
[0099] To provide suitable focusing, while enabling detection of the differences between the penetrations depths into the tissue, the autofocusing module 520 may be adapted to determine focusing state/level at one of more object planes, and the focusing state may be determined using detector cells of the selected type.
[0100] Generally, this technique may include: determining initial focusing state providing sharp image, varying focusing state by a selected amount to provide blurred image, returning focusing state toward said initial focusing state in a plurality of small focus steps, for each of said plurality of small focus steps determining a focusing state indicative of sharpness of the collected image is said one of said at least first and second wavelength ranges, and determining focusing state in accordance with focus step having maximal focusing state.
[0101] In some examples, the plurality of small focus steps pass said initial focusing state to its other focal side. More specifically, if the first diversion from initial focusing state is directed to focusing on object plane that is further from the imaging unit, the technique may utilize progress in small focus steps and overshoot toward defocusing for object plane located closer with respect to the imaging unit and vice versa. It should be noted that, generally, the present technique may utilize selection of preferred penetration depth for which optimal focusing is desired. In accordance with the preferred penetration depth, the wavelength, or type of detector cells, used for autofocusing is selected based on the penetration depth of the corresponding illumination wavelength.
[0102] Thus, the present technique provides for novel imaging technique enabling improved and enhanced contrast imaging. This technique may enable improved imaging of biological tissues allowing angiographic imaging, by enabling detection of blood vessel from optical imaging that does not require administration of contrast material. The technique of the present invention may be advantageously used for angiographic imaging of eye regions, such as retina and sclera where rapid eye movement does not allow collection of separated images.