WIDE FIELD FUNDUS CAMERA
20170280995 · 2017-10-05
Inventors
Cpc classification
A61B3/0025
HUMAN NECESSITIES
A61B3/12
HUMAN NECESSITIES
International classification
Abstract
A wide field fundus camera is disclosed to implement multiple illumination beam projectors and to capture multiple retinal images at a various viewing angles to mimic wide field retinal examination with an indirect ophthalmoscope. The wide field fundus camera may incorporate a consumer image recording device with fast auto focusing so as to make the device quick to respond and easy to use. The wide field fundus camera may include narrow and broad slit beam illuminations to enhance autofocusing and imaging through less transparent crystalline lens and through haze due to Purkinje reflections from crystalline lens surfaces. Control of multiple illumination beam projectors in a programmable manner can be used to assess alignment of each illumination beam projector with the eye and to capture said multiple retinal images. Furthermore, a method is disclosed to montage said multiple retinal images into a single montage and to remove haze and reflections.
Claims
1-38. (canceled)
39. A wide field fundus camera, comprising: an objective lens having a symmetric viewing axis and disposed to form a retinal image of wide field of view; an image recording device disposed to capture said retinal image of said wide field of view; a plurality of illumination beam projectors positioned around said viewing axis and each configured to project an illumination beam at a predetermined angle toward said objective lens; a first polarizer disposed in front of said image recording device, to define a polarization orientation; a set of second polarizers disposed each in front of a said illumination beam projector and oriented each to form a cross polarization condition with respect to said first polarizer to reject specular reflections of said illumination beams; and an electronic controller powering said plurality of illumination beam projectors and facilitating plurality of retinal images in a programmable manner.
40. The wide field fundus camera of claim 39, further comprising: a software algorithm implemented to process said plurality of retinal images and to stitch them into a wide field single image.
41. The wide field fundus camera of claim 39, wherein said objective lens includes an aspherical lens forming a field of view of 120 degrees or wider.
42. The wide field fundus camera of claim 39, wherein said image recording device is a consumer camera configured to provide automatic focusing and automatic exposure selection.
43. The wide field fundus camera of claim 39, wherein said illumination beam is delivered from a high power, high brightness white light LED.
44. The wide field fundus camera of claim 39, wherein said illumination beam is delivered from a high power, high brightness infrared LED.
45. The wide field fundus camera of claim 39, wherein said illumination beam is delivered from a low vergency beam projector.
46. The wide field fundus camera of claim 39, wherein said illumination beam is a slit beam.
47. The wide field fundus camera of claim 39, wherein said electronic controller is coupled with said image recording device via wireless electronics.
48. A wide field fundus camera, comprising: an aspherical lens having a symmetric viewing axis and disposed to form a retinal image of wide field of view; a focusing lens positioned along said viewing axis and reimaging said retinal image to distance; an image recording device capable of auto focus and auto exposure and disposed behind said focusing lens to capture said retinal image of said wide field of view; a plurality of illumination beam projectors positioned around said viewing axis and each illumination beam projected at an angle toward said objective lens; a narrow illumination beam projected at an angle and away from pupil center to illuminate a small section on retina to facilitate auto focusing through less-transparent eye optics; a cross polarization system incorporated between said illumination beams and said image recording device, to reject specular reflections of said illumination beams; and an electronic controller powering said plurality of illumination beam projectors and facilitating plurality of retinal images in a programmable manner.
49. The wide field fundus camera of claim 48, further comprising: a processor circuit coupled to a memory circuit, said memory circuit including instructions that cause said processor circuit to receive imaging information corresponding to said plurality of retinal images and to provide a composite image including stitching together said plurality of retinal images into a single montage image.
50. The wide field fundus camera of claim 48, further comprising: a processor circuit coupled to a memory circuit, said memory circuit including instructions that cause said processor circuit to receive imaging information corresponding to said plurality of retinal images and to remove artificial reflection spots and lens haze from each of said plurality of retinal images.
51. The wide field fundus camera of claim 48, wherein said aspherical lens has a field of view of 120 degrees or greater on said retina.
52. The wide field fundus camera of claim 48, wherein said focusing lens comprises an achromatic lens.
53. The wide field fundus camera of claim 48, wherein said illumination beams are each a slit beam.
54. The wide field fundus camera of claim 48, wherein said narrow illumination beam is a narrowed slit beam.
55. A method for providing a wide field fundus camera, comprising the steps of: providing an objective lens having a symmetric viewing axis and disposed to form a retinal image of said wide field of view; providing an image recording device disposed to capture said retinal image; providing plurality of illumination beam projectors positioned around said viewing axis and projected each an illumination beam at a predetermined angle with respect to said viewing axis; providing a cross polarization condition incorporated between said illumination beam projectors and said image recording device to reject specular reflections of said illumination beams. providing an electronic controller controlling said plurality of illumination beam projectors to control illumination power for each of said illumination beam projectors; powering said plurality of illumination beam projectors in a sequentially programmable manner; capturing plurality of fundus images synchronized with said illumination beam projectors in said sequential programmable manner; and providing a processor circuit coupled to a memory circuit, said memory circuit including instructions that cause said processor circuit to receive imaging information corresponding to said plurality of retinal images and to provide a composite image including stitching together said plurality of retinal images into a single montage image.
56. The method of claim 55, further comprising the steps of: providing a processor circuit coupled to a memory circuit, wherein said memory circuit includes instructions that cause said processor circuit to receive imaging information corresponding to said plurality of retinal images and capable of removing artificial reflection spots from each of said plurality of retinal images.
57. The method of claim 55, wherein said objective lens including an aspherical lens having a field of view of 120 degrees or wider on said retina.
58. The method of claim 55, wherein said illumination beams include slit beams.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
DETAILED DESCRIPTION
[0023]
[0024]
[0025] Objective lens 10 may be an aspherical lens and is located at a first end of the wide field fundus camera 100. The objective lens 10 defines a symmetric viewing axis 11 and a working plane 6 of the wide field fundus camera 100. The plurality of illumination beams 32a-32n emerging through an illumination aperture 8 are pre-focused at the working plane 6. When a subject eye 1 is aligned with the wide field fundus camera 100 for fundus viewing, subject pupil 3 is about to position at the working plane 6 and the illumination beams 32a-32n are projected into subject pupil 3 to illuminate the subject retina 2 for alignment and for photographing. At a proper alignment, objective lens 10 produces a first retina image near its back focal plane 5, and the first retina image is then re-imaged into the image recording device 20. The illumination aperture 8 is located at the back focal plane 5 so as to define illumination area on the subject retina 2.
[0026] At a proper alignment, objective lens 10 also forms an image of the subject pupil 3 onto the plane of optical stop 14, which thus defines a small, virtual viewing window on the subject pupil 3 for the camera 20 to look through into the retina 2. The illumination beams 32a-32n are thus respectively focused at the subject pupil 3 and the focal spots are pre-positioned outside the virtual viewing window. Therefore, any scattering light of illumination beams 32a-32n scattered outside this virtual viewing window will be substantially blocked from getting into the image recording device 20.
[0027] In an illustrative example, the wide field fundus camera 100 may provide a static field of view of 120 degrees or wider on the subject retina 2. In this illustrative example, the objective lens 10 has an optical power of about 120D and a diameter of about 18 mm. The objective lens 10 has thus a back focal length of shorter than 8 mm and a small working distance of approximate 4 millimeters with respect to the subject cornea 7. The objective lens 10 may be an aspherical lens such that to have relative lightweight and to produce optimal image quality over the subject retina 2.
[0028] A contact lens 12 may be positioned in front of the aspherical objective lens 10 and in direct contact with the subject cornea 7. The contact lens 12 may or may not have optical power.
[0029] There are commercially available aspherical lenses for retinal viewing, with indirect ophthalmoscopes or slit lamp microscopes. For instance, an aspherical lens integrated with a contact lens can be found in an Ocular ORMR-2x (Ocular Instruments, Bellevue, Wash., United States of America).
[0030] The image recording device 20 is located at a second end of the wide field fundus camera 100 and is to view and to photograph fundus image through objective lens 10. Also, this image recording device 20 is in an illustrative example able to perform auto-focusing and auto-exposure control. The image recording device 20 in an illustrative example may include a consumer image recording device that includes advanced features of auto-focus, auto-exposure, real time display, and image storage and transfer, and that is compact, lightweight, and easy to use. The image recording device 20 may have built-in function to readily transfer its recorded image to a local computer or other processor for internet connectivity and telemedicine networks. The image recording device 20 as an illustrative example may have a resolution over 2 mega pixels and have an entrance pupil of 8 mm or bigger to receive all light passing through the optical stop 14. The image recording device 20 may have a feature of a custom setting and be capable of saving working parameters for convenient operation. The image recording device 20 may have a separate display 60 for easy viewing, to provide a desirable viewing angle, display size, and display distance.
[0031] The image recording device 20 in an illustrative example is a smart lens type of consumer camera, such as a Sony QX100 (Sony Corporation, Japan). In this illustrative example, the image recording device 20 is coupled with the display 60 via Wi-Fi, and the display 60 may be a wireless device such as an iPhone or an iPad. Also this image recording device 20 may have high sensitivity and high resolution operation.
[0032] The plurality of illumination beam projectors 30a-30n may include two or more illumination beam projectors 30a-30n. Each of the projectors 30a-30n projects an illumination beam 32a-32n at an angle toward the objective lens 10. In an illustrative example, each illumination beam 32a-32n has a small vergency and has a beam size to cover the illumination aperture 8. This way, each illumination beam 32a-32n is to mimic the illumination of an indirect ophthalmoscope and to illuminate a portion of an image on the subject retina 2. In an illustrative example, the plurality of illumination beam projectors 30a-30n produces four illumination beams 32a-32n, of which each illuminates a quadrant of the field of view on the subject retina 2.
[0033] A wide field fundus camera 100 may be operated in the mydriatic condition, and white light illumination can be used for both aligning and photographing the subject retina 2. In an illustrative example, each of the plurality of illumination beam projectors 30a-30n includes a high brightness, high power white LED and a projection lens to produce a white light illumination beam 32a-32n. The white light LED may include a warm white light source with a color temperature about 3000 degrees of Kelvin. For radiation safety, each illumination beam 32a-32n is limited to project a few milli-watts of illumination power.
[0034] When another illumination condition is desirable, the illumination beam projectors 30a-30n can include one or more of high power, high brightness infrared LEDs. Further, the illumination beam projectors 30a-30n can include one or more of high power, high brightness LEDs capable of projecting a limited spectral range of illumination such as red, green, or blue light.
[0035] The projection angle of the illumination beams 32a-32n may be set so as to move corneal and crystalline lens reflections away from central viewing area. On the other hand, the projection angle of the illumination beams 32a-32n is limited to the minimum pupil size that the wide field fundus camera 100 is intended to use. For screening for ROP, the minimum pupil size is set to approximately 5 mm, and the projection angle of the illumination beams 32a-32n is thus set to about 10 to 15 degrees.
[0036] The narrow beam projector 40 is to project a narrow illumination beam 42 and to form a bright illumination feature on the retina 2 to facilitate auto focusing of the image recording device 20. Typically, a consumer image recording device 20 requires a relatively high illumination level and a relatively high contrast target feature to obtain reliable and effective auto focusing. A bright and narrow slit beam illumination on or near the center of retina 2 is illustrated. In one illustrated example, the dimensions of the slit beam are about 3 mm long and 1 mm wide on the retina 2.
[0037] The narrow illumination beam 42 is to project at an angle with respect to the viewing axis 11. In an illustrative example, the narrow slit beam 42 is focused outside the virtual image window and has no overlap with the image beam path throughout the crystalline lens 4.
[0038] The first polarizer 13 and the set of second polarizers 31a-31n may form a cross polarization condition to reject specular reflections of the illuminations beams 32a-32n back into the image recording device 20. For a predetermined orientation of the first polarizer 13, each of the second polarizers 31a-31n may be rotationally adjusted to form a precise condition of cross polarization. Specular reflections at surfaces of the objective lens 10 and contact lens 12 are particularly strong and necessary to remove. Specular reflections from first corneal surface (i.e. first Purkinje reflection), first surface of crystalline lens (i.e., third Purkinje reflection) and second surface of crystalline lens (i.e., fourth Purkinje reflection) can be a major source of image haze. A high extinction ratio of cross polarization is required for reflection haze reduction. The polarizers 31a-31n and 13 may be selectively thin film polarizers and have an extinction ratio of 300 or higher throughout the visible and infrared light spectrum.
[0039] The contact lens 12 may serve as an optical window of the wide field fundus camera 100 to interface with the subject cornea 7. The contact lens 12 is illustrated to have an anti-reflection coating on its convex surface. As the illumination beams 32a-32n and the narrow illumination beam 42 are small and bright on the contact lens 12, effort is required to minimize and to remove specular reflection from its convex surface that interfaces to air.
[0040] The focusing lens 17 in one illustrative example is an achromatic lens with a focal length about 60 mm to 80 mm and is positioned one focal length away from the back focal plane 5 of the objective lens 10. In one illustrative example, the collimation lens 17 is to reimage the first retinal image formed by the objective lens 10 into distance, and thus the image recording device 20 is operated to focus at distance. This way, the focal length of camera 20 can be adjusted continuously to match a desirable field of view and the selected retinal image area can thus fill up the camera display 60. As a result, the pixel resolution of the camera and its display can be optimized. Focusing lens 17 and objective lens 10 may form an optical afocal relay, to relay the outgoing beam from the subject pupil 3 to the image recording device 20. The optical afocal relay has a scaling factor m, equal to the ratio of the focal lengths between the focusing lens 17 and the objective lens 10. In an illustrative example, the focusing lens 17 has a focal length of 60 mm, and the optical afocal relay has a scaling factor m of about 7.5.
[0041] Optical stop 14 may be positioned in front of the image recording device 20 and is conjugated with the working plane 6 of the wide field fundus camera 100 via objective lens 10. The optical stop 14 has an aperture corresponding to a predetermined virtual viewing window on the subject pupil 3. For instance, for a scaling factor of 7.5 and a virtual viewing window of 1.3 mm on the subject pupil 3, the optical stop 14 is thus 10 mm. In operation, the subject pupil 3 is aligned with the working plane 6, and the optical stop 14 blocks any light scattered from outside the virtual viewing window on the subject pupil 3. The aperture of the optical stop 14 may also be limited to the effective aperture of the image recording device 20.
[0042] The electronic controller 50 is to couple with the image recording device 20 and to power the illumination projectors 30a-30n and the narrow beam projector 40. In an illustrative example, the electronic controller 50 powers the illumination projectors 30a-30n at a low power level during alignment and then ramps up them to a high power level for photographing the subject retina 2. The power level of each of the illumination projectors 30a-30n can be controlled in a programmable manner. This way, the illumination projectors 30a-30n can be synchronized with the image recording device 20 to take multiple retinal images with various on-off configurations and time sequences.
[0043] The display 60 may couple with and display real-time images of the image recording device 20. In an illustrative example, the display 60 is a high definition monitor and is coupled wirelessly with the image recording device 20. For instance, the image recording device 20 may be a Sony QX100 (Sony Corporation, Japan) and the display may be an iPad (Apple, Cupertino, California, United States of America) and data transfer between the two devices may be through Wi-Fi built into the devices.
[0044] The images captured by the image recording device 20 may be stored in the camera 20, monitored at the display 60, and transferred to a local computer or other networked computers. The images captured by the image recording device 20 may thus be viewed through the network, and retinal diseases can be diagnosed by a retinal professional in a local or remote location.
[0045] A digital controller 50 may be used to independently control each illumination beam projector 30a-30n. In an illustrative example there are four independent LED beam projectors controlled by a digital controller. The controller may be connected to a tablet through its USB port and the user interface to the image recording device 20 and the digital controller 50 may be provided on the tablet display.
[0046] In
[0047] In a separate illustrated example in
[0048] A method may be used to process the multiple retinal images provided by each independent projector beam 30a-30n and to stitch them into a single fundus image. An illustrative example of this method is a processor circuit coupled to a memory circuit, the memory circuit including instructions that cause the processor circuit to receive imaging information corresponding to the plurality of retinal images and to provide a composite image including stitching together the plurality of retinal images into a single montage image. Please refer to
[0049]
[0050] Because the illumination beam 232n is projected at an angle and is shaped by the apertures 8 and 9, the illumination beam 232n can thus be focused into subject pupil 3 and be away from the pupil center. In an illustrated condition, the illumination beam path is not overlapped with the image beam path inside the crystalline lens 4, and scattering light scattered from the crystalline lens 4 is not captured by the image recording device 20. In this way, image haze resulting from lens scattering of the illumination beam inside a less-transparent crystalline lens may be significantly reduced.
[0051] Also because the illumination beam 232n is projected at an angle and is shaped by the apertures 8 and 9, the illumination beam 233n is not symmetric on the subject retina 2. More than a quadrant of the field of view may be illuminated via such an illumination configuration. At this illumination condition, an image captured by the image recording device 20 may show only a portion but not the full field of view being illuminated. Therefore, multiple images may be required to capture the subject retina 2 in order to have a full field of view. In an illustrative example, four illumination beam projectors 230 are used and four retinal images may be captured in time sequence to provide a 120 degree field of view of the subject retina 2.
[0052]
[0053] The narrow slit beam 342 can be projected at an angle with respect to the viewing axis 11. In an illustrative example, the narrow slit bean 342 is focused outside the virtual image window and has no overlap with the image beam path throughout the crystalline lens 4. This way the slit beam image on the image recording device 20 is not blurred by scattering light from the crystalline lens 4, and the narrow slit beam 342 thus serves to facilitate autofocusing through less transparent crystalline lens 4.
[0054]
[0055] In an illustrative example, the slit beam 432n of
[0056]
[0057] In one illustrative example, the hand piece 500 may have an elongated shape, having dimensions about 60 mm in diameter and 200 mm long. In another illustrative example, for screening for ROP, the front end of the hand piece 500 is about 10 mm in diameter.
[0058]
[0059]
[0060]
[0061] Blending may be performed on the stitched pieces to seamlessly blend differences in exposure level of each illumination projector beam image. The final montage 905 may eliminate the lens haze 906, 907, 908, 909 from the montaged image. The image processing method may include a processor circuit coupled to a memory circuit, the memory circuit including instructions that cause the processor circuit to receive imaging information corresponding to the plurality of retinal images and to provide a composite image including stitching together the plurality of retinal images into a single montage image. It may further include a processor circuit coupled to a memory circuit, the memory circuit including instructions that cause the processor circuit to receive imaging information corresponding to the plurality of retinal images and remove artificial reflection spots and lens haze from each of said plurality of retinal images.
[0062] The above detailed description includes references to the accompanying drawings, which form a part of the detailed description. The drawings show, by way of illustration, specific embodiments in which the invention can be practiced. These embodiments are also referred to herein as “examples.” Such examples can include elements in addition to those shown or described. However, the present inventors also contemplate examples in which only those elements shown or described are provided. Moreover, the present inventors also contemplate examples using any combination or permutation of those elements shown or described (or one or more aspects thereof), either with respect to a particular example (or one or more aspects thereof), or with respect to other examples (or one or more aspects thereof) shown or described herein. In the event of inconsistent usages between this document and any documents so incorporated by reference, the usage in this document controls.
[0063] In this document, the terms “a” or “an” are used, as is common in patent documents, to include one or more than one, independent of any other instances or usages of “at least one” or “one or more.” In this document, the term “or” is used to refer to a nonexclusive or, such that “A or B” includes “A but not B,” “B but not A,” and “A and B,” unless otherwise indicated. In this document, the terms “including” and “in which” are used as the plain-English equivalents of the respective terms “comprising” and “wherein.” Also, in the following claims, the terms “including” and “comprising” are open-ended, that is, a system, device, article, composition, formulation, or process that includes elements in addition to those listed after such a term in a claim are still deemed to fall within the scope of that claim. Moreover, in the following claims, the terms “first,” “second,” and “third,” etc. are used merely as labels, and are not intended to impose numerical requirements on their objects.
[0064] Method examples described herein can be machine or computer-implemented at least in part. Some examples can include a computer-readable medium or machine-readable medium encoded with instructions operable to configure an electronic device to perform methods as described in the above examples. An implementation of such methods can include code, such as microcode, assembly language code, a higher-level language code, or the like. Such code can include computer readable instructions for performing various methods. The code may form portions of computer program products. Further, in an example, the code can be tangibly stored on one or more volatile, non-transitory, or non-volatile tangible computer-readable media, such as during execution or at other times. Examples of these tangible computer-readable media can include, but are not limited to, hard disks, removable magnetic disks, removable optical disks (e.g., compact disks and digital video disks), magnetic cassettes, memory cards or sticks, random access memories (RAMs), read only memories (ROMs), and the like.
[0065] The above description is intended to be illustrative, and not restrictive. For example, the above-described examples (or one or more aspects thereof) may be used in combination with each other. Other embodiments can be used, such as by one of ordinary skill in the art upon reviewing the above description. The Abstract is provided to comply with 37 C.F.R. §1.72(b), to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. Also, in the above Detailed Description, various features may be grouped together to streamline the disclosure. This should not be interpreted as intending that an unclaimed disclosed feature is essential to any claim. Rather, inventive subject matter may lie in less than all features of a particular disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description as examples or embodiments, with each claim standing on its own as a separate embodiment, and it is contemplated that such embodiments can be combined with each other in various combinations or permutations. The scope of the invention should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.