Abstract
A microscope, a reflection correction method for correcting digital microscopic images and an apparatus for producing reflection-corrected, preferably microscopic, images of an object are provided. The apparatus comprises an illumination device with an illumination source and an illumination pupil for illuminating an object; an image recording sensor device that is configured to record a sequence of images of the object that belong to illumination situations, which differ from one another in each case; an image processing device that is configured to produce a reflection-corrected image from the sequence and a sub-aperture modulation device that is configured to produce the illumination situations, which differ from one another, in such a way that, for each image region in an image from the sequence containing a reflected illumination image of at least part of the illumination pupil, there is a corresponding image region without this reflected illumination image.
Claims
1. An apparatus for producing reflection-corrected images, preferably reflection-corrected microscopic images, of an object, comprising an illumination device with an illumination source and an illumination pupil for illuminating an object; an image recording sensor device that is configured to record a sequence of images of the object that belong to illumination situations, which differ from one another in each case; an image processing device that is configured to produce a reflection-corrected image from the sequence; and a sub-aperture modulation device that is configured to produce the illumination situations, which differ from one another, in such a way that, for each image region in an image from the sequence containing a reflected illumination image of at least part of the illumination pupil, there is a corresponding image region without this reflected illumination image in at least one of the remaining images from the sequence; wherein the sub-aperture modulation device comprises means for producing the illumination situations, which differ from one another, by a sequential modification of an illumination beam path from the illumination pupil to the object, wherein, in each case, light from a respectively associated first sub-aperture region of the illumination pupil is incident on the object while no light is incident on the object from a respective second sub-aperture region of the illumination pupil.
2. The apparatus as claimed in claim 1, wherein the means for producing the illumination situations, which differ from one another, comprise means for respectively modifying the illumination beam path in such a way that, when considered over all the illumination situations, which differ from one another, the respectively associated first sub-aperture regions are disjoint from one another.
3. The apparatus as claimed in claim 1, wherein the means for producing the illumination situations, which differ from one another, comprise means for respectively modifying the illumination beam path in such a way that, when considered over all the different illumination situations, a composition of the respective second sub-aperture regions covers the entire illumination pupil.
4. The apparatus as claimed in claim 1, wherein the illumination pupil is a first illumination pupil at the illumination source and the sub-aperture modulation device is configured to modify the illumination beam path from the first illumination pupil.
5. The apparatus as claimed in claim 1, wherein the illumination pupil is a second illumination pupil in a plane that is conjugate to the illumination source and the sub-aperture modulation device is configured to modify the illumination beam path from the second illumination pupil.
6. The apparatus as claimed in claim 1, wherein the means for producing the illumination situations, which differ from one another, comprise means for intermittently shadowing the respective second sub-aperture region.
7. The apparatus as claimed in claim 6, wherein the means for intermittently shadowing the respective second sub-aperture region comprise a movable mechanical sub-aperture mask.
8. The apparatus as claimed in claim 6, wherein the means for intermittently shadowing the respective second sub-aperture region comprise an electronically actuatable aperture stop.
9. The apparatus as claimed in claim 1, wherein the means for producing the illumination situations, which differ from one another, comprise means for intermittently coupling the respective first sub-aperture region into the illumination beam path without simultaneously coupling-in the respective second sub-aperture region.
10. The apparatus as claimed in claim 9, wherein the means for intermittently coupling the respective first sub-aperture region into the illumination beam path are configured to displace a position of the reflected illumination image of the respective first sub-aperture region in a targeted manner by a time-varying angle deflection.
11. The apparatus as claimed in claim 1, wherein the means for producing the different illumination situations comprise means for intermittently activating separately actuatable sub-aperture regions of the illumination source.
12. The apparatus as claimed in claim 11, wherein the illumination device as an illumination source comprises a secondary illumination source, into which light that was modulated by the sub-aperture modulation device is fed, said light being emitted by a primary illumination source.
13. The apparatus as claimed in claim 12, wherein the illumination device comprises at least one optical waveguide bundle and the secondary illumination source is an output of the optical waveguide bundle.
14. The apparatus as claimed in claim 1, wherein the apparatus comprises a further illumination device with a further illumination pupil for illuminating the object.
15. The apparatus as claimed in claim 14, wherein the sub-aperture modulation device is further configured to produce the illumination situations, which differ from one another, in such a way that, for each further image region in the image from the sequence containing a further reflected illumination image of at least a part of the further illumination pupil, too, a further corresponding image region without this further reflected illumination image is present in at least one of the remaining images from the sequence; and wherein the sub-aperture modulation device comprises means for producing the illumination situations, which differ from one another, by a sequential modification of a further illumination beam path from the further illumination pupil to the object, too, wherein, in each case, light from a respectively associated first sub-aperture region of the further illumination pupil is also incident on the object while no light is incident on the object from a respective second sub-aperture region of the further illumination pupil.
16. A microscope preferably an operating microscope, comprising an apparatus as claimed in claim 1.
17. The microscope as claimed in claim 16, wherein the illumination beam path from the illumination source comprises a beam path of a coaxial illumination.
18. The microscope as claimed in claim 16, wherein the apparatus comprises means to only steer the modified illumination beam path onto the object in a region between an objective of the microscope and the object.
19. The microscope as claimed in claim 16, having a display device which comprises at least a digital eyepiece, an eyepiece with data superimposition, a monitor or smartglasses.
20. A reflection correction method for correcting digital microscopic images, comprising the following steps: illuminating an object through an illumination pupil of an illumination device; recording a sequence of images of the object that belong to illumination situations, which differ from one another in each case, by way of an image recording sensor device; producing a reflection-corrected image from the sequence using an image processing device; and producing the illumination situations, which differ from one another, using an illumination modulation device in such a way that, for each image region in an image from the sequence containing a reflected illumination image of at least part of the illumination pupil, there is a corresponding image region without this reflected illumination image in at least one of the remaining images from the sequence; wherein producing the illumination situations, which differ from one another, comprises producing the illumination situations, which differ from one another, by a sequential modification of an illumination beam path from the illumination pupil to the object, wherein, in each case, light from a respectively associated first sub-aperture region of the illumination pupil is incident on the object, while no light is incident on the object from a respective second sub-aperture region of the illumination pupil.
21. The reflection correction method as claimed in claim 20, wherein producing the reflection-corrected image from the sequence comprises, in a segmentation step, carrying out a deep-learning-based reflection segmentation for each image from the sequence and eliminating image regions that are detected as afflicted by reflections from the respective image and, in a combination-by-calculation step, carrying out a combination based on an HDR method by calculation of the images of the sequence resulting from the segmentation step for reflection-corrected imaging.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0075] FIG. 1 shows a schematic illustration of an apparatus for producing reflection-corrected images according to an embodiment of the invention;
[0076] FIG. 2 shows a schematic illustration of a first example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0077] FIG. 3 shows a schematic illustration of a second example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0078] FIG. 4 shows a schematic illustration of a third example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0079] FIG. 5 shows a schematic illustration of a fourth example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0080] FIG. 6 shows a schematic illustration of a fifth example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0081] FIG. 7 shows a schematic illustration of a sixth example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0082] FIG. 8 shows a schematic illustration of a seventh example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0083] FIG. 9 shows a schematic illustration of an eighth example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0084] FIG. 10 shows a schematic illustration of a ninth example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0085] FIG. 11 shows a schematic illustration of a tenth example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations;
[0086] FIG. 12 shows a schematic illustration of a first example of a microscope with an apparatus for producing reflection-corrected images according to an embodiment of the invention;
[0087] FIG. 13 shows a schematic illustration of a second example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0088] FIG. 14 shows a schematic illustration of a third example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0089] FIG. 15 shows a schematic illustration of a fourth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0090] FIG. 16 shows a schematic illustration of a fifth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0091] FIG. 17 shows a schematic illustration of a sixth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0092] FIG. 18 shows a schematic illustration of a seventh example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0093] FIG. 19 shows a schematic illustration of an eighth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0094] FIG. 20 shows a schematic illustration of examples for sub-aperture illumination options of an illuminated field array of LED chip;
[0095] FIG. 21 shows a schematic illustration of a ninth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0096] FIG. 22 shows a schematic illustration of an example for a sub-aperture stop that is suitable for use in a microscope according to FIG. 21;
[0097] FIG. 23 shows a schematic illustration of an example for the arrangement of an illumination module for a microscope;
[0098] FIG. 24 shows a schematic illustration of a first example for an illumination device with a sub-aperture modulation device;
[0099] FIG. 25 shows a schematic illustration of a further example for a sub-aperture stop;
[0100] FIG. 26 shows a schematic illustration of an example for a rotatably mounted receptacle of a sub-aperture stop;
[0101] FIG. 27 shows a schematic illustration of an example for a sub-aperture stop that is integrated into a hollow shaft motor;
[0102] FIG. 28 shows a schematic illustration of an example for a sub-aperture modulation device;
[0103] FIG. 29 shows a schematic illustration of a further example for a sub-aperture modulation device;
[0104] FIG. 30 shows a schematic illustration of another further example for a sub-aperture modulation device;
[0105] FIG. 31 shows a schematic illustration of a second example for an illumination device with a sub-aperture modulation device;
[0106] FIG. 32 shows a schematic illustration of a third example for an illumination device with a sub-aperture modulation device;
[0107] FIG. 33 shows a schematic illustration of a fourth example for an illumination device with a sub-aperture modulation device;
[0108] FIG. 34 shows a schematic illustration of a tenth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0109] FIG. 35 shows a schematic illustration of an eleventh example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0110] FIG. 36 shows a schematic illustration of a twelfth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0111] FIG. 37 shows a schematic illustration of a thirteenth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention;
[0112] FIG. 38 shows a schematic illustration of a fourteenth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention; and
[0113] FIG. 39 shows a schematic illustration of an example for a reflection correction method for correcting digital microscopic images according to a further embodiment of the invention.
DETAILED DESCRIPTION OF THE INVENTION
[0114] Identical or similar elements have been provided with identical reference signs in the figures, to the extent that this is expedient.
[0115] It is understood that other embodiments can be used and structural or logical modifications can be undertaken, without departing from the scope of protection of the present invention. It is understood that the features of the various described exemplary embodiments can be combined with one another, provided there is no specific statement to the contrary. Therefore, the description should not be considered restrictive and the scope of protection of the present invention is defined by the attached claims.
[0116] FIG. 1 shows a schematic illustration of an apparatus 10 for producing reflection-corrected images of an object 11 according to an embodiment of the invention. In FIG. 1, the object 11 is presented in a manner reduced to the observed object field. The apparatus 10 comprises an illumination device 12 with an illumination source 13 and an illumination pupil 14 for illuminating an object 11. Moreover, the apparatus 10 has an image recording sensor device 15, by means of which it is possible to record a sequence of images of the object 11 that belong to illumination situations, which differ from one another in each case. The image recording sensor device 15 is connected to an image processing device 16 (or forms a structural unit with the latter) that is configured to produce a reflection-corrected image from the sequence. To this end, the image processing device 16 may comprise a processor, a memory and programming, for example, by means of which a reflection correction method is carried out and a reflection-corrected image is synthesized from the sequence of images.
[0117] Moreover, the apparatus 10 comprises a sub-aperture modulation device 17 that is configured to produce the illumination situations, which differ from one another, in such a way that, for each image region in an image from the sequence containing a reflected illumination image of at least part of the illumination pupil 14, in particular an illumination image whose image location is situated at or near that of the object, there is a corresponding image region without this reflected illumination image in at least one of the remaining images from the sequence, wherein the sub-aperture modulation device 17 comprises means for producing the illumination situations, which differ from one another, by a sequential modification of an illumination beam path 18 from the illumination pupil 14 to the object 11, wherein, in each case, light from a respectively associated first sub-aperture region of the illumination pupil 14 is incident on the object 11, while no light is incident on the object 11 from a respective second sub-aperture region of the illumination pupil 14.
[0118] The image processing device 16 can have an interface in order to output reflection-corrected images, for example to a memory or, as shown in FIG. 1, to an image display device 19, which comprises a monitor, for example, in order to display the images.
[0119] In one embodiment, the image recording sensor device is configured to record the images with the same frequency with which the sub-aperture modulation device modifies the illumination situations. In a further embodiment, the image recording sensor device records images while the sub-aperture modulation device changes the illumination situations and the image processing device is configured to detect the change in the illumination situations in the recorded sequence and either to select images, which belong to the different illumination situations, for reflection correction purposes or to synchronize the image recording sensor device with the sub-aperture modulation device. To this end, provision can be made of a controller device (not shown), for example, by means of which the synchronous operation of producing the illumination situations, which differ from one another, with the sub-aperture modulation device and recording at least one image for each of these illumination situations is ensured.
[0120] FIG. 2 shows a schematic illustration of a first example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations, for example by way of the sub-aperture modulation device 17 in FIG. 1. The sub-aperture modulation device 17 shown in FIG. 1 decomposes the cross-sectional area of the illumination pupil 14 of the associated light source or illumination source 13 into n (n=6 in FIG. 2) spatially disjoint respective first sub-aperture regions 21 (illustrated by hatching here), through which light from the illumination source 13 can be incident on the object 11, and associated respective second sub-aperture regions 22 (illustrated in white here), though which no light can be incident on the object, in a temporally sequential manner. The union of the disjoint respective first sub-aperture region 21 over all n=6 illumination situations need not necessarily result in the overall region of the cross-sectional area of the illumination pupil 14 again. However, this is the case in the shown example. Light only emerges from the respective first sub-aperture region 21 in all 6 illumination situations. As a result of this procedure, different image regions will always be afflicted by reflections in the various images recorded by the image recording sensor device 15. The reflection of the entire illumination source is then largely eliminated by calculation by way of the image processing device 16, for example under the application of formula (1). Other methods, too, can be used for eliminating reflections, said other methods being based on comparative threshold value criteria, for example. In any case, the reflection-corrected image is synthesized from the reflection-free portions of the sequence of images.
[0121] The basic form of the illumination pupil 14 that is illustrated as circular in FIG. 2 is not mandatory. By way of example, elliptical, rectangular or polygonal illumination pupil forms are also possible. Furthermore, the basic form of the illumination pupil 14 need not consist of a contiguous region in all cases but can itself consist of spatially separated regions.
[0122] Further examples for decomposing an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations are illustrated schematically in FIGS. 3-8. Further ones are conceivable, depending on contrasting method and combination of images.
[0123] FIG. 3 shows a second example, in which the sequence of different illumination situations consists of two illumination situations and the illumination pupil 14 is decomposed into respectively two disjoint first sub-aperture regions 21 and respectively two second sub-aperture regions 22.
[0124] FIG. 4 shows a third example, which differs from the second example only in the orientation of the sub-aperture regions. FIG. 5 shows a fourth example, in which three different illumination situations are produced, wherein the illumination pupil 14 is decomposed into respectively three disjoint first sub-aperture regions 21 and respectively three second sub-aperture regions 22.
[0125] FIG. 6 and FIG. 7 show a fifth and a sixth example, in which the illumination pupil 14 is decomposed into disjoint first (illustrated black in this case) and second (illustrated white) sub-aperture regions 21, 22, with the sub-aperture regions in these two examples respectively running through one another. These leads to very similar illumination conditions and, in the ideal case, the associated images differ for the two disjoint decompositions only by way of the likewise disjoint intensity distributions of the reflection images in the respective images and can be removed by calculation while avoiding the loss of other image information. Sub-aperture regions running through one another are particularly suitable for corneal reflection suppression in ophthalmic observation appliances or operating microscopes, i.e. for correcting the reflection of the illumination source on the cornea of the patient's eye.
[0126] For the purposes of suppressing corneal reflections while maintaining an otherwise unchanged image impression, it is advantageous if the disjoint regions lie close together or are realized by alternating decompositions of the illumination pupil that run through one another since particularly similar images then arise from the n illumination settings, which substantially only differ by the intensity distributions of the corneal reflections in the image, which ideally are disjoint again themselves. Since the elimination method according to formula (1) substantially removes the differences from the various images, this removes the loss of image information.
[0127] FIG. 8 and FIG. 9, too, show that the illumination pupil 14 is decomposed into disjoint first and second sub-aperture regions 21, 22 in a seventh and an eighth example, with the sub-aperture regions in these two examples respectively running through one another, wherein the respective first sub-aperture region 21 is illustrated in white and the respective second sub-aperture region is illustrated with hatching. The examples in FIG. 8 and FIG. 9 elucidate how the sub-aperture modulation can be realized by a moving stop.
[0128] FIG. 10 shows a schematic illustration of a ninth example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations. The decomposition of the illumination pupil 101, which is rectangular in the shown example, into disjoint first sub-aperture regions 102, which are illustrated in white, is only mandatory if the intention is to work with only two illumination settings for only two different illumination situations in order thus to facilitate the greatest possible speed during image recording and image processing. However, if more than two illumination settings are used (four in the case shown here), it is not generally mandatory. In the shown example, the respective first sub-aperture regions 102 are disjoint from one another, i.e. the regions of the illumination pupil 101 that are illustrated in white and shine at the times t1 to t4 do not overlap, whereas the respective second sub-aperture regions 103, which are illustrated in black, do overlap when considered over the times t1 to t4. By way of example, a rectangular illumination pupil 101 may be present if it corresponds to the illuminated field array of an LED chip as an illumination source.
[0129] It is also possible to use a division of the illuminated fields that is inverted thereto. FIG. 11 shows a schematic illustration of a tenth example for a decomposition of an illumination pupil into respective first and second sub-aperture regions for producing different illumination situations, in which four disjoint dark regions or second sub-aperture regions 113 (illustrated black in this case) of the illumination pupil 111 are provided, while the four shining first sub-aperture regions 112 (illustrated white in this case) respectively correspond, in pairs, on two quadrants of the illumination pupil 111, i.e. overlap. The shining regions of the illumination pupil 111 are imaged as reflections in the recorded images. The described reflection correction nevertheless works for as long as the composition of the reflection-free image regions, considered over the entire recorded sequence of images, covers the whole imaging region.
[0130] The apparatus according to the invention is preferably an apparatus for producing reflection-corrected microscopic images of the object. Therefore, embodiments of microscopes with such an apparatus are described in particular below, said microscopes differing in terms of the location and the means for the sub-aperture modulation. In particular, the shown exemplary embodiments can be digital ophthalmic operating microscopes with ambient illumination and coaxial illumination.
[0131] FIG. 12 shows a schematic illustration of a first example of a microscope 120 with an apparatus for producing reflection-corrected images according to an embodiment of the invention. The microscope 120 has a coaxial illumination (1 channel per observation channel). To this end, the microscope has a coaxial illumination source 121 with a coaxial illumination pupil 122. In FIG. 12, only one of usually two coaxial illuminations is illustrated in the side view for reasons of clarity. If the microscope additionally has a coaxial assistant's system, two further illuminations are present.
[0132] Moreover, the shown microscope 120 uses an ambient illumination. To this end, the microscope 120 has an ambient illumination source 123 with an ambient illumination pupil 124. Here, and in the embodiments described below, the ambient illumination is designed as a Khler illumination, although this is not mandatory. What is essential is that the illumination pupil is accessible for the sub-aperture modulation by decomposing the illumination pupil. The ambient illumination device overall comprises the ambient illumination source 123, an optical system 125, a radiant field stop 126 and a further optical system 127. The ambient illumination beam path is imaged into the object plane 130 through the illuminated radiant field stop 126, via a deflection mirror 128 and through the main objective 129 of the operating microscope 120. The object plane 130 or the object field corresponds to the portion (of the surface) of an object observed through the microscope, i.e. the whole object or a portion of the object depending on the object.
[0133] By way of example, the main objective 129 can be embodied as an achromatic or apochromatic objective. The object field or the object plane 130 is arranged in the focal plane of the main objective 129, for example, and so it is imaged at infinity by the latter such that the observation beam path of a divergent beam bundle emanating from the object plane 130 is converted to that of a parallel beam bundle upon its passage through the main objective 129.
[0134] The shown coaxial illumination device (just like the coaxial illumination device not shown) comprises the coaxial illumination source 121 with the coaxial illumination pupil 122 and an optical system 131. Its associated coaxial illumination beam path is input coupled in the shown exemplary embodiment by the reflection path of an optical splitter 132 and steered into the object plane 130. The observation beam path (dashed lines), by means of which the image of the object is recorded, runs through the main objective 129, the transmission path of the optical splitter 132, and through (an optional/optional) magnification system/systems 133.
[0135] The coaxial illumination beam path is input coupled into the microscope by the reflection path of the beam splitter or optical splitter 132 in a fashion parallel to the optical axis of the observation beam path such that the illumination runs in coaxial fashion between the optical splitter 132 and main objective 129 in relation to the observation beam path. As a rule, if the microscope is a binocular operating microscope, a further illumination beam path and observation beam path is present. Then, for example, a further magnification system or the second channel in a stereo system may be provided for the further observation beam path. However, in the case of suitable dimensioning of the magnification system 133, the further observation beam path may also additionally run therethrough.
[0136] Reference is made to the fact that the illumination beam paths illustrated in FIG. 12 are very schematic and do not necessarily reproduce the actual course of the illumination beam paths.
[0137] For the purposes of recording an image of the object, a recording device with digital observation port(s) 134, one observation port per observation channel, is provided in FIG. 12. Two observation ports should be provided for two observation channels for a main observer. If the microscope 120 additionally comprises a coaxial illumination and optical systems for an assistant, two further observation ports should be provided.
[0138] A digital observation port 134 comprises an image recording sensor device for recording the images and an image processing device in order to synthesize at least one reflection-corrected image from the recorded images and it can comprise an image display device in order to display the reflection-corrected image. Instead of the digital observation port 134 comprising the image processing device, the former may also have, for example, a digital interface in order to connect a separate image processing device thereto, the recorded images being transferred via said interface to the image processing device so that the latter calculates the reflection-corrected image.
[0139] In the shown embodiment, the microscope 120 comprises a sub-aperture modulation device 135 in or near the plane of the illumination pupils. The sub-aperture modulation device decomposes the coaxial illumination pupil 122 and the ambient illumination pupil 124 in or in the direct vicinity of the plane of the illumination pupils, i.e. at or in the vicinity of the location of the illumination sources, into respective first light-transmitting and second shadowing sub-aperture regions. The illumination pupil decomposition is effectuated here by time-varying shadowing of the respective second sub-aperture regions in the plane of the illumination pupils. To this end, the sub-aperture modulation device 135 comprises movable mechanical stops. In a further embodiment, one or more actuatable LCD aperture stops, for example, are used instead of movable mechanical stops for targeted disjoint illumination pupil shadowing in order to produce the various illumination situations.
[0140] The reflection correction can be effectuated sequentially for all illumination channels. It is real-time capable. In the case of a sufficiently high image recording rate by the observation ports and sufficiently fast image combination-by-calculation, it is consequently possible to calculate reflection-freed or greatly reflection-reduced real-time images for the various illuminations of the observed object in the microscope and said images can be observed by the user, for example by way of the corresponding display device or the corresponding reproduction medium (monitors, digital eyepieces).
[0141] Further embodiments of a microscope according to the invention with an apparatus for producing reflection-corrected images are shown below, in which certain features differ from those of the embodiment shown in FIG. 12, while other features correspond. In order to avoid repetition, the description of the following exemplary embodiments is restricted to the features differing from those shown in FIG. 12, with the same reference signs referring to the same or similar components.
[0142] FIG. 13 shows a schematic illustration of a second example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. The shown embodiment of a microscope 136 corresponds in substantial parts to the microscope 120 shown in FIG. 12. However, the microscope 136 additionally has an optical system 137 in the coaxial illumination beam path and an additional optical system 138 in the ambient illumination beam path, by means of which further illumination pupils 139, 140 arise as intermediate images of the original illumination pupils in the plane of the illumination pupils that is conjugate to the illumination sources 121, 123. In the shown embodiment, provision is made of a sub-aperture modulation device 141 in order to carry out the sub-aperture modulation at or in the direct vicinity of these illumination pupils 139, 140. Like in the embodiment described in FIG. 12, this can be effectuated by time-varying shadowing of the respective second sub-aperture regions of the respective illumination pupils, for example by moving mechanical stops or by one or more actuatable LCD aperture stops for targeted disjoint pupil shadowing for the individual illuminations.
[0143] FIG. 14 shows a schematic illustration of a third example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. The shown embodiment of a microscope 142 corresponds in substantial parts to the microscope 136 shown in FIG. 13. The microscope 142, too, comprises an additional optical system 137 in the coaxial illumination beam path and an additional optical system 138 in the ambient illumination beam path, by means of which illumination pupils 143, 144, which are in addition to the illumination sources 121, 123, arise as intermediate images of the original illumination pupils in planes conjugate thereto. In the shown embodiment, provision is made there of a sub-aperture modulation device 145 in order to carry out the sub-aperture modulation at these illumination pupils 143, 144. Here, the sub-aperture modulation device 145 comprises an electronically actuatable DMD (digital micromirror device) micro-system. Instead of shadowing selected sub-aperture regions, the respective illumination beam path is modified, i.e. the illumination pupil area is decomposed, here by the intermittent or time-varying input coupling of the respective first sub-aperture regions, i.e. of the regions of the illumination pupils that are provided for the sub-aperture illumination in the respective illumination situation. As shown, a commonly employed DMD or DMD micro-system 145 may be provided to this end for the disjoint, time-varying sub-aperture region input coupling for the individual illumination beam paths. In a further embodiment, a dedicated DMD is provided for individual illumination beam paths or for each illumination beam path.
[0144] FIG. 15 shows a schematic illustration of a fourth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. The illustrated embodiment of the microscope 150 shows that the options for the sub-aperture modulation shown in FIG. 13 and FIG. 14 are combinable with one another and that it is thus possible, for example, to provide an adaptation of the structure that is optimized for the respective illumination. While the sub-aperture modulation device 151 is provided as a DMD micro-system for the sub-aperture modulation of the ambient illumination beam path from the ambient illumination source 123 in order to facilitate a time-varying input coupling of sub-aperture regions of the ambient illumination pupil, an illumination pupil 152 is initially produced in a plane conjugate to the coaxial illumination source 121 in the coaxial illumination beam path from the coaxial illumination source 121 by means of the optical system 131, said illumination pupil then being modulated by a sub-aperture modulation device 153, for example by way of moving mechanical stops or one or more actuatable LCD aperture stops for targeted disjoint illumination pupil sub-aperture region shadowing. The coaxial illumination beam path modified thus is then steered via a further optical system 154, the optical splitter 132, and the main objective 129 onto the object plane 130.
[0145] FIG. 16 shows a schematic illustration of a fifth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. The shown embodiment of a microscope 160 corresponds in substantial parts to the microscope 150 shown in FIG. 15. While the sub-aperture modulation for the coaxial illumination source 121 corresponds to that shown in FIG. 15 and the sub-aperture modulation is carried out by a sub-aperture modulation device 161 in a plane at an illumination pupil 162 of the coaxial illumination beam path, provision is made in the microscope 160 of FIG. 16 for the DMD from FIG. 15, used for the sub-aperture modulation device 151, to be replaced by a deflection mirror 163 and for the sub-aperture modulation to be carried out by the ambient illumination pupil sub-aperture modulation device 164 at or in the direct vicinity of a further illumination pupil 165 of the ambient illumination beam path. In both sub-aperture modulation devices 161, 164, it is possible, for example, to use mutually independent moving mechanical stops or actuatable LCD aperture stops for targeted disjoint illumination pupil region shadowing for the individual illumination beam paths.
[0146] FIG. 17 shows a schematic illustration of a sixth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. The shown embodiment of the microscope 170 corresponds in substantial parts to the microscope 142 shown in FIG. 14, wherein the DMD micro-system 145 from FIG. 14, which was used for plurality of illumination beam paths, was replaced by a first DMD micro-system 171, by means of which there is only a realization of the sub-aperture modulation by time-varying superimposition of disjoint sub-aperture regions of the illumination pupil of the ambient illumination 123, and by a second DMD micro-system 172, by means of which there is a realization of the sub-aperture modulation by time-varying superimposition of disjoint sub-aperture regions of the illumination pupil of the coaxial illumination 121. The imaging of the illumination sources 121, 123 from ambient and coaxial illuminations onto the two DMDs is effectuated by way of the additional optical systems 137 and 138.
[0147] FIG. 18 shows a schematic illustration of a seventh example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. The shown embodiment of a microscope 180 corresponds in substantial parts to the microscope 136 shown in FIG. 13, wherein the sub-aperture modulation device 141 from FIG. 13, which was used for a plurality of illumination beam paths, was replaced by a first sub-aperture modulation device 181, by means of which there is a realization of the sub-aperture modulation by time-varying shadowing at the ambient illumination pupil 182 in the plane that is conjugate to the ambient illumination source 123, or in the direct vicinity of said plane, and by a second sub-aperture modulation device 183, by means of which there is a realization of the sub-aperture modulation by time-varying shadowing at the coaxial illumination pupil 184 in the plane that is conjugate to the coaxial illumination source 121, or in the direct vicinity of said plane. At these locations, it is possible, for example, to use moving mechanical stops or actuatable LCD aperture stops for targeted disjoint illumination pupil shadowing for the individual illumination beam paths.
[0148] FIG. 19 shows a schematic illustration of an eighth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. The shown embodiment of a microscope 190 corresponds in substantial parts to the microscope 120 shown in FIG. 12. However, provision is not made here for any sub-aperture modulation device 135, as provided in FIG. 12, that is separate from the illumination sources 121, 123. Instead, the sub-aperture modulation device is identical to the respective coaxial illumination source 191 or ambient illumination source 193. To this end, an illuminated field array of an LED chip respectively serves in the shown embodiment as a coaxial illumination source 191 and as an ambient illumination source 193. The area of the illuminated field array that can be illuminated predefines the respective illumination pupil, and first and second sub-aperture regions for emitting or masking some of the illumination are defined by activating or deactivating portions of the illuminated field array, i.e. by a time-varying actuation and activation or deactivation of luminous area regions on the respective LED chip.
[0149] To this end, FIG. 20 shows a schematic illustration of examples for sub-aperture illumination options of an illuminated field array of an LED chip by time varying activation and deactivation of separated luminous area regions on the LED chip Luminous field regions illustrated in black represent deactivated regions which do not emit light; luminous field regions illustrated in white denote activated luminous area regions which emit light. In the shown example variants V1 to V6, the illuminated field array has 22=4 separately actuatable luminous area regions, with the illuminated field array being switched over at the four times t1, t2, t3, and t4 in the first example variant V1. In the second to sixth example variant V2 to V6, the illuminated field array is in each case switched over at the two times t1 and t2. Moreover, the example variant V2 illustrates the option of a disjoint decomposition, which pierces itself in reciprocal fashion.
[0150] FIG. 21 shows a schematic illustration of a ninth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. In the shown embodiment of a microscope 210, the shown coaxial illumination device and the ambient illumination device are respectively designed in such a way that the illumination beam paths of the coaxial illumination source 121 and of the ambient illumination source 123 are collimated by an optical system 211 and an optical system 212 (e.g. Khler illumination). Then, respectively in the collimated illumination beam path, the image of the respective illumination reflection (for example of the corneal reflection in the case of ophthalmic operating microscopes) is moved to various positions by controllable tiltable mirrors or DMDs. In FIG. 21, this is carried out by the mirror 213 that is rotatable through an angle for the coaxial illumination beam path and by the rotatable mirror 214 for the ambient illumination beam path. The coaxial illumination beam path then reaches the object plane 130 via a radiant field stop (LFB) and the optical system OS4 215, the reflection path of an optical splitter 132 and the main objective 129. The ambient illumination beam path reaches the object plane 130 via a radiant field stop (LFB) and the optical system OS2 216, the deflection mirror 128 and the main objective 129. The observation beam path (illustrated in a dashed fashion) runs from the object plane 130 through the main objective 129 and the traversing path of the optical splitter 132 into the magnification system 133 and the recording device 132 with the digital observation port(s).
[0151] The sub-aperture stops 217 and 218 are introduced into the coaxial illumination beam path and the ambient illumination beam path directly after the coaxial illumination source 121 and the ambient illumination source 123 at the locations of the respective illumination pupils 219, 220. To this end, FIG. 22 shows a schematic illustration of an example for a sub-aperture stop that is suitable for use in a microscope according to FIG. 21. Here, black regions have a shadowing effect while regions illustrated in white transmit light. Using this, it is possible to shadow a sub-aperture region of the illumination pupil of the respective illumination source while light reaches the respective optical system through the other sub-aperture region. The sub-aperture stops 217, 218 can be stationary stops. The modulation of the respective illumination beam path arises in the embodiment shown in FIG. 21 by virtue of tilting or rotating the mirrors 213, 214 or a stationary DMD micro-system. In this way, it is not necessary for the sub-aperture modulation for the movement to be carried out at the location of the illumination pupils 219, 220. Instead, the light of the respective illumination source is initially collimated and it can then be deflected in a targeted manner by the controllable tilt mirrors or DMDs in order to move the reflection image of the illuminated stop(s) in a targeted manner such that the reflections can be corrected or eliminated by calculation.
[0152] FIG. 23 shows a schematic illustration of an example for the arrangement of an illumination module 231 for a microscope 230. As shown above, the apparatus according to the invention for producing reflection-corrected images of an object can be embodied as a microscope or as a part thereof. In one embodiment, provision is made, in particular, for at least one illumination device for the illumination device to be integrated in an illumination module 231 together with an associated sub-aperture modulation device, said illumination module being able to emit sub-modulated light, said light then illuminates the object, for example via the reflection path of an optical splitter 232, which is introduced into the observation beam path of a microscope 230 below the main objective 233 of the microscope 230, i.e. between the main microscope 233 and object plane 234. Thus, the sub-aperture modulation device modifies or modulates the illumination beam path only in a region between the main objective 233 of the microscope 230 and the object or the object plane 234, for example by time-varying partial shadowing.
[0153] In particular, this offers the advantage of being able to provide a module to this end, said module, where necessary, also being able to be arranged, for example fitted, to the microscope retrospectively. By way of example, if the microscope 230 is an operating microscope which already comprises image recording sensors and one or more image output or reproduction devices, for example digital eyepieces, eyepieces with data superimposition, monitors or displays, and which comprises a processor for image processing purposes, which can be programmed to calculate a reflection-corrected image to be displayed from the sequence of sub-aperture-modulated images, it is possible in this embodiment, for example, to retrofit an available operating microscope for reflection correction purposes by providing the illumination module 231 and an optical splitter 232. Provision can likewise be made for the illumination module 231 to also already comprise the optical splitter 232. For reasons of clarity, the components of the microscope 230 apart from the main objective 233 are illustrated in a schematically combined manner as a common block 235 in FIG. 23.
[0154] FIG. 24 shows a schematic illustration of a first example for an illumination device with a sub-aperture modulation device. Such a combination of illumination device and sub-aperture modulation device can be used, for example, as illumination module 231 according to FIG. 23, with the arrangement below a main objective of a microscope only constituting one example.
[0155] The shown illumination device 240 comprises a (primary or secondary) illumination source 241, optionally including additional optical devices, and an optical system 242 as an illumination optical unit. Here too, provision is made for the aperture, i.e. the area of the illumination pupil of the illumination source 241, to be decomposed in a temporal sequence into disjoint luminous and non-luminous sub-aperture regions. In the illumination device 240 shown in FIG. 24, the sub-aperture modulation device 243 is integrated into the illumination device, for example for an operating microscope. Thus, the sub-aperture modulation device can be integrated into the microscope without having to undertake structural modifications at the further optical systems of the microscope. Moreover, the location of the sub-aperture modulation can be relocated to a location of the microscope where, for example, the transfer of vibrations on the optical appliance is low, said vibrations otherwise being able to influence the observation result.
[0156] In one embodiment, the sub-aperture modulation device 243 comprises a sub-aperture mask or a sub-aperture stop made of light-transmissive and light-opaque regions, said sub-aperture modulation device, for the angle positions alpha and alpha+360/n (alpha arbitrary), generating two disjoint transmissive decompositions of the mask region and thus respectively generating a first and a second sub-aperture region for each angular position. To this end, FIG. 25 shows a schematic illustration of an example for a suitable sub-aperture stop or sub-aperture mask 250, in which, as an example, a sub-aperture mask geometry for angle increments of 360/16 with respectively 6 alternating transmissive and opaque regions along the radial direction is shown.
[0157] The geometric design of the regions on the sub-aperture mask can also be designed differently in respect of number, position, form, and size of the light-transmissive and light-opaque regions. By way of example, curved spokes are also possible instead of the straight spokes shown in FIG. 25, for example as a result of a radially increasing shear of the pattern.
[0158] By way of example, the sub-aperture mask 250 can be realized as a chromium mask on an optically transmissive substrate.
[0159] In an exemplary embodiment, the sub-aperture mask 250 is applied to a substrate, the light-transmissive regions of which on the front and/or rear side have an optically scattering effect in order to manipulate the angle distribution of the illumination. In a further exemplary embodiment, the sub-aperture mask 250 is applied to a substrate whose areas in the light-transmissive regions have an optically refractive effect in order to manipulate the image of the illumination pupil or illumination aperture and the angle distribution of the illumination.
[0160] The sub-aperture modulation device 243 provides for a rotatable bearing of the sub-aperture mask 250 about the axis of rotation thereof. FIG. 26 shows a schematic illustration of an example for a rotatably mounted receptacle 261 of a sub-aperture stop or sub-aperture mask 250, and a drive 262 for the receptacle 261. By way of example, the drive can be a drive with a friction wheel, a gearing or a belt. The sub-aperture mask 250 is introduced in a bore of the receptacle 261 and rotates with the latter when the latter is driven about the axis of rotation. The rotating receptacle 261 itself is held in the process by a secure holder or enclosure 263. In one embodiment, a position sensor (not shown) of the angle position of the rotatable sub-aperture mask 250 is provided.
[0161] FIG. 27 shows, in a plan view and in a side view, a schematic illustration of an example for a sub-aperture stop or sub-aperture mask 250 that is integrated into the hollow shaft motor 270. The hollow shaft motor 270 serves as a drive for rotating the sub-aperture mask 250. In the shown embodiment, provision is made for the sub-aperture mask 250 to be received centered in relation to the axis of rotation in the rotor 271 of a hollow shaft motor 270 which is rotatably mounted in the stator 272 of the hollow shaft motor. The hollow shaft motor provides for light to be radiated in along the axis of rotation of the rotor onto the sub-aperture mask 250 that is rotatable with the latter and for sub-aperture-modulated light to be emitted in order to produce different illumination situations.
[0162] In other embodiments, the mechanically movable sub-aperture masks are moved in different ways. By way of example, provision can be made of realizing a linear back and forth movement of the mask in the case of a sub-aperture modulation device with a checkerboard-like sub-aperture mask or a linear mask.
[0163] As an alternative to the approach of using a mechanically moving sub-aperture mask for sub-aperture modulation purposes, provision is made in other embodiments of providing a sub-aperture modulation device, which may correspond to the sub-aperture modulation device 243 shown in FIG. 24, for example, having a stationary actuatable stop in order to realize time-varying light-guiding and non-light-guiding sub-aperture stop regions.
[0164] To this end, FIG. 28 is a schematic illustration of an example for a sub-aperture modulation device 280 with an electronically actuatable stop 281 (here in transmission), for example on the basis of an LCD, i.e. as an LCD sub-aperture stop. The stop is configured as a programmable stop, optionally in combination with optical polarization elements.
[0165] FIG. 29 shows a schematic illustration of a further example for a sub-aperture modulation device. The sub-aperture modulation device 290 provides for the use of a stationary actuatable stop on the basis of a micro-electromechanical system (MEMS) 291. By way of example, the MEMS can be a digital micromirror device (DMD) with micromirror actuators arranged in a matrix-shaped manner, the actuation of which is configured to steer only a sub-aperture component of the light, fed by an input 292 of the sub-aperture modulation device 290, to an output 293 of the sub-aperture modulation device 290 in order thus to realize time-varying light-guiding and non-light guiding stop regions. Here, the first optical system 294 and the second optical system 295 serve to image input 292, MEMS 291, and output 293 onto one another in a conjugate manner.
[0166] FIG. 30 shows a schematic illustration of another further example for a sub-aperture modulation device. The sub-aperture modulation device 300 provides for the use of a stationary actuatable stop on the basis of two micro-electromechanical systems (MEMS) 301, 302. The MEMS 301, 302 can be digital micromirror devices (DMD) with micromirror actuators arranged in a matrix-shaped manner, the actuation of which is configured to steer only a sub-aperture component of the light, fed by an input 303 of the sub-aperture modulation device 300, to an output 304 of the sub-aperture modulation device 300 in order thus to realize time-varying light-guiding and non-light guiding stop regions. Here, the first optical system 305, the second optical system 306, and the third optical system 307 serve to image input 303, the MEMS 301, 302, and output 304 onto one another in a conjugate manner.
[0167] While both components are directly connected in the first example of an illumination device with a sub-aperture modulation device shown in FIG. 24, FIG. 31 shows a schematic illustration of a second example for an illumination device 310 with a sub-aperture modulation device, in which the illumination source 311 can be a primary illumination source comprising an input coupling optical unit, by means of which the emitted light is coupled into a light carrier bundle 312, the other end of which, as an illumination pupil of a secondary illumination source, then being positioned immediately in front of the sub-aperture mask of the sub-aperture modulation device 313 which carries out the sub-aperture modulation and feeds the modulated light into an optical system 314 as an illumination optical unit. In this way, the primary illumination source can be chosen independently of structural restrictions in a microscope, for example, and it can be arranged externally. Then, all that is decisive for positioning the secondary source is whether the position is reachable by the optical fiber bundle or the light carrier bundle 312. By way of example, this allows the sub-aperture modulation device to be integrated in an operating microscope while the primary illumination source is arranged externally. The light carrier bundle facilitates great flexibility in the structural implementation.
[0168] FIG. 32 shows a schematic illustration of a third example for an illumination device 320 with a sub-aperture modulation device. Here too, the illumination source 321 can be a primary illumination source comprising an input coupling optical unit, by means of which the emitted light is coupled into a light carrier bundle 322, the other end of which, as an illumination pupil of a secondary illumination source, then being positioned immediately in front of the sub-aperture mask of the sub-aperture modulation device 323, the latter carrying out the sub-aperture modulation and feeding the modulated light into an optical system 324 as an illumination optical unit. In this way, the primary illumination source can be chosen independently of structural restrictions in a microscope, for example, and it can be arranged externally. Unlike the second example shown in FIG. 31, it is also possible here to provide the sub-aperture modulation device 323 as an external component since the sub-aperture-modulated light is not fed directly into the optical system 324 but it is connected to the optical system 324, which may be the illumination optical unit on the operating microscope, via a second light carrier bundle 325. By arranging the sub-aperture modulation device outside of the microscope, the transfer of vibrations which could possibly be produced by a sub-aperture modulation device with mechanically moving components and which could possibly impair the observation result is avoided or at least greatly reduced.
[0169] In one embodiment, the second light carrier bundle 325 is designed as a coherent fiber bundle such that the sub-aperture decompositions by the second light carrier bundle 325 can be transferred with the greatest similarity to the location of the entry pupil of the optical system 324, i.e. the illumination optical unit in the operating microscope, for example.
[0170] In another embodiment, a non-coherent fiber bundle is used as the second light carrier bundle 325, and so the sub-aperture decomposition is locally redistributed.
[0171] FIG. 33 shows a schematic illustration of a fourth example for an illumination device 330 with a sub-aperture modulation device. The illumination source 331 can be an external primary illumination source, into which a sub-aperture modulation device 332 is integrated, the latter being connected to the optical system 334, e.g. the illumination optical unit of the optical appliance (e.g. operating microscope), via a light carrier bundle 333.
[0172] In one embodiment, the light carrier bundle 333 is designed as a coherent fiber bundle such that the sub-aperture decompositions by the light carrier bundle 333 can be transferred with the greatest similarity to the location of the entry pupil of the illumination optical unit in the operating microscope.
[0173] In another embodiment, a non-coherent fiber bundle is used as the light carrier bundle 333, as a result of which the sub-aperture decomposition is locally redistributed to a further extent.
[0174] Further embodiments of a microscope according to the invention with an apparatus for producing reflection-corrected images are shown below, in which the basic design corresponds to that of the embodiment shown in FIG. 12, wherein, however, the illumination devices and sub-aperture modulation devices differ. In order to avoid repetition, the description of the following exemplary embodiments is restricted to the features differing from those shown in FIG. 12, with the same reference signs referring to the same or similar components.
[0175] FIG. 34 shows a schematic illustration of a tenth example of a microscope, in particular an ophthalmic operating microscope, with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. In the shown embodiment of a microscope 340, the ambient illumination device comprises an optical system 125, a radiant field stop 126 and a further optical system 127. The ambient illumination beam path is imaged into the object plane 130 through the illuminated radiant field stop 126, via a deflection mirror 128 and through the main objective 129 of the operating microscope 120.
[0176] The ambient illumination device moreover comprises a primary ambient illumination source 341, the light of which is coupled into a first light carrier bundle 342, the associated output of which acts as a secondary ambient illumination source 343 with an illumination pupil that, at the location of the secondary illumination source 343, is decomposed in a time varying manner into respectively first light-transmissive and second, shadowing sub-aperture regions by a first sub-aperture modulation device 344. The ambient illumination modulated thus is then fed into the first optical system 125.
[0177] The shown coaxial illumination device comprises the coaxial illumination source 121 with the coaxial illumination pupil 122 and an optical system 131. Its associated coaxial illumination beam path is input coupled in the shown exemplary embodiment by the reflection path of an optical splitter 132 and steered into the object plane 130.
[0178] The observation beam path (dashed lines), by means of which the image of the object is recorded, runs through the main objective 129, the transmission path of the optical splitter 132, and through (an optional/optional) coaxial magnification system/systems 133. To this end, a recording device 134 with digital observation port(s), one observation port per observation channel, is provided in FIG. 12.
[0179] The coaxial illumination device moreover comprises a primary coaxial illumination source 345, the light of which is coupled into a second light carrier bundle 346, the associated output of which acts as a secondary coaxial illumination source 347 with an illumination pupil that, at the location of the secondary coaxial illumination source 347, is decomposed in a time varying manner into respectively first light-transmissive and second, shadowing sub-aperture regions by a second sub-aperture modulation device 348. The coaxial illumination modulated thus is then fed into the optical system 131.
[0180] In the shown embodiment, the sub-aperture modulation devices 344, 348 can be coupled directly to the illumination optical unit of the microscope, for example structurally integrated into the microscope, while the primary illumination sources 341, 345 can be arranged externally.
[0181] FIG. 35 shows a schematic illustration of an eleventh example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. In the microscope 350 shown here, too, the basic structure corresponds to the embodiment of a microscope shown in FIG. 12.
[0182] Unlike what is shown in FIG. 34, the ambient illumination device moreover comprises a primary ambient illumination source 351 in this case, the light of which is coupled into a primary first light carrier bundle 352, the associated output of which acts as a secondary ambient illumination source 353 with an illumination pupil that, at the location of the secondary ambient illumination source 353, is decomposed in a time varying manner into respectively first light-transmissive and second shadowing sub-aperture regions by a first sub-aperture modulation device 354. The ambient illumination modulated thus is then coupled into a secondary first light carrier bundle 355 and fed into the first optical system 125 at the output thereof.
[0183] Also unlike what is shown in FIG. 34, the coaxial illumination device moreover comprises a primary coaxial illumination source 356 in this case, the light of which is coupled into a primary second light carrier bundle 357, the associated output of which acts as a secondary coaxial illumination source 358 with an illumination pupil that, at the location of the secondary coaxial illumination source 358, is decomposed in a time varying manner into respectively first light-transmissive and second shadowing sub-aperture regions by a second sub-aperture modulation device 359. The coaxial illumination modulated thus is then coupled into a secondary second light carrier bundle 360 and fed into the optical system 131 at the output thereof.
[0184] In the shown embodiment, the sub-aperture modulation devices 354, 359, like the primary illumination sources 341, 345, can be arranged externally and can be connectable to the illumination optical unit of the microscope by way of optical waveguides and, where necessary, appropriate optical coupling interfaces.
[0185] FIG. 36 shows a schematic illustration of a twelfth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. In the microscope 361 shown here, too, the basic structure corresponds to the embodiment of a microscope shown in FIG. 12.
[0186] Unlike what is shown in FIG. 34, the ambient illumination device and the coaxial illumination device are realized here with the same primary illumination source 362, the light of which is coupled into a divided light carrier bundle that consists of a first partial light carrier bundle 363 and a second partial light carrier bundle 364. The output belonging to the first partial light carrier bundle 363 acts as a secondary ambient illumination source 365 with an illumination pupil that, at the location of the secondary ambient illumination source 365, is decomposed in a time varying manner into respectively first light-transmissive and second shadowing sub-aperture regions by a first sub-aperture modulation device 366. The ambient illumination modulated thus is then fed into the first optical system 125.
[0187] The output belonging to the second partial light carrier bundle 364 acts as a secondary coaxial illumination source 367 with an illumination pupil that, at the location of the secondary coaxial illumination source 367, is decomposed in a time varying manner into respectively first light-transmissive and second shadowing sub-aperture regions by a second sub-aperture modulation device 368. The coaxial illumination modulated thus is then fed into the optical system 131.
[0188] In the shown embodiment, the sub-aperture modulation devices 366, 368 can be coupled directly to the illumination optical unit of the microscope, for example structurally integrated into the microscope, while a single primary illumination source, which may be arranged externally, is required on account of the use of a split light carrier bundle.
[0189] FIG. 37 shows a schematic illustration of a thirteenth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. In the microscope 370 shown here, too, the basic structure corresponds to the embodiment of a microscope shown in FIG. 12.
[0190] As shown in FIG. 36, the ambient illumination device and the coaxial illumination device are realized here, too, with a common primary illumination source 371, the light of which, in this case, is coupled into a divided light carrier bundle that consists of a primary first partial light carrier bundle 372 and a primary second partial light carrier bundle 373. The output belonging to the primary first partial light carrier bundle 372 acts as a secondary ambient illumination source 374 with an illumination pupil that, at the location of the secondary ambient illumination source 374, is decomposed in a time varying manner into respectively first light-transmissive and second shadowing sub-aperture regions by a first sub-aperture modulation device 375. The ambient illumination modulated thus is then coupled into a secondary first light carrier bundle 378 and fed into the first optical system 125 at the output thereof.
[0191] The output belonging to the primary second partial light carrier bundle 373 acts as a secondary coaxial illumination source 376 with an illumination pupil that, at the location of the secondary coaxial illumination source 376, is decomposed in a time varying manner into respectively first light-transmissive and second shadowing sub-aperture regions by a second sub-aperture modulation device 377. The coaxial illumination modulated thus is then coupled into a secondary second light carrier bundle 379 and fed into the optical system 125 at the output thereof.
[0192] In the shown embodiment, the sub-aperture modulation devices 375, 377 and the common primary illumination source 371 can be arranged externally and can be connectable to the illumination optical unit of the microscope by way of optical waveguides and, where necessary, an appropriate optical coupling interface.
[0193] FIG. 38 shows a schematic illustration of a fourteenth example of a microscope with an apparatus for producing reflection-corrected images according to a further embodiment of the invention. In the microscope 380 shown here, too, the basic structure corresponds to the embodiment of a microscope shown in FIG. 12.
[0194] As shown in FIG. 36, the ambient illumination device and the coaxial illumination device are, here too, realized with a common illumination source 381 with an illumination pupil that is directly decomposed in a time varying manner into respective first light-transmissive and second, shadowing sub-aperture regions by a single common sub-aperture modulation device 382. The illumination modulated thus is then coupled into a split light carrier bundle that consists of the first partial light carrier bundle 383 and a second partial light carrier bundle, and said illumination modulated thus is fed into the first optical system 125 at the output of the first partial light carrier bundle 383 and fed into the optical system 131 at the output of the second partial light carrier bundle 384.
[0195] In the shown embodiment, a common sub-aperture modulation device 382 can be integrated into a common illumination source 381, can be arranged externally and can be connectable to the illumination optical unit of the microscope by way of a split light carrier bundle and, where necessary, appropriate optical coupling interfaces.
[0196] FIG. 39 shows a schematic illustration of an example for a reflection correction method for correcting digital microscopic images according to a further embodiment of the invention. Initially, an object and an apparatus for producing reflection-corrected images are provided in a provision step (not illustrated). The reflection correction method 390 for correcting digital microscopic images then comprises at least illuminating 391 an object through an illumination pupil of an illumination device, recording 392 a sequence of images of the object that belong to illumination situations, which differ from one another in each case, by way of an image recording sensor device, and producing 393 a reflection-corrected image from the sequence using an image processing device. In particular, the reflection correction method according to the invention also comprises producing 394 the illumination situations, which differ from one another, using an illumination modulation device in such a way that, for each image region in an image from the sequence containing a reflected illumination image of at least part of the illumination pupil, in particular an illumination image whose image position is situated at or in the vicinity of that of the object, there is a corresponding image region without this reflected illumination image in at least one of the remaining images from the sequence, wherein producing the illumination situations, which differ from one another, comprises producing the illumination situations, which differ from one another, by a sequential modification of an illumination beam path from the illumination pupil to the object, wherein, in each case, light from a respectively associated first sub-aperture region of the illumination pupil is incident on the object, while no light is incident on the object from a respective second sub-aperture region of the illumination pupil.
[0197] To the extent that nothing else is specified, terms such as first and second or the like (for example, first and second optical system, first and second sub-aperture modulation device, etc.) were used to distinguish between the respective elements. Therefore, the use of the terms does not necessarily imply a functional or any other prioritization of one or the other element.
[0198] The present invention has been described in detail on the basis of exemplary embodiments for explanation purposes. A person skilled in the art recognizes that details that were described with reference to one embodiment can also be used in other embodiments. Therefore, the invention is not intended to be restricted to individual embodiments, but rather only by the appended claims.
LIST OF REFERENCE SIGNS
[0199] 10 Apparatus for producing reflection-corrected images [0200] 11 Object [0201] 12 Illumination device [0202] 13 Illumination source [0203] 14 Illumination pupil [0204] 15 Image recording sensor device [0205] 16 Image processing device [0206] 17 Sub-aperture modulation device [0207] 18 Illumination beam path [0208] 19 Image display device [0209] 21 First sub-aperture region [0210] 22 Second sub-aperture region [0211] 101 Illumination pupil [0212] 102 First sub-aperture regions [0213] 103 Second sub-aperture regions [0214] 111 Illumination pupil [0215] 112 First sub-aperture regions [0216] 113 Second sub-aperture regions [0217] 120 Microscope [0218] 121 Coaxial illumination source [0219] 122 Coaxial illumination pupil [0220] 123 Ambient illumination source [0221] 124 Ambient illumination pupil [0222] 125 Optical system [0223] 126 Radiant field stop [0224] 127 Further optical system [0225] 128 Deflection mirror [0226] 129 Main objective [0227] 130 Object plane [0228] 131 Optical system [0229] 132 Optical splitter [0230] 133 Magnification system [0231] 134 Digital observation port [0232] 135 Sub-aperture modulation device [0233] 136 Microscope [0234] 137 Optical system [0235] 138 Optical system [0236] 139 Illumination pupil [0237] 140 Illumination pupil [0238] 141 Sub-aperture modulation device [0239] 142 Microscope [0240] 143 Illumination pupil [0241] 144 Illumination pupil [0242] 145 Sub-aperture modulation device [0243] 150 Microscope [0244] 151 Sub-aperture modulation device [0245] 152 Illumination pupil [0246] 153 Sub-aperture modulation device [0247] 154 Optical system [0248] 160 Microscope [0249] 161 Sub-aperture modulation device [0250] 162 Illumination pupil [0251] 163 Deflection mirror [0252] 164 Sub-aperture modulation device [0253] 165 Illumination pupil [0254] 170 Microscope [0255] 171 First DMD micro-system [0256] 172 Second DMD micro-system [0257] 180 Microscope [0258] 181 First sub-aperture modulation device [0259] 182 Ambient illumination pupil [0260] 183 Second sub-aperture modulation device [0261] 184 Coaxial illumination pupil [0262] 190 Microscope [0263] 191 Coaxial illumination source [0264] 193 Ambient illumination source [0265] 210 Microscope [0266] 211 Optical system [0267] 212 Optical system [0268] 213 Rotatable mirror [0269] 214 Rotatable mirror [0270] 215 Optical system [0271] 216 Optical system [0272] 217 Sub-aperture stop [0273] 218 Sub-aperture stop [0274] 219 Illumination pupil [0275] 220 Illumination pupil [0276] 230 Microscope [0277] 231 Illumination module [0278] 232 Optical splitter [0279] 233 Main objective [0280] 234 Object plane [0281] 235 Block [0282] 240 Illumination device [0283] 241 Illumination source [0284] 242 Optical system [0285] 243 Sub-aperture modulation device [0286] 250 Sub-aperture mask [0287] 261 Receptacle [0288] 262 Drive [0289] 263 Enclosure [0290] 270 Hollow shaft motor [0291] 271 Rotor [0292] 272 Stator [0293] 280 Sub-aperture modulation device [0294] 281 Electronically actuatable stop [0295] 290 Sub-aperture modulation device [0296] 291 Micro-electromechanical system [0297] 292 Input [0298] 293 Output [0299] 294 First optical system [0300] 295 Second optical system [0301] 300 Sub-aperture modulation device [0302] 301 Micro-electromechanical system [0303] 302 Micro-electromechanical system [0304] 303 Input [0305] 304 Output [0306] 305 First optical system [0307] 306 Second optical system [0308] 307 Third optical system [0309] 310 Illumination device [0310] 311 Illumination source [0311] 312 Light carrier bundle [0312] 313 Sub-aperture modulation device [0313] 314 Optical system [0314] 320 Illumination device [0315] 321 Illumination source [0316] 322 Light carrier bundle [0317] 323 Sub-aperture modulation device [0318] 324 Optical system [0319] 325 Second light carrier bundle [0320] 330 Illumination device [0321] 331 Illumination source [0322] 332 Sub-aperture modulation device [0323] 333 Light carrier bundle [0324] 334 Optical system [0325] 340 Microscope [0326] 341 Primary ambient illumination source [0327] 342 First light carrier bundle [0328] 343 Secondary ambient illumination source [0329] 344 First sub-aperture modulation device [0330] 345 Primary coaxial illumination source [0331] 346 Second light carrier bundle [0332] 347 Secondary coaxial illumination source [0333] 348 Second sub-aperture modulation device [0334] 350 Microscope [0335] 351 Primary ambient illumination source [0336] 352 Primary first light carrier bundle [0337] 353 Secondary ambient illumination source [0338] 354 First sub-aperture modulation device [0339] 355 Secondary first light carrier bundle [0340] 356 Primary coaxial illumination source [0341] 357 Primary second light carrier bundle [0342] 358 Secondary coaxial illumination source [0343] 359 Second sub-aperture modulation device [0344] 360 Secondary second light carrier bundle [0345] 361 Microscope [0346] 362 Primary illumination source [0347] 363 First partial light carrier bundle [0348] 364 Second partial light carrier bundle [0349] 365 Secondary ambient illumination source [0350] 366 First sub-aperture modulation device [0351] 367 Secondary coaxial illumination source [0352] 368 Second sub-aperture modulation device [0353] 370 Microscope [0354] 371 Primary illumination source [0355] 372 Primary first partial light carrier bundle [0356] 373 Primary second partial light carrier bundle [0357] 374 Secondary ambient illumination source [0358] 375 First sub-aperture modulation device [0359] 376 Secondary coaxial illumination source [0360] 377 Second sub-aperture modulation device [0361] 378 Secondary first light carrier bundle [0362] 379 Secondary second light carrier bundle [0363] 380 Microscope [0364] 381 Illumination source [0365] 382 Sub-aperture modulation device [0366] 383 First partial light carrier bundle [0367] 384 Second partial light carrier bundle [0368] 390 Reflection correction method [0369] 391 Illuminating an object [0370] 392 Recording a sequence [0371] 393 Producing a reflection-corrected image [0372] 394 Producing the illumination situations, which differ from one another
