DIGITAL MICROSCOPE AND METHOD FOR CAPTURING AND DISPLAYING MICROSCOPIC IMAGES

Abstract

The invention concerns a method for capturing and displaying microscopic images of a sample to be microscopically examined using a digital microscope. In a step, a sequence of microscopic images with enhanced visual information in a third geometric dimension is captured. The sequence of the microscopic images is displayed while it is captured. A visual representation of a capturing range in the third geometric dimension is displayed at a graphical user interface. A user input that defines at least one adjustment of the capturing range is received resulting in an adjusted capturing range. At least one parameter of detecting visual information in the third geometric dimension is adjusted according to the adjusted capturing range. It is continued to capture the sequence of the microscopic images with the enhanced visual information in the third geometric dimension applying the at least one adjusted parameter. Furthermore, the invention concerns a digital microscope.

Claims

1. A method for capturing and displaying microscopic images (01) of a sample to be microscopically examined using a digital microscope; wherein the method comprises the following steps: capturing a sequence of microscopic images with enhanced visual information in a third geometric dimension; displaying the sequence of the microscopic images while it is captured; determining a capturing range in the third geometric dimension depending on an extent of an area of interest of the sample, displaying a visual representation of the capturing range in the third geometric dimension, wherein that visual representation is displayed at a graphical user interface, and wherein at least a lower limit and an upper limit of the capturing range are adjustable at the graphical user interface; receiving a user input that defines at least one adjustment of the capturing range in the third geometric dimension resulting in an adjusted capturing range in the third geometric dimension; adjusting at least one parameter of detecting visual information in the third geometric dimension according to the adjusted capturing range in the third geometric dimension; and continuing to capture the sequence of the microscopic images with the enhanced visual information in the third geometric dimension applying the at least one adjusted parameter.

2. The method according to claim 1, characterized in that the images with the enhanced visual information in the third geometric dimension are images with an extended depth of field or three-dimensional images.

3. The method according to claim 1, characterized in that the least one parameter of detecting visual information in the third geometric dimension comprises: a selection of an objective of a set of exchangeable objectives, an optical magnification of an objective, a step size in the third geometric dimension, a number of steps in the third geometric dimension, a field of view, an illumination setting, an illumination condition, an option for an automatic correction of reflexes, an option for an automatic telecentric correction, a rate of images per second, a rate of volumes per second, a depth quality threshold, a smoothing index, an index of a pixelwise iteration, a depthwise kernel size, a value of a bilateral sigma colour, a value of a bilateral sigma space; a resize ratio, a number of threads, a spectral range of an illumination, a frequency of a stroboscopic illumination, an acquisition time, a selection of rings of illumination, a selection of a coaxial illumination, an exposure time, a mode of white balance, and/or a camera gain.

4. The method according to claim 1, characterized in that an available range in the third geometric dimension is determined based on properties of the used digital microscope.

5. The method according to claim 4, characterized in that the visual representation of the capturing range in the third geometric dimension is an inner bar in an outer bar, wherein the outer bar visually represents the available range in the third geometric dimension.

6. The method according to claim 1, characterized in that it comprises a step, in which parameters of capturing and/or displaying the microscopic images with the enhanced visual information in the third geometric dimension are automatically determined before the sample is microscopically examined.

7. The method according to claim 6, characterized in that the parameters to be automatically determined before the sample is microscopically examined comprise: a selection of an objective of a set of exchangeable objectives, an optical magnification of an objective, an illumination, a spectral range of an illumination, a frequency of a stroboscopic illumination, an acquisition time, and/or a camera gain.

8. The method according to claim 1, characterized in that it further comprises the following steps: displaying a visual representation of an available exposing range that ranges from a minimally available exposure to a maximally available exposure of the sample, wherein that visual representation of the exposing range is displayed at the graphical user interface, receiving a further user input that defines a selected exposing range that ranges from a minimally applicable exposure to a maximally applicable exposure of the sample.

9. The method according to claim 8, characterized in that the selected exposing range is visually represented at the graphical user interface as an inner bar in an outer bar that visually represents the available exposing range.

10. The method according to claim 1, characterized in that it further comprises the following steps: displaying a first menu at the graphical user interface, wherein the first menu comprises at least two menu items, wherein each of the menu items stands for a mode of capturing microscopic images, wherein at least one of the modes describes capturing of microscopic images with enhanced visual information in the third geometric dimension; and receiving a user input of selecting one of the first menu items of the first menu.

11. The method according to claim 1, characterized in that it further comprises the following steps: displaying a second menu at the graphical user interface, wherein the second menu (14) comprises at least two menu items, wherein at least one of the menu items stands for a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension; and receiving a user input of selecting one of the menu items of the second menu.

12. The method according to claim 1, characterized in that a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as images with an extended depth of field is selected automatically if the user uses a two dimensional display for watching the microscopic images, wherein a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as 2.5-dimensional images or as three dimensional images is selected automatically if the user uses a 2.5-dimensional display or a three-dimensional display for watching the microscopic images.

13. The method according to claim 1, characterized in that an option is displayed at the graphical user interface, wherein this option stands for a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as microscopic images showing an extended depth of field and/or showing a focused area, wherein the extended depth of field or the focused area is at least present in at least one region of interest.

14. The method according to claim 1, characterized in that a tool for measuring is presented at the graphical user interface, wherein a user input on that tool is received, wherein geometric data are determined by image data processing of the captured sequence of the microscopic images with enhanced visual information in the third geometric dimension, and wherein the user input is applied to the geometric data in order to calculate a measure that is output at the graphical user interface.

15. A digital microscope for capturing microscopic images of a sample to be microscopically examined; comprising: an objective for gathering light from the sample to be microscopically examined, wherein the objective comprises at least one lens; an image sensor for converting an image transferred from the objective to the image sensor into an electrical signal; an illumination unit for illuminating the sample; an apparatus for capturing enhanced visual information in the third geometric dimension; a graphical user interface; and a control circuitry that is configured for executing a method according to claim 1.

Description

BRIEF DESCRIPTION OF THE DRAWING

[0057] FIG. 1 shows a graphical user interface of a preferred embodiment of a digital microscope according to the invention.

PREFERRED EMBODIMENT OF THE INVENTION

[0058] That digital microscope can be used, e. g. for shop-floor microscopy. The digital microscope according to the invention can be used by a user of any level of education and preparation since its graphical user interface is simple and user-friendly. The user can use the digital microscope as an efficient tool in his daily routine. An example of usage is supervision. According to this example, the user makes supervision and control of six machines (not shown) for drills production at a factory shop floor. Every 30 minutes or on demand, the user visits each machine in a turn and takes a sample (not shown) to be inspected under the microscope. The sample is a drill bit (not shown) that must be inspected with a particular microscopic magnification as, e. g. 2.5× to fulfil resolution and size requirements. The requirement to inspect the drill bit (not shown) fast benefits from an extended depth of field that is provided by the digital microscope. This embodiment of the digital microscope allows seeing a complete microscopic image in form of a volume in order to inspect a three-dimensional structure of the drill (not shown) at once. The user can rotate drill (not shown) while inspecting. The user can rotate it either by hand or using a specialized manipulator (not shown). The user can observe the constant quality and the absence of any defect. The user can ensure that quality degradation does not occur. A pre-defined quality degradation will indicate need for particular adjustments on one of the machines (not shown). The user is enabled to quickly document a quality level with high attentions to details.

[0059] The preferred embodiment of the digital microscope provides live microscopic images 01 of the sample with an extended depth of field and live microscopic images 01 that are completely in focus. Pursuant to a method according to the invention, the user has to adjust only one parameter or only very few parameters in order the configure the digital microscope for capturing and displaying the live microscopic images 01 of the sample with an extended depth of field (EDoF) or the live microscopic images 01 that are completely in focus based on an autofocus (AF). These live microscopic images 01 that are completely in focus are also referred to as all-in-focus images (AIF). The described user-friendly manual configuration is done via the shown graphical user interface.

[0060] The shown graphical user interface comprises a presentation of the live microscopic images 01 of the sample (not shown) that is inspected. The graphical user interface further comprises a toggle button 02 for toggling between “live” mode and a “snap” mode. The “live” mode can also be named as “navigation” mode and allows live capturing and live displaying of the microscopic images 01 that are images with an extended depth of field (EDoF) or images that are completely in focus (AF). In the “snap” mode, individual still microscopic images 01 that are still images with an extended depth of field (EDoF) or still images that are completely in focus (AF) are captured and stored.

[0061] The graphical user interface further comprises a first menu 03. The first menu 03 comprises four menu items that stands for modes of capturing the microscopic images 01 with an extended depth of field (EDoF) or images that are completely in focus based on an autofocus (AF-2D) as three-dimensional images or two-dimensional images (2D). These images that are completely in focus are also referred to as all-in-focus images (AIF). There are also modes with pre-defined parameters (Def. 1) and automatic modes (Auto) as well as modes for specific samples or ranges.

[0062] The graphical user interface further comprises a first inner bar 06 in a first outer bar 07. The first outer bar 07 visually represents a range available for capturing visual information in depth. Hence, this range can be named as “MaxZrange”. The first inner bar 06 is a filled area within the first outer bar 07. The first inner bar 06 visually represents a range, in which the depth information is actually captured. Hence, this range can be named as “expZrange”. The user can interactively move the first inner bar 06 and the user can interactively adjust the ends of the first inner bar 06 in order to adjust the capturing range. An upper limit and a lower limit of the capturing range are visually emphasized by extended lines 08 at the ends of the first inner bar 06. A centre of the capturing range is visually emphasized by a further extended line 09 across the first inner bar 06. The centre of the capturing range is determined based on a position of an actuator of an apparatus (not shown) for gathering the extended depth of field.

[0063] The graphical user interface further comprises a second inner bar 11 in a second outer bar 12. The second outer bar 12 visually represents a range available for exposing the sample (not shown). That available exposing range ranges from a minimally available exposure that is zero to a maximally available exposure. Hence, this range can be named as “ExpRange”. The second inner bar 12 visually represents a range, in which the sample (not shown) is actually exposed. Hence, this range can be names as applied exposing range. An upper limit of the applied exposing range is visually emphasized by an extended line 13 at the end of the second inner bar 12.

[0064] The graphical user interface further comprises a second menu 14. The second menu 14 comprises menu items that stand for modes of displaying the microscopic images with extended depth of field as three-dimensional images with extended depth of field. Such images can also be named as topographic images (Texture). In further modes, the microscopic images are displayed as a heightmap (Heightmap). The modes are divided in “live” modes and “snap” modes. In the “live” modes, the microscopic images 01 are displayed continuously. In the “snap” modes, the microscopic images 01 are displayed as still images. In more preferred embodiments, the second menu 14 is not present since that selection of the mode is done automatically.

[0065] The graphical user interface further comprises a third menu 16. The third menu 16 comprises menu items that stand for alternative “live” modes of displaying the microscopic images 01 showing an extended depth of field (Fast-EDoF) or showing a focused area based on an autofocus (Fast AF) or an combination thereof (Fast AF/EDoF), wherein the extended depth of field and the focused area, respectively, are at least present in at least one region of interest. These modes are in accordance with human vision. These modes allow fast investigation and fast navigation.

[0066] The graphical user interface further comprises a fourth menu 17. The fourth menu 17 comprises menu items that stand for different modes of illuminating the sample (not shown). These modes comprise a mode for a high dynamic range (HDR) and a mode for automatic exposure (AE).