VIDEO BASED MICROSCOPE ADJUSTMENT

Abstract

The present disclosure relates to an optical observation device which is controlled in a sterility preserving manner, and to a corresponding controlling program and/or program storage medium. The optical observation device includes a main structure having at least one optical camera, a support structure adapted to variably position the main structure, and a control unit that receives a sequence of images from the at least one optical camera, searches a current image from the sequence of images for a trackable object, tracks the trackable object shown in the sequence of images subsequent to the current image; and controls adjustable properties of AR-content superimposed with the sequence of images in accordance with a motion of the trackable object, wherein the adjustable properties of the AR-content include a location, orientation, and/or size of the AR-content with respect to the sequence of images.

Claims

1.-13. (canceled)

14. An optical observation device comprising: a main structure comprising a surgical microscope having at least one optical camera adapted to be aimed at a patient to be treated; a support structure adapted to variably position the main structure at or near a workplace to be observed; and a control unit adapted to: receive a sequence of images from the at least one optical camera; search a current image from the sequence of images for a trackable object positioned within a field of view of the at least one optical camera; track the trackable object shown in the sequence of images subsequent to the current image; and control properties of AR-content superimposed with the sequence of images in accordance with a motion of the trackable object, the properties of the AR-content including a location, orientation, and/or size of the AR-content with respect to the sequence of images.

15. The optical observation device according to claim 14, wherein the control unit is further adapted to control properties of an optical set-up including a focus-point of the optical set-up and/or to control properties of the at least one optical camera including a zoom-factor of the at least one optical camera in accordance with the motion of the trackable object.

16. The optical observation device according to claim 14, wherein an upper threshold for a speed of motion of the trackable object is defined and motions above the upper threshold are ignored.

17. The optical observation device of claim 14, wherein a handheld medical instrument is recognized as the trackable object, which is provided as a disposable device.

18. The optical observation device according to claim 17, wherein the medical instrument is tracked via a ring pattern provided on the medical instrument and visible in the sequence of images.

19. The optical observation device of claim 14, wherein the support structure is a motorized support structure and the control unit is further adapted to control the motorized support structure, an optical set-up and/or the at least one optical camera, wherein motion of the main structure, and/or adjustable properties of the optical set-up and/or of the at least one optical camera, is coupled to the motion of the trackable object via at least one conversion factor.

20. The optical observation device according to claim 19, wherein at least two degrees of freedom for the motion of the main structure are controlled separately, such that motion of the main structure in at least one of the at least two degrees of freedom is blocked while the main structure is controlled to move within at least one other of the at least two degrees of freedom.

21. The optical observation device according to claim 19, wherein the control unit is adapted to receive a trigger signal for controlling the motorized support structure, the optical set-up and/or the at least one optical camera, in accordance with the motion of the trackable object, via a sterility preserving user interface, via covering or uncovering an optically recognizable feature provided on the trackable object, wherein the trigger signal is activated by a foot pedal switch, voice command, and/or gestures which are recognizable from the sequence of images.

22. The optical observation device according to claim 19, wherein the motorized support structure is controlled to move the main structure in accordance with the motion of the trackable object, wherein the motorized support structure is an articulated arm with at least two arm sections which are hingedly connected to each other via at least one motorized joint.

23. The optical observation device according to claim 22, wherein the motion of the main structure is coupled to the motion of the trackable object via the at least one conversion factor causing: the motion of the main structure to be amplified as compared to the motion of the trackable object; the motion of the main structure to be reduced as compared to the motion of the trackable object; and/or the motion of the main structure to be damped as compared to the motion of the trackable object.

24. An optical observation device comprising: a main structure comprising at least one optical camera adapted to transmit a sequence of images; a support structure adapted to move the main structure; and a control unit adapted to receive the sequence of images from the optical camera, track a trackable object shown in the sequence of images, and control properties of AR-content superimposed with the sequence of images in accordance with a motion of the trackable object, wherein the properties of the AR-content include a location, orientation, and/or size of the AR-content with respect to the sequence of images.

25. The optical observation device according to claim 24, wherein the control unit is further adapted to search a current image from the sequence of images for the trackable object after receipt of the sequence of images.

26. The optical observation device according to claim 25, wherein the support structure is a motorized support structure and the control unit is further adapted to transmit a signal to the motorized support structure of where to move the main structure in accordance with the motion of the trackable object via at least one conversion factor, wherein the control unit is further adapted to receive a trigger signal for controlling the motorized support structure in accordance with the motion of the trackable object.

27. The optical observation device according to claim 26, wherein the motion of the main structure is coupled to the motion of the trackable object via the at least one conversion factor causing the motion of the main structure to be reduced as compared to the motion of the trackable object, and/or the motion of the main structure to be damped as compared to the motion of the trackable object.

28. The optical observation device according to claim 24, wherein the control unit is further adapted to control properties of an optical set-up including a focus-point of the optical set-up and/or to control properties of the at least one optical camera including a zoom-factor of the at least one optical camera in accordance with the motion of the trackable object.

29. The optical observation device according to claim 24, wherein the support structure is a motorized support structure and the control unit is further adapted to transmit a signal to the motorized support structure of where to move the main structure in accordance with the motion of the trackable object via at least one conversion factor.

30. The optical observation device according to claim 29, wherein the motorized support structure is controlled to move the main structure in accordance with the motion of the trackable object, and wherein the motorized support structure is an articulated arm with at least two arm sections which are hingedly connected to each other via at least one motorized joint.

31. The optical observation device according to claim 29, wherein the control unit is adapted to receive a trigger signal for controlling the motorized support structure, via a sterility preserving user interface, via covering or uncovering an optically recognizable feature provided on the trackable object, wherein the trigger signal is activated by a foot pedal switch, voice command, and/or gestures which are recognizable from the sequence of images.

32. The optical observation device according to claim 31, wherein covering a designated feature of the trackable object, which is visible to the at least one optical camera is recognized as a gesture provoking the trigger signal.

33. A program logic stored in a memory device of a computer, that when the program logic is executed by the computer causes the computer to: receive a sequence of images from at least one optical camera; search a current image from a sequence of images for a trackable object; track the trackable object shown in the sequence of images subsequent to the current image; and control adjustable properties of AR-content superimposed with the sequence of images, adjustable properties of an optical set-up, and/or adjustable properties of the at least one optical camera in accordance with motion of the trackable object, wherein the adjustable properties of the AR-content include a location, orientation, and/or size of the AR-content with respect to the sequence of images.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0043] In the following, the invention is described with reference to the enclosed FIGURE which represents a preferred embodiment of the invention. The scope of the invention is however not limited to the specific features disclosed in the FIGURE, which shows:

[0044] FIG. 1 an optical observation device in accordance with the present invention controlled via a hand-held pointer instrument.

DETAILED DESCRIPTION

[0045] The optical observation device 1 shown in FIG. 1 comprises, as a main structure, a surgical microscope 2 which is held above a workplace by an articulated support structure 5 which is, at its other end, connected to a mobile wheel trolley.

[0046] The spatial position of the microscope 2 with respect to the trolley and therefore also with respect to the workplace is adjusted by activating motorized joints 9 between the arm sections 8 of the articulated support arm 5.

[0047] In accordance with the present invention, this is done with the help of a pointer instrument 7 which is positioned within the field of view of the microscope. By covering an optically detectable feature 12 on the instrument 7 (which has to be at this time within the microscope's field of view and may be a colored spot or marking; even tracking markers or one or more rings of the ring pattern 13 may act as the feature 12) or by pushing the foot pedal switch 11 which is connected to an interface 10 of the control unit 6, a triggering signal is provoked that sets off the following control procedure:

[0048] The spatial position of a ring pattern 13 which is provided at the tip of the instrument 7 is determined within the sequence of images the control unit 6 receives from the cameras 4 of the microscope 2. As soon as the instrument 7 is moved by a user within the field of view of the microscope, the control unit 6 controls the motorized joints 9 such that the microscope 2 “follows” the ring pattern 13 on the instrument 7. Since “exaggerated” microscope motions are undesired, the microscope 2 will move by a smaller distance than the instrument 7 does. Obviously, the ring-pattern 13 is not suitable for controlling the microscope 2 in accordance with a rotation of the instrument 7 around its longitudinal axis. However, other features recognizable for the cameras 4 or even for an external medical tracking system may be provided to allow for tracking this motion as well. Provided that all six degrees of freedom (x′, y′, z′, u′, v′, w′) are recognized within the field of view of the microscope 2, the position of the microscope 2 can in principle be adjusted in six degrees of freedom (x, y, z, u, v, w). Even though the above lines describe a positional adjustment of the microscope 2 with respect to a medical workplace underneath the microscope 2, the properties of an optical set-up 3 of the microscope 2 or the cameras 4 of the microscope 2 may alternatively or additionally be adjusted via a motion of the instrument 7 in the same manner as described above. For example, the focal length of the optical set-up 3 of the microscope 2 may be adjusted by moving the instrument 7 in a vertical direction. In a further example, the zoom factor of the microscope cameras 4 may be adjusted by moving the instrument 7 in a horizontal or even in a vertical direction.