High-reliability spectacle-type device and method

Abstract

The invention relates to a spectacle-type device (1) in which a full image can be depicted in a reliable manner by overlapping the first partial image (α3) and the second partial image (α4), wherein a correct full image can be perceived by the operator (2), and an action can be carried out with reliability when at least two items of image information coincide. The invention also relates to a method for depicting a full image and/or for carrying out an action using a spectacle-type device.

Claims

1. A spectacle-type apparatus for operating a machine tool, a production machine and/or a robot, said apparatus comprising: a first display unit; a second display unit independent from the first display unit; a first registration unit configured to register a first surrounding region of an operator and to convert the first surrounding region into a first item of image information; a second registration unit independent from the first registration unit and configured to register a second surrounding region of the operator in overlapping relationship to the first surrounding region and to convert the second surrounding region into a second item of image information; a first computing unit receiving the first item of image information from the first registration unit and generating a first partial image for passing to the first display unit and display by the first display unit; a second computing unit independent from the first computing unit, said second computing unit receiving the second item of image information from the second registration unit and generating a second partial image for passing to the second display unit and display by the second display unit, said spectacle-type apparatus configured to generate and display a full image using two channels by overlaying the first partial image and the second partial image, with one of the two channels being defined by a data connection between the first registration unit and the first computing unit for passing the first item of image information from the first registration unit to the first computing unit, and with the other one of the two channels being defined by a data connection between the second registration unit and the second computing unit for passing the second item of image information from the second registration unit to the second computing unit, and further comprising a higher-level computing unit operably connected to the first and second computing units for comparing the first item of image information and the second item of image information, said spectacle-type apparatus being embodied as an interface between the operator and the machine tool, the production machine and/or the robot and comprising a virtual HMI (Human-Machine Interface) having a virtual switch or button to enable the operator to carry out a reliable action by the machine tool, the production machine and/or the robot with a finger of the operator when the first item of image information and the second item of image information coincide, and to stop or not carry out the reliable action of the machine tool, the production machine and/or the robot when the first item of image information and the second item of image information do not coincide which is indicative of an error or malfunction of the spectacle-type apparatus.

2. The spectacle-type apparatus of claim 1, wherein the higher-level computing unit is configured to place the machine tool, the production machine and/or the robot into a safe state when the first item of image information and the second item of image information do not coincide.

3. The spectacle-type apparatus of claim 1, wherein at least one of the first and second display units is embodied as a display and/or as a projector.

4. The spectacle-type apparatus of claim 1, wherein the first display unit shows the first partial image to a first eye of the operator, and wherein the second display unit shows the second partial image to a second eye of the operator.

5. The spectacle-type apparatus of claim 1, wherein at least one of the first and second registration units is embodied as a camera.

6. The spectacle-type apparatus of claim 5, wherein the camera registers at least two dimensions.

7. The spectacle-type apparatus of claim 1, constructed in the form of virtual reality glasses or augmented reality glasses.

8. The spectacle-type apparatus of claim 1, constructed to be worn by the operator as a head-mounted display.

9. A method for operating a machine tool, a production machine and/or a robot with a spectacle-type apparatus as set forth in claim 1.

10. A method, comprising: registering a first surrounding region of an operator by a first registration unit; converting the first surrounding region into a first item of image information; registering a second surrounding region of the operator by a second registration unit; converting the second surrounding region into a second item of image information; passing the first item of image information from the first registration unit to a first computing unit; passing the second item of image information from the second registration unit to a second computing unit; and executing a reliable action of a machine tool, a production machine and/or a robot, when the first item of image information and the second item of image information coincide, via two channels through actuation of a virtual switch of button with the finger of the operator, with one of the channels being defined by a data connection between the first registration unit and the first computing unit for passing the first item of image information from the first registration unit to the first computing unit, and with the other one of the channels being defined by a data connection between the second registration unit and the second computing unit for passing the second item of image information from the second registration unit to the second computing unit, said method further comprising comparing the first item of image information with the second item of image information by a higher-level computing unit to determine whether the first item of image information and the second item of image information coincide to initiate execution of the reliable action.

11. The method of claim 10, further comprising: generating a first partial image by the first computing unit; passing the first partial image from the first computing unit to a first display unit; displaying the first partial image by the first display unit; generating a second partial image by the second computing unit; passing the second partial image from the second computing unit to a second display unit; displaying the second partial image by the second display unit; and overlaying the first partial image and the second partial image to enable the operator to determine whether a resultant full image is correct or incorrect.

12. The method of claim 11, wherein the full image is depicted via the channels, with the first partial image being generated in the first computing unit in one of the channels and passed from the first computing unit to the first display unit, and with the second partial image being generated in the second computing unit in the other one of the channels passed from the second computing unit to the second display unit.

13. The method of claim 10, wherein the reliable action is carried out as a reaction to an operator action initiated by the operator.

14. The method of claim 13, wherein the operator action is carried out as a gesture.

Description

BRIEF DESCRIPTION OF THE DRAWING

(1) The invention is described and explained in more detail below on the basis of the exemplary embodiments shown in the figures, in which:

(2) FIG. 1 shows an embodiment of a spectacle-type apparatus according to the invention,

(3) FIG. 2 shows a method for carrying out an action according to the invention,

(4) FIG. 3 shows a method for depicting a full image according to the invention,

(5) FIG. 4 shows an operator with a spectacle-type apparatus in front of a machine tool and a superimposed projection image.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

(6) FIG. 1 shows an embodiment of a spectacle-type apparatus 1 according to the invention. In the figure, the spectacle-type apparatus 1 is worn on the head of an operator 2. The spectacle-type apparatus 1 is advantageously embodied as a head-mounted display.

(7) The spectacle-type apparatus 1 has two display units. The display units can be embodied as a display 21 or 22 or as a projector.

(8) In the figure, the spectacle-type apparatus 1 has a first display 21 and a second display 22. The first display 21 displays a first partial image to a first eye 3. The second display 22 displays a second partial image to a second eye 4.

(9) The spectacle-type apparatus 1 also has a first registration unit, which is embodied as a first camera 11. In addition, the spectacle-type apparatus 1 has a second registration unit, which is embodied as a second camera 12.

(10) Each camera 11 or 12 can preferably register two dimensions.

(11) The spectacle-type apparatus 1 also has a first computing unit 31 and a second computing unit 32.

(12) The first camera 11 registers a first surrounding region α1 of the operator 2, and the second camera 12 registers a second surrounding region α2. The two surrounding regions α1 and α2 at least adjoin one another. Preferably, however, the two surrounding regions α1 and α2 overlap, as shown in the figure.

(13) The first camera 11 converts the first surrounding region α1 into a first item of image information. The first item of image information can be processed by the first computing unit 31.

(14) The second camera 12 converts the second surrounding region α2 into a second item of image information, which can be processed by the second computing unit.

(15) The first camera passes the first item of image information to the first computing unit via a data connection 13. The second camera 12 passes the second item of image information to the second computing unit 32 via the data connection 14.

(16) The data connections can be embodied as a physical connection or also cable-free.

(17) The first computing unit 31 generates a first partial image and passes the first partial image to the first display 21 via the data connection 23.

(18) The second computing unit 32 generates a second partial image and passes the second partial image to the second display 22 via the data connection 24.

(19) The first display 21 represents the angle of view α3 shown in the figure. The second display 22 represents the angle of view α4 shown in the figure. The two angles of view α3 and α4 overlap and represent a projection image 15, which is visible to the operator.

(20) As shown in the figure, a first eye 3 sees the angle of view α3 and a second eye 4 sees the angle of view α4. The first partial image in the angle of view α3 and the second partial image in the angle of view α4 are thus overlaid, as a result of which a full image is produced. A correct full image can be perceived by the operator 2. Here, the operator 2 can also perceive an incorrect full image and thus a malfunction of the spectacle-type apparatus.

(21) In the figure, the virtual projection image 15 shows a virtual human machine interface (HMI) 16. The projection image 15 corresponds to the full image. The HMI 16 enables the operator 2 to interact with a machine tool, for example.

(22) The first and the second camera 11 and 12 can register a surrounding of the operator. Here, the first camera registers a first surrounding region α1 and the second camera registers a second surrounding region α2. The first item of image information and the second item of image information are passed to the first computing unit 31 and the second computing unit 32 via the data connections 13 and 14.

(23) For example, one computing unit or both computing units 31 and 32 can register the machine, for example machine tool, in front of which the operator 2 is standing and superimpose a corresponding HMI. Here, the first computing unit 31 calculates a first partial image and passes it to the first display 21 via the data connection 23. The second computing unit 32 generates a second partial image and passes it to the second display 22 via the data connection 24.

(24) The two displays 21 and 22 display the respective partial images. The first partial image preferably corresponds to the second partial image. If one of the two partial images is incorrect, the operator 2 perceives this immediately because the two partial images do not produce a correct full image. In this way, the operator 2 perceives a malfunction of the spectacle-type apparatus 1. This enables the machine, for example the machine tool, to be operated reliably.

(25) If for example one of the two displays 21 or 22 fails, the operator 2 perceives this because he is “blind” in one eye. Moreover, on account of the overlaying of the two partial images, a three-dimensional projection image 15 is produced.

(26) As shown in the figure, the virtual HMI 16 comprises a virtual HMI display 164 and three virtual knobs 161, 162 and 163. The virtual knobs are embodied for example as switches or buttons.

(27) The operator 2 can operate the virtual HMI 16 for example using a finger 5. Here, if the operator 2 presses a virtual knob 162 of the virtual HMI 16, this operator action is registered by both the first camera 11 and the second camera 12. The resulting items of image information are respectively passed to the first or second computing unit 31 or 32 via the data connection 13 or 14.

(28) A higher-level computing unit 33 is also shown in the figure by way of example. The first computing unit 31 passes the item of image information showing the operation of the virtual HMI 16 to the higher-level control unit 33 via the data connection 19. The second computing unit 32 passes the item of image information to the higher-level computing unit 33 via the data connection 20.

(29) The higher-level computing unit 33 can check whether the item of image information from the first camera 11 coincides with the item of image information from the second camera 12. If this is the case, an action, such as “start” the machine tool, “stop”, or “emergency off”, can be initiated.

(30) Because both the registration of image information and the depiction of the full image take place using two channels and thus redundantly, a spectacle-type apparatus 1 of this type is reliable. If the item of image information from the first camera 11 and the item of image information from the second camera 12 do not coincide, an error or malfunction of the spectacle-type apparatus 1 is perceived and the action is not carried out or is stopped. The operator 2 can be informed about this malfunction, for example by means of a display field in the projection image 15. Furthermore, the placing of the machine into a safe state can be initiated, for example by the higher-level computing unit 33.

(31) A communication between the spectacle-type apparatus 1 and the machine tool is possible, for example by means of cables or also radio. An optical transmission of data for communication purposes is also conceivable. The spectacle-type apparatus 1 described enables what are known as 3D glasses to be integrated into the industrial environment.

(32) FIG. 2 shows a method for carrying out an action according to the invention.

(33) In method step S1, the first surrounding region of the operator is registered by the first registration unit.

(34) In method step S2, the first surrounding region is converted into the first item of image information, which can be processed by the first computing unit.

(35) In method step S5, the first item of image information is passed from the first registration unit to the first computing unit.

(36) In method step S3, the second surrounding region of the operator is registered by the second registration unit.

(37) In method step S4, the second surrounding region is converted into the second item of image information, which can be processed by the second computing unit.

(38) In method step S6, the second item of image information is passed from the second registration unit to the second computing unit.

(39) If the first item of image information and the second item of image information coincide—indicated in the figure with=?—the action is carried out reliably in method step S7. This path is indicated in the figure with y.

(40) An action is for example “start”, “stop” or “emergency of” of a machine tool.

(41) FIG. 3 shows a method for depicting a full image according to the invention.

(42) In method step S10, the first partial image is generated by the first computing unit.

(43) In method step S11, the first partial image is passed from the first computing unit to the first display unit.

(44) In method step S12, the first partial image is displayed by the first display unit.

(45) In method step S13, the second partial image is generated by the second computing unit.

(46) In method step S14, the second partial image is passed from the second computing unit to the second display unit.

(47) In method step S15, the second partial image is displayed by the second display unit.

(48) By an overlaying of the first partial image and the second partial image in method step S16, a full image can be depicted reliably because the operator perceives in method step S17 whether a correct full image is present.

(49) The operator also perceives an incorrect full image and in this way can identify a defective spectacle-type apparatus.

(50) FIG. 4 shows an operator 2 with a spectacle-type apparatus 1 in front of a machine tool 6 and a superimposed projection image 15.

(51) The figure shows that the operator 2 wishes to use a finger 5 to press a virtual knob in the virtual projection image 15. The projection image 15 has an HMI 16. This enables the interaction between the operator 2 and the machine tool 6. In the figure, the HMI 16 is superimposed as part of an augmented reality. This means that the operator 2 sees a virtual projection image 15 of the HMI 16 in a real surrounding.

(52) For example, the two registration units register the surrounding of the operator. The registered surrounding is displayed to the operator together with the virtual projection image 15 by means of the two display units.