REMOTE CONTROL DEVICE FOR CRANE, CONSTRUCTION MACHINE, AND/OR INDUSTRIAL TRUCK

Abstract

The present invention relates to a remote control device for a crane, a construction machine and/or an industrial truck, comprising a mobile end device in the form of a tablet computer that has a screen having a touch-screen function, and at least one input means for inputting control commands in the form of a touch-screen display means, as well as a signal transmission device for transmitting the input control commands to the control apparatus of the crane, of the construction machine and/or of the industrial truck. It is proposed to use the screen of the tablet computer not only to input and display control commands, but also to present actual images and/or desired images of the working environment of the machine so that, on an inputting of control commands via the touchscreen function of the screen, the machine operator can simultaneously monitor the working environment there.

Claims

1. A remote control device for a crane, for a construction machine, or for an industrial truck, having a mobile end device in the form of a tablet computer that comprises a screen having a touchscreen function and that has at least one input device for inputting control commands in the form of a touchscreen display device and that has a signal transmission device for transmitting the input control commands to a control apparatus of the crane, of the construction machine, or of the industrial truck, wherein the mobile end device is configured to receive image data from a camera and/or digital data from a building information model (BIM); to display a representation of a machine environment and/or of a work tool of the machine on the screen with reference to the received image data of the camera and/or to the digital data from the building information model (BIM); and to display the input device for inputting control commands at least at times simultaneously with the representation of the machine environment and/or of the work tool.

2. The remote control device in accordance with claim 1, wherein the input device for inputting control commands is faded into the representation of the machine environment and/or of the work tool in a manner of a superposed representation or is displayed on the screen in a manner of a window next to the representation of the machine environment and/or of the work tool.

3. The remote control device in accordance with claim 1, wherein the mobile end device has a graphical simulation module for calculating a virtual representation of the machine environment and/or of machine components; and wherein the graphical simulation module has a data interface for importing building information and/or construction site information and has an image processing device for generating and/or adapting the virtual representation of the machine environment in dependence on the imported construction site information and/or building information.

4. The remote control device in accordance with claim 3, wherein the data interface is a CAD interface and the image processing device is configured for generating and/or adapting the virtual representation of the machine environment in dependence on the CAD data imported via the CAD interface and/or is an image data interface and the image processing device is configured for generating and/or adapting the virtual representation of the machine environment in dependence on the image data, imported via the image data interface.

5. The remote control device in accordance with claim 1, wherein the mobile end device has a display control apparatus for generating a superposed screen representation in a manner of a virtual reality image on the screen that is assembled from the received image data of the camera and the received digital data from the building information model (BIM) and thus from a camera image of the machine environment and from a virtual representation of the machine environment and/or of a building.

6. The remote control device in accordance with claim 1, wherein at least one live camera is provided for providing a live image of the work tool and/or of the machine environment; and wherein the mobile end device has at least one image receiver for receiving the live image of the camera, which live image is based on the representation displayed on the screen.

7. The remote control device in accordance with claim 6, wherein the at least one camera installed at a remote-controlled aerial drone; and wherein the tablet computer has a position control device in the form of a touchscreen display device for remote control of the aerial drone such that different desired positions relative to the machine and/or to its work tool are flown to by the aerial drone.

8. The remote control device in accordance with claim 1, wherein at least one camera for providing a live image of the machine environment is installed in an operator's cabin at the crane, at the construction machine, or at the industrial truck, having a direction of view at least approximately toward the work tool; and wherein the tablet computer has camera control device in the form of a touchscreen display device for the remote control of the angle of view and/or the zoom setting of the camera.

9. The remote control device in accordance with claim 5, wherein the tablet computer is configured to display a camera selection menu for selecting the camera image of one of a plurality of cameras on its screen and to display the camera image after the selection of a camera.

10. The remote control device in accordance with claim 1, wherein the tablet computer is configured to display a touchscreen control device for controlling the focal length and/or the field of view of a camera.

11. The remote control device in accordance with claim 1, wherein the tablet computer is configured to display a virtual representation of the structure in accordance with a determined actual state and/or a virtual representation of a next work task to be carried out by the construction machine on the screen of the tablet computer in dependence on digital information from the building information model in dependence on a specific construction phase; and/or to display a virtual representation of a next construction element to be worked and the installed position of the construction element at the building on the screen of the tablet computer in dependence on digital data from the building information model.

12. The remote control device in accordance with claim 1, wherein the tablet computer is configured to change a working region boundary function taken into account by the construction machine control apparatus in dependence on digital information from the building information model; and to dynamically display the changed working region boundary in the representation of the machine environment on the screen, and wherein the tablet computer is configured to automatically update and/or to automatically adapt cyclically or continuously the working region boundary function in dependence on construction progresses at the building to be erected and/or to be worked while taking account of digital information from the building information model.

13. (canceled)

14. The remote control device in accordance with claim 1, wherein the tablet computer has a configuration module for a selective preconfiguration for adapting the input device in the form of the touchscreen display device to a selected machine type for one of a plurality of machine types.

15. The remote control device in accordance with claim 1, wherein the tablet computer is configured to communicate with different machines to be remote controlled over a network; to display a selection menu for selecting one of a plurality of machines that are connected to the network; and to send generated control commands to the selected machine after selecting one of the plurality of machines on the screen.

16. The remote control device in accordance with claim 1, wherein at least one further electronic module, separate from the tablet computer, is provided for inputting control commands and is wearable and/or fastenable to a body of a machine operator.

17. The remote control device in accordance with claim 16, wherein the additional electronic module is configured as a wristwatch or as a wristband computer and has a screen having a touchscreen function.

18. The remote control device in accordance with claim 16, wherein the tablet computer and the at least one further electronic module provide at least partially mutually overlapping control functions for execution such that a control command desired by the machine operator can selectively be input on the tablet computer or on the further electronic module.

19. The remote control device in accordance with claim 1, wherein the tablet computer is configured to identify a machine part to be adjusted or to be traveled by tapping the representation of the machine part on the screen of the table computer; to detect a dragging and/or displacing of a tapped image element on the screen with respect to a direction and/or a degree and/or a speed of the displacement; and to generate a control command to travel the identified machine part in dependence on the detected dragging and/or displacement.

20. The remote control device in accordance with claim 16, wherein a body installation apparatus is provided for installing the tablet computer at the body of the machine operator; and wherein the body installation apparatus comprises a holding frame having a fastening device for fastening the tablet computer and comprising a carry strap fastened to the holding frame, and wherein a spacer is attached to the holding frame to splay the tablet computer in front of the stomach of the machine operator.

21. (canceled)

22. A system comprising a remote control device, the remote control device having a mobile end device in the form of a tablet computer that comprises a screen having a touchscreen function, and that has at least one input device for inputting control commands in the form of a touchscreen display device and that has a signal transmission device for transmitting the input control commands to a control apparatus of a crane, of a construction machine, or of an industrial truck, wherein that the mobile end device is configured to receive image data from a camera and/or digital data from a building information model (BIM); to display a representation of a machine environment and/or of a work tool of the machine on the screen with reference to the received image data of the camera and/or to the digital data from the building information model; and to display the input device for inputting control commands at least at times simultaneously with the representation of the machine environment and/or of the work tool; wherein a communication connection via which control commands input at a control station of the remote control device are transmittable to a control device of the crane, of the construction machine and/or of the industrial truck, is provided between the crane, the construction machine and/or the industrial truck, on the one hand, and the remote control device, on the other hand.

Description

[0040] The invention will be explained in more detail in the following with reference to a preferred embodiment and to associated drawings. There are shown in the drawings:

[0041] FIG. 1: a schematic representation of a remote control in the form of a tablet computer with a touchscreen for the remote control of a crane, of a construction machine, or of a pallet truck, with partial view (a) showing the holding device for the tablet computer in the installed state and partial view (b) showing the holding device in an exploded representation;

[0042] FIG. 2: a schematic, perspective representation of an additional electronic module of the remote control device that is configured as a wristwatch and that permits the input of control commands such as Up and Down for the lifting hook of the crane or similar control commands;

[0043] FIG. 3: a schematic representation of the system architecture of the remote control and its components from the preceding Figures;

[0044] FIG. 4: a schematic representation of a crane in its working environment of a construction site and of the components of the remote control device for the crane from the preceding Figures;

[0045] FIG. 5: a schematic representation of the system architecture of a plurality of remote control device that are networked with one another for the remote control of a plurality of cranes or similar machines;

[0046] FIG. 6: a schematic representation of a plurality of cranes that are operable using the mutually networked remote controls of FIG. 5; and

[0047] FIG. 7: a schematic representation of the screen of the tablet computer of the remote control device from the preceding Figures, with an actual image of the lifting hook of a crane from a camera being displayed on the screen and, faded in therein, touchscreen display means for inputting control commands being faded in.

[0048] As FIG. 1 shows, the remote control device 1 can be configured as a crane remote control that comprises a mobile end device 2 in the form of a tablet computer 3 and that can, for example, be used for the remote control of a revolving tower crane, of a harbor crane, or of a maritime crane, or of a mobile telescopic crane.

[0049] The crane 200 can here be configured as a revolving tower crane whose tower bears a boom at which a trolley is travelably supported, cf. FIG. 4. The boom can be rotated about an upright axis together with the tower or also without the towerdepending on the configuration of the crane as a top slewer or as a bottom slewerfor which purpose a slewing gear drive is provided. The boom could optionally also be configured as being able to be luffed up and down about a horizontal transverse axis, with a suitable luffing drive being able to be provided, for example, in interaction with the boom guying. Said trolley can be traveled by means of a trolley travel winch or of a different trolley travel drive.

[0050] As FIG. 1 shows, said remote control device 1 can comprise an in principle commercial tablet computer 3 that can be configured by importing corresponding software modules, for example by downloading apps, for the remote control of said crane. The tablet computer 3 here comprises a screen 4 that substantially takes up the total front side of the tablet computer 3 and that can be configured as a touchscreen.

[0051] To be able to hold or guide the tablet computer 3 better, a body installation apparatus 5 is provided by means of which the tablet computer 3 is held at the body of a machine operator.

[0052] Said body installation apparatus 5 can here advantageously comprise a carry strap or belt 6 that can be configured as a neck strap or optionally also as a shoulder strap and that is intended to be hung at the neck or at the shoulder of the machine operator. Said carry strap 6 can here be adjustable in length to be able to set the carrying position at the body.

[0053] Said carry strap 6 is connected to the tablet computer 3 by a holding frame 7 to which the panel-like flat tablet computer 3 can be releasably fastened. As FIG. 1 shows, the holding frame 7 can be formed in multiple parts and can have a sandwich-like structure between whose parts the tablet computer 3 is held. For example, a tub-like bottom housing 7a can be provided in which the tablet computer can be placed with an exact fit, optionally while interposing a soft material 7b or a soft case part that can, for example, comprise a soft plastic and protects the tablet computer 3 from blows and/or compensates fit tolerances with respect to the tub-shaped bottom housing. A cover frame 7c can be placed onto the tablet computer 3 from above to hold it in the bottom housing 7a.

[0054] The body installation apparatus 5 can advantageously comprise a spacer 8 that can be attached to the holding frame 7 in a predefined orientation, and in particular oriented projecting from a narrow side of the tablet computer 3, to hold the tablet computer 3 supported to the front from the stomach of the machine operator. As FIG. 1 shows, such a spacer 8 can, for example, be configured as a support hoop that can advantageously be pushed into the holding frame 7 to be stowed in a transport position and that can conversely be extended to support the tablet computer 3 in the work position in accordance with partial view (a) of FIG. 1.

[0055] As FIG. 3 shows, the tablet computer 3 can communicate via a preferably cableless data communication connection with a control processor 9 that can directly be the control processor of the crane or can form its control apparatus, or is alternatively a construction site processor that can in turn communicate with one or more control apparatus of one or more cranes. As FIG. 3 shows, said control processor 9 can here comprise a router 10 to which the tablet computer 3 is connected, on the one hand, and to which further electronic modules are connected, on the other hand.

[0056] Furthermore, as FIG. 2 shows, an additional electronic module 11 can be part of the remote control device 1, which electronic module 11 can, for example, be configured in the form of a wristwatch or can be wearably fastened to the body in a different manner. Said electronic module 11 can in particular be configured as a so-called smart watch 12 that can comprise a screen having a touchscreen function to be able to input control commands for the crane.

[0057] Control interfaces that permit the input of control commands can be displayed on the screen on said tablet computer 3 and on the additional smart watch 12, that can optionally also be configured as a cellphone, by importing corresponding software modules. Respective touchscreen display means 13 in the form of graphical symbols such as arrows, pictograms, or letters and/or numerical symbols can be displayed on the screen 4 of the tablet computer 3 and on the screen of the smart watch 12 and trigger a corresponding control command on being touched by a finger or by a part of the hand, as is known per se as a touchscreen technique.

[0058] However, in this respect, not only said control commands or the touchscreen display means 13 representing them are displayed on the tablet computer 3, but advantageously also an actual image of the machine environment or working environment and/or a virtual representation of the working environment or of the building to be erected and/or of other elements or pieces of information helpful for the work process.

[0059] As FIG. 3 shows, the tablet computer 3 is connectable for this purpose via said router 10 to a BIM, that is to a so-called construction site information model, that can be stored in the control processor 9 or that has access to the control processor 9. The tablet computer 3 can optionally also communicate directly with said construction site information model while bypassing the router 10. Corresponding digital building information and/or construction site information or other relevant digital information that can be displayed on the screen 4 of the tablet computer 3 can be imported to the tablet computer 3 via a corresponding data interface from the construction site information model BIM. Virtual representations of the building to be erected and/or of the working environment of the crane can in particular be displayed with reference to the BIM data.

[0060] Alternatively or additionally to such a virtual representation, however, a real camera-generated representation of the crane environment and/or of the lifting hook can also be used at the tablet computer 3. At least one camera whose live images are transmitted to the tablet 3 can be installed at the crane 200 for this purpose. Such a camera 220 can, for example, be installed at the crane operator's cab of the remote controlled crane 200 and can advantageously have at least approximately an axis of view that corresponds to the axis of view of a crane operator in the crane operator's cab and/or that goes from the crane operator's cab to the lifting hook.

[0061] Alternatively or additionally, however, different cameras and/or representations can be recorded from different perspectives and can be transmitted to the tablet computer 3 to be displayed there. An aerial drone can in particular be used that is equipped with at least one camera and that can be moved by remote control relative to the crane 200.

[0062] To be able also to see the lifting hook that can be connected to a hoist rope running down from the trolley or a load received thereat or the environment of the lifting hook 208 when the lifting hook 208 is outside the range of vision of the crane operator's cab or of the crane operator, for example whenas FIG. 1 showsthe load is to be placed down behind a building, an aerial drone 209 is provided in accordance with the invention at which at least one camera 210 is installed by means of which a camera image of the lifting hook 208 and/or of the lifting hook environment can be provided. Said camera image is advantageously a live image or a real-time image in the sense of a TV image or video image and is wirelessly transmittable from the camera 220 of the aerial drone 209 to the display of the tablet 3.

[0063] The aerial drone 209 is provided with a remote control device 212 that permits the aerial drone 209 to be remote controlled, in particular the flight control units such as rotor blades to be controlled to remote control the flight position of the aerial drone 209 and/or to remote control the camera 220, in particular with respect to the panning angle or the viewing axis of the camera 220 relative to the body of the aerial drone 209 and/or the focal length of the camera 220.

[0064] A corresponding remote control module can be provided in the mobile operating unit 2. The tablet computer 3 can in particular have an invokable control menu for the aerial drone 209 by means of which the flight position of the aerial drone 209 relative to the crane 200, in particular relative to its trolley, can be controlled. For example, a desired position relative to the trolley and/or relative to the lifting hook then independently held by the aerial drone 209 can be input via corresponding touchscreen control elements.

[0065] To enable a simple operation however, a voice control and/or a selection menu control can also be provided for the aerial drone 209, for example to select a desired relative position from a plurality of predefined relative positions of the aerial drone 209 relative to the crane. This can be done, for example, in that drone position 1 is input by voice control and/or by menu control that can be stored in a preprogrammed or predetermined manner in the position control apparatus 213.

[0066] The tablet computer 3 is advantageously configured to select a desired camera image from a plurality of provided camera images.

[0067] Virtual representations that are generated with reference to the digital data imported from the construction site information model BIM can be faded into the respective selected camera image that is displayed on the screen of the tablet computer 3 by fade-in and/or by image assembly so that the screen of the tablet computer 3 equally displays the real actual image that is provided by a camera and, faded therein, virtual representation elements of the working environment such as a building contour.

[0068] As FIG. 7 shows, touchscreen display means 13 for inputting control commands can furthermore also be faded into the image shown on the screen of the tablet computer 3, with zoom control means being shown in the example of FIG. 7 shown for zooming in on the shown lifting hook 208 or for changing the focal length and/or field of view of a camera.

[0069] If the remote-controlling machine operator wants to adjust or travel a machine part, for example to raise or lower the crane hook 208 shown on the screen in FIG. 7, the tablet computer 3 can, for example, be configured such that a tapping of a marginal screen bar causes the available control commands to be displayed in the form of a control window that expands outward or pops up. Touchscreen display means 13 such as travel arrows in specific directions can be displayed therein and tapping them then causes a corresponding travel.

[0070] Alternatively or additionally, the tablet computer 3 can also be configured to have the machine element to be adjusted or to be traveled identified by tapping the screen of the tablet computer 3 and then to generate a corresponding control command by dragging or pushing the tapped image element on the screen. The lifting hook 208 shown on the screen of the tablet computer 3 in FIG. 7 can, for example, be tapped, which the tablet computer 3 interprets as a desire for a positional adjustment of the lifting hook. If then, for example the finger tapping the lifting hook, swipes up or down on the screen of the tablet computer, the tablet computer 3 can interpret this as a desire for an upward or downward adjustment and can generate a corresponding control command. Such a swiping technique permits a particularly intuitive operation of the machine to be remote controlled.

[0071] Alternatively or additionally to such a control command generation on the tablet computer 3, the machine operator can also input a corresponding control command via the aforesaid smart watch 12.

[0072] As FIG. 3 shows, the remote control device 1 can work in direct association with a machine to be remote controlled, with in this case the tablet computer 3 and the possibly present electronic components 11 being able to communicate with the control apparatus of the respective machine via said router 10.

[0073] As FIGS. 5 and 6 show, a plurality of remote control devices can, however, also work in a networked manner with one another to be able to remote control a plurality of machines such as the cranes 200 of a construction site, with six cranes being able to be controlled by means of three remote controls 1, for example. A plurality of cranes can be accessed by one remote control 1 for this purpose via the network by which the remote controls 1 are networked with the cranes. For this purpose, the respective tablet computer 3 can, for example, comprise a selection menu by means of which one of a plurality of cranes that are connected to the network can be selected, whereupon the control commands generated at the tablet computer 3 are sent to the selected crane.