A REMOTE-CONTROLLED DEMOLITION ROBOT WITH IMPROVED FIELD OF APPLICATION AND A METHOD TO ACHIEVE SUCH A DEMOLITION ROBOT

Abstract

The invention relates to a remote-controlled demolition robot (1) with improved field of application, comprising a chassis (5), a base (7) and a rotatable top (6), a moveable arm means (13), a working tool (13f), a control unit (9), a remote-control device (4, 40) intended to be impacted by an operator (3, 3′) of the demolition robot and arranged to give commands that can be registered by the control unit for operation of the remote-controlled demolition robot. A characteristic is that the demolition robot comprises a broadcasting device (20) and an image reproduction means (30), an image sensor (22:1), which can register first image data (21:1) and second image data (21:2) of a scene of surroundings of the demolition robot from at least two different view directions, that the broadcasting device (20) can communicate with the image reproduction means (30) and that the image reproduction means (30) is arranged to show, in real time, an image area (30a) of said scene to an operator (3′), who with a line thereto can control and operate the demolition robot through indirect viewing, the image sensor (22:1) is arranged to the demolition robot in such a manner that part of the working tool (13f) is visible in the image area.

Claims

1. A remote-controlled demolition robot, comprising, a chassis with a travelling base and a rotatable top in a horizontal plane, a moveable arm means in a vertical plane, which is suspended on the top, a working tool suspended in the arm organ, a control unit, a remote-control device intended to be impacted by an operator of the demolition robot and arranged to give commands that can be registered by the control unit and which cause the control unit to control the operation of the remote-controlled demolition robot (1), a broadcasting device and an image reproduction means, and a first image sensor respectively a second image sensor placed in each sides of the vertical plane in which the arm means is moveable, wherein each image sensor is directed towards the working tool, which is attached in the arm means' end, the first image sensor is placed on one side of the vertical plane, in which the arm means is moveable, wherein the first image sensor can register first image data and second image data of a scene of surroundings of the demolition robot from at least two different view directions, and correspondingly, the second image sensor can register first image data respectively second image data from a scene on the other side of the vertical plane, the broadcasting device can communicate with the image reproduction means, and the image reproduction means is arranged to show an image area of said scenes in real time for an operator, who with a line thereto can control and operate the demolition robot through indirect viewing and that the image sensors are arranged to the demolition robot so that at least part of the working tool is visible in said image area.

2. The remote-controlled demolition robot according to claim 1, wherein the image area forms a spatial three-dimensional scene, which can be seen by the indirectly viewing operator in the image reproduction means.

3. The remote-controlled demolition robot according to claim 1, comprising a central unit with software that allows said first image data and second image data to be superposed for generation of the image area corresponding to said scenes.

4. The remote-controlled demolition robot according to claim 1, wherein the broadcasting device is located on board the demolition robot, while the image reproduction means is located outside the demolition robot.

5. The remote-controlled demolition robot according to claim 1, wherein the broadcasting device comprises a unit for wireless communication with the image reproduction means.

6. The remote-controlled demolition robot according to claim 5, wherein the broadcasting device's wireless communication comprises a wireless short-range data communication unit.

7. The remote-controlled demolition robot according to claim 1, wherein the image sensors for registration of said first and second image data comprise a 3D image sensor unit or an image sensor unit, which is susceptible to IR radiation.

8. The remote-controlled demolition robot according to claim 1, wherein the image reproduction means comprises following means; one or a plurality of display screens, VR headsets, a hand-held computing device, a so-called smartphone.

9. The remote-controlled demolition robot according to claim 1, comprising a camera control unit with which the image sensors' view of the scene for reception of said first image data and second image data can be varied through adaptation of at least one of the following parameters; view direction, panning, zoom.

10. The remote-controlled demolition robot according to claim 1, wherein the remote-control device comprises a transmitter unit and a receiver unit, levers and regulation, which can be impacted by the indirectly viewing operator and give commands, which can be registered by the demolition robot's control unit to control the operation of the remote-controlled demolition robot.

11. The remote-controlled demolition robot according to claim 9, wherein the remote-control device comprises a transmitter unit and a receiver unit, levers and regulation, which can be impacted by the indirectly viewing operator and give commands, which can be registered by the demolition robot's camera control unit and allow advanced image sensor control by one of the following controls: direction guide, panning/tilt, zoom.

12. The remote-controlled demolition robot according to claim 1, wherein the image reproduction means comprises software arranged for the operator to graphically present a first user interface zone, in which the image area corresponding to said scenes can be shown.

13. The remote-controlled demolition robot according to claim 1, wherein the image reproduction means comprises software arranged for the operator to graphically present a second user interface zone, in which a touch surface is included with which the operator can give commands that can be registered by the control unit, and which cause the control unit to control the operation of the remote-controlled demolition robot.

14. The remote-controlled demolition robot according to claim 9, wherein the image reproduction means comprises software arranged for the operator to graphically present a third user interface zone with which the operator can give the commands that can be registered by the camera control unit and which makes it control and operate the image sensor devices' view direction.

15. The remote-controlled demolition robot according to claim 1, wherein the image sensors are located at a front end of the demolition robot's rotatable top and have a pair of lenses that are directed in the arm means' longitudinal direction forward.

16. The remote-controlled demolition robot according to claim 1, wherein the image reproduction means comprises red-green 3D glasses, which can be used by the operator.

17. A method to achieve a demolition robot according to claim 1, wherein the following operational steps are performed; the demolition robot is connected to a remote-control device, the transmitter unit and receiver unit of which enable bi-directional communication, this bi-directional communication is selected in such a manner that it allows image data to be transmitted wirelessly from surroundings of the demolition robot to an image reproduction means located outside the demolition robot, by which an operator can control and operate the demolition robot through indirect viewing.

Description

[0014] In the following, an exemplary embodiment of the invention is described in further detail with reference to the accompanying drawing, in which;

[0015] FIG. 1 schematically shows a block diagram of a control and operating system in an embodiment for transmission of image data for 3-dimensional reproduction of scenes and objects between a transmitter and a receiver, and which can be included in an demolition robot with improved field of application according to the present invention,

[0016] FIG. 2 shows a view from the front of a carrier for an image sensor device, which offers indirect viewing and which is included in a demolition robot according to the present invention,

[0017] FIG. 3 shows a plane view of optical axes and the field of vision for a scene to the right and the left, respectively, when receiving image data from a first respectively a second image sensor located on either side of a vertical plane about which an arm means constituent in the demolition robot is moveable,

[0018] FIG. 4 schematically shows a block diagram of a control and operating system in an alternative embodiment and transmission of image data for 3-dimensional reproduction of scenes and objects between a transmitter and a receiver, and which can be included in an demolition robot with improved field of application according to the present invention,

[0019] FIG. 1 shows a generally denoted 1 mobile electrically powered wrecking and demolition robot, in the following called demolition robot 1. The demolition robot 1 is normally intended to be controlled and operated by an operator 3, who walks beside the demolition robot and remote-controls it via a radio link (mobile network) by means of a remote-control device, comprising a transmitter unit 4a, which is normally located outside the demolition robot 1. The remote-control device also includes a receiver unit 4b, which is normally located on board the demolition robot 1. The operator 3 can thus, during broadcasting of control signals, constantly be at an adequate safety distance from the working area of the demolition robot. The operator 3 can move freely around the demolition robot and constantly seek suitable areas that give the operator a good overview of the work of the demolition robot.

[0020] The demolition robot 1 generally comprises a chassis with a carriage 5 with a top 6 and a base 7. The demolition robot 1 has a rotation device, with which the top 6 is twistably bedded on the base 7 for swinging in a horizontal plane about a vertical axis 6A, which is shown in FIG. 3. On the carriage 5, a robot control unit 9 is sustained with which the receiver unit 4b of the remote-control device is connected. Through the impact of the remote-control device's transmitter unit 4a, the operator 3 can give the demolition robot commands that can be registered by the robot control unit 9 and which cause the robot control unit to control the operation of the remote-controlled demolition robot 1.

[0021] The carriage base 7 is provided with a propulsion device comprising right respectively left tracks 9. Support legs are denoted 12 and are operated by associated hydraulic cylinders, and an operable arm means is denoted 13, is sustained on the top 6 and is operable in a vertical plane 1B by means of hydraulic cylinders, see also FIG. 3. The arm means 13 includes a boom 13a, an operating arm 13b and a operating link 13c located farthest out on the arm means.

[0022] A cable is denoted 15 and is intended to be connected to a stationary electric network to provide the demolition robot 1 with electric power.

[0023] The arm means 13 is at its free end provided with a tool attachment 13e, in which various types of working tools 13f can be removably arranged and optionally also be connected for hydraulic operation. The working tool 13f can be activated for operation by means of the remote-control device 4.

[0024] Everything described above is essentially already known.

[0025] According to the invention, it is desired to improve the field of application of the demolition robot. Substantially by enabling an operator to control and operate the work of the demolition robot without the operator having to be in the surroundings of the demolition robot. With the invention, surroundings of the demolition robot 1 can be presented to an indirectly viewing operator in such a manner that the operator in practice can perform desired work tasks. In the following an indirectly viewing operator is denoted 3′ to be distinguished from a normally operating directly viewing operator 3.

[0026] There can be a number of various needs for indirect viewing and the possibility of operating without the demolition robot and/or its surroundings being directly visible, for instance for work in health-harmful or particularly dangerous environments.

[0027] According to the invention, the demolition robot 1 also comprises a broadcasting device 20 for image transmission and an image reproduction means 30, with which surroundings of the demolition robot can be presented to the indirectly viewing operator 3′, who by a line thereof can control and operate the demolition robot, The broadcasting device 20 can suitably be located on board the demolition robot 1 and be integrated in said receiver portion 4b, which implies that, unlike a known demolition robot, communication between the transmitter/receiver will in part be bi-directional as illustrated with double arrows in the block diagram in FIG. 1.

[0028] The remote-control device's transmitter unit 4a located outside the demolition robot sends out control signals and commands to the receiver unit 4b on board the demolition robot 1, while the broadcasting device 20 transfers images to the image reproduction means 30 outside the demolition robot. The broadcasting device 20 is preferably in wireless connection with the image reproduction means 30. The image reproduction means 30 is located outside the demolition robot 1 and can, but should not necessarily, be hand-held.

[0029] The demolition robot 1 furthermore includes an image sensor 22:1, which comprises a first lens, which can register first image data 21:1 and a second lens, which can register second image data 21:2 of a scene of the surroundings. Each lens can thus register a specific scene from two different view directions in the manner illustrated in FIG. 3.

[0030] The image sensor 22:1 is hereby so arranged on board the demolition robot's 1 rotatable top 6 that at least part of the working tool 13f is stereoscopically visible in said scene of registered image data. The image sensor device 22:1 can be connected with a central unit (CPU), which comprises software, in which said first and second image data 21:1, 21:2 can be superposed to generate a stereoscopic image area, which corresponds to said scene.

[0031] As said image data 21:1, 21:2 comprises a scene with different camera perspectives, the operator 3′ can perceive the scene as spatial and with depth as the scene is viewed with both eyes. For the sake of clarity, it can be mentioned that the left respectively right eye will hereby see different images, which the viewer will perceive. Glasses 30b, which can filter out either colours red/green or polarization of the light (horizontal/vertical) in corresponding images for the left respectively the right eye can be included in the demolition robot and be used for the operator 3′ to experience stereoscopic vision or so-called 3D effect.

[0032] In a first embodiment, the demolition robot 1 can be equipped with a single image sensor 22:1, which can suitably be placed at a front end of the demolition robot's 1 rotatable top 6 and having a pair of lenses, which are directed forward in the longitudinal direction of the arm means 13. Such a first image sensor 22:1 can thus be placed on the one side of the vertical plane 1B, in which the arm means 13 is moveable.

[0033] In a second embodiment, the demolition robot 1 can be equipped with two separate image sensors 22:1, 22:2, placed at a front end of the demolition robot's 1 rotatable top 6 and directed forward in the longitudinal direction of the arm means 13. More specifically, a first image sensor 22:1 respectively a second image sensor 22:2 can hereby be placed on either side of the vertical plane 1B, in which the arm means 13 is moveable, whereby each image sensor is directed towards the working tool 13f, which is attached to the end of the arm means 13.

[0034] As most clearly appears from FIG. 3, the demolition robot 1, at a front end of the rotatable top 6, is equipped with a first image sensor 22:1 on the right side (R) and a second image sensor 22:2 on the left side (L) of the vertical plane 1B in which the arm means 13 is moveable. As the image sensors 21:1, 21:2 are placed on either side of the said vertical plane 1B, and indirectly viewing operator 3′ can obtain image data 20:1, 20:2 in real time, a scene from each side of the arm means 13 of the demolition robot 1.

[0035] As shown in FIG. 2, each image sensor 22:1, 22:2 can be equipped with built-in light sources 22a, for instance of the LED type.

[0036] FIG. 2 also illustrates in more detail how each image sensor 22:1, 22:2 can be placed on a so-called gimbal 23 and through the operation of which each image sensor is twistable in a horizontal plane about a first axis 18 as well as twistable in a vertical plane about a second axis 19. Each of said degrees of freedom for setting and control of the image sensors 21:1, 21:2 can be performed by an indirectly viewing operator 3′ via the remote control's 40 transmitter/receiver units 4a, 4b.

[0037] Alternatively, as shown in FIG. 4 via a smartphone 34, which will be described in more detail below. It should be understood that a smartphone equipped with suitable application programs and touchscreen (pekskarm in Swedish) can be used for camera control.

[0038] FIG. 3 illustrates in a plane view of optical axes and the field of vision for a scene to the right respectively a scene to the left of the arm means 13 of the demolition robot 1. Hereby the first image sensor 22:1 receives first respectively second image data 21:1 21:2 from a scene to the left of the arm means 13. Correspondingly, the second image sensor 22:2 receives first respectively second image data 21:2, 21:2 from a scene to the left of an arm means 13. Received image data can via data processing generate an image area, which in the form of a spatial three-dimensional scene that can be viewed by the indirectly viewing operator 3′ and in which image area at least part of the working tool 13Bf is visible.

[0039] 3D is short for three-dimensional and is the space perspective, in which length, width and depth can be registered. A 3D camera relates to an image sensor, wherein each such sensor unit comprises at least two camera modules (lenses) in mutually displaced perspective in order to take two-dimensional images. Unlike a conventional camera, a 3D camera also takes depth information and thereby generates three-dimensional image data with distance or distance values for the individual pixels in the 3D image. 3DTV is technology for television, which can transfer a three-dimensional moveable image. A number of various presentation devices for an operator in case of indirect viewing are known, for instance 3DTV technology and stereoscopic virtual retina display (VRD), retinal projectors (nathinneprojektor in Swedish) not shown, or VR headsets 30c.

[0040] FIG. 3 shows a first respectively second image sensor 22:1, 22:2 placed so that each image sensor, for accumulation of first and second image data 21:1, 21:2, has a view direction or line of sight, which is directed along the arm means 13 at any angle towards this with an imaginable common target position towards a free end of the working tool 13f attached to the arm means′ 13 tool attachment 13e. In real time, indirect viewing is created in a virtual environment. The operator 3′ can be in an optional physical place, which is different from the image sensors 22:1, 22:2, but experience it as if the person is virtually in the same place as said image sensors.

[0041] For the indirectly viewing operator 3′ to have a good perception of the surroundings, they should be presented to the operator in the form of a 3D image in as large a field of vision as possible, for instance by means of one or a plurality of large display screens 30a. As regards stereo-photographic 3DTV two images are thus shown, one for each eye. Thus, red-green 3D glasses 30b can be used together with a usual 2DTV screen. The glasses 30b show a red image for one eye and a green image for the other eye. Practical experiments with a demolition robot 1 have shown that stereo-photographic 3DTV that shows two images, one for each eye, in combination with red-green 3D glasses and an ordinary 2DTV screen function very well and without it becoming significantly tiresome for an indirectly viewing operator 3′.

[0042] It is essential that an indirectly viewing operator 3′ can search the surroundings, not just straight ahead but also to the sides of the demolition robot 1. For this purpose, each image sensor 22:1, 22:2 can be of the type that offers advanced image sensor control, for instance of the so-called pan/tilt type with zoom-in function. This type of camera can thus partly be placed on said gimbal 23, partly, through said pant/tilt features, be capable of zooming in and thus for instance follow an object that moves.

[0043] Again, with reference to FIG. 1, the block diagram shows in more detail a basic drawing of an embodiment of the invention, which gives a demolition robot improved field of application.

[0044] As stated above, the demolition robot 1 comprises an image reproduction means 30 for reproduction of a 3D image for the indirectly viewing operator 3′ of a scene with image data 21:1, 21:2 captured by the image sensor 22:1. A remote-control device 40 with a transmitter unit 4a and a receiver unit 4b of the kind described above comprises levers and regulation 9a, which can be impacted by an indirectly viewing operator 3′ and give the command, which can be registered by the demolition robot's 1 control unit 9 to control the operation of the remote-controlled demolition robot.

[0045] In an alternative embodiment, the demolition robot 1 comprises a camera control unit 25. The remote-control device 40 thus comprises levers and regulation 25a for control of each image sensor 22:1 included in the demolition robot 1. The control can relate to advanced image sensor control, for instance of the so-called pan/tilt type with zoom-in function as described above. The remote-control device's 40 transmitter unit 4a located outside the demolition robot, thus sends out control signals commands to the receiver unit 4b on board the demolition robot 1, which in turn leaves said control signals and commands to the robot control unit 9 and/or the image sensor control unit 25. At the same time, the broadcasting device 20 located on board can transfer images to the image reproduction means 30 located outside the demolition robot, which in real time can be seen by the indirectly viewing operator 3′. The broadcasting device 20 is preferably in wireless connection with the image reproduction means 30.

[0046] FIG. 4 schematically shows a block diagram of a control and operating system in an alternative embodiment, wherein at least one of the remove-control device 40 or the broadcasting device 20 and the image reproduction means 30 comprises technology that offers bi-directional wireless short-range communication. Wireless short-range communication means cheap short-range technology such as WPAN technology (Wireless Personal Area Network), Wi-Fi or Bluetooth, which usually does not depend on a third-party operator. Hereby, at least the image reproduction means 30 could be constituted by a hand-held unit, a so-called smartphone 34 or tablet, which can communicate bi-directionally with short-range communication. Correspondingly, the broadcasting device 20 located on board is a unit which can communicate bi-directionally with the short-range communication.

[0047] A smartphone 34 can be equipped with suitable software that is constituted by a so-called application or so-called app, which enables an indirectly viewing operator 3′, via said image sensors 20:1, 20:2, to obtain image information in real time about the surroundings of the demolition robot 1 as well as give commands that can be registered by a control unit 9 included in the demolition robot 1 to control the operation of the remote-controlled demolition robot.

[0048] The system hereby utilizes the wireless communication units, which are already installed in a smart mobile phone or tablet. In the following, the expressions smartphone, mobile phone or tablet relate to hand-held computers, “smart mobile phones”, slate computers and information screens and similar appliances with touch screens that can function for input of data and/or commands, so-called in units.

[0049] The smartphone 34 can thus comprise a suitable first user interface area 34A, which in real time shows a 3D image based on image data from a first image sensor 22:1. By a suitably configured second user interface area 34B of the smartphone 34A, the indirectly viewing operator 3′ can give commands that can be registered by the demolition robot's remote-control unit 9 to control the operation of the remote-controlled demolition robot. In the latter case, a central processing unit CPU constituent in the demolition robot 1 can be connected to a primary Wi-Fi unit, which can exchange both input and output with the secondary Wi-Fi unit included in said smartphone 44.

[0050] In an alternative embodiment, it is worth considering that the image reproduction means 30 comprises software arranged for the operator 3′ to graphically present a third user interface zone 34C with which the operator can give commands that can be registered by a camera control unit 25 and which makes it control and operate the image sensor device's 22:1 view direction and/or panning and/or zoom.

[0051] In another embodiment, the software can be configured so that it enables the operator 3′ to operationally at the same time show and use two in combination of each of the first, second or third user interface zones 34A, 34B, 34C mentioned above.

[0052] The demolition robot 1 can thus be controlled by means of a smartphone 34 via suitable software, i.e. an application program and a touch or click surface 34B in another user interface area 34B on said smartphone 34. By means of red-green 3D glasses 33, the indirectly viewing operator 3′ can look at the images in the smartphone 34, wherein said glasses can convert the 2D images on the smartphone's 34 screen 34A phone 3 into a 3D image.

[0053] It is worth considering that the communication between the broadcasting device 20 and the image reproduction means 30 can comprise a fixed or stationary environment, for instance a wired network or cable, but it should be understood that the wireless environment described above in comparison has completely different pre-conditions than a stationary environment.