ROBOTIC REPAIR SYSTEM

Abstract

An integrated robotic repair system for repairing a surface is described. The said system comprising: a base translation system (110), said system comprising a multistage platform; a repair module (150), said module coupled to the translation system (110) to move the module (150) relative to the base translation system (110); an end effector selector system coupled to the repair module, said selector system comprising end effector repair tools (360, 362, 366), each tool (360, 362, 366) configured to undertake a repair task on the surface; and deployable legs (120), said legs (120) coupled to the base translation system (110) and configured to engage and disengage from the surface to allow the system to walk along surface.

Claims

1. An integrated robotic repair system for repairing a surface, said system comprising: a base translation system, said system comprising a multistage platform; a repair module, said module coupled to the translation system to move the module relative to the base translation system; an end effector selector system coupled to the repair module, said selector system comprising end effector repair tools, each tool configured to undertake a repair task on the surface; deployable legs, said legs coupled to the base translation system and configured to engage and disengage from the surface to allow the system to walk along surface.

2. The system of claim 1, wherein the deployable legs comprise attachment means for releasably engaging the repair system to the surface.

3. The system of claim 2, wherein the attachment means comprise suction discs.

4. The system of claim 3, wherein the suction discs comprise a plurality of suctions cups, said cups provided between an inlet sealing block and a contact surface sealing block.

5. The system of claim 4, wherein the suction cups are configured to engage the surface by compressing the inlet sealing block towards the contact surface sealing block.

6. The system of any one of claims 2 to 5, wherein the multistage platform comprises a first translation stage and a second translation stage, wherein the repair module is coupled to the first translation stage and is translatable in a first single axis.

7. The system of claim 6, wherein the first translation stage is coupled to the second translation stage and is translatable in a second single axis perpendicular to the first axis.

8. The system of any one of claims 2 to 7, wherein the deployable legs are hingedly attached to the attachment means.

9. The system of any preceding claim, where the surface may be a flat or curved surface.

10. The system of any preceding claim, wherein the repair module comprises a repair arm, said repair arm extending within the base translation system to present the end effector repair tool on the surface.

11. The system of any preceding claim, wherein the repair arm comprises a rotary tool selection system, said system rotatable to allow the desired end effector repair tool to be presented to the surface.

12. The system of any preceding claim, wherein the end-effector repair tools comprise a cleaning end-effector for performing a cleaning task.

13. The system according to claim 12, wherein the cleaning end-effector comprises: a controllable dispenser for metering cleaning liquid; and a rotary cleaning device driven by a motor.

14. The system of claim 13, wherein the controllable dispenser further comprises: a metering motor for actuating the dispenser, and wherein position information from the motor and metering motor allow control of a release rate of the cleaning liquid to the rotary cleaning device and a rotational speed of the rotary cleaning device according to the cleaning task.

15. The system according to any preceding claim, wherein the end-effector repair tools comprise a sanding end-effector for performing an abrasive task.

16. The system according to claim 15, wherein the sanding end-effector comprises a rotary sanding device driven by a motor.

17. The system according to any preceding claim, wherein the end-effector repair tools comprise a filler deposition end-effector for performing a filling task.

18. The system according to claim 17, wherein then filler deposition end-effector comprises: an active mixer for mixing filler, said active mixer comprising a motor; a nozzle for applying the filler to the blade according to the filling task, wherein the nozzle is a soft slit nozzle that conforms to the curvature of the blade; and a proximity sensor for measuring a deposition thickness of the filler and to interrupt the motor once a desired thickness according to the filling task is reached.

19. The system of any preceding claim, wherein the repair module comprises a series of joints for moving manoeuvring the repair module relative to the base translation system, and wherein the system further comprises a toolbox for storing the plurality of end effector repair tools; and wherein the repair module comprises a tool change mechanism located at a terminal end and configured to retrieve the repair tools from the toolbox and install them onto the module.

20. The system according to claim 19, wherein the toolbox comprises a retractable end-effector tool holder, said holder comprising resiliently biased jaws for holding one of the end-effector repair tools.

21. The system according to any preceding claim, wherein the system further comprises a casing for housing the toolbox, control electronics and any repair tool materials.

22. The system of claims 19 to 21, wherein the repair module comprises a mounting mechanism for installing the robotic repair system to a mobile robotic platform.

23. The system of claims 19 to 22, wherein the mobile robotic platform is an unmanned aerial vehicle or a crawler.

24. The system of claims 19 to 23, wherein the system further comprises a vacuum mounting for mounting the system to a surface.

25. The system of claims 19 to 24, wherein the plurality of joints comprise revolute joints, each revolute joint providing a rotational degree of freedom for the terminal end of the arm.

26. The system of claims 19 to 25, wherein the repair arm comprises a plurality of linkages, and wherein each revolute joint connects two linkages together.

27. The system of claim 26, wherein the repair arm comprises 5 revolute joints.

28. The system according to any of claims 19 to 27, wherein end-effector repair tools comprise a female connector and the tool change mechanism comprises a corresponding male connector for releasably retaining the end-effector repair tools.

29. The system according to claim 28, wherein the male connector is configured to retract to receive the female connector on the end-effector repair tool and is configured to extend to engage the female connector.

30. The system according to any preceding claim, further comprising one or more cameras for wirelessly transmitting visual images of performance of the repair system to a remote user.

31. The system according to any preceding claim, wherein the repair system comprises an imaging camera, and wherein the system comprises an image processing module for examining the surface for defects; and optionally or preferably wherein the system begins a repair task autonomously upon detection of defect.

32. The system according to any preceding claim, wherein the repair system is covered in a flexible protective sleeve; and optionally or preferably wherein the sleeve comprises one or more sleeve sensors configured to detect sheer strain in the sleeve indicative of the repair module being configured in a damaging orientation.

33. The system according to any preceding claim, further comprising a user interface for providing wireless control commands to the repair module by a remote user for transferring the remote user's tacit knowledge of the robotic repair process.

34. The system according to claim 33, further comprising a remote motion imitator for imitating movement of the remote control commands in a model of the repair module.

35. The system according to any preceding claim, wherein movement of the repair module through space is determined using one or more sensors.

36. The system of claim 35 wherein the sensor includes a collision detection sensor for detecting deleterious contact between the repair module and the blade and optionally or preferably wherein the collision detection sensor is an encoder on a motor of the system.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0049] Embodiments will be described, by way of example only, with reference to the drawings, in which

[0050] FIG. 1 illustrates an offshore wind turbine having a turbine blade and a robotic repair system according to the present invention as installed in a repair robot placed on the blade;

[0051] FIG. 2 shows the robotic repair robot of FIG. 1;

[0052] FIG. 3 shows the robotic repair system of FIGS. 1 and 2;

[0053] FIG. 4 shows a casing unit and a toolbox of the repair system of FIG. 3;

[0054] FIG. 5 shows a retractable end-effector tool holder of the toolbox of FIG. 4 used to hold end-effector repair tools;

[0055] FIG. 6 shows an tool change mechanism for retrieving end-effector repair tool from the tool holder of FIG. 5;

[0056] FIG. 7 shows a sanding end-effector for use with the robotic repair system of FIG. 3;

[0057] FIG. 8 shows a cleaning end-effector for use with the robotic repair system of FIG. 3;

[0058] FIG. 9 shows a filler end-effector for use with the robotic repair system of FIG. 3;

[0059] FIG. 10 shows a spatula end-effector for use with the robotic repair system of FIG. 3;

[0060] FIG. 11 shows a tape dispenser end-effector for use with the robotic repair system of FIG. 3;

[0061] FIG. 12 shows a motion imitator and user interface for replicating movement of the robotic repair system of FIG. 3;

[0062] FIG. 13 illustrates a control system for controlling the robotic repair system of FIG. 3;

[0063] FIG. 14 illustrates a control system for the motion imitator and user interface of FIG. 12;

[0064] FIGS. 15a-15e show a typical repair process enacted by the repair arm of FIG. 3; and

[0065] FIG. 16a shows a structure of a ROSIC network;

[0066] FIG. 16b shows a ROSIC based telecommunication for the applied ROS based manipulator;

[0067] FIG. 16c shows a ROSIC Internet based communication system structure;

[0068] FIG. 16d shows an experiment test to control a manipulator based on Internet and online video streaming from it the imitator LCD;

[0069] FIG. 16e illustrates Latency between the send and receive the command between the console and the manipulator in different hours of day

[0070] FIG. 17a illustrates a robotic system according to an embodiment of the present invention having legs in a deployed position;

[0071] FIG. 17b illustrates the repair system integrated with the legs;

[0072] FIG. 17c shows the repair system components of FIG. 17b;

[0073] FIG. 18 shows the system of claim 17a in a compact position;

[0074] FIG. 19a shows a spatula end effector tool;

[0075] FIG. 19b shows a sander end effector tool;

[0076] FIG. 20a shows a leg having attachment means used with the system of FIG. 17; and

[0077] FIG. 20b shows an exploded view of the attachment means.

[0078] It should be noted that the Figures are diagrammatic and not drawn to scale. Relative dimensions and proportions of parts of these Figures have been shown exaggerated or reduced in size, for the sake of clarity and convenience in the drawings. The same reference signs are generally used to refer to corresponding or similar feature in modified and different embodiments.

DETAILED DESCRIPTION OF EMBODIMENTS

[0079] FIG. 1 illustrates an offshore wind turbine 1 with a repair robot placed on a blade 2 of the wind turbine. FIG. 2 shows a close-up of the repair robot, in this instance a crawling robot 3. It can be appreciated that the repair robot may be an alternative mobile platform, such as an unmanned aerial vehicle. Attached to the crawling robot 3 is a robotic repair system 4. The repair system 4 is shown in detail in FIG. 3. In particular, the system 4 comprises a casing unit that houses components of the repair system. A mounting mechanism, in this instance a pump vacuum suction cup 5, for installation of the repair system to flat surfaces is shown. This can be used to anchor the system. The casing unit houses materials, dispensing mechanisms and electronics 6. Also shown is a toolbox 14 that holds a plurality of end-effector repair tools (described below).

[0080] Cameras 7, typically Wi-Fi cameras are used to monitor performance of the system and to provide real-time feedback to a remote user of the motion and movement of the repair system. The repair system comprises a repair module, such as a repair arm 8 and a tip 9 having an end-effector tool change mechanism 13 that is configured to retrieve repair tools from the toolbox and to install them onto the terminal end of the arm. Also shown is a stepper motor 10 and a servo-motor 11 that are linked by joints 12.

[0081] FIG. 4 shows a closer view of the casing unit. The unit comprises a cap plate 15, computing electronics 16, 17 and a number of end-effector repair tools. In particular, a cleaning end-effector repair tool 18 held within a retractable end effector tool holder 19. Additional repair tools may be held in other end-effector tool holders 19, such as a protective tape end-effector repair tool 20.

[0082] The casing unit may form a three layer cluster case structured with a top layer 15 that is integrated with the mounting mechanism 5 for arm attachment, a middle layer housing the electronics 16, 17 for communication & control and material supply 24 and dispensing 25 mechanisms, and a base layer which accommodates the end-effector repair tools (toolbox layer). The electronics may be Arduino and/or Raspberry Pi boards or other system on a chip device. The lower layer accommodates retractable clamping end-effector tool holders 19 to hold the end-effector repair tools whilst not in use in the toolbox 14.

[0083] As will be described in further detail below, FIG. 4 further shows a female connector 21 attached to said repair tools, a sanding end-effector repair tool 22, a soft-tip slit nozzle filling end-effector repair tool 23, cleaning material dispensing mechanism 24 and repair filling dispenser 25.

[0084] FIG. 5 details the retractable end-effector tool holder 19 of the toolbox 14 of FIG. 4 used to hold end-effector repair tools. The holder 19 comprises a main body 26 and a compression spring 27 to resiliently bias two jaws together that are used to hold an end-effector repair tool therebetween. The jaws comprise a chamfered surface 29 that acts as a surface against which the tool change mechanism on the tip 9 of the repair arm may press to disengage the resilient bias of the jaws to access the retained end-effector repair tool. Use of a passive clamping solution (no electronics) minimises weight and power draw of the device.

[0085] FIG. 6 shows the end-effector tool change mechanism 13 (male connector): and features a connection 30 to a step motor, top 31 and bottom 33 housings for a retraction mechanism, compression spring 34 and flaps 32. In use, the tool change mechanism 13 is retracted using the step motor to bias the flaps against the compression spring 34. In this retracted configuration the mechanism is then inserted into a connector of the end-effector repair tool before being released such that the flaps expand due to the spring 34 to bias the flaps 34 outward. Due to the design of the connector of the end-effector repair tools, the flaps engage with surfaces and are too big to pass through the substantially U-shaped gap, engaging the tip 9 of the repair arm 4 with the repair tool. The repair tool may then be manipulated as desired, including by removing from storage within the toolbox, and/or used as intended to undertake a repair.

[0086] FIG. 7 shows the sanding end-effector repair tool 22 and details a U-shape connector 35 for latching onto the end-effector tool change mechanism in the manner described above, motor and gear box container 36, ball-bearing 37, and a rigid sanding drum covered by sand paper 38. The sanding drum is typically fabricated from rigid PLA materials and the drum's external surface is covered by a layer of sandpaper. In this embodiment two sanding drums with grits of 60 and 80, as advised by TEKNOBLADE REPAIR 9000-material application guidelines may be provided, although alternative grade grits may be selected as desired. In a similar design, the sanding drum may also be actuated by a DC Gear motor with Encoder (12 V, 500 rpm), which enables controlling the of rotation speed when required.

[0087] FIG. 8 shows a cleaning end-effector repair tool 24a. This forms a cleaning module in addition to cleaning material dispensing mechanism 24. The cleaning material dispensing mechanism is typically located in the upper level of the system and comprises a controllable dispenser, using a 15gr DC Micro Metal gear motor with Encoder (12V, 100 rpm), to automatically release cleaning liquid. This is fluidly connected using OD flexible tubing (4 mm) to a rotary cleaning end-effector repair tool 24a mountable at the tip 9 of the repair arm 4. The tool 24a a U-shape connector for latching onto the arm 39, motor and gear 40, position of the tubing for cleaning materials 41, and cleaning drum 43 as shown in FIG. 8. The drum is integrated into the casing structure via two metal ball-bearings 42. The cleaning drum 43 is typically covered by a soft microfibre cloth material with thickness of 1 mm at the surface, a 3 mm layer of silicone rubber materials in the middle and a rigid shaft at the centre. This mechanical stiffness-gradient architecture helps conformation of the roller drum 43 onto curved or damaged surfaces of the blade to clean them more effectively. The mechanical design of the drum 43 and the assembly constraints with its casing structure allow a maximum deformation curvature of =43 on the drum's external surface.

[0088] A DC gear motor with Encoder (12 V, 300 rpm) is in charge of moving the drum 43 via an integrated 3D-printed gear. The position information provided by the two motor encoders, within a cleaning liquid dispenser module and the cleaning end-effector repair tool, enables controlling the release-rate of the cleaning liquid to the microfiber material as well as the drum rotational speed to carry out an effective cleaning task. The maximum capacity of the cleaning material dispenser is typically 20 ml.

[0089] The position information provided by the two motor encoders, within the cleaning liquid dispenser module 24 and the cleaning end-effector repair tool 24a, enables controlling the release-rate of the cleaning liquid to the microfibre.

[0090] FIG. 9 shows a filling end-effector repair tool 25a that is part of a filler deposition module with the repair filling dispenser 25. This module is configured to dispense and mix material parts of a repair kit (such as the TEKNOBLADE REPAIR 9000-10 kit) and apply it to an identified damaged area, after completion of the sanding and cleaning tasks. Given that weight and moment arms should be minimised, a motorized active mixer is used. The module comprises three parts linked via 4 mm OD tubing and include a two-part material dispenser 25 driven by a DC gear motor (12V, 250 rpm) and equipped with an encoder, that are merged to a single tubing and fed into an active mixer. Subsequently, the mixed material is moved to a slit nozzle 44 that can conform to the surface geometry of the turbine blade 2, filler material container 45, U-shape latching connector 46, and a position for filler material supply 47.

[0091] According to the material's technical datasheet, the recommended film thickness of this material (a layer of deposition at time) is 2 mm. In order to ensure this, a proximity sensor which comprises of an optical head FU-69U (Keyence Co., Japan) and a fiber-optic sensor FS-N11MN at locations near the terminal end of the arm continuously measure the deposition depth and interrupt the process if the maximum thickness is exceeded.

[0092] FIG. 10 details a spatula end-effector repair tool for flattening of the surface: a spatula 48 and the U-shape connector 49 are shown. The spatula 48 acts to smooth filler material and to restore the geometrical shape of the turbine blade edge being repaired.

[0093] FIG. 11 shows a protective taping end-effector repair tool comprised of tape tensioning and cutting mechanisms: the U-shape connector 50, protective tape 51, solenoid motor for cutting 52, cutting blade head 53, tape moving roller 54, and dancer roller 55.

[0094] FIG. 12 shows a motion imitator and user interface according to an embodiment of the present invention. The repair system can include a plurality of cameras and/or sensors to track the movement of the repair arm and the associated end-effector repair tools. FIG. 12 utilises the visual and sensor information derived from the cameras/sensors to map the movement of the repair arm to a scaled multi-segment motion imitator 56. The imitator 56 is configured to replicate the movement of the actual repair arm. Additionally or alternatively a user interface module may be provided to supply remote control to the imitator, which is then correspondingly relayed to the repair arm to remotely control the arm. The user interface has a stylus 57, buttons for moving the arm's end-effector tool changer to specified locations for Home 58, toolbox locations for Cleaning 59, Sanding 60, Filling 61, and safety stop 62 positions. A LCD or similar display panel is used to livestream the repair progress as captured visually by a Wi-Fi camera on the arm, and sensor elements such as a potentiometer 64. The stylus can act to replicate the motion of the repair arm to provide an indicator to the controller. This can allow for direct visual feedback and visualization to the controller in real-time so the controller can monitor the position and status of the repair arm.

[0095] FIG. 13 Details of the arm's control system: The main control unit (master) 65 communicates the commands 66 with the imitator via the Internet communication. The path planning algorithm 67 uses the arms' inverse kinematics and is run within the master control system. The servo motors 69 and a stepper motor 70, which actuate the 5R assembly, are controlled via the master control system. The DC geared encoder motors that are used for filler deposition 71, mixing 72, dispensing cleaning material 73, sanding end-effector 74, cleaning end-effector 75 and taping 76 are controlled by the slave control unit 77. The on-board power system 78 is used to run the motors and control system units.

[0096] FIG. 14 illustrates schematically details of the control system for the motion imitator and user interface. The user interface system, communicating with the arm through Wi-Fi 84, is comprised of a multi-segment motion imitation tool, a Touch Screen Display for monitoring and visualisation of the repair operations 80, and five self-locking latching buttons 83, which enable sending predefined commands to the arm, under a control system 79. In a setting, there are five predefined functions that can be communicated via the interface buttons, HOME, SAND, CLEAN, and FILL 83. When the operator presses any button, the motorized joints of the repair arm (shown as a 5R assembly) will be displaced to position the arm's terminal end in a predefined location 81, 82.

[0097] FIGS. 15a to 15e show the process of performing a repair procedure. In FIG. 15a in the first step the surface of a blade will be scanned to find the defects by using an erosion detection algorithm. Then the arm will be back returned to a Home position. The next step shown in FIG. 15b is a cleaning task. Accordingly the arm grips the cleaning end-effector and then the arm again comes back to the Home position to begin the process of cleaning. When the cleaning task is completed as approved by the operator then the arm takes back the cleaning end-effector to its predefined position within the toolbox by moving the arm into the corresponding storage slot of the toolbox, using the arm to deflect and open the end-effector storage module, releasing the cleaning end-effector repair tool when within the module and then retracting the arm.

[0098] All the presented process can be done autonomously and the operator acts as a supervisor to take control of the repair arm via the remote motion imitator via the user interface if any problem happens for its autonomous control system.

[0099] The other two sanding (FIG. 15c) and filling (FIG. 15d)-forming (FIG. 15e) process can be performed in the same manner as described above for FIGS. 15a and 15b. At the end of repair process, the repaired area will be scanned again to evaluate the repair and if the erosion detection algorithm can't detect any contour then it will send a command to the operator to finish the repair process.

[0100] Additionally communication with the robotic system may be undertaken using communication software. In the last three decades, increasing attention to safety in human's working environments and need to industrial mass productions are two major reasons for the widespread use of robots and automation systems. However, the initial progress in developing robots were very slow. One of the main reason of the proposed problem was lack of open-source standard programming libraries to be used to sensors reading and actuators controlling which caused to re-write them for each application. The complexity writing the mentioned libraries led to creation of various middleware to simplify the process of robots' software developing and low-level communication complexity. For example, middleware that most widely used to facilitate the process of developing various kinds of robots is Robot Operating System (ROS). In fact, ROS is not an operating system, but it is an open-source middleware which can provide the services like low-level controlling, package management, building environment, message routine and hardware abstraction which simplified the process of robots' software development.

[0101] The fast progress in broadband telecommunication technologies, increases need to wireless controlling, big data collection, processing and analyzing has grown the researchers' attention to use Internet based telecommunication system for robots. In 1995, Taylor and Trevelyan provided a web based control for a robotic arm to manipulate some colored blocks. Burgard and Schulz developed a predictive simulation for visualization to handle teleoperation delay of mobile robots. Goldberg et al. created a web based control system and allowed users to maintain a garden by interacting with the robot over web. Yinong et al. presents a cloud based framework to interact with robots in the area of service-oriented computing. Osentoski et al. proposed the rosbridge and rosjs to enabled users who hasn't familiar with ROS to interact with ROS topics and services using JavaScript. Alexander et al. presents a collection of open-source modules to coverage ROS with modern web and network technologies[ ]. Kubaa et al. developed an asynchronous cloud based communication protocol between the robot and users.

[0102] Despite of the advantages of the aforementioned Internet based telecommunication system, there are weaknesses like need to have access to public IP address to be accessible by Websockets clients in rosbridge or need to have access to cloud based services like ROSLink. Moreover, based on new approaches in multiple robotic systems control, smart resources management and telecommunication security, we need new facilities which can support them.

[0103] There have been done many researches about the Internet based telecommunication systems that can be applied for interacting with robots over the Internet. In the following the most related works to our research and their pros and cons will be described.

[0104] In 2011, Osentoski et al. presented rosbridge and rosjs. As it mentioned in, the main motivations behind rosbridge and rosjs are, to enable novice robot users to interact with a ROS based robot by using Internet browsers and to provide the possibility of develop client applications to communicate with ROS based robots by Web developers who has no knowledge in field of robotics. Rosbridge and rosjs were developed based on JavaScript programming language for web applications. Moreover, they used the version 1.0 of socket and version 2.0 of WebSocket to provide common interfaces for non-web clients. In order to use rosjs we need to create a rosjs object firstly to be able to interact with a ROS based system by using ROS services and topics. The main features of rosbridge and rosjs are ability to publish through a simple publish command, providing an additional abstraction level on top of ROS systems, ability to interact with ROS through TCP/IP or WebSocket connection and provides two methods of security, first, protecting services/topics and key authorization. According to structure of rosbridge, the Websockets server which is ran on the robot need a public IP address then the WebSocket client can have access to it. This issue couldn't be reached in all robots. Developing robot applications by using web browsers advantages includes, the web-browsers are simple to use and people are familiar by using them and because of using web browsers in all of operating systems, then developing web browsers based applications can increase the accessibility of them. In 2012 B. Alexander et al. presented Robot Web Tools (RWT), which allows web applications to interface with various robots that has middleware like ROS. RVVT uses rosbridge for messaging ROS topics in a client-server architecture and interact with users through web browsers. A principal goal of RVVT is to converge robot middleware like ROS with web based technologies to provide the possibility of accessing to cloud robotics for use over public area networks. In 2015, A. Casan et al. developed a Robotic Programming Network (RPN) in the context of a web-enabled ROS system to provide the possibility of remote education and training. In 2017 Koubaa et al. proposed ROSLink as a bridge between ROS and Internet of Things (IoT) to use for cloud robotics. In fact, ROSLink is as a communication protocol that enable the possibility of implementing specifications of client in the robot side, and manifestation of a proxy server which is set on a public IP server machine, like a cloud server. One of the main points about ROSLink is, its ability to define its own communication protocol between ROS and non-ROS users through the cloud. The main advantages of ROSLink cloud-based approach compare to the similar protocols like it can be regarded as, its independency from the robots' ROS master nodes, ability to communication between users and robots through the cloud, and effective management of robots, users and fundamental services. Due to the vast facilities of cloud services provides for their users, interesting in researches about cloud robotics has been increased currently. In 2019, Pereira et al. developed ROSRemote to helps users to work with ROS in a remote master based on a framework that give the possibility to create several applications that may run remotely on it. In 2020, Toffetti et al. presented an Enterprise Cloud Robotics Platform (ECRP), a Platform as a Service (PaaS) solution to build ROS-based cloud robotics applications. In spite of cloud services advantages for using as remote computing service or logged data storage, there are some concerns exist about them like, having continues access to them, privacy and security of storage data, and the support of services providers about their products.

[0105] ROS is an open-source meta-operating software which is created based on a collection of tools, libraries, and conventions that aim to simplify the process of creating complex and robust robot behavior across a wide variety of robotic platforms. ROS provides common interface that allow users to code sharing and reuse. The proposed features of ROS help robotic researchers and developers to concentrate on new innovation instead of spending time to writing the standard programming libraries again.

[0106] Moreover, it provides an abstraction layer to hardware resources and reveal the data obtained from the hardware parts as a labeled data stream which is named Topic.

[0107] ROS uses a peer-to-peer networking topology. The systems that are ROS based include a number of processes called nodes which are communicate with each other by sending messages. The ROSs' messages are simple data structures consist of typed fields. The communication between nodes will be done through ROS Master. The ROS Master main duties is to naming and registration services to rest of the nodes in ROS based system. In a ROS distributed network the master device will be considered as the ROS-core executer.

[0108] The main communication models between ROS nodes are, publish/subscribe and request/reply models. In the first communication model nodes exchanges topics, in this case one or multiple nodes may act as publisher(s) of a specific topic, and multiple nodes may subscribe to that topic, via the ROS Master. In the second ROS based communication model, one node will act as server which provide the service which is defined by using a pair of messages (one for the request and the other for reply) under a certain name, and process the received requests from other nodes as clients.

[0109] ROS is an open-source meta-operating software which is created based on a collection of tools, libraries, and onventions that aim to simplify the process of creating complex and robust robot behavior across a wide variety of robotic platforms. ROS provides common interface that allow users to code sharing and reuse. The proposed features of ROS help robotic researchers and developers to concentrate on new innovation instead of spending time to writing the standard programming libraries again.

[0110] Moreover, it provides an abstraction layer to hardware resources and reveal the data obtained from the hardware parts as a labeled data stream which is named Topic.

[0111] ROS uses a peer-to-peer networking topology. The systems that are ROS based include a number of processes called nodes which are communicate with each other by sending messages. The ROSs' messages are simple data structures consist of typed fields. The communication between nodes will be done through ROS Master. The ROS Master main duties is to naming and registration services to rest of the nodes in ROS based system. In a ROS distributed network the master device will be considered as the ROS-core executer.

[0112] The main communication models between ROS nodes are, publish/subscribe and request/reply models. In the first communication model nodes exchanges topics, in this case one or multiple nodes may act as publisher(s) of a specific topic, and multiple nodes may subscribe to that topic, via the ROS Master. In the second ROS based communication model, one node will act as server which provide the service which is defined by using a pair of messages (one for the request and the other for reply) under a certain name, and process the received requests from other nodes as clients.

TABLE-US-00001 Algorithm 1: Sending command from console to the manipulator 1. Function sent (command): 2. Define: user api_id, api_hash and phone number, 3. Client = TelegramClient(phone, api_id, api_hash) 4. Client_connect 5. If not client_is_user_authoriaed( ) then 6. Client_send_code_request(phone); 7. Client_sign_in(phone, (Enter the code)); 8. Client_start( ); 9. Destination_user_username=insert the client user name; 10. Entity=client_get_entity(robot_user_username); 11. Client)send_message(entity, message=command); 12. Function main( ); 13. If container.txt>0 then 14. Command=read_container.txt( ); 15. Sign_1=command[0] 16. If sign_1==1 then->input command is related to switch button or joints 17. Sent(command[1]); 18. else 19. for (i=2; i<7; i++) do 20. Sent(command[i]); Control a Manipulator

[0113] In order to make a remote connection between the arm and the console, a secure internet-based communication system is designed and implemented.

[0114] FIG. 16a illustrates the telecommunication concept using Telegram mobile application. As it is illustrated in FIG. 16b, ROSIC is a multi-languages communication system. In order to facilitate the communication between ROSIC subsystems a container which is a text file is provided to collect the output of each subsystem. Each subsystem can put its output in the container with a specific sign which is used for identification.

[0115] In the case that the operator push each of the console switch button a number and a sign will be sent to the Telegram application and then the proposed data will be sent to the arm as an executable command.

[0116] In Algorithms 1 and 2, the api id, api hash and the phone number are three parameters used for user identification which can be obtained from the Telegram application, and they are unique. Moreover, as seen in Algorithm 1, the content of the container.txt file will be monitored continuously, and any change in the content is checked against the commands for end-effector switch buttons or the console's imitation tool, which is used to detect the onset of commands array for reading. The output of Algorithm 2 will be saved in container.txt file which is used as the input command to the ROS node used to control the arm.

[0117] The latency of the ROSIC system is calculated; the delay between the time of sending and receiving of the data over 4G mobile internet network is less than three seconds, which is acceptable for this project application. FIG. 16epresents the latency in receiving the console commands by the arm, at 15 different times of the day. Said system may also utilize a stylus.

TABLE-US-00002 Algorithm 2: Receiving command from console and save in container.txt file. 1. Function receive( ); 2. Define: user api_id, api_hash and phone number; 3. Client=TelegramClient(phone, api_id, api_hash)_start( ) 4. Client_start( ) 5. Destination_user_username==insert the user's name; 6. @client_on(events_NewMessage) -> Check the command which are 7. Async def handler(event); received from operator Telegram 8. Chat = await event_get_input_chat( ) 9. UI=chat_user_id 10. If(UI==user_id) then 11. Save even in container.txt 12. Client_run_until_disconnected( )

[0118] FIG. 17a shows an integrated robotic system 100 configured to attach to and move along wind turbine blades to perform maintenance and repair. The system comprises a base translation system 110, deployable legs 120 having attachment means 130, and a repair arm 150.

[0119] FIG. 17a shows the robotic system in a deployed position where the legs 120 are splayed out with the attachment means 130 secured to the turbine blades. The repair module 150 comprises an end effector selector system coupled to the repair module. The selector system in the example shown is a rotary system that can rotate to select a desired end effector repair or maintenance tool located at an end of a spur of the selector system. Example repair tools are shown in FIGS. 19a and 19b, and it can be appreciated that the repair tools described above can also be deployed on the end of any arm.

[0120] FIG. 17b shows the system 100 of FIG. 17a having a repair module 350 attached to the stage of the legs 120. The repair module 350 allows for autonomous detection, repair and evaluation of the surfaces. A DC motor 352 may be used to power the relative position of the module along the translation system 110. Although one motor is shown, further motors may be used. Cameras 354 and 356 allow for remote monitoring of the module during operation and aids in application of the repair tools during use. The repair module 350 comprises a rotary tool selection system having a plurality of repair tools that can be selected to be presented to the surface by rotating the rotary tool selection system to the desired repair tool. The repair tools comprise a rotary cleaning end-effector 360 of a similar manner to described previously. A rotary sanding end-effector 362 and a deposition nozzle 366 are also utilised. Flexible shafts 364 are used to control the repair tools.

[0121] FIG. 18 shows the robotic system in a stowed or transport position. The base translation system 110 comprises a first translation stage 112 and a second translation stage 114. Each stage comprises connectors that allow for the repair arm 150 or repair system 350 to be translated both relative thereto and within the stage. The repair module 150 is coupled to the first translation stage and is translatable in a first single axis that allows the repair module to be moved within the stage to a position along an axis where the repair or maintenance can be performed. Additionally, the second translation stage is provided is coupled to the first translation stage and the first translation stage is translatable in a second axis, perpendicular to the first axis.

[0122] By utilising this two axis stage, the repair module and the associated end effector tools can be positioned at any point within the stage. FIGS. 19a and 19b show an autonomously adapting spatula 204 that enables conformation to the surface curvature for enhanced forming, and a stable platform, using suction cups 214 making for sanding and cleaning using surface-anchored rotational tools 212. Both end effector tools use a lead screw 206, 210 that allow the height of the tools to be adjusted. The autonomous spatula is an active system that can conform to the shape of the surface. For example, for a wind turbine leading edge, the autonomous spatula can adapt its curvature to the varying curvature of the leading edge to be able to recover the original leading edge curvature profile. The spatula can detect and measure the surface shape using a tactile sensor, micro-switches, ultrasonic sensor, or an optical sensor. The system has multiple containers to keep filler and cleaning materials.

[0123] In order for the robotic system to be moveable to a general location for repair/maintenance, the deployable legs are able to attach and release the turbine surface to allow the system to walk across the surface of the blade and into position.

[0124] In order to attach to the surface the deployable legs are hingedly attached to the attachment means. The attachment means are shown in FIGS. 20a and 20b. In particular the attachment means 130 comprises a coupling 132 to secure the attachment means to the leg 120, a sliding plate 134, a sealing block 136 and a sliding plate lead screw actuator 138. The sealing block 136 comprises soft silicone cup inlets for receiving an end of suction cups 142 that pass through holes in a suction cup holder plate 140.

[0125] The example shown has 3 suction cups that are retained in the suction cup holder plate through a bayonet fitting about a neck of the suction cups 142. The suction cups 142 comprise a stopper 144 that are secured to the blade surface through a stopper hub 146 and a soft foam layer 148 that is placed on the surface. The foam layer is typically soft EPDM foam that allows conformation to the blade's curved surface.

[0126] Negative pressure may be used to engage and disengage the suction cups. This may include using a vacuum pump or using a compression mechanism for the suction cup as well as a sealing mechanism for the suction cup inlet. The above suction cup compression mechanism can either exploit the weight of the robot or be an active (motorised) compression mechanism.

[0127] From reading the present disclosure, other variations and modifications will be apparent to the skilled person. Such variations and modifications may involve equivalent and other features which are already known, and which may be used instead of, or in addition to, features already described herein.

[0128] Although the appended claims are directed to particular combinations of features, it should be understood that the scope of the disclosure of the present invention also includes any novel feature or any novel combination of features disclosed herein either explicitly or implicitly or any generalisation thereof, whether or not it relates to the same invention as presently claimed in any claim and whether or not it mitigates any or all of the same technical problems as does the present invention.

[0129] Features which are described in the context of separate embodiments may also be provided in combination in a single embodiment. Conversely, various features which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable sub-combination. The applicant hereby gives notice that new claims may be formulated to such features and/or combinations of such features during the prosecution of the present application or of any further application derived therefrom.

[0130] For the sake of completeness it is also stated that the term comprising does not exclude other elements or steps, the term a or an does not exclude a plurality, and reference signs in the claims shall not be construed as limiting the scope of the claims.