ROBOT SYSTEM INCLUDING AN AERIAL VEHICLE AND A GROUND VEHICLE
20240327042 ยท 2024-10-03
Assignee
Inventors
- Shaohui Foong (Singapore, SG)
- Jer Luen CHIEN (Singapore, SG)
- Clarissa Tze Lyn LEONG (Singapore, SG)
- Jingmin LIU (Singapore, SG)
- Jia Hwee LOW (Singapore, SG)
Cpc classification
B64U2201/202
PERFORMING OPERATIONS; TRANSPORTING
B25J19/0025
PERFORMING OPERATIONS; TRANSPORTING
International classification
B25J19/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
Aspects concerning a robot system is provided comprising a ground vehicle, an aerial vehicle capable of flight, and a tether connecting the aerial vehicle to the ground vehicle, wherein the tether comprises on or more Bowden cables, each having an inner cable connected at one end to a respective motor of one or more motors of the ground vehicle and at another end to a component of the aerial vehicle, wherein the ground vehicle comprises a motor controller configured to control movement of the component of the aerial vehicle by controlling the one or more motors.
Claims
1. A robot system comprising: a ground vehicle; an aerial vehicle capable of flight; and a tether connecting the aerial vehicle to the ground vehicle, wherein the tether comprises one or more Bowden cables, each having an inner cable connected at one end to a respective motor of one or more motors of the ground vehicle and at another end to a component of the aerial vehicle; and wherein the ground vehicle comprises a motor controller configured to control movement of the component of the aerial vehicle by controlling the one or more motors.
2. The robot system of claim 1, wherein the aerial vehicle has a robot arm and the component whose movement is controlled by the motor controller is the robot arm with an end-effector.
3. The robot system of claim 2, wherein the robot arm has a plurality of discs arranged at a flexible backbone, wherein the discs have one or more holes which guide the inner cables of the one or more Bowden cables.
4. The robot system of claim 1, wherein the aerial vehicle comprises one or more rotors to make it capable of flight.
5. The robot system of claim 1, wherein the tether further comprises a data transmission line configured to provide a data connection between the ground vehicle and the aerial vehicle.
6. The robot system of claim 5, wherein the motor controller is configured to receive sensor data from the aerial vehicle via the data transmission line and control movement of the component of the aerial vehicle using the received sensor data.
7. The robot system of claim 6, wherein the sensor data comprise information about a position of the component.
8. The robot system of claim 1, wherein the tether further comprises a power supply line configured to supply electric power from the ground vehicle to the aerial vehicle.
9. The robot system of claim 1, wherein the tether further comprises a fluid pipe configured to supply fluid from the ground vehicle to the aerial vehicle.
10. The robot system of claim 1, wherein the tether further comprises a fluid pipe configured to provide a hydraulic or pneumatic connection between the ground vehicle and the aerial vehicle.
11. The robot system of claim 10, wherein the ground vehicle is configured to control a movement of the component or a further component of the aerial vehicle by means of the hydraulic or pneumatic connection.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The invention will be better understood with reference to the detailed description when considered in conjunction with the non-limiting examples and the accompanying drawings, in which:
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
DETAILED DESCRIPTION
[0026] The following detailed description refers to the accompanying drawings that show, by way of illustration, specific details and embodiments in which the disclosure may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the disclosure. Other embodiments may be utilized and structural, and logical changes may be made without departing from the scope of the disclosure. The various embodiments are not necessarily mutually exclusive, as some embodiments can be combined with one or more other embodiments to form new embodiments.
[0027] Features that are described in the context of an embodiment may correspondingly be applicable to the same or similar features in the other embodiments. Features that are described in the context of an embodiment may correspondingly be applicable to the other embodiments, even if not explicitly described in these other embodiments. Furthermore, additions and/or combinations and/or alternatives as described for a feature in the context of an embodiment may correspondingly be applicable to the same or similar feature in the other embodiments.
[0028] In the context of various embodiments, the articles a, an and the as used with regard to a feature or element include a reference to one or more of the features or elements.
[0029] As used herein, the term and/or includes any and all combinations of one or more of the associated listed items.
[0030] In the following, embodiments will be described in detail.
[0031] A majority of inspection tasks are not located at high altitude so a UAV (Unmanned Aerial Vehicle) designed for high altitudes is often not necessary. On the other hand, as mentioned above, aerial work platforms (AWPs) are hard to deploy.
[0032] In view of the above, according to various embodiments, the capability of an aerial unit is enhanced by pairing it with a supporting ground unit which can provide power, data process, fluid source and safety to the aerial unit. The resulting robot system according to one embodiment is a ground-aerial robotic system that targets inspection tasks that require close proximity and even contact to the target.
[0033]
[0034] The robot system 100 includes an aerial unit (i.e. an aerial vehicle) 101 which is for example implemented based on a multirotor unmanned aerial vehicle (UAV), a mobile ground unit (i.e. a mobile ground device, i.e. a ground vehicle) 102 and a tether 103 tethering the aerial unit 101 to the ground unit 102.
[0035] The tether 103 provides a connection to provide power from the ground unit 102 to the aerial unit 101. Further, it provides a datalink so that onboard processing can be carried out on the ground unit 102 rather than aerial unit 101. This allows the aerial unit 101 to remain small and compact.
[0036] The tether 103 may include [0037] a power tether (i.e. a power line) providing power to the aerial unit from the ground unit so that it can operate indefinitely. Without the need for batteries, the aerial unit can be smaller and lighter [0038] a data tether (i.e. a data line) for the robotic system 100 to perform intelligent operations without the need to provide processing power in the aerial unit 101 which would consume power and add size/weight. By moving the computational system to the ground unit 102, the aerial unit 101 can be smaller and lighter while retaining original capabilities [0039] a fluid tether (i.e. a fluid pipe): by providing a pneumatic or hydraulic connection to the aerial unit 101, the aerial unit 101 can harness pneumatic/hydraulic tools (e.g. drills) as well as eject fluid for cleaning applications. Fluid can also flow the opposite way for suction and removal of debris [0040] a safety tether (i.e. a safety cord) to ensure that the aerial unit 101 does not fly away and allow operation near aerodromes
[0041] The ground unit 102 for example includes an automated tethering system which supports these functionalities of the tether 104 and further components related to these functionalities like one or more batteries or a generator for supplying power to the aerial unit, a microprocessor or computer (which may depending on the application scenario be seen as edge computer) for controlling the aerial unit or motors of the ground unit for controlling movement of a the robot arm 104 via Bowden cables or a pneumatic/hydraulic device or controller for controlling movement a component of the aerial vehicle.
[0042] The actuators are located on the ground unit 102 and connected to the aerial unit 101 via the tether 104.
[0043] Introducing manipulation to the aerial unit 101 requires incorporating actuators, sensors and a mechanism to enable a controllable (e.g. grasping) motion. These devices are both large and heavy, which may make their integration with the aerial unit 101 cumbersome and may lead to poor performance. Therefore, according to various embodiments, a cable-driven mechanism is used for a specialized manipulator for the robot system 100. This allows that the actuators and other electronic devices are located in the ground unit 102 and the aerial unit 101 can be made compact and agile with fully capability of manipulation.
[0044] So, the robot system 100 is an integrated ground-aerial robotic system with a multi-modal tether 103 between the ground unit 102 (also denoted as ground station, ground system or ground vehicle) and an aerial unit 101 (also denoted as aerial vehicle), which may and may hold a cable-driven continuum robot (e.g. robot arm) 104 as manipulator. Flexible aerial manipulation is achieved via cable actuation from the ground, thus removing the need for heavy onboard motors in aerial unit 101. Furthermore, due to the tether 102 supplying power to the aerial unit 101, batteries are not required onboard the aerial unit 101 and the aerial unit 10 has enough endurance to perform what needs to be achieved. The aerial unit 102 may hold a cable-driven continuum robot (e.g. robot arm) 104.
[0045]
[0046] As mentioned above, the aerial unit 201 may hold a cable-driven continuum robot 202. The continuum robot 202 can have multiple independent moving stages. The aerial unit 201 may for example be implemented by a quadcopter which is connected to the ground unit 102 by bowden tubes (e.g. of 4 m length) made for example from polytetrafluoroethylene (PTFE). The aerial unit 201 for example includes a continuum arm 202 (as continuum robot 104) in the form of a two-stage robot with a PTFE tube attached as the robot arm's end-effector 203.
[0047] The ground unit 102 includes (servo-)motors 204, 205, 206, 207 connected with a central processing unit 208, e.g. in a daisy chain manner via a connection (e.g. bus) 209. They are connected to the aerial unit 201, specifically to its end-effector 203 by (driven) cables in bowden tubes 210. The aerial unit 201 is in communication with a tether unit 213 of the ground station 202. The ground unit 211 may control (pilot) 212 the aerial unit 201 based on telemetry 211 (these functions may be implemented by the central processing unit 208 or by dedicated processing units).
[0048] According to various embodiments, a reference frames are used to fully define the kinematics of the robot manipulator 104.
[0049]
T.sub.w,e=T.sub.w,bT.sub.b,0?.sub.{i=1}.sup.{n}T.sub.i?1,iT.sub.n,e(1)
where T.sub.n,e is the transformation between the n-th reference frame and the reference fream of the end-effector of the robot arm 104, T.sub.i?1,i is the transformation between reference frames of subsequent stage of the arm 104, where i=1, . . . , n (i=0 is the robot arm origin and i=1 is the first stage of the robot arm 104). If there is no end-effector, T.sub.n,e=I. The system is generalized such that T.sub.b,1 represents an onboard mechanism that allows the entire arm 104 to be shifted around with respect to the body origin of the aerial platform.
[0050] For the following derivation of a kinematic model of the continuum robot, the following assumptions are made: [0051] According to Euler-Bernoulli theory it is assumed that the continuum robot bends with a constant curvature. [0052] The continuum robot 104 includes a flexible rod as backbone which is incompressible. [0053] Three cables are used per stage to actuate the robot's end-effector pose. Each stage has two configuration states: bending angle ? and bending plane angle ?.
[0054]
[0055] With the above assumptions, the resulting transformation matrix R.sub.i?1,i?SO(3) between stages can be expressed as:
where s?=sin ? and c?=cos ?. It should be noted that
(indices omitted for simplicity).
[0056] Meanwhile, the position p.sub.i?1,i?R.sup.3 (i.e. is the relative position of ith state with respect to the i-1th state) can be expressed as:
where
{dot over (p)}.sub.0,n=J(?).Math.?(4)
[0057] Regarding the mapping of motor variables to configuration states of the manipulator 104, the driven cables 210 of the tether 103 are expressed as a function of the displacements of the motors 204-207 and vice versa. Since each cable 210 is connected to a pulley (driven by the respective motor), the driven cables 210 can be mapped by scaling the motor displacements by the pulley radius:
q.sub.ij=f?.sub.ij(5)
where ? is the angular displacement of the motor, r is the radius of the pulley and q.sub.ij is the driving displacement of stage i, cable j. The total length of each cable is expressed as:
l.sub.ij.sup.total=l.sub.ij.sup.tube+l.sub.ij.sup.arm(6)
=l.sub.ij.sup.tube+
where l.sub.ij.sup.tube is the length of the cables in each tube, l.sub.ij.sup.arm is the length of each cable at the arm 104.
[0058]
[0059] The configuration states can be expressed in terms of the driven cables:
?.sub.i>=atan 2(?{square root over (3)}(q.sub.i1+q.sub.i2?2q.sub.i3),3(q.sub.i1?q.sub.i2)?(i?1)?(8)
[0060] With these equations, the forward kinematics of the system can be computed. Computing the inverse of the mapping functions is often key in implementing control. The driven cables can be expressed as a function of the configuration states:
q.sub.ij=d?.sub.j cos(?.sub.i+?.sub.ij)(10)
where ?.sub.ij is the division angle, i.e. the angle of the hole to which cable ij is assigned on stage i with respect to a reference direction. Eq. (10) can be differentiated with respect to time to determine the relationship between configuration states and actuation states:
{dot over (q)}.sub.ij=d({dot over (?)}.sub.i cos(?.sub.ij??.sub.i)??.sub.i{dot over (?)}.sub.i sin(?.sub.ij??.sub.i)(11)
[0061] Now, {dot over (?)} can be found using (5). Subsequently, {dot over (?)} can be used as the reference input for a controller of the motor (e.g. a PID controller).
[0062] Regarding displacement efficiency of the continuum manipulator system, when the motors drive the cables for a specified displacement, the ideal system assumes that the cables run through the Bowden tubes smoothly without distorting their shape. However, in the robot system 100, the Bowden tubes bend accordingly to ensure that mechanical power is being transferred to the arm. Extending Eq. (7) gives:
l.sub.ij.sup.total=l.sub.ij.sup.tube+
where l.sub.ij.sup.w is the portion of the driven displacement required to tension the cables in the bowden tubes. The displacement efficiency can be expressed as:
[0063] According to various embodiments a MPC (Model Predictive Control) controller is implemented in the robot system 100 according to the derived velocity kinematics.
[0064] This requires full-state feedback which is obtained by first assuming that p.sub.i?1,i is known to determine ?.sub.i by solving the optimisation problem
where ? is a small positive number to avoid singularity issues. The value of ?.sub.i can be found using the equation
?.sub.i=atan 2(y.sub.i?1,i,x.sub.i?1,i)(15)
[0065] As the function in Eq. (3) is a surjective function, i.e., using Eq. (3), f(?, ?)=f(??, 2???), the domain of ? is limited such that Eq. (14) and ??[??,?] are satisfied, for (3) to be bijective. Supposing that the solution is not bounded to Eq. (14), the discontinuous error signal can create erratic system behaviours, especially in linear PID controllers. It should be noted that using motor encoders to estimate 0 may be avoided as Eq. (13) is likely to demonstrate nonlinear behaviour in real life. It is further assumed that the kinematics of the system is substantially faster than its dynamics. Hence, the effects of mass and inertia in the system, and effectively the transient response of the motors, can be ignored. From Eq. (4), the configuration states are appended to the state-space system to get:
where x=[x, y, z, ?.sub.1 . . . ?.sub.i ?.sub.1 . . . ?.sub.i].sup.T, u=[{dot over (?)}.sub.1 . . . {dot over (?)}.sub.i {dot over (?)}.sub.1 . . . {dot over (?)}.sub.i].sup.T. The MPC problem can be formulated as a least squares function, subjected to kinematic constraints and upper and lower bounds of states and constraints. We can express the optimisation problem mathematically as:
where N is the length of the prediction horizon, and Q, R are positive definite matrices to penalise state errors and control inputs while P accounts for the terminal cost enforcing stability. Here, the domain of ?.sub.i?[??/2,?/2] and ?.sub.i?[?2?,2?] is relaxed to ensure that the solver can dynamically plan its path to the desired reference point.
[0066]
[0067] Experiments show that the continuum robot's end-effector can draw a circle in, i.e. with reference points varying with time according to
x.sub.ref=r sin(?t)(18)
y.sub.ref=r cos(?t)(19)
with bounded tracking error.
[0068] It should be noted that [0069] i. The transient responses of the motors are not negligible in practical application. The rise time of the motors increase as the stiffness of the continuum robot increases. [0070] ii. The continuum robot is assumed to bend with a constant curvature, which is only an approximation of the robot's true behaviour. [0071] iii. The sensors are assumed to be error free and provide full state feedback. However, the optimization problem (14) and Eq. (15) are based on the constant curvature assumption.
[0072] Further, transmission losses (due to the cables running in the tubes) impacting performance should be taking into account.
[0073] The robot system 100 thus includes a tethered aerial unit 101 capable of flight including a cable-driven continuum manipulator 103 and actuation whilst drawing its power from its ground station system 102. Transmission of mechanical work from the ground station to the continuum end-effector of the manipulator 103 is achieved via cables over, e.g., four metres in length. It combines the manoeuvrability of an aerial vehicle with the flexibility of a continuum robot to make it an ideal candidate for a variety of operations in distant and narrow locations with a higher level of operational safety. The novelty of multi-modal tether of the system allows for the following: [0074] i. Unified safety for operations which require it, to prevent the occurrence of fly-aways, like those near aerodromes, [0075] ii. Longer endurance with sufficient power for extended aerial operation via a power tether to a high-capacity power source on the ground station system, [0076] iii. More robustness and capacity for computational-heavy algorithms and data utilization for real-time analysis, to boost its performance, via a data tether to a high-performance edge computing unit on the ground station system, [0077] iv. Off-board actuation of various components via robust cables to the winch system on the ground station system to reduce the weight and improve the performance and efficiency of the aerial unit during operations, and [0078] v. Potential incorporation of pneumatic or hydraulic powered equipment and machines, like drills, on the aerial unit via a fluid tether.
[0079] With these, together with the employment of intrinsic (onboard sensors) and extrinsic (externally placed sensors) approaches, providing high localization and navigation capabilities, the robot system according to various embodiments can be operated in close proximity to the target such that: [0080] i. Direct or extremely close interactions with the target is permissible during operations, and [0081] ii. Operations in confined and fully enclosed environments are possible.
[0082] The continuum end-effector 104 with a gripping mechanism has potential applications of integrated and lightweight manipulators that may be optimised to enable the robot system 100 to perform advanced interactive tasks requiring direct contact. Various mechanisms can be developed or adapted for mounting to the end of the end-effector to achieve a wide range of applications in which the robot system 100 can be deployed to. Actuation of these mechanisms can be located off-board the aerial unit 101 on the ground station system 102 to reduce its weight and increase its agility. This bolsters its close-proximity to-target-operations capability whilst optimizing the performance of the aerial unit and end-effector.
[0083] In summary, according to various embodiments, a robot system is provided including a ground vehicle, an aerial vehicle capable of flight and a tether connecting the aerial vehicle to the ground vehicle, wherein the tether includes on or more Bowden cables, each having an inner cable connected at one end to a respective motor of one or more motors of the ground vehicle and at another end to a component of the aerial vehicle, wherein the ground vehicle includes a motor controller configured to control movement of the component of the aerial vehicle by controlling the one or more motors.
[0084] The robot system has for example a maximum altitude (of the aerial vehicle) of 20 m, a diagonal footprint of the ground vehicle of 1.25 m, a payload of the aerial vehicle of a maximum of 1 kg, a weight of 25 kg and is for example electrically supplied (e.g. by 16V by a one or more batteries).
[0085] The control operations described herein may be performed and the various processing or computation units and the devices and computing entities described herein may be implemented by one or more circuits. In an embodiment, a circuit may be understood as any kind of a logic implementing entity, which may be hardware, software, firmware, or any combination thereof. Thus, in an embodiment, a circuit may be a hard-wired logic circuit or a programmable logic circuit such as a programmable processor, e.g. a microprocessor. A circuit may also be software being implemented or executed by a processor, e.g. any kind of computer program, e.g. a computer program using a virtual machine code. Any other kind of implementation of the respective functions which are described herein may also be understood as a circuit in accordance with an alternative embodiment.
[0086] While the disclosure has been particularly shown and described with reference to specific embodiments, it should be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The scope of the invention is thus indicated by the appended claims and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced.