Robot training system including a motion bar

Abstract

A teaching system for a robot is provided, including a motion bar for controlling the robot and a robot system utilizing the teaching system. In one embodiment, the teaching system is provided including a first controller configured to provide motion-related control functions for controlling motion of the robot. The teaching system may also include a second controller configured to provide control functions other than the motion-related control functions for programming one or more actions of the robot.

Claims

1. A teaching system for a robot, comprising: a first controller configured to provide motion-related control functions for controlling motion of the robot; a second controller configured to provide control functions other than the motion-related control functions for programming one or more actions of the robot; a rotary switch configured to switch the robot between different operation modes comprising a debugging mode and at least one of an idle mode, a running mode, a floating mode, and/or a user interface mode; and a joystick configured to perform a corresponding function based on a current operation mode of the robot selected from the different operation modes, wherein, when the current operation mode of the robot is the debugging mode, the joystick is configured to provide direct manipulation of individual joints of the robot.

2. The teaching system of claim 1, wherein the first controller comprises an elongated body and a plurality of functional buttons installed on the elongated body, the plurality of functional buttons comprising: an emergency stop button configured to stop motion of the robot when pressed; an enabling button configured to enable movement of the robot when pressed; and a multifunction button configured (i) to control the robot to perform a programmed motion-related function and (ii) to be reprogrammable such that the programmed motion-related function may be changed.

3. The teaching system of claim 1, wherein, when the current operation mode of the robot is the user interface mode, the joystick is configured to control the second controller as a remote controller.

4. The teaching system of claim 1, further comprising a control box configured to receive user input from the first controller and the second controller and to generate control commands for controlling the robot based, at least in part, on the user input.

5. The teaching system of claim 4, wherein the first controller is connected to the control box via a cable.

6. The teaching system of claim 4, wherein the second controller is wirelessly connected to the control box.

7. The teaching system of claim 1, wherein the second controller is a mobile phone and/or a tablet computer.

8. The teaching system of claim 1, wherein the second controller further comprises a holding component for attaching the first controller to the second controller.

9. The teaching system of claim 1, wherein the first controller is attached to an end effector of the robot by using one or both of a mechanical or magnetic interlock between the first controller and the end effector of the robot.

10. A motion bar for controlling a robot, comprising an elongated body and a plurality of functional buttons for performing motion-related functions installed on the elongated body, wherein the plurality of functional buttons comprise: an emergency stop button configured to stop motion of the robot when pressed; an enabling button configured to enable movement of the robot when pressed; a multifunction button configured (i) to control the robot to perform a programmed motion-related function and (ii) to be reprogrammable such that the programmed motion-related function may be changed; a rotary switch configured to switch the robot between different operation modes comprising a debugging mode and at least one of an idle mode, a running mode, a floating mode, and/or a user interface mode; and a joystick configured to perform a corresponding function based on a current operation mode of the robot selected from the different operation modes, wherein, when the current operation mode of the robot is the debugging mode, the joystick is configured to provide direct manipulation of individual joints of the robot.

11. The motion bar of claim 10, wherein, when the current operation mode of the robot is the user interface mode, the joystick is configured to control a controller as a remote controller.

12. The motion bar of claim 10, wherein the motion bar is communicatively coupled with the robot via a cable.

13. A robot system, comprising: at least one sub-system comprising: a robot; a control box configured to generate control commands for the robot; and a motion bar configured to provide motion-related control functions for controlling motion of the robot, wherein the motion bar is communicatively coupled to the control box via a cable the motion bar comprising: a rotary switch configured to switch the robot between different operation modes comprising a debugging mode and at least one of an idle mode, a running mode, a floating mode, and/or a user interface mode; and a joystick configured to perform a corresponding function based on a current operation mode of the robot selected from the different operation modes, wherein, when the current operation mode of the robot is the debugging mode, the joystick is configured to provide direct manipulation of individual joints of the robot; and a wireless user interface capable of communicating with the at least one sub-system on an ad-hoc manner, and configured to provide control functions other than the motion-related control functions.

14. The robot system of claim 13, wherein the motion bar further comprises an elongated body and a plurality of functional buttons installed on the elongated body, the plurality of functional buttons comprising: an emergency stop button configured to stop motion of the robot when pressed; an enabling button configured to enable movement of the robot when pressed; and a multifunction button configured (i) to control the robot to perform a programmed motion-related function and (ii) to be reprogrammable such that the programmed motion-related function may be changed.

15. The robot system of claim 13, wherein when the current operation mode of the robot is the user interface mode, the joystick is configured to control a controller as a remote controller.

16. The robot system of claim 13, wherein the wireless user interface is a mobile phone or a tablet computer.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) To more clearly explain the technical solutions in the embodiments of the present disclosure, the drawings used in the description of the embodiments will be briefly described below. The drawings in the following description are merely exemplary embodiments of the present disclosure. For those of ordinary skill in the art, other drawings may also be obtained based on these drawings without any creative work.

(2) FIG. 1 illustrates a robotic system of related art.

(3) FIG. 2 illustrates a side view of a motion bar according to an exemplary embodiment of the present disclosure.

(4) FIG. 3 illustrates a front view of a motion bar according to an exemplary embodiment of the present disclosure.

(5) FIG. 4 illustrates a robotic system according to an exemplary embodiment of the present disclosure.

(6) FIGS. 5-7 illustrate additional configurations of a motion bar, a wireless user interface, and a robot according to some embodiments of the present disclosure.

(7) FIG. 8 illustrates a multi-robot system according to an exemplary embodiment of the present disclosure.

(8) FIG. 9 illustrates a vision calibration system according to an exemplary embodiment of the present disclosure.

DETAILED DESCRIPTION

(9) The disclosure will now be described in detail with reference to the accompanying drawings and examples. As will be apparent to one skilled in the art, the embodiments described in the present disclosure are merely exemplary and represent only a subset of all such embodiments. In particular, all other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts fall within the scope of the present disclosure.

(10) One way to resolve the problems with conventional teaching pendants is to replace the teaching pendant with a motion bar and a wireless user interface (WLUI) designed to provide the same function as the teaching pendant in a robot system. For example, functions that directly trigger motion of the robot may only be executed with the motion bar, while the WLUI implements all other non-motion-related functions. This divided implementation may comply with teaching pendant safety requirements while also reducing the design constraints created by the safety requirements.

(11) FIGS. 2 and 3 depict a motion bar 10 according to an exemplary embodiment of the present disclosure. The motion bar 10 may provide control to a robot system in compliance with safety requirements and may also allow for direct manipulation of the WLUI. As depicted, the motion bar 10 may include a body 16 and multiple functional buttons arranged on the body 16. As shown in FIG. 2, the body 16 may have an elongated configuration. The functional buttons may include, for example, an emergency stop button 11, an enabling button 12, a multifunction button 13, a rotary switch 14, and a joystick 15.

(12) The emergency stop button 11 may be provided to improve the safety of the robot system. For example, pressing the emergency stop button 11 may stop (e.g., immediately stop) all movement of the robot system (e.g., the robot 106) in the event of an emergency. In certain implementations, the emergency stop button 11 may also be required by relevant safety requirements.

(13) The enabling button 12 may be similarly provided to improve the safety of the robot system. For example, movement of the robot system (e.g., the robot 106) may be disabled until the enabling button 12 is pressed, and may be stopped again when the enabling button 12 is released. In certain implementations, the enabling button 12 may also be required by relevant safety requirements.

(14) The multifunction button 13 may be configured to perform multiple functions (e.g., movement-related functions), depending on the use case. For example, the multifunction button 13 may be reprogrammable by the WLUI. In certain implementations, the multifunction button 13 may be configured to act as a ‘Start’ button of the robot system that causes the robot system to begin performing a programmed function.

(15) The rotary switch 14 may be used to switch between different operating modes of the robot system. For example, it may allow for switching between an Idle Mode, a Running Mode, a Floating Mode, a Debugging Mode, and a User Interface Mode.

(16) The joystick 15 may be configured to perform multiple functions based on the operating mode of the robot system. In one implementation, the joystick 15 may control the WLUI under User Interface Mode as a remote controller and may provide direct manipulation of individual joints of the robot system under Debugging Mode. In another implementation, the joystick 15 may control the end effector of the robot system in Cartesian coordinates.

(17) FIG. 4 depicts a robotic system 400 according to an exemplary embodiment of the present disclosure. The robotic system may include a motion bar 10, a wireless user interface (WLUI) 20, a control box 30, and a robot 40.

(18) The control box 30 may act as the hub of the robot system, where all user input (either from the motion bar 10 or from the WLUI 20) is received, and all control commands are generated. The robot 40 may be a robotic arm that performs tasks specified by users. The motion bar 10 may be connected to the control box 30 via a cable or wire, which may be required by certain safety requirements. A wired connection may provide a more stable and reliable connection than a wireless connection and may thus be required by certain safety regulations.

(19) By contrast, the WLUI 20 may be wirelessly connected to the control box 30, e.g., via Wi-Fi. Such a wireless connection may provide more flexibility to the user as a result of potentially more compact form factor and cable-free designs for the WLUI 20. In certain implementations, the wireless connection between the control box 30 and the WLUI 20 may also enable sharing of a single WLUI 20 across multiple robot systems 400. Users may be able to perform tasks such as programming, debugging, and monitoring on the WLUI 20, similar to what can be performed on a regular teaching pendant.

(20) With this design, because safety-related features, such as the emergency stop and enabling buttons 11 and 12, are not performed by the WLUI 20, the applicable safety requirements, such as drop tests and heavy set down test, may be less stringent. This relaxing of the safety requirements may allow for a more compact and elegant design for the WLUI 20. On the other hand, the motion bar 10 may be easier to design to meet the relevant safety requirements because of its lighter weight as compared to traditional teaching pendants.

(21) The motion bar 10 can also be integrated into or stored along with the WLUI 20 or the robot 40 according to certain user requirements. FIGS. 5-7 depict several such configurations of the motion bar 10, the wireless user interface 20, and/or the robot 40 according to exemplary embodiments of the present disclosure. One of these configurations may be selected for several reasons, including convenience, aesthetics, safety, and tidiness.

(22) In one implementation, users may need to hold both the WLUI 20 and the motion bar 10 at the same time for robot control and programming. The motion bar and the WLUI may thus be coupled together as one assembly with a motion bar—WLUI holder. For example, FIG. 5 depicts a motion bar—WLUI holder 21 that stores the motion bar 10 alongside the WLUI 20. As another example, FIG. 6 depicts a motion bar—WLUI holder 22 that stores the motion bar 10 behind the WLUI 20. Although not depicted, in another configuration, the motion bar 10 may be stored at the bottom of the WLUI 20.

(23) In a further implementation, users may need to move or position the robot 40 by hand (i.e., in the Floating Mode). In such implementations, the enabling button 11 on the motion bar 10 may have to be held at all time for safety reasons. In practice, this may require two-handed operation. To resolve this manipulation difficulty, the motion bar 10 may be attached to the robot 40 itself, as depicted in FIG. 7 (e.g., using a mechanical interlock or a magnetic interlock between the motion bar 10 and the robot 40). In such a configuration, users may need only one hand to hold the enabling button 11 and move the robot 40 at the same time, which may make the robot 40 easier to operate in the Floating Mode.

(24) FIG. 8 depicts a multi-robot system 800 according to an exemplary embodiment of the present disclosure. The multi-robot system 800 may be used to wirelessly connect the WLUI 20 to different robot systems 802, 804, 806 in an ad-hoc manner. For example, when programming, debugging, or maintenance of a particular robot system is required, users may connect the WLUI 20 to a particular robot system 802, 804, 806 and may then perform the required tasks using the WLUI 20. Such configurations may reduce the total number of WLUIs 20 needed, thereby reducing the overall cost of a deployment in the field (e.g., in a factory utilizing multiple robots).

(25) For consumer applications, smart phones or tablets can also act as WLUIs 20 without compromising the safety requirements. This enables remote programming and control of the robots and brings extra flexibility for the users.

(26) FIG. 9 depicts a vision calibration system 900 according to an exemplary embodiment of the present disclosure. Robotic systems 902 may, in certain implementations and as illustrated, include an end effector visual system 42 (e.g., a camera) attached to an end effector of the robot 40 and/or a separate camera near the robot system 902. The WLUI 20 may also be used as a visual calibration device for the robotic system 902 as a result of its portability and real-time wireless connection to the robotic system 902.

(27) For example, in one embodiment, as shown in FIG. 9, the WLUI 20 may be placed beneath the end effector vision system 42 of a robot 40. A pattern 23 (e.g., a checkered pattern or similar) may be displayed on the WLUI 20 with a pre-known grid size. The end effector vision system 42 may then capture the patterns 23 on the WLUI 20 and calculate the associated kinematic parameters of the end effector relative to the robotic system 902. In addition, the WLUI 20 may display various displayed patterns, or may calibrate in separate locations or separate orientations to achieve more accurate calibration results.

(28) Further, a global vision system 60 may be placed near the WLUI 20 to provide an overall visual view of the robotic system 902. With the same WLUI 20 and patterns 23, the global vision system 60 may be calibrated using similar methods as mentioned above. Since both the end effector vision system 42 and the global vision system 60 are calibrated with respect to the WLUI 20, the relative locations between the end effector visual system 42 and the global vision system 60 may be calculated accordingly.

(29) In certain implementations, one or more jigs 51, 52 may be used to directly fix the relative locations between the robot 40 and the WLUI 20, and between the global vision system 60 and the WLUI 20 during calibration. This may enable faster and more convenient calibration between the robot 40, the end effector vision system 42, and the global vision system 60.

(30) The above-discussed systems and methods have one or more of the following benefits: (1) more flexible teaching pendant design with the same level of safety compliance; (2) direct control of the robot system with the motion bar; (3) reduced difficulty for robot vision system calibration; (4) reduced number of teaching pendants in the field; and (5) reduced overall cost.

(31) The foregoing are merely embodiments of the present disclosure, and are not intended to limit the scope of the disclosure. Any transformation of equivalent structure or equivalent process which uses the specification and the accompanying drawings of the present disclosure, or directly or indirectly application in other related technical fields, are likewise included within the scope of the protection of the present disclosure.