A computer-implemented method, executed by data processing hardware of a robot, includes receiving sensor data for a space within an environment about the robot. The method includes receiving, from a user interface (UI) in communication with the data processing hardware, a user input indicating a user-selection of a location within a two-dimensional (2D) representation of the space. The location corresponds to a position of a target object within the space. The method includes receiving, from the UI, a plurality of grasping inputs designating an orientation and a translation for an end-effector of a robotic manipulator to grasp the target object. The method includes generating a three-dimensional (3D) location of the target object based on the received sensor data and the location corresponding to the user input. The method includes instructing the end-effector to grasp the target object using the generated 3D location and the plurality of grasping inputs.

A robot instructing apparatus for a robot having an end effector includes a teaching pendant, and orientation device, and at least one processor. The orientation device is configured to output an orientation of the teaching pendant based on an angular position of the teaching pendant about a vertical axis. The at least one processor is configured to generate movement instructions to move the robot during one or more teaching operations. The at least one processor is configured to generate the movement instructions in a translation teaching mode in which a translational change of the end effector, in response to the movement instructions, corresponds to an input direction input to the teaching pendant by a user relative to the orientation of the teaching pendant.

A robot control system including a robot controller configured to control a robot, two operation devices configured to manually operate the robot, the first operation device being connected to the robot controller. Each of the operation devices has a request switch configured to switch between a request state in which an operation right for the robot is requested and a non-request state in which the operation right is not requested, and the robot controller is configured to start providing the operation right to one of the operation devices only when the request switch of the one of the operation devices is in the request state and the request switch of the other of the operation devices is in the non-request state, and keep the operation right granted until the request switch of the one of the operation devices is switched to the non-request state.

A robot operation terminal includes multiple application programs. The robot operation terminal is connected to a controller that controls a robot, and the robot operation terminal receives an input operation carried out by an operator to operate or set the robot. In each of application programs, a necessity of an inbuilt login is set to confirm an operation authority of the operator.

Example systems and methods allow for runtime control of robotic devices during a construction process. One example method includes determining at least one sequence of robot operations corresponding to at least one robot actor, causing the at least one robot actor to execute a portion of the at least one sequence of robot operations during a first time period, receiving an interrupt signal from a mobile computing device indicating a modification to the at least one sequence of robot operations, where the mobile computing device is configured to display a digital interface including one or more robot parameters describing the at least one robot actor and one or more tool parameters describing operating characteristics of at least one physical tool, and causing the at least one robot actor to execute a portion of the at least one modified sequence of robot operations during a second time period.

A control device includes a motion controller configured to control operation of a mechanical apparatus according to an operational command, a correction controller configured to correct the operation of the mechanical apparatus according to manipulational information outputted from a manipulating device, a memory part configured to store first operational information indicative of the operation of the mechanical apparatus, and correctional information indicative of the correction made by the correction controller, and a learning part configured to carry out machine learning using the first operational information and the correctional information corresponding to the first operational information. The motion controller controls the operation of the mechanical apparatus according to the operational command based on the command of the learning part, and the manipulating device outputs the manipulational information based on second operational information indicative of motion of the manipulating device.

A method includes receiving sensor data for an environment about the robot. The sensor data is captured by one or more sensors of the robot. The method includes detecting one or more objects in the environment using the received sensor data. For each detected object, the method includes authoring an interaction behavior indicating a behavior that the robot is capable of performing with respect to the corresponding detected object. The method also includes augmenting a localization map of the environment to reflect the respective interaction behavior of each detected object.

A robot instructing apparatus includes a teaching pendant having a display and an inclination device. The inclination device outputs an inclination of the teaching pendant based on the inclination of the teaching pendant about at least one horizontal axis. The robot instructing apparatus also includes at least one processor that generates movement instructions to change a posture of the robot based on the inclination of the teaching pendant output by the inclination device during a teaching operation in which the movement instructions are generated.

A supporting apparatus for programing a robot operation has a display by which an operator sees a movement trajectory corresponding to a movement of the robot and by which the operator is supported to provide a program including moving order and non-moving order. The supporting apparatus for programing has a first operating portion describing a target position of each of the moving orders superimposed with the movement trajectory by using a first code, and a second operating portion describing a number of the non-moving orders operated at the target position by using a second code.

A robot operation terminal includes multiple application programs. The robot operation terminal is connected to a controller that controls a robot, and the robot operation terminal receives an input operation carried out by an operator to operate or set the robot. In each of application programs, a necessity of an inbuilt login is set to confirm an operation authority of the operator.