A robot teaching device includes: a display device; an operation key formed of a hard key or a soft key and including an input changeover switch; a microphone; a voice recognition section; a correspondence storage section storing each of a plurality of types of commands and a recognition target word in association with each other; a recognition target word determination section configured to determine whether a phrase represented by character information includes the recognition target word; and a command execution signal output section configured to switch, in response to the input changeover switch being operated, between a first operation in which a signal for executing the command corresponding to an operation to the operation key is outputted and a second operation in which a signal for executing the command associated with the recognition target word represented by the character information is outputted.

Example systems and methods allow for runtime control of robotic devices during a construction process. One example method includes determining at least one sequence of robot operations corresponding to at least one robot actor, causing the at least one robot actor to execute a portion of the at least one sequence of robot operations during a first time period, receiving an interrupt signal from a mobile computing device indicating a modification to the at least one sequence of robot operations, where the mobile computing device is configured to display a digital interface including one or more robot parameters describing the at least one robot actor and one or more tool parameters describing operating characteristics of at least one physical tool, and causing the at least one robot actor to execute a portion of the at least one modified sequence of robot operations during a second time period.

A robot control system includes a control device for controlling a robot and a portable operating panel connected to the control device. The portable operating panel and at least one other device include contact points connected in series. The control device includes a reception circuit that can detect the opening of at least one of the contact points. The portable operating panel includes a smart device having a sensor. The contact point included in the portable operating panel is opened and closed in conjunction with a physical movement of a switch member attached to an exterior of the smart device. The sensor can detect a physical quantity that changes in conjunction with the physical movement of the switch member. The portable operating panel transmits, to the control device, a detection signal indicating the physical quantity detected by the sensor or information about the physical quantity.

A teaching support device configured to perform teaching to a robot which has a robot arm a tip of which is attached with a polishing tool, and which controls the robot arm with force control to perform a polishing task on an object includes a teaching point acquisition section configured to obtain information related to a plurality of teaching points set to the object, a polishing parameter acquisition section configured to obtain information related to a polishing parameter of the polishing task at the plurality of teaching points obtained by the teaching point acquisition section, and a display control section configured to display the teaching point out of the plurality of teaching points with a color based on the polishing parameter obtained by the polishing parameter acquisition section so as to overlap the object.

A method comprising identifying a robotic device and a calibration fixture in a vicinity of the robotic device; referencing the calibration fixture to a base of the robotic device to determine a first pose of the robotic device; receiving a 3D image of the environment, wherein the 3D image includes the calibration fixture; determining a second pose of the calibration fixture relative to the sensor; determining a third pose of the robotic device relative to the sensor based on the first pose and the second pose; receiving a plurality of trajectory points; determining a plurality of virtual trajectory points corresponding to the plurality of trajectory points based on the 3D image and the third pose; providing for display of the plurality of virtual trajectory points; and providing an interface for manipulating the virtual trajectory points.

An information processing apparatus including a display unit configured to display a state of a robot system based on first data is characterized in that at least one element of the robot system based on the first data can be outputted with second data that is different from the first data.

Example systems and methods allow for runtime control of robotic devices during a construction process. One example method includes determining at least one sequence of robot operations corresponding to at least one robot actor, causing the at least one robot actor to execute a portion of the at least one sequence of robot operations during a first time period, receiving an interrupt signal from a mobile computing device indicating a modification to the at least one sequence of robot operations, where the mobile computing device is configured to display a digital interface including one or more robot parameters describing the at least one robot actor and one or more tool parameters describing operating characteristics of at least one physical tool, and causing the at least one robot actor to execute a portion of the at least one modified sequence of robot operations during a second time period.

A teaching system configured to teach operation to a plurality of robots includes a first controlling device which determines whether a first robot and a second robot are in an enabled state where the first and second robots are permitted to operate, and when the first controlling device determines as in the enabled state, the first controlling device transmits an enable signal indicative of permitting the second robot to operate and enables the first robot to be taught the operation when a teaching terminal specifies the first robot. When a second controlling device receives the enable signal from the first controlling device and the teaching terminal specifies the second robot, the second controlling device enables the second robot to be taught the operation.

A non-transitory computer-readable storage medium stores a computer program that controls a processor to execute (a) processing of displaying an operation window for operation of a position and an attitude of a control point for a robot arm, (b) processing of storing the position and the attitude of the control point as a teaching point according to an instruction of a user, and (c) processing of associating and storing the operation window when the instruction is received in the processing (b) with the teaching point.

A computer-implemented method, executed by data processing hardware of a robot, includes receiving a three-dimensional point cloud of sensor data for a space within an environment about the robot. The method includes receiving a selection input indicating a user-selection of a target object represented in an image corresponding to the space. The target object is for grasping by an end-effector of a robotic manipulator of the robot. The method includes generating a grasp region for the end-effector of the robotic manipulator by projecting a plurality of rays from the selected target object of the image onto the three-dimensional point cloud of sensor data. The method includes determining a grasp geometry for the robotic manipulator to grasp the target object within the grasp region. The method includes instructing the end-effector of the robotic manipulator to grasp the target object within the grasp region based on the grasp geometry.