A robot teaching device includes: an image acquisition device configured to acquire, as a moving image, a distance image representing distance information of an imaging object, or a two-dimensional image of the imaging object; a trajectory detection section configured to detect a movement trajectory of an operator's hand depicted as the imaging object in the moving image by using the moving image; an identification section configured to identify whether the detected movement trajectory represents a linear movement or a rotational movement; and a command generation section configured to output a command for translating a predetermined movable part of the robot based on the movement trajectory when the movement trajectory is identified as representing a linear movement, and to output a command for rotating the predetermined movable part based on the movement trajectory when the movement trajectory is identified as representing a rotational movement.

A robot image display method includes (a) a step of recognizing the position and the posture of a base of a robot from a base section image of a base section for teaching, (b) a step of recognizing the position and the posture of a finger section of the robot from a finger section image of a finger section for teaching, (c) a step of calculating angles of one or more joints of the robot from the position and the posture of the base and the position and the posture of the finger section, and (d) a step of displaying, in a virtual space, a three-dimensional image of the robot in a state in which the joints are at the angles calculated in the step (c).

A medical system includes: a slave having at least one moving part; an operation device having at least one operation part; and a processor that controls operations of the slave based on a conversion table that associates operations of the moving part of the slave with inputs of the operation part of the operation device. The processor is programmed to execute: acquiring user identification information of a user of the slave, slave identification information of the slave, and operation device identification information of the operation device, and generating and proposing the conversion table based on the user identification information, the slave identification information, and the operation device identification information.

Systems, methods, and related technologies are disclosed for multi-device robot control. In one implementation, input(s) are received and provided to a personal assistant or another application or service. In response, command(s) directed to an external device are received, e.g., from the personal assistant. Based on the command(s), a robot is maneuvered in relation to a location associated with the external device. Transmission of instruction(s) from the robot to the external device is initiated.

The invention relates to a mobile security basic control device (15) of a robot (1), comprising a hand-held housing (16), an emergency stop switching means (17) arranged at the housing (16), a communication device (18) for establishing a link in terms of control between the mobile security basic control device (15) and a robot controller (12) of the robot (1), and further comprising a holder (19) connected to the housing (16), which is designed to mount the mobile security basic control device (15) on a mobile terminal (20). Said mobile terminal has a terminal control system (21) and a multi-touchscreen (22), which is designed to transmit inputs to the terminal control system (21) via the multi-touchscreen (22). The mobile security basic control device (15) comprises a coding device (25) which, in a state where the mobile security basic control device (15) is mounted on the mobile terminal (20) by means of the holder (19), is designed to automatically transmit at least one identification code identifying the mobile security basic control device (15) to the terminal control system (21) via the multi-touchscreen (22).

The invention relates to a mobile security basic control device (15) of a robot (1), comprising a hand-held housing (16), an emergency stop switching means (17) arranged at the housing (16), a communication device (18) for establishing a link in terms of control between the mobile security basic control device (15) and a robot controller (12) of the robot (1), and further comprising a holder (19) connected to the housing (16), which is designed to mount the mobile security basic control device (15) on a mobile terminal (20). Said mobile terminal has a terminal control system (21) and a multi-touchscreen (22), which is designed to transmit inputs to the terminal control system (21) via the multi-touchscreen (22). The mobile security basic control device (15) comprises a coding device (25) which, in a state where the mobile security basic control device (15) is mounted on the mobile terminal (20) by means of the holder (19), is designed to automatically transmit at least one identification code identifying the mobile security basic control device (15) to the terminal control system (21) via the multi-touchscreen (22).

An augmented reality (AR) system for production-tuning of parameters for a visual tracking robotic picking system. The robotic picking system includes one or more robots configured to pick randomly-placed and randomly-oriented parts off a conveyor belt and place the parts in an available position, either on a second moving conveyor belt or on a stationary device such as a pallet. A visual tracking system identifies position and orientation of the parts on the feed conveyor. The AR system allows picking system tuning parameters including upstream, discard and downstream boundary locations to be visualized and controlled, real-time robot pick/place operations to be viewed with virtual boundaries, and system performance parameters such as part throughput rate and part allocation by robot to be viewed. The AR system also allows virtual parts to be used in simulations, either instead of or in addition to real parts.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a demonstration device for robotic demonstration learning. One of the methods includes generating, by a demonstration device for a robot, a representation of a sequence of states input by a user of the demonstration device. The representation is provided by the demonstration device to a robot execution system. The representation of the sequence of actions is translated into a plurality of robot commands corresponding to the representation of the sequence of states input by the user on the demonstration device. The plurality of robot commands corresponding to the sequence of actions input by the user on the demonstration device are executed. Demonstration data is generated from one or more sensor streams of the robot while executing the plurality of robot commands corresponding to the sequence of actions input by the user on the demonstration device.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a demonstration device for robotic demonstration learning. One of the methods includes generating, by a demonstration device for a robot, a representation of a sequence of states input by a user of the demonstration device. The representation is provided by the demonstration device to a robot execution system. The representation of the sequence of actions is translated into a plurality of robot commands corresponding to the representation of the sequence of states input by the user on the demonstration device. The plurality of robot commands corresponding to the sequence of actions input by the user on the demonstration device are executed. Demonstration data is generated from one or more sensor streams of the robot while executing the plurality of robot commands corresponding to the sequence of actions input by the user on the demonstration device.

A computer-assisted system includes an instrument manipulator assembly including a preload assembly and a motor, an insertion assembly configured to control a position of the instrument manipulator assembly, and a motor controller coupled to the preload assembly. The motor controller is configured to actuate the preload assembly to control an amount of preload applied by the preload assembly to the motor and actuate the preload assembly to apply a low preload in response to detecting that a sterile adapter is mounted to the instrument manipulator assembly.