Methods, apparatus, systems, and computer-readable media are provided for visually annotating rendered multi-dimensional representations of robot environments. In various implementations, an entity may be identified that is present with a telepresence robot in an environment. A measure of potential interest of a user in the entity may be calculated based on a record of one or more interactions between the user and one or more computing devices. In some implementations, the one or more interactions may be for purposes other than directly operating the telepresence robot. In various implementations, a multi-dimensional representation of the environment may be rendered as part of a graphical user interface operable by the user to control the telepresence robot. In various implementations, a visual annotation may be selectively rendered within the multi-dimensional representation of the environment in association with the entity based on the measure of potential interest.

A control system, method and computer program product cooperate to assist control for an autonomous robot. The system includes a communications interface that exchanges information with the autonomous robot. A user interface displays a scene of a location in which the autonomous robot is positioned, and also receives an indication of a user selection of a user selected area within the scene. The communications interface transmits an indication of said user selected area to the autonomous robot for further processing of the area by said autonomous

Method for controlling the operation of at least one machine (1), which is in particular configured to carry out pick-and-place or singulation tasks on objects (2), wherein the machine (1) comprises at least one functional device that comprises at least one functional element for carrying out at least one task, wherein the operation of the machine (1) is controlled on the basis of control information in order to carry out the at least one task, wherein the control information is generated on the basis of a plurality of task parameter types (APT) that relate to the operation of the machine (1) in order to carry out the task, wherein the task parameter types (APT) are stored on at least one data storage device (10) in a linked manner on the basis of predefined links specific to the task parameter types.

Disclosed herein is a computing system that includes a memory and a processor coupled to the memory. The memory storing processor executable instructions for an interface engine that integrates robotic processes into a graphic user interface of the computing system. The processor executes the interface engine to cause the computing device to receive inputs via a menu of the graphic user interface and to automatically determine the robotic processes for display in response to the inputs. The interface engine further generates a list including selectable links corresponding to the robotic processes and displays the list in association with the menu.

A system and method for programming a robot includes providing a 3D representation of workpieces to be handled by the robot, and of a working environment; synthesizing and displaying a view of the working environment comprising an image of the workpieces at respective initial positions; identifying matching features of the selected workpiece and of the working environment which are able to cooperate to hold the workpiece in a final position in the working environment, and a skill by which the matching features can be brought to cooperate; identifying an intermediate position from where applying the skill to the workpiece moves the workpiece to the final position; and adding to a motion program for the robot a routine for moving the workpiece from its initial position to the intermediate position and for applying the skill to the workpiece at the intermediate position.

The disclosure provides a method for generating a joint command. The method includes receiving a maneuver script including a plurality of maneuvers for a legged robot to perform where each maneuver is associated with a cost. The method further includes identifying that two or more maneuvers of the plurality of maneuvers of the maneuver script occur at the same time instance. The method also includes determining a combined maneuver for the legged robot to perform at the time instance based on the two or more maneuvers and the costs associated with the two or more maneuvers. The method additionally includes generating a joint command to control motion of the legged robot at the time instance where the joint command commands a set of joints of the legged robot. Here, the set of joints correspond to the combined maneuver.

A display part of a mobile terminal displays an operation program. The operation program includes an operation icon indicating an operation of a robot or an operation tool, and an auxiliary icon having a shape sandwiching the operation icon. The auxiliary icon indicates control of adding an operation of the robot apparatus. The display part is configured to display a screen configured to set setting information related to the operation of the robot apparatus in such a manner that as operator is enabled to set the setting information. The display part displays the operation icon and the auxiliary icon so as to align the operation icon and the auxiliary icon in order of the operations of the robot apparatus.

A dual-arm robot assembling system including a controlling unit, a GUI, a first robotic-arm, and a second robotic-arm is disclosed. The GUI provides a graphic program editing page, which provides multiple instruction blocks used for editing a graphical program executed by the assembling system. At least one of the first robotic arm and the second robotic arm is disposed with a point-teaching tool thereon. Before the controlling unit controls the two robotic arms to perform an assembling operation based on the graphical program, a manager may directly drag the two robotic arms through the point-teaching tool, so as to implement a point-teaching procedure for the two robotic arms. Therefore, the assembling system may accomplish the assembling operation through the two robotic arms with cooperative movement.

A program generation device includes a display; at least one memory configured to store an operation symbol including information in relation to an operation command of a robot, and an auxiliary symbol including information in relation to a control command for adding an operation of the robot or for correcting the operation of the robot defined by at least one operation symbol; and at least one processor configured to obtain information in relation to setting of at least one of the operation symbol or the auxiliary symbol, and cause the display to display the operation symbol and the auxiliary symbol so as to align the operation symbol and the auxiliary symbol in order of operations of the robot based on the obtained information in relation to setting.

An information providing device has an operation program using information on a structure related to a work robot and information on a processing model related to the structure to execute processing of the processing model by the structure in a virtual space. In addition, the information providing device includes a control section for acquiring data of a development target object including at least one of a new structure and a new processing model from an information processing device used by a developer, executing the operation program using the acquired data of the development target object to execute processing by the development target object in the virtual space, and outputting a processing result by the development target object.