Disclosed are various embodiments of a three-dimensional perception and object manipulation robot gripper configured for connection to and operation in conjunction with a robot arm. In some embodiments, the gripper comprises a palm, a plurality of motors or actuators operably connected to the palm, a mechanical manipulation system operably connected to the palm, a plurality of fingers operably connected to the motors or actuators and configured to manipulate one or more objects located within a workspace or target volume that can be accessed by the fingers. A depth camera system is also operably connected to the palm. One or more computing devices are operably connected to the depth camera and are configured and programmed to process images provided by the depth camera system to determine the location and orientation of the one or more objects within a workspace, and in accordance therewith, provide as outputs therefrom control signals or instructions configured to be employed by the motors or actuators to control movement and operation of the plurality of fingers so as to permit the fingers to manipulate the one or more objects located within the workspace or target volume. The gripper can also be configured to vary controllably at least one of a force, a torque, a stiffness, and a compliance applied by one or more of the plurality of fingers to the one or more objects.

A robotic process automation system includes a server processor that performs an automation task to process a work item, by initiating a java virtual machine on a second device. A first user session that employs credentials of a first user for managing execution of the automation task is also initiated on the second device. The server processor loads into the java virtual machine, with a platform class loader, one or more modules, such as logging and security, that perform functions common to the sets of task processing instructions. A first class loader a first set of task processing instructions is also loaded. Then each instruction in the first set of task processing instructions is loaded with a separate class loader. The server processor causes execution, under control of the first user session, on the second device, the task processing instructions that correspond to the work item.

A processor-based system provides a user interface to facilitate generation of motion planning graphs or roadmaps, for example via autonomous generate of additional poses, for example neighboring poses, based on specified seed or origin pose, and/or generate or sub-lattice connecting poses and/or edges to couple separate regions or sub-lattices of the motion planning graph together. Such may include performing collision-checking and/or kinematic checking (e.g., taking into account kinematic constraints of robots being modeled). The resulting motion planning graphs or roadmaps are useful in controlling robots during runtime. Robots may include robots with appendages and/or robots in the form of autonomous vehicles.

A method of supporting creation of a program for supporting creation of a program for work by a robot, includes detecting an operation by a user on an input device, determining a type of the work by the operation to select the type, displaying a dedicated motion flow showing a sequence of motion of the robot corresponding to the type and containing a dedicated object showing the motion for which a change of the sequence is not allowed on a display device, and converting the dedicated object into a versatile object showing the motion for which a change of the sequence is allowed by the operation to convert the dedicated object.

A method for supporting creation of a program for supporting creation of a program for a robot that performs work on an object by force control for controlling a force acting on the object to be a target force, includes displaying a mark having an aspect indicating the target force on a display device, changing the aspect of the mark according to an operation on an input device by a user, and presenting a parameter in the force control corresponding to the aspect of the mark to the user.

A robot program generation apparatus that selects a typical arrangement pattern of a robot system; selects elements to be arranged in the arrangement pattern; automatically generates a layout where the elements in a stationary state do not interfere with each other; automatically generates a robot program in accordance with task details corresponding to the arrangement pattern and with the layout; executes the robot program in a virtual environment and automatically modifies installation positions of the elements in the layout based on whether or not the robot in an operating state interfere with any other elements and on whether or not the robot can reach a workpiece; and corrects the robot program based on the installation positions.

In some embodiments, a robotic process automation (RPA) design application provides a user-friendly graphical user interface that unifies the design of automation activities performed on desktop computers with the design of automation activities performed on mobile computing devices such as smartphones and wearable computers. Some embodiments connect to a model device acting as a substitute for an actual automation target device (e.g., smartphone of specific make and model) and display a model GUI mirroring the output of the respective model device. Some embodiments further enable the user to design an automation workflow by directly interacting with the model GUI.

The present invention relates to a method for controlling a robot, the method including usage of a behavior tree architecture for tasks performed by the robot. The present invention also relates to a system comprising a data processing means adapted to carry out the method, wherein the system preferably comprises a robot. The present invention also relates to a use of a behavior tree architecture for programming, supervision, introspection and/or debugging.

Embodiments included herein are directed towards a system and method for robotic control. The system may include a graphical user interface configured to allow a user to access a data storage unit associated with a robot. The system may further include a configurable portion including the data storage unit, a manipulator controller, and a data transfer layer. The system may also include a generic portion configured to parse the configurable portion to generate a robotic controller.

One embodiment can provide a method and system for configuring a robotic system. During operation, the system can present to a user on a graphical user interface an image of a work scene comprising a plurality of components and receive, from the user, a sequence of operation commands. A respective operation command can correspond to a pixel location in the image. For each operation command, the system can determine, based on the image, a task to be performed at a corresponding location in the work scene and generate a directed graph based on the received sequence of operation commands. Each node in the directed graph can correspond to a task, and each directed edge in the directed graph can correspond to a task-performing order, thereby facilitating the robotic system to perform a sequence of tasks based on the sequence of operation commands.