Embodiments of the present disclosure provide a system, method, apparatus and computer-readable medium for teleoperation. An exemplary system includes a robot machine having a machine body, at least one sensor, at least one robot processor, and at least one user processor operable to maintain a user simulation model of the robot machine and the environment surrounding the robot machine, the at least one user processor being remote from the robot machine. The system further includes at least one user interface comprising a haptic user interface operable to receive user commands and to transmit the user commands to the user simulation model, a display operable to display a virtual representation of the user simulation model.

There is provided a robot simulation part device which can facilitate the setting of parameters of force control. A robot simulation device for simulating a force control operation which is performed while bringing a tool part mounted on a robot manipulator into contact with a target workpiece includes a memory which stores a motion program and a force control parameter, which is a set parameter related to the force control operation, and a force control simulation execution part which executes a simulation of the force control operation based on the motion program and the force control parameter, wherein the force control simulation execution part has a virtual force generation part configured to generate, based on position information of the tool part obtained from results of the simulation of the force control operation, a virtual force received by the tool part from the target workpiece in a state in which the tool part is in contact with the target workpiece, and executes the simulation of the force control operation based on the virtual force and a target force set as the force control parameter.

A method, apparatus and a system are disclosed for robotic programming. In at least one embodiment of a method for robotic programming, the method includes receiving, from a controller of a robot, movement parameters reflecting movement of the robot manipulated by a user; making a first data model of a robot move, according to the movement parameters; calculating, upon the first data model touching a second data model of a virtual object, parameters of a first force to be fed back to the user for feeling touch by the robot on a physical object corresponding to the virtual object; and sending the parameters of the first force to the controller of the robot, to drive the robot to feed back the first force to the user.

A management server according to an embodiment includes a communication part, an acquisition part, an intention estimation part, and a motion control part. The communication part communicates with one or more robot devices and one or more operation terminals that remotely operate at least one of the one or more robot devices via a network. The acquisition part acquires an operation content inputted by the operation terminal. The intention estimation part estimates an intention of an operator of the operation terminal based on the operation content acquired by the acquisition part. The motion control part controls a motion of the robot device based on an intention result estimated by the intention estimation part.

Robotic systems and methods employ a virtual simulation wherein a tool is represented as a virtual volume adapted to interact relative to a virtual boundary defined by a mesh of polygonal elements. A reactive force is computed in response to penetration of one of the polygonal elements by the virtual volume in the virtual simulation. The reactive force is computed as a function of a volume of a penetrating portion of the virtual volume that is penetrating a plane of the polygonal element. The reactive force is applied to the virtual volume in the virtual simulation for reducing penetration of the polygonal element by the virtual volume.

A robotic system and methods are provided. The robotic system includes a tool and a manipulator with links for moving the tool. A controller implements a virtual simulation wherein the tool is represented as a virtual volume interacting with a virtual boundary defined by a mesh of polygonal elements. The controller computes a reactive force responsive to penetration of polygonal elements by the virtual volume. The reactive force is computed based on a penetration factor being a function of a geometry of the virtual volume bound relative to a geometry of the polygonal element. The controller applies the reactive force to the virtual volume to reduce penetration of the polygonal element by the virtual volume. The controller commands the manipulator to move the tool in accordance with application of the reactive force to the virtual volume to constrain movement of the tool relative to the virtual boundary.

Described is system for tele-robotic operations over time-delayed communication links. Sensor data is acquired from at least one sensor for sensing surroundings of a robot having at least one robotic arm for manipulating an object. A three-dimensional model of the sensed surroundings is generated, and the sensor data is fit to the three-dimensional model. Using the three-dimensional model, a user demonstrates a movement path for the at least one robotic arm. A flow field representing the movement path is generated and combined with obstacle-repellent forces to provide force feedback to the user through a haptic device. The flow field comprises a set of parameters, and the set of parameters are transmitted to the robot to execute a movement of the at least one robotic arm for manipulating the object.

Robotic systems and methods employ a virtual simulation wherein a tool is represented as a virtual volume adapted to interact relative to a virtual boundary defined by a mesh of polygonal elements. A reactive force is computed in response to penetration of one of the polygonal elements by the virtual volume in the virtual simulation. The reactive force is computed as a function of a volume of a penetrating portion of the virtual volume that is penetrating a plane of the polygonal element. The reactive force is applied to the virtual volume in the virtual simulation for reducing penetration of the polygonal element by the virtual volume.

Disclosed herein are techniques including a robotic manipulator including a surgical tool to interface with and rotate the screw about a rotational axis. A haptic device includes an actuator and a rotational interface coupled to the actuator and the rotational interface is manually manipulatable by a hand of an operator. One or more controllers control movement of the robotic manipulator to maintain the rotational axis of the surgical tool along a planned trajectory; autonomously control the surgical tool to rotate the screw at a rotational rate about the rotational axis and to linearly advance the screw at an advancement rate according to a known thread geometry of the screw; obtain a measurement indicative of a present interaction between the screw and the target site; and control the actuator of the haptic device to enable the rotational interface to emulate the present interaction between the screw and the target site.

Methods and systems for enabling human-machine collaborations include a generalizable framework that supports dynamic adaptation and reuse of robotic capability representations and human-machine collaborative behaviors. Specifically, a method of feedback-enabled user-robot collaboration includes obtaining a robot capability that models a robot's functionality for performing task actions, specializing the robot capability with an information kernel that encapsulates task-related parameters associated with the task actions, and providing an instance of the specialized robot capability as a robot capability element that controls the robot's functionality based on the task-related parameters. The method also includes obtaining, based on the robot capability element's user interaction requirements, user interaction capability elements, via which the robot capability element receives user input and provides user feedback, controlling, based on the task-related parameters, the robot's functionality to perform the task actions in collaboration with the user input; and providing the user feedback including task-related information generated by the robot capability element in association with the task actions.