Embodiments of the present disclosure provide a system, method, apparatus and computer-readable medium for teleoperation. An exemplary system includes a robot machine having a machine body, at least one sensor, at least one robot processor, and at least one user processor operable to maintain a user simulation model of the robot machine and the environment surrounding the robot machine, the at least one user processor being remote from the robot machine. The system further includes at least one user interface comprising a haptic user interface operable to receive user commands and to transmit the user commands to the user simulation model, a display operable to display a virtual representation of the user simulation model.

A virtual wall system for a robot includes: a movement device, configured to control a robot to move; a first electronic map, configured to describe information on environment where the robot is located; a virtual wall module, configured to form a virtual wall to divide the first electronic map into zones; a storage device, configured to store the first electronic map of the environment where the robot is located.

A position/force controller includes a function-dependent force/speed distribution conversion unit that, on the basis of speed, position and force information relating to a position based on an action of an actuator and control reference information, performs a conversion to distribute control energy to at least one of speed or position energy and force energy according to a function that is being realized. A control amount calculation unit calculates at least one of a speed or position control amount and a force energy on the basis of at least one of the speed or position energy and the force energy distributed by the force/speed distribution conversion unit. An integration unit integrates speed or position control amount with force control amount and, to return an output to the actuator, performs a reverse conversion on the speed or position control amount and the force control amount and determines an input to the actuator.

A method, apparatus and a system are disclosed for robotic programming. In at least one embodiment of a method for robotic programming, the method includes receiving, from a controller of a robot, movement parameters reflecting movement of the robot manipulated by a user; making a first data model of a robot move, according to the movement parameters; calculating, upon the first data model touching a second data model of a virtual object, parameters of a first force to be fed back to the user for feeling touch by the robot on a physical object corresponding to the virtual object; and sending the parameters of the first force to the controller of the robot, to drive the robot to feed back the first force to the user.

A position/force controller includes a function-dependent force/speed distribution conversion unit that, on the basis of speed, position and force information relating to a position based on an action of an actuator and control reference information, performs a conversion to distribute control energy to at least one of speed or position energy and force energy according to a function that is being realized. A control amount calculation unit calculates at least one of a speed or position control amount and a force energy on the basis of at least one of the speed or position energy and the force energy distributed by the force/speed distribution conversion unit. An integration unit integrates speed or position control amount with force control amount and, to return an output to the actuator, performs a reverse conversion on the speed or position control amount and the force control amount and determines an input to the actuator.

Apparatus and methods for defining and utilizing virtual fixtures for haptic navigation within real-world environments, including underwater environments, are provided. A computing device can determine a real-world object within a real-world environment. The computing device can receive an indication of the real-world object. The computing device can determine a virtual fixture that corresponds to the real-world object based on the indication, where aspects of the virtual fixture are configured to align with aspects of the real-world object. The computing device can provide a virtual environment for manipulating the robotic tool to operate on the real-world object utilizing the virtual fixture. The virtual fixture is configured to provide haptic feedback based on a position of a virtual robotic tool in the virtual environment that corresponds to the robotic tool in the real-world environment.

A position/force controller performs: detecting information relating to a position based on the effect of an actuator; converting by distributing control energy to speed or positional energy and force energy in response to functions realized on the basis of speed (position) and force information corresponding to the information relating to the position and on the basis of information serving as a reference for control; calculating the control amount for speed or position on the basis of the speed or positional energy; calculating the force control amount on the basis of the force energy; and integrating the speed or position control amount and the force control amount and performing a reverse conversion on the speed or position control amount and the force control amount to return the output to the actuator, to determine the input to the actuator.

A robotic system and methods are provided. The robotic system comprises a tool and a manipulator with links for moving the tool. A controller implements a virtual simulation wherein the tool is represented as a virtual volume interacting with a virtual boundary defined by a mesh of polygonal elements. The controller computes a reactive force responsive to penetration of polygonal elements by the virtual volume. The reactive force is computed based on a penetration factor being a function of a geometry of the virtual volume bound relative to a geometry of the polygonal element. The controller applies the reactive force to the virtual volume to reduce penetration of the polygonal element by the virtual volume. The controller commands the manipulator to move the tool in accordance with application of the reactive force to the virtual volume to constrain movement of the tool relative to the virtual boundary.

Methods and systems for enabling human-machine collaborations include a generalizable framework that supports dynamic adaptation and reuse of robotic capability representations and human-machine collaborative behaviors. Specifically, a method of feedback-enabled user-robot collaboration includes obtaining a robot capability that models a robot's functionality for performing task actions, specializing the robot capability with an information kernel that encapsulates task-related parameters associated with the task actions, and providing an instance of the specialized robot capability as a robot capability element that controls the robot's functionality based on the task-related parameters. The method also includes obtaining, based on the robot capability element's user interaction requirements, user interaction capability elements, via which the robot capability element receives user input and provides user feedback, controlling, based on the task-related parameters, the robot's functionality to perform the task actions in collaboration with the user input; and providing the user feedback including task-related information generated by the robot capability element in association with the task actions.

Methods and systems for enabling human-machine collaborations include a generalizable framework that supports dynamic adaptation and reuse of robotic capability representations and human-machine collaborative behaviors. Specifically, a method of feedback-enabled user-robot collaboration includes obtaining a robot capability that models a robot's functionality for performing task actions, specializing the robot capability with an information kernel that encapsulates task-related parameters associated with the task actions, and providing an instance of the specialized robot capability as a robot capability element that controls the robot's functionality based on the task-related parameters. The method also includes obtaining, based on the robot capability element's user interaction requirements, user interaction capability elements, via which the robot capability element receives user input and provides user feedback, controlling, based on the task-related parameters, the robot's functionality to perform the task actions in collaboration with the user input; and providing the user feedback including task-related information generated by the robot capability element in association with the task actions.