The present disclosure provides a system and a method for manipulating a robotic device. The system includes a human interface device for obtaining information associated with a position and/or movement of a user's finger using the human interface device; and a robotic device for simulating the position and/or movement of the user's finger in real time. The robotic device is in communication with the human interface device. The operating system of the robotic device of the present disclosure can accurately simulate the functions of human hand.

The present disclosure provides a system and a method for manipulating a robotic device. The system includes a human interface device for obtaining information associated with a position and/or movement of a user's finger using the human interface device; and a robotic device for simulating the position and/or movement of the user's finger in real time. The robotic device is in communication with the human interface device. The operating system of the robotic device of the present disclosure can accurately simulate the functions of human hand.

Embodiments of the present disclosure are directed to methods, computer program products, and computer systems of a robotic apparatus with robotic instructions replicating a food preparation recipe. In one embodiment, a robotic control platform, comprises one or more sensors; a mechanical robotic structure including one or more end effectors, and one or more robotic arms; an electronic library database of minimanipulations; a robotic planning module configured for real-time planning and adjustment based at least in part on the sensor data received from the one or more sensors in an electronic multi-stage process file, the electronic multi-stage process recipe file including a sequence of minimanipulations and associated timing data; a robotic interpreter module configured for reading the minimanipulation steps from the minimanipulation library and converting to a machine code; and a robotic execution module configured for executing the minimanipulation steps by the robotic platform to accomplish a functional result.

Embodiments of the present disclosure are directed to methods, computer program products, and computer systems of a robotic apparatus with robotic instructions replicating a food preparation recipe. In one embodiment, a robotic control platform, comprises one or more sensors; a mechanical robotic structure including one or more end effectors, and one or more robotic arms; an electronic library database of minimanipulations; a robotic planning module configured for real-time planning and adjustment based at least in part on the sensor data received from the one or more sensors in an electronic multi-stage process file, the electronic multi-stage process recipe file including a sequence of minimanipulations and associated timing data; a robotic interpreter module configured for reading the minimanipulation steps from the minimanipulation library and converting to a machine code; and a robotic execution module configured for executing the minimanipulation steps by the robotic platform to accomplish a functional result.

A local haptic hand controller is provided for enabling an operator to remotely perform fine manipulation, such as microsurgery, in conjunction with a remotely located robotic manipulator, for example at which the microsurgery is to be performed. The local haptic hand controller includes a base, a kinematic structure in communication with the base and comprises a gimbal as an end effector. A local surgical tool is provided at the gimbal and has a shape and construction substantially similar to a remote surgical tool provided at the remote robotic manipulator. A control system is in communication with the local surgical tool and with the remote surgical tool, and configured to enable operation of the local haptic hand controller when a local surgical tool identifier matches a remote surgical tool identifier.

A local haptic hand controller is provided for enabling an operator to remotely perform fine manipulation, such as microsurgery, in conjunction with a remotely located robotic manipulator, for example at which the microsurgery is to be performed. The local haptic hand controller includes a base, a kinematic structure in communication with the base and comprises a gimbal as an end effector. A local surgical tool is provided at the gimbal and has a shape and construction substantially similar to a remote surgical tool provided at the remote robotic manipulator. A control system is in communication with the local surgical tool and with the remote surgical tool, and configured to enable operation of the local haptic hand controller when a local surgical tool identifier matches a remote surgical tool identifier.

A robot system includes a slave unit including a slave-side force detector configured to detect a direction and a magnitude of a reaction force acting on a workpiece held by a work end of a slave arm, a master unit including a master-side force detector configured to detect a direction and a magnitude of an operating force applied by an operator to an operation end of a master arm, and a system controller configured to generate a slave operational command and a master operational command based on the operating force and the reaction force. The system controller includes a regulator configured to correct a moving direction of the work end so that the movement of the work end in a pressing direction of an object is regulated when the reaction force exceeds an acceptable value set beforehand.

A robot system includes a slave unit including a slave-side force detector configured to detect a direction and a magnitude of a reaction force acting on a workpiece held by a work end of a slave arm, a master unit including a master-side force detector configured to detect a direction and a magnitude of an operating force applied by an operator to an operation end of a master arm, and a system controller configured to generate a slave operational command and a master operational command based on the operating force and the reaction force. The system controller includes a regulator configured to correct a moving direction of the work end so that the movement of the work end in a pressing direction of an object is regulated when the reaction force exceeds an acceptable value set beforehand.

A bilateral teleoperation system includes: a primary-end operation platform and a secondary-end operation platform. The primary-end operation platform includes: a primary-end support, primary-end mechanical arms, a mechanical hand control assembly, and a first controller, a root end of the primary-end mechanical arm being arranged on the primary-end support, and a tail end of the primary-end mechanical arm being connected to the mechanical hand control assembly. The secondary-end operation platform includes: a secondary-end support, secondary-end mechanical arms, secondary-end mechanical hands, and a second controller, a root end of the secondary-end mechanical arm being arranged on the secondary-end support, and a tail end of the secondary-end mechanical arm being connected to the secondary-end mechanical hand; the primary-end mechanical arm and the secondary-end mechanical arm are homogeneous mechanical arms, and the first controller in the primary-end operation platform is communicatively connected to the second controller in the secondary-end operation platform.

A bilateral teleoperation system includes: a primary-end operation platform and a secondary-end operation platform. The primary-end operation platform includes: a primary-end support, primary-end mechanical arms, a mechanical hand control assembly, and a first controller, a root end of the primary-end mechanical arm being arranged on the primary-end support, and a tail end of the primary-end mechanical arm being connected to the mechanical hand control assembly. The secondary-end operation platform includes: a secondary-end support, secondary-end mechanical arms, secondary-end mechanical hands, and a second controller, a root end of the secondary-end mechanical arm being arranged on the secondary-end support, and a tail end of the secondary-end mechanical arm being connected to the secondary-end mechanical hand; the primary-end mechanical arm and the secondary-end mechanical arm are homogeneous mechanical arms, and the first controller in the primary-end operation platform is communicatively connected to the second controller in the secondary-end operation platform.