A robot control system includes circuitry configured to: generate a command to a robot; receive a frame image in which a capture position changes according to a motion of the robot based on the command; extract a partial region from the frame image according to the command; superimpose a delay mark on the partial region to generate an operation image; and display the operation image on a display device, so as to represent a delay of the motion of the robot with respect to the command.

An operation system including: a prediction unit configured to determine a predicted value of a motion of an operator at a prediction time that is a time after elapse of a prediction time interval from the present using a predetermined machine learning model from a biomedical signal of the operator; a control unit configured to control a motion of a robot on the basis of the predicted value; and a prediction time setting unit configured to determine the prediction time interval on the basis of a delay time from a current value of the motion of the operator to the motion of the robot.

An operation system and an operation method that may improve operability are provided. The operation system includes a circuitry configured to determine a predicted value of an operator motion after a predetermined prediction latency from a current time based on a bio-signal using a prescribed machine learning model, the bio-signal captured from the operator and a controller configured to control a motion of a robot based on the predicted value. The operation method includes a step of determining a predicted value of an operator motion after a predetermined latency from the current time based on a bio-signal using a prescribed machine learning model, the bio-signal captured from the operator, and a step of controlling a motion of a robot on the predicted value.

A robotic medical device system includes a robotic medical device and a controller. The controller is configured to control, in response to one or more control signals, movement of the robotic medical device to maintain a substantially constant overshoot for different step responses of the robotic medical device system independent of variations in a delay associated with control of the robotic medical device, the one or more control signals received via a network.

An operation system including: a prediction unit configured to determine a predicted value of a motion of an operator at a prediction time that is a time after elapse of a prediction time interval from the present using a predetermined machine learning model from a biomedical signal of the operator; a control unit configured to control a motion of a robot on the basis of the predicted value; and a prediction time setting unit configured to determine the prediction time interval on the basis of a delay time from a current value of the motion of the operator to the motion of the robot.

When a control message is determined and sent from a master system to a slave system, the control message is accompanied with a time stamp, indicative of the master model version of the environment which was applied when the control data was determined by the master system. When data, triggered by data provided from the environment to the slave system in the form of updated sensor data is provided from the slave system to the master system, also that data, indicative of an updated slave model version of the environment made by the slave system, is provided to the master system, together with a time stamp, indicative of when the update of the slave model version was made. By applying the suggested time stamp, a coordination of model versions can be obtained between the master system and the slave system.

A robot is configured to move in accordance with an operation instruction made by an operator via a network. The robot includes a moving image acquisition unit, a receiving unit, a movement destination predicting unit, and an autonomous control unit. The moving image acquisition unit is configured to capture, as a moving image, an environment around the robot. The receiving unit is configured to receive the operation instruction. The movement destination predicting unit is configured to predict a movement destination of the robot based on the operation instruction received by the receiving unit. The autonomous control unit is configured to autonomously correct movement to the movement destination in accordance with the operation instruction, based on information on the environment obtained from a moving image at an instant when the operation instruction is received.

A method for using a control center at a remote site to control operation of a robotic medical device system at a local site includes transmitting a control signal from the control center to the robotic medical device system, determining a delay in transmission of the control signal, comparing the delay to a threshold delay value and operating the robotic medical device system based on the comparison of the delay to the threshold delay value.

A method includes presenting a virtual representation of an environment of a robot, receiving a first user command to control the robot within the environment, rendering a predicted version of the virtual representation during a period of latency in which current data pertaining to the environment of the robot is not available, updating the predicted version of the virtual representation based upon a second user command received during the period of latency, and upon conclusion of the period of latency, reconciling the predicted version of the virtual representation with current data pertaining to the environment of the robot.

A haptic transmission system includes a master device and a slave device. The master device controls position and force in an operation of the master device based on information acquired from the operation of the master device and information relating to a response of the slave device, and compensates for a communication delay in a communication path with respect to the control of force. The slave device controls speed and force in an operation of the slave device based on information acquired from the operation of the slave device and information relating to control from the master device.