A robot system includes a robot main body, memory part configured to store information for causing robot main body to perform given operation, as saved operational information, motion controller configured to control operation of robot main body by using saved operational information as automatic operational information for causing robot main body to operate, and an operation correcting device configured to generate, by being operated, manipulating information for correcting operation of robot main body during operation. Motion controller controls robot main body to perform an operation corrected from operation related to automatic operational information in response to a reception of the manipulating information while robot main body is operating by using automatic operational information. Memory part is configured to be storable of corrected operational information for causing robot main body to perform corrected operation as saved operational information, when robot main body performs corrected operation.

A robot system is provided, which includes a robot body including, robot arm and an end effector attached to robot arm, and operating device, having operating part and configured to output, when operating part is operated, operational information according to operation, a motion controller configured to control operation of robot body according to the operational information outputted from the operating device, a velocity detector configured to detect a velocity at a tip end of the end effector, a virtual reaction-force information generating module configured to output force information containing a first force component having a positive correlation to the velocity at the tip end of the end effector, as virtual reaction-force information, and a force applying device configured to give a force to the operating part in order to make an operator perceive a force according to the virtual reaction-force information outputted from the virtual reaction-force information generating module.

A display system includes an HMD and a PC. The HMD displays an image on a scene in a real space in an overlapped manner. The PC includes a first control unit. The first control unit causes the HMD to display a guide image indicating a direction set based on a robot to correspond to a robot arranged in the real space. On a tool of the robot, a tool coordinate system is set based on the tool. The first control unit displays the guide image indicating the tool coordinate system in accordance with a direction of the tool. The guide image includes an X-axis image, a Y-axis image, and a Z-axis image.

Robot system which includes a master device configured to receive an operating instruction from an operator, slave arm, storage device configured to store operating sequence information that defines processing carried out by slave arm, and control device configured to control operation of slave arm. Control device includes a receiver configured to receive an input signal, motion controller configured to determine whether operating mode of slave arm is to be automatic, manual or correctable automatic mode and control operation of slave arm in determined operating mode, and continuation determinator configured to determine whether continuation of automatic mode is permitted. In a process at which slave arm is scheduled to operate in automatic mode, after motion controller suspends operation of slave arm in automatic mode at a given step of process, continuation determinator determines whether continuation of automatic mode is permitted based on input signal received by receiver when operation is suspended.

A robot main body having a robotic arm, a remote control device which includes a robotic arm operational instruction input part installed outside of a working area and by which an operational instruction for the robotic arm is inputted, and a contactless action detecting part configured to detect a contactless action including at least one given operating condition parameter change instructing action by an operator, a control device communicably connected to the remote control device and configured to control operation of the robot main body.

A method includes providing a virtual representation of an environment of a robot, the virtual representation including an object representation of an object in the environment. The method further includes receiving manipulation input from a user to teleoperate the robot for manipulation of the object. The method also includes alerting the user to an alignment dimension based upon the manipulation input, receiving confirmation input from the user to engage the alignment dimension, and constraining at least one dimension of movement of the object according to the alignment dimension.

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

A display system for performing a predetermined operation with respect to a moving body is disclosed. The display system includes an operation reception unit configured to receive a switching operation to switch an operation mode between a manual operation mode and an autonomous movement mode, the manual operation mode being selected for moving the moving body by manual operation and the autonomous movement mode being selected for moving the moving body by autonomous movement; and a display controller configured to display notification information representing accuracy of the autonomous movement.

A sequence of tracking input samples that are measures of position or orientation of a user interface device, UID, being held by a user, are received. In a prediction phase, a current output sample of a state of linear quadratic estimator, LQE, is computed that is an estimate of the position or orientation of the UID. The current output sample is computed based on i) a previously computed output sample, and ii) a velocity term. In an update phase, an updated output sample of the state of the LQE is computed, based on i) a previously computed output sample from the prediction phase, and ii) a most recent tracking input sample. Other embodiments are also described and claimed.