An approach to positioning one or more robotic arms in an assembly system may be described herein. For example, an apparatus may include a first robotic arm having a distal end and a proximal end. The distal end may be configured for movement and the proximal end may secure the first robotic arm. The apparatus may further include a camera connected with the distal end of the first robotic arm. The camera may be configured to capture image data of a marker connected with a second robotic arm and provide the image data to a computer. The computer may generate a set of instructions for the first robotic arm based on the image data of the marker. The movement of the first robotic arm may be caused by the computer according to the generated set of instructions.

A method for automatically predetermining an intended movement of a manipulator arrangement of a medical system having a medical instrument and a recording means for generating images, wherein the recording means and/or the instrument is guided by the manipulator arrangement. The method includes establishing an intended transformation between a reference stationary in relation to the recording means and a reference stationary in relation to the instrument; monitoring a deviation between the intended transformation and a current transformation between the reference stationary in relation to the recording means and the reference stationary in relation to the instrument; and determining a reset movement of the manipulator arrangement for returning the current transformation to the intended transformation when the deviation satisfies a predetermined condition.

An approach to positioning one or more robotic arms in an assembly system may be described herein. For example, an apparatus may include a first robotic arm having a distal end and a proximal end. The distal end may be configured for movement and the proximal end may secure the first robotic arm. The apparatus may further include a camera connected with the distal end of the first robotic arm. The camera may be configured to capture image data of a marker connected with a second robotic arm and provide the image data to a computer. The computer may generate a set of instructions for the first robotic arm based on the image data of the marker. The movement of the first robotic arm may be caused by the computer according to the generated set of instructions.

A method for automatically predetermining an intended movement of a manipulator arrangement of a medical system having a medical instrument and a recording means for generating images, wherein the recording means and/or the instrument is guided by the manipulator arrangement. The method includes establishing an intended transformation between a reference stationary in relation to the recording means and a reference stationary in relation to the instrument; monitoring a deviation between the intended transformation and a current transformation between the reference stationary in relation to the recording means and the reference stationary in relation to the instrument; and determining a reset movement of the manipulator arrangement for returning the current transformation to the intended transformation when the deviation satisfies a predetermined condition.

System and methods for controlling a robotic medical tool are provided. The system includes the robotic medical tool, a motion capture device, and a controller. The motion capture device is configured to capture a motion of an object. The controller is configured to adjust the robotic tool relative to the object as a function of the captured motion.

Provided is a control system that controls an imaging condition of a camera equipped on a robot to capture an image in which a blur is suppressed.

The control system includes a robot control unit that controls a motion of the robot equipped with the camera, and a camera control unit that controls an imaging operation of the camera. The camera control unit determines an exposure time for suppressing a blur that occurs in a captured image of the camera within an allowable pixel number for the moving speed of the camera, and in a case where the camera control unit cannot set the exposure time, the camera control unit instructs the robot control unit to update a speed limit value of the robot.

A system and a method for carrying out a teleoperative process, wherein an image recording device and a tool are used. The tool may be guided by a first manipulator, and a currently captured region of the image recording device is determined. Monitoring the position of the tool relative to the currently captured region of the image recording device makes it possible to prevent the tool from unintentionally leaving the captured region. The axes of the manipulator are provided with sensors for detecting the forces and/or torques acting on the axes.

A controller is provided for performing dynamic grasping of a target object using visual sensory inputs. The controller includes a robotic interface connected to a robotic arm including links connected by joints having actuators and encoders, and a gripper of the end-effector of the robotic arm configured to grasp the target object in response to robot control signals, and a vision sensor configured to continuously provide visual observations for tracking poses of the target object in a workspace and compute grasp poses, wherein the vision sensor is mounted on a distal end of the robotic arm adjacent to the gripper. The controller trains the Eye-on-Hand reinforcement learner policy, tracks the poses of the target object, and generates robot control signals to follow the target object while keeping it in the field of view of the vision sensor and grasp the target object in the workspace.