Systems and methods for automated steering control of a robotic endoscope, e.g., a colonoscope, are provided. The control system may comprise: a) a first image sensor configured to capture a first input data stream comprising a series of two or more images of a lumen; and b) one or more processors that are individually or collectively configured to generate a steering control output signal based on an analysis of data derived from the first input data stream using a machine learning architecture, wherein the steering control output signal adapts to changes in the data of the first input data stream in real time.

A robot arm controller controlling a treatment tool having a robot arm with an electrically driven joint has a driver configured to drive the treatment tool; a manipulator configured to accept a manipulation input for the treatment tool; and a processor. The processor is configured to: store a position of a distal end portion of the treatment tool as a teaching point when a teaching operation is detected from the manipulator, calculate an interpolation curve passing a plurality of teaching points and an interpolation point on the interpolation curve, control the driver to move the distal end portion of the treatment tool to the interpolation point, and store the position of the distal end portion of the treatment tool as a treatment point when a treatment operation is detected from the manipulator. The interpolation curve is updated so as to pass the plurality of teaching points and the treatment point.

Autonomous closed loop control of a flexible tendon-driven continuum manipulator having a sensor at a distal tip is performed by measuring spatial attributes of a sensor at the distal tip and estimating an orientation of a base of an articulating region of the flexible tendon-driven continuum manipulator from a kinematic model and the spatial attributes of the sensor. The manipulator control in a task space uses the estimated orientation, a desired trajectory in the task space, and the position of the sensor at the distal tip. The sensor at the distal tip may be a magnetic sensor, impedance sensor, or optical sensor.

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

A manual robot control by which a reference point of the robot is moved continually in space or positioned on an adjacent snap point depending on the control input.

A method for a robotic surgical system includes displaying a graphical user interface on a display to a user, wherein the graphical user interface includes a plurality of reconfigurable display panels, receiving a user input at one or more user input devices, wherein the user input indicates a selection of at least one software application relating to the robotic surgical system, and rendering content from the at least one selected software application among the plurality of reconfigurable display panels.

An apparatus for providing haptic guidance during manipulation of an end-effector includes a robotic arm. The robotic arm has at least one actuated joint, at least one other joint connected to the at least one actuated joint, and a physical constraint movable by actuation of the at least one actuated joint. The physical constraint limits the motion of the at least one other joint in at least one direction. The apparatus further includes an end-effector configured to be manipulated by an application of external forces and connected to the at least one other joint.

A method includes obtaining an implant plan, defining a range of motion for a surgical tool based on the implant plan, adjusting, by an actuator and based on the range of motion, a passive joint coupled between the actuator and the surgical tool, and allowing manual movement of the surgical tool through the range of motion via rotation at the passive joint.

Provided is a grip tool that allows detecting a slip of an object. The grip tool includes a pair of grip portions that sandwiches to grip an object; an opening/closing mechanism that opens and closes the pair of grip portions; and at least one sensor unit disposed in one or both of the pair of grip portions. The sensor unit includes a plurality of force sensors disposed in a predetermined distribution. The plurality of force sensors each have a function of measuring forces in triaxial directions received from the object. The sensor unit can measure a load distribution received from the object. The slip of the object is detectable based on the load distribution.

The embodiments relate to a method for operating a medical robotic device with an end effector for performing a diagnostic and/or therapeutic measure, involving predetermining at least one position to be reached by the end effector, evaluating at least two movement sequences of the medical robotic device, by which the end effector reaches the respectively predetermined at least one position, using an optimization criterion to select the movement sequence with the best evaluation result as the optimum movement sequence and implementing the optimum movement sequence, so that the respective predetermined position is reached by the end effector, in order to improve the reaching of the predetermined position.