Embodiments described herein provide various examples of a machine-learning-based visual-haptic system for constructing visual-haptic models for various interactions between surgical tools and tissues. In one aspect, a process for constructing a visual-haptic model is disclosed. This process can begin by receiving a set of training videos. The process then processes each training video in the set of training videos to extract one or more video segments that depict a target tool-tissue interaction from the training video, wherein the target tool-tissue interaction involves exerting a force by one or more surgical tools on a tissue. Next, for each video segment in the set of video segments, the process annotates each video image in the video segment with a set of force levels predefined for the target tool-tissue interaction. The process subsequently trains a machine-learning model using the annotated video images to obtain a trained machine-learning model for the target tool-tissue interaction.

A medical robot system, including a robot coupled to an effectuator element with the robot configured for controlled movement and positioning. The system may include a transmitter configured to emit one or more signals, and the transmitter is coupled to an instrument coupled to the effectuator element. The system may further include a motor assembly coupled to the robot and a plurality of receivers configured to receive the one or more signals emitted by the transmitter. A control unit is coupled to the motor assembly and the plurality of receivers, and the control unit is configured to supply one or more instruction signals to the motor assembly. The instruction signals can be configured to cause the motor assembly to selectively move the effectuator element.

A computer implemented method for determining a configuration of a medical robotic arm, wherein the configuration comprises a pose of the robotic arm and a position of a base of the robotic arm, comprising the steps of: —acquiring treatment information data representing information about the treatment to be performed by use of the robotic arm; —acquiring patient position data representing the position of a patient to be treated; and —calculating the configuration from the treatment information data and the patient position data.

In accordance with one embodiment, an automated probe system includes a probe configured to be reversibly inserted into a live body part, a robotic arm attached to the probe and configured to manipulate the probe, a first sensor configured to track movement of the probe during an insertion and a reinsertion of the probe in the live body part, a second sensor configured to track movement of the live body part, and a controller configured to calculate an insertion path of the probe in the live body part based on the tracked movement of the probe during the insertion, and calculate a reinsertion path of the probe based on the calculated insertion path while compensating for the tracked movement of the live body part, and send control commands to the robotic arm to reinsert the probe in the live body part according to the calculated reinsertion path.

The present application relates to a motion control method and system for a mechanical arm and surgical system, the terminal end of the mechanical arm is adapted to carry an effector, the method includes steps of: receiving a first control command from a first input device by a graphical user interface, wherein the first control command is configured to control the mechanical arm to move according to a first movement mode; receiving a second control command from the first input device or a second input device, wherein the second control command is configured to control the mechanical arm to enter a second movement mode; and receiving a third control command from the second input device, wherein the third control command is configured to control the effector to perform a predetermined movement, wherein the first input device and the second input device are separated from each other.

A robotic system includes a robotic manipulator configured to: manipulate a medical instrument having a basket; open the basket at a first opening speed and a second, faster opening speed; and close the basket at a first closing speed and a second, faster closing speed. The system includes an input device configured to receive one or more user interactions and initiate one or more actions by the robotic manipulator, including directly controlled movement and/or pre-programmed motions. Control circuitry of the robotic system is configured to: in response to receiving a first user interaction via the input device, trigger a first pre-programmed motion of the robotic manipulator to open the basket at the second, faster opening speed; and in response to receiving a second user interaction via the input device, trigger a second pre-programmed motion to close the basket at the second, faster closing speed.

A device sized and shaped for insertion into a body comprising: at least one mechanical limb comprising: a support segment; a first flexible section extending from the support segment and terminating in a coupling section; and a second flexible section extending from the coupling section and terminating in a tool or a connector for a tool; wherein a long axis of one or more of the flexible sections is bendable in a single bending plane; wherein a long axis length of the first flexible section is at least double a maximum extent of the first flexible section perpendicular to a flexible section long axis; wherein a long axis length of the second flexible section is at least double a maximum extent of the second flexible section perpendicular to a flexible section long axis.

A surgical instrument is described that includes a surgical effector moving with N degrees of freedom for manipulation of objects at a surgical site during surgical procedures. The N degrees of freedom are manipulated by N+1 input controllers and a plurality of cables, the controllers and cables coupled to the surgical effector and configured to change the orientation of the surgical effector about the N degrees of freedom when actuated. In some embodiments, the N+1 input controllers and plurality of cables are further coupled to a pantograph, the pantograph configured to move in a reciprocal manner to the surgical effector when the input controllers and cables are actuated.

Generally, a sterile adapter for use in robotic surgery may include a frame configured to be interposed between a tool driver and a surgical tool, a plate assembly coupled to the frame, and at least one rotatable coupler supported by the plate assembly and configured to communicate torque from an output drive of the tool driver to an input drive of the surgical tool.

Robotic surgical systems and methods of operating robotic surgical systems are included. The methods include directing light at an optical element configured to be detected by an image capture device of the robotic surgical system, the optical element configured to reflect light having a wavelength within a predetermined range, detecting, using an image capture device capturing images of the optical element, an absence or a presence of the reflected light from the optical element, and providing a notification, in response to the detection by the image capture device of the absence of the reflected light from the optical element.