A method, device, and system for obtaining time of flight images is provided. A surgical plan may be received and a first path for a first robotic arm and a second path for a second robotic arm may be determined based on the surgical plan. The first robotic arm may be caused to move on the first path and may be configured to hold a transducer. The second robotic arm may be caused to move on the second path and may be configured to hold a receiver. At least one image may be received from the receiver, the image depicting patient anatomy and generated using time-of-flight measurements.

A medical manipulator system including: a placement table on which a patient is placed; at least one manipulator configured to support a treatment tool which is configured to treat the patient, the manipulator configured to adjust a position and an orientation of the treatment tool; a base portion configured to support the manipulator; a sensor configured to detect objects which are present in a predetermined area including the manipulator and the placement table; and a controller including at least one processor, wherein the processor is configured to: calculate degrees of proximity between the objects detected by the sensor and the manipulator, and generate, in case that the calculated degrees of proximity exceed a predetermined threshold, a control signal for preventing interference between the objects and the manipulator.

A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.

An acquisition section 42 acquires a pose at a clock time ti and a pose at a clock time tj for each of plural robots, and acquires structural information. Based on structural information a computation section 44 computes positions of the prescribed part for each of the robots at the clock times ti, tj and at a midway clock times tc. A possibility determination section determines a possibility of interference, based on any overlap between added-margin regions resulting from addition of a prescribed margin to a circumscribing shape containing positions of the prescribed part at the clock times ti, tj, and tc for each of the robots. In cases in which there is a possibility of interference, an end determination section 48 sets tc so as to be a new ti or a new tj, and causes processing of the computation section 44 and the possibility determination section 46 to be executed repeatedly until a spacing between the prescribed parts satisfies an end condition. When determined that the end condition has been satisfied, an interference determination section 50 determines whether or not there is interference between the prescribed parts between the robots at any of the positions at ti, tc, and tj.

An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for optimizing a plan for one or more robots using a process definition graph. One of the methods includes receiving a process definition graph for a robot, the process definition graph having a plurality of action nodes. One or more of the action nodes are motion nodes that represent a motion to be taken by the robot from a respective start location to an end location. It is determined that a motion node satisfies one or more splitting criteria, and in response to determining that the motion node satisfies the one or more splitting criteria, the process definition graph is modified. Modifying the process definition graph includes splitting the motion node into two or more separate motion nodes whose respective paths can be scheduled independently.

A system for controlling a robot. The system includes: an interface that provides data DAT(t) captured by one or more sensors, wherein the data DAT(t) indicate a current state ZUS(t) of the robot, a first processor that is connected to the interface and that is set up to use a first algorithm to check, on the basis of the data DAT(t) and a prescribed state space Z, which indicates exclusively permitted states of the robot, whether it holds that: ZUS(t)Z, wherein in the event of: ZUS(t).Math.Z a first stop signal Sig1 is generated, a unit, connected to the first processor via a data link, for generating a second stop signal Sig2, which generates the second stop signal Sig2 when the unit receives the first stop signal Sig1 or when the unit establishes that the data link is interrupted, a second processor, connected to the interface and the first processor or only to the first processor, that is set up to use a second algorithm to check, on the basis of the data DAT(t) and a prescribed state space Z or a boundary for the state space Z, whether it holds that: ZUS(t)Z, wherein in the event of ZUS(t).Math.Z the second processor prompts an interruption unit to interrupt the data link between the first processor and the unit, and a control unit, connected to the unit, for controlling the robot, which control unit controls/regulates the robot into a prescribed safe state when the second stop signal Sig2 is present.

Accuracy in interference determination between a hand gripping a workpiece and nearby objects is increased. An information processing apparatus includes a measuring unit configured to decide an object to be gripped among a plurality of objects on the basis of a first image of the imaged objects, a specifying unit configured to specify an attention area for determining, when a gripping device grips the object to be gripped, whether the gripping device interferes with objects near the object to be gripped, a controller configured to change an imaging range of an imaging device on the basis of the attention area, and a determination unit configured to determine, when the gripping device grips the object to be gripped, whether the gripping device interferes with the objects near the object to be gripped on the basis of a second image of an object imaged in a changed imaging range.

A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.

A method for implementing machining tasks for an object. The method identifies location coordinates for a plurality of holes. A task file contains the machining tasks. The robotic devices use the task files to perform the machining tasks. A minimum number of positioning stations is determined where a portion of the machining tasks will be performed by the robotic devices. An ordered sequence for performing the machining tasks is calculated and path a path with the near-minimum distance is determined. Robotic control files are created that cause the robotic devices to perform the machining tasks. The robotic control files are output to the robotic devices to perform the machining tasks to form the plurality of holes.