A robot includes: a local coordinate system deriving portion which derives a local coordinate system having two shafts which are parallel to a work plane and orthogonal to each other, based on an image in which markers illustrating three or more points on the work plane which is not horizontal are captured; and a control parameter obtaining portion which obtains control parameters via the local coordinate system.

A method and an electronic device for calibrating a robot. The method includes obtaining at least two sets of positional data of a first reference point in a base coordinate system of the robot, the first reference point fixedly arranged on the external axis, the at least two sets of positional data corresponding to at least two positions of the first reference point during movement of the external axis. The method includes determining a transformation relationship between the base coordinate system and an user coordinate system of the external axis according to the at least two sets of positional data, determining the calibrated user coordinate system based on the base coordinate system and the transformation relationship, and controlling the robot to process an object arranged on the external axis under the calibrated user coordinate system.

An interference avoidance device is provided with: a three-dimensional sensor that is attached to a tip portion of a robot arm and acquires a distance image of an area around a robot; a position data creating portion that converts coordinates of a nearby object in the distance image to coordinates on a robot coordinate system and creates the position data of the nearby object based on the coordinates of the nearby object on the robot coordinate system; a storage portion that stores the position data; and a control portion that controls the robot based on the robot coordinate system; and the control portion controls the robot to avoid interference of the robot with the nearby object, based on the position data stored in the storage portion.

Systems and methods for inter-arm registration include a computer-assisted system having a control unit coupled to a repositionable arm of a computer-assisted device. The control unit is configured to: receive, from an imaging device, successive images of an instrument mounted to the repositionable arm; determine an observed velocity of a feature of the instrument; determine an expected velocity of the feature of the instrument based on kinematics of the repositionable arm; transform the observed velocity and/or the expected velocity to a common coordinate system using a registration transform; determine an error between directions of the observed and expected velocities in the common coordinate system; and update the registration transform based on the determined error. In some embodiments, the instrument is a medical instrument and the imaging device is an endoscope. In some embodiments, the control unit is further configured to control the instrument using the registration transform.

A robot includes an instruction receiving unit that receives a calibration initiation instruction, and an arm that changes a positional relationship between a marker which indicates a reference point and a capturing unit when the calibration initiation instruction is received, in which the calibration of a coordinate system of the capturing unit and a coordinate system of the robot is performed on the basis of an image in which the marker is captured by the capturing unit after the positional relationship between the capturing unit and the marker changes.

Various technologies described herein pertain to automatic in-situ calibration and registration of a depth sensor and a robotic arm, where the depth sensor and the robotic arm operate in a workspace. The robotic arm can include an end effector. A non-parametric technique for registration between the depth sensor and the robotic arm can be implemented. The registration technique can utilize a sparse sampling of the workspace (e.g., collected during calibration or recalibration). A point cloud can be formed over calibration points and interpolation can be performed within the point cloud to map coordinates in a sensor coordinate frame to coordinates in an arm coordinate frame. Such technique can automatically incorporate intrinsic sensor parameters into transformations between the depth sensor and the robotic arm. Accordingly, an explicit model of intrinsics or biases of the depth sensor need not be utilized.

A control apparatus that is connectable to a memory that stores computer-readable instructions, comprising a processor that is configured to execute the computer-readable instructions so as to control driving of a robot and a camera, create setting details on an image processing sequence containing image processing of a captured image captured by the camera, and setting details on a calibration of correlating a coordinate system of the robot and a coordinate system of the camera, and call up the image processing sequence in creation of the setting details on the calibration.

A control device, which controls a robot including a movable portion provided with a tool including a marker, includes: an obtaining portion which obtains a first captured image obtained by capturing an image of the marker by a movable first image capturing portion that captures an image of the marker; and a control portion which performs first corresponding between a coordinate system of the first image capturing portion and a coordinate system of the robot based on the first captured image obtained by the obtaining portion after the first image capturing portion has moved.

A robot includes an arm, and the arm is controlled using an offset of a reference point of a tool, the tool being attached to the arm, the offset being set based on a first state, in which a first image, in which the reference point is located at a control point of an image, can be taken by a imaging section, and a second state, in which a second image, in which the tool is rotated around a rotational axis passing through a position of the reference point in the state in which the reference point is located at the control point, can be taken by the imaging section, and controlled based on a third image, which is taken by the imaging section, and in which the control point is shifted from the reference point, in a process of a transition from the first state to the second state.

A robot includes a movable part, and the movable part performs an action based on a position of a first marker obtained using first position and attitude of the movable part when a first image containing the first marker is captured by an imaging unit provided in the movable part and second position and attitude of the movable part when a second image containing the first marker is captured by the imaging unit.