A method for automatically predetermining an intended movement of a manipulator arrangement of a medical system having a medical instrument and a recording means for generating images, wherein the recording means and/or the instrument is guided by the manipulator arrangement. The method includes establishing an intended transformation between a reference stationary in relation to the recording means and a reference stationary in relation to the instrument; monitoring a deviation between the intended transformation and a current transformation between the reference stationary in relation to the recording means and the reference stationary in relation to the instrument; and determining a reset movement of the manipulator arrangement for returning the current transformation to the intended transformation when the deviation satisfies a predetermined condition.

A first characteristic portion of a first workpiece and a second characteristic portion of a second workpiece are previously determined. A characteristic amount detection unit detects a first characteristic amount related to the position of the first characteristic portion and a second characteristic amount related to the position of the second characteristic portion in an image captured by a camera. A calculation unit calculates, as a relative position amount, the difference between the first characteristic amount and the second characteristic amount. A command generation unit generates a movement command for operating a robot based on a relative position amount in the image captured by the camera and a relative position amount in a predetermined reference image.

A first characteristic portion of a first workpiece and a second characteristic portion of a second workpiece are previously determined. A characteristic amount detection unit detects a first characteristic amount related to the position of the first characteristic portion and a second characteristic amount related to the position of the second characteristic portion in an image captured by a camera. A calculation unit calculates, as a relative position amount, the difference between the first characteristic amount and the second characteristic amount. A command generation unit generates a movement command for operating a robot based on a relative position amount in the image captured by the camera and a relative position amount in a predetermined reference image.

In one aspect, the present invention relates to a mobile plant for orienting a tool with respect to a hole, the plant comprising: an arm assembly for supporting a tool, the tool being adapted to be lowered into the hole; a primary sensor for sensing the geographical location of the tool; and a secondary sensor for sensing the location and/or orientation of the hole; wherein the plant is adapted to adjust the position of the tool supported by the arm assembly based on the geographical location sensed by the primary sensor and the location and/or orientation sensed by the secondary sensor, to thereby align the tool supported by the arm assembly with the hole. In other aspects the present invention relates to a plant, to methods of using the plant, and to a boom arm assembly.

A method for visually controlling a robot arm which is displaceable in a plurality of degrees of freedom, the robot arm carrying at least one displaceable reference point, includes the steps of: a) placing at least one camera so that a target point where the reference point is to be placed is contained in an image output by the at least one camera; b) displacing the robot arm so that the reference point is within the image; c) determining a vector which, in the image, connects the reference point to the target point; d) choosing one of the plurality of degrees of freedom, moving the robot arm by a predetermined standard distance in the one degree of freedom, and recording a standard displacement of the reference point within the image resulting from the movement of the robot arm; e) repeating step d) at least until the vector can be decomposed.

A first characteristic portion of a first workpiece and a second characteristic portion of a second workpiece are previously determined. A characteristic amount detection unit detects a first characteristic amount related to the position of the first characteristic portion and a second characteristic amount related to the position of the second characteristic portion in an image captured by a camera. A calculation unit calculates, as a relative position amount, the difference between the first characteristic amount and the second characteristic amount. A command generation unit generates a movement command for operating a robot based on a relative position amount in the image captured by the camera and a relative position amount in a predetermined reference image.

A robot system includes a robot, a vision sensor, a controller, and an input unit. The vision sensor configured to measure a feature point and obtain a measured coordinate value. The controller configured to control the robot. The input unit configured to receive an input from a user toward the controller. The controller obtains, via the input unit, setting information data on a determination point which is different from the feature point. The robot system uses a coordinate value of the determination point and the measured coordinate value, and determines whether the robot is taking a target position and orientation.

A method for visually controlling a robot arm which is displaceable in a plurality of degrees of freedom, the robot arm carrying at least one displaceable reference point, includes the steps of: a) placing at least one camera so that a target point where the reference point is to be placed is contained in an image output by the at least one camera; b) displacing the robot arm so that the reference point is within the image; c) determining a vector which, in the image, connects the reference point to the target point; d) choosing one of the plurality of degrees of freedom, moving the robot arm by a predetermined standard distance in the one degree of freedom, and recording a standard displacement of the reference point within the image resulting from the movement of the robot arm; e) repeating step d) at least until the vector can be decomposed.

A method for automatically predetermining an intended movement of a manipulator arrangement of a medical system having a medical instrument and a recording means for generating images, wherein the recording means and/or the instrument is guided by the manipulator arrangement. The method includes establishing an intended transformation between a reference stationary in relation to the recording means and a reference stationary in relation to the instrument; monitoring a deviation between the intended transformation and a current transformation between the reference stationary in relation to the recording means and the reference stationary in relation to the instrument; and determining a reset movement of the manipulator arrangement for returning the current transformation to the intended transformation when the deviation satisfies a predetermined condition.

A method for line matching during image-based visual servoing control of a robot performing a workpiece installation. The method uses a target image from human demonstration and a current image of a robotic execution phase. A plurality of lines are identified in the target and current images, and an initial pairing of target-current lines is defined based on distance and angle. An optimization computation determines image transposes which minimize a cost function formulated to include both direction and distance between target lines and current lines using 2D data in the camera image plane, and constraint equations which relate the lines in the image plane to the 3D workpiece pose. The rotational and translational transposes which minimize the cost function are used to update the line pair matching, and the best line pairs are used to compute a difference signal for controlling robot motion during visual servoing.