A method and apparatus for supplying cables to robots at non-static locations. A work platform for supporting one or more humans is positioned above a base platform for supporting one or more are robots independently of the work platform. A cable carrier system for providing cables to the robots is positioned underneath the work platform and above the base platform.

A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.

A method and apparatus for supplying cables to robots at non-static locations. A base platform is provided, and a work platform is positioned above the base platform for supporting one or more humans. One or more are robots supported on the base platform independently of the work platform. A cable carrier system is positioned above the base platform and underneath the work platform for providing cables to the robots.

A method and system for picking articles from a collection of articles and arranging articles into placement locations, includes capturing an image with a first vision system from a collection of articles at a first pick location and determining coordinate data for at least some of the articles in the collection of articles. The coordinate data for an article in the collection of articles is provided to a first robotic manipulator. That article is picked from the collection of articles with the first robotic manipulator according to the coordinate data for that article and that article placed at a first place location. The position and orientation data of that article are obtained at a second pick location and provided along with a desired position and orientation of that article at a second place location to a second robotic manipulator. That article is picked with the second robotic manipulator using the position and orientation data of that article at the second pick location and that article is placed at the second place location at the desired position and orientation.

A robotic system may comprise a first robotic arm operatively coupleable to a first tool. The first tool has a first working end. The system may also comprise an image capture device, a display, and a processor. The processor may be configured to cause an image of a work site, which was captured by the image capture device from a perspective of an image reference frame, to be displayed on the display. The image of the work site includes an image of the first working end of the first tool. The processor may also determine a position of the first working end of the first tool in the image of the work site and render a tool information overlay at the position of the first working end of the first tool in the image of the work site. The tool information overlay visually indicates state information for the first tool. The processor may also change the tool information overlay while the first tool is in a first operational state by changing a brightness of the tool information overlay.

An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.

An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.

The invention relates to a system for controlling a robot. The system includes: an interface that provides data DAT(t) captured by one or more sensors, wherein the data DAT(t) indicate a current state ZUS(t) of the robot, a first processor that is connected to the interface and that is set up to use a first algorithm to check, on the basis of the data DAT(t) and a prescribed state space Z, which indicates exclusively permitted states of the robot, whether it holds that: ZUS(t) Z, wherein in the event of: ZUS(t) .Math. Z a first stop signal Sig1 is generated, a unit, connected to the first processor via a data link, for generating a second stop signal Sig2, which generates the second stop signal Sig2 when the unit receives the first stop signal Sig1 or when the unit establishes that the data link is interrupted, a second processor, connected to the interface and the first processor or only to the first processor, that is set up to use a second algorithm to check, on the basis of the data DAT(t) and a prescribed state space Z or a boundary for the state space Z whether it holds that: ZUS(t) Z wherein in the event of ZUS(t) .Math. Z the second processor prompts an interruption unit to interrupt the data link between the first processor and the unit, and a control unit, connected to the unit, for controlling the robot, which control unit controls/regulates the robot into a prescribed safe state when the second stop signal Sig2 is present.

A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.

Systems and methods are provided herein for coordinating motion between components of an inventory system. A first set of instructions associated with a first task to be performed by a first robotic device may be received. A second set of instructions associated with a second task to be performed by a second robotic device may be received. The first and second robotic devices may be configured to utilize corresponding operational areas that may overlap to define an area of overlap. Light information representative of the spatial condition of at least one of the robotic devices may be projected onto a projection surface. The light information may be utilized to determine that at least one of the first and second robotic devices is utilizing the area of overlap. A remedial action may be performed to coordinate motion of the first and second robotic devices within the area of overlap.