Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing robot plan online adjustment. A method includes receiving an initial plan for performing a particular task with a robot having a sensor. The initial plan defines an initial path having a plurality of waypoints. Each waypoint is associated with a target position and a target velocity. The method includes generating an alternative path from the initial path. Generating an alternative path includes generating a plurality of alternative paths including performing respective modifications to one or more waypoints in the initial plan, evaluating each alternative path according to a simulated total time duration required for the robot to traverse the alternative path, and selecting an alternative path having a total time duration that is less than a total time duration of the initial plan.

An example computer-implemented method includes receiving, from one or more vision components in an environment, vision data that captures features of the environment, including object features of an object that is located in the environment, and prior to a robot manipulating the object: (i) determining based on the vision data, at least one first adjustment to a programmed trajectory of movement of the robot operating in the environment to perform a task of transporting the object, and (ii) determining based on the object features of the object, at least one second adjustment to the programmed trajectory of movement of the robot operating in the environment to perform the task, and causing the robot to perform the task, in accordance with the at least one first adjustment and the at least one second adjustment to the programmed trajectory of movement of the robot.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for controlling a robot to perform a custom real-time action that uses a callback function. One of the methods comprises receiving a definition of a custom real-time control function that specifies a custom callback function, an action, and a custom reaction that references the custom callback function; providing a command to initiate the action; repeatedly executing, by the control layer of the real-time robotics control framework, the custom real-time control function at each tick of a real-time robotics system driving one or more physical robots, including: obtaining current values of one or more state variables, evaluating the custom reaction specified by the custom real-time control function according to the current values of the one or more state variables, and whenever the one or more conditions of the custom reaction are satisfied, invoking the custom callback function.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for controlling a robot to perform a custom real-time action that uses streaming inputs. One of the methods comprises receiving a definition of a custom real-time streaming control function that defines a custom streaming action, wherein the custom streaming action specifies a goal state for a robot in an operating environment; providing a command to initiate the custom streaming action; and repeatedly providing updated goal states for the custom streaming action, wherein the control layer of the framework is configured to execute the custom streaming action including driving the robot toward a most recent goal state at each tick of a real-time robotics control cycle.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for controlling a robot to perform a custom real-time action. One of the methods comprises receiving, by a real-time robotics control framework, a definition of a custom real-time control function, wherein the definition specifies a plurality of actions and one or more custom reactions; repeatedly executing, by the real-time robotics control framework, the custom real-time control function at each tick of a real-time robotics system driving one or more physical robots, including: obtaining current values of one or more state variables, evaluating the one or more custom reactions specified by the custom real-time control function according to the current values of the one or more state variables, and whenever a custom reaction is satisfied, updating a current action in real time according to the custom reaction that is satisfied, and executing a next tick of the current action.

A method of coordinating automated systems, the method includes providing a first automated system that is programmed with a set of predetermined operating instructions that correspond with automated system processing requirements, monitoring an operational status of the first automated system with a second automated system, automatically generating a second system action, with the second automated system, that is complimentary to a first system action of the first automated system, where the first system action corresponds to the set of predetermined operating instructions and the second system action depends on the operational status of the first automated system, and performing the second system action with the second automated system so that the second automated system cooperates with the first automated system to perform a predetermined operation.

The present invention includes a collection device a communication module, a first processing unit, a second processing unit and an execution unit. The benefit of the invention compared to the prior art is: by the cooperation of the using of the first processing unit and the second processing unit, the complicated operation with which the second processing unit can not accomplish is transferred to the first processing unit, the first processing unit then accomplish the operation, thus the processing speed and accuracy are increased. Meanwhile the simple logic operation processed by the first processing unit is transferred to the second processing unit the second processing unit then processes the logic operation and forms control signal to control the execution unit, so that the delayed processing of the execution unit is avoided.

A method of fabricating and repairing a gas turbine component having a plurality of cooling holes defined therein is provided. The method includes determining a parameter of a first cooling hole defined in the gas turbine component, and generating a tool path for forming a protective cap around the first cooling hole. The tool path is based at least partially on the parameter of the first cooling hole. The method also includes directing a robotic device to follow the tool path, and discharging successive layers of ceramic slurry towards the gas turbine component as the tool path is followed such that the protective cap is formed around the first cooling hole.

A method for guiding in real time a robot arm for the processing of data of the surface of a body, includes generating a body model including a meshing of points; planning a treatment trajectory on the surface of the body model with a calculator; activating at least one transmission of a transmitter and/or acquisition of a sensor of an operator device, the operator device being arranged at the distal end of the robotised arm, the activation being carried out when the orientation of the axis of the sensor or the transmitter is merged with a predefined straight line passing through the target point, the target point being referenced on the generated body model.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for robot plan online adjustment. A method includes receiving an initial plan for performing a particular task with a robot having a sensor. The initial plan defines an initial path having a plurality of waypoints and a footprint space for performing the particular task. The method includes receiving a sensor input from the sensor, and determining from the sensor input that the initial plan requires modification to complete the particular task. The method includes evaluating a plurality of alternative paths, including rejecting one or more alternative paths having any alternative waypoints that are outside the footprint space defined by the initial plan. The method includes selecting an alternative path having alternative waypoints that are all within the footprint space defined by the initial plan. The method includes following, by the robot, the alternative path.