A method is disclosed of changing a tool on a programmable motion device. The method includes the steps of moving an attachment portion of an end effector of the programmable motion device in a continuous motion; while the attachment portion of the end effector moves in the continuous motion, engaging one of: the attachment portion of the end effector with the tool, or the tool attached to the attachment portion of the end effector with an exchange system, and continuing to move the attachment portion of the end effector in the continuous motion to change a connection status of the attachment portion of the end effector while the attachment portion of the end effector moves in the continuous motion.

A programmable motion system is disclosed that includes a dynamic end effector system. The dynamic end effector system includes a plurality of acquisition units that are provided at an exchange station within an area accessible by the programmable motion device, and a coupling system for coupling any of the plurality of acquisition units to an end effector of the programmable motion device such that any of the acquisition units may be automatically selected from the exchange station and used by the programmable motion device without requiring any activation or actuation by the exchange station and without requiring any intervention by a human.

To reduce the working hours of a user in an operation and improve an operation rate in an industrial network system. A communication setting change part is provided which automatically changes, in a timing of an end effector replacement, the communication setting in a communication part according to the communication information that corresponds to an end effector.

Systems and methods are provided for controlling robots and their end effectors. One embodiment is a method for controlling a robot. The method includes: maneuvering a robot via a robot controller that is dedicated to operating the robot, thereby altering a position of an end effector mounted to the robot, communicating from the robot controller to an end effector controller that is disposed at the end effector and is dedicated to operating the end effector, determining a position of the end effector via the end effector controller, and operating the end effector via the end effector controller based on the position of the end effector.

Current technologies allow a robot to acquire a tool only if the tool is in a set known location, such as in a rack. In an embodiment, a method and corresponding system, can determine the previously unknow pose of a tool freely placed in an environment. The method can then calculate a trajectory that allows for a robot to move from its current position to the tool and attach with the tool. In such a way, tools can be located and used by a robot when placed at any location in an environment.

In an embodiment, a method includes identifying a force and torque for a robot to accomplish a task and identifying context of a portion of a movement plan indicating motion of the robot to perform the task. Based on the identified force, torque, and context, a context specific torque is determined for at least one aspect of the robot while the robot executes the portion of the movement plan. In turn, a control signal is generated for the at least one aspect of the robot to operate in accordance with the determined context specific torque.

In an embodiment, a method and system use various sensors to determine a shape of a collection of materials (e.g., foodstuffs). A controller can determine a trajectory which achieves the desired end-state, possibly chosen from a set of feasible, collision-free trajectories to execute, and a robot executes that trajectory. The robot, executing that trajectory, scoops, grabs, or otherwise acquires the desired amount of material from the collection of materials at a desired location. The robot then deposits the collected material in the desired receptacle at a specific location and orientation.

Embodiments provide functionality to prevent collisions between robots and objects. An example embodiment detects a type and a location of an object based on a camera image of the object, where the image has a reference frame. Motion of the object is then predicted based on at least one of: the detected type of the object, the detected location of the object, and a model of object motion. To continue, a motion plan for the robot is generated that avoids having the robot collide with the object based on the predicted motion of the object and a transformation between the reference frame of the image and a reference frame of the robot. The robot can be controlled to move in accordance with the motion plan or a signal can be generated that controls the robot to operate in accordance with the motion plan.

Embodiments provide methods and systems to modify motion of a robot based on sound and context. An embodiment detects a sound in an environment and processes the sound. The processing includes comparing the detected sound to a library of sound characteristics associated with sound cues and/or extracting features or characteristics from the detected sound using a model. Motion of a robot is modified based on a context of the robot and at least one of: (i) the comparison, (ii) the features extracted from the detected sound, and (iii) the characteristics extracted from the detected sound.

In an embodiment, a method during execution of a motion plan by a robotic arm includes determining a voice command from speech of a user said during the execution of the motion plan, determining a modification of the motion plan based on the voice command from the speech of the user, and executing the modification of the motion plan by the robotic arm.