A powered user interface for a robotic surgical system includes a handle on a linkage having a plurality of joints, a base, and actuators. The interface operates in accordance with a first mode of operation in which a plurality of its actuators are operated to constrain predetermined ones of the joints to permit motion of the handle in only 4DOF with respect to the base, and a second mode of operation in which the actuators permit motion of the handle in at least 6DOF with respect to the base.

A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

A method may include generating visualizations each representative of operational parameters associated with industrial devices in an industrial system via a control system that controls operations of the industrial devices. The control system is communicatively connected to a first computing system and a second computing system. The method may also include receiving a request including credentials associated with a requester from the second computing system and determining rights to each of the visualizations. Additionally, the method may include identifying one or more of the visualizations based on the access rights and receiving a selection of the one or more of the visualizations from the second computing system. Moreover, the method may include transmitting the one or more of the visualizations to the first computing system that live streams the one or more of the visualizations to the second computing system.

A powered user interface for a robotic surgical system having a manipulator and a surgical instrument mounted to the manipulator includes a base and a linkage assembly that includes two two-bar linkage mechanisms. The linkage assembly is rotatably mounted to the base at a base joint, and a handle mounted to each of the two-bar linkage mechanisms. Sensors and actuators are arranged to measure and actuate the position and orientation of the user interface.

A powered user interface for a robotic surgical system includes a base, a handle mounted to the base and moveable relative to the base in at least six degrees of freedom, and actuators. The interface operates in accordance with a first mode of operation in which the actuators are operated to constrain predetermined ones of the joints to permit motion of the handle in only 4DOF with respect to the base, and a second mode of operation in which the actuators permit motion of the handle in at least 6DOF with respect to the base.

A sequence of tracking input samples that are measures of position or orientation of a user interface device, UID, being held by a user, are received. In a prediction phase, a current output sample of a state of linear quadratic estimator, LQE, is computed that is an estimate of the position or orientation of the UID. The current output sample is computed based on i) a previously computed output sample, and ii) a velocity term. In an update phase, an updated output sample of the state of the LQE is computed, based on i) a previously computed output sample from the prediction phase, and ii) a most recent tracking input sample. Other embodiments are also described and claimed.

A method includes receiving sensor data for an environment about the robot. The sensor data is captured by one or more sensors of the robot. The method includes detecting one or more objects in the environment using the received sensor data. For each detected object, the method includes authoring an interaction behavior indicating a behavior that the robot is capable of performing with respect to the corresponding detected object. The method also includes augmenting a localization map of the environment to reflect the respective interaction behavior of each detected object.

A robotic singulation system is disclosed. In various embodiments, sensor data including data associated with an item present in a workspace is received. The sensor data is used to determine and implement a plan to autonomously operate a robotic structure to move and place the item singly in a corresponding location in a singulation conveyance structure. The plan takes into consideration an attribute of the item determined based at least in part on the sensor data.

A robotic singulation system is disclosed. In various embodiments, sensor data image data associated with a plurality of items present in a workspace is received. The sensor data is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workspace and place each item singly in a corresponding location in a singulation conveyance structure. The plan includes performing an active measure to change or adapt to a detected state or condition associated with one or more items in the workspace.