A method and device for controlling a robot, and a robot. The device detects whether there is an article being put into or taken out from a storage container of a robot, and if it is detected that an article is put into or taken out from the storage container, an information list is updated according to the article being put into or taken out, the information list recording relevant information about articles in the storage container.

An estimation device includes a memory and at least one processor. The at least one processor is configured to acquire information regarding a target object. The at least one processor is configured to estimate information regarding a location and a posture of a gripper relating to where the gripper is able to grasp the target object. The estimation is based on an output of a neural model having as an input the information regarding the target object. The estimated information regarding the posture includes information capable of expressing a rotation angle around a plurality of axes.

A method for determining a shape of a lumen in an anatomical structure comprises reading information from a plurality of strain sensors disposed substantially along a length of a flexible medical device when the flexible medical device is positioned in the lumen. When the flexible medical device is positioned in the lumen, the flexible medical device conforms to the shape of the lumen. The method further comprises computationally determining, by a processing system, the shape of the lumen based on the information from the plurality of strain sensors.

Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to an Interaction Engine. According to various embodiments, Interaction Engine generates within a unified three-dimensional (3D) coordinate space, a virtual 3D medical model positioned according to a model pose. The Interaction Engine receives video data from a plurality of video sources. The Interaction Engine renders a first Augmented Reality (AR) display that includes concurrent display of the virtual 3D medical model and visualization of at least a portion of video data from a first video source. The Interaction Engine renders a second Augmented Reality (AR) display that includes concurrent display of the virtual 3D medical model and visualization of at least a portion of video data from a second video source.

A robot system includes: a robot including an end effector connected to an arm thereof; a vision sensor mounted to the robot; and a controller configured to output an operation signal that enables the robot to operate when an input is generated through a touch screen. Each of an object and a target to which the object is placed is inputted through the touch screen. The touch screen displays a recommendation region of the target in a distinguished manner.

A robot control method, and associated robot controllers and robots operating with such methods and controllers, providing real-time vibration suppression. The control method involves learning to support real-time, vibration-suppressing control. The method uses state-of-the-art machine learning techniques in conjunction with a differentiable dynamics simulator to yield fast and accurate vibration suppression. Vibration suppression using offline simulation approaches that can be computationally expensive may be used to create training data for the controller, which may be provide by a variety of neural network configurations. In other cases, sensory feedback from sensors onboard the robot being controlled can be used to provide training data to account for wear of the robot's components.

A robotic post system includes one or more composable robotic posts each having a processor and a memory. At least one composable post includes a set of modules including one or more pairable latches which is configured to couple and lock with another pairable latch from among another set of modules included on another of the composable posts, such that the composable robotic posts form a composable surface supported by the composable robotic posts.

A robotic post system includes one or more composable robotic posts each having a processor and a memory. At least one composable post includes a set of modules including one or more pairable latches which is configured to couple and lock with another pairable latch from among another set of modules included on another of the composable posts, such that the composable robotic posts form a composable carrier structure defined by the composable robotic posts.

A flux system includes a memory and a processor in communication with the memory and a sensing device, the memory storing a plurality of capabilities and a plurality of semantic fluxes associated with the plurality of capabilities. The computing system is configured to infer a semantic based on received inputs and to infer an activity interest semantic based on an input, and to assign a servicing agent to service an activity interest based on semantic matching.

A method and computing system for transferring objects between a source repository and a destination repository is provided. The computing system is configured to operate by a combination of pre-planned and image base trajectories to improve speed and reliability of object transfer. The computing system is configured to capture image information of repositories and use the captured information to alter or adjust pre-planned trajectories to improve performance.