The present invention relates to a robot and method for estimating an orientation on the basis of a vanishing point in a low-luminance image, and the robot for estimating an orientation on the basis of a vanishing point in a low-luminance image according to an embodiment of the present invention includes a camera unit configured to capture an image of at least one of a forward area and an upward area of the robot and an image processor configured to extract line segments from a first image captured by the camera unit by applying histogram equalization and a rolling guidance filter to the first image, calculate a vanishing point on the basis of the line segments, and estimate a global angle of the robot corresponding to the vanishing point.

The present invention relates to a robot and method for estimating an orientation on the basis of a vanishing point in a low-luminance image, and the robot for estimating an orientation on the basis of a vanishing point in a low-luminance image according to an embodiment of the present invention includes a camera unit configured to capture an image of at least one of a forward area and an upward area of the robot and an image processor configured to extract line segments from a first image captured by the camera unit by applying histogram equalization and a rolling guidance filter to the first image, calculate a vanishing point on the basis of the line segments, and estimate a global angle of the robot corresponding to the vanishing point.

Certain aspects relate to systems and techniques for preparing a robotic system for surgery. In one aspect, the method includes a robotic arm, a sensor configured to generate information indicative of a location of the robotic arm, a processor, and at least one computer-readable memory in communication with the processor and having stored thereon computer-executable instructions. The instructions are configured to cause the processor to receive the information from the sensor, determine that the robotic arm is located at a first position in which a first axis associated with the robotic arm is not in alignment with a second axis associated with a port installed in a patient, and provide a command to move the robotic arm to a second position in which the first axis associated with the robotic arm is in alignment with the second axis.

Certain aspects relate to systems and techniques for preparing a robotic system for surgery. In one aspect, the method includes a robotic arm, a sensor configured to generate information indicative of a location of the robotic arm, a processor, and at least one computer-readable memory in communication with the processor and having stored thereon computer-executable instructions. The instructions are configured to cause the processor to receive the information from the sensor, determine that the robotic arm is located at a first position in which a first axis associated with the robotic arm is not in alignment with a second axis associated with a port installed in a patient, and provide a command to move the robotic arm to a second position in which the first axis associated with the robotic arm is in alignment with the second axis.

A virtualization system implemented within a cloud server enables the simulation of robot structure and behavior in a virtual environment. The simulated robots are controlled by clients remote from the cloud server, enabling human operators or autonomous robot control programs running on the clients to control the movement and behavior of the simulated robots within the virtual environment. Data describing interactions between robots, the virtual environment, and objects can be recorded for use in future robot design. The virtualization system can include robot templates, enabling users to quickly select and customize a robot to be simulated, and further enabling users to update and re-customize the robot in real-time during the simulation. The virtualization system can re-simulate a portion of the robot simulation when an intervention by a human operator is detected, positioning robots, people, and objects within the virtual environment based on the detected intervention.

A virtualization system implemented within a cloud server enables the simulation of robot structure and behavior in a virtual environment. The simulated robots are controlled by clients remote from the cloud server, enabling human operators or autonomous robot control programs running on the clients to control the movement and behavior of the simulated robots within the virtual environment. Data describing interactions between robots, the virtual environment, and objects can be recorded for use in future robot design. The virtualization system can include robot templates, enabling users to quickly select and customize a robot to be simulated, and further enabling users to update and re-customize the robot in real-time during the simulation. The virtualization system can re-simulate a portion of the robot simulation when an intervention by a human operator is detected, positioning robots, people, and objects within the virtual environment based on the detected intervention.

A sortation system is disclosed that includes a programmable motion device including an end effector, a perception system for recognizing any of the identity, location, and orientation of an object presented in a plurality of objects, a grasp selection system for selecting a grasp location on the object, the grasp location being chosen to provide a secure grasp of the object by the end effector to permit the object to be moved from the plurality of objects to one of a plurality of destination locations, and a motion planning system for providing a motion path for the transport of the object when grasped by the end effector from the plurality of objects to the one of the plurality of destination locations, wherein the motion path is chosen to provide a path from the plurality of objects to the one of the plurality of destination locations.

A sortation system is disclosed that includes a programmable motion device including an end effector, a perception system for recognizing any of the identity, location, and orientation of an object presented in a plurality of objects, a grasp selection system for selecting a grasp location on the object, the grasp location being chosen to provide a secure grasp of the object by the end effector to permit the object to be moved from the plurality of objects to one of a plurality of destination locations, and a motion planning system for providing a motion path for the transport of the object when grasped by the end effector from the plurality of objects to the one of the plurality of destination locations, wherein the motion path is chosen to provide a path from the plurality of objects to the one of the plurality of destination locations.

A sortation system is disclosed that includes a programmable motion device including an end effector, a perception system for recognizing any of the identity, location, and orientation of an object presented in a plurality of objects, a grasp selection system for selecting a grasp location on the object, the grasp location being chosen to provide a secure grasp of the object by the end effector to permit the object to be moved from the plurality of objects to one of a plurality of destination locations, and a motion planning system for providing a motion path for the transport of the object when grasped by the end effector from the plurality of objects to the one of the plurality of destination locations, wherein the motion path is chosen to provide a path from the plurality of objects to the one of the plurality of destination locations.

A sortation system is disclosed that includes a programmable motion device including an end effector, a perception system for recognizing any of the identity, location, and orientation of an object presented in a plurality of objects, a grasp selection system for selecting a grasp location on the object, the grasp location being chosen to provide a secure grasp of the object by the end effector to permit the object to be moved from the plurality of objects to one of a plurality of destination locations, and a motion planning system for providing a motion path for the transport of the object when grasped by the end effector from the plurality of objects to the one of the plurality of destination locations, wherein the motion path is chosen to provide a path from the plurality of objects to the one of the plurality of destination locations.