A robot system includes: a robot including an end effector connected to an arm thereof; a vision sensor mounted to the robot; and a controller configured to output an operation signal that enables the robot to operate when an input is generated through a touch screen. Each of an object and a target to which the object is placed is inputted through the touch screen. The touch screen displays a recommendation region of the target in a distinguished manner.

An object handling control device includes one or more processors configured to acquire at least object information and status information representing an initial position and a destination of an object; set, when a grasper grasping the object moves from the initial position to the destination, a first region, a second region, and a third region in accordance with the object information and the status information; and calculate a moving route along which the object is moved from the initial position to the destination with reference to the first region, the second region, and the third region.

Disclosed is a moving robot including: a voice input unit configured to receive a voice input of a user; a first display capable of receiving a touch input; a second display larger than the first display; and a controller configured to perform control such that a screen to be displayed in response to the voice input or the touch input is displayed on at least one of the first display or the second display based on a type and an amount of information included in the screen, and accordingly, it is possible to provide information and services more effectively using the two displays.

Disclosed is a moving robot including: a voice input unit configured to receive a voice input of a user; a first display capable of receiving a touch input; a second display larger than the first display; and a controller configured to perform control such that a screen to be displayed in response to the voice input or the touch input is displayed on at least one of the first display or the second display based on a type and an amount of information included in the screen, and accordingly, it is possible to provide information and services more effectively using the two displays.

An adaptive robot grasp planning technique for bin picking. Workpieces in a bin having random positions and poses are to be grasped by a robot and placed in a goal position and pose. The workpiece shape is analyzed to identify a plurality of robust grasp options, each grasp option having a position and orientation. The workpiece shape is also analyzed to determine a plurality of stable intermediate poses. Each individual workpiece in the bin is evaluated to identity a set of feasible grasps, and the workpiece is moved to the goal pose if such direct movement is possible. If direct movement is not possible, a search problem is formulated, where each stable intermediate pose is a node. The search problem is solved by evaluating the feasibility and optimality of each link between nodes. Feasibility of each link is evaluated in terms of collision avoidance constraints and robot joint motion constraints.

An adaptive robot grasp planning technique for bin picking. Workpieces in a bin having random positions and poses are to be grasped by a robot and placed in a goal position and pose. The workpiece shape is analyzed to identify a plurality of robust grasp options, each grasp option having a position and orientation. The workpiece shape is also analyzed to determine a plurality of stable intermediate poses. Each individual workpiece in the bin is evaluated to identity a set of feasible grasps, and the workpiece is moved to the goal pose if such direct movement is possible. If direct movement is not possible, a search problem is formulated, where each stable intermediate pose is a node. The search problem is solved by evaluating the feasibility and optimality of each link between nodes. Feasibility of each link is evaluated in terms of collision avoidance constraints and robot joint motion constraints.

The present disclosure provides an information processing method for performing the following steps, and the resulting information includes captured image data including at least the robot arm every predetermined period: a step of causing a captured image data acquisition unit to acquire captured image data of an imaging target at least including a robot arm and a control object; a step of causing a control unit to change a state of the control object every predetermined period based on user setting; an image comparison step of causing an image comparison unit to compare the captured image data with reference image data; and a step of causing a result information acquisition unit to detect a predetermined state change based on a result of the comparison in the image comparison step, acquire result information regarding a work of the robot arm, and store the result information in a result information storage unit.

Inter-operative switching of tools in a robotic system includes a system with a plurality of manipulators and a controller. The controller is configured to detect mounting of a first imaging device to a first manipulator of the plurality of manipulators, the first imaging device having a first reference frame; in response to detecting the mounting of the first imaging device, control a tool relative to the first reference frame using a second manipulator of the plurality of manipulators, the tool being mounted to the second manipulator; detect mounting of a second imaging device to a third manipulator of the plurality of manipulators, the second imaging device having a second reference frame; and in response to detecting the mounting of the second imaging device, control the tool relative to the second reference frame using the second manipulator.

A robotic system is provided for assembling parts together. In the assembly process, both parts are moving separately with one part moving on an assembly base and another part moving on a moveable arm of a robot base. Motion data is measured by an inertial measurement unit (IMU) sensor. Movement of the robot base or moveable arm is then compensated based on the measured motion to align the first and second parts with each other and assemble the parts together.

A robotic system is provided for assembling parts together. In the assembly process, both parts are moving separately with one part moving on an assembly base and another part moving on a moveable arm of a robot base. Motion data is measured by an inertial measurement unit (IMU) sensor. Movement of the robot base or moveable arm is then compensated based on the measured motion to align the first and second parts with each other and assemble the parts together.