A method for controlling a robotic device is presented. The method includes positioning the robotic device within a task environment. The method also includes mapping descriptors of a task image of a scene in the task environment to a teaching image of a teaching environment. The method further includes defining a relative transform between the task image and the teaching image based on the mapping. Furthermore, the method includes updating parameters of a set of parameterized behaviors based on the relative transform to perform a task corresponding to the teaching image.

A method for visualizing data generated by a robotic device is presented. The method includes displaying an intended path of the robotic device in an environment. The method also includes displaying a first area in the environment identified as drivable for the robotic device. The method further includes receiving an input to identify a second area in the environment as drivable and transmitting the second area to the robotic device.

A computer-implemented method executed by data processing hardware of a robot causes the data processing hardware to perform operations. The operations include receiving a sensor pointing command that commands the robot to use a sensor to capture sensor data of a location in an environment of the robot. The sensor is disposed on the robot. The operations include determining, based on an orientation of the sensor relative to the location, a direction for pointing the sensor toward the location, and an alignment pose of the robot to cause the sensor to point in the direction toward the location. The operations include commanding the robot to move from a current pose to the alignment pose. After the robot moves to the alignment pose and the sensor is pointing in the direction toward the location, the operations include commanding the sensor to capture the sensor data of the location in the environment.

Disclosed is an interior tracking system for manufacturing control. The interior tracking system has multiple, fixedly installed transceivers for determining the position of multiple mobile units, the position being determined in particular by evaluating the propagation time of electromagnetic (radio) signals. The interior tracking system is used to assign one of the mobile units to one or more workpieces in an industrial manufacturing plant that processes steel and/or sheet metal, to determine the position of the assigned workpieces by localizing the assigned mobile unit using the interior tracking system and to integrate the interior tracking system into a manufacturing control system of the industrial manufacturing plant.

A method for automatically recognizing a location of an object so that a robot can grasp and transfer the product in an apparatus for automatically recognizing a location of an object is provided. The method for automatically recognizing a location of an object obtains one frame from image data of the product produced by the manufacturing facility, detects location and shape information of the product based on a hue, saturation, value (HSV) color space using the frame, generates a recipe for the robot to grasp and transfer the product based on the location and shape information of the product, and transmits the recipe to the robot.

A robot automatically annotates items by training a semantic segmentation module. The robot includes one or more imaging devices, and a controller comprising machine readable instructions. The machine readable instructions, when executed by one or more processors, cause the controller to capture an image with the one or more imaging devices, identify a target area in the image in response to one or more points on the image designated by a user, obtain depth information for the target area, calculate a center of an item corresponding to the target area based on the depth information, rotate the imaging device based on the center, and capture an image of the item at a different viewing angle in response to rotating the view of the imaging device.

A method for assigning a processing plan to a mobile unit data set of a mobile unit of an indoor location system of a manufacturing hall is provided. The method includes: providing a manufacturing control system for industrial processing of workpieces with a machine tool in accordance with workpiece-specific processing plans, each processing plan storing order information for a workpiece to be processed, providing a mobile unit with an image acquisition unit for acquiring image data, mobile unit data set belonging to the mobile unit and position data of the mobile unit acquired with the indoor location system being stored in the manufacturing control system, acquiring image data of a processing plan-specific object for identifying the processing plan to be assigned with the manufacturing control system, and assigning the identified processing plan to the mobile unit data set of the mobile unit in the manufacturing control system.

A machine learning method for learning an action of a robot including a hand to pick out a workpiece from a container containing a plurality of the workpieces stacked in bulk and install the workpiece such that the workpiece is in a predetermined installation state includes learning a reverse-order action of removing, by the hand, the workpiece in the predetermined installation state after completion of installation, and learning an installation order of the workpiece based on a learning result of the reverse-order action of removing the workpiece.

A method of controlling a robot that performs work using an end effector on an object transported by a handler includes calculating a target position of the end effector based on a position of the object, calculating a tracking correction amount for correction of the target position in correspondence with a transport amount of the object, controlling the end effector to follow the object based on the target position and the tracking correction amount, acquiring an acting force acting on the end effector from the object using a force sensor, calculating a force control correction amount for correction of the target position to set the acting force to a target force, and controlling the acting force to be the predetermined target force by driving the manipulator based on the force control correction amount.

According to various embodiments of the present invention, an electronic device comprises: a memory including instructions and a training database, which includes data, on at least one object, acquired on the basis of an artificial intelligence algorithm; at least one sensor; and a processor connected to the at least one sensor and the memory, wherein the processor can be configured to execute the instructions in order to acquire data on a designated area including the at least one object by using the at least one sensor, identify location information and positioning information on the at least one object on the basis of the training database, and transmit a control signal for picking the at least one object to a picking tool related to the electronic device on the basis of the identified location information and positioning information.