A processing system having at least one processor operatively coupled to at least one memory. The processor receives sensor data from the at least one sensor indicating one or more characteristics of the asset. The processor generates, updates, or maintains a digital representation that models the one or more characteristics of the asset. The processor detects a defect of the asset based at least in part on the one or more characteristics. The processor generate an output signal encoding or conveying instructions to provide a recommendation to an operator, to control the at least one robot to address the defect on the asset, or both, based on the defect and the digital representation of the asset.

A system and a method using a system for planning a use includes at least one marking, a control and evaluation unit, a database, a display unit, at least one time of flight sensor for a spatial scanning of a real environment, and at least one camera for imaging the real environment. The real environment in a spatial model can be displayed as a virtual environment on the display unit. The marking in the real environment is arranged at a position and has an orientation. The position and the orientation of the marking can be detected at least by the time of flight sensor and the position and orientation of the marking are linked by a virtual sensor model. The virtual sensor model in the spatial model of the virtual environment can be displayed on the display unit at the position and having the orientation of the marking.

A robot program generation apparatus that selects a typical arrangement pattern of a robot system; selects elements to be arranged in the arrangement pattern; automatically generates a layout where the elements in a stationary state do not interfere with each other; automatically generates a robot program in accordance with task details corresponding to the arrangement pattern and with the layout; executes the robot program in a virtual environment and automatically modifies installation positions of the elements in the layout based on whether or not the robot in an operating state interfere with any other elements and on whether or not the robot can reach a workpiece; and corrects the robot program based on the installation positions.

A simulation device according to the present disclosure includes: a model arrangement unit which arranges three-dimensional models of a feeder, a robot and a receiving device in virtual space; a workpiece supply unit which arranges the three-dimensional model of the workpiece on the conveyor surface; and a robot operation control unit which causes the robot to operate so as to move the workpiece on the conveyor surface to over the receiving surface, in which the workpiece supply unit includes: a reference position calculation part which calculates a position and orientation of the workpiece to be newly arranged, according to set conditions; a workpiece area setting part which sets a workpiece area occupied by the workpiece; an interference area setting part which sets an interference area adjacent to the workpiece area; a display control part which displays a screen indicating the workpiece area and the interference area; and a supply position adjustment part which adjusts a relative position of the workpiece to be newly arranged, so that the workpiece area of the workpiece to be newly arranged does not overlap with the workpiece area and the interference area of the workpiece arranged previously.

An autonomous system used for a production process includes a device configured to manipulate workpieces according to production process tasks. A device controller generates world model of the autonomous system to include data objects representing respective physical objects in the production process, such as workspace, workpieces, and the device. Semantic markers attached to the data objects include information related to a skill to accomplish a task objective. Semantic markers may be activated or deactivated depending on whether the physical object is currently available for a task performance. The device is controlled to perform tasks guided by the semantic markers while relying on an anticipation function with reasoning operations based on types of physical objects, types of skills, and configuration of the data objects.

A robot simulation device includes an image display unit configured to display a three-dimensional model of a robot system having a robot, a workpiece, and a peripheral device, as a pseudo three-dimensional object existing in a three-dimensional space, and a simulation execution unit configured to perform simulation operation for the three-dimensional model of the robot system displayed by the image display unit.

A robotic system comprising a robot, and human-imperceptible indicia associated with an object within an environment in which the robot operates, the human-imperceptible indicia comprising or linking to interaction information pertaining to a predetermined intended interaction of the robot with the object, the interaction information being operable to facilitate interaction with the object by the robot in accordance with the predetermined intended interaction. The system can further comprise at least one sensor operable to sense the human-imperceptible indicia and the interaction information, and an augmented reality system comprising a computer for conveying human-understandable information to a human operator, which is associated with at least one of the interaction or linking information. The machine readable indicia can comprise symbols that can be sensed by a sensor of the robot or the augmented reality system and interpreted by the robot or the augmented reality system. The robot can utilize a camera to transmit a real-world view of the operating environment to the augmented reality system that can be combined with the human-understandable information to provide augmented reality operation of the robot.

Mitigating the reality gap through optimization of one or more simulated hardware parameters for simulated hardware components of a simulated robot. Implementations generate and store real navigation data instances that are each based on a corresponding episode of locomotion of a real robot. A real navigation data instance can include a sequence of velocity control instances generated to control a real robot during a real episode of locomotion of the real robot, and one or more ground truth values, where each of the ground truth values is a measured value of a corresponding property of the real robot (e.g., pose). The velocity control instances can be applied to a simulated robot, and one or more losses can be generated based on comparing the ground truth value(s) to corresponding simulated value(s) generated from applying the velocity control instances to the simulated robot. The simulated hardware parameters and environmental parameters can be optimized based on the loss(es).

The disclosure relates to a method for creating an object map for a factory environment by using sensors present in the factory environment, wherein at least one part of an object in the factory environment has information relating to its position recorded by at least two of the sensors, wherein the information recorded by the sensors is transmitted to a server associated with the sensors, and wherein the server is used to take the information recorded and transmitted by the sensors as a basis for creating an object map for the factory environment having a position of the at least one part of the object.

A simulation device simulates a robot device including two two-dimensional cameras. The simulation device includes a setting point arrangement unit which arranges a plurality of setting points on a surface of a workpiece model, and a distance calculation unit which calculates distances from a three-dimensional sensor model to each of the setting points. The simulation device includes a three-dimensional information generating unit which generates three-dimensional information including positions of the setting points and distances from the three-dimensional sensor model to the setting points. The simulation device includes an exclusion unit which excludes the setting point that is not visible from the camera models. The simulation device changes a position and orientation of a robot model on the basis of the three-dimensional information.