Apparatus, systems, methods, and articles of manufacture for automatic robot perception programming by imitation learning are disclosed. An example apparatus includes a percept mapper to identify a first percept and a second percept from data gathered from a demonstration of a task and an entropy encoder to calculate a first saliency of the first percept and a second saliency of the second percept. The example apparatus also includes a trajectory mapper to map a trajectory based on the first percept and the second percept, the first percept skewed based on the first saliency, the second percept skewed based on the second saliency. In addition, the example apparatus includes a probabilistic encoder to determine a plurality of variations of the trajectory and create a collection of trajectories including the trajectory and the variations of the trajectory. The example apparatus also includes an assemble network to imitate an action based on a first simulated signal from a first neural network of a first modality and a second simulated signal from a second neural network of a second modality, the action representative of a perceptual skill.

A method for configuring an interface device connected to a control device and a field device, wherein the method includes receiving a first machine learning application having a plurality of logical components connected in a pipeline, where the first machine learning application serves to analyze a signal from the field device utilizing a first machine learning model, generating a plurality of code blocks utilizing a translator based on the plurality of logical components of the first machine learning application, connecting the plurality of code blocks in accordance with the pipeline of the first machine learning application to generate a first output from the signal from the field device, and deploying the connected code blocks on firmware of the interface device including creating a virtual port connectable to the control device, and where the virtual port serves to transmits the first output to the control device.

A method for configuring an interface device connected to a control device and a field device, wherein the method includes receiving a first machine learning application having a plurality of logical components connected in a pipeline, where the first machine learning application serves to analyze a signal from the field device utilizing a first machine learning model, generating a plurality of code blocks utilizing a translator based on the plurality of logical components of the first machine learning application, connecting the plurality of code blocks in accordance with the pipeline of the first machine learning application to generate a first output from the signal from the field device, and deploying the connected code blocks on firmware of the interface device including creating a virtual port connectable to the control device, and where the virtual port serves to transmits the first output to the control device.

Apparatus, systems, methods, and articles of manufacture for automatic robot perception programming by imitation learning are disclosed. An example apparatus includes a percept mapper to identify a first percept and a second percept from data gathered from a demonstration of a task and an entropy encoder to calculate a first saliency of the first percept and a second saliency of the second percept. The example apparatus also includes a trajectory mapper to map a trajectory based on the first percept and the second percept, the first percept skewed based on the first saliency, the second percept skewed based on the second saliency. In addition, the example apparatus includes a probabilistic encoder to determine a plurality of variations of the trajectory and create a collection of trajectories including the trajectory and the variations of the trajectory. The example apparatus also includes an assemble network to imitate an action based on a first simulated signal from a first neural network of a first modality and a second simulated signal from a second neural network of a second modality, the action representative of a perceptual skill.

A method of acquiring sensor data on a construction site by at least one sensor of a construction robot system comprising at least one construction robot is provided, wherein a sensor is controlled using a trainable agent, thus improving the quality of acquired sensor data. A construction robot system, a computer program product, and a training method are also provided.

A method for controlling a robotic manipulator according to a task comprises accepting a feedback signal including a sequence of multi-modal observations of a state of execution of the task. The multi-modal observations are processed with a neural network having a self-attention module with a hierarchically conditioned output to produce a skill of the robotic manipulator and an action conditioned on the skill. The neural network is trained in a supervised manner with demonstration data to produce a sequence of skills and a corresponding sequence of actions for the actuators of the robotic manipulator to perform the task. The method further comprises determining one or more control commands for the one or more actuators based on the produced action and submitting the one or more control commands to the one or more actuators causing a change of the state of execution of the task.