Systems and methods for human-machine interaction. An adaptive behavioral control system of a human-machine interaction system controls an interaction sub-system to perform a plurality of actions for a first action type in accordance with a computer-behavioral policy, each action being a different alternative action for the action type. The adaptive behavioral control system detects a human reaction of an interaction participant to the performance of each action of the first action type from data received from a human reaction detection sub-system. The adaptive behavioral control system stores information indicating each detected human reaction in association with information identifying the associated action. In a case where stored information indicating detected human reactions for the first action type satisfy an update condition, the adaptive behavioral control system updates the computer-behavioral policy for the first action type.

Systems and methods for human-machine interaction. An adaptive behavioral control system of a human-machine interaction system controls an interaction sub-system to perform a plurality of actions for a first action type in accordance with a computer-behavioral policy, each action being a different alternative action for the action type. The adaptive behavioral control system detects a human reaction of an interaction participant to the performance of each action of the first action type from data received from a human reaction detection sub-system. The adaptive behavioral control system stores information indicating each detected human reaction in association with information identifying the associated action. In a case where stored information indicating detected human reactions for the first action type satisfy an update condition, the adaptive behavioral control system updates the computer-behavioral policy for the first action type.

An industrial virtual reality (VR) system includes visualization processing capabilities that allow an augmented reality (AR) human-machine interface (HMI) application to be tested within a virtual representation of the plant environment. This approach can yield an interactable AR HMI that simulates, within the VR environment, what a wearer of an AR appliance will see while traversing the physical plant. In this way, proper operation of the AR HMI can be verified prior to commissioning of the physical system. This can include ensuring that graphics are tied to the correct data points, confirming correct and non-obtrusive locations of graphics within the user's field of view.

A method, a component, and an electronic device relating to the field of industrial automation technology, particularly relating to the creation of a human machine interface, and are used for automatically creating an HMI of a system. The method for creating an HMI comprises: a first component of a system receives, via an HMI, a first command for creating an HMI for the system; the first component obtains, from each searched and found second component of the system an HMI resource of each of the second components; and the first component creates, on the basis of an HMI resource of the first component and the obtained HMI resource from each of the second components, the HMI for the system. One component of the system collects the HMI resource of another component of the system and creates the HMI for the whole system, providing a method for automatically creating the HMI for the system.

Systems and methods for human-machine interaction. An adaptive behavioral control system of a human-machine interaction system controls an interaction sub-system to perform a plurality of actions for a first action type in accordance with a computer-behavioral policy, each action being a different alternative action for the action type. The adaptive behavioral control system detects a human reaction of an interaction participant to the performance of each action of the first action type from data received from a human reaction detection sub-system. The adaptive behavioral control system stores information indicating each detected human reaction in association with information identifying the associated action. In a case where stored information indicating detected human reactions for the first action type satisfy an update condition, the adaptive behavioral control system updates the computer-behavioral policy for the first action type.

A control system configured for safe input, visualization and/or communication for controlling a machine, includes a display device configured to display at least one symbol, an optical input device configured to detect, from the display device, at least a portion of the symbol, a redundant communication system configured to send the symbol, and a control unit configured to send the symbol and a test sequence to the display device, receive the symbol and the test sequence from the display device, test at least the test sequence, and, if the check sequence is correctly received, generate a redundant encoding of the symbol and send the redundantly encoded symbol over a redundant network.

An industrial virtual reality (VR) system includes visualization processing capabilities that allow an augmented reality (AR) human-machine interface (HMI) application to be tested within a virtual representation of the plant environment. This approach can yield an interactable AR HMI that simulates, within the VR environment, what a wearer of an AR appliance will see while traversing the physical plant. In this way, proper operation of the AR HMI can be verified prior to commissioning of the physical system. This can include ensuring that graphics are tied to the correct data points, confirming correct and non-obtrusive locations of graphics within the user's field of view.

A combined visualization configuration is stored and provided by a visualization manager to a thin client HMI. Based upon the configuration, the thin client HMI accesses individual visualizations from automation components, such as automation controllers, motor controllers, camera, and so forth. Policies may be established for users and their roles, and for particular thin client HMIs, and for particular locations of or around a machine or process being monitored and/or controlled. Based on the policies, the individual visualizations are combined and may be changed if one or more of the factors changes. Interactions with the individual visualizations of the combined visualization result in signals back to the automation components originating the visualizations.

A system for visual state identification including: a visual display system including a plurality of light displays, each of the light displays provided to different physical locations on an automation system; an execution device operatively connected to the visual display system, including: an input device configured to receive data from the automation system; and computer readable instructions which, if executed by a processor, cause the processor to: receive input data; determine a state of the automation system based on the input data, wherein the state may include an area of interest related to one of the different physical locations; communicate with the visual display system to selectively light a portion of one or more of the plurality of light displays to display the state of the automation system and the physical location of the area of interest.

A machine learning device, which detects an operator, communicates with a database registering information concerning the operator, and learns display of an operation menu based on the information concerning the operator, includes a state observation unit which observes an operation history of the operation menu; and a learning unit which learns the display of the operation menu on the basis of the operation history of the operation menu observed by the state observation unit.