The present disclosure relates to an operating system for a machine of a food industry. The operating system includes eyeglasses for a user of the operating system and a transceiver for exchanging data between the operating system and the machine. The eyeglasses include a display system configured to display a control element and information of a human machine interface (HMI). Furthermore, the operating system includes at least one input module which receives user input from the user with respect to the control element. The operating system additionally includes a processing module. The processing module converts the received user input into an input signal for controlling at least one of the machine or the HMI.

Methods and systems for providing a telepresence to a remote user are disclosed. A data connection between a headgear device in a first location and a display device in a second location is established. A first input device communicatively coupled to the headgear device collects at least one of first video data and first audio data. At least one of the first video data and the first audio data is transmitted to the display device. At least one of the first video data and the first audio data is output on the display device. In response to outputting at least one of the first video data and the first audio data, at least one of haptic data and second audio data is collected by at least a second input device. The at least one of the haptic data and the second audio data is transmitted to the headgear device.

A defect visualization system includes an augmented reality display system to display an image representing a defect, such as missing metal, in a ferromagnetic material when a user gazes at a portion of the ferromagnetic material hosting the defect, based on magnetic field data provide by a magnetometry system, thereby facilitating locating the defect and replacing magnetometers after the defect has been repaired, even if location references originally present on cladding material are lost or destroyed during the repair.

A display system which has: a display device configured to be able to display an image superimposed on a reality space; and a managing device configured to manage the image the display device displays, wherein the display device has a display processor configured to read at least one of a qualified image and a disqualified image for an inspection target existing in the reality space from a memory and to display the read image superimposed on the reality space seen through an optical see-through displayer, on the displayer.

An augmented reality simulation device includes: extension information display means for displaying a virtual object; relation information acquisition means for acquiring first relation information which is information that specifies relation between the virtual object and control axes of a numerical controller and second relation information which is information that specifies settings of the control axes and relation between the control axes; conversion means for converting a movement amount in a first coordinate system which is a coordinate system of the control axis to movement information in a second coordinate system which is a coordinate system for allowing the extension information display means to display the virtual object on the basis of the first relation information and the second relation information; and calculation means for calculating a display position and a display angle of the virtual object based on the movement information in the second coordinate system after the conversion.

A remote presence system includes a robot, a headset, and a computer system. The robot includes a camera mounted on a motorized manipulator and a control system. The headset includes a head position sensor and a display. The computer system configured to perform operations including: receiving head movement data indicative of head movements of a user wearing the headset from the head position sensor; causing, using the head movement data, the control system of the robot to move the motorized manipulator so that the camera mimics the head movements of the user; and establishing a video feed from the camera to the display.

A robot teaching and testing system and method that performs human-operated robot tasks according to instructions generated from generative AI models. The process starts with a user prompt and combines the user prompt with predefined prompt templates to generate well-formatted text prompts. Generative AI models take the text prompts and convert them into high-level instructions or control codes that can be deployed on a robot. The high-level instructions are then converted into human-operated robot tasks for a human data collector using a mixed reality (MR) device. The human data collector will attempt to follow the instructions to complete the human-operated robot tasks and may overwrite the suggested instructions by performing a different action, demonstrate a task without instructions, or leave feedback or comments regarding the tasks. Feedback data will be captured and saved for improving the robot system.

A method of visualizing data with respect to a component includes identifying a model of the component. The method further includes accessing part data defining an internal configuration of each of a plurality of models of components. The method further includes associating the internal configuration of the model of the component with the component. The method further includes accessing process data defining a plurality of processing methods applicable to the identified model of the component, and receiving an indicator of a desired processing method out of the processing methods defined by the process data. The method further includes generating a visual overlay on a display based on the process data and the associated internal configuration of the component, wherein the visual overlay includes a guiding visualization for at least one step of the desired processing method associated with at least one feature of the internal configuration of the component.

A method for training and/or testing a robot control module. The method includes generating an instruction specified by a robot control module configured for robot training and/or testing, the instruction indicating how a human-driven robot task is to be performed when training and/or testing the robot control module; providing the instruction to a mixed reality device worn by a human data collector, the mixed device rendering the instruction in a manner that shows the human data collector how to perform the human-driven robot task; collecting performance data and environmental data in response to the human data collector attempting to perform the human-driven robot task using the data collection device; receiving feedback data in response to the human data collector attempting to perform the human-driven robot task specified by the instruction; and updating the robot control module using the feedback data and the collected performance and environmental data.

A method of visualizing data with respect to a component includes identifying a model of the component. The method further includes accessing part data defining an internal configuration of each of a plurality of models of components. The method further includes associating the internal configuration of the model of the component with the component. The method further includes accessing process data defining a plurality of processing methods applicable to the identified model of the component, and receiving an indicator of a desired processing method out of the processing methods defined by the process data. The method further includes generating a visual overlay on a display based on the process data and the associated internal configuration of the component, wherein the visual overlay includes a guiding visualization for at least one step of the desired processing method associated with at least one feature of the internal configuration of the component.