Patent classifications
G05B2219/32004
Vehicle build information system
A system and methods for vehicle build information management in an assembly plant are disclosed. Once example method includes receiving, from a first information source, identification information for at least one vehicle being assembled in the vehicle assembly plant. The method further includes receiving, from a second information source, build instructions describing at least one work process to be performed for the at least one vehicle. The method further includes receiving, from a third information source, inventory information identifying a plurality of components required to comply with the build instructions. Finally, the method further includes sending for display, to a user interface, a visual representation of at least two of the identification information and the build instructions and the inventory information.
HUMAN-IN-LOOP ROBOT TRAINING AND TESTING SYSTEM WITH GENERATIVE ARTIFICIAL INTELLIGENCE (AI)
A robot teaching and testing system and method that performs human-operated robot tasks according to instructions generated from generative AI models. The process starts with a user prompt and combines the user prompt with predefined prompt templates to generate well-formatted text prompts. Generative AI models take the text prompts and convert them into high-level instructions or control codes that can be deployed on a robot. The high-level instructions are then converted into human-operated robot tasks for a human data collector using a mixed reality (MR) device. The human data collector will attempt to follow the instructions to complete the human-operated robot tasks and may overwrite the suggested instructions by performing a different action, demonstrate a task without instructions, or leave feedback or comments regarding the tasks. Feedback data will be captured and saved for improving the robot system.