Certain aspects and features of the present disclosure relate to providing contextually grounded recommendations using a large language model. For example, a method involves receiving domain specific data for a simulation and transforming the domain specific data into a labeled, natural language description of the domain specific data. The method also involves providing the labeled, natural language description and a classification task prompt with interaction history to a large language model (LLM) to generate a contextually enhanced LLM configured to produce context-aware output. The method further involves outputting, using the contextually enhanced LLM, an interactive list of scored actions corresponding to the simulation. The interactive list can be used to produce a sequence of actions to direct a process or control a machine.