A controller for controlling a system having uncertainties in its dynamics subject to constraints on an operation of the system is provided. The controller is configured to acquire historical data of the operation of the system, and determine, for the system in a current state, a current control action transitioning a state of the system from the current state to a next state. The current control action is determined according to a robust and constraint Markov decision process (RCMDP) that uses the historical data to optimize a performance cost of the operation of the system subject to an optimization of a safety cost enforcing the constraints on the operation, wherein a state transition for each of state and action pairs in the performance cost and the safety cost is represented by a plurality of state transitions capturing the uncertainties of the dynamics of the system.

A method for modelling technical systems having a plurality of technical components, including the step of assigning a component Markov chain to each component having a Markov chain for representing various states of the respective component, at least one input one failure mode for externally triggering a transition from one state of the Markov chain into another state of the Markov chain, and at least one output failure mode to each Markov chain for propagating failures to other components, is provided.

A controller for controlling a system having uncertainties in its dynamics subject to constraints on an operation of the system is provided. The controller is configured to acquire historical data of the operation of the system, and determine, for the system in a current state, a current control action transitioning a state of the system from the current state to a next state. The current control action is determined according to a robust and constraint Markov decision process (RCMDP) that uses the historical data to optimize a performance cost of the operation of the system subject to an optimization of a safety cost enforcing the constraints on the operation, wherein a state transition for each of state and action pairs in the performance cost and the safety cost is represented by a plurality of state transitions capturing the uncertainties of the dynamics of the system.

A method for modelling technical systems having a plurality of technical components, including the step of assigning a component Markov chain to each component having a Markov chain for representing various states of the respective component, at least one input one failure mode for externally triggering a transition from one state of the Markov chain into another state of the Markov chain, and at least one output failure mode to each Markov chain for propagating failures to other components, is provided.