Permissive Strategy Templates: Theory and Applications to Autonomous Systems
Ashwani Anand
Max Planck Institute for Software Systems
02 Sep 2026, 10:00 am - 11:00 am
Kaiserslautern building G26, room 111
SWS Student Defense Talks - Thesis Proposal
Critical autonomous systems, such as robots operating amongst humans or a rover
navigating on a remote planet, must continuously react to environments they do
not control while provably satisfying their specifications. Designing a correct
controller for such machines manually is impossible as a human cannot foresee
every environmental possibility. Reactive synthesis provides an alternative
approach of automatically building correct-by-construction controllers from
formal specifications. Although this is a well-studied field, it almost
entirely focuses on finding a single controller that satisfies the
specification. ...
Critical autonomous systems, such as robots operating amongst humans or a rover
navigating on a remote planet, must continuously react to environments they do
not control while provably satisfying their specifications. Designing a correct
controller for such machines manually is impossible as a human cannot foresee
every environmental possibility. Reactive synthesis provides an alternative
approach of automatically building correct-by-construction controllers from
formal specifications. Although this is a well-studied field, it almost
entirely focuses on finding a single controller that satisfies the
specification. The real world, however, is transient, and a single controller
is rarely sufficient in practical applications. When an action proposed by the
controller becomes unavailable (e.g., due to a component failure), the system
immediately stalls, forcing an expensive re-synthesis.
This thesis addresses this problem by introducing a concise data-structure, called the strategy template, which represents infinitely many controllers. Strategy templates localize a given specification by local guidelines for a controller to choose the next action. In the first part of the thesis, we define the notion of strategy templates for major classes of specifications and models of interaction of the system and the environment. We then provide algorithms for computing the templates, and prove soundness (i.e., a controller following the template satisfies the specification) and completeness (i.e., if there is a controller that satisfies the specification, we compute a strategy template). We show that the strategy templates enable us to compose various specification online, and make controllers more robust to changes in the environment at runtime. In the second part, we utilize the resulting permissiveness (i.e., capturing infinitely many controllers) of the templates to shield learned policies which usually lack formal guarantees of correctness. The templates allow us to monitor and nudge the policies to ensure that they satisfy liveness (i.e., some progress is made), which until now had eluded the shielding literature. Furthermore, we implement all the algorithms proposed and show that they outperform the state-of-the-art in terms of composibility, robustness and scalability.
Read more
This thesis addresses this problem by introducing a concise data-structure, called the strategy template, which represents infinitely many controllers. Strategy templates localize a given specification by local guidelines for a controller to choose the next action. In the first part of the thesis, we define the notion of strategy templates for major classes of specifications and models of interaction of the system and the environment. We then provide algorithms for computing the templates, and prove soundness (i.e., a controller following the template satisfies the specification) and completeness (i.e., if there is a controller that satisfies the specification, we compute a strategy template). We show that the strategy templates enable us to compose various specification online, and make controllers more robust to changes in the environment at runtime. In the second part, we utilize the resulting permissiveness (i.e., capturing infinitely many controllers) of the templates to shield learned policies which usually lack formal guarantees of correctness. The templates allow us to monitor and nudge the policies to ensure that they satisfy liveness (i.e., some progress is made), which until now had eluded the shielding literature. Furthermore, we implement all the algorithms proposed and show that they outperform the state-of-the-art in terms of composibility, robustness and scalability.