Bastion: Capability Safety for AI Safety
We argue for concise formal architectural policy descriptions which are responsible for specifying constraints and passing a minimal set of capabilities to downstream system components and AI agents working within these components. By constructing the operating system for AI agents atop a capability-safe programming language, we will be able to provide formally provable bounds on AI capabilities, addressing a major problem in governing agentic AIs.