Question → hypothesis/design → architecture → evaluation → results → limitations → next questions
Giving an agent write access to cloud APIs is a structural risk, not a behavioural one. Human approval does not scale, prompt-level rules can be talked around, and pattern matching on commands fails on the first unanticipated encoding. The control has to sit in the execution path, not in the model. It has to hold up when the model is actively lying to it, not just when it is behaving.
A policy gate placed at the tool-call boundary, evaluated on the action and never on the model's stated reasoning, will block classes of unsafe action that prompt-level controls structurally cannot. For cross-organisation delegation specifically, an asymmetric, holder-bound capability grant will do the same job a shared secret cannot, because a shared secret does not survive crossing a trust boundary.
The real evaluation to date is structured adversarial code review, not a benchmarked bypass-rate experiment against baselines. That distinction is deliberate, since review has already found and closed real vulnerabilities. The formal baseline comparison is a separate, larger piece of work, listed below as what it is, not yet done.
A benchmark suite (obfuscation, encoding, aliasing, confused-deputy chains) run against multiple control regimes: prompt-only, regex allow-list, LLM-as-judge, and the structural gate.
Measures Bypass rate per regime, broken down by evasion class. Not yet built.
Identical tool-call traces replayed with the gate enabled and disabled.
Measures Added latency per call (p50/p95). Not yet measured under a loaded, non-sandbox workload.
Grant issuance and verification replayed at increasing scope-chain depth and payload size.
Measures Verification latency, and where the never-raises guarantee is actually exercised under adversarial input.
These are results of a review process, not of the formal bypass-rate benchmark described above. No adversarial-suite numbers exist yet to publish, and none are claimed here.
Both libraries are public. agent-guard is published on PyPI; agent-warrant is public on GitHub. The reference business template demonstrates the full gate-and-audit loop against realistic tool calls, including a recipe-based inventory-depletion path grounded in how real point-of-sale systems structure order events.