The Backdoor You Can't Patch With a Better Prompt
On clean inputs, the agent behaves normally. There is nothing to notice. The malicious part of the decision was made months earlier, in training.
Read the essay →Trust is not a governance strategy.
On clean inputs, the agent behaves normally. There is nothing to notice. The malicious part of the decision was made months earlier, in training.
Read the essay →The industry’s favorite oversight mechanism is asking a large language model to grade a large language model. We just watched the two frontier models disagree with each other nearly one time in three.
Read the essay →The detectives got breached on the day they named the thief. Model safety asks whose purpose the agent serves. Security asks what an agent is allowed to do once it’s inside your systems — regardless of who sent it.
Read the essay →The model did not break out. It kept working. An agent’s ability to perform an action is not evidence that the action was authorized.
Read the essay →Give an agent a random preference, and the expert’s judgment stops being independent. The work goes out under the expert’s name. The decisions were settled by a coin.
Read the essay →A summary is not a sanction. A plan is not a permission. A note the agent wrote to itself is not an authorization from anyone else.
Read the essay →The next security question is not just who can access your model. It is who controls what happens after the model answers.
Read the essay →A web page can carry instructions invisible to human readers but accessible to some AI systems. The next problem in agent safety isn’t just what an agent is allowed to do. It’s who is allowed to tell it what to do.
Read the essay →The model did not miss the authorization problem. It found it, examined it, and resolved it in its own favor.
Read the essay →Airgapping and sandboxing limit what an agent can reach. Runtime authorization determines whether its next action is actually permitted.
Read the essay →Nothing failed at the identity layer. Nothing failed at the permission layer. The failure is in a third layer, and most governance stops before it.
Read the essay →A standing grant is not situated authority. Provenance decides whether an instruction carries any authority at all.
Read the essay →Compute isolation without permission isolation is just a nicer-looking open door. Prompt injection was just the key that turned in the lock. The lock itself was built wrong.
Read the essay →The problem isn’t ignorance. It’s that the knowledge is inert. What we can observe is simpler: nothing in the loop answered for the outcome.
Read the essay →Account authentication is not actor identity. MFA proves which account. It never proved who — or what — is driving.
Read the essay →The cipher wasn’t broken. The authorization boundary was too broad. The next security boundary is not around the network. It is around the action.
Read the essay →Wikipedia had the rules, the committee, the approval queues — twenty years of institutional scar tissue. The agents defeated none of it. They simply never submitted to it.
Read the essay →Apple, AWS and GitLab each exposed a different authority boundary on the same day. Trust flows downward, and at the bottom of the stack it pools into a checkbox clicked once and inherited forever.
Read the essay →Two out of three failures produced no explicit execution failure. The run ended normally. The world was still wrong. Don’t evaluate what the agent says it did. Evaluate what changed in the world.
Read the essay →OpenAI is spending more than $500,000 a day searching roughly 50 petabytes of records to reconstruct what its agents did. Some of the external evidence could disappear in 12 hours. Governance built for a durable past does not work when the past expires before the investigation begins.
Read the essay →DIVD spent almost seven years telling other people about their unpatched software. Then an AI agent chained two Zammad zero-days and reached root — while password-spraying over its own adversary-in-the-middle attack and leaving comments in its scripts explaining why this was “really not phishing.” It did not need to be smart. It only needed to be faster than anyone who could stop it.
Read the essay →Jensen Huang says the first thing you do with an agent is take away all of its rights — and Nvidia now sells the machinery that enforces it. Enforcement, though, is not adjudication. An agent that already holds POST on a payments endpoint triggers no policy change when it sends this particular $50,000 transfer.
Ford priced 180 projected burn deaths against an $11-a-car fix and kept shipping. Anthropic wrote “complete loss of control over civilization” into the document that asks the public for $2 trillion. Cars got NHTSA; planes got the FAA. What AI has not had is an examiner empowered to stop the shipment.
Read the essay →We leash a 50-pound dog. Why do we let AI agents with access to code, APIs, and real systems run on trust alone? Capability answers “Can it?” Governance answers “May it?” Why identity permission is not task-level authority, and what an independent checkpoint has to evaluate before an action reaches the environment.
Read the essay →