Nadella says AI models need an emergency brake
The Microsoft CEO wants models separated from the systems that run them, with a human able to stop them mid-task.
Policy#02
Policy
Image: TechCrunch
The short version
- Microsoft CEO Satya Nadella posted on X on a Saturday morning, calling for a step back to assess the trust architecture of AI.
- He said AI models should be separated from the harness that orchestrates their work, and that controls and safeguards should be externalized.
- He called for every meaningful model action to be documented with tamper-proof human readable evidence.
- He said an authorized person should always be able to pause or shut down a model mid-task.
Why it matters
Nadella's post adds to calls from across the industry for incident disclosure, independent audits and containment. For developers, it points to designs that separate models from orchestration code and log every meaningful action. The post comes as AI companies acknowledge more incidents where they seemed to lose control of their models.
“We must assume a model is compromised and contain it from the start.”