Microsoft CEO: AI Must Stay Under Human Control, No Rush
Microsoft CEO: AI Must Stay Under Human Control, No Rush
In a candid internal memo, Microsoft CEO Satya Nadella weighed in on the breakneck speed of AI development—and his message was clear: humans must stay in the driver's seat. He warned that as risks grow, the company should "spend as much time as needed" to ensure safety, or risk losing its license to operate.
A Growing Chorus for Caution
Nadella's comments come amid a wave of concern from industry leaders. Last week, researchers warned that AI could pose an existential threat. Over the weekend, Anthropic CEO Dario Amodei called for slowing down development and opening models to external monitoring. OpenAI's Sam Altman also backed third-party oversight and pausing deployment when necessary.
On Monday, Microsoft released a 37-page draft of its "humanistic" AI code of conduct. Mustafa Suleiman, who leads Microsoft's AI efforts, put it bluntly: "The theoretical concerns we've long had are now very real."
Three Pillars of Responsible AI
In his memo, Nadella laid out three key areas:
1. Design with purpose – AI must remain under human control and benefit society broadly. That means fostering both open-source and closed-source models, and being careful about the pace of change. More external testers? Good. When risks rise, take your time—or eventually, you'll lose your operating license.
2. Keep customers in control – Businesses need to maintain ownership of their unique, implicit knowledge. They should build their own continuous learning loops without being locked into a single model provider. Microsoft's Foundry platform helps by offering long-running agents with built-in security, safety, and FinOps.
3. Share the benefits – To build infrastructure, Microsoft must ensure local communities actually gain from it. Nadella pointed to the Quincy data center as an example of long-term co-growth with residents.
Walking the Talk
Nadella concluded that this is a three-level practice: how to build at the frontier, how to keep customers in control, and how to spread economic benefits widely. As a company, he said, Microsoft can point to real actions behind its words.
Key Points:
- Microsoft CEO Satya Nadella urges caution: AI must stay under human control, with ample time for safety testing.
- The company released a 37-page AI code of conduct, echoing calls from Anthropic and OpenAI for slower, monitored development.
- Nadella outlined three priorities: clear design objectives, customer control over data, and community benefit from infrastructure.
- Microsoft emphasizes concrete actions, not just words, in responsible AI development.