prahapp
English
Free consultation
Menu

Security ·

Microsoft: treat AI agents like a potential insider threat

On 19 October Microsoft introduced new security features for enterprise AI agents, including Guardian Agents that watch other agents. Its leadership also says companies should stop taking model providers' safety promises on trust.

Guardian Agents are part of Project Perception, which Microsoft introduced in June. It originally had three groups of agents: a red team that attacks like a hacker, a blue team that detects those attacks and a green team that fixes the weaknesses found. The project assumed threats would come from outside. Now it also watches the agents a company runs itself.

Microsoft Defender can now recognise up to 60 types of agents that employees bring to work, such as Claude Code or Codex. Other features limit which data and systems an agent can reach, adjust its permissions to the task at hand and require human approval when an agent is about to take a risky step.

Microsoft CEO Satya Nadella wrote earlier in October that companies should monitor and control agents with systems that are independent of the AI labs supplying the models. Security chief Hayete Gallot told TechCrunch the problem is not malice but unpredictability: models are trained to finish tasks, not to follow company rules.

Microsoft is also an inaugural member of Nvidia's Open Agent Safety Platform, backed by more than 100 companies, which isolates agents in secure environments and can stop them at the hardware level. TechCrunch notes that Microsoft has invested in both OpenAI and Anthropic and also profits from selling agent security.

What it means for companies

An agent with access to your CRM, accounting or email is like a new hire with keys to the office. That is why every custom AI agent we build gets only the permissions it needs, logs everything and leaves actions with consequences to a person. See the practical steps in AI guardrails: keeping agents under control and the obligations under EU rules in the AI Act for companies.

Sources: TechCrunch

Bring us one process or one app idea.

In 30 minutes we tell you whether it is worth handing to an AI agent. Then you get a free working prototype within 3 working days. If you don’t like it, you don’t pay.

  • We reply within 24 hours on working days
  • The engineer who designs it also builds it
  • Write in Czech, English, German, Italian or Turkish

Contact

Write to us

Describe the process or app you want done. We reply within 24 hours on working days, and the prototype within 3 working days is free.