How AI autonomy is outrunning the limits placed on it
The debate about AI often centers on what could happen if it ever slips out of control. That fixation makes it easy to miss how much control organizations have already handed over.
Cybersecurity, a field you might expect to be the most aware of potential AI risk, has been one of the most eager to embrace it.
For decades, cybersecurity rested on two assumptions. Prevention would stop attacks before damage occurred, and people would stay in charge of the defenses. AI is challenging both. The goal of reducing risk hasn't changed, but the way we get there has. When attacks move at machine speed, containment matters as much as prevention.
This research measures the scale and effects of that challenge.
now delegate decisions and actions to AI that would have required human approval a year ago
can see and audit every action an AI agent takes — against 84% who claim clear visibility
,
name explicitly defined permitted actions as one of their two primary controls, the least common approach assessed
had at least one AI‑related security issue or warning sign in the past 12 months
What emerges is a picture of AI authority moving faster than the limits placed on it. AI no longer just suggests and summarizes. Now it acts, making decisions and carrying them out, often with no human in the loop. Seventy percent of organizations are now delegating decisions and actions that would have needed human approval a year ago . While security teams typically see themselves as risk-averse, many security and IT decision-makers are comfortable trading increased cyber risk in exchange for the benefits AI brings.
That trade-off is already producing consequences. In the past 12 months, 76% of organizations experienced at least one AI-related security issue or warning sign .
The most common incidents relate to AI tools suggesting risky actions. Behind this sits a cluster of boundary failures — AI connecting to systems without approval, accessing data it should not reach, and triggering unsanctioned actions.
Most respondents still lean on controls that shape how AI behaves. Internal guardrails and human oversight were named about as often as outside containment controls. But only a quarter explicitly defined permitted actions as one of their two main controls, the least common approach assessed. Defining what an agent is intended to do is no longer enough. Organizations must define what it’s allowed to access, where it can connect, and how far it can move if something goes wrong.
But those boundaries are only effective if organizations can see and verify what agents are actually doing. While 84% say they have clear visibility into how AI systems access data and resources, only 49% can see and audit every action an AI agent takes.
That gap — between the authority organizations have granted AI and the limits they have placed on it — is the subject of this report. The sections that follow trace:
Sapio Research conducted this study for Illumio, surveying 1,100 IT and security decision-makers at manager level and above. Interviews were conducted online during August and September 2026, using email invitations and online partner panels. Markets covered: Australia, Brazil, the DACH region, France, Japan, Mexico, the Middle East, Singapore, the United Kingdom, and the United States.
All samples are subject to variation. In this study, the chances are 95 in 100 that a result varies by no more than three percentage points from the figure a full census would have produced.
Unless stated otherwise, all figures are global totals.
Wording. The questionnaire is reproduced exactly as asked, in the British English the survey was fielded in, wherever it is shown as such: in quotation marks, in the question pop-ups, and throughout the appendix. Where the report’s own charts use answer options as labels, they are set in American spelling for consistency with the rest of the report.
Rounding. Percentages are rounded to the nearest whole number and may not sum to exactly 100. Where a figure combines answer options — “% Agree”, “% Confident” — it is the combined figure as published, which can sit a point away from the sum of its rounded parts.
AI is now embedded where an instruction becomes an action. Most organizations use it in IT operations and cybersecurity operations . And its authority reaches well past advice. Close to a third (32%) are comfortable letting AI run security investigations with no human review . Over a quarter (28%) are comfortable letting it modify production environments unsupervised .
Adoption has outrun the controls meant to govern it. Sixty-two percent of decision-makers agree they deployed AI tools before setting up the right safeguards , and 69% say their organization has accepted higher levels of risk to realize the benefits AI brings . At the same time, confidence about AI safeguards outpaces respondents’ ability to control it. A large majority claim clear visibility into how AI systems access data and systems, but half cannot audit every action an agent takes , .
Most organizations have already seen something go wrong. In the past 12 months, 76% experienced at least one AI-related security issue or warning sign, ranging from risky recommendations to agents connecting to systems without approval . However, the control that most directly limits AI’s reach ranked last. Only 25% named explicitly defined permitted actions as one of their two primary controls .
Many organizations still think of AI tools as assistants for planning and summarizing. But across the business, and especially in the functions these security leaders are responsible for, it is already doing much more.
32%
are comfortable letting AI run security investigations with no human review
26%
are comfortable letting AI reset privileged credentials unsupervised – those with administrative control over critical systems
12%
would never allow AI to shut down systems, the highest refusal rate anywhere in the study
AI is now common in the functions closest to the infrastructure that keeps a business running. It is most widespread in IT operations and service management, then cybersecurity operations, data analysis and software development — and it reaches every function the study asked about .
Across these functions, AI is becoming embedded in the parts of the business where an instruction directly turns into an action. Enterprises are letting agents make decisions and changes without regular human intervention.
In this report, an “AI agent” is a system that doesn’t just produce an answer — it acts on it. It calls other systems, changes configurations, and completes multi-step tasks. That ability to act, not the underlying model itself, is what turns an AI agent deployment into a security boundary issue.
AI has not settled into one corner of the business. It runs heaviest in the functions closest to the infrastructure — but nothing on this list sits below three in ten, and the average organization named close to five.
. Select all that apply, so shares sum past 100%. Bars scale to 80%. “Other” drew no selections and is left out.
How organizations describe their current and expected use of AI for each activity, ordered from the lowest-stakes task to the highest. Ranking by unsupervised use instead gives exactly the same order: comfort falls in step with what a wrong call would cost, from 43% down to 26%, without once rising.
Close to a third would let AI investigate and fix security issues with no human review , . As many would let an agent cut off a compromised device on its own. That means taking a machine off the network without waiting for anyone to approve it.
For every activity assessed, only a small minority said they would never be comfortable letting AI perform it . Even shutting down systems, the most refused task in the study, leaves almost nine in ten willing to let AI pull the plug under some circumstances.
On every rung of the ladder, a wrong choice can have immediate consequences. An overzealous action can interrupt business operations. A lax one can let a threat escalate into an incident.
The same pattern runs through software releases and infrastructure, where a mistake can cost just as much. About three in ten would let AI ship code changes or change live systems with no one watching , .
Even the most sensitive tasks are being handed over. Over a quarter would let AI grant or remove access rights, or reset privileged credentials, with no one checking , . Those credentials belong to the accounts that run critical systems.
Unsupervised AI has become surprisingly common in critical IT and security functions. Still, organizations usually keep a person in the loop, at least for now. For most of the tasks tested, around half of decision-makers are comfortable letting AI act only if someone reviews what it does . But it’s rare for AI to be off the table altogether.
AI already holds the permissions of a senior operator across these functions. The question is no longer whether it acts, but how far it can go when it does, and whether anyone is watching when it happens.
Many enterprises are consciously granting AI more authority and accepting increased cyber risk in exchange for its operational benefits.
69%
have accepted higher levels of risk to realize the benefits of AI
70%
now delegate decisions that a year ago would have required human approval
62%
deployed AI tools before setting up appropriate safeguards
Most decision-makers agree their organization is willing to accept higher risk to realize the benefits of AI . And that risk appetite is growing. More than half accept more AI-related cyber risk than they did a year ago .
The clearest consequence is in who now signs off. Most organizations now let AI make decisions and take actions that once needed a person’s approval .
How organizations describe their approach to AI-related cyber risk against a year ago, clockwise from the top in the order it was asked — least appetite to most.
Practices these organizations now allow that would have been considered too risky 12 months ago.
Among those accepting more risk, about half now let AI act, not just advise, including on its own in live production. Its reach has widened with that freedom: to the internet, to sensitive data, and to privileged identities that carry administrator-level access .
How comfortable decision-makers are with the level of cyber risk their organization now carries to support AI.
Many respondents appeared willing to accept more AI risk in return for operational gains. But adoption has often moved faster than security. Most decision-makers agree they deployed AI tools before setting up the right safeguards .
Anyone who was securing IT infrastructure during the early years of cloud adoption will recognize this pattern. Workloads moved to new environments faster than the controls built to protect them; data protection and governance lagged behind the pressure to migrate.
The cost of this haste came later. Teams spent years retrofitting controls onto environments that were already running in production. And breaches traveled further than they should have, because nothing inside those environments limited movement. Many organizations are still grappling with the fallout of rushed migration.
Most IT and security leaders are at ease with the AI risk their company now accepts, and few are uneasy. But that ease runs shallow. More are somewhat comfortable than very comfortable .
AI keeps moving deeper into critical operations. Yet most IT and security leaders are confident they have a firm grip on their AI deployments. The great majority believe they can see how AI systems access data and systems . And 81% agree they fully understand the risks AI agents introduce .
84%
say they have clear visibility into how AI systems access data and systems, yet only 49% can see and audit every action an AI agent takes
,
92%
are confident their own guardrails would stop an AI acting outside its intended role
48%
say they are not prepared for the risks introduced by frontier AI
Nearly all are also confident they could contain a compromised or out-of-role AI system before it reached critical systems or data .
But that confidence doesn’t match what teams can actually track. When asked what their security team can observe, fewer than half (49%) said they can see and audit every action an AI agent takes . The rest have a less complete view. Thirty-two percent see most actions but not all. Twelve percent see only the outcomes, not the individual actions behind them. And a small minority (6%) have limited or no visibility .
Confidence in containment against the share that has actually been hit. Choose a lens to split the sample — the two measures move almost independently of each other in every one.
That is a 35-point gap between the visibility organizations claim and what they can prove.
Respondents grouped by how comfortable they say they are with the level of cyber risk their organization currently carries to support AI.
What they say about themselves
66%85%97%
+31pts
Confident they could contain a compromised agent
56%72%86%
+30pts
Fully understand the risks AI agents introduce
68%67%88%
+20pts
Have clear visibility into how AI accesses data
What they actually did
45%45%66%
+21pts
Deployed AI tools before safeguards were in place
18%12%28%
+10pts
Let AI reset privileged credentials, no human review
What happened to them
72%67%78%
+6pts
Had at least one AI-related event in 12 months
That confidence extends to the controls wrapped around those AI systems. Nearly all trust their own guardrails to stop an AI model acting outside its intended role, and almost as many trust the ones their AI providers supply , .
Confidence that each kind of guardrail would stop an AI system acting outside its intended role.
But organizations do not need to predict every decision an AI agent might make to control its impact. They can control what it can access, where it can connect, and what it can do.
Confidence does have a limit, and frontier AI is where it stops. Frontier AI refers to the models at the cutting edge of what the market offers. Nearly half of decision-makers say they aren’t prepared for the risks it introduces , even as most report clear visibility into today’s AI . Taken together, the findings suggest a sharp divide between confidence in today’s deployments and readiness for what comes next.
As AI systems gain greater reach and autonomy, respondents are also reporting a high level of AI-related security issues and warning signs. Over three-quarters of the decision-makers reported at least one AI-related security event in the last year.
76%
experienced at least one AI-related security issue or warning sign in the past year
only25%
selected explicitly defined permitted actions as one of their two primary controls
26%
had an AI agent or tool connect to their systems without security approval
Some of these issues come from outside: attackers using AI to write phishing lures or pose as someone else to get in. These tools have lowered the barrier to entry for criminal groups. They make it easier to run targeted campaigns at scale.
Share of organizations reporting each event involving an AI system, agent, or AI‑enabled tool.
Inside, the failures take several forms. The most common was an AI tool suggesting a security step that would have added risk if followed. These risky recommendations were caught because a human was still in the loop to review suggested actions.
Behind it sits a cluster of boundary failures: agents linking to systems without approval, reaching data they should not, and taking actions no one allowed . Whatever their underlying cause, these events became security failures because the agent could reach systems, data, or actions without an effective boundary stopping it.
These internal incidents reflect the most common AI fears held by IT and security decision-makers. Their top worry is sensitive data getting out, then AI-powered attacks from outside.
Each respondent chose up to three concerns.
Public attention is often drawn to the dangers of AI in the hands of attackers, while overlooking how risky internal AI systems can be. But fear of outside attacks is about level with fear of their own AI getting too much access, or going past its role . Yet, AI tools essentially have a head start – while attackers must find a way in, a company’s own AI has already been handed all the credentials it needs.
That inherited access matters more because the defenses around it are growing less effective. Two-thirds of leaders (66%) say keeping systems patched is no longer sufficient to prevent compromise, and 61% say blocking known bad behavior no longer works as a primary security strategy , . The controls built to keep attackers out were never designed for something that starts on the inside holding valid credentials.
Primary controls, up to two selections each.
Decision-makers were asked to pick two primary controls for managing what AI systems can do. Three came out at broadly similar rates . Internal guardrails are the policies, instructions, and behavioral constraints applied to the AI itself. External containment controls restrict what AI can access or affect when something goes wrong. Human oversight was the third. The real story is at the bottom of the list. Explicitly defined permitted actions, or allow-listing, ranked last .
Looking at wider AI security strategy, 34% say their primary approach to securing AI systems and agents is to prevent risky actions through policies, filters, and guardrails , while a similar 33% focus on tightly controlling access.
Some of these priorities point in the wrong direction. Guardrails, oversight, and monitoring all describe how an AI system ought to behave. But every incident in this section involves a system behaving differently from how it was told to. Allow-listing and access control are the only measures on the list that don’t depend on the AI cooperating. They govern what a system can access, not how it’s told to act.
The good news is that most security leaders see how their priorities need to change for AI. Most agree AI agents need a different kind of security control than ordinary software . Most also agree that limiting what AI can reach matters more than trying to predict every threat .
82%
agree AI agents require fundamentally different security controls from traditional software.
69%
say limiting what AI can access matters more than trying to predict every threat
42%
have allocated new budget in response to frontier AI risk
Share agreeing with each statement.
agree that AI agents require fundamentally different security controls than traditional software.
name explicitly defined permitted actions as one of their two primary controls for AI, the least common approach assessed.
Leaders have recognized the problem in the abstract. Few have changed the controls they actually rely on.
Organizations are putting more money behind AI security. Many are raising their overall security spending. Many have also set aside new budget just for AI risk.
How the risk from frontier AI has changed security investment.
Containment and segmentation sit at the bottom of this list — below awareness training.
But more spending doesn’t always mean more priority for the controls that restrict movement and contain impact. Of the ten capabilities assessed, network segmentation ranks last, with incident containment just above it . Organizations have accepted that reach is the thing to control. Yet they rank the controls that actually limit reach at the bottom of the list.
Writing rules for what AI must not do is a losing race. Nobody has ever finished a list of everything that could go wrong. Security has run this race before with firewall rules, application control, and identity. Each time, it won by flipping the question. The list of forbidden behavior is effectively endless. The list of allowed behavior is short enough to write down, agree on, and enforce.
Applied to AI, that is the practical logic of Zero Trust: start with what the agent needs to do and explicitly define the identity, access, connections, and actions required to do it.
Each step answers a gap this research uncovered.
The picture on AI risk is broadly similar across markets, but some differences are worth noting. Country-level findings are indicative due regional sample sizes.
51%
of US organizations are very comfortable with the level of AI risk they accept, compared with 37% globally
91%
of Singapore organizations experienced at least one AI-related security issue or warning sign in the past year
only16%
of French organizations say frontier AI has made segmentation more important, compared with 27% globally
The five measures that carry the argument, for each market surveyed.
n = 100 per market; United States n = 200.
| Market | Had an AI event | Confident they could contain | Can see & audit every action | Deployed before safeguards | No human review: privileged credentials |
|---|
Europe offers the opposite surprise. Despite strict European regulation, France has moved furthest of any market on risk appetite. Sixty-six percent of French organizations accept more cyber risk than they did 12 months ago, compared with 56% globally. DACH also sits above average at 61% . France pairs that jump in risk appetite with the lowest priority on segmentation. Just 16% say frontier AI has made segmentation more important, compared with 27% globally .
In the U.S., just over half of respondents (51%) are very comfortable with the risk they now accept . That’s the highest share of any market. And 71% are very confident they could contain a compromised AI system, second only to the Middle East at 73% . Despite this higher confidence, U.S. willingness to take on more risk than a year ago (56%) matches the global average .
Australia puts more emphasis on limiting AI’s reach. Thirty-seven percent of Australian organizations say frontier AI has increased the importance of network segmentation or microsegmentation, compared with 27% globally . And 77% say limiting what AI can access is becoming more important than trying to predict every threat, compared with 69% globally .
LATAM is less uniform. Mexico reports a relatively high increase in risk appetite: 64% are willing to accept more cyber risk than a year ago. Yet only 52% say limiting AI access is becoming more important than predicting every threat, compared with 69% globally , . Brazil shows a different pattern. Forty-eight percent are very comfortable with their current risk level. Yet only 59% are delegating previously human-approved decisions to AI, below the 70% global average , .
Finally, Singapore reports the most security issues by a wide margin. Nearly all (91%) have experienced at least one AI-related security issue or warning sign in the past year vs. 76% globally . Only 39% are very confident they could contain a compromised or rogue AI system.
Illumio helps organizations set limits on what AI can reach. Our breach containment platform maps how AI agents, workloads, applications, and data actually connect, then lets you enforce the boundaries that keep a single failure from spreading.
Read all 40 of the study’s questions for any one of 43 groups, or set several groups against each other on every one of them.
Reading a filtered figure. The ±3 point interval above is the full-sample figure. The explorer lets you cut the sample much finer than that, and a smaller group carries a wider interval: a single market has a base of about 100, where the comparable figure is nearer ±10. Treat a difference between two small groups as a direction, not a measurement.
What is suppressed. Every figure in the explorer comes straight from the published cross-breaks — nothing is re-weighted, modeled or multiplied out. Where a base falls below 30 respondents the percentages are withheld rather than shown unreliably, and a base below 100 is flagged on the control that selects it. Two-way breaks exist only for market crossed with one other characteristic, and only 90 of the 320 possible cells clear the 30-respondent floor.
1Pick who to read it for
All respondents reads every question for the whole sample of 1,100, as the report does. One group reads them for a single market, industry, company size, role or answer group — and, inside a market, for one break within it. Compare groups sets several against each other on every question.
2Narrow it to a topic