Infrastructure
Sovereign AI: where your agents actually run
In 2022 almost nobody asked where an AI workload executed. In 2026 it is a board question, the sovereign cloud market is measured in tens of billions, and Gartner expects most enterprises adopting generative AI to name digital sovereignty as a top selection criterion by 2027. For agents the question is sharper than it is for models, because an agent holds credentials and takes actions.
The short answer: sovereignty is about jurisdiction and control — whose law governs your data, who can compel access to it, and whether you could keep operating if a supplier relationship changed. Data residency (where bytes are stored) is one component and the easiest to satisfy. For AI agents you have to answer it in four places, not one: where the data sits, where the model call goes, where the credentials live, and where the agent's memory and logs accumulate.
Third-party figures on this page were checked on 26 September 2026 against the publishing organisation's own release or report. Research in this field ages quickly and definitions vary between surveys — treat any undated statistic with suspicion, including on our own pages.
Why this became urgent in 2026 specifically
Three things converged. Regulation gave it a deadline: the EU AI Act's obligations arrived on a schedule, which turned an architectural preference into a compliance date. Geopolitics gave it a reason: enterprises started asking what happens if a supplier's home jurisdiction changes what that supplier may do. And the hyperscalers gave it a product line — AWS, Microsoft, Google and Oracle all shipped sovereign or boundary offerings for Europe, which made "where does this run" a question with a purchasable answer rather than an awkward one.
The market numbers follow from that. Sovereign cloud spending was reported at around $80bn in 2026, growing about a third year on year, and sovereign AI investment globally is projected above $100bn — from a base close to zero four years earlier.
Four places an agent touches, and the question for each
Most vendor sovereignty claims answer the first of these and go quiet on the rest.
- Data at rest. Where do documents, transcripts and records physically live? This is the question everyone asks, and the one with the easiest answer.
- The model call. When your agent reasons, whose infrastructure processes the prompt, and what is the contractual position on retention and training? An agent whose files never leave a region but whose every thought crosses an ocean has solved the easy half.
- Credentials. An agent holds tokens to your mail, your CRM, your files. Where those are stored and who can decrypt them is a sovereignty question with an incident-response dimension attached.
- Memory and logs. The agent's accumulated context — what it learned, what it did, who approved it — is often the most sensitive artefact of the lot, because it is a distillation of everything else. It is also the one most likely to be sitting in a vendor's shared database without anyone having asked.
Six questions worth putting to a vendor in writing
- In which jurisdiction does the compute run, and can I choose it? A region list is not a commitment unless your tenancy is pinned to one.
- Where does the model inference happen, and under what retention terms? Ask separately for the default model and for anything the platform calls internally — summarisation, embedding, classification.
- Where do you store the credentials my agents use, and who can read them? The answer should involve encryption at rest and a scope limited to the agent, not the account.
- Where does the agent's memory live, and can I export and delete it? Export is the test of whether you own it. Deletion is the test of whether they meant it.
- What happens to all of the above if I stop paying? A clean answer here is the difference between a supplier and a dependency. We wrote about the general case in platform lock-in and what it costs.
- Can I run this on infrastructure I control, and what do I lose if I do? Even if you never exercise it, the shape of the answer tells you how the product is built.
Self-hosting is a means, not the goal
A common move is to jump straight to "we will self-host everything". Sometimes that is right. Often it substitutes one risk for another: an agent stack running on a server nobody patches, with backups nobody tested, is less resilient than a managed deployment in the correct jurisdiction. The honest comparison includes the operational load, which is the part most plans underestimate — what self-hosting an agent really costs works through it.
The useful middle is a deployment you control, in a region you chose, that you could move. Control over configuration, credentials and data, without owning the pager. That is also what makes the answer defensible to an auditor: not "we run it ourselves" but "here is where each of the four things lives, and here is how we would change it".
The sovereignty question agents raise that models do not
A model that answers a question and forgets it poses a data question. An agent that holds credentials, takes actions in your systems and accumulates a record of what it did poses an operational one: if access to the platform ended tomorrow, what would you have lost, and what would still be running with your keys?
That is worth answering before it is urgent. The agents whose answer is comfortable tend to be the ones where state and credentials were kept in one place the customer controls from the beginning — not the ones that got migrated there later.
For the regulatory backdrop this sits inside, see the EU AI Act and AI agents and the US state AI law patchwork.
Related reading
What self-hosting really costs
The operational bill behind the infrastructure line, which is the part most plans leave out.
Platform lock-in
The export test, the deletion test, and what you would actually lose.
The EU AI Act and AI agents
The regulation that turned an architectural preference into a date in the calendar.
Local versus cloud agents
The trade-off in its concrete form, rather than as a principle.
FAQ
What is sovereign AI?
Running AI workloads under a chosen jurisdiction's control — where the data sits, whose law governs it, who can compel access, and whether you could keep operating if a supplier relationship changed. It is broader than data residency, which only concerns where bytes are physically stored.
What is the difference between data residency and data sovereignty?
Residency is geographic: the data is stored in a named country or region. Sovereignty is legal and operational: which jurisdiction's law applies, who can be compelled to hand data over, and who holds the keys and the ability to keep the system running. Data can be resident in one country and still be subject to another country's legal reach.
Which parts of an AI agent raise sovereignty questions?
Four, and vendors typically answer only the first. Where the data sits at rest; where the model inference call is processed and under what retention terms; where the agent's credentials are stored and who can decrypt them; and where the agent's memory and action logs accumulate. The last is often the most sensitive, because it is a distillation of everything else.
Does sovereignty mean we have to self-host?
No, and jumping straight to self-hosting often trades one risk for another — an unpatched server with untested backups is less resilient than a managed deployment in the right jurisdiction. The defensible position is a deployment you control, in a region you chose, that you could move: control over configuration, credentials and data without owning the pager.
What should I ask an AI vendor about data residency?
In which jurisdiction the compute runs and whether you can pin it; where model inference happens and under what retention terms, including for internal calls the platform makes; where agent credentials are stored and who can read them; where agent memory lives and whether you can export and delete it; what happens to all of it if you stop paying; and whether you could run it on infrastructure you control.
A deployment you control, in a region you chose
Your own environment, your own credentials, your agents' memory and logs in one place you can export — without running the infrastructure yourself.