FTFuture Technology
COMPUTING

Japan Built the World's First National AI Infrastructure and It's Already Running

· 3 min read · By Nath Connell

Key takeaways

  • Japan's national AI infrastructure includes 13,750 NVIDIA Vera CPUs and 27,500 NVIDIA Rubin GPUs operated by Noetra Corp.
  • The facility uses NVIDIA's Vera Rubin architecture, with the NVL72 rack configuration packing 72 Rubin GPUs per rack
  • Japan chose to build sovereign AI infrastructure rather than rent compute from US cloud providers like AWS or Azure
  • France, UAE and India have announced similar ambitions but Japan has become the first to deploy at national scale

There is a difference between a government announcing an AI strategy and a government actually turning on the compute. Japan has done the second. Working with NVIDIA and a newly formed company called Noetra Corp., Japan has launched what is being described as the world's first national AI infrastructure — a purpose-built, government-backed compute facility designed to serve the AI needs of an entire country.

The numbers are specific and significant. The facility includes 13,750 NVIDIA Vera CPUs and 27,500 NVIDIA Rubin GPUs, deployed as part of an NVIDIA Vera Rubin AI factory. This is not a cloud service that Japan is buying access to. It is sovereign AI infrastructure, owned and operated to serve Japanese industry, research institutions, and government services.

What Vera Rubin Means at This Scale

NVIDIA's Vera Rubin platform is its current generation architecture, combining the Vera CPU with the Rubin GPU in an integrated system optimised for AI training and inference at large scale. The Vera Rubin NVL72 rack configuration packs 72 Rubin GPUs into a single rack with very high-bandwidth interconnects, which is important for the kind of large-scale model training that national AI infrastructure needs to support.

Deploying 27,500 Rubin GPUs is a serious commitment. For context, many of the largest commercial AI training clusters that made headlines in 2024 and 2025 were built with tens of thousands of H100 or H200 GPUs. Japan's national infrastructure is in that league, which means it is not a symbolic gesture — it has real capability to train frontier-class AI models.

Noetra Corp. is the entity established to operate this infrastructure. The involvement of a purpose-built operator rather than an existing cloud provider suggests that Japan wanted institutional control over the facility at a level that renting capacity from AWS or Azure would not provide. That is a meaningful policy choice: Japan is treating AI compute the way countries treat power grid infrastructure or telecommunications — as something too strategically important to leave entirely in foreign hands.

The Geopolitics of Sovereign Compute

Japan's move is the most concrete example yet of what AI sovereignty looks like in practice. Several countries, including France, the UAE, and India, have announced ambitions to build national AI infrastructure. Japan has actually done it, and at a scale that makes it credible as a frontier AI nation rather than just a consumer of AI services.

The future, in 3 minutes a day. The biggest tech story explained every morning, free. Get the briefing →

The distinction matters for several reasons. Countries that control their own AI compute can train models on sensitive domestic data — health records, government documents, financial data — without that data leaving the country. They can prioritise their own researchers and industries for compute access rather than competing in an open market. And they can build the technical expertise domestically that allows them to understand and direct the AI systems they are deploying.

For Japan specifically, sovereign AI infrastructure connects to the same economic urgency driving its manufacturing AI push. An ageing, shrinking workforce makes productivity through AI genuinely critical, not optional. Having national compute infrastructure means that productivity gains from AI can be developed and deployed on Japan's terms.

What Other Countries Should Take Note Of

The Japan model will be watched carefully by governments that have been deliberating about whether to invest in sovereign AI compute rather than simply procuring AI services from American cloud providers. The argument against sovereign compute has usually been cost: building and operating a large GPU cluster is expensive, and renting compute from an established cloud provider seems cheaper on a per-hour basis.

But that calculation changes when you factor in strategic considerations: data sovereignty, access guarantees, the ability to prioritise domestic users during periods of high demand, and the geopolitical risk of dependence on foreign infrastructure during a period when AI is increasingly relevant to national security and economic competitiveness.

Japan turning on its national AI infrastructure is not just a technology story. It is a policy story about how countries intend to exercise agency in the AI era rather than simply accepting the choices made by a handful of American technology companies.

Get the briefing, free

The biggest tech story, explained in 3 minutes every weekday. Choose your briefings →

Free. No spam. Unsubscribe in one click.