FTFuture Technology
COMPUTING

What the Global AI Infrastructure Build-Out Actually Looks Like From the Inside

· 3 min read · By Nath Connell

Key takeaways

  • High-bandwidth memory produced by only three companies (SK Hynix, Samsung, Micron) is the single biggest physical constraint on the AI infrastructure build-out
  • A fully loaded NVL72 rack draws tens of kilowatts, meaning hyperscale AI data centres require gigawatts of reliable power
  • Several US data centre operators have signed power purchase agreements with next-generation nuclear facilities to meet AI compute power demand

There is a version of the AI infrastructure story that gets told in press releases and earnings calls, full of billion-dollar numbers and national strategy announcements. And then there is the version that happens in practice: factories being retooled, supply chains being stress-tested, and countries competing to secure compute capacity the way previous generations competed for oil.

The past few weeks have offered an unusually clear window into the second version of that story, with announcements from NVIDIA's partner network painting a detailed picture of how global AI infrastructure is actually being assembled in 2026.

The factory layer

At the most physical level, AI infrastructure starts with manufacturing. Printed circuit boards, GPU dies, high-bandwidth memory stacks, custom networking silicon, and power management components all need to be produced, assembled, and tested before a single AI workload runs.

The geography of that manufacturing is shifting. The opening of contract manufacturing facilities in Texas, alongside deep expansions by partners in South Korea and Japan, reflects a deliberate effort to diversify the physical supply chain away from a concentration in Taiwan and China. This is partly geopolitical risk management and partly a response to US policy incentives that have made domestic and allied-nation manufacturing more economically attractive.

The challenge is that advanced AI system assembly is not a skill that can be stood up overnight. The technicians who build and validate NVL72 rack systems are working with tolerances and specifications that require significant training. Building manufacturing capacity in new locations takes years, not months.

The memory bottleneck

If there is one component that most constrains the pace of the AI infrastructure build-out, it is high-bandwidth memory. HBM is the specialised memory that sits alongside GPU dies in AI accelerators, providing the enormous bandwidth needed to feed data to thousands of compute cores simultaneously.

Only three companies in the world produce HBM at meaningful scale: SK Hynix, Samsung, and Micron. Each new GPU generation demands more HBM per chip, and each new HBM generation takes years to bring to yield. The supply relationship between NVIDIA and SK Hynix, deepened significantly by the partnership announced this month, is a direct response to this constraint.

The future, in 3 minutes a day. The biggest tech story explained every morning, free. Get the briefing →

The HBM bottleneck has real downstream effects. It influences which cloud providers can access the newest GPU generations and in what quantities. It affects the pricing of AI compute. And it creates strategic vulnerability: if any of the three HBM producers faces a significant production disruption, the effects would ripple across the entire AI industry within months.

The power question

Above the component layer sits a challenge that is arguably harder to solve: power. A fully loaded NVL72 rack draws tens of kilowatts. A hyperscale AI data centre housing thousands of such racks requires gigawatts of reliable electricity. The build-out of AI infrastructure is running directly into the limits of existing electrical grids in the United States, Europe, and parts of Asia.

This is driving a wave of investment in grid upgrades, data centre power management technology, and alternative energy sources. Nuclear power has re-entered serious conversations for the first time in decades, with several US data centre operators signing power purchase agreements with next-generation nuclear facilities that are not yet built.

What the pace of investment means

The cumulative scale of AI infrastructure investment being announced across these deals is genuinely unprecedented in the technology industry's history. The closest analogue is the build-out of internet infrastructure in the late 1990s, which also involved enormous capital commitment, some waste, and ultimately a physical foundation that enabled decades of subsequent value creation.

The key question is whether the demand for AI compute will justify the scale of the investment being made. Current trajectories suggest that inference demand, running AI models in production applications, is growing fast enough to absorb a great deal of the capacity being built. But build-outs at this scale always involve a bet on future demand that cannot be known with certainty.

What is clear is that the physical infrastructure of the AI era is being assembled right now, in factories and data centres and power substations around the world. The decisions being made about where to put it, who controls it, and how to power it will shape the AI landscape for the next 20 years.

Get the briefing, free

The biggest tech story, explained in 3 minutes every weekday. Choose your briefings →

Free. No spam. Unsubscribe in one click.