EV charging company plans to deploy 100,000 Nvidia GPUs in pods at its roadside sites across the US

What happened

“Latient is the fastest way to bring new compute online, tapping already permitted and grid-connected, yet idle energy capacity, located right where it's needed for ultra-low latency (the delay between asking for something and getting it), with no water hookup requirements,” highlighted the exec. EV charging firm Xeal plans to use its existing U.S.

The big idea is that it already has 1,600+ locations and 200MW of permitted, installed electrical infrastructure, so it aims to “deploy over 100,000 NVIDIA GPUs (a chip built for many calculations at once, used for graphics and AI)” at these sites. NVIDIA is a semiconductor company based in Santa Clara, and its products and services include graphics processing units. Thus it has developed Latient Pods (pictured), with each containing up to 48 Nvidia Hopper or Blackwell Ultra GPUs. Nikhil Bharadwaj, co-founder and CEO of Xeal, explained that Latient Pods can deliver inference (running a trained model to get an answer, rather than training it) compute today while new data centers (a building full of computers that runs online services) are still being built.