News Nvidia to boost AI server racks to megawatt scale, increasing power delivery by five times or more

[Admin]

Nvidia is working on an 800V HVDC system, which would replace the current 412V AC used in most data centers.

Nvidia to boost AI server racks to megawatt scale, increasing power delivery by five times or more : Read more

 

[chaz_music]

This has been done before, including a patent from about 30 years ago for UPS system purposes. I believe IBM also looked into this for data centers. One anecdote that I remember was that they found pluggable connections to be quite dangerous at these DC voltages, because of the chance for unplugging the DC while in operation. One study allowing using the ubiquitous IEC 60320 cables for the DC inlets (standard 3-prong PC power cables). That DC bus design was only at ~250VDC if I remember correctly (300V limit for IEC 60320?).

DC arcing does not quench like an AC arc does due to no inherent zero voltage crossing to naturally commutate the current to zero. So even DC fusing is a different animal - larger fuses are needed for the same power level. The telecom industry used to use -48VDC for central office powering and it was also found to be very dangerous. Telecom DC plant workers could be fired for using non-insulated tools due to the chance of causing fires and having bodily injury. Nothing like having all of your facial hair being singed off.

I see a learning curve coming again, and industries have to relearn past knowledge. It is kind of fascinating to see that happen over and over as power technology gets adopted in newer industries, such as wind power, solar, EV systems and chargers, and circling back again here in server farm applications.

 

[DS426]

We should definitely let nVidia be the authority and driver of this massive power distribution system change given what they did on the 4090's power design and then repeat it again on 5090. No faith vote from me, but I guess their saving grace this time is the other respectable engineering and design entities working on this project.

I agree with @chaz_music that electrical receptacles will (should) be eliminated to reduce risks, hardwiring everything and requiring those big industrial-grade disconnect switches or levers.

It would definitely be a learning curve, plus requiring some realignments from supply chains. I can only hope that serviceability wouldn't be reduced.