AI cloud startup TensorWave bets AMD can beat Nvidia

Specialist cloud operators skilled at running hot and power-hungry GPUs and other AI infrastructure are emerging, and while some of these players like CoreWeave, Lambda, or Voltage Park — have built their clusters using tens of thousands of Nvidia GPUs, others are turning to AMD instead.

By the end of 2024, TensorWave aims to have 20,000 MI300X accelerators deployed across two facilities, and plans to bring additional liquid-cooled systems online next year. In addition to higher floating point performance, the chip also boasts a larger 192GB of HBM3 memory capable of delivering 5.3TB/s of bandwidth versus the 80GB and 3.35TB/s claimed by the H100.

This cooling tech has become a hot commodity among datacenter operators looking to support denser GPU clusters and led to some supply chain challenges, TensorWave COO Piotr Tomasik said.

Technology Technology Latest News, Technology Technology Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Major Taiwan earthquake temporarily halts production at Nvidia and AMD chipmakerJacob earned his first byline writing for his own tech blog. From there, he graduated to professionally breaking things as hardware writer at PCGamesN, and would go on to run the team as hardware editor.
Source: pcgamer - 🏆 38. / 67 Read more »

Intel courts devs with open arms and exotic hardwareIs Developer Cloud enough to steal Nvidia's thunder?
Source: TheRegister - 🏆 67. / 61 Read more »

Intel's Habana Gaudi3 AI Accelerators Take on Nvidia's H100Intel's latest Habana Gaudi3 AI accelerators are poised to compete with Nvidia's H100 in both inference and training, despite older process tech and slower memory.
Source: TheRegister - 🏆 67. / 61 Read more »

Ethernet advances will end Nvidia's InfiniBand lead in AI networks: GartnerDesire to build brainboxes will also see optical interconnects go mainstream
Source: TheRegister - 🏆 67. / 61 Read more »