Nvidia’s H200 is the new must-have GPU for AI

  • 📰 verge
  • ⏱ Reading Time:
  • 25 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 13%
  • Publisher: 67%

Technology Technology Headlines News

Technology Technology Latest News,Technology Technology Headlines

Nvidia’s H200 GPU for generative AI and LLMs has more memory capacity and bandwidth. Microsoft, Google, Amazon, and Oracle are already committed to buying them.

Nvidia is introducing a new top-of-the-line chip for AI work, the HGX H200. The new GPU upgrades the wildly in demand H100 with 1.4x more memory bandwidth and 1.8x more memory capacity, improving its ability to handle intensive generative AI work. The big question is whether companies will be able to get their hands on the new chips or whether they’ll be as supply constrained as the H100 — and Nvidia doesn’t quite have an answer for that.

Nvidia says cloud providers won’t need to make any changes as they add H200s into the mix. The cloud arms of Amazon, Google, Microsoft, and Oracle will be among the first to offer the new GPUs next year. Once they launch, the new chips are sure to be expensive. Nvidia doesn’t list how much they cost, but CNBC reports that the prior-generation H100s are estimated to sell for anywhere between $25,000 to $40,000 each, with thousands of them needed to operate at the highest levels.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 94. in TECHNOLOGY

Technology Technology Latest News, Technology Technology Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Nvidia Unveils the H200 AI Chip. Why That's It’s Bad News for AMD.Nvidia's new chip will be up to 90% faster at AI inference applications than its current H100.
Source: MarketWatch - 🏆 3. / 97 Read more »

Nvidia Unveils the H200 AI Chip. Why That's It’s Bad News for AMD.Nvidia's new chip will be up to 90% faster at AI inference applications than its current H100.
Source: MarketWatch - 🏆 3. / 97 Read more »

Installer No. 14: The Best and Verge-iest Stuff in the WorldYNAB, Copilot, a new Steam Deck, the Humane AI Pin, music podcasts, Elon Musk, ChatGPT, and more in this week’s Installer newsletter.
Source: verge - 🏆 94. / 67 Read more »

France to host next AI safety summit as European nations jockey for tech leadershipFrance has agreed to host the second AI safety summit sometime next year and pledged half a billion euros toward research and development of new models.
Source: FoxNews - 🏆 9. / 87 Read more »

France to Host Second Artificial Intelligence Security SummitFrance has agreed to host the second AI safety summit sometime next year and pledged half a billion euros toward research and development of new models.
Source: FoxNews - 🏆 9. / 87 Read more »

The best apps and tools for managing your money onlineYNAB, Copilot, a new Steam Deck, the Humane AI Pin, music podcasts, Elon Musk, ChatGPT, and more in this week’s Installer newsletter.
Source: verge - 🏆 94. / 67 Read more »