Intel Announces Gaudi 3 Accelerator For Generative AI

AI and generative AI dominate virtually every enterprise IT strategy discussion these days. Long the solution looking for a problem, the use cases for AI have started to emerge and will likely unlock countless opportunities for businesses to drive efficiencies, healthcare providers to deliver better healthcare and governments to serve their constituencies better. While this may sound a little like the typical hyperbole from AI industry pundits, it’s also true.

Part of the infrastructure challenge is tied directly to what we’ve experienced with Nvidia’s meteoric rise: product availability. When I speak to customers, it’s not unusual to hear about 12-month wait times for Nvidia H100s. This is for both enterprise IT and cloud providers alike. When the product is finally received, it’s feasible that some of these organizations will lose most of the product’s value as next-generation parts become available in the market.

It is important to provide these challenges as a backdrop because that sets the tone for Intel's value proposition with Gaudi 3.As mentioned, Gaudi 3 is an AI accelerator, not a GPU. It is designed from the ground up for one thing—to make AI tasks of training, tuning and inference run faster. From my perspective, Gaudi 3 is an accelerator that seems to have been built with the enterprise datacenter in mind.

The company’s claims for inference are equally impressive, showing Llama2 7B inferencing slightly faster than on Nvidia, while Llama2 70B will infer up to 1.7x faster. Most impressively, the Falcon 180B model inferences up to 4x faster. While performance-per-dollar metrics are not yet available because pricing hasn't been published, I think we can safely say that Gaudi will not be priced at the $30,000 or so where Nvidia is pricing its GPUs. I will bet on this one.

Technology Technology Latest News, Technology Technology Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Intel Unveils Efficient Gaudi 3 AI Accelerator And New Xeons At VisionI am a freelance writer, co-founder and Principal Analyst at HTVA, and the longtime Managing Editor at HotHardware.com. My work has been published worldwide, in a number of educational, PC, and technology-related print and web publications. I have been a computing and technology enthusiast since my early childhood.
Source: ForbesTech - 🏆 318. / 59 Read more »

Intel Introduces Gaudi-3 AI Accelerator as Competitive Alternative to Nvidia H100Intel unveiled its new Gaudi-3 AI accelerator at the Intel Vision conference, positioning itself as a strong competitor to Nvidia H100. The Gaudi-3 offers 40% better performance and improved power efficiency, making it an attractive option for generative AI models. MLPerf benchmarks are expected in the next six months to provide a more comprehensive analysis.
Source: ForbesTech - 🏆 318. / 59 Read more »

Intel’s Challenges Nvidia With Gaudi 3 AI AcceleratorSteve McDowell is chief analyst at NAND Research. Steve is a technologist with over 25 years of deep industry experience in a variety of strategy, engineering, and strategic marketing roles, all with the unifying theme of delivering innovative technologies into the enterprise infrastructure market.
Source: ForbesTech - 🏆 318. / 59 Read more »

Intel Unveils Gaudi 3 Chip for AI ModelsIntel has introduced its latest artificial intelligence chip, Gaudi 3, which is more power-efficient and faster than Nvidia's H100 GPU. The chip comes in different configurations and has been tested on various models, including Llama and Falcon.
Source: NBCNewsHealth - 🏆 707. / 51 Read more »

Intel Introduces Gaudi 3 Chip to Compete with Nvidia in AI Chip MarketIntel aims to challenge Nvidia's dominance in the AI chip market with its new Gaudi 3 chip, which offers improved power efficiency and faster AI model processing. The chip comes in various configurations and can be used for training or deploying models in different applications.
Source: NBCLA - 🏆 319. / 59 Read more »