Intel has introduced its latest artificial intelligence (AI) chip, the Gaudi 3, at its Vision 2024 conference. The Gaudi 3, which is expected to launch in the third quarter of 2024, is designed to train and deploy large AI models, such as those used by OpenAI’s ChatGPT.
The Gaudi 3 chip is a significant upgrade from its predecessor, the Gaudi 2. It offers four times the BF16 performance, twice the networking performance, and 1.5 times the bandwidth. The chip comes in different configurations, including a bundle of eight Gaudi 3 chips on one motherboard or a card that can slot into existing systems.
The Gaudi 3 chip is also more power-efficient. According to Intel, it is over twice as power-efficient as Nvidia’s H100 GPU and can run AI models one-and-a-half times faster. Despite these improvements, the chip maintains a thermal design power (TDP) of 900 Watts, which is 50% higher than its predecessor.
Intel has already started shipping samples of the Gaudi 3 to customers and is optimistic about its potential in the AI market. The company believes that the Gaudi 3 chip will help it secure a larger share of the AI accelerator market, which is currently dominated by Nvidia.
The introduction of the Gaudi 3 AI chip represents a significant step in Intel’s efforts to compete in the AI market. However, the success of this endeavor will depend on the chip’s performance and its adoption by the industry.
Read more at: www.anandtech.com