sales@hkmjd.com
Service Telephone:86-755-83294757
Intel officially launches Gaudi3 AI chip: slower than NVIDIA's H100, at a lower cost
Intel recently officially launched its Gaudi3 gas pedal for AI workloads.
September 28, 2011 - Intel recently officially launched its Gaudi3 gas pedal for AI workloads. The new chips are slower than NVIDIA's popular H100 and H200 GPUs (for AI and HPC), so Intel is betting its Gaudi3 success on its lower price and lower total cost of ownership (TCO).
Intel's Gaudi3 processor uses two chips containing 64 tensor processor cores (TPC, a 256x256 MAC fabric with FP32 accumulators), eight matrix multiplication engines (MME, a 256-bit wide vector processor), and 96MB of on-chip SRAM cache with a bandwidth of 19.2 TB/s. Additionally, Gaudi3 integrates 24 200GbE network interfaces and 14 media engines, the latter capable of processing H.265, H.264, JPEG and VP9 to support visual processing. The processor is equipped with 128GB of HBM2E memory divided into eight memory stacks to deliver a massive 3.67TB/s of bandwidth.
In terms of performance, Intel says the Gaudi3 can deliver up to 1,856 BF16/FP8 matrix TFLOPS and up to 28.7 BF16 vector TFLOPS, with a TDP of around 600 W. Compared to NVIDIA's H100, at least on the bright side, the Gaudi3 has slightly lower BF16 matrix performance (1,856 vs. 1,979 TFLOPS ), twice as low FP8 matrix performance (1,856 vs 3,958 TFLOPS) and significantly lower BF16 vector performance (28.7 vs 1,979 TFLOPS).
More important than the raw specs is the actual performance of Gaudi3. It needs to compete with AMD's Instinct MI300 series and NVIDIA's H100 and B100/B200 chips. That remains to be seen, as much depends on software and other factors. For now, Intel showed some slides claiming that the Gaudi3 could offer a significant price/performance advantage over NVIDIA's H100.
Time:2024-09-28
Time:2024-09-28
Time:2024-09-28
Time:2024-09-28
Contact Number:86-755-83294757
Enterprise QQ:1668527835/ 2850151598/ 2850151584/ 2850151585
Business Hours:9:00-18:00
E-mail:sales@hkmjd.com
Company Address:Room1239, Guoli building, Zhenzhong Road, Futian District, Shenzhen, Guangdong
CopyRight ©2022 Copyright belongs to Mingjiada Yue ICP Bei No. 05062024-12
Official QR Code
Links: