In a bold step forward for artificial intelligence infrastructure, Intel has announced the launch of its next-generation AI products: Xeon 6 processors with Performance-cores (P-cores) and the Gaudi 3 AI accelerators. These advancements represent a significant leap in high-performance enterprise AI systems, offering enhanced performance, energy efficiency, and lower total cost of ownership (TCO).
Powering the Next Generation of AI
Xeon 6 with P-cores offers double the performance of its predecessor, making it ideal for compute-intensive workloads. It features increased core count, enhanced memory bandwidth, and built-in AI acceleration capabilities. This processor is designed to meet the demanding requirements of AI applications across various environments, from edge to data center and cloud.
Gaudi 3 AI Accelerator is optimized for large-scale generative AI. It boasts 64 Tensor processor cores (TPCs) and eight matrix multiplication engines (MMEs) for accelerated deep neural network computations. With 128GB of HBM2e memory and 24 200Gb Ethernet ports, Gaudi 3 offers exceptional performance and scalability. It also seamlessly integrates with PyTorch and advanced Hugging Face models.
Justin Hotard, Intel’s Executive Vice President and General Manager of the Data Center and AI Group, remarked, "The demand for AI is reshaping the data center landscape. Our Xeon 6 processors and Gaudi 3 accelerators provide the hardware, software, and ecosystem necessary for enterprises to achieve unparalleled AI performance, efficiency, and security."
Intel's Xeon 6 and Gaudi 3 are more than just hardware. They represent a significant step forward in the evolution of AI technology. With these powerful tools in hand, enterprises can now unlock the full potential of AI and drive innovation across industries.
Collaborating for Enterprise AI Success
Intel is working closely with major OEMs like Dell Technologies to co-engineer specialized AI solutions. These partnerships focus on transitioning generative AI prototypes into production, addressing challenges such as scalability and security. Dell's new retrieval-augmented generation (RAG) systems are leveraging Intel's AI technologies for optimized performance in real-world applications.
Intel also announced a collaboration with IBM to deploy Gaudi 3 AI accelerators on IBM Cloud, aiming to reduce the TCO of AI deployments while boosting performance.
Expanding Access with the Intel Tiber Developer Cloud
Intel’s Tiber Developer Cloud is offering early access to Xeon 6 and Gaudi 3 systems for developers to evaluate and test AI workloads. Enterprises can expect Gaudi 3 clusters for large-scale production deployments in the coming quarter, alongside new AI tools and platforms like SeekrFlow, designed for building and scaling trusted AI applications.
With these innovations, Intel continues to drive the future of enterprise AI, providing robust, scalable solutions that meet the needs of a rapidly evolving AI landscape.