With the continued explosion of data, advancements in AI and machine learning, and ongoing acceleration of cloud-based services, there is an insatiable need for compute performance. To meet these ever-growing demands, we launched the Intel Xeon 6900P series, which delivers 2X performance gains compared to our prior generation.
Leadership Performance at Its Core
At the heart of Xeon 6 is a robust architecture engineered to handle compute-intensive workloads – from AI to HPC and data service workloads. Xeon 6 with P-cores provides additional Intel® AMX support for FP16 and new MRDIMM technology, delivering increased memory bandwidth for memory-bound workloads across AI and HPC. With 2X the number of cores and threads, Xeon 6 delivers leadership performance - 5.5x better for AI inferencing vs alternative CPUs and 2.1x better for key HPC workloads. For transparency, you're invited to review the Xeon 6 performance details.
Built for the AI Era
AI and ML are rapidly transforming the business landscape, and Xeon 6 is built to accelerate these innovations. For vector databases used in RAG models, Xeon 6 combined with Intel Scalable Vector Search (SVS) libraries, we have measured 2.7X the indexing performance vs competition and 7.3X search performance. You will see a detailed blog in the future on the role that a host CPU plays for AI accelerated systems, but Xeon 6 showcases the investment we’re making in features (improved I/O, high single thread performance, memory B/W and capacity, RAS) to ensure Xeon continues to be the predominant host CPU used for AI systems.
Energy Efficiency
Along with performance gains, we are also seeing performance per watt gains – an average of 1.6X vs the previous generation across a range of workloads. Benchmarks by design are at or near 100% CPU utilization, but typical data center deployments target and provision at a lower utilization to manage demand spikes and overall power usage. We have made improvements in Xeon 6 to provide better efficiency across the load line. As an example, at 40% utilization, we are seeing 1.9X performance per watt improvement vs prior generation.
Conclusion
The new Xeon 6 with P-cores dramatically improves performance in an energy-efficient manner. With its performance leaps, AI and ML capabilities, and robust security, Xeon 6 is poised to redefine what businesses can achieve with their IT infrastructure – from data analytics, AI, ML, cloud services, HPC, or any other field that demands high-performance computing. The best CPU for AI just got better.
For more information visit intel.com/xeon.
Notices and Disclaimers
See intel.com/processorclaims: Intel® Xeon® 6 for details on performance claims. Performance/Watt based on CPU TDP. Results may vary.
Performance varies by use, configuration, and other factors. Learn more on the Performance Index site.
Performance results are based on testing as of dates shown in configurations and may not reflect all publicly available updates. See backup for configuration details. No product or component can be absolutely secure.
Your costs and results may vary.
Intel technologies may require enabled hardware, software, or service activation.
© Intel Corporation. Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries. Other names and brands may be claimed as the property of others.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.