SQL Server 2022 (16.x) provides a framework for offloading specific SQL Server workload to Hardware

[bogg06527]

Hi Support,
I am using a server with  OS Microsoft Windows Server 2019 Standard and 
Processor Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz, 2900 Mhz, 4 Core(s), 8 Logical Processor(s)

I would like to utilize this Intel® QuickAssist Technology (QAT) in my server , as per the MS blog https://learn.microsoft.com/en-us/sql/relational-databases/integrated-acceleration/overview?view=sql-server-ver16 

I need to install the below driver 
Intel® QuickAssist Technology Driver for Windows* – HW Version 1.X

Would like to clarify few things

Will this driver installation is chargeable ? if yes what is the cost ?

Also from the MS blog above this QAT will benefit the below   

You can offload backup compression with Intel® QAT to reduce CPU usage, backup completion times, and reduce storage consumption.

Along with above will there be any beneficial / improvement in with DISK I/O & Throughput with this QAT option  ?

Please review and provide your inputs to proceed further.

Thank you
Hari

[Ronny_G_Intel]

Hi bogg06527,

Thanks for using Intel communities.

The Intel® Xeon® Platinum 8276 Processor does not come with Intel® QuickAssist Technology (QAT). Intel QAT is typically available in specific processor models or as a separate accelerator card, and it is not a feature of the Xeon Platinum 8276.

For more information you may visit the following URL: https://www.intel.com/content/www/us/en/products/docs/accelerator-engines/what-is-intel-qat.html

Driver Installation Cost:

The installation of drivers for Intel QAT is not chargeable. Intel provides drivers and software which can be downloaded from the official website at no additional cost. 

Benefits of Intel QAT:

Intel QAT can offload tasks such as compression, which helps reduce CPU usage.

Refer to the following website for more details: https://www.intel.com/content/www/us/en/products/docs/accelerator-engines/what-is-intel-qat.html

Impact on Disk I/O and Throughput:

While Intel QAT primarily focuses on accelerating cryptographic and compression workloads, its use can indirectly benefit disk I/O and throughput. By offloading these tasks from the CPU, the processor can handle other operations more efficiently, potentially improving overall system performance, including disk I/O and throughput. However, the direct impact on disk I/O and throughput would depend on the specific workload and system configuration.

I hope this helps and please let me know if you have more questions.

Regards,

Ronny G

[bogg06527]

Hi @Ronny_G_Intel 

Thank you for your valuable update.

I am using below 3rd generation processor 
Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz, 2900 Mhz, 4 Core(s), 8 Logical Processor(s)

So as per your update this 8375C  processor doesn't come with inbuilt intel QAT accelerator right ? please confirm?
Also in case if we want to install this on this 3rd gen processor do we have to install any extra hardware? if yes please provide the detailed information about how to install them.

Thank you
Hari

[bogg06527]

FYI... This is VM in AWS coming with 8375C processor. upon checking found below please review this link and confim

https://edc.intel.com/content/www/us/en/products/performance/benchmarks/4th-generation-intel-xeon-scalable-processors/ 

In this link its mentioned as 4th Gen processor for AWS , i am confused please help me.

[bogg06527]

Good morning @Ronny_G_Intel 

Thank you 

At this point of time we are facing DISK Throughput issues during backup / compression activities.
As per the above update it seems QAT is not directly benefitting the DISK throughput issues, would you able to share any information about any white paper test cases about how it's improving the disk throughput during compression activity.

How much QAT will benefit the throughput ? based on your feedback we will proceed with our testing.

Thank you
Hari   

[Ronny_G_Intel]

Hello Hari,

Thank you for the Kudos!

The Intel® Xeon® Platinum 8375C belongs to Intel's Xeon Scalable processor family. The number "8375" is part of our model numbering system, which helps identify the processor's specific capabilities and performance level within the Platinum tier. The suffix "C" denotes that this processor is a "custom SKU," for which public information is not available. Please note that we do not offer public support for custom SKUs.

Intel Quick Assist Technology was first introduced with our 4th Gen Xeon CPUs. Your processor is from the 3rd Gen, based on Ice Lake technology, and should be compatible with the Intel® QuickAssist Adapter 8960 and Intel® QuickAssist Adapter 8970. The Intel® QuickAssist Adapter 8960 uses x8 PCIe gen3, while the Intel® QuickAssist Adapter 8970 uses x16 PCIe gen3. If you are primarily accelerating PKE, the x8 configuration should suffice. However, for symmetric encryption or data compression, the x16 configuration is recommended.

For more information, please visit: https://www.intel.com/content/www/us/en/products/docs/network-io/ethernet/10-25-40-gigabit-adapters/quickassist-adapter-for-servers.html

Regards,

Ronny G

[bogg06527]

Good day @Ronny_G_Intel 

Thank you very much for the detailed information.

I understood that my current processor 8375C is suitable for Intel QAT , but i have to install the specified adapters to get the Hardware accelerator as the 3rd Gen processors doesn't come with built in QAT accelerator. Please correct me if i misunderstood.

Also i have gone through the link and found that these adapters are supported with Linux OS.    

Do we have any adapter specifically works for windows operating system? 
Also i didn't find the options to download these adapters ? is these adapters chargeable ?
if not chargeable please do provide the downloadable links for these below adapters

Intel® QuickAssist Adapter 8960 

Intel® QuickAssist Adapter 8970 

When i try to find for these adapters its pointing to the same driver which you have confirmed that its not chargeable. 

https://www.intel.com/content/www/us/en/products/sku/125200/intel-quickassist-adapter-8970/downloads.html 

Please review and provide your inputs to proceed further.

Thankyou
Hari

[Ronny_G_Intel]

Hi Hari,

The following driver is suitable for both Intel® QuickAssist Adapter 8960 and 8970:

https://www.intel.com/content/www/us/en/download/19732/intel-quickassist-technology-driver-for-windows-hw-version-1-x.html

The QAT package is available with no charge.

The link that you provided: https://www.intel.com/content/www/us/en/products/sku/125200/intel-quickassist-adapter-8970/downloads.html is pointing to the QAT package version that I mentioned above, same information.

I hope this helps.

Regards,

Ronny G

[bogg06527]

Thank you very much @Ronny_G_Intel  for the detailed explanation.

One last clarification help still required from you on the below

If i install the driver(mentioned above) will install the required Intel® QuickAssist Adapter 8960 and 8970 on 8375C  processor ?

else do i need to install these  Intel® QuickAssist Adapters 8960 and 8970 separately ? if yes please provide the links to download these 8960 and 8970 adapters.

Thank you
Hari 

[bogg06527]

Good morning @Ronny_G_Intel 

Thank you 

At this point of time we are facing DISK Throughput issues during backup / compression activities.
As per the above update it seems QAT is not directly benefitting the DISK throughput issues, would you able to share any information about any white paper test cases about how it's improving the disk throughput during compression activity.

How much QAT will benefit the throughput ? based on your feedback we will proceed with our testing.

Thank you
Hari  

[Ronny_G_Intel]

Hi bogg06527,

The Intel® Xeon® Platinum 8375C processor does not include Intel® QuickAssist Technology (QAT) built-in. To utilize QAT, you will need an adapter like the Intel® QuickAssist Adapter 8960 or 8970, along with the appropriate QAT driver package.

These Intel® QuickAssist Adapters are PCIe devices. For more information, you can refer to the Product Brief available at: https://cdrdv2-public.intel.com/691474/intel-quickassist-adapter-8960-8970.pdf

Intel® QuickAssist Technology is mainly designed to accelerate cryptographic and compression tasks. While it doesn't directly enhance disk throughput, it can be indirectly beneficial, particularly when these tasks involve encryption or compression. However, QAT is not specifically intended to improve disk throughput. For more details, visit: https://www.intel.com/content/www/us/en/architecture-and-technology/intel-quick-assist-technology-overview.html

I hope this helps.

Regards,

Ronny G

[bogg06527]

Thank you very much @Ronny_G_Intel  for your patience and answer to my queries with detailed information.

I understood that if we want to utilize this QAT with in-built Hardware mode we have to upgrade to 4th Gen Intel processors.

Processor code 8480  and above.

Thankyou
Hari

[Ronny_G_Intel · Accepted solution]

Hi Hari,

You're right but it doesn't necessarily have to be a model 8480 or higher. Here's an example to illustrate:

• Visit https://www.intel.com/content/www/us/en/ark/products/codename/126212/products-formerly-sapphire-rapids.html and select any processor to view its specifications.

• In the "Advanced Technologies" section, look for Intel® QuickAssist Technology (QAT). If devices are listed there, it indicates that QAT is integrated into the processor (highlighted in the red box in the attached image).

• In the "Security and Reliability" section, check for Intel® QuickAssist Software Acceleration. If it says "Yes," it means QAT PCIe cards are compatible with this processor (highlighted in the yellow box in the attached image).

• If you don't see any of these technologies listed, it means not supported.

You may explore more processor options by visiting this website: https://www.intel.com/content/www/us/en/ark.html#@PanelLabel595

Thanks,

Ronny G

[bogg06527]

Good day @Ronny_G_Intel 

One more query 

Even after we upgraded to 4th Gen Intel processors we have to install the below driver to make this feature to enable or use on SQL Server right ?

https://www.intel.com/content/www/us/en/download/19732/intel-quickassist-technology-driver-for-windows-hw-version-1-x.html 

[Ronny_G_Intel]

Hi Hari,

Quick correction to your previous statement: 

• If you go with a QAT solution that is integrated into Sapphire Rapids processors, you will need Software Package for Hardware Version 2.0. https://www.intel.com/content/www/us/en/download/765502/intel-quickassist-technology-driver-for-windows-hw-version-2-0.html  
• If you go a QAT PCIe adding card, you will need Software Package for Hardware Version 1.x. https://www.intel.com/content/www/us/en/download/19732/intel-quickassist-technology-driver-for-windows-hw-version-1-x.html

Regards,

Ronny G