Enabling media-driver for H264 acceleration on XRDP

[Nexarian]

Hello All,

I'm new to these forums (just joined). I've been contributing to the open source remote desktop system XRDP for some time, and I wanted to ask a couple questions related to getting Intel's QuickSync hardware encoder working with it.

Right now, there is a prototype from Jay Sorg that works with https://github.com/intel/libyami

However, from what I can tell, both libyami and the i965 driver (https://github.com/intel/intel-vaapi-driver) look like they aren't really being maintained anymore. I can't seem to find any official announcement on this, but it looks like both are intended to be replaced and folded into https://github.com/intel/media-driver/tree/master/media_driver. As I have a brand new i9-12950HX system, I basically have to use something with Gen12 compat, otherwise it looks like these older libraries are not being kept up-to-date with the latest generation. To that effect, I posted this fix:  https://github.com/intel/media-driver/pull/1544

That was a bit of a tangent, but I'm trying to find a path such that we can replace XRDP's prototype implementation here: https://github.com/jsorg71/builders/blob/master/yami/omatic/yami_inf/yami_inf.c and here: https://github.com/Nexarian/xrdp/blob/mainline_merge/xorgxrdp_helper/xorgxrdp_helper_yami.c with something that will work with media-driver.

So my questions are:
1. Are the "yami" and "i965" infrastructures deprecated, and is media-driver intended to fully replace both? If not, what is the supported status?

2. How hard is it to convert from the above YAMI implementation to something that would support media-driver, and are there any examples to get me started in the right direction? I could reverse engineer ffmpeg, but that might be overkill for what I need here.

3. AV1 is also interesting, would media-driver work for that as well?

Any additional thoughts or advice on how to properly proceed would be appreciated!

[DeividA_Intel]

Hello Nexarian,  

Thank you for posting on the Intel® communities. I understand that you have some questions related to the Intel® UHD Graphics for 12th Gen Intel® Processors.

In order to better assist you, please provide the following:  

1. Are you working on a personal project or are you working for a company?

2. Are you using a customized system or a manufacturer system (from Asus, Dell, or HP)?

3. What is the operating system used?

4. Can you provide more details about the XRDP?

5. What does XRDP stand for?

Regards,  

Deivid A.  

Intel Customer Support Technician 

[DeividA_Intel]

Hello Nexarian, 

Were you able to check the previous post and get the information requested? Please let me know if you need more assistance.   

Regards,  

Deivid A.  

Intel Customer Support Technician  

[Nexarian]

1. Are you working on a personal project or are you working for a company?

- Personal project. I'm an open source contributor to the XRDP project. While the main reason I contribute is with the intent to use it at work, it's not directly sponsored by any employer I've ever worked for. I do it on my own time.

2. Are you using a customized system or a manufacturer system (from Asus, Dell, or HP)?

The system I'm developing/testing on has an Intel Processor with a 12950HX on an Asus G733CX. However, please do not assume this is all I want to develop for. XRDP is an open source system that is meant to run on MANY types of hardware.

3. What is the operating system used?

- Ubuntu 22.04 and Arch Linux.

4. Can you provide more details about the XRDP?

5. What does XRDP stand for?

Better spelled "X-RDP":

X - X-window system

RDP - Remote Desktop Protocol (Written and maintained by Microsoft)

It's a server implementation of the Microsoft RDP protocol on Linux. This is more commonly known in Windows as "MSTSC" or just "Remote Desktop."

The reason I have this request is that remote desktop commonly works by compressing the video stream, and Intel's H264 QuickSync encoder is one of the best out there, and we'd like to enable XRDP to work with that. Right now we have a prototype, but it only works with the older i965 drivers (https://github.com/intel/intel-vaapi-driver) which seems to be deprecated.

[DeividA_Intel]

Hello Nexarian,  

I would like to let you know that we have a specific forum for this kind of issue and product, it is called the Intel Developer Zone. There you will receive the appropriate support on this and other concerns you may have related to this product.  

Here you will find the links to access the website and the community forums:  

• Forum: https://software.intel.com/content/www/us/en/develop/home.html  
• Website: https://community.intel.com/t5/Software/ct-p/software-products  

Please keep in mind that this thread will no longer be monitored by Intel.  

Regards,   

Deivid A.  

Intel Customer Support Technician