topic Re:Distribute XGBoost on multiple nodes in Intel® Optimized AI Frameworks

Distribute XGBoost on multiple nodes

Misra — Tue, 09 Aug 2022 00:40:17 GMT

Hi,

Does Intel's distribution of XGBoost (in the oneAPI AI Analytics Toolkit) support multi-node training? If so, can this experiment be executed on Devcloud? Is there any reference documentation available?

Regards,

Manjari

Re:Distribute XGBoost on multiple nodes

JananiC_Intel — Thu, 11 Aug 2022 05:12:34 GMT

Hi,

Thanks for posting in Intel forum.

We will check on this and get back to you soon.

For your information, currently we don't have any reference documentation for Intel XGBoost multi node training, we will let you know once we get an update regarding this.

Regards,

Janani Chandran

Re: Distribute XGBoost on multiple nodes

JananiC_Intel — Tue, 16 Aug 2022 09:38:50 GMT

Hi,

For multi-node training with Intel XGBoost in DevCloud follow the steps mentioned in the below article.

https://medium.com/intel-analytics-software/distributed-xgboost-with-modin-on-ray-fc17edef7720

In DevCloud, multi-node computation is only available through the job queue.

Syntax for multi-node:

qsub -l nodes=<count>:ppn=2

You can combine a request for multiple nodes with a request for their specific features.

Try this and let us know the updates.

Regards,

Janani Chandran

Re:Distribute XGBoost on multiple nodes

JananiC_Intel — Tue, 23 Aug 2022 07:13:53 GMT

Hi,

Is your issue resolved? Do you have any update?

Regards,

Janani Chandran

Re: Distribute XGBoost on multiple nodes

mmisra18 — Fri, 26 Aug 2022 07:37:26 GMT

Re: Re:Distribute XGBoost on multiple nodes

Misra — Fri, 26 Aug 2022 07:38:36 GMT

Hi,

Thank you for your reply. I did try this method before. However, when I looked into OneAPI and DevCloud documentation, it mentioned that in order to distribute XGBoost training between multiple nodes I would have to use MPI communication for nodes to process in parallel.

I am unable to find documentation or any code sample that would explain it since I have no experience in MPI application programming.

Could you please let me know more about it? If this is the correct way or the way you mentioned is same as the above.

Thank you!

Regards,

Manjari Misra

Re:Distribute XGBoost on multiple nodes

AthiraM_Intel — Tue, 30 Aug 2022 06:13:54 GMT

Hi,

Please find the below documentation for running basic mpi application in DevCloud.

You can find the sample code under "Distributed-Memory Architecture" topic.

link: https://devcloud.intel.com/oneapi/documentation/advanced-queue/

Hope this helps.

Thanks

Re:Distribute XGBoost on multiple nodes

AthiraM_Intel — Wed, 07 Sep 2022 11:39:01 GMT

Hi,

We have not heard back from you. Could you please give us an update?

Thanks

Re:Distribute XGBoost on multiple nodes

AthiraM_Intel — Wed, 14 Sep 2022 05:47:34 GMT

Hi,

We have not heard back from you. This thread will no longer be monitored by Intel. If you need further assistance, please post a new question.

Thanks.