Intel® DevCloud
Help for those needing help starting or connecting to the Intel® DevCloud
1626 Discussions

GLIBC mismatch for FPGA nodes

Vile_Lasagna
Novice
3,693 Views

TL;DR: fpga_compile nodes on the devCloud have a newer glibc installed than the nodes with actual FPGAs so code build on the former cannot run on the latter



I've been trying for a few days to test some code on the FPGAs in the dev cloud but I keep running into blocking issues.

It took me a long time to even get things building (thanks to Susannah from the Discord for helping me troubleshoot environment setup issues on the devcloud) but now that I've finally got my code building, it turns out I can't run anything.

After looking at logs yesterday and double checking things today it seems that... yeah... Unless I'm missing something there's a fundamental issue with the cluster setup.

All of the nodes in the cluster, from what I can tell run Ubuntu. They're all at Ubuntu 20 EXCEPT the nodes with the stratix10 or the arria10 FPGAs. These are Ubuntu 18, but NOT the fpga_compile nodes. 

This means that code built on the compile nodes cannot run on the FPGA nodes due to GLIBC version mismatch which I'd THINK someone would've run into immediately.

I'm not sure if this is the ideal feedback channel for this. I'd still like to report the issue that prevented me from compiling in the first place (the wrong version of python 2 gets used by default and the scripts in quartus start looking into nonexistent locations for stuff).

For context:
The code I'm building can be found in Gitlab . One can find the code in question under the `raymarched/SYCL/` folder if you want to verify. It's C++ with SYCL that I know itself works as I've validated it both with hipSYCL as well with oneAPI on the GPUs in the devCloud so not worried there. Everything is built with CMake so I'm not calling the compiler on my own or writing makefiles by hand.

And here's just some validation of what i'm going on about. After building, I get this when trying to run:


/home/u121770/repos/toyBrot/redist/bin/rmSYCL-fpga-arria10: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.26' not found (required by /home/u121770/repos/toyBrot/redist/bin/rmSYCL-fpga-arria10)
/home/u121770/repos/toyBrot/redist/bin/rmSYCL-fpga-stratix10: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.26' not found (required by /home/u121770/repos/toyBrot/redist/bin/rmSYCL-fpga-stratix10)


And double checking with cat /etc/os-release and nm on glib confirms that, yes, this error completely makes sense

# Resources: neednodes=1:fpga_compile:ppn=2,nodes=1:fpga_compile:ppn=2,walltime=06:00:00
########################################################################

NAME="Ubuntu"
VERSION="20.04.2 LTS (Focal Fossa)"
<....>
0000000000000000 A GLIBCXX_3.4.24@@GLIBCXX_3.4.24
0000000000000000 A GLIBCXX_3.4.25@@GLIBCXX_3.4.25
0000000000000000 A GLIBCXX_3.4.26@@GLIBCXX_3.4.26
0000000000000000 A GLIBCXX_3.4.27@@GLIBCXX_3.4.27
0000000000000000 A GLIBCXX_3.4.28@@GLIBCXX_3.4.28
0000000000000000 A GLIBCXX_3.4.3@@GLIBCXX_3.4.3



# Resources: neednodes=1:stratix10:ppn=2,nodes=1:stratix10:ppn=2,walltime=06:00:00
########################################################################

NAME="Ubuntu"
VERSION="18.04.6 LTS (Bionic Beaver)"
<....>
0000000000000000 A GLIBCXX_3.4.24@@GLIBCXX_3.4.24
0000000000000000 A GLIBCXX_3.4.25@@GLIBCXX_3.4.25
0000000000000000 A GLIBCXX_3.4.3@@GLIBCXX_3.4.3




For my own code, it seems like what I have to do now is make either a VM or a container on my local machine with the correct versions of things (assuming the FPGA toolkit extensions for the oneAPI SDK are free) and then scp the binaries up to the cluster which is.... good thing I'm familiar with containers and have a threadripper at home? Because the way it is, unless I'm missing something, no code built on the fpga_compile nodes can ever run on the fpga nodes in the devcloud because of this issue




2 Replies
BoonBengT_Intel
Moderator
3,627 Views

Hi @Vile_Lasagna,

 

Thank you for posting in Intel community forum and hope all is well.
Just to confirm is this the similar issues on what is being mention in the thread below:
https://community.intel.com/t5/Intel-DevCloud/Moved-from-old-forum-GLIBC-issues-on-the-devcloud-for-FPGA/m-p/1358299#M4281

Best Wishes
BB

0 Kudos
BoonBengT_Intel
Moderator
3,586 Views

Hi @Vile_Lasagna,

Greetings, as we do not received any inputs on the similarity of issues, hence would assume challenge are the same. Hence thread will no longer be monitored. For new queries, please feel free to open a new thread and we will be right with you. Pleasure having you here.

Best Wishes
BB

0 Kudos
Reply