u1xxxxxx@login-2:~$ qsub -q batch@v-qsvr-fpga -I -l nodes=darby:ppn=2 qsub: waiting for job 39801.v-qsvr-fpga.aidevcloud to start qsub: job 39801.v-qsvr-fpga.aidevcloud ready ######################################################################## # Date: Wed Feb 15 11:08:26 PST 2023 # Job ID: 39801.v-qsvr-fpga.aidevcloud # User: u1xxxxxx # Resources: neednodes=darby:ppn=2,nodes=darby:ppn=2,walltime=06:00:00 ######################################################################## u1xxxxxx@s001-n137:~$ source /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/init_env.sh d5005/2.0.1/inteldevstack/hld/init_opencl.sh export FPGA_BBB_CCI_SRC=/usr/local/intel-fpga-bbb export PATH=/glob/intel-python/python2/bin:${PATH}export QUARTUS_HOME=/glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/quartus export OPAE_PLATFORM_ROOT=/glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/d5005_ias_2_0_1_b237 export AOCL_BOARD_PACKAGE_ROOT=/glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/d5005_ias_2_0_1_b237/opencl/opencl_bsp Adding $OPAE_PLATFORM_ROOT/bin to PATH export INTELFPGAOCLSDKROOT=/glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld export ALTERAOCLSDKROOT=/glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld Adding $QUARTUS_HOME/bin to PATH source /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld/init_opencl.sh u1xxxxxx@s001-n137:~$ source /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld/init_opencl.sh INTELFPGAOCLSDKROOT is set to /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld. Using that. Will use $QUARTUS_ROOTDIR_OVERRIDE= /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/quartus to find Quartus AOCL_BOARD_PACKAGE_ROOT is set to /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/d5005_ias_2_0_1_b237/opencl/opencl_bsp. Using that. Adding /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld/bin to PATH Adding /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld/linux64/lib to LD_LIBRARY_PATH Adding /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld/host/linux64/lib to LD_LIBRARY_PATH Adding /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/d5005_ias_2_0_1_b237/opencl/opencl_bsp/linux64/lib to LD_LIBRARY_PATH u1xxxxxx@s001-n137:~$ export FPGA_BBB_CCI_SRC=/usr/local/intel-fpga-bbb u1xxxxxx@s001-n137:~$ export PATH=/glob/intel-python/python2/bin:${PATH} u1xxxxxx@s001-n137:~$ mkdir S10_OPENCL_AFU u1xxxxxx@s001-n137:~$ cp $OPAE_PLATFORM_ROOT/opencl/exm_opencl_hello_world_x64_linux.tgz S10_OPENCL_AFU tar xvf exm_opencl_hello_world_x64_linux.tgzu1xxxxxx@s001-n137:~$ cd S10_OPENCL_AFU u1xxxxxx@s001-n137:~/S10_OPENCL_AFU$ tar xvf exm_opencl_hello_world_x64_linux.tgz common/ common/src/ common/src/AOCLUtils/ common/src/AOCLUtils/options.cpp common/src/AOCLUtils/opencl.cpp common/src/AOCLUtils/.dir common/inc/ common/inc/AOCLUtils/ common/inc/AOCLUtils/options.h common/inc/AOCLUtils/opencl.h common/inc/AOCLUtils/aocl_utils.h common/inc/AOCLUtils/scoped_ptrs.h common/inc/AOCLUtils/.dir common/readme.css common/.dir hello_world/ hello_world/host/ hello_world/host/src/ hello_world/host/src/main.cpp hello_world/host/src/.dir hello_world/device/ hello_world/device/hello_world.cl hello_world/device/.dir hello_world/Makefile hello_world/README.html hello_world/.dir u1xxxxxx@s001-n137:~/S10_OPENCL_AFU$ aocl diagnose -------------------------------------------------------------------- ICD System Diagnostics -------------------------------------------------------------------- Using the following location for ICD installation: /etc/OpenCL/vendors Found 2 icd entry at that location: /etc/OpenCL/vendors/Altera.icd /etc/OpenCL/vendors/Intel_FPGA_SSG_Emulator.icd the following OpenCL libraries are referenced in the icd files: libalteracl.so libintelocl_emu.so checking LD_LIBRARY_PATH for registered libraries: libalteracl.so was registered on the system at /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld/host/linux64/lib WARNING: libintelocl_emu.so NOT FOUND Using the following location for fcd installations: /opt/Intel/OpenCL/Boards Found 1 fcd entry at that location: /opt/Intel/OpenCL/Boards/dcp_bsp.fcd the following OpenCL libraries are referenced in the fcd files: /opt/a10/inteldevstack/a10_gx_pac_ias_1_2_1_pv/opencl/opencl_bsp/linux64/lib/libintel_opae_mmd.so checking LD_LIBRARY_PATH for registered libraries: /opt/a10/inteldevstack/a10_gx_pac_ias_1_2_1_pv/opencl/opencl_bsp/linux64/lib/libintel_opae_mmd.so was registered on the system. Number of Platforms = 1 1. Intel(R) FPGA SDK for OpenCL(TM) | Intel(R) Corporation | OpenCL 1.0 Intel(R) FPGA SDK for OpenCL(TM), Version 19.2 -------------------------------------------------------------------- ICD diagnostics PASSED -------------------------------------------------------------------- -------------------------------------------------------------------- BSP Diagnostics -------------------------------------------------------------------- -------------------------------------------------------------------- Device Name: acl0 BSP Install Location: /opt/a10/inteldevstack/a10_gx_pac_ias_1_2_1_pv/opencl/opencl_bsp Vendor: Intel Corp Physical Dev Name Status Information pac_ee00000 Passed Intel PAC Platform (pac_ee00000) PCIe 59:00.0 FPGA temperature = 42 degrees C. DIAGNOSTIC_PASSED -------------------------------------------------------------------- Call "aocl diagnose " to run diagnose for specified devices Call "aocl diagnose all" to run diagnose for all devices u1xxxxxx@s001-n137:~/S10_OPENCL_AFU$ aocl diagnose acl0 -------------------------------------------------------------------- ICD System Diagnostics -------------------------------------------------------------------- Using the following location for ICD installation: /etc/OpenCL/vendors Found 2 icd entry at that location: /etc/OpenCL/vendors/Altera.icd /etc/OpenCL/vendors/Intel_FPGA_SSG_Emulator.icd the following OpenCL libraries are referenced in the icd files: libalteracl.so libintelocl_emu.so checking LD_LIBRARY_PATH for registered libraries: libalteracl.so was registered on the system at /glob/development-tools/versions/fpgasupportstack/d5005/2.0.1/inteldevstack/hld/host/linux64/lib WARNING: libintelocl_emu.so NOT FOUND Using the following location for fcd installations: /opt/Intel/OpenCL/Boards Found 1 fcd entry at that location: /opt/Intel/OpenCL/Boards/dcp_bsp.fcd the following OpenCL libraries are referenced in the fcd files: /opt/a10/inteldevstack/a10_gx_pac_ias_1_2_1_pv/opencl/opencl_bsp/linux64/lib/libintel_opae_mmd.so checking LD_LIBRARY_PATH for registered libraries: /opt/a10/inteldevstack/a10_gx_pac_ias_1_2_1_pv/opencl/opencl_bsp/linux64/lib/libintel_opae_mmd.so was registered on the system. Number of Platforms = 1 1. Intel(R) FPGA SDK for OpenCL(TM) | Intel(R) Corporation | OpenCL 1.0 Intel(R) FPGA SDK for OpenCL(TM), Version 19.2 -------------------------------------------------------------------- ICD diagnostics PASSED -------------------------------------------------------------------- -------------------------------------------------------------------- BSP Diagnostics -------------------------------------------------------------------- Using platform: Intel(R) FPGA SDK for OpenCL(TM) Using Device with name: pac_a10 : Intel PAC Platform (pac_ee00000) Using Device from vendor: Intel Corp clGetDeviceInfo CL_DEVICE_GLOBAL_MEM_SIZE = 8589933568 clGetDeviceInfo CL_DEVICE_MAX_MEM_ALLOC_SIZE = 8589933568 Allocated 8589933568 bytes Actual maximum buffer size = 8589933568 bytes Writing 8191 MB to global memory ... Allocated 1073741824 Bytes host buffer for large transfers Write speed: 6618.95 MB/s [6582.89 -> 6639.90] Reading and verifying 8191 MB from global memory ... Read speed: 6939.10 MB/s [6930.20 -> 6941.35] Successfully wrote and readback 8191 MB buffer Transferring 262144 KBs in 512 512 KB blocks ... 3713.25 MB/s Transferring 262144 KBs in 256 1024 KB blocks ... 3864.21 MB/s Transferring 262144 KBs in 128 2048 KB blocks ... 3783.43 MB/s Transferring 262144 KBs in 64 4096 KB blocks ... 4857.49 MB/s Transferring 262144 KBs in 32 8192 KB blocks ... 5702.58 MB/s Transferring 262144 KBs in 16 16384 KB blocks ... 6271.08 MB/s Transferring 262144 KBs in 8 32768 KB blocks ... 6590.81 MB/s Transferring 262144 KBs in 4 65536 KB blocks ... 6766.26 MB/s Transferring 262144 KBs in 2 131072 KB blocks ... 6857.73 MB/s Transferring 262144 KBs in 1 262144 KB blocks ... 6901.29 MB/s As a reference: PCIe Gen1 peak speed: 250MB/s/lane PCIe Gen2 peak speed: 500MB/s/lane PCIe Gen3 peak speed: 985MB/s/lane Writing 262144 KBs with block size (in bytes) below: Block_Size Avg Max Min End-End (MB/s) 524288 2845.36 3103.42 1917.79 2333.10 1048576 3057.90 3317.32 2378.19 2748.67 2097152 3171.22 3332.23 2575.43 3023.44 4194304 4229.36 4422.43 3384.40 4090.31 8388608 5122.87 5281.16 4325.88 5040.78 16777216 5789.42 5852.19 5325.66 5727.64 33554432 6113.74 6173.17 5787.89 6085.85 67108864 6286.82 6346.66 6121.03 6272.74 134217728 6386.98 6444.23 6330.74 6385.43 268435456 6426.82 6426.82 6426.82 6426.82 Reading 262144 KBs with block size (in bytes) below: Block_Size Avg Max Min End-End (MB/s) 524288 3452.46 3713.25 2807.69 2667.00 1048576 3642.77 3864.21 2648.51 3307.84 2097152 3690.29 3783.43 3504.37 3505.54 4194304 4800.91 4857.49 4515.82 4685.33 8388608 5676.27 5702.58 5620.99 5604.76 16777216 6237.62 6271.08 6145.33 6155.03 33554432 6585.39 6590.81 6571.93 6549.25 67108864 6762.17 6766.26 6756.00 6757.45 134217728 6857.36 6857.73 6857.00 6847.51 268435456 6901.29 6901.29 6901.29 6901.29 Write top speed = 6444.23 MB/s Read top speed = 6901.29 MB/s Throughput = 6672.76 MB/s DIAGNOSTIC_PASSED u1xxxxxx@s001-n137:~/S10_OPENCL_AFU$ aoc device/hello_world.cl -o bin/hello_world_fpga.aocx -board=pac_s10_dc rld_fpga.aocx bin/hello_world.aocxError: Invalid kernel file device/hello_world.cl: No such file or directory u1xxxxxx@s001-n137:~/S10_OPENCL_AFU$ cd hello_world/ u1xxxxxx@s001-n137:~/S10_OPENCL_AFU/hello_world$ aoc device/hello_world.cl -o bin/hello_world_fpga.aocx -board=pac_s10_dc aoc: Running OpenCL parser.... aoc: OpenCL parser completed successfully. aoc: Linking Object files.... aoc: Optimizing and doing static analysis of code... aoc: First stage compilation completed successfully. Compiling for FPGA. This process may take a long time, please be patient. Error: Compiler Error, not able to generate hardware u1xxxxxx@s001-n137:~/S10_OPENCL_AFU/hello_world$ cat bin/hello_world_fpga/quartus_sh_compile.log This is the run.sh script. ERROR: packager tool failed to run. Check installation. Aborting compilation!