offload error (trying my first program)

[matsbror]

I am just trying to get our XeonPhi to work properly. It worked for offload computing a couple of months ago when I tried it, but now I get the following error:

offload error: cannot find offload entry __offload_entry_Conceptual_Transformation_cpp_40f_7e694fe6ef39bee36b1d18aad1ea599dicc43479367WrTpxg
offload error: process on the device 0 unexpectedly exited with code 1

icc version 14.0.2 (gcc version 4.7.2 compatibility)

MPSS 3.5

Code is just a simple example to try out offloading. Any help appreciated.

// Source code
#include <stdio.h>
__attribute__((target(mic))) int g()
{
  return 5;
}

void f()
{
  int a,b=5;
  #pragma offload target(mic)
  a = b + g();
  printf("a = %2d\n", a);
}

main()
{
  f();
}

[matsbror]

An update. The problem appeared after updating both compilers and MPSS. I found an old binary, compiled before I upgraded the compiler, where offloading was used, and I could run it and verified that offloading actually takes place. So MPSS seems to work OK. I can also ssh to the device and run programs natively. The example above finds the MIC-card correctly using the _Offload_number_of_devices call.

How do I go about and try to find the error. Is there a way to check micuser logs on the device

[Frances_R_Intel]

I am having trouble finding any source code file named Conceptual_Transformation.cpp in any Intel libraries. That doesn't mean it's not there. But just in case, could you check to see if you can see such a file anywhere in your source tree or libraries? Not sure how it might have gotten itself linked in to such a simple program. If nothing jumps out at you, could you post your compile command?

[matsbror]

Frances,

Conceptual_Transformation.cpp is the name of the source code file. Here is the compile command, error output and a dump from the symbol table showing that the symbol is in the file. My guess is that something that should be copied to the device is not copied.

$ icc -o offl -offload Conceptual_Transformation.cpp

$ ./offl
 Checking for Intel(R) Xeon Phi(TM) (Target CPU)devices...

 Number of Target devices installed: 1

offload error: cannot find offload entry __offload_entry_Conceptual_Transformation_cpp_40f_7e694fe6ef39bee36b1d18aad1ea599dicc953973692cqP2s3
offload error: process on the device 0 unexpectedly exited with code 1

$ nm offl| grep __offload_entry
00000000006167b0 d __offload_entry_Conceptual_Transformation_cpp_40f_7e694fe6ef39bee36b1d18aad1ea599dicc953973692cqP2s3_$entry
0000000000615d48 d __offload_entry_node
00000000006167c0 d __offload_entry_table_end
00000000006167a0 d __offload_entry_table_start
 

[matsbror]

Frances,

Conceptual_Transformation.cpp is the name of the source code file. Here is the compile command, error output and a dump from the symbol table showing that the symbol is in the file. My guess is that something that should be copied to the device is not copied.

$ icc -o offl -offload Conceptual_Transformation.cpp

$ ./offl
 Checking for Intel(R) Xeon Phi(TM) (Target CPU)devices...

 Number of Target devices installed: 1

offload error: cannot find offload entry __offload_entry_Conceptual_Transformation_cpp_40f_7e694fe6ef39bee36b1d18aad1ea599dicc953973692cqP2s3
offload error: process on the device 0 unexpectedly exited with code 1

$ nm offl| grep __offload_entry
00000000006167b0 d __offload_entry_Conceptual_Transformation_cpp_40f_7e694fe6ef39bee36b1d18aad1ea599dicc953973692cqP2s3_$entry
0000000000615d48 d __offload_entry_node
00000000006167c0 d __offload_entry_table_end
00000000006167a0 d __offload_entry_table_start
 

[Frances_R_Intel]

Ok, the compiler shouldn't be doing that to you. It works fine for me with the 15.0 compiler. You say that you have just recently installed the 14.0.2 version of the C++ compiler. I don't know if you have plans to get Intel® Parallel Studio XE 2015 (i.e. the 15.0.* compilers) at any time in the near future. If you have, then that would be the optimal solution. If not, you might want to try getting the 14.0.5 version of the compiler. I don't know if the problem is fixed in there, but it would be worth a try.

If you can't get a later compiler or if it doesn't fix the problem, let me know.

[matsbror]

I completely removed MPSS and the parallel studio and reinstalled in from scratch (CentOS 6.6). I do not have license for higher versions than 14 and the higherst version I could find was 14.0.3. MPSS installed is version 3.5.

As I wrote. It did work earlier. Are there any environment variables to get more info when I try to run the code?

[matsbror]

Here is the verbose output of compilation and linking:

[matsbror@valarauko slide11]$ icc -Xlinker -v -V -o offl Conceptual_Transformation.cpp
Intel(R) C Intel(R) 64 Compiler XE for applications running on Intel(R) 64, Version 14.0.3.174 Build 20140422
Copyright (C) 1985-2014 Intel Corporation.  All rights reserved.
FOR NON-COMMERCIAL USE ONLY

icc version 14.0.3 (gcc version 4.7.2 compatibility)
/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64/mcpcom    -_g -mP3OPT_inline_alloca -D__HONOR_STD -D__ICC=1400 -D__INTEL_COMPILER=1400 -D__INTEL_COMPILER_UPDATE=3 -D__PTRDIFF_TYPE__=long "-D__SIZE_TYPE__=unsigned long" -D__WCHAR_TYPE__=int "-D__WINT_TYPE__=unsigned int" "-D__INTMAX_TYPE__=long int" "-D__UINTMAX_TYPE__=long unsigned int" -D__LONG_MAX__=9223372036854775807L -D__QMSPP_ -D__OPTIMIZE__ -D__NO_MATH_INLINES -D__NO_STRING_INLINES -D__GNUC_GNU_INLINE__ -D__GNUG__=4 -D__GNUC__=4 -D__GNUC_MINOR__=7 -D__GNUC_PATCHLEVEL__=2 -D__LP64__ -D_LP64 -D_GNU_SOURCE=1 -D__DEPRECATED=1 -D__GXX_WEAK__=1 -D__GXX_ABI_VERSION=1002 "-D__USER_LABEL_PREFIX__= " -D__REGISTER_PREFIX__= -D__INTEL_RTTI__ -D__EXCEPTIONS=1 -D__unix__ -D__unix -D__linux__ -D__linux -D__gnu_linux__ -B -Dunix -Dlinux "-_Asystem(unix)" -D__ELF__ -D__x86_64 -D__x86_64__ "-_Acpu(x86_64)" "-_Amachine(x86_64)" -D_MT -D__INTEL_COMPILER_BUILD_DATE=20140422 -D__INTEL_OFFLOAD -D__i686 -D__i686__ -D__pentiumpro -D__pentiumpro__ -D__pentium4 -D__pentium4__ -D__tune_pentium4__ -D__SSE2__ -D__SSE__ -D__MMX__ -_k -_8 -_l -_a -_b --gnu_version=472 -_W5 --gcc-extern-inline -p --bool -tused -x -v --multibyte_chars --array_section --simd --simd_func --offload_mode=1 --offload_target_names=mic,MIC --offload_unique_string=icc18149083125cNpkp --bool -mP1OPT_version=14.0-intel64 -mGLOB_diag_file=/tmp/iccXEzo45.diag -mP1OPT_print_version=FALSE -mCG_use_gas_got_workaround=F -mP2OPT_align_option_used=TRUE -mGLOB_gcc_version=472 "-mGLOB_options_string=-Xlinker -v -V -o offl" -mGLOB_cxx_limited_range=FALSE -mCG_extend_parms=FALSE -mGLOB_compiler_bin_directory=/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64 -mGLOB_as_output_backup_file_name=/tmp/icczhrqRMas_.s -mIPOPT_activate -mIPOPT_lite -mGLOB_em64t -mGLOB_instruction_tuning=0x0 -mGLOB_product_id_code=0x22006d91 -mCG_bnl_movbe=T -mGLOB_extended_instructions=0x8 -mP3OPT_use_mspp_call_convention -mPGOPTI_value_profile_use=T -mP2OPT_il0_array_sections=TRUE -mGLOB_offload_mode=1 -mP2OPT_offload_unique_var_string=icc18149083125cNpkp -mP2OPT_hlo_level=2 -mP2OPT_hlo -mP2OPT_hpo_rtt_control=0 -mIPOPT_args_in_regs=0 -mP2OPT_disam_assume_nonstd_intent_in=FALSE -mGLOB_imf_mapping_library=/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64/libiml_attr.so -mIPOPT_obj_output_file_name=/tmp/iccXEzo45.o -mIPOPT_whole_archive_fixup_file_name=/tmp/iccwarchumVmzX -mGLOB_linker_version=2.20.51.0.2 -mGLOB_long_size_64 -mGLOB_routine_pointer_size_64 -mGLOB_driver_tempfile_name=/tmp/icctempfile9AcvZi -mP3OPT_asm_target=P3OPT_ASM_TARGET_GAS -mGLOB_async_unwind_tables=TRUE -mGLOB_obj_output_file=/tmp/iccXEzo45.o -mGLOB_source_dialect=GLOB_SOURCE_DIALECT_C_PLUS_PLUS -mP1OPT_source_file_name=Conceptual_Transformation.cpp -mGLOB_eh_linux Conceptual_Transformation.cpp
#include "..." search starts here:
#include <...> search starts here:
 /opt/intel/composer_xe_2013_sp1.3.174/ipp/include
 /opt/intel/composer_xe_2013_sp1.3.174/mkl/include
 /opt/intel/composer_xe_2013_sp1.3.174/tbb/include
 /opt/intel/composer_xe_2013_sp1.3.174/compiler/include/intel64
 /opt/intel/composer_xe_2013_sp1.3.174/compiler/include
 /usr/local/include/c++/4.7.2
 /usr/local/include/c++/4.7.2/x86_64-unknown-linux-gnu
 /usr/local/include/c++/4.7.2/backward
 /usr/local/include
 /usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/include
 /usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/include-fixed
 /usr/include
End of search list.
Edison Design Group C/C++ Front End, version 4.6 (Apr 22 2014 18:27:03)
Copyright 1988-2013 Edison Design Group, Inc.

FOR NON-COMMERCIAL USE ONLY

icc version 14.0.3 (gcc version 4.7.0 compatibility)
/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64_mic/mcpcom    -_g -mP3OPT_inline_alloca -D__HONOR_STD -D__ICC=1400 -D__INTEL_COMPILER=1400 -D__INTEL_COMPILER_UPDATE=3 -D__PTRDIFF_TYPE__=long "-D__SIZE_TYPE__=unsigned long" -D__WCHAR_TYPE__=int "-D__WINT_TYPE__=unsigned int" "-D__INTMAX_TYPE__=long int" "-D__UINTMAX_TYPE__=long unsigned int" -D__LONG_MAX__=9223372036854775807L -D__QMSPP_ -D__OPTIMIZE__ -D__NO_MATH_INLINES -D__NO_STRING_INLINES -D__GNUC_GNU_INLINE__ -D__GNUG__=4 -D__GNUC__=4 -D__GNUC_MINOR__=7 -D__GNUC_PATCHLEVEL__=0 -D__LP64__ -D_LP64 -D_GNU_SOURCE=1 -D__DEPRECATED=1 -D__GXX_WEAK__=1 -D__GXX_ABI_VERSION=1002 "-D__USER_LABEL_PREFIX__= " -D__REGISTER_PREFIX__= -D__INTEL_RTTI__ -D__EXCEPTIONS=1 "-_Asystem(unix)" "-_Acpu(x86_64)" "-_Amachine(x86_64)" -D__ELF__ -D__unix__ -D__unix -D__linux__ -D__linux -D__gnu_linux__ -B -Dunix -Dlinux -D__x86_64 -D__x86_64__ -D__k1om__ -D_MT -D__INTEL_COMPILER_BUILD_DATE=20140422 -DTARGET_ARCH_MIC -DTARGET_ARCH_LRB -D__PIC__ -D__pic__ -D__INTEL_OFFLOAD -D__KNC__ -D__KNC -D__MIC__ -D__MIC -_k -_8 -_l -_a -_b --gnu_version=470 -_W5 --gcc-extern-inline -p --bool -tused -x -v --multibyte_chars --diag_error=2348 --diag_error=2351 --array_section --simd --simd_func --offload_mode=2 --offload_target_names=mic,MIC --offload_unique_string=icc18149083125cNpkp --bool -mP1OPT_version=14.0-intel64 -mGLOB_diag_file=/tmp/iccFSpUgS.diag -mP1OPT_print_version=FALSE -mCG_use_gas_got_workaround=F -mP2OPT_align_option_used=TRUE -mGLOB_gcc_version=470 "-mGLOB_options_string= -Xlinker -v -V -o offl" -mGLOB_position_independent_code -mGLOB_preemption_model=3 -mGLOB_cxx_limited_range=FALSE -mCG_extend_parms=FALSE -mGLOB_compiler_bin_directory=/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64_mic -mGLOB_as_output_backup_file_name=/tmp/iccPXtM72as_.s -mIPOPT_activate -mIPOPT_lite -mGLOB_em64t -mGLOB_instruction_tuning=0x0 -mGLOB_k1om_objects=TRUE -mGLOB_product_id_code=0x22006d91 -mCG_bnl_movbe=T -mGLOB_extended_instructions=0x10000 -mCG_allow_xmm=FALSE -mP3OPT_use_mspp_call_convention -mPGOPTI_value_profile_use=T -mP2OPT_il0_array_sections=TRUE -mGLOB_offload_mode=2 -mP2OPT_offload_unique_var_string=icc18149083125cNpkp -mP2OPT_hlo_level=2 -mP2OPT_hlo -mP2OPT_hpo_rtt_control=0 -mIPOPT_args_in_regs=0 -mP2OPT_disam_assume_nonstd_intent_in=FALSE -mGLOB_imf_mapping_library=/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64_mic/libiml_attr.so -mIPOPT_obj_output_file_name=/tmp/iccFSpUgS.o -mIPOPT_whole_archive_fixup_file_name=/tmp/iccwarchztgFYd -mGLOB_linker_version=2.20.51.0.2 -mGLOB_long_size_64 -mGLOB_routine_pointer_size_64 -mGLOB_driver_tempfile_name=/tmp/icctempfiletmyyPo -mP3OPT_asm_target=P3OPT_ASM_TARGET_GAS -mGLOB_async_unwind_tables=TRUE -mGLOB_obj_output_file=/tmp/iccFSpUgS.o -mGLOB_source_dialect=GLOB_SOURCE_DIALECT_C_PLUS_PLUS -mP1OPT_source_file_name=Conceptual_Transformation.cpp -mP1OPT_max_rec_copy_size=256 -mGLOB_eh_linux Conceptual_Transformation.cpp
#include "..." search starts here:
#include <...> search starts here:
 /opt/intel/composer_xe_2013_sp1.3.174/ipp/include
 /opt/intel/composer_xe_2013_sp1.3.174/mkl/include
 /opt/intel/composer_xe_2013_sp1.3.174/tbb/include
 /opt/intel/composer_xe_2013_sp1.3.174/compiler/include/mic
 /opt/intel/composer_xe_2013_sp1.3.174/compiler/include
 /usr/linux-k1om-4.7/linux-k1om/../x86_64-k1om-linux/include/c++/4.7.0
 /usr/linux-k1om-4.7/linux-k1om/../x86_64-k1om-linux/include/c++/4.7.0/backward
 /usr/linux-k1om-4.7/linux-k1om/../lib/gcc/x86_64-k1om-linux/4.7.0/include
 /usr/linux-k1om-4.7/linux-k1om/../lib/gcc/x86_64-k1om-linux/4.7.0/include-fixed
 /usr/linux-k1om-4.7/linux-k1om/usr/include
End of search list.
Edison Design Group C/C++ Front End, version 4.6 (Apr 22 2014 19:06:29)
Copyright 1988-2013 Edison Design Group, Inc.

x86_64-k1om-linux-ld    --sysroot=/usr/linux-k1om-4.7/linux-k1om /usr/linux-k1om-4.7/linux-k1om/usr/lib64/crti.o /usr/linux-k1om-4.7/linux-k1om/usr/lib64/k1om-mpss-linux/4.7.0/crtbeginS.o /opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/mic/ofldbegin.o --eh-frame-hdr -shared -m elf_k1om -o /tmp/iccoutMGN7B6 -soname offlMIC -L/opt/intel/composer_xe_2013_sp1.3.174/tbb/lib/mic -v -L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/mic -L/usr/linux-k1om-4.7/linux-k1om/../lib/gcc/x86_64-k1om-linux/4.7.0 -L/usr/linux-k1om-4.7/linux-k1om/../lib/gcc -L/usr/linux-k1om-4.7/linux-k1om/lib64 -L/usr/linux-k1om-4.7/linux-k1om/usr/lib64 -L/usr/linux-k1om-4.7/linux-k1om/lib64 -L/usr/linux-k1om-4.7/linux-k1om/usr/lib64 /tmp/iccFSpUgS.o -Bdynamic -limf -lsvml -lirng -lm -lipgo -ldecimal -loffload --as-needed -lcilkrts --no-as-needed -lstdc++ -lgcc -lgcc_s -lintlc -lsvml -lrt -lc -lgcc -lgcc_s -lirc_s -ldl -lc /opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/mic/ofldend.o /usr/linux-k1om-4.7/linux-k1om/usr/lib64/k1om-mpss-linux/4.7.0/crtendS.o /usr/linux-k1om-4.7/linux-k1om/usr/lib64/crtn.o
GNU ld (GNU Binutils) 2.22.52.20120302
FOR NON-COMMERCIAL USE ONLY

icc version 14.0.3 (gcc version 4.7.2 compatibility)
/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64/mcpcom    -mP1OPT_version=14.0-intel64 -mGLOB_diag_file=/tmp/iccXEzo45.diag -mP1OPT_print_version=FALSE -mCG_use_gas_got_workaround=F -mP2OPT_align_option_used=TRUE -mGLOB_gcc_version=472 "-mGLOB_options_string= -Xlinker -v -V -o offl" -mGLOB_cxx_limited_range=FALSE -mCG_extend_parms=FALSE -mGLOB_compiler_bin_directory=/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64 -mGLOB_as_output_backup_file_name=/tmp/iccWWUQiNas_.s -mIPOPT_activate -mGLOB_em64t -mGLOB_product_id_code=0x22006d91 -mP3OPT_use_mspp_call_convention -mPGOPTI_value_profile_use=T -mPAROPT_openmp=TRUE -mP2OPT_il0_array_sections=TRUE -mGLOB_offload_mode=1 -mP2OPT_offload_unique_var_string=icc18149083125cNpkp -mP2OPT_hlo -mP2OPT_hpo_rtt_control=0 -mIPOPT_args_in_regs=0 -mP2OPT_disam_assume_nonstd_intent_in=FALSE -mGLOB_imf_mapping_library=/opt/intel/composer_xe_2013_sp1.3.174/bin/intel64/libiml_attr.so -mIPOPT_link -mIPOPT_ipo_activate -mIPOPT_mo_activate -mIPOPT_source_files_list=/tmp/iccsliseolE2q -mIPOPT_mo_global_data -mIPOPT_link_script_file=/tmp/iccscript4LnKaC "-mIPOPT_cmdline_link="/usr/lib/../lib64/crt1.o" "/usr/lib/../lib64/crti.o" "/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/crtbegin.o" "/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64/ofldbegin.o" "--eh-frame-hdr" "--build-id" "-dynamic-linker" "/lib64/ld-linux-x86-64.so.2" "-o" "offl" "-L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64" "-L/opt/intel/composer_xe_2013_sp1.3.174/ipp/../compiler/lib/intel64" "-L/opt/intel/composer_xe_2013_sp1.3.174/ipp/lib/intel64" "-L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64" "-L/opt/intel/composer_xe_2013_sp1.3.174/mkl/lib/intel64" "-L/opt/intel/composer_xe_2013_sp1.3.174/tbb/lib/intel64/gcc4.4" "-v" "-L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64" "-L/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/" "-L/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/../../../../lib64" "-L/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/../../../../lib64/" "-L/lib/../lib64" "-L/lib/../lib64/" "-L/usr/lib/../lib64" "-L/usr/lib/../lib64/" "-L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64/" "-L/opt/intel/composer_xe_2013_sp1.3.174/ipp/../compiler/lib/intel64/" "-L/opt/intel/composer_xe_2013_sp1.3.174/ipp/lib/intel64/" "-L/opt/intel/composer_xe_2013_sp1.3.174/mkl/lib/intel64/" "-L/opt/intel/composer_xe_2013_sp1.3.174/tbb/lib/intel64/gcc4.4/" "-L/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/../../../" "-L/lib64" "-L/lib/" "-L/usr/lib64" "-L/usr/lib" "-v" "/tmp/iccXEzo45.o" "/tmp/iccxqCYKD.o" "-Bdynamic" "-Bstatic" "-limf" "-lsvml" "-lirng" "-Bdynamic" "-lm" "-Bstatic" "-lipgo" "-ldecimal" "-Bdynamic" "-liomp5" "-loffload" "--as-needed" "-lcilkrts" "--no-as-needed" "-lstdc++" "-lgcc" "-lgcc_s" "-Bstatic" "-lirc" "-Bdynamic" "-lpthread" "-Bstatic" "-lsvml" "-Bdynamic" "-lc" "-lgcc" "-lgcc_s" "-Bstatic" "-lirc_s" "-Bdynamic" "-ldl" "-lc" "/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64/ofldend.o" "/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/crtend.o" "/usr/lib/../lib64/crtn.o"" -mIPOPT_il_in_obj -mIPOPT_ipo_activate_warn=FALSE -mIPOPT_obj_output_file_name=/tmp/ipo_iccgpbdgm.o -mIPOPT_whole_archive_fixup_file_name=/tmp/iccwarcheUw1YL -mGLOB_linker_version=2.20.51.0.2 -mGLOB_long_size_64 -mGLOB_routine_pointer_size_64 -mGLOB_driver_tempfile_name=/tmp/icctempfileTreT9W -mP3OPT_asm_target=P3OPT_ASM_TARGET_GAS -mGLOB_async_unwind_tables=TRUE -mGLOB_obj_output_file=/tmp/ipo_iccgpbdgm.o -mGLOB_source_dialect=GLOB_SOURCE_DIALECT_NONE -mP1OPT_source_file_name=ipo_out.c /tmp/iccXEzo45.o /tmp/iccxqCYKD.o -mIPOPT_object_files=T -mIPOPT_assembly_files=/tmp/iccalisUdvkwI -mIPOPT_generated_tempfiles=/tmp/iccelis0JQoET -mIPOPT_embedded_object_base_name=/tmp/icceobjScCtM4 -mIPOPT_cmdline_link_new_name=/tmp/iccllisKBLyUf
ld    /usr/lib/../lib64/crt1.o /usr/lib/../lib64/crti.o /usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/crtbegin.o /opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64/ofldbegin.o --eh-frame-hdr --build-id -dynamic-linker /lib64/ld-linux-x86-64.so.2 -o offl -L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64 -L/opt/intel/composer_xe_2013_sp1.3.174/ipp/../compiler/lib/intel64 -L/opt/intel/composer_xe_2013_sp1.3.174/ipp/lib/intel64 -L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64 -L/opt/intel/composer_xe_2013_sp1.3.174/mkl/lib/intel64 -L/opt/intel/composer_xe_2013_sp1.3.174/tbb/lib/intel64/gcc4.4 -v -L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64 -L/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/ -L/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/../../../../lib64 -L/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/../../../../lib64/ -L/lib/../lib64 -L/lib/../lib64/ -L/usr/lib/../lib64 -L/usr/lib/../lib64/ -L/opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64/ -L/opt/intel/composer_xe_2013_sp1.3.174/ipp/../compiler/lib/intel64/ -L/opt/intel/composer_xe_2013_sp1.3.174/ipp/lib/intel64/ -L/opt/intel/composer_xe_2013_sp1.3.174/mkl/lib/intel64/ -L/opt/intel/composer_xe_2013_sp1.3.174/tbb/lib/intel64/gcc4.4/ -L/usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/../../../ -L/lib64 -L/lib/ -L/usr/lib64 -L/usr/lib -v /tmp/iccXEzo45.o /tmp/iccxqCYKD.o -Bdynamic -Bstatic -limf -lsvml -lirng -Bdynamic -lm -Bstatic -lipgo -ldecimal -Bdynamic -liomp5 -loffload --as-needed -lcilkrts --no-as-needed -lstdc++ -lgcc -lgcc_s -Bstatic -lirc -Bdynamic -lpthread -Bstatic -lsvml -Bdynamic -lc -lgcc -lgcc_s -Bstatic -lirc_s -Bdynamic -ldl -lc /opt/intel/composer_xe_2013_sp1.3.174/compiler/lib/intel64/ofldend.o /usr/local/lib/gcc/x86_64-unknown-linux-gnu/4.7.2/crtend.o /usr/lib/../lib64/crtn.o
GNU ld version 2.20.51.0.2-5.42.el6 20100205
GNU ld version 2.20.51.0.2-5.42.el6 20100205

[Frances_R_Intel]

I have asked someone else to take a look at this, to see if they have a work around or can get you a later 14.0 compiler to work with. They can also do a more thorough check for other reports of this problem. What version of the compiler were you using before the problem appeared?

In the meantime:

To ask the linking stage to tell you about unsatisfied symbols, you could try adding this option to your compile line: -offload-option,mic,compiler,"-z defs". This is intended to track down symbols that are required by shared libraries but are not always checked by the loader. So I am not sure this will actually help, but it won't hurt.

Also in the vein of "it might not help but it won't hurt", instead of -offload, you might try -offload=mandatory and -offload=optional, to see if makes any difference whether the compiler produces only coprocessor code for the offload region or produces both coprocessor and host code for the offload region.

You wouldn't want to do this in your real code, but does the problem go away if you manually inline the function g instead of letting the compiler do it? If you do something to prevent the function from inlining?

[matsbror]

Thanks for having someone look at this. None of what you suggested made any difference in the output.

I have an executable for which the offload computing works on the card now. It was compiled on Dec 19. I think I have one of the 2013 (v14) versions installed then. Is there a way to look in the executable and find out which compiler version was used to compile it? If I recompile it, it will not work.

[Frances_R_Intel]

As to finding out what version of the compiler was used in building the working executable, I don't believe that information is in the executable anywhere. However, in my searches, I did come across another case where this behavior popped up, but with later versions of the compiler and MPSS. In that case, they never did figure out exactly what was going on but found that the problem went away when they went through and reinstalled both compilers and MPSS.

[matsbror]

Frances,

Unfortunately I cannot install a later version than 2013 because of license issues. However, I did remove MPSS and the compiler and reinstalled it. Maybe there was a part that I could not completely remove and therefore the problem persisted. Anyway, the fact remains that binaries that I compile now do not work (except for native execution on the MIC) and binaries for offload computing compiled before december do work.

[JJK]

Hi,

I'm running mpss 3.4 and 3.5 on CentOS 6.6 with icc 14 and 15 ( mix & match :) ) .

I've grabbed your sample code and it compiles just fine on my boxen. However, I did notice one difference in the output of the "icc -Xlinker -v -V " command:

<  /usr/include/c++/4.4.7
<  /usr/include/c++/4.4.7/x86_64-redhat-linux
<  /usr/include/c++/4.4.7/backward
---
>  /usr/local/include/c++/4.7.2
>  /usr/local/include/c++/4.7.2/x86_64-unknown-linux-gnu
>  /usr/local/include/c++/4.7.2/backward

where is gcc 4.7.2 coming from? it seems to be a local installation (/usr/local). Can  you verify that it also does not work with the 'stock' EL6 version of gcc (4.4.7).

Apart from the gcc-4.47 v gcc.4.7.2 mismatch I did not see any significant differences in compiler output (I've got 14.0.3 lying around ).

[Frances_R_Intel]

I doubt it is the include file version. I am using 4.8.3. But there is one way we can find out if the problem goes away with a new compiler or if it is something else in the environment.

Would you mind installing Intel® Parallel Studio XE 2016 Beta? You can download it without charge. The cost to you is that you will be asked to fill out a survey at the end of June and unfortunately the license expires in September. But this will give you a chance to try a later compiler so that we can narrow down where the problem is.

[matsbror]

Thanks JJK!

it was indeed the difference on gcc version that made it. I removed gcc 4.7 (which I had installed from source) and reinstalled the standard package from centOS and now I can use offload processing on the mic again. To use version 16 of icc did not make a difference, but thanks anyway.

Case closed!