topic Doesn't work Infiniband using IntelMPI in Intel® MPI Library https://community.intel.com/t5/Intel-MPI-Library/Doesn-t-work-Infiniband-using-IntelMPI/m-p/764758#M45 I gave tried to run parallel program using Intel MPI Library, but when I started like<DIV></DIV><DIV>mpirun -hosts node01,node02 -np 36 ./prog</DIV><DIV></DIV><DIV>it finished work without start witj an error message&nbsp;</DIV><DIV></DIV><DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 705 us(705 us): &nbsp;open_hca: get lid ERR for mlx4_0 port=2, err=Invalid argument</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 590 us(590 us): &nbsp;open_hca: get lid ERR for mlx4_0 port=2, err=Invalid argument</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 522 us(522 us): &nbsp;open_hca: getaddr_netdev ERROR: No such device. Is ib1 configured?</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 7180 us(6475 us): &nbsp;open_hca: device mthca0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 7403 us(223 us): &nbsp;open_hca: device mthca0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 7613 us(210 us): &nbsp;open_hca: device ipath0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 7810 us(197 us): &nbsp;open_hca: device ipath0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 8128 us(318 us): &nbsp;open_hca: device ehca0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 1994 us(1472 us): &nbsp;open_hca: getaddr_netdev ERROR: No such device. Is eth2 configured?</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 596 us(596 us): &nbsp;open_hca: getaddr_netdev ERROR: No such device. Is ib1 configured?</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 7904 us(7314 us): &nbsp;open_hca: device mthca0 not found</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 8221 us(317 us): &nbsp;open_hca: device mthca0 not found</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 8524 us(303 us): &nbsp;open_hca: device ipath0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 869 us(869 us): &nbsp;ucm_create_services: ERR Cannot allocate memory</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 8784 us(260 us): &nbsp;open_hca: device ipath0 not found</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 9042 us(258 us): &nbsp;open_hca: device ehca0 not found</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 2440 us(1844 us): &nbsp;open_hca: getaddr_netdev ERROR: No such device. Is eth2 configured?</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 859 us(859 us): &nbsp;ucm_create_services: ERR Cannot allocate memory</DIV><DIV id="_mcePaste">APPLICATION TERMINATED WITH THE EXIT STRING: Hangup (signal 1)</DIV></DIV><DIV>Infiniband devices works, everything seems to be OK. People who were asked said that this error related with permissions to devices, because when I ran it under root it worked well, but when I ran it under common user I had this error. Could you please help me?</DIV><DIV></DIV><DIV><DIV>[root@tisnum-head1 ~]# ibstat</DIV><DIV>CA 'mlx4_0'</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; CA type: MT26428</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Number of ports: 2</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Firmware version: 2.9.1000</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Hardware version: b0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Node GUID: 0x0002c90300565970</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; System image GUID: 0x0002c90300565973</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Port 1:</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; State: Down</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Physical state: Polling</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Rate: 70</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Base lid: 0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; LMC: 0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; SM lid: 0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Capability mask: 0x02510868</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Port GUID: 0x0002c90300565971</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Link layer: InfiniBand</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Port 2:</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; State: Active</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Physical state: LinkUp</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Rate: 40</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Base lid: 1</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; LMC: 0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; SM lid: 1</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Capability mask: 0x0251086a</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Port GUID: 0x0002c90300565972</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Link layer: InfiniBand</DIV></DIV><DIV></DIV><DIV><DIV>[root@tisnum-head1 ~]# lsmod</DIV><DIV>Module &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Size &nbsp;Used by</DIV><DIV>rdma_ucm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 12586 &nbsp;0</DIV><DIV>ib_ucm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 12255 &nbsp;0</DIV><DIV>rdma_cm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;35175 &nbsp;1 rdma_ucm</DIV><DIV>iw_cm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 8836 &nbsp;1 rdma_cm</DIV><DIV>ib_addr &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 6321 &nbsp;1 rdma_cm</DIV><DIV>ib_ipoib &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 84890 &nbsp;0</DIV><DIV>ib_cm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;38085 &nbsp;3 ib_ucm,rdma_cm,ib_ipoib</DIV><DIV>ib_sa &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;44401 &nbsp;4 rdma_ucm,rdma_cm,ib_ipoib,ib_cm</DIV><DIV>ib_uverbs &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;39637 &nbsp;2 rdma_ucm,ib_ucm</DIV><DIV>ib_umad &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;12477 &nbsp;6</DIV><DIV>iw_nes &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;192353 &nbsp;0</DIV><DIV>iw_cxgb3 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;133047 &nbsp;0</DIV><DIV>cxgb3 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 196233 &nbsp;1 iw_cxgb3</DIV><DIV>mlx4_ib &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;80171 &nbsp;0</DIV><DIV>mlx4_en &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;97664 &nbsp;0</DIV><DIV>mlx4_core &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 185193 &nbsp;2 mlx4_ib,mlx4_en</DIV><DIV>ib_mthca &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;141407 &nbsp;0</DIV><DIV>ib_mad &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 40497 &nbsp;5 ib_cm,ib_sa,ib_umad,mlx4_ib,ib_mthca</DIV><DIV>ib_core &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;69979 &nbsp;14 rdma_ucm,ib_ucm,rdma_cm,iw_cm,ib_ipoib,ib_cm,ib_sa,ib_uverbs,ib_umad,iw_nes,iw_cxgb3,mlx4_ib,ib_mthca,ib_mad</DIV><DIV>mpt2sas &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 173216 &nbsp;0</DIV><DIV>scsi_transport_sas &nbsp; &nbsp; 35070 &nbsp;1 mpt2sas</DIV><DIV>raid_class &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;4804 &nbsp;1 mpt2sas</DIV><DIV>mptctl &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 31976 &nbsp;0</DIV><DIV>mptbase &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;93845 &nbsp;1 mptctl</DIV><DIV>nfsd &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;305799 &nbsp;13</DIV><DIV>lockd &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;74270 &nbsp;1 nfsd</DIV><DIV>nfs_acl &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 2647 &nbsp;1 nfsd</DIV><DIV>auth_rpcgss &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;44895 &nbsp;1 nfsd</DIV><DIV>exportfs &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;4236 &nbsp;1 nfsd</DIV><DIV>autofs4 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;26888 &nbsp;3</DIV><DIV>ipmi_devintf &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;8049 &nbsp;0</DIV><DIV>ipmi_si &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;42401 &nbsp;0</DIV><DIV>ipmi_msghandler &nbsp; &nbsp; &nbsp; &nbsp;35992 &nbsp;2 ipmi_devintf,ipmi_si</DIV><DIV>sunrpc &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;243758 &nbsp;26 nfsd,lockd,nfs_acl,auth_rpcgss</DIV><DIV>8021q &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;23575 &nbsp;0</DIV><DIV>garp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;7344 &nbsp;1 8021q</DIV><DIV>stp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 2173 &nbsp;1 garp</DIV><DIV>llc &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 5642 &nbsp;2 garp,stp</DIV><DIV>ipv6 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;322029 &nbsp;134 ib_addr,ib_ipoib</DIV><DIV>libcrc32c &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 1246 &nbsp;1 iw_nes</DIV><DIV>nls_utf8 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;1455 &nbsp;1</DIV><DIV>ext3 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;235341 &nbsp;1</DIV><DIV>jbd &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;80337 &nbsp;1 ext3</DIV><DIV>sg &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 30124 &nbsp;0</DIV><DIV>igb &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 157825 &nbsp;0</DIV><DIV>dca &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 7197 &nbsp;1 igb</DIV><DIV>microcode &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 112594 &nbsp;0</DIV><DIV>sr_mod &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 16228 &nbsp;0</DIV><DIV>cdrom &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;39771 &nbsp;1 sr_mod</DIV><DIV>serio_raw &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 4818 &nbsp;0</DIV><DIV>amd64_edac_mod &nbsp; &nbsp; &nbsp; &nbsp; 21461 &nbsp;0</DIV><DIV>edac_core &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;46773 &nbsp;6 amd64_edac_mod</DIV><DIV>edac_mce_amd &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 15488 &nbsp;1 amd64_edac_mod</DIV><DIV>i2c_piix4 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;12608 &nbsp;0</DIV><DIV>i2c_core &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 31276 &nbsp;1 i2c_piix4</DIV><DIV>shpchp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 33482 &nbsp;0</DIV><DIV>ext4 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;364410 &nbsp;3</DIV><DIV>mbcache &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 8144 &nbsp;2 ext3,ext4</DIV><DIV>jbd2 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 88738 &nbsp;1 ext4</DIV><DIV>sd_mod &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 39488 &nbsp;7</DIV><DIV>crc_t10dif &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;1541 &nbsp;1 sd_mod</DIV><DIV>usb_storage &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;49452 &nbsp;0</DIV><DIV>megaraid_sas &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 77090 &nbsp;5</DIV><DIV>ata_generic &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 3837 &nbsp;0</DIV><DIV>pata_acpi &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 3701 &nbsp;0</DIV><DIV>pata_atiixp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 4211 &nbsp;0</DIV><DIV>ahci &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 40455 &nbsp;0</DIV><DIV>dm_mirror &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;14101 &nbsp;0</DIV><DIV>dm_region_hash &nbsp; &nbsp; &nbsp; &nbsp; 12170 &nbsp;1 dm_mirror</DIV><DIV>dm_log &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 10122 &nbsp;2 dm_mirror,dm_region_hash</DIV><DIV>dm_mod &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 81500 &nbsp;2 dm_mirror,dm_log</DIV></DIV><DIV></DIV><DIV></DIV><DIV>Thank you!</DIV><DIV></DIV><DIV>--</DIV><DIV>Alexander Kvashnin</DIV><DIV></DIV> Sat, 18 Aug 2012 12:02:38 GMT alexkvashnin 2012-08-18T12:02:38Z Doesn't work Infiniband using IntelMPI https://community.intel.com/t5/Intel-MPI-Library/Doesn-t-work-Infiniband-using-IntelMPI/m-p/764758#M45 I gave tried to run parallel program using Intel MPI Library, but when I started like<DIV></DIV><DIV>mpirun -hosts node01,node02 -np 36 ./prog</DIV><DIV></DIV><DIV>it finished work without start witj an error message&nbsp;</DIV><DIV></DIV><DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 705 us(705 us): &nbsp;open_hca: get lid ERR for mlx4_0 port=2, err=Invalid argument</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 590 us(590 us): &nbsp;open_hca: get lid ERR for mlx4_0 port=2, err=Invalid argument</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 522 us(522 us): &nbsp;open_hca: getaddr_netdev ERROR: No such device. Is ib1 configured?</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 7180 us(6475 us): &nbsp;open_hca: device mthca0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 7403 us(223 us): &nbsp;open_hca: device mthca0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 7613 us(210 us): &nbsp;open_hca: device ipath0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 7810 us(197 us): &nbsp;open_hca: device ipath0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 8128 us(318 us): &nbsp;open_hca: device ehca0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 1994 us(1472 us): &nbsp;open_hca: getaddr_netdev ERROR: No such device. Is eth2 configured?</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 596 us(596 us): &nbsp;open_hca: getaddr_netdev ERROR: No such device. Is ib1 configured?</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 7904 us(7314 us): &nbsp;open_hca: device mthca0 not found</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 8221 us(317 us): &nbsp;open_hca: device mthca0 not found</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 8524 us(303 us): &nbsp;open_hca: device ipath0 not found</DIV><DIV id="_mcePaste">node02-ib0:56fa:17a5a440: 869 us(869 us): &nbsp;ucm_create_services: ERR Cannot allocate memory</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 8784 us(260 us): &nbsp;open_hca: device ipath0 not found</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 9042 us(258 us): &nbsp;open_hca: device ehca0 not found</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 2440 us(1844 us): &nbsp;open_hca: getaddr_netdev ERROR: No such device. Is eth2 configured?</DIV><DIV id="_mcePaste">node01-ib0:4bd1:ceb2a440: 859 us(859 us): &nbsp;ucm_create_services: ERR Cannot allocate memory</DIV><DIV id="_mcePaste">APPLICATION TERMINATED WITH THE EXIT STRING: Hangup (signal 1)</DIV></DIV><DIV>Infiniband devices works, everything seems to be OK. People who were asked said that this error related with permissions to devices, because when I ran it under root it worked well, but when I ran it under common user I had this error. Could you please help me?</DIV><DIV></DIV><DIV><DIV>[root@tisnum-head1 ~]# ibstat</DIV><DIV>CA 'mlx4_0'</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; CA type: MT26428</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Number of ports: 2</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Firmware version: 2.9.1000</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Hardware version: b0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Node GUID: 0x0002c90300565970</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; System image GUID: 0x0002c90300565973</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Port 1:</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; State: Down</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Physical state: Polling</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Rate: 70</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Base lid: 0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; LMC: 0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; SM lid: 0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Capability mask: 0x02510868</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Port GUID: 0x0002c90300565971</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Link layer: InfiniBand</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; Port 2:</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; State: Active</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Physical state: LinkUp</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Rate: 40</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Base lid: 1</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; LMC: 0</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; SM lid: 1</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Capability mask: 0x0251086a</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Port GUID: 0x0002c90300565972</DIV><DIV>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Link layer: InfiniBand</DIV></DIV><DIV></DIV><DIV><DIV>[root@tisnum-head1 ~]# lsmod</DIV><DIV>Module &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Size &nbsp;Used by</DIV><DIV>rdma_ucm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 12586 &nbsp;0</DIV><DIV>ib_ucm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 12255 &nbsp;0</DIV><DIV>rdma_cm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;35175 &nbsp;1 rdma_ucm</DIV><DIV>iw_cm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 8836 &nbsp;1 rdma_cm</DIV><DIV>ib_addr &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 6321 &nbsp;1 rdma_cm</DIV><DIV>ib_ipoib &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 84890 &nbsp;0</DIV><DIV>ib_cm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;38085 &nbsp;3 ib_ucm,rdma_cm,ib_ipoib</DIV><DIV>ib_sa &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;44401 &nbsp;4 rdma_ucm,rdma_cm,ib_ipoib,ib_cm</DIV><DIV>ib_uverbs &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;39637 &nbsp;2 rdma_ucm,ib_ucm</DIV><DIV>ib_umad &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;12477 &nbsp;6</DIV><DIV>iw_nes &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;192353 &nbsp;0</DIV><DIV>iw_cxgb3 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;133047 &nbsp;0</DIV><DIV>cxgb3 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 196233 &nbsp;1 iw_cxgb3</DIV><DIV>mlx4_ib &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;80171 &nbsp;0</DIV><DIV>mlx4_en &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;97664 &nbsp;0</DIV><DIV>mlx4_core &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 185193 &nbsp;2 mlx4_ib,mlx4_en</DIV><DIV>ib_mthca &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;141407 &nbsp;0</DIV><DIV>ib_mad &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 40497 &nbsp;5 ib_cm,ib_sa,ib_umad,mlx4_ib,ib_mthca</DIV><DIV>ib_core &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;69979 &nbsp;14 rdma_ucm,ib_ucm,rdma_cm,iw_cm,ib_ipoib,ib_cm,ib_sa,ib_uverbs,ib_umad,iw_nes,iw_cxgb3,mlx4_ib,ib_mthca,ib_mad</DIV><DIV>mpt2sas &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 173216 &nbsp;0</DIV><DIV>scsi_transport_sas &nbsp; &nbsp; 35070 &nbsp;1 mpt2sas</DIV><DIV>raid_class &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;4804 &nbsp;1 mpt2sas</DIV><DIV>mptctl &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 31976 &nbsp;0</DIV><DIV>mptbase &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;93845 &nbsp;1 mptctl</DIV><DIV>nfsd &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;305799 &nbsp;13</DIV><DIV>lockd &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;74270 &nbsp;1 nfsd</DIV><DIV>nfs_acl &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 2647 &nbsp;1 nfsd</DIV><DIV>auth_rpcgss &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;44895 &nbsp;1 nfsd</DIV><DIV>exportfs &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;4236 &nbsp;1 nfsd</DIV><DIV>autofs4 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;26888 &nbsp;3</DIV><DIV>ipmi_devintf &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;8049 &nbsp;0</DIV><DIV>ipmi_si &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;42401 &nbsp;0</DIV><DIV>ipmi_msghandler &nbsp; &nbsp; &nbsp; &nbsp;35992 &nbsp;2 ipmi_devintf,ipmi_si</DIV><DIV>sunrpc &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;243758 &nbsp;26 nfsd,lockd,nfs_acl,auth_rpcgss</DIV><DIV>8021q &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;23575 &nbsp;0</DIV><DIV>garp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;7344 &nbsp;1 8021q</DIV><DIV>stp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 2173 &nbsp;1 garp</DIV><DIV>llc &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 5642 &nbsp;2 garp,stp</DIV><DIV>ipv6 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;322029 &nbsp;134 ib_addr,ib_ipoib</DIV><DIV>libcrc32c &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 1246 &nbsp;1 iw_nes</DIV><DIV>nls_utf8 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;1455 &nbsp;1</DIV><DIV>ext3 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;235341 &nbsp;1</DIV><DIV>jbd &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;80337 &nbsp;1 ext3</DIV><DIV>sg &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 30124 &nbsp;0</DIV><DIV>igb &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 157825 &nbsp;0</DIV><DIV>dca &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 7197 &nbsp;1 igb</DIV><DIV>microcode &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 112594 &nbsp;0</DIV><DIV>sr_mod &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 16228 &nbsp;0</DIV><DIV>cdrom &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;39771 &nbsp;1 sr_mod</DIV><DIV>serio_raw &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 4818 &nbsp;0</DIV><DIV>amd64_edac_mod &nbsp; &nbsp; &nbsp; &nbsp; 21461 &nbsp;0</DIV><DIV>edac_core &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;46773 &nbsp;6 amd64_edac_mod</DIV><DIV>edac_mce_amd &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 15488 &nbsp;1 amd64_edac_mod</DIV><DIV>i2c_piix4 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;12608 &nbsp;0</DIV><DIV>i2c_core &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 31276 &nbsp;1 i2c_piix4</DIV><DIV>shpchp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 33482 &nbsp;0</DIV><DIV>ext4 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;364410 &nbsp;3</DIV><DIV>mbcache &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 8144 &nbsp;2 ext3,ext4</DIV><DIV>jbd2 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 88738 &nbsp;1 ext4</DIV><DIV>sd_mod &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 39488 &nbsp;7</DIV><DIV>crc_t10dif &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;1541 &nbsp;1 sd_mod</DIV><DIV>usb_storage &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;49452 &nbsp;0</DIV><DIV>megaraid_sas &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 77090 &nbsp;5</DIV><DIV>ata_generic &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 3837 &nbsp;0</DIV><DIV>pata_acpi &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 3701 &nbsp;0</DIV><DIV>pata_atiixp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 4211 &nbsp;0</DIV><DIV>ahci &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 40455 &nbsp;0</DIV><DIV>dm_mirror &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;14101 &nbsp;0</DIV><DIV>dm_region_hash &nbsp; &nbsp; &nbsp; &nbsp; 12170 &nbsp;1 dm_mirror</DIV><DIV>dm_log &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 10122 &nbsp;2 dm_mirror,dm_region_hash</DIV><DIV>dm_mod &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 81500 &nbsp;2 dm_mirror,dm_log</DIV></DIV><DIV></DIV><DIV></DIV><DIV>Thank you!</DIV><DIV></DIV><DIV>--</DIV><DIV>Alexander Kvashnin</DIV><DIV></DIV> Sat, 18 Aug 2012 12:02:38 GMT https://community.intel.com/t5/Intel-MPI-Library/Doesn-t-work-Infiniband-using-IntelMPI/m-p/764758#M45 alexkvashnin 2012-08-18T12:02:38Z