nohup: ignoring input :: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables. Wed Jul 7 12:55:03 CST 2021 [0] MPI startup(): Intel(R) MPI Library, Version 2021.2 Build 20210302 (id: f4f7c92cd) [0] MPI startup(): Copyright (C) 2003-2021 Intel Corporation. All rights reserved. [0] MPI startup(): library kind: release [16] MPI startup(): shm segment size (212 MB per rank) * (16 local ranks) = 3397 MB total [48] MPI startup(): shm segment size (212 MB per rank) * (16 local ranks) = 3397 MB total [0] MPI startup(): shm segment size (212 MB per rank) * (16 local ranks) = 3397 MB total [0] MPI startup(): libfabric version: 1.11.0-impi [32] MPI startup(): shm segment size (212 MB per rank) * (16 local ranks) = 3397 MB total [0] MPI startup(): libfabric provider: mlx [0] MPI startup(): Load tuning file: "/opt/intel/oneapi/mpi/2021.2.0/etc/tuning_icx_shm-ofi_mlx.dat" starting wrf task 19 of 64 starting wrf task 21 of 64 starting wrf task 25 of 64 starting wrf task 27 of 64 starting wrf task 29 of 64 starting wrf task 31 of 64 starting wrf task 17 of 64 starting wrf task 7 of 64 starting wrf task 9 of 64 starting wrf task 11 of 64 starting wrf task 5 of 64 starting wrf task 3 of 64 starting wrf task 1 of 64 starting wrf task 30 of 64 starting wrf task 23 of 64 starting wrf task 2 of 64 starting wrf task 6 of 64 starting wrf task 10 of 64 starting wrf task 4 of 64 starting wrf task 13 of 64 starting wrf task 12 of 64 starting wrf task 14 of 64 starting wrf task 15 of 64 starting wrf task 8 of 64 starting wrf task 22 of 64 starting wrf task 20 of 64 starting wrf task 18 of 64 starting wrf task 57 of 64 starting wrf task 61 of 64 starting wrf task 63 of 64 starting wrf task 59 of 64 starting wrf task 49 of 64 starting wrf task 51 of 64 starting wrf task 55 of 64 starting wrf task 53 of 64 starting wrf task 26 of 64 starting wrf task 28 of 64 starting wrf task 24 of 64 starting wrf task 37 of 64 starting wrf task 33 of 64 starting wrf task 43 of 64 starting wrf task 41 of 64 starting wrf task 45 of 64 starting wrf task 47 of 64 starting wrf task 39 of 64 starting wrf task 35 of 64 starting wrf task 58 of 64 starting wrf task 50 of 64 starting wrf task 54 of 64 starting wrf task 62 of 64 starting wrf task 60 of 64 starting wrf task 52 of 64 starting wrf task 48 of 64 starting wrf task 56 of 64 starting wrf task 38 of 64 starting wrf task 36 of 64 starting wrf task 34 of 64 starting wrf task 42 of 64 starting wrf task 46 of 64 starting wrf task 44 of 64 starting wrf task 40 of 64 starting wrf task 32 of 64 [0] MPI startup(): Rank Pid Node name Pin cpu [0] MPI startup(): 0 50551 cu02 {32,33,34,35} [0] MPI startup(): 1 50552 cu02 {36,37,38,39} [0] MPI startup(): 2 50553 cu02 {40,41,42,43} [0] MPI startup(): 3 50554 cu02 {44,45,46,47} [0] MPI startup(): 4 50555 cu02 {48,49,50,51} [0] MPI startup(): 5 50556 cu02 {52,53,54,55} [0] MPI startup(): 6 50557 cu02 {56,57,58,59} [0] MPI startup(): 7 50558 cu02 {60,61,62,63} [0] MPI startup(): 8 50559 cu02 {0,1,2,3} [0] MPI startup(): 9 50560 cu02 {4,5,6,7} [0] MPI startup(): 10 50561 cu02 {8,9,10,11} [0] MPI startup(): 11 50562 cu02 {12,13,14,15} [0] MPI startup(): 12 50563 cu02 {16,17,18,19} [0] MPI startup(): 13 50565 cu02 {20,21,22,23} [0] MPI startup(): 14 50566 cu02 {24,25,26,27} [0] MPI startup(): 15 50567 cu02 {28,29,30,31} [0] MPI startup(): 16 49419 cu03 {32,33,34,35} [0] MPI startup(): 17 49420 cu03 {36,37,38,39} [0] MPI startup(): 18 49421 cu03 {40,41,42,43} [0] MPI startup(): 19 49422 cu03 {44,45,46,47} [0] MPI startup(): 20 49423 cu03 {48,49,50,51} [0] MPI startup(): 21 49424 cu03 {52,53,54,55} [0] MPI startup(): 22 49425 cu03 {56,57,58,59} [0] MPI startup(): 23 49426 cu03 {60,61,62,63} [0] MPI startup(): 24 49427 cu03 {0,1,2,3} [0] MPI startup(): 25 49428 cu03 {4,5,6,7} [0] MPI startup(): 26 49429 cu03 {8,9,10,11} [0] MPI startup(): 27 49430 cu03 {12,13,14,15} [0] MPI startup(): 28 49431 cu03 {16,17,18,19} [0] MPI startup(): 29 49432 cu03 {20,21,22,23} [0] MPI startup(): 30 49435 cu03 {24,25,26,27} [0] MPI startup(): 31 49436 cu03 {28,29,30,31} [0] MPI startup(): 32 48637 cu04 {32,33,34,35} [0] MPI startup(): 33 48638 cu04 {36,37,38,39} [0] MPI startup(): 34 48639 cu04 {40,41,42,43} starting wrf task 16 of 64 [0] MPI startup(): 35 48640 cu04 {44,45,46,47} [0] MPI startup(): 36 48641 cu04 {48,49,50,51} [0] MPI startup(): 37 48642 cu04 {52,53,54,55} [0] MPI startup(): 38 48643 cu04 {56,57,58,59} [0] MPI startup(): 39 48644 cu04 {60,61,62,63} [0] MPI startup(): 40 48645 cu04 {0,1,2,3} [0] MPI startup(): 41 48646 cu04 {4,5,6,7} [0] MPI startup(): 42 48647 cu04 {8,9,10,11} [0] MPI startup(): 43 48648 cu04 {12,13,14,15} [0] MPI startup(): 44 48649 cu04 {16,17,18,19} [0] MPI startup(): 45 48650 cu04 {20,21,22,23} [0] MPI startup(): 46 48651 cu04 {24,25,26,27} [0] MPI startup(): 47 48652 cu04 {28,29,30,31} [0] MPI startup(): 48 19457 cu05 {32,33,34,35} [0] MPI startup(): 49 19458 cu05 {36,37,38,39} [0] MPI startup(): 50 19459 cu05 {40,41,42,43} [0] MPI startup(): 51 19460 cu05 {44,45,46,47} [0] MPI startup(): 52 19461 cu05 {48,49,50,51} [0] MPI startup(): 53 19462 cu05 {52,53,54,55} [0] MPI startup(): 54 19463 cu05 {56,57,58,59} [0] MPI startup(): 55 19464 cu05 {60,61,62,63} [0] MPI startup(): 56 19465 cu05 {0,1,2,3} [0] MPI startup(): 57 19466 cu05 {4,5,6,7} [0] MPI startup(): 58 19467 cu05 {8,9,10,11} [0] MPI startup(): 59 19468 cu05 {12,13,14,15} [0] MPI startup(): 60 19469 cu05 {16,17,18,19} [0] MPI startup(): 61 19470 cu05 {20,21,22,23} [0] MPI startup(): 62 19471 cu05 {24,25,26,27} [0] MPI startup(): 63 19472 cu05 {28,29,30,31} [0] MPI startup(): I_MPI_OFI_LIBRARY_INTERNAL=1 [0] MPI startup(): I_MPI_ROOT=/opt/intel/oneapi/mpi/2021.2.0 [0] MPI startup(): I_MPI_MPIRUN=mpirun [0] MPI startup(): I_MPI_HYDRA_TOPOLIB=hwloc [0] MPI startup(): I_MPI_PIN_RESPECT_HCA=enable [0] MPI startup(): I_MPI_INTERNAL_MEM_POLICY=default [0] MPI startup(): I_MPI_FABRICS=shm:ofi [0] MPI startup(): I_MPI_DEBUG=10 starting wrf task 0 of 64 =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 32 PID 48637 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 33 PID 48638 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 34 PID 48639 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 35 PID 48640 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 36 PID 48641 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 37 PID 48642 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 38 PID 48643 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 39 PID 48644 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 40 PID 48645 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 41 PID 48646 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 42 PID 48647 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 43 PID 48648 RUNNING AT cu04 = KILLED BY SIGNAL: 11 (Segmentation fault) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 44 PID 48649 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 45 PID 48650 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 46 PID 48651 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 47 PID 48652 RUNNING AT cu04 = KILLED BY SIGNAL: 9 (Killed) =================================================================================== real 0m12.894s user 0m0.049s sys 0m0.018s Wed Jul 7 12:55:16 CST 2021