topic Time-stamp output for mpiexec in Intel® MPI Library

Time-stamp output for mpiexec

pboehl — Wed, 29 Jul 2020 09:08:02 GMT

Hello all,

I am looking for a similar option to "-timestamp-output" for mpiexec of openMPI for Intel MPI, which adds a timestamp at each line of output to stdout, stderr, and stddiag of the program (not only for Intel MPI Debug messages). I found the option "-prepend-pattern" but I was not able to get proper timestamps for the output of each rank.

Anyone knows how to do that?

Thanks in advance and best regards!

Crunchip

Re:Time-stamp output for mpiexec

AbhishekD_Intel — Thu, 30 Jul 2020 12:47:18 GMT

Hi Patrick,

Thanks for reaching out to us. Currently, Intel MPI does not have any flags like -timestamp-output which is there in OpenMPI.

However, you can get output similar to that by using bash command. For example, to print timestamp for stdout and stderr you can use the following command:

mpirun -n 6 ./<executable_name> 2>&1 | xargs -L 1 echo `date +'[%Y-%m-%d %H:%M:%S]'` $1

Do let us know if this helps.

Warm Regards,

Abhishek

Re:Time-stamp output for mpiexec

pboehl — Fri, 07 Aug 2020 08:05:40 GMT

Hi Abhishek,

thank you for your reply. Yes, something similar I also found. There are just two possible drawbacks which I see with that solution. I think the output of mpiexec is buffered, so it could be that it does not the really print correct timestamp.

And the other thing: It might be a quite heavy additional load to call an external "date" for each process and output if one uses really large jobs with debugging output.

I guess an internal syscall might be a better option.

Anyway, thanks for your help

Best regards

Patrick

Re:Time-stamp output for mpiexec

AbhishekD_Intel — Mon, 10 Aug 2020 09:22:09 GMT

Hi Patrick,

Yes, the provided solution does have some drawbacks in some cases and also I do agree that it will create some additional load. But if you want then you can embed some library calls into your program at a time of stdout/stderr that will also help you depending on your use-case.

Please let us know if there is a critical need for this feature in our use-case.

Warm Regards,

Abhishek

Re:Time-stamp output for mpiexec

AbhishekD_Intel — Mon, 17 Aug 2020 12:36:06 GMT

Hi,

Please give us an update on the issue.

Thank You

Abhishek

Re: Re:Time-stamp output for mpiexec

pboehl — Tue, 18 Aug 2020 07:22:09 GMT

Hello Abhishek,

thank you. Yes, I know about things like LD_PRELOAD to "hack" something. But as we (at a supercomputing centre) have use for such a feature more often (also in our user support), we would appreciate a simple command line switch.

Kind regards,

Patrick

Re:Time-stamp output for mpiexec

AbhishekD_Intel — Thu, 20 Aug 2020 05:37:06 GMT

Hi Patrick,

We have discussed this issue with the experts and escalating it as a feature request for Intel MPI.

Warm Regards,

Abhishek

Betreff: Re:Time-stamp output for mpiexec

pboehl — Thu, 20 Aug 2020 09:00:31 GMT

Hi Abhishek,

thank you a lot for your effort, very appreciated.

Best regards

Patrick

Re: Time-stamp output for mpiexec

Devorah_H_Intel — Wed, 07 Sep 2022 21:10:04 GMT

-prepend-timestamp option is available now.