topic $TMPDIR question in Intel® MPI Library

$TMPDIR question

Rafał_Błaszczyk — Mon, 24 May 2010 11:23:04 GMT

Hello,

I've got simple question about TMPDIR behaviour of Intel MPI.

We are receiving some info in the logs:

[bash]mpd: wn29_60522 (run 1652): Warning: the directory pointed by TMPDIR (/tmp/pbs.16445.mgmt1) does not exist! 
/tmp will be used.[/bash]

We are using PBS Professional which sets TMPDIR to job-specific directory but it only creates it on the first compute node. I believe that this is a problem - I assume that mpd tries to use $TMPDIR on every node it runs.

Is that right? How can we avoid it?

$TMPDIR question

Dmitry_K_Intel2 — Mon, 24 May 2010 11:42:45 GMT

Hi Rafal,

Please use I_MPI_MPD_TMPDIR env variable - it has higher priority.
$ export I_MPI_MPD_TMPDIR=/tmp
and all temp files will be in /tmp directory.

Please don't use directories located on parallel file systems (like pvfs) for temporary files!

Regards!
Dmitry

$TMPDIR question

Rafał_Błaszczyk — Mon, 24 May 2010 12:56:39 GMT

Hi Dmitry,

I wanted to use $TMPDIR assigned by PBS because it is destroyed every time job finishes - that would look after cleaning up (in case if mpd failed and left some files behind) but as I see there is no "right" way...

I'm aware that /tmp should be local, have no fear :)

I see the best option is to clear /tmp on regular basis...

Thanks for tip!

Regards

$TMPDIR question

Dmitry_K_Intel2 — Mon, 24 May 2010 14:06:34 GMT

Rafal, is it possible to create /tmp directory on a shared drive?

Regards!
Dmitry