"No space left on device" error when profiling a parallel application using Intel Trace Analyzer

[prakrati]

We are running Intel Trace Analyzer with Intel MPI to profile an application. It gives the following error mid-way between the execution :

.....
Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0006-010072.dat": No space left on device
[2] Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0002-013005.dat": No space left on device
[9] Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0009-010324.dat": No space left on device
[5] Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0005-010051.dat": No space left on device
[15] Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0015-010341.dat": No space left on device
[4] Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0004-010341.dat": No space left on device
[13] Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0013-010407.dat": No space left on device
[11] Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0011-010418.dat": No space left on device
[8] Intel Trace Collector ERROR: Failed writing buffer to flush file "/tmp/VT-flush-namd2_0008-010450.dat": No space left on device
....

This problem did not occur when a smaller run of the same application was profiled, with lesser number of nodes.

What could be the reason for this problem ?

[Dmitry_K_Intel2]

Hello,

You can set VT_LOGFILE_PREFIX environment variable pointing to a directory on a shared drive where you have huge amount of free space.
Also you can remove unneeded files from node namd2.

Regards!
Dmitry