Error on Intel Devcloud

[Saharsa]

Hi,

Could you please help why when I try to bash my script, which is submitting my job on a queue. it troughs this error:

/usr/local/sbin/torque_submitfilter: line 67: echo: write error: No space left on device
tr: write error: No space left on device

the result of df -h :

Filesystem Size Used Avail Use% Mounted on
udev 7.7G 0 7.7G 0% /dev
tmpfs 1.6G 1.3M 1.6G 1% /run
/dev/mapper/login--2--vg-root 24G 23G 0 100% /
tmpfs 7.7G 24K 7.7G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 7.7G 0 7.7G 0% /sys/fs/cgroup
p-stor:/shared/home 305T 32T 258T 11% /home
p-stor:/shared/glob 305T 32T 258T 11% /glob
p-stor:/shared/data 305T 32T 258T 11% /data
v-jupyter:/jhub 6.7G 5.1G 1.7G 76% /jhub
tmpfs 1.6G 0 1.6G 0% /run/user/76105
tmpfs 1.6G 0 1.6G 0% /run/user/77262
tmpfs 1.6G 0 1.6G 0% /run/user/79181
tmpfs 1.6G 0 1.6G 0% /run/user/68119
tmpfs 1.6G 0 1.6G 0% /run/user/80230
tmpfs 1.6G 0 1.6G 0% /run/user/0
tmpfs 1.6G 0 1.6G 0% /run/user/62539
tmpfs 1.6G 0 1.6G 0% /run/user/71681
tmpfs 1.6G 0 1.6G 0% /run/user/33830
tmpfs 1.6G 0 1.6G 0% /run/user/69463
tmpfs 1.6G 0 1.6G 0% /run/user/68392
tmpfs 1.6G 0 1.6G 0% /run/user/79859
tmpfs 1.6G 0 1.6G 0% /run/user/69788
tmpfs 1.6G 0 1.6G 0% /run/user/80931
tmpfs 1.6G 0 1.6G 0% /run/user/80239
tmpfs 1.6G 0 1.6G 0% /run/user/78949
tmpfs 1.6G 0 1.6G 0% /run/user/60207
tmpfs 1.6G 0 1.6G 0% /run/user/77785
tmpfs 1.6G 0 1.6G 0% /run/user/27802

[MGRAV]

Same problem here ! 

FYI, you can still open an interactive session (better than nothing)

Best,

Mathieu

[Saharsa]

But I stuck and I can not do anything

[Gopika_Intel]

Hi,

Thank you for reaching out. We have raised this issue with the internal team. We will get back to you as soon as we get an update.

Regards

Gopika

[Gopika_Intel]

Hi,

This error can happen because of number of reasons, including some other user having a process that is locking up files. Could you please share with us the following information so that we can narrow down the issue?

1. Could you please elaborate on what are you trying to achieve?

2. Are you able to ignore the error message and connect to compute node through interactive session?

3. Are you able to submit batch jobs?

NOTE: When the prompt is like this- uXXXXX@login-2:, you are in login node. If the prompt is like this- uXXXXX@s001-n011:, you are in compute node.

Regards

Gopika

[MGRAV]

For me,

1) simply submit job in queue, in particular it was FPGA compilation.

2) yep interactive session were still working (but as usually only one at the time)

3) It was not working, but since yesterday the problem was fixed (for me at least)

best,

Mathieu

[Saharsa]

Thank you for your reply, but the problem did not resolve with your suggestion. instead I copied all my files to my local directory and I deleted all of them from DevCloud, and after that it works.

I do not know how. Other thing they assigned 24G for me, but I do not know where it is.

[Gopika_Intel]

@MGRAV Thank you for the confirmation.

@Saharsa It seems the issue is fixed now. Could you please check it from your end, whether you are still facing the issue? If not, can we discontinue monitoring this thread?

Regards

Gopika

[Saharsa]

Thank you, you can close it.

[Gopika_Intel]

Hi,

Thank you for the confirmation. If you need any additional information, please submit a new question as this thread will no longer be monitored.

For further questions regarding space, please raise a new thread so that we can look in detail about that issue and help you better.

Regards

Gopika