rtc_invalidate error

jbencray_com · ‎04-10-2009

We have built a hybrid MPI/OpenMP version of WRF with ifort 10.1.15. If we set OMP_NUM_THREADS=1 it runs without error. If we set OMP_NUM_THREADS=8 (or any other value) we see: "rtc_invalidate error".
This is running on Rocks+/CentOS5.0/2.6.18-53.1.14.el5 and Intel MPI 3.1

TimP · ‎04-10-2009

Quoting - jbencray.com

We have built a hybrid MPI/OpenMP version of WRF with ifort 10.1.15. If we set OMP_NUM_THREADS=1 it runs without error. If we set OMP_NUM_THREADS=8 (or any other value) we see: "rtc_invalidate error".
This is running on Rocks+/CentOS5.0/2.6.18-53.1.14.el5 and Intel MPI 3.1

Intel MPI has made great strides in support of hybrid since 3.1, which hardly supported hybrid at all. Your report is amazingly cryptic. Do you set I_MPI_PIN_DOMAIN=omp, as required to work with OMP_NUM_THREADS ? Given that Red Hat 5.0 upheld the tradition of brokenness of .0 versions, why would you not use a recent version of Rocks? Rocks is up to RH/CentOS 5.3. ifort 10.1.15 also is fairly ancient, in the scheme of hybrid developments. The final update of ifort 11.0 has already been issued, and there were quite a few updates of 10.1 prior to that.

jbencray_com · ‎04-23-2009

Quoting - tim18

Quoting - jbencray.com

We have built a hybrid MPI/OpenMP version of WRF with ifort 10.1.15. If we set OMP_NUM_THREADS=1 it runs without error. If we set OMP_NUM_THREADS=8 (or any other value) we see: "rtc_invalidate error".
This is running on Rocks+/CentOS5.0/2.6.18-53.1.14.el5 and Intel MPI 3.1

Intel MPI has made great strides in support of hybrid since 3.1, which hardly supported hybrid at all. Your report is amazingly cryptic. Do you set I_MPI_PIN_DOMAIN=omp, as required to work with OMP_NUM_THREADS ? Given that Red Hat 5.0 upheld the tradition of brokenness of .0 versions, why would you not use a recent version of Rocks? Rocks is up to RH/CentOS 5.3. ifort 10.1.15 also is fairly ancient, in the scheme of hybrid developments. The final update of ifort 11.0 has already been issued, and there were quite a few updates of 10.1 prior to that.

Thanks. OS and middleware upgrades are hampered by ISV support for the latest version. This is actually Rocks+ and the 5.1 version of Rocks+ just came out. I'll upgrade to ifort 11.0 and iMPI 3.2 as well as set I_MPI_PIN_DOMAIN=omp.
/jb