topic Re: Fortran program freezes in Intel® Fortran Compiler

Fortran program freezes

Li__Jun — Mon, 24 Jan 2022 17:32:01 GMT

Hi,

I had an issue running a simulation program. The program run in loops and, within each loop, uses OpenML in a parallel way. The program can run more than 100 loops without any problem, but it freezes completely at a loop 136 and certain thread, without any error message.

After digging into the program, it appears that it freezes at the Poisson process step:

CALL S_RNPOI(LAMBDA, IR)

for that thread. The lambda value was 3.74, so it was a reasonable value.

My question is:

1) Do someone know why this happens, and if there is any direct way of resolving this?

2) Is there any indirect way to get around this? For example, try to run this line of code, but it takes more than 5 seconds, it runs an alternative code.

Thank you in advance!

Jun

Re: Fortran program freezes

JohnNichols — Mon, 24 Jan 2022 18:24:58 GMT

You should provide a sample that fails as observed. You did not provide enough information.

Re: Fortran program freezes

Li__Jun — Mon, 24 Jan 2022 18:33:30 GMT

Thanks, JohnNichols.

I just googled and found this post: https://community.intel.com/t5/Intel-Fortran-Compiler/Fortran-frozen-after-iterations-in-a-loop/td-p/941535

It appears that this is a bug in the function RNPOI in IMSL that trigger nonexit loop forever. The error depends on random seed and Poisson intensity, so it could be difficult to replicate on your end.

There is no way I can change the IMSL function, so I wonder if there is a way to do something like 2) I mentioned above?

Re: Fortran program freezes

mecej4 — Tue, 25 Jan 2022 12:07:45 GMT

The IMSL error that you encountered was reported about nine years ago in this forum, also 13 years ago in comp.lang.fortran, and pertains to an old version of IMSL (some platform distributions of versions 4, 5, 6 and early releases of 7). Which version of IMSL are you using?

You can find an extended discussion of this bug here . Note that this is an IMSL bug that was fixed many years ago, and has little to do with the Intel Fortran Compiler. Intel no longer provides a bundled version of IMSL, and the bug was no longer present in the last IMSL version (7.0.1) that was available from Intel as an optional add on to the Fortran compiler package.

The MKL library provides the same functionality. For details, read the MKL documentation for virngpoisson . After some initial set up, you can use the following lines of code to fill an array with the desired random numbers as follows:

errcode=vslnewstream( stream, brng, iseed ) do j = 1, nr errcode = virngpoisson( method, stream, 1, y(j), lambda(j) ) end do

Re: Fortran program freezes

Li__Jun — Thu, 27 Jan 2022 17:27:53 GMT

Thank you so much, mecej4！ I followed your suggestion, managed to install MKL, and used the RNG there. Now it works well.

I am not sure the version of IMSL I have. The folder name is w_fcompxe_imsl_p_15.0.1.032. It came with my purchase of "Intel® Visual Fortran Composer XE for Windows* with IMSL*" about 10 years ago. Since the thread was back in 2013, so I think the version of IMSL has not fixed that issue.

Re: Fortran program freezes

mecej4 — Fri, 28 Jan 2022 03:09:05 GMT

You have a workaround now, but I think that if you actually have installed IMSL from w_fcompxe_imsl_p_15.0.1.032 you should have version of 7.0.1 of IMSL and with it the program should not hang. I wonder if you have an older version of IMSL that gets linked because of your environmental setup.

Here is a short test program that you can run to help identify the version of IMSL that gets used. Please report the program output and also tell us if the program freezes.

!https://comp.lang.fortran.narkive.com/71xJ5w7A/why-does-the-program-stop-when-random-numbers-from-a-poisson-distribution-are-generated !Hangs with CVF 6.6C + IMSL4 !OK with IFort 14 + IMSL 7.0.1 PROGRAM TEST IMPLICIT NONE INTEGER NR PARAMETER (NR=7) INTEGER IR(NR), ISEED REAL MEAN INTEGER ISELCT, NOUT CHARACTER STRING(4)*80, TEMP*80, VERML*80 EXTERNAL VERML ! STRING(1) = '(" IMSL MATH/LIBRARY Version Number: ", A)' STRING(3) = '(" Fortran Compiler Version Number: ", A)' ! Print the versions and numbers. DO ISELCT=1, 3, 2 TEMP = VERML(ISELCT) WRITE (*,STRING(ISELCT)) trim(TEMP) END DO MEAN = Z'41224925' ISEED = 1013973114 print *,'Calling RNSET(',iseed,')' CALL RNSET (ISEED) print *,'Calling RNPOI' CALL RNPOI(NR,MEAN,IR) END PROGRAM

Re: Fortran program freezes

Li__Jun — Fri, 28 Jan 2022 03:44:43 GMT

Thanks, mecej4.

I just tried it. Somehow, I got an error message in running STRING(3), so I modified the code slightly so that it does not print out the fortran compiler version number. Below is what I got:

*************

IMSL MATH/LIBRARY Version Number: IMSL Fortran Numerical Library, Version 7.0.1
Calling RNSET( 1013973114 )
Calling RNPOI
Press any key to continue . . .

*************

It appears that it is version 7.0.1, and the program did finish.

But my original program does freeze even when I use different parameter values, seeds, and it stops at the function RNPOI. I guess the problem remains at version 7.0.1 at different circumstances.

Re: Fortran program freezes

Li__Jun — Fri, 28 Jan 2022 03:57:34 GMT

Thanks, mercej4!

Below is what I got. I had to mute the STRING(3) as I got an error message. But it appears that the version is 7.0.1, and the program did finish. I guess the issue remains unfixed at different occasions.

IMSL MATH/LIBRARY Version Number: IMSL Fortran Numerical Library, Version 7.0.1
Calling RNSET( 1013973114 )
Calling RNPOI
Press any key to continue . . .

Re: Fortran program freezes

Li__Jun — Fri, 28 Jan 2022 15:42:32 GMT

Thanks, mercej4!

IMSL MATH/LIBRARY Version Number: IMSL Fortran Numerical Library, Version 7.0.1
Calling RNSET( 1013973114 )
Calling RNPOI
Press any key to continue . . .

Re: Fortran program freezes

Li__Jun — Fri, 28 Jan 2022 16:13:24 GMT

Thanks, mercej4! Somehow I tried to post my reply several times without success.

IMSL MATH/LIBRARY Version Number: IMSL Fortran Numerical Library, Version 7.0.1
Calling RNSET( 1013973114 )
Calling RNPOI
Press any key to continue .

Re: Fortran program freezes

Li__Jun — Fri, 28 Jan 2022 16:14:33 GMT

I tried to post my reply several times without success. Did I violate some forum policy?

Re: Fortran program freezes

Li__Jun — Fri, 28 Jan 2022 16:15:49 GMT

Thanks, mercej4!

I had to mute the STRING(3) as I got an error message. But based on the outputs, it appears that the version is 7.0.1 and the program did finish without being frozen. I guess the issue remains unfixed at different occasions.

Re: Fortran program freezes

mecej4 — Sat, 29 Jan 2022 17:32:20 GMT

The bug in the IMSL routine has since been fixed, but the reason for the failure is worth noting. The IMSL function RNPOI calls a uniform-distribution RNG, and solves a nonlinear equation to find the corresponding random number in a Poisson distribution. The solution fails to converge for certain values when the calculations are performed in single precision. Here is a simple demonstration program, which does not depend on having IMSL or MKL available.

In each iteration, variables u and fp are updated, and the iterations are stopped when u falls below fp. In the old version of the IMSL library, the variable u was single-precision, and that caused the failure. To see this, change the declaration of u to single precision and run the program again.

In the old forum thread (posted in 2013) that Li__Jun linked to, there were some codes that were originally available for testing related issues, but the revamping of the forum may have caused those to be removed.

program xrnp implicit none real :: ymu = 8.0, fp integer :: ix real*8 :: u !single precision causes failure integer :: i , j, iter real, external :: rnunf ! i=1 ix = 0 fp = exp(-ymu) u = 0.9999999 !value very near 1.0 iter = 0 do if( u <= fp )exit ix = ix + 1 u = u - fp fp = fp*ymu/ix iter = iter+1 print '(2i4,2x,2ES12.5)',iter,ix,u,fp if(iter <= 30)cycle ! place a limit of 30 on iterations stop 'Failed' ! u never went below fp end do stop end program

Re: Fortran program freezes

JohnNichols — Sat, 29 Jan 2022 20:36:46 GMT

A brief look at the results with EXCEL for Real* 4 shows the problem.

program xrnp implicit none real :: ymu = 8.0, fp real :: ix real :: u !single precision causes failure integer :: i , j, iter real, external :: rnunf ! i=1 ix = 0.0D0 fp = exp(-ymu) u = 0.9999999 !value very near 1.0 iter = 0 do if( abs(u- fp) < 0.0000001 )exit ix = ix + 1.0D0 u = u - fp fp = fp*ymu/ix iter = iter+1 write(*, '(i4,2x,4ES12.5)'),iter,ymu,ix,u,fp if(iter <= 100)cycle ! place a limit of 30 on iterations stop 'Failed' ! u never went below fp end do stop end program

Does solve the problem and is the way my very old and probably dead lecturers taught us how to do it.

Conte and de Boore page 82 is the sort of thing I was taught.

ERROR = ABS(B-A) DO WHILE ERROR .GT. XTOL

Re: Fortran program freezes

JohnNichols — Sat, 29 Jan 2022 20:41:58 GMT

In my humble opinion, a human cannot write a RNG that is truly random, it may pass the spectral tests, but that is also human.

Even measuring some physical property that is supposedly random, is dependent on the generator.

So randomness is a neat mathematical idea, it is purely an idea.

Re: Fortran program freezes

Li__Jun — Sat, 29 Jan 2022 22:53:26 GMT

Yes, I can replicate the failure (with a small change, u = 0.99999999, not u = 0.9999999), but I have no clue about the bug in IMSL. I noticed this freeze more a year ago, but never doubted the problem was due to the RNPOI function until recently.

Re: Fortran program freezes

Steve_Lionel — Sun, 30 Jan 2022 00:07:38 GMT

Just understand that Intel can't help you with IMSL anymore. Visual Numerics withdrew all rights to IMSL from Intel (Intel chose not to renew their contract.)

I'd definitely recommend an MKL solution if that works for you.

Re: Fortran program freezes

nordmay0 — Wed, 02 Feb 2022 08:00:21 GMT

most likely this is due to an error in the RNPOI function

Re: Fortran program freezes

nordmay0 — Wed, 02 Feb 2022 08:01:22 GMT

perhaps you tried to write an incorrect answer?