[gmx-developers] r2018 regressiontest script return value does not reflect test results

[Szilárd Páll]

Hi,

I know this issue has been noted in the past, but I am not sure if
this has been addressed.

The following sequence of commands illustrates that in my relaese-2018
git tip of the branch build the ctest execution of the regressiontests
claims pass, but a number of tests do fail and gmxtests seems to
return 0. Thoughts?


$ cmake ../ -; make check -j8
[...]
33/39 Test #33: MdrunMpiTests ....................   Passed    3.36 sec
      Start 34: regressiontests/simple
34/39 Test #34: regressiontests/simple ...........   Passed    6.70 sec
      Start 35: regressiontests/complex
35/39 Test #35: regressiontests/complex ..........   Passed  179.95 sec
      Start 36: regressiontests/kernel
36/39 Test #36: regressiontests/kernel ...........   Passed   65.51 sec
      Start 37: regressiontests/freeenergy
37/39 Test #37: regressiontests/freeenergy .......   Passed   13.12 sec
      Start 38: regressiontests/pdb2gmx
38/39 Test #38: regressiontests/pdb2gmx ..........   Passed   26.82 sec
      Start 39: regressiontests/rotation
39/39 Test #39: regressiontests/rotation .........   Passed    5.81 sec
[...]

$ PATH=$gmxdir:$PATH perl gmxtest.pl -xml complex -ntomp 8 -npme 0 -nt
1; echo -e "\n\n===> RETVAL: $? <==="
[...]
11 out of 51 complex tests FAILED


===> RETVAL: 0 <===


--
Szilárd