[gmx-developers] Test Suite, CTest, CDash

Esztermann, Ansgar Ansgar.Esztermann at mpi-bpc.mpg.de
Wed Aug 25 14:28:54 CEST 2010

Hello everyone,

a few years ago, I have been briefly involved in the gcc project. I was extremely impressed by the huge test suite and by the way it could be used to quickly detect regressions. Putting aside for the moment the fact that "correct behaviour" is much easier to define for a compiler than for a simulation engine, I think that gromacs would profit from a similar test suite.

So I've taken Mark Abrahams' Regression Tests and started to convert them to CTest. The simple and complex tests are already in my local git repository (although some of them are still failing). There is CDash support as well: http://my.cdash.org/index.php?project=Gromacs

I'm planning to extend and maintain these tests. Offhand, these points strike me as important:

-Integrate more of Mark's tests (i.e. kernel tests, double precision tests)
-Fix the tests that are failing (or the software, if the failure is genuine)
-Add more tests (unit tests, "bugzilla" tests triggering known bugs)
-Add coverage support

Any comments?


Ansgar Esztermann
Max-Planck-Institut für biophysikalische Chemie, Abteilung 105

More information about the gromacs.org_gmx-developers mailing list