[gmx-developers] Reproducible runs with DLB

Roland Schulz roland at utk.edu
Thu Jul 21 18:18:35 CEST 2011


take a look at GMX_DLB_FLOP and GMX_DD_LOAD environment variables defined in
domdec.c. They might help with what you are trying to do.


---------- Forwarded message ----------
From: Bogdan Costescu <bcostescu at gmail.com>
Date: Thu, Jul 21, 2011 at 7:15 AM
Subject: [gmx-developers] Reproducible runs with DLB
To: "gmx-developers at gromacs.org" <gmx-developers at gromacs.org>

Dear GROMACS developers,

I need to be able to restart from an earlier point in a simulation and
exactly reproduce the original simulation while running in parallel
with DD. Although I save the state of the simulation in a checkpoint
file (using mdrun -cpnum), upon restart with the same number of ranks,
there are differences, small at the beginning but which become larger
later, which seem to appear due to the different DD cell sizes as they
are modified by the dynamic load balancing (DLB). Turning DLB off
(mdrun -dlb no) or running in reproducible mode (mdrun -reprod) makes
the restart exactly reproduce the original (at least based on the
criteria I'm interested in), however the run is significantly slower -
the molecular system is not homogeneous, so DLB helps a lot in
redistributing the calculations.

If my understanding of the issue is correct, saving the state of the
DD together with the checkpoint data and loading it upon restart would
allow me to keep DLB enabled and exactly reproduce the original run.
Is this so ? What are the difficulties in doing it ? If this is
doable, is someone with a good understanding of DD willing to guide me
in implementing it ? Of course, if someone with a good understanding
of DD would be willing to implement it, I'd be more than glad to test
it :-)

Thanks in advance!
gmx-developers mailing list
gmx-developers at gromacs.org
Please don't post (un)subscribe requests to the list. Use the
www interface or send it to gmx-developers-request at gromacs.org.

ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://maillist.sys.kth.se/pipermail/gromacs.org_gmx-developers/attachments/20110721/86584990/attachment.html>

More information about the gromacs.org_gmx-developers mailing list