[gmx-developers] Reference coordinates in mdrun - Availability at all nodes

Tsjerk Wassenaar tsjerkw at gmail.com
Wed Jan 13 15:07:38 CET 2010


Hi,

Looks good to me :)

Cheers,

Tsjerk

On Wed, Jan 13, 2010 at 11:35 AM, Berk Hess <hess at cbr.su.se> wrote:
> Hi,
>
> I just have a suggestion for the name:
> group_util is a bit too general, I would suggest something like groupcoord.
>
> Berk
>
> Carsten Kutzner wrote:
>> Hi,
>>
>> as David suggested, I have assembled in a new file the routines that are
>> useful to do comparisons to a set of reference positions (and for other
>> things as well). I called the new files group_util.[c,h] and put them
>> in ./src/mdlib/. I attach the header file if someone wants to take a look
>> over it and has useful suggestions before I commit. At the moment, the routines
>> are used by the essential dynamics module, and most of them also by the
>> enforced rotation module (which is in a separate branch, though).
>>
>> Tsjerk, you might want to use dd_make_local_group_indices() to select
>> the local atoms of the group you need to compare against the reference.
>> If you pass the the cross products of particle velocities and reference
>> positions per node to get_center_comm(), it will do the global summing for
>> you.
>>
>> If everybody is happy with the new file, I would commit it to the master
>> branch.
>>
>> Carsten
>>
>>
>> David van der Spoel wrote:
>>
>>> Carsten Kutzner wrote:
>>>
>>>> On Jan 6, 2010, at 12:27 PM, David van der Spoel wrote:
>>>>
>>>>
>>>>> Tsjerk Wassenaar wrote:
>>>>>
>>>>>> Hi Carsten,
>>>>>> Thanks a lot, that seems quite useful, and comes very close to what I
>>>>>> need. To elaborate a bit more, at runtime, I only need to have
>>>>>> differences between particle positions and their respective reference
>>>>>> positions, so adaptive local indexing seems most efficient, even
>>>>>> though it requires more memory. That shouldn't be a big problem
>>>>>> though. The difference vectors are to be summed, but I'd only need to
>>>>>> communicate partial sums, and then redistribute the outcome. I'm
>>>>>> vigilant, as I don't want to compromise/break anything. Would you mind
>>>>>> to look a bit over my shoulder? I can send you a more full account of
>>>>>> what I'm doing off line...
>>>>>>
>>>>> If the simlarity between the code is sufficient, I would like to
>>>>> advocate to take out the communication bits from edsam.c and move
>>>>> them to a separate source code file, used by edsam and Tsjerk's code.
>>>>> In general the code that does communication is most prone to problems
>>>>> when changing e.g. the parallellisation scheme, and hence it is
>>>>> useful to minimize the amount of code doing communication. IMHO it is
>>>>> even worth doing some unnecessary work (e.g. copying arrays in
>>>>> running mdrun) in order to be able to re-use communication code.
>>>>>
>>>>>
>>>> This is a good idea. In general, all approaches that make use of some
>>>> set of reference positions against which the current ones are compared
>>>> could use these routines (this would also apply to the enforced rotation
>>>> module). Maybe we could also include other useful operations on
>>>> "collective"
>>>> coordinate subsets like fitting to the reference or getting the center
>>>> of mass, or making the structure whole.
>>>>
>>> That sounds good!
>>>
>>> After moving the relevant routines from edsam.c to a new file it would
>>> be good to make a small API (in the header file) with comprehensible
>>> names not related to edsam.
>>>
>>> Cheers,
>>>
>>
>>
>> /*  -*- mode: c; tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4; c-file-style: "stroustrup"; -*-
>>  *
>>  *
>>  *                This source code is part of
>>  *
>>  *                 G   R   O   M   A   C   S
>>  *
>>  *          GROningen MAchine for Chemical Simulations
>>  *
>>  * Written by David van der Spoel, Erik Lindahl, Berk Hess, and others.
>>  * Copyright (c) 1991-2000, University of Groningen, The Netherlands.
>>  * Copyright (c) 2001-2008, The GROMACS development team,
>>  * check out http://www.gromacs.org for more information.
>>
>>  * This program is free software; you can redistribute it and/or
>>  * modify it under the terms of the GNU General Public License
>>  * as published by the Free Software Foundation; either version 2
>>  * of the License, or (at your option) any later version.
>>  *
>>  * If you want to redistribute modifications, please consider that
>>  * scientific software is very special. Version control is crucial -
>>  * bugs must be traceable. We will be happy to consider code for
>>  * inclusion in the official distribution, but derived work must not
>>  * be called official GROMACS. Details are found in the README & COPYING
>>  * files - if they are missing, get the official version at www.gromacs.org.
>>  *
>>  * To help us fund GROMACS development, we humbly ask that you cite
>>  * the papers on the package - you can find them in the top README file.
>>  *
>>  * For more info, check our website at http://www.gromacs.org
>>  *
>>  * And Hey:
>>  * Gallium Rubidium Oxygen Manganese Argon Carbon Silicon
>>  */
>>
>> /*! \file group_util.h
>>  *
>>  *  @brief Assemble atom positions for comparison with a reference set.
>>  *
>>  *  This file contains functions to assemble the positions of a subset of the
>>  *  atoms and to do operations on it like determining the center of mass, or
>>  *  doing translations and rotations. These functions are useful when
>>  *  a subset of the positions needs to be compared to some set of reference
>>  *  positions, as e.g. done for essential dynamics.
>>  *
>>  */
>>
>> #ifdef HAVE_CONFIG_H
>> #include <config.h>
>> #endif
>>
>> #include <stdio.h>
>> #include "typedefs.h"
>>
>>
>> /*! \brief Select local atoms of a group.
>> *
>> * Selects the indices of local atoms of a group and stores them in anrs_loc[0..nr_loc].
>> * If you need the positions of the group's atoms on all nodes, provide a coll_ind[0..nr]
>> * array and pass it on to communicate_group_positions. Thus the collective array
>> * will always have the same atom order (ascending indices).
>> *
>> *  \param ga2la[in]         Global to local atom index conversion data.
>> *  \param md[in]            Pointer to runtime atom data.
>> *  \param nr[in]            The total number of atoms that the group contains.
>> *  \param anrs[in]          The global atom number of the group's atoms.
>> *  \param nr_loc[out]       The number of group atoms present on the local node.
>> *  \param anrs_loc[out]     The local atom numbers of the group.
>> *  \param nalloc_loc[inout] Local allocation size of anrs_loc array.
>> *  \param coll_ind[opt]     If not NULL this array must be of size nr. It stores
>> *                           for each local atom where it belongs in the global
>> *                           (collective) array such that it can be gmx_summed
>> *                           in the communicate_group_positions routine.
>> */
>> extern void dd_make_local_group_indices(gmx_ga2la_t ga2la, t_mdatoms *md,
>>                                         const int nr, int anrs[], int *nr_loc,
>>                                         int *anrs_loc[], int *nalloc_loc,
>>                                         int coll_ind[]);
>>
>>
>> /*! \brief Assemble local positions into a collective array present on all nodes.
>>  *
>>  * Communicate the positions of the group's atoms such that every node has all of
>>  * them. Unless running on huge number of cores, this is not a big performance impact
>>  * as long as the collective subset [0..nr] is kept small. The atom indices are
>>  * retrieved from anrs_loc[0..nr_loc]. If you call the routine for the serial case,
>>  * provide an array coll_ind[i] = i for i in 1..nr.
>>  *
>>  * \param cr[in]             Pointer to MPI communication data.
>>  * \param xcoll[out]         Collective array of positions, idential on all nodes
>>  *                           after this routine has been called.
>>  * \param shifts[inout]      Collective array of shifts for xcoll, needed to make
>>  *                           the group whole. This array remembers the shifts
>>  *                           since the start of the simulation (where the group
>>  *                           is whole) and must therefore not be changed outside
>>  *                           of this routine!
>>  * \param extra_shifts[buf]  Extra shifts since last time step, only needed as
>>  *                           buffer variable [0..nr].
>>  * \param bNS[in]            Neighborsearching/domain redecomposition has been
>>  *                           performed at the begin of this time step such that
>>  *                           the shifts have changed and need to be updated.
>>  * \param x_loc[in]          Pointer to the local atom positions this node has.
>>  * \param nr[in]             Total number of atoms in the group.
>>  * \param nr_loc[in]         Number of group atoms on the local node.
>>  * \param anrs_loc[in]       Array of the local atom indices.
>>  * \param coll_ind[in]       This array of size nr stores for each local atom where
>>  *                           it belongs in the collective array so that the local
>>  *                           contributions can be gmx_summed. It is provided by
>>  *                           dd_make_local_group_indices.
>>  * \param xcoll_old[inout]   Positions from the last time step, used to make the
>>  *                           group whole.
>>  * \param box[in]            Simulation box matrix, needed to shift xcoll such that
>>  *                           the group becomes whole.
>>  */
>> extern void communicate_group_positions(t_commrec *cr, rvec *xcoll, ivec *shifts,
>>                                         ivec *extra_shifts, const bool bNS,
>>                                         rvec *x_loc, const int nr, const int nr_loc,
>>                                         int *anrs_loc, int *coll_ind, rvec *xcoll_old,
>>                                         matrix box);
>>
>>
>> /*! \brief Calculates the center of the positions x locally.
>>  *
>>  * Calculates the center of mass (if masses are given in the weight array) or
>>  * the geometrical center (if NULL is passed as weight).
>>  *
>>  * \param x[in]              Positions.
>>  * \param weight[in]         Can be NULL or an array of weights. If masses are
>>  *                           given as weights, the COM is calculated.
>>  * \param nr[in]             Number of positions and weights if present.
>>  * \param center[out]        The (weighted) center of the positions.
>>  *
>>  */
>> extern void get_center(rvec x[], real weight[], const int nr, rvec center);
>>
>>
>> /*! \brief Calculates the sum of the positions x locally.
>>  *
>>  * Calculates the (weighted) sum of position vectors and returns the sum of
>>  * weights, which is needed when local contributions shall be summed to a
>>  * global weighted center.
>>  *
>>  * \param x[in]              Array of positions.
>>  * \param weight[in]         Can be NULL or an array of weights.
>>  * \param nr[in]             Number of positions and weights if present.
>>  * \param dsumvec[out]       The (weighted) sum of the positions.
>>  * \return Sum of weights.
>>  *
>>  */
>> extern double get_sum_of_positions(rvec x[], real weight[], const int nr, dvec dsumvec);
>>
>>
>> /*! \brief Calculates the global center of all local arrays x.
>>  *
>>  * Get the center from local positions [0..nr_loc], this involves communication.
>>  * Not that the positions must already have the correct PBC representation. Use
>>  * this routine if no collective coordinates are assembled from which the center
>>  * could be calculated without communication.
>>  *
>>  * \param cr[in]             Pointer to MPI communication data.
>>  * \param x_loc[in]          Array of local positions [0..nr_loc].
>>  * \param weight_loc[in]     Array of local weights, these are the masses if the
>>  *                           center of mass is to be calculated.
>>  * \param nr_loc[in]         The number of positions on the local node.
>>  * \param nr_group[in]       The number of positions in the whole group. Since
>>  *                           this is known anyway, we do not need to communicate
>>  *                           and sum nr_loc if we pass it over.
>>  * \param center[out]        The (weighted) center of all x_loc from all the
>>  *                           nodes.
>>  */
>> extern void get_center_comm(t_commrec *cr, rvec x_loc[], real weight_loc[],
>>                             int nr_loc, int nr_group, rvec center);
>>
>>
>> /*! \brief Translate positions.
>>  *
>>  * Add a translation vector to the positions x.
>>  *
>>  * \param x[inout]           Array of positions.
>>  * \param nr[in]             Number of entries in the position array.
>>  * \param transvec[in]       Translation vector to be added to all positions.
>>  *
>>  */
>> extern void translate_x(rvec x[], const int nr, const rvec transvec);
>>
>>
>> /*! \brief Rotate positions.
>>  *
>>  * Rotate the positions with the rotation matrix.
>>  *
>>  * \param x[inout]           Array of positions.
>>  * \param nr[in]             Number of entries in the position array.
>>  * \param rmat[in]           Rotation matrix to operate on all positions.
>>  *
>>  */
>> extern void rotate_x(rvec x[], int nr, matrix rmat);
>>
>>
>>
>>
>
> --
> gmx-developers mailing list
> gmx-developers at gromacs.org
> http://lists.gromacs.org/mailman/listinfo/gmx-developers
> Please don't post (un)subscribe requests to the list. Use the
> www interface or send it to gmx-developers-request at gromacs.org.
>



-- 
Tsjerk A. Wassenaar, Ph.D.

Computational Chemist
Medicinal Chemist
Neuropharmacologist



More information about the gromacs.org_gmx-developers mailing list