NERSC Franklin System

We recommend using MPI-Progress Ranks (PR) port in GA for compilation and evaluation on NERSC Cori KNL system.

Compiling GA

cd ga
mkdir build
cd build
../configure --with-mpi-pr --prefix=$PWD && make -j 4 && make install 

Suggested Performance Optimizations

Establish connections statically

export MPICH_GNI_DYNAMIC_CONN=disabled

Increase eager threshold size for better performance of strided communication

export MPICH_GNI_MAX_EAGER_MSG_SIZE=131072