Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add configuration file for Graham (#169) #172

Open
wants to merge 36 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
bd86e21
Added test for slurm integration
aalitaiga Jul 31, 2017
1168e3e
New test for priority
aalitaiga Aug 8, 2017
243b191
Added gres + memory tests
aalitaiga Aug 8, 2017
0a16243
Refactored tests
aalitaiga Aug 9, 2017
6f31489
small update
aalitaiga Aug 10, 2017
3b0dd0b
Python3 compatibility + PR comments
aalitaiga Sep 1, 2017
e8e6ec0
Fixed naccelerators issue
aalitaiga Sep 1, 2017
04f0ff1
Updated tests to skip on Graham and Cedar smartdispatch modified to h…
aalitaiga Sep 19, 2017
d7d0300
Cleaned code with PR feedback
aalitaiga Sep 26, 2017
c7bb250
Updated tests
aalitaiga Oct 6, 2017
a20405b
Updated tests using mock
aalitaiga Oct 10, 2017
5bde1c6
Refactor detect_cluster tests
bouthilx Oct 10, 2017
0ff4776
Small changes in TestSlurmQueue
aalitaiga Oct 10, 2017
d1ad338
Fix add_sbatch_option bug
bouthilx Oct 13, 2017
899167f
Refactor SlurmJobGenerator
bouthilx Oct 13, 2017
581f835
Remove queue name for Slurm clusters
bouthilx Oct 13, 2017
1d74e1a
Replace PBS_JOBID with SLURM_JOB_ID
bouthilx Oct 13, 2017
f00e877
Add PBS_FILENAME definition to pbs.prolog
bouthilx Oct 14, 2017
6b2d530
Fix env var export option for Slurm
bouthilx Oct 14, 2017
21df3dd
Adapt PBS_WALLTIME for slurm
bouthilx Oct 14, 2017
ea1d5b3
Add sbatch to command-line launcher options
bouthilx Oct 14, 2017
adb8cba
Make get_launcher more flexible
bouthilx Oct 14, 2017
f3661ba
Add verbosity to smart-dispatch
bouthilx Oct 14, 2017
972a1ab
Updated documentation for slurm clusters
aalitaiga Oct 15, 2017
29973b0
Add support for SlurmJobGenerator
bouthilx Oct 16, 2017
f734fb3
Print stderr when both qsub and sacctmgr fails
bouthilx Oct 16, 2017
4506887
Add automatic script for cluster verification
bouthilx Oct 16, 2017
02845e0
Add verification script for cedar
bouthilx Oct 16, 2017
2d6e6fd
Add verification script for graham
bouthilx Oct 16, 2017
f967180
Add verification script for mila
bouthilx Oct 16, 2017
8c655b4
Make get_launcher return None when no launcher
bouthilx Oct 16, 2017
998f3ba
Updated README
aalitaiga Oct 16, 2017
a3c08c8
Set properly account in verify_graham
bouthilx Oct 16, 2017
9fb5ab6
Set properly account in verify_cedar
bouthilx Oct 16, 2017
1dea0d8
Fix walltime_to_seconds convertion
bouthilx Oct 17, 2017
cac2f08
Add configuration file for Graham
bouthilx Oct 16, 2017
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Set properly account in verify_cedar
The tests were failing because the account was not specified
bouthilx committed Oct 16, 2017
commit 9fb5ab66a7c4ff6c3df067b92ff00d4f8b27fcac
19 changes: 12 additions & 7 deletions smartdispatch/tests/verify_cedar.py
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
import os
import sys

from verify_slurm_cluster import VerifySlurmCluster, set_defaults
@@ -11,13 +12,17 @@ class VerifyCedarCluster(VerifySlurmCluster):

def get_arguments(self, **kwargs):

set_defaults(
kwargs,
coresPerCommand=1,
gpusPerCommand=0,
walltime=self.WALLTIME,
coresPerNode=self.CORES_PER_NODE,
gpusPerNode=self.GPUS_PER_NODE)
kwargs = super(VerifyCedarCluster, self).get_arguments(**kwargs)

if kwargs["gpusPerCommand"] == 0:
account = os.environ.get("CPU_SLURM_ACCOUNT")
else:
account = os.environ.get("GPU_SLURM_ACCOUNT")

if "sbatchFlags" not in kwargs or len(kwargs["sbatchFlags"]) == 0:
kwargs["sbatchFlags"] = "--account=" + account
else:
kwargs["sbatchFlags"] += " --account=" + account

return kwargs