Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

uondrs_ada config file : WIP #715

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,7 @@ jobs:
strategy:
matrix:
profile:
- "uondrs_ada"
- "abims"
- "adcra"
- "alice"
Expand Down
3 changes: 3 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -296,6 +296,9 @@ Currently documentation is available for the following pipeline:

- viralrecon
- [genomes](docs/pipeline/viralrecon/genomes.md)

- rnaseq
- [uondrs_ada](docs/pipeline/rnaseq/uondrs_ada.md)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This path doesn't seem to exist?


### Enabling pipeline-specific configs within a pipeline

Expand Down
55 changes: 55 additions & 0 deletions conf/uondrs_ada.config
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
//Profile config names for nf-core/configs

params {
// Config Params
config_profile_description = 'University of Nottingham DRS - HPC Profile -- provided by nf-core/configs.'
config_profile_contact = 'Niraj Shah (@ShahNiraj)'
config_profile_url = 'https://forms.office.com/Pages/ResponsePage.aspx?id=7qe9Z4D970GskTWEGCkKHpYhN2mnMuNPm5Y3GQx5rlxUMzJQTDE0OUVSNUtHT0UyU0o2UTRCQzNaQSQlQCN0PWcu'

}

// definition of the slurm executor. Run the pipeline in a node able to submit jobs to a HPC via sbatch
singularity {
enabled = true
autoMounts = true
// Some processes don't respect the TMP environment variables: https://github.com/nf-core/rnaseq/issues/115
}

process {
// Global process config
executor = 'slurm'
queueSize = 10
queue = 'defq'
submitRateLimit = '10/2min'
}

process {

// resources for default process execution
withLabel:process_low {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This list of process labels isn't exhaustive I think. Do you need to define them? Normally we've been recommending setting max resources in params (https://nf-co.re/docs/usage/getting_started/configuration#max-resources).

Nextflow has changed for the better since but that haven't yet reached everywhere, so I still think that's a good idea.

cpus = 2
memory = 12.GB
time = 6.h
}
withLabel:process_medium {
cpus = 6
memory = 36.GB
time = 6.h
}
withLabel:process_high {
cpus = 12
memory = 240.GB
time = 6.h
}
withLabel:process_long {
time = 20.h
}
withLabel:error_ignore {
errorStrategy = 'ignore'
}
withLabel:error_retry {
errorStrategy = 'retry'
maxRetries = 2
}
// resources for execution of processes / modules with the label "two cpus". This override the default ones.
}
29 changes: 29 additions & 0 deletions docs/uondrs_ada.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
# nf-core/configs: Ada HPC Configuration

nfcore pipeline rnaseq have been tested on the Ada HPC.

## Before running the pipeline

- You will need an account to use the Ada HPC cluster in order to run the pipeline.
- Make sure that Singularity and Nextflow are installed.
- Downlode pipeline singularity images to a HPC system using [nf-core tools](https://nf-co.re/tools/#downloading-pipelines-for-offline-use)

```
$ conda install nf-core
$ nf-core download
```




## Running the pipeline using the adcra config profile

- Run the pipeline within a [screen](https://linuxize.com/post/how-to-use-linux-screen/) or [tmux](https://linuxize.com/post/getting-started-with-tmux/) session.
- Specify the config profile with `-profile uondrs_ada`.

```
nextflow run /path/to/nf-core/rnaseq -profile uondrs_ada \
--genome GRCh38 \
--igenomes_base /path/to/genome_references/ \
... # the rest of pipeline flags
```
1 change: 1 addition & 0 deletions nfcore_custom.config
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@

//Please use a new line per include Config section to allow easier linting/parsing. Thank you.
profiles {
uondrs_ada { includeConfig "${params.custom_config_base}/conf/uondrs_ada.config" }
abims { includeConfig "${params.custom_config_base}/conf/abims.config" }
adcra { includeConfig "${params.custom_config_base}/conf/adcra.config" }
alice { includeConfig "${params.custom_config_base}/conf/alice.config" }
Expand Down
Loading