Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add hic minimap2 #44

Merged
merged 23 commits into from
Jul 16, 2024
Merged

add hic minimap2 #44

merged 23 commits into from
Jul 16, 2024

Conversation

yumisims
Copy link
Contributor

PR checklist

  • This comment contains a description of changes (with reason).
  • If you've fixed a bug or added code that should be tested, add tests!
  • If you've added a new tool - have you followed the pipeline conventions in the contribution docs
  • Make sure your code lints (nf-core lint).
  • Ensure the test suite passes (nextflow run . -profile test,docker --outdir <OUTDIR>).
  • Usage Documentation in docs/usage.md is updated.
  • Output Documentation in docs/output.md is updated.
  • CHANGELOG.md is updated.
  • README.md is updated (including new tool citations and authors/contributors).

Copy link

github-actions bot commented May 17, 2024

nf-core lint overall result: Passed ✅ ⚠️

Posted for pipeline commit a6edc93

+| ✅ 130 tests passed       |+
#| ❔  19 tests were ignored |#
!| ❗   3 tests had warnings |!

❗ Test warnings:

  • files_exist - File not found: conf/igenomes.config
  • pipeline_todos - TODO string in base.config: Check the defaults for all processes
  • pipeline_todos - TODO string in base.config: Customise requirements for specific processes.

❔ Tests ignored:

  • files_exist - File is ignored: assets/nf-core-genomeassembly_logo_light.png
  • files_exist - File is ignored: docs/images/nf-core-genomeassembly_logo_light.png
  • files_exist - File is ignored: docs/images/nf-core-genomeassembly_logo_dark.png
  • files_exist - File is ignored: .github/ISSUE_TEMPLATE/config.yml
  • files_exist - File is ignored: .github/workflows/awstest.yml
  • files_exist - File is ignored: .github/workflows/awsfulltest.yml
  • nextflow_config - Config variable ignored: manifest.name
  • nextflow_config - Config variable ignored: manifest.homePage
  • files_unchanged - File ignored due to lint config: LICENSE or LICENSE.md or LICENCE or LICENCE.md
  • files_unchanged - File ignored due to lint config: .github/CONTRIBUTING.md
  • files_unchanged - File ignored due to lint config: .github/ISSUE_TEMPLATE/bug_report.yml
  • files_unchanged - File ignored due to lint config: .github/workflows/linting.yml
  • files_unchanged - File ignored due to lint config: assets/sendmail_template.txt
  • files_unchanged - File does not exist: assets/nf-core-genomeassembly_logo_light.png
  • files_unchanged - File does not exist: docs/images/nf-core-genomeassembly_logo_light.png
  • files_unchanged - File does not exist: docs/images/nf-core-genomeassembly_logo_dark.png
  • files_unchanged - File ignored due to lint config: lib/NfcoreTemplate.groovy
  • files_unchanged - File ignored due to lint config: .gitignore or .prettierignore or pyproject.toml
  • actions_awstest - 'awstest.yml' workflow not found: /home/runner/work/genomeassembly/genomeassembly/.github/workflows/awstest.yml

✅ Tests passed:

Run details

  • nf-core/tools version 2.8
  • Run at 2024-07-12 15:28:36

GENOMESCOPE_MODEL( hifi_reads_ch )
ch_versions = ch_versions.mix(GENOMESCOPE_MODEL.out.versions)
/*GENOMESCOPE_MODEL( hifi_reads_ch )
ch_versions = ch_versions.mix(GENOMESCOPE_MODEL.out.versions)*/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was it commented out with the purpose of debugging and does it need uncommenting?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, that was the purpose :) I will remove them now.

@@ -312,24 +312,27 @@ workflow GENOMEASSEMBLY {
GENOMESCOPE_MODEL.out.hist,
GENOMESCOPE_MODEL.out.ktab
)
}
}*/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was it commented out with the purpose of debugging and does it need uncommenting?

@@ -347,7 +350,7 @@ workflow GENOMEASSEMBLY {
PREPARE_INPUT.out.busco,
GENOMESCOPE_MODEL.out.hist,
GENOMESCOPE_MODEL.out.ktab
)
)*/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was it commented out with the purpose of debugging and does it need uncommenting?

@ksenia-krasheninnikova
Copy link
Contributor

@yumisims Was this version of the pipeline tested on a big dataset with hic_aligner: minimap2 ?

@yumisims
Copy link
Contributor Author

@ksenia-krasheninnikova not necessary to test on a bigger genome. I encountered an image downloading problem, have you seen this before?

@ksenia-krasheninnikova
Copy link
Contributor

@yumisims what image exactly threw the error? Can't see it in the current CI run.

As I understand the purpose of adding minimap2 option is to be able to run the pipeline on big genomes.

@@ -38,6 +38,9 @@ jobs:
- name: Check out pipeline code
uses: actions/checkout@v3

- name: Setup apptainer
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This step is already in this CI, duplicated.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok

@yumisims
Copy link
Contributor Author

@muffato do you know the reason why Container library: 'quay.io' is not valid? thanks

@muffato
Copy link
Member

muffato commented May 29, 2024

@yumisims : there was a problem on the dev in the first place. The python containers were not properly defined. d72047a shows how it should be done (and no need to edit the nf-core download command)

container "${ workflow.containerEngine == 'singularity' && !task.ext.singularity_pull_docker_container ?
'https://depot.galaxyproject.org/singularity/python:3' :
'docker.io/python:3.9' }"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This container definition worked for nextflow run, probably not for nf-core download?

I tried to run the test on dev branch yesterday again without problems.
https://github.com/sanger-tol/genomeassembly/actions/runs/8988294821

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can't see any difference with the Treeval CI and container definition.
On the farm, nf-core download works for me.

Or maybe a version incompatibility ? (e.g. different version of nf-core or apptainer/singularity or docker)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That is what we discussed yesterday in the pipeline meeting.
Obviously -l flag didn't help. Now we can try to fix the nf-core version as the one on local.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oki. I'll let you try that

@yumisims
Copy link
Contributor Author

yumisims commented May 29, 2024 via email

@ksenia-krasheninnikova ksenia-krasheninnikova merged commit 5869d2a into dev Jul 16, 2024
6 checks passed
@muffato muffato deleted the hic_minimap2 branch August 15, 2024 23:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants