Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pass splitbank tags to inspiral jobs #4457

Conversation

GarethCabournDavies
Copy link
Contributor

So that we can vary inspiral settings over different parts of the bank, we would like to use splitbank tags in the inspiral jobs and do this via config, in the config files, this would look something like:

[inspiral-bank0]
cluster-window = 0.5

[inspiral-bank1]
cluster-window = 1

@@ -251,6 +251,9 @@ def sngl_ifo_job_setup(workflow, ifo, out_files, curr_exe_job, science_segs,
for pnum, parent in enumerate(sorted_parents):
if len(curr_parent) != 1:
tag = ["JOB%d" %(pnum,)]
bank_tag = [t for t in parent.tags if 'bank' in t]
# add splitbank tags into the current executable
curr_exe_job.update_current_tags(bank_tag)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If curr_exe_job has any tags other than a bank_tag, I think this would remove them. Need a little bit more to pass existing tags through.

This would also have a JOBX tag (used only in the output file) and the BANKX tag. So we'd have files called INSPIRAL_BANK1_JOB1. (but BANK and JOB are always the same number). Don't think we need both here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BANK and JOB are not always the same - JOB numbers are set according to a sort on the tag string a few lines above, meaning that e.g. BANK11 would be JOB4, which will come before BANK2 (which would be JOB13)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think my objection still holds though if this is a one-to-one mapping. If BANK2 is always JOB13, then we don't need the JOB13 tag at all(?)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point - I will remove the JOB tags then (for some reason that possibility didn't register with me!)

@GarethCabournDavies
Copy link
Contributor Author

I checked the -main.dax file, and can confirm that adding the tags does not add extra versions of the executable

There are versions for each detector, FULL_DATA and each injection type, but not additional ones for each bank

pycbc/workflow/jobsetup.py Outdated Show resolved Hide resolved
@GarethCabournDavies GarethCabournDavies enabled auto-merge (squash) August 14, 2023 13:09
@GarethCabournDavies GarethCabournDavies merged commit 9c438dc into gwastro:master Aug 14, 2023
36 checks passed
@GarethCabournDavies GarethCabournDavies deleted the pass_splitbank_tag_to_inspiral branch October 16, 2023 09:01
PRAVEEN-mnl pushed a commit to PRAVEEN-mnl/pycbc that referenced this pull request Nov 3, 2023
* pass splitbank tags to inspiral jobs

* remove JOB tags, dont overwrite existing tags

* Update pycbc/workflow/jobsetup.py

* Update pycbc/workflow/jobsetup.py
bhooshan-gadre pushed a commit to bhooshan-gadre/pycbc that referenced this pull request Mar 4, 2024
* pass splitbank tags to inspiral jobs

* remove JOB tags, dont overwrite existing tags

* Update pycbc/workflow/jobsetup.py

* Update pycbc/workflow/jobsetup.py
acorreia61201 pushed a commit to acorreia61201/pycbc that referenced this pull request Apr 4, 2024
* pass splitbank tags to inspiral jobs

* remove JOB tags, dont overwrite existing tags

* Update pycbc/workflow/jobsetup.py

* Update pycbc/workflow/jobsetup.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants