Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add mock catalog type requiring no calibration, and add example pipeline #361

Merged
merged 19 commits into from
Nov 8, 2024

Conversation

joezuntz
Copy link
Collaborator

Addresses issue #360

Still looking at the ingestion part.

@joezuntz joezuntz marked this pull request as ready for review July 16, 2024 12:33
@ts485
Copy link
Collaborator

ts485 commented Jul 18, 2024

Hi Joe,

We also need an output "source_photoz_pdfs" (which is originally generated from the stage "BPZ_lite") to run the stage "CLClusterShearCatlog". Can either create one more stage or add the functionality to "TXSourceSelectorSimple" to generate "source_photoz_pdfs"?

I attached the flowchart of CL pipeline and the mock pipeline.

Best,
Tomomi
mock_pipeline

CL_pipeline

@joezuntz
Copy link
Collaborator Author

I will add the BPZ stages to the pipeline, I think it should work fine.

@joezuntz
Copy link
Collaborator Author

For speed, and to avoid difficult questions about photo-z for the source sample (which may have only r, i ,z), I have added a quick stage to generate fake source_photoz_pdfs using the true redshifts. I've added it to the pipeline file.

I've also added a call to the CLClusterShearCatalogs stage. To use that as-is you will need to download and extract the latest version of the example.tar.gz inputs file. See the README for the URL.

@ts485
Copy link
Collaborator

ts485 commented Jul 19, 2024

I ran the pipeline and it generated the files properly. I have not checked output files yet, but it seems working fine.

@ts485
Copy link
Collaborator

ts485 commented Jul 23, 2024

@joezuntz Hi Joe, I realized that now I can use the latest version of CLMM in TXPipe at NERSC, but now I cannot run the stage "CLClusterShearCatalogs". Have you checked whether the pipeline works fine?

@ts485
Copy link
Collaborator

ts485 commented Jul 23, 2024

P.S. I could run the pipeline till the end by using tx-10 instead of tx

@joezuntz joezuntz merged commit d0fd186 into master Nov 8, 2024
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants