Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add MESMER-M integration tests #501

Conversation

veni-vidi-vici-dormivi
Copy link
Collaborator

@veni-vidi-vici-dormivi veni-vidi-vici-dormivi commented Aug 20, 2024

  • Tests added
  • Fully documented, including CHANGELOG.rst

@mathause
Copy link
Member

Thanks - can you save the coeffs as netCDF and not pickle (I know it's a bit more annoying but we want to move away from pickle)

@mathause
Copy link
Member

mathause commented Aug 23, 2024

I haven't looked into it so not sure what is going on but a bit strange that none of the environments get it right. I thought this does not have to be high priority but then it would be good to stabilize the numerics for memser-m. What helped for the covariance thingy was testing the code on cfc vs exo, which have different cpus with different sets of SIMD instructions. But I am not really working today - if I find time I'll take a look tomorrow or else after our retreat...

@veni-vidi-vici-dormivi
Copy link
Collaborator Author

good way to avoid pulling 😆

@veni-vidi-vici-dormivi
Copy link
Collaborator Author

🥲

@mathause
Copy link
Member

mathause commented Dec 2, 2024

I think I should have adjusted rtol 🤦‍♂️

@mathause
Copy link
Member

mathause commented Dec 2, 2024

😅

Copy link
Member

@mathause mathause left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok I think we can finally finish this - thanks for all your work!

mesmer/stats/_power_transformer.py Outdated Show resolved Hide resolved
@veni-vidi-vici-dormivi veni-vidi-vici-dormivi merged commit 8f75b2e into MESMER-group:main Dec 3, 2024
11 checks passed
@veni-vidi-vici-dormivi veni-vidi-vici-dormivi deleted the m_integrationtests branch December 3, 2024 16:14
veni-vidi-vici-dormivi added a commit to veni-vidi-vici-dormivi/mesmer that referenced this pull request Dec 12, 2024
* add mesmer_m calibration test

* add time to calibration results

* update calibrate test

* add test for drawing

* update emulations

* sneakily add nits to other tests

* switch do allclose for drawing

* switch to allclose for calibrating

* nit in example

* save params as netcdf

* relax tol

* test all params individually

* test_calibrate_mesmer_m: mark slow

* test_calibrate_mesmer_m: less localisation radii

* extract data loading function

* speed up by avoiding open_mfdataset

* upper bound to lambda in pt

* regenerate params

* hm_coeffs: tighten atol & rtol

* comment on upper bound

* change order of yearly, monthly inputs for consistency

* adjust example

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Victoria Bauer <[email protected]>
Co-authored-by: Mathias Hauser <[email protected]>
Co-authored-by: Mathias Hauser <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants