UFS-dev PR#226

[grantfirl]

This is only a ccpp-physics submodule update for NCAR/ccpp-physics#1097

RT baseline changes are consistent with changes to ccpp physics changes.

[grantfirl]

RT results:

Output for arm_sgp_summer_1997_A_SCM_GFS_v17_p8_ugwpv1 is IDENTICAL to baseline
Output for arm_sgp_summer_1997_A_SCM_GFS_v16_RRTMGP is IDENTICAL to baseline
Output for arm_sgp_summer_1997_A_SCM_GFS_v16 is IDENTICAL to baseline
Output for arm_sgp_summer_1997_A_SCM_WoFS_v0 DIFFERS from baseline.
Output for arm_sgp_summer_1997_A_SCM_HRRR_gf DIFFERS from baseline.
Output for twpice_SCM_GFS_v17_p8_ugwpv1 is IDENTICAL to baseline
Output for twpice_SCM_GFS_v16_RRTMGP is IDENTICAL to baseline
Output for twpice_SCM_GFS_v16 is IDENTICAL to baseline
Output for twpice_SCM_WoFS_v0 DIFFERS from baseline.
Output for twpice_SCM_HRRR_gf DIFFERS from baseline.
Output for bomex_SCM_GFS_v17_p8_ugwpv1 is IDENTICAL to baseline
Output for bomex_SCM_GFS_v16_RRTMGP is IDENTICAL to baseline
Output for bomex_SCM_GFS_v16 is IDENTICAL to baseline
Output for bomex_SCM_WoFS_v0 is IDENTICAL to baseline
Output for bomex_SCM_HRRR_gf DIFFERS from baseline.
Output for astex_SCM_GFS_v17_p8_ugwpv1 is IDENTICAL to baseline
Output for astex_SCM_GFS_v16_RRTMGP is IDENTICAL to baseline
Output for astex_SCM_GFS_v16 is IDENTICAL to baseline
Output for astex_SCM_WoFS_v0 is IDENTICAL to baseline
Output for astex_SCM_HRRR_gf is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_GFS_v17_p8_ugwpv1 is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_GFS_v16_RRTMGP is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_GFS_v16 is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_WoFS_v0 is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_HRRR_gf is IDENTICAL to baseline
Output for COMBLE_SCM_GFS_v17_p8_ugwpv1 is IDENTICAL to baseline
Output for COMBLE_SCM_GFS_v16_RRTMGP is IDENTICAL to baseline
Output for COMBLE_SCM_GFS_v16 is IDENTICAL to baseline
Output for COMBLE_SCM_WoFS_v0 DIFFERS from baseline.
Output for COMBLE_SCM_HRRR_gf DIFFERS from baseline.
Output for MOSAiC-AMPS_SCM_GFS_v17_p8_ugwpv1 is IDENTICAL to baseline
Output for MOSAiC-AMPS_SCM_GFS_v16_RRTMGP is IDENTICAL to baseline
Output for MOSAiC-AMPS_SCM_GFS_v16 is IDENTICAL to baseline
Output for MOSAiC-AMPS_SCM_WoFS_v0 DIFFERS from baseline.
Output for MOSAiC-AMPS_SCM_HRRR_gf is IDENTICAL to baseline
Output for gabls3_SCM_GFS_v16 is IDENTICAL to baseline
Output for arm_sgp_summer_1997_A_SCM_GFS_v17_p8 is IDENTICAL to baseline
Output for arm_sgp_summer_1997_A_SCM_HRRR DIFFERS from baseline.
Output for arm_sgp_summer_1997_A_SCM_RRFS_v1beta DIFFERS from baseline.
Output for arm_sgp_summer_1997_A_SCM_RAP DIFFERS from baseline.
Output for arm_sgp_summer_1997_A_SCM_GFS_v15p2 is IDENTICAL to baseline
Output for twpice_SCM_GFS_v17_p8 is IDENTICAL to baseline
Output for twpice_SCM_HRRR DIFFERS from baseline.
Output for twpice_SCM_RRFS_v1beta DIFFERS from baseline.
Output for twpice_SCM_RAP DIFFERS from baseline.
Output for twpice_SCM_GFS_v15p2 is IDENTICAL to baseline
Output for bomex_SCM_GFS_v17_p8 is IDENTICAL to baseline
Output for bomex_SCM_HRRR is IDENTICAL to baseline
Output for bomex_SCM_RRFS_v1beta is IDENTICAL to baseline
Output for bomex_SCM_RAP DIFFERS from baseline.
Output for bomex_SCM_GFS_v15p2 is IDENTICAL to baseline
Output for bomex_SCM_GFS_v16_debug is IDENTICAL to baseline
Output for astex_SCM_GFS_v17_p8 is IDENTICAL to baseline
Output for astex_SCM_HRRR is IDENTICAL to baseline
Output for astex_SCM_RRFS_v1beta is IDENTICAL to baseline
Output for astex_SCM_RAP is IDENTICAL to baseline
Output for astex_SCM_GFS_v15p2 is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_GFS_v17_p8 is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_HRRR is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_RRFS_v1beta is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_RAP is IDENTICAL to baseline
Output for LASSO_2016051812_SCM_GFS_v15p2 is IDENTICAL to baseline
ALL TESTS PASSED, BUT OUTPUT DIFFERS FROM BASELINE.

[dustinswales]

@grantfirl @scrasmussen @mkavulich It seems that the CI tests are now failing when the baseline comparison fails, and consequentially not creating new github artifacts that need to be used to get the tests passing again?
The CI tests shouldn't fail when baselines disagree?

Update What is this? https://github.com/NCAR/ccpp-scm/actions/runs/11411899398/job/31756974040?pr=533#step:24:1664

[grantfirl]

@grantfirl @scrasmussen @mkavulich It seems that the CI tests are now failing when the baseline comparison fails, and consequentially not creating new github artifacts that need to be used to get the tests passing again? The CI tests shouldn't fail when baselines disagree?

Update What is this? https://github.com/NCAR/ccpp-scm/actions/runs/11411899398/job/31756974040?pr=533#step:24:1664

I added a new test that runs schemes in the GFS_debug file for Dom. Let's concentrate on PRs in order and debug this when we get to it.

[mkavulich]

@dustinswales I don't think that's what's keeping the artifacts from being created, I think it's the new failing "GFS_debug" test. You can see that the single-precision artifacts were created. I do see the same message you do ('No artifacts will be uploaded.'). I honestly don't know what that's about, because they clearly are being uploaded. You can see the same message for all tests in the last PR here: https://github.com/NCAR/ccpp-scm/actions/runs/11446706947

[dustinswales]

@mkavulich Yeah, I didn't realize there was a new test being added in an earlier PR.
The artifact isn't being created because the RTs disagree with the baseline, but rather they are failing because the baseline does not exist.

[grantfirl]

@dustinswales @scrasmussen @mkavulich This is ready to review. Several RTs that use GF convection and MYNN PBL change results. Therefore, we'll need to upload the artifacts from this.