Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option to run builds on compute nodes #3180

Closed
Closed
Show file tree
Hide file tree
Changes from 38 commits
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
1c5b14b
allow building multiple ufs_model.x for gfs, gefs and sfs
aerorahul Nov 14, 2024
98f26a8
use SFS_POST as a proxy for SFS
aerorahul Nov 14, 2024
041e7e1
link/copy the appropriate model executable
aerorahul Nov 14, 2024
e886c38
Merge branch 'develop' into feature/multi_model_build
aerorahul Nov 25, 2024
e536a3a
create gfs/gefs versions of ww3 pre/post execs
aerorahul Dec 4, 2024
2a9f12b
Merge branch 'develop' into feature/multi_model_build
aerorahul Dec 4, 2024
b8eb15d
use NET specific executable names
aerorahul Dec 5, 2024
f0bf57c
fix errors detected by shellnorms
aerorahul Dec 5, 2024
3bd366a
one shellnorm error escaped
aerorahul Dec 5, 2024
b102c07
one shellnorm error escaped
aerorahul Dec 5, 2024
c26da40
Merge branch 'develop' into feature/multi_model_build
aerorahul Dec 5, 2024
8bee97c
minor fixes for typos and such
aerorahul Dec 5, 2024
612ef35
update Jenkinsfile to build in a single location and use it
aerorahul Dec 6, 2024
080186a
remove build matrix from Jenkinsfile
aerorahul Dec 6, 2024
f8e3d6a
fix shellnorm found issue
aerorahul Dec 6, 2024
fc41b6d
fix shellnorm found issue by disabling it
aerorahul Dec 6, 2024
c61ff88
fix not changed shellcheck detected error
aerorahul Dec 6, 2024
200d6bd
add comment back in ww3prepost build script
aerorahul Dec 6, 2024
37d1fb9
Update ush/wave_grid_interp_sbs.sh
aerorahul Dec 9, 2024
ab66442
Update sorc/link_workflow.sh
aerorahul Dec 10, 2024
dae774a
Update ush/wave_grid_interp_sbs.sh
aerorahul Dec 10, 2024
1d47c9e
Update ush/wave_prnc_cur.sh
aerorahul Dec 10, 2024
b136b8a
Update ush/wave_prnc_ice.sh
aerorahul Dec 10, 2024
ebf6176
Update scripts/exgfs_wave_post_pnt.sh
aerorahul Dec 10, 2024
93ad4bf
Update ush/wave_outp_spec.sh
aerorahul Dec 10, 2024
ea41c19
Merge branch 'develop' into feature/multi_model_build
aerorahul Dec 10, 2024
b5ede8b
capture stdout/stderr from Jenkinsbuild for gefs variants. Also, was…
aerorahul Dec 11, 2024
4531678
Update sorc/link_workflow.sh
aerorahul Dec 11, 2024
842e717
Update sorc/build_ufs.sh
aerorahul Dec 11, 2024
c1e01f8
Update sorc/link_workflow.sh
aerorahul Dec 11, 2024
d3e76a6
Update sorc/link_workflow.sh
aerorahul Dec 11, 2024
be0ca2c
since using single build location, GEFS wcoss testing can be enabled
aerorahul Dec 11, 2024
c37409d
update Jenkinsfile to try to do scm checkout if it fails the first time;
aerorahul Dec 11, 2024
5079448
undo the fix and reintroduce the incorrect logic. Fixing the bug ope…
aerorahul Dec 12, 2024
41f20a4
Simplify build_all.sh
DavidHuber-NOAA Dec 13, 2024
30698b8
Initial WIP stab at compute builds
DavidHuber-NOAA Dec 19, 2024
fd29a75
Merge develop
DavidHuber-NOAA Dec 19, 2024
3bdbbd8
Address shellcheck issues
DavidHuber-NOAA Dec 19, 2024
919bd40
Double quote variables
DavidHuber-NOAA Dec 19, 2024
af37a6c
Add build configs
DavidHuber-NOAA Dec 19, 2024
d92e1cf
Remove duplicate ufs_utils build resource
DavidHuber-NOAA Dec 19, 2024
bd93b16
Remove unused build/yaml directory
DavidHuber-NOAA Dec 19, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions jobs/JBUILD_COMPILE
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
#! /usr/bin/env bash

source "${HOMEgfs}/ush/preamble.sh"
source "${EXPDIR}/config.base"
source "${EXPDIR}/config.resources" "${BUILD}"

###############
# Run the build script

# TODO redirect output to sorc/logs/BUILD_SCRIPT.log via rocoto
logfile="${HOMEgfs}/sorc/logs/${BUILD_SCRIPT/.sh/}.log"
# shellcheck disable=SC2086,SC2312
"${HOMEgfs}/sorc/${BUILD_SCRIPT}" ${BUILD_FLAGS:-} -j "${ntasks}" 2>&1 | tee "${logfile}"
Fixed Show fixed Hide fixed
Fixed Show fixed Hide fixed

stat=$?

exit "${stat}"
12 changes: 12 additions & 0 deletions jobs/rocoto/build.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
#! /usr/bin/env bash

source "${HOMEgfs}/ush/preamble.sh"

export job="compile_${BUILD}"
export jobid="${job}.$$"

###############################################################
# Execute the JJOB
"${HOMEgfs}/jobs/JBUILD_COMPILE"
status=$?
exit "${status}"
Loading