Skip to content
This repository has been archived by the owner on Jun 2, 2023. It is now read-only.

Figure out how to pull drb_climate_2022_06_14.nc in pipeline with S3 #31

Open
msleckman opened this issue Sep 6, 2022 · 0 comments
Open
Labels
enhancement New feature or request pipeline

Comments

@msleckman
Copy link
Collaborator

File is 15GB.

Need to pull drb_climate_2022_06_14.nc more efficiently. Let's explore placing it in an S3 bucket that we can request directly in 1_fetch.R

# Read in meteorological data aggregated to NHDPlusV2 catchments for the
# DRB (prepped in https://github.com/USGS-R/drb_gridmet_tools). Note that
# the DRB met data file must be stored in 1_fetch/in. If working outside
# of tallgrass/caldera, this file will need to be downloaded from the
# PGDL-DO project's S3 bucket and manually placed in 1_fetch/in.
tar_target(
p1_drb_nhd_gridmet,
"1_fetch/in/drb_climate_2022_06_14.nc",
format = "file"
),

@msleckman msleckman added the enhancement New feature or request label Sep 21, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request pipeline
Projects
None yet
Development

No branches or pull requests

2 participants