PFT/landuse tools: availability, documentation, training

[slevis-lmwg]

TODOs as of Feb 2024.

• @lawrencepj1 updates/completes the documentation, currently in prep: This is for clm5 and is needed by end of 2024 for clm52, as well.
• Reformat documentation from .doc to .rst (@mvdebolskiy , June-July)
• Peter shows a few of us how the tools work in a half-day training: Individual tools, as well as complete workflows.
• Peter Update tools to the newest version for ctsm54 compatible with ctsm53 mksurfdata_esmf
• @ekluzek and @lawrencepj1 move tools to ESCOMP
• Make tools part of ctsm/tools and use the infrastructure of cime/ctsmtools to make them work on any machine
• Run mksurfdata_esmf with the new vegetation raw data for ctsm5.3: Run mksurfdata_esmf with the new vegetation raw data #2452
• Run mksurfdata_esmf with the new CMIP7 data Update to CMIP7 LULCC forcings #2851
• Add more exlpanations into README at mksrurfdata_esmf to explain what is expected to be in the mksruf_ files for landuse.
  @lawrencepj1 @mvdebolskiy @ekluzek

[slevis-lmwg]

@lawrencepj1 shared with us by email the latest pdf of his documentation. I'm open to uploading here if you all think it makes sense.

[lawrencepj1]

Thanks @slevis-lmwg yes please upload and make available as a work in progress

[slevis-lmwg]

CLM50_Land_Data_Tech_Note_v20.pdf

[slevis-lmwg]

Meeting 2023/11/16 @lawrencepj1 @ekluzek @mvdebolskiy @slevis-lmwg

Peter points out:

• There are 3 overall steps in the big picture of preparing CTSM raw datasets.
• Step 1 is most volatile in its process because datasets change in formats, projections, grids, etc.

So Peter proposes standardizing steps 2 and 3 initially.

Peter is organizing step 2 on the cgd machines here:
/project/tss/lawrence/ctsm52landusedataprep/ctsm52landusedata025
This directory has a /tools subdirectory and a README that Peter is in the middle of completing.

Peter is organizing step 3 on cheyenne and needs to move stuff to /campaign before cheyenne goes away.
Peter gave us a quick tour of these directories:

/glade/p/cesm/sdwg_dev/thesis/collections/cesm_tools/ctsm52landusedatatool
/glade/p/cesm/sdwg_dev/thesis/data/cesm_tools/lumipfinallcc/historicLUH2_181217
/glade/p/cesm/sdwg_dev/thesis/data/cesm_tools/surfacedata/ctsm52finalrawdata

This is a sample namelist used by the C-program (each directory here has a diff. namelist):
/glade/p/cesm/sdwg_dev/thesis/data/cesm_tools/surfacedata/ctsm52finalrawdata/globalctsm52histLUH2deg025_220305/globalctsm52histLUH2namelist.txt

For /glade/p data we decided (Erik, Peter, and Sam L will meet Dec 6 to do the following):

• @lawrencepj1 will move output (i.e. ctsm rawdata) to /glade/campaign/cesm/cesmdata/cseg/inputdata
• @lawrencepj1 will move inputs to /glade/campaign/cesm/development/lmwg

[mvdebolskiy]

@lawrencepj1 can you add the path to where READMEs and shell-scripts are for step 2?

[slevis-lmwg]

@mvdebolskiy I think you mean the path that I listed under step 2 above. The README is there and the scripts are in /tools. Do you mean something else?

[mvdebolskiy]

Yeah, step two. I thought it was also on thesis. nvm

[mvdebolskiy]

Updates:
Peter finished building all the pre-proc tools on derecho.
Potential vegetation #2320 added.
New directory: /glade/campaign/cesm/development/lmwg/ with raw and surface data for CTSM5.2. They include namelists for ctsm52landusetool
Ctsm5.2 release will include only re-processed old rawdata (with new variables etc).
List of datasets for CESM3
Project board for CTSM5.2 datasets

[slevis-lmwg]

@mvdebolskiy thank you for tracking today's conversation with these notes.

[lawrencepj1]

README from Land Use Data Prep

CTSM52 Land Use Data Prep Workflow

This is step two in the bigger picture of generating CTSM raw PFT/CFT data.
The prior stage is to take the 1km MODIS, AVHRR, ICESAT Satellite and EarthSTAT
cropping products processed into a consistent format including grids and land masks.

1. Generate Base LUH2 surface datasets

   Use tools/runcreateluh2statesfile LUH2SeriesName startyear endyear
   Use tools/runcreateluh2transitionsfile LUH2SeriesName startyear endyear
   Use tools/runcreateluh2managementfile LUH2SeriesName startyear endyear

2. Generate CTSM52 MODIS EarthStat and Current raw and surface data files

   Use tools/runcreatemodisearthstatsurffile CTSM52_MODISEarthStat 2005
   Use tools/runcreateluh2modiscurrentallrawfiles LUH2_HIST_GEOG_DEG025 CTSM52_MODISEarthStat CTSM52_MODISCurrent 2005
   Use tools/runcreatemodiscurrentsurffile CTSM52_MODISCurrent 2005

3. Generate CRU Climate surface data

   Use tools/runcreateclimatesurffile CRUSeriesName

4. Generate CRU CTSM LUH2 climate vegetation cover lookup files

   Use tools/runcreateluh2modiscruclimatevegetationlutfiles
   Must have CTSM52LUH2.Deg025.Hist.001 processed for year 2005

5. Generate CTSM52 MODIS EarthStat and Initial Potential Vegetation Continuous Fields (VCF) in workrawdata

   Use tools/runcreateluh2modiscurrentvcfrawfiles CTSM52_MODISCurrent 2005
   Use tools/runcreateluh2potvegforestinitialvcfrawfiles CTSM52_MODISCurrent CTSM52_POTVEGInit 2005
   Use tools/runcreateluh2potvegnonforestinitialvcfrawfiles CTSM52_MODISCurrent CTSM52_POTVEGInit 2005
   Use tools/runcreateluh2potvegrangeinitialvcfrawfiles CTSM52_MODISCurrent CTSM52_POTVEGInit 2005
   Check Initial Vegetation Continuous Fields (VCF) netcdf files in worksurfdata
   Use tools/runcreatevcfsurffile CTSM52_POTVEGInit LUH2Component_VCF 2005

6. Generate Combined Vegetation Continuous Fields (VCF) for Climate Potential Vegetation in workrawdata

   Use tools/runcreateluh2potvegallcombinedvcfrawfiles CTSM52_MODISCurrent CTSM52_POTVEGInit CTSM52_POTVEGComb 2005
   Check Vegetation Continuous Fields (VCF) netcdf files in worksurfdata
   Use tools/runcreatevcfsurffile CTSM52SeriesName LUH2Component_VCF year

7. Generate Current Day Scaled Vegetation Continuous Fields (VCF) for Climate Potential Vegetation in workrawdata

   Use tools/runcreateluh2potvegallscaledvcfrawfiles LUH2_HIST_GEOG_DEG025 CTSM52_MODISCurrent CTSM52_POTVEGComb CTSM52_POTVEGScaled 2005
   Check Vegetation Continuous Fields (VCF) netcdf files in worksurfdata
   Use tools/runcreatevcfsurffile CTSM52SeriesName LUH2Component_VCF year

8. Generate Maximum Vegetation Continuous Fields (VCF) for Climate Potential Vegetation in workrawdata. Potential Vegetation is updated where current day MODIS EarthStat vegetation is higher.

   Use tools/runcreateluh2potvegallmaxvcfrawfiles CTSM52_MODISCurrent CTSM52_POTVEGComb CTSM52_POTVEGScaled CTSM52_POTVEGMax 2005
   Check Vegetation Continuous Fields (VCF) netcdf files in worksurfdata
   Use tools/runcreatevcfsurffile CTSM52SeriesName LUH2Component_VCF year

9. Generate All of the raw Merge files for primf secdf primn secdn range for generating the timeseries Descriptor files

   Use tools/runcreateluh2mergeallhistoricalrawfiles CTSM52_MODISCurrent CTSM52_LUH2Hist 2005 1700 2015
   Check Merge netcdf files in worksurfdata for LUH2Type (primf,secdf,primn,secdn,range) FractionType (TREEFRAC,HERBFRAC,BAREFRAC)
   Use tools/runcreatemergesurffile CTSM52SeriesCurrentName CTSM52MergeSeriesName LUH2Group VCFGroup ReferenceYear StartYear EndYear

10. Generate All the VCF Tree, Herb and Grass PFT extrapolation files

Use tools/runcreateluh2modisearthstatextraptreerawfiles CTSM52_MODISCurrent CTSM52_POTVEGMax 2005
Use tools/runcreateluh2modisearthstatextrapherbrawfiles CTSM52_MODISCurrent CTSM52_POTVEGMax 2005
Use tools/runcreateluh2modisearthstatextrapgrassrawfiles CTSM52_MODISCurrent CTSM52_POTVEGMax 2005
Check Extrapolation netcdf files in worksurfdata for PFT composition (TREE_EXTRAP,HERB_EXTRAP,GRASS_EXTRAP)
Use tools/runcreateworksurffile CTSM52_MODISEarthStat GRASS_EXTRAP 2005

11. Generate All of the raw LUH2 component PFT Descriptor files for primf secdf primn secdn range pastr for a timeseries

Generate the Descriptor files in rawdata:
Use tools/runcreateluh2descprimfrawfiles CTSM52_MODISCurrent CTSM52_POTVEGMax CTSM52_POTVEGScaled CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreateluh2descsecdfrawfiles CTSM52_MODISCurrent CTSM52_POTVEGMax CTSM52_POTVEGScaled CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreateluh2descprimnrawfiles CTSM52_MODISCurrent CTSM52_POTVEGMax CTSM52_POTVEGScaled CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreateluh2descsecdnrawfiles CTSM52_MODISCurrent CTSM52_POTVEGMax CTSM52_POTVEGScaled CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreateluh2descrangerawfiles CTSM52_MODISCurrent CTSM52_POTVEGMax CTSM52_POTVEGScaled CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreateluh2descpastrrawfiles CTSM52_MODISCurrent CTSM52_LUH2Hist 2005

Generate the Descriptor files in surfdata:
Use tools/runcreateprimfdescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreatesecdfdescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreateprimndescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreatesecdndescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreaterangedescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1700 2015
Use tools/runcreatepastrdescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 2005 2005

12. Generate All of the raw LUH2 component CFT Descriptor files for c3ann c4ann c3per c4per c3nfx for a timeseries

Generate the Descriptor files in rawdata:
Use tools/runcreateluh2descc3annrawfiles CTSM52_MODISCurrent CTSM52_LUH2Hist 2005 1961 2015
Use tools/runcreateluh2descc4annrawfiles CTSM52_MODISCurrent CTSM52_LUH2Hist 2005 1961 2015
Use tools/runcreateluh2descc3perrawfiles CTSM52_MODISCurrent CTSM52_LUH2Hist 2005 1961 2015
Use tools/runcreateluh2descc4perrawfiles CTSM52_MODISCurrent CTSM52_LUH2Hist 2005 1961 2015
Use tools/runcreateluh2descc3nfxrawfiles CTSM52_MODISCurrent CTSM52_LUH2Hist 2005 1961 2015

Generate the Descriptor files in surfdata:
Use tools/runcreatec3anndescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1961 2015
Use tools/runcreatec4anndescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1961 2015
Use tools/runcreatec3perdescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1961 2015
Use tools/runcreatec4perdescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1961 2015
Use tools/runcreatec3nfxdescsurffile CTSM52_MODISEarthStat CTSM52_LUH2Hist 2005 1961 2015

13. Generate All the raw LAI and Soil Color files for a timeseries these need to already exist as raw data for the timeseries

In surfdata:
Use tools/runcreatelaimksurffile CTSM52_LUH2Hist
Use tools/runcreatesoilcolormksurffile CTSM52_LUH2Hist

[mvdebolskiy]

Moving tools from Peter to ESCOMP:

1. Make it as a CTSM external for ctsm-tools
2. Leverage CIME to set up configuration and compile options
3. Tools will not be in the CESM3 release
4. Tech note is more realistic for tech note ( Ask Peter for the .doc before June to convert into .rst

Peter will present on CESM version for CCIS with datasets created with the previous version of mksurf tools.

/glade/campaign/cesm/development/lmwg/ is now readable for others

Newer versions of landuse tools are not on github. (for scenarios).

[slevis-lmwg]

@mvdebolskiy offered to make a list of TODO checkboxes here in the discussion. Possibly at the next meeting we can decide to start a project board.

[mvdebolskiy]

Notes from 17th May 2024:

• Need to run ssp245 to test with anomaly forcing? (blocked by SSP cases get rcp45 anomalies #2301)
• For SE testing: multiple resolutions. (primarily ne30)
• For scientific testing: f09 historical and spinup.
• @slevis-lmwg has started testing new pft datasets Run mksurfdata_esmf with the new vegetation raw data #2452
• Baselines with 5.2 datasets to compare with new pft datasets 5.3
• Run diagnostics on the scientific runs.

[mvdebolskiy]

Notes 18th September 2024

• 5.3 datasets are being remade, bunch of tests failing
• TRENDY simulations: WT fluxes go to 0 at 1850 (ask adriana what exactly was the problem with the case).
• RUN clm50landusetools for RESCUE project. (is done by CMCC)

[mvdebolskiy]

October Agenda:
Run raw pft tools and landuse timeseries together.

[mvdebolskiy]

Descriptor files tool have been moved from /project/tss/lawrence/ to /project/ccis/lawrence....

[mvdebolskiy]

Discussion on CMIP7 LULCC #2851

[lawrencepj1]

Updated README file with all tools using namelist files rather than command line arguments.

For @slevis-lmwg @ekluzek @mvdebolskiy

CTSM52 Land Data Prep Workflow

This is step two in the bigger picture of generating CTSM raw PFT/CFT data.
The prior stage is to take the 1km MODIS, AVHRR, ICESAT Satellite and EarthSTAT
cropping products processed into a consistent format including grids and land masks.
This step generates LUH2 Descriptor files that are combined with LUH2 time series data
in the CTSM52 Land Data Tool.

Historical Descriptor File Generation

1. Generate All Base LUH2 surface datasets

   tools/runcreateluh2allsurfdata luh2namelist/LUH2_NOANTHRO_gensurfdata.txt
   tools/runcreateluh2allsurfdata luh2namelist/LUH2_HIST_gensurfdata.txt
   tools/runcreateluh2allsurfdata luh2namelist/LUH2_SSP119_gensurfdata.txt
   tools/runcreateluh2allsurfdata luh2namelist/LUH2_SSP126_gensurfdata.txt
   tools/runcreateluh2allsurfdata luh2namelist/LUH2_SSP245_gensurfdata.txt
   tools/runcreateluh2allsurfdata luh2namelist/LUH2_SSP370_gensurfdata.txt
   tools/runcreateluh2allsurfdata luh2namelist/LUH2_SSP460_gensurfdata.txt
   tools/runcreateluh2allsurfdata luh2namelist/LUH2_SSP585_gensurfdata.txt

2. Generate CTSM52 MODIS EarthStat, MODIS Current and CRU raw and surface data files

   tools/runcreateworkmodiscurrentallrawdata worknamelist/CTSM52_MODISCURRENT_generateallrawdata.txt
   tools/runcreateworkclm5surfdata worknamelist/CTSM52_MODISCURRENT_generatesurfdata.txt
   tools/runcreateworkclimatesurfdata worknamelist/CRU_321_generatesurfdata.txt

3. Generate CRU CTSM LUH2 climate vegetation cover lookup files

   tools/runcreateluh2modiscruclimatevegetationlutfiles

4. Generate CTSM52 MODIS EarthStat and Initial Potential Vegetation Continuous Fields (VCF) in workrawdata

   tools/runcreateworkmodiscurrentvcfrawdata worknamelist/CTSM52_MODISCURRENTVCF_generateallrawdata.txt
   tools/runcreateworkpotvegforestinitialvcfrawdata worknamelist/CTSM52_POTVEGINITFORESTVCF_generateallrawdata.txt
   tools/runcreateworkpotvegnonforestinitialvcfrawdata worknamelist/CTSM52_POTVEGINITNONFORESTVCF_generateallrawdata.txt
   tools/runcreateworkpotvegrangeinitialvcfrawdata worknamelist/CTSM52_POTVEGINITRANGEVCF_generateallrawdata.txt

   Check Initial Vegetation Continuous Fields (VCF) netcdf files in worksurfdata

   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_MODISCURRENTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGINITFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGINITNONFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGINITRANGEVCF_generatesurfdata.txt

5. Generate Combined Vegetation Continuous Fields (VCF) for Climate Potential Vegetation in workrawdata

   tools/runcreateworkpotvegallcombinedvcfrawdata worknamelist/CTSM52_POTVEGCOMBALLVCF_generateallrawdata.txt

   Check Vegetation Continuous Fields (VCF) netcdf files in worksurfdata

   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGCOMBFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGCOMBNONFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGCOMBRANGEVCF_generatesurfdata.txt

6. Generate Current Day Scaled Vegetation Continuous Fields (VCF) for Climate Potential Vegetation in workrawdata

   tools/runcreateworkpotvegallscaledvcfrawdata worknamelist/CTSM52_POTVEGSCALEDALLVCF_generateallrawdata.txt

   Check Vegetation Continuous Fields (VCF) netcdf files in worksurfdata

   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGSCALEDFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGSCALEDNONFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGSCALEDRANGEVCF_generatesurfdata.txt

7. Generate Maximum Vegetation Continuous Fields (VCF) for Climate Potential Vegetation in workrawdata.
   Potential Vegetation is updated where current day MODIS EarthStat vegetation is higher.

   tools/runcreateworkpotvegallmaxvcfrawdata worknamelist/CTSM52_POTVEGMAXALLVCF_generateallrawdata.txt

   Check Vegetation Continuous Fields (VCF) netcdf files in worksurfdata

   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGMAXFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGMAXNONFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_POTVEGMAXRANGEVCF_generatesurfdata.txt

8. Generate Maximum Vegetation Continuous Fields (VCF) for Forests in workrawdata. Maximum Potential Vegetation
   is updated to account for human plantation management.

   tools/runcreateworkforestallmaxvcfrawdata worknamelist/CTSM52_FORESTMAXALLVCF_generateallrawdata.txt

   Check Vegetation Continuous Fields (VCF) netcdf files in worksurfdata

   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_FORESTMAXFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_FORESTMAXNONFORESTVCF_generatesurfdata.txt
   tools/runcreateworkvcfsurfdata worknamelist/CTSM52_FORESTMAXRANGEVCF_generatesurfdata.txt

9. Generate All of the raw Merge files for primf secdf primn secdn range for generating the LUH2 Descriptor files

   tools/runcreateworkmergeallhistoricalrawdata worknamelist/CTSM52_LUH2HISTMERGE_generateallrawdata.txt

   Check Merge netcdf files in worksurfdata for LUH2Type (PRIMF,SECDF,PRIMN,SECDN,RANGE) FractionType (TREEFRAC,HERBFRAC,BAREFRAC)

   tools/runcreateworkmergesurfdata worknamelist/CTSM52_LUH2HISTMERGE_generatesurfdata.txt

10. Generate All the VCF Tree, Herb and Grass PFT extrapolation files

tools/runcreateworkclm5extrapallvcfpftrawdata worknamelist/CTSM52_MODISCURRENTEXTRAPVCFPFT_generateallrawdata.txt

Check Extrapolation netcdf files in worksurfdata for PFT composition (TREE_EXTRAP,HERB_EXTRAP,GRASS_EXTRAP)

tools/runcreateworkclm5surfdata worknamelist/CTSM52_MODISCURRENTEXTRAPTREEVCFPFT_generatesurfdata.txt
tools/runcreateworkclm5surfdata worknamelist/CTSM52_MODISCURRENTEXTRAPHERBVCFPFT_generatesurfdata.txt
tools/runcreateworkclm5surfdata worknamelist/CTSM52_MODISCURRENTEXTRAPGRASSVCFPFT_generatesurfdata.txt

11. Generate All of the raw LUH2 component PFT Descriptor files for PRIMF SECDF PRIMN SECDN RANGE PASTR for a timeseries

Generate the Descriptor files in rawdata:
tools/runcreateluh2descprimfrawdata luh2descnamelist/CTSM52_LUH2HISTDESCPRIMFPFTS_generateallrawdata.txt
tools/runcreateluh2descsecdfrawdata luh2descnamelist/CTSM52_LUH2HISTDESCSECDFPFTS_generateallrawdata.txt
tools/runcreateluh2descprimnrawdata luh2descnamelist/CTSM52_LUH2HISTDESCPRIMNPFTS_generateallrawdata.txt
tools/runcreateluh2descsecdnrawdata luh2descnamelist/CTSM52_LUH2HISTDESCSECDNPFTS_generateallrawdata.txt
tools/runcreateluh2descrangerawdata luh2descnamelist/CTSM52_LUH2HISTDESCRANGEPFTS_generateallrawdata.txt
tools/runcreateluh2descpastrrawdata luh2descnamelist/CTSM52_LUH2HISTDESCPASTRPFTS_generateallrawdata.txt

Generate the Descriptor files in surfdata:
tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCPRIMFPFTS_generatesurfdata.txt
tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCSECDFPFTS_generatesurfdata.txt
tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCPRIMNPFTS_generatesurfdata.txt
tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCSECDNPFTS_generatesurfdata.txt
tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCRANGEPFTS_generatesurfdata.txt
tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCPASTRPFTS_generatesurfdata.txt

12. Generate All of the raw LUH2 component CFT Descriptor files for c3ann c4ann c3per c4per c3nfx for a timeseries

Generate the Descriptor files in rawdata:
tools/runcreateluh2descc3annrawdata luh2descnamelist/CTSM52_LUH2HISTDESCC3ANNCFTS_generateallrawdata.txt
tools/runcreateluh2descc4annrawdata luh2descnamelist/CTSM52_LUH2HISTDESCC4ANNCFTS_generateallrawdata.txt
tools/runcreateluh2descc3perrawdata luh2descnamelist/CTSM52_LUH2HISTDESCC3PERCFTS_generateallrawdata.txt
tools/runcreateluh2descc4perrawdata luh2descnamelist/CTSM52_LUH2HISTDESCC4PERCFTS_generateallrawdata.txt
tools/runcreateluh2descc3nfxrawdata luh2descnamelist/CTSM52_LUH2HISTDESCC3NFXCFTS_generateallrawdata.txt

Generate the Descriptor files in surfdata:
tools/runcreateluh2desccftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCC3ANNCFTS_generatesurfdata.txt
tools/runcreateluh2desccftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCC4ANNCFTS_generatesurfdata.txt
tools/runcreateluh2desccftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCC3PERCFTS_generatesurfdata.txt
tools/runcreateluh2desccftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCC4PERCFTS_generatesurfdata.txt
tools/runcreateluh2desccftsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCC3NFXCFTS_generatesurfdata.txt

13. Generate All the raw LAI and Soil Color files for a timeseries these need to already exist as raw data for the timeseries

tools/runcreateluh2descpftlaisurfdata luh2descnamelist/CTSM52_LUH2HISTDESCPFTLAIS_generatedata.txt
tools/runcreateluh2descsoilcolorsurfdata luh2descnamelist/CTSM52_LUH2HISTDESCSOILCOLORS_generatedata.txt

Future SSP Time Series Descriptor File Generation - Assumes that Historical Descriptor Files have been generated.

1. Generate Secondary Forest Merge File to account for Re/Afforestation using FORESTMAX plantation potential PFT values.

   tools/runcreateworkmergeallssprawdata worknamelist/CTSM52_LUH2SSP119MERGE_generateallrawdata.txt
   tools/runcreateworkmergeallssprawdata worknamelist/CTSM52_LUH2SSP126MERGE_generateallrawdata.txt
   tools/runcreateworkmergeallssprawdata worknamelist/CTSM52_LUH2SSP245MERGE_generateallrawdata.txt
   tools/runcreateworkmergeallssprawdata worknamelist/CTSM52_LUH2SSP370MERGE_generateallrawdata.txt
   tools/runcreateworkmergeallssprawdata worknamelist/CTSM52_LUH2SSP460MERGE_generateallrawdata.txt
   tools/runcreateworkmergeallssprawdata worknamelist/CTSM52_LUH2SSP585MERGE_generateallrawdata.txt

   Check Merge netcdf files in worksurfdata for LUH2Type (SECDF) FractionType (TREEFRAC,HERBFRAC,BAREFRAC)

   tools/runcreateworkmergesurfdata worknamelist/CTSM52_LUH2SSP119MERGE_generatesurfdata.txt
   tools/runcreateworkmergesurfdata worknamelist/CTSM52_LUH2SSP126MERGE_generatesurfdata.txt
   tools/runcreateworkmergesurfdata worknamelist/CTSM52_LUH2SSP245MERGE_generatesurfdata.txt
   tools/runcreateworkmergesurfdata worknamelist/CTSM52_LUH2SSP370MERGE_generatesurfdata.txt
   tools/runcreateworkmergesurfdata worknamelist/CTSM52_LUH2SSP460MERGE_generatesurfdata.txt
   tools/runcreateworkmergesurfdata worknamelist/CTSM52_LUH2SSP585MERGE_generatesurfdata.txt

2. Generate Secondary Forest Descriptor File to account for Re/Afforestation using FORESTMAX plantation potential PFT values.

   Generate the Descriptor files in rawdata:
   tools/runcreateluh2descsecdfrawdata luh2descnamelist/CTSM52_LUH2SSP119DESCSECDFPFTS_generateallrawdata.txt
   tools/runcreateluh2descsecdfrawdata luh2descnamelist/CTSM52_LUH2SSP126DESCSECDFPFTS_generateallrawdata.txt
   tools/runcreateluh2descsecdfrawdata luh2descnamelist/CTSM52_LUH2SSP245DESCSECDFPFTS_generateallrawdata.txt
   tools/runcreateluh2descsecdfrawdata luh2descnamelist/CTSM52_LUH2SSP370DESCSECDFPFTS_generateallrawdata.txt
   tools/runcreateluh2descsecdfrawdata luh2descnamelist/CTSM52_LUH2SSP460DESCSECDFPFTS_generateallrawdata.txt
   tools/runcreateluh2descsecdfrawdata luh2descnamelist/CTSM52_LUH2SSP585DESCSECDFPFTS_generateallrawdata.txt

   Generate the Descriptor files in surfdata:
   tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2SSP119DESCSECDFPFTs_generatesurfdata.txt
   tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2SSP126DESCSECDFPFTs_generatesurfdata.txt
   tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2SSP245DESCSECDFPFTs_generatesurfdata.txt
   tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2SSP370DESCSECDFPFTs_generatesurfdata.txt
   tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2SSP460DESCSECDFPFTs_generatesurfdata.txt
   tools/runcreateluh2descpftsurfdata luh2descnamelist/CTSM52_LUH2SSP585DESCSECDFPFTs_generatesurfdata.txt

[ekluzek]

Meet with @slevis-lmwg @lawrencepj1 and @wwieder. Mostly confirming the CMIP7 process for ctsm5.4 and CESM3.0 release.

• Peter will create rawdatasets for ctsm5.4 when CMIP7 datasets are available, late Feb/early March (looking like mid-March now)
• We will move the new updated tools into github
• Peter will create ctsm54landusedatatool copied from ctsm52landusedatatool and updated
• Peter will convert the LUH3 data format to the LUH2 format that the tool uses
• Peter, Sam and Erik will have a hackathon around the Winter LMWG to run through the complete process to transfer knowledge
• Sam L. will rimport the finished rawdata datasets into CESM inputdata
• Peter: Step 1 prior stage of raw Satellite product handling will need to be put into a repository

Non-CMIP7 work will be outside of the standard workflow. On a branch or in a separate project. Reforestation, or bioenergy work for example.

[slevis-lmwg]

Meeting with @lawrencepj1 @ekluzek 2025/2/28

When the new version becomes visible in /project/ccis/lawrence (today it's not), Peter will put it on github.

Today's process... On a cgd machine Peter made a demo directory with an older version because the new is not visible right now:

cd /project/tss/lawrence/ctsm52landusedataprepdemo/ctsm52landusedata025
# In the future we will obtain the above with git clone of the dataprep tool. Then...
cd bin
make
# Next follow the instructions in the README (this part is step 2).
# Now copy the .nc outputs to /glade and work on derecho (this part is step 3).
# The user would git clone the landuse data tool now.
cd /glade/campaign/cesm/development/lmwg/landuse_source_tools
# Notice here /MksrfDataTools is the old mksurfdata_map refurbished to work on derecho
cd CTSM52LandUseDataTool/bin
make
cd ../../../landuse_source_data/CTSM53RawData/globalctsm53histMKSRFDeg025_demo
/glade/campaign/cesm/development/lmwg/landuse_source_tools/CTSM52LandUseDataTool/bin/ctsm52landusedatatool globalctsm52histTRENDY2023namelist.txt  # <-- the namelist is the only file you need to update, then you may want to run with qcmd --
# When cloning, the user will get a demo namelist.txt file and demo look-up tables
# Next is step 4, i.e. the mksurfdata_esmf (or mksurfdata_map) step to generate fsurdat/landuse files

Next meeting March 28 to do all this from github and to discuss CMIP 7 (see invite).