========== 20190801: 1. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. 2. Prepared for meeting with Randy. 3. Met with Randy: 11am-12pm; 3:30-3:45pm. ========== 20190802: 1. July report. 2. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. ========== 20190805: 1. Processed GMAO August forecast. 2. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. 3. Seminar by Kathy Breen about application of deep learning to hydrology ========== 20190806: 1. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. ========== 20190807: 1. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. 2. Prepared meeting slides. ========== 20190808: 1. Continued preparing meeting slides. 2. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. 3. Met with Randy, Melanie and Eunjee 4. Met with Sarith ========== 20190809: 1. Met with Randy, Sigfrad, Eunjee and Lesley. 2. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. ========== 20190812: 1. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. 2. Took most of the day off. ========== 20190813: 1. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. ========== 20190814: 1. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. ========== 20190815: 1. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. 2. Prepared meeting slides. 3. Met with Randy, Melanie and Eunjee ========== 20190816: 1. Met with Sarith, Weiyuan and Justin to discuss how to add CLM4.5CN to GEOSldas. To make the checkout work: Had to copy the public key in my id_rsa.pub to Github first. "ssh -T git@github.com" to check if the key is added successfully. To check out the latest GEOSldas: git clone git@github.com:GEOS-ESM/GEOSldas.git cd GEOSldas git branch -a git checkout develop checkout_externals -e Develop.cfg To build: ./parallel_build.csh To create my own branch clm4.5: GEOSland_GridComp > git branch -a GEOSland_GridComp > git checkout -b feature/clm4.5 GEOSland_GridComp > mkdir GEOScatchCN4.5_GridComp GEOSland_GridComp > cd GEOScatchCN4.5_GridComp GEOScatchCN4.5_GridComp > touch tmp.F90 GEOScatchCN4.5_GridComp > cd .. GEOSland_GridComp > git status GEOSland_GridComp > git add GEOScatchCN4.5_GridComp/tmp.F90 GEOSland_GridComp > git status ========== 20190819: 1. Read the NOAA MAPP 2020 call for which Eunjee is developing ideas. 2. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. 3. Created /discover/nobackup/fzeng/Huisheng/ndep_CF90.txt using ~/python/Huisheng/tile2grid_ndep_CF90.py and email Huisheng. 4. Worked on GEOSldas with CLM4.5: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp > git checkout feature/ldas-surface [to make sure that I branch out from the ldas-surface branch] > git branch -d feature/clm4.5 > git checkout -b feature/clm4.5 > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3_V24_C05/src/Components/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp > cp -p *.F90 /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN4.5_GridComp/. > cp -p *.perl /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN4.5_GridComp/. Next: CMakeLists.txt dbg_cnlsm_offline.F90 (what's this?) TridiagonalMod.F90 (need this?) ========== 20190820: 1. Continued working on GEOSldas with CLM4.5: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN4.5_GridComp > cp -p ../GEOScatchCN_GridComp/CMakeLists.txt . dbg_cnlsm_offline.F90 is not in the list to compile in CMakeLists.txt, so don't copy it. TridiagonalMod.F90 has subroutine Tridiagonal which is called from CNSoilLittVertTranspMod.F90. Modified GEOS_CatchCNGridComp.F90: GEOScatchCN4.5_GridComp > cp -p ../GEOScatchCN_GridComp/GEOS_CatchCNGridComp.F90 . GEOScatchCN4.5_GridComp > nedit GEOS_CatchCNGridComp.F90 & 2. Met with Eunjee, Melanie and Randy about Eunjee's proposal ideas. Emailed Steven asking if it's ok for me to join Eunjee's proposal with 0.1 FTE. Also email Robin and Joe about this. ========== 20190821: 1. Continued working on GEOSldas with CLM4.5: Continued modifying GEOS_CatchCNGridComp.F90. /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3_V24_C05/src/Components > ~ltakacs/cvstools/cvscmp Icarus-3_0 Error: Tag Icarus-3_0 does not exist for files in question The following files are locally MODIFIED: - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNAllocationMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNAnnualUpdateMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNBalanceCheckMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNCStateUpdate1Mod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNCStateUpdate2Mod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNCStateUpdate3Mod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNEcosystemDynMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNFireMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNGRespMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNGapMortalityMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNMRespMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNNDynamicsMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNNStateUpdate1Mod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNNStateUpdate2Mod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNNStateUpdate3Mod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNPhenologyMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNPrecisionControlMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNSetValueMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNSummaryMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNVegStructUpdateMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNWoodProductsMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNiniTimeVar.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/GEOS_CatchCNGridComp.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/GNUmakefile_openmp - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/catchmentCN.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/clm_time_manager.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/clm_varcon.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/clmtype.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/clmtypeInitMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/shr_const_mod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/subgridAveMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/Shared/lsm_routines.F90 - GEOSsurface_GridComp/Shared/StieglitzSnow.F90 The following files are CONFLICTING: - GEOSlana_GridComp/LSM_Calib.rc - GEOSlana_GridComp/catch_types.F90 - GEOSlana_GridComp/clsm_ensdrv_drv_routines.F90 - GEOSlana_GridComp/clsm_ensdrv_glob_param.F90 - GEOSlana_GridComp/clsm_ensdrv_init_routines.F90 - GEOSlana_GridComp/clsm_ensdrv_mpi.F90 - GEOSlana_GridComp/clsm_ensdrv_out_routines.F90 - GEOSlana_GridComp/clsm_ensdrv_vegalb_routines.F90 - GEOSlana_GridComp/driver_types.F90 - GEOSlana_GridComp/lsm_calib_routines.F90 - GEOSlana_GridComp/process_cn.F90 - GEOSlana_GridComp/tile_coord.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNDecompMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CN_DriverMod.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/clm_varpar.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/compute_rc.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/pftvarcon.F90 - GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/mk_LDASsaRestarts.F90 - GEOSsurface_GridComp/GEOSland_GridComp/Shared/update_model_paras.F90 The following files need to be UPDATED for tag Icarus-3_0 |-------------|------------------------------------------------------------ | Newest | |-------------| File Name | Here | Tag | |------|------|------------------------------------------------------------ | x | - | GNUmakefile | x | - | GEOSlana_GridComp/GNUmakefile | x | - | GEOSlana_GridComp/GNUmakefile_parallel | x | - | GEOSlana_GridComp/LDASsa_DEFAULT_inputs_adapt.nml | x | - | GEOSlana_GridComp/LDASsa_DEFAULT_inputs_catbias.nml | x | - | GEOSlana_GridComp/LDASsa_DEFAULT_inputs_driver.nml | x | - | GEOSlana_GridComp/LDASsa_DEFAULT_inputs_ensprop.nml | x | - | GEOSlana_GridComp/LDASsa_DEFAULT_inputs_ensupd.nml | x | - | GEOSlana_GridComp/README.LDASsa_build | x | - | GEOSlana_GridComp/README.LDASsa_history | x | - | GEOSlana_GridComp/README.LDASsa_input | x | - | GEOSlana_GridComp/README.LDASsa_model-versions | x | - | GEOSlana_GridComp/README.LDASsa_output | x | - | GEOSlana_GridComp/adapt_types.F90 | x | - | GEOSlana_GridComp/build_river_network.pro | x | - | GEOSlana_GridComp/catch_bias_types.F90 | x | - | GEOSlana_GridComp/clsm_adapt_routines.F90 | x | - | GEOSlana_GridComp/clsm_bias_routines.F90 | x | - | GEOSlana_GridComp/clsm_ensdrv_force_routines.F90 | x | - | GEOSlana_GridComp/clsm_ensdrv_functions.F90 | x | - | GEOSlana_GridComp/clsm_ensdrv_pert_routines.F90 | x | - | GEOSlana_GridComp/clsm_ensupd_enkf_update.F90 | x | - | GEOSlana_GridComp/clsm_ensupd_glob_param.F90 | x | - | GEOSlana_GridComp/clsm_ensupd_read_obs.F90 | x | - | GEOSlana_GridComp/clsm_ensupd_upd_routines.F90 | x | - | GEOSlana_GridComp/create_ccorr_cat_progn_default.m | x | - | GEOSlana_GridComp/date_time_util.F90 | x | - | GEOSlana_GridComp/easeV1_conv.F90 | x | - | GEOSlana_GridComp/easeV2_conv.F90 | x | - | GEOSlana_GridComp/enkf_general.F90 | x | - | GEOSlana_GridComp/enkf_types.F90 | x | - | GEOSlana_GridComp/ens_driver_routines.F90 | x | - | GEOSlana_GridComp/force_and_cat_progn_pert_types.F90 | x | - | GEOSlana_GridComp/get_catch_ldas_rst_tag.m | x | - | GEOSlana_GridComp/get_data_tag.m | x | - | GEOSlana_GridComp/io_hdf5.F90 | x | - | GEOSlana_GridComp/land_pert.F90 | x | - | GEOSlana_GridComp/land_pert_types.F90 | x | - | GEOSlana_GridComp/ldas_exceptions.F90 | x | - | GEOSlana_GridComp/mwRTM_routines.F90 | x | - | GEOSlana_GridComp/mwRTM_types.F90 | x | - | GEOSlana_GridComp/my_lu_decomp.f | x | - | GEOSlana_GridComp/my_matrix_functions.F90 | x | - | GEOSlana_GridComp/nr_fft.F90 | x | - | GEOSlana_GridComp/nr_indexx.f | x | - | GEOSlana_GridComp/nr_jacobi.F90 | x | - | GEOSlana_GridComp/nr_ran2_gasdev.F90 | x | - | GEOSlana_GridComp/process_cat.F90 | x | - | GEOSlana_GridComp/process_route.F90 | x | - | GEOSlana_GridComp/random_fields.F90 | x | - | GEOSlana_GridComp/read_ObsFcstAna.m | x | - | GEOSlana_GridComp/read_adapt.m | x | - | GEOSlana_GridComp/read_catbias_ldas_rst.m | x | - | GEOSlana_GridComp/read_catch_internal_rst.m | x | - | GEOSlana_GridComp/read_catch_ldas_rst.m | x | - | GEOSlana_GridComp/read_catparam.m | x | - | GEOSlana_GridComp/read_grid_data.m | x | - | GEOSlana_GridComp/read_mwRTMparam.m | x | - | GEOSlana_GridComp/read_obsbias_ldas_rst.m | x | - | GEOSlana_GridComp/read_obslog.m | x | - | GEOSlana_GridComp/read_obsparam.m | x | - | GEOSlana_GridComp/read_pert_ldas_rst.m | x | - | GEOSlana_GridComp/read_smapL4SMaup.m | x | - | GEOSlana_GridComp/read_smapL4SMlmc.m | x | - | GEOSlana_GridComp/read_tile_data.m | x | - | GEOSlana_GridComp/read_tilecoord.m | x | - | GEOSlana_GridComp/read_tilegrids.m | x | - | GEOSlana_GridComp/tile2grid.m | x | - | GEOSlana_GridComp/tile_coord_types.F90 | x | - | GEOSlana_GridComp/write_smapL4SMqa.m | x | - | GEOSlana_GridComp/zenith.f | x | - | GEOSsurface_GridComp/GEOSland_GridComp/GEOSroute_GridComp/GEOS_RouteGridComp.F90 | x | - | GEOSsurface_GridComp/GEOSland_GridComp/GEOSroute_GridComp/GNUmakefile | x | - | GEOSsurface_GridComp/GEOSland_GridComp/GEOSroute_GridComp/routing_model.F90 | x | - | GEOSsurface_GridComp/Shared/Raster/data/MOM/120x65/grid_spec.nc.gz | x | - | GEOSsurface_GridComp/Shared/Raster/data/MOM/360x200/grid_spec.nc.gz | x | - | GEOSsurface_GridComp/Shared/Raster/data/MOM/720x410/grid_spec.nc.gz | | x | GEOSsurface_GridComp/GEOS_SurfaceGridComp.F90 | | x | GEOSsurface_GridComp/GEOSland_GridComp/GNUmakefile | - | x | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/CNHarvestMod.F90 | | x | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/GEOS_CatchGridComp.F90 | | x | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/GNUmakefile_openmp | x | | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/catchment.F90 | x | | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/GNUmakefile | x | | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/Scale_CatchCN.F90 | x | | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/check_land_restarts.pro | - | x | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/cv_SaltRestart.F90 | - | x | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/mk_CICERestart.F90 | x | | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/mk_CatchCNRestarts.F90 | | x | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/mk_CatchRestarts.F90 | | x | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/mk_LakeLandiceSaltRestarts.F90 | | x | GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/mk_Restarts | x | | GEOSsurface_GridComp/GEOSland_GridComp/GEOSvegdyn_GridComp/GEOS_VegdynGridComp.F90 | x | | GEOSsurface_GridComp/GEOSland_GridComp/Shared/GNUmakefile | x | | GEOSsurface_GridComp/GEOSland_GridComp/Shared/catch_constants.f90 | | x | GEOSsurface_GridComp/GEOSsaltwater_GridComp/GEOS_SaltWaterGridComp.F90 | | x | GEOSsurface_GridComp/GEOSsaltwater_GridComp/GNUmakefile | | x | GEOSsurface_GridComp/Shared/Raster/GNUmakefile | x | | GEOSsurface_GridComp/Shared/Raster/make_bcs | x | | GEOSsurface_GridComp/Shared/Raster/src/clsm_plots.pro | x | | GEOSsurface_GridComp/Shared/Raster/src/create_README.csh | x | | GEOSsurface_GridComp/Shared/Raster/src/mkCatchParam.F90 | x | | GEOSsurface_GridComp/Shared/Raster/src/mkLISTilesPara.F90 | x | | GEOSsurface_GridComp/Shared/Raster/src/mod_process_hres_data.F90 |------|------|------------------------------------------------------------ ========== 20190822: 1. Continued working on GEOSldas with CLM4.5: Continued modifying GEOS_CatchCNGridComp.F90. 2. Met with Randy, Melanie, Eunjee and Jana. ========== 20190823: 1. Continued working on GEOSldas with CLM4.5: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN4.5_GridComp (1) Continued modifying GEOS_CatchCNGridComp.F90. About lnfm, I used to follow how grn and lai are read in clsm_ensdrv_drv_routines.F90 to read lnfm in LDASsa. However, I can't find anywhere grn and lai are read in GEOSldas. Asked Sarith. He said he would create a branch on git to show me how to read lnfm. (2) Moved on to compute_rc.F90: > cd /discover/nobackup/fzeng/offline_code/GEOSldas_m4-17_UCatchCN/src/GEOSldas_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp > xdiff compute_rc.F90 /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/. & > xdiff CN_DriverMod.F90 /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/. & This is to make sure that the GEOSldas I checked out includes Sarith's modifications. ========== 20190826: 1. Worked on upgrading CLM4 to CLM4.5. See notes in /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily_2019. 2. Continued working on GEOSldas with CLM4.5: (1) Committed the changes made so far: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN4.5_GridComp > git add . > git commit -a -m "Added CLM4.5 files, modified GEOS_CatchCNGridComp.F90 for CLM4.5" (2) compute_rc.F90 (3) GEOS_CatchCNGridComp.F90: Added read lnfm. (4) CN_DriverMod.F90: Added Sarith's modification about skip_initCN. Added subroutine upd_curr_date_time which was added to update_model_paras.F90 in LDASsa. (5) Checked clm_varpar.F90: no modification needed. (6) Modified GEOSland_GridComp/Shared/lsm_routines.F90 to add output arguments for surface soil moisture at column level in subroutine catch_calc_soil_moist. (7) catchmentCN.F90: Since I didn't make any changes to catchmentCN.F90 when I upgraded Catchment-CN from CLM4 to CLM4.5, just copy the one from GEOScatchCN_GridComp which has included the changes Justin made: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN4.5_GridComp > cp -p ../GEOScatchCN_GridComp/catchmentCN.F90 . (8) pftvarcon.F90: Checked this file. It's the same between my LDASsa CLM4.0 and GEOSldas CLM4.0, so no change needed to this file. (9) GEOScatchCN4.5_GridComp/CMakeLists.txt: Modified following /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3_V24_C05/src/Components/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/GNUmakefile_openmp ========== 20190827: 1. Continued working on GEOSldas with CLM4.5: (1) > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/Shared > cp -p update_model_paras.F90 update_model_paras.F90.clm4 > cp -p /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3_V24_C05/src/Components/GEOSsurface_GridComp/GEOSland_GridComp/Shared/update_model_paras.F90 . (2) Do this temporary: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp > mv GEOScatchCN_GridComp GEOScatchCN4.0_GridComp > mv GEOScatchCN4.5_GridComp GEOScatchCN_GridComp (3) getco2.F90: > cd GEOScatchCN_GridComp > cp -p ../GEOScatchCN4.0_GridComp/getco2.F90 . (4) GEOSland_GridComp/Shared/CMakeLists.txt: add update_model_paras.F90 (5) Compile: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas > ./parallel_build.csh (6) Set up experiment: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install/bin > source g5_modules > ./ldas_setup sample --exeinp > test_exeinp.txt > ./ldas_setup sample --batinp > test_batinp.txt > nedit test_exeinp.txt test_batinp.txt & > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/clm4.5_DE720_54/output/global/rs/ens0000/Y1980/M01 > ln -s ../../Y2017/M01/clm4.5_DE720.ens0000.catchcn_ldas_rst.20170101_0000z clm4.5_DE720_54.catchcn_internal_rst.19800101_0000 The TILE_ID in the restart file shows that the tiles are not in the order of ascending tile_id. Try and see if this works. > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install/bin > ./ldas_setup setup --runmodel /discover/nobackup/fzeng/Catchment/M2n5P/ test_exeinp.txt test_batinp.txt creating dir structure creating restart and bc Correct the tile file if it is an old EASE tile format... cmd: ./preprocess_ldas.x correctease /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//DE_00720x00360_PE_0720x0360.til /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//MAPL_DE_00720x00360_PE_0720x0360.til Creating f2g.txt.... cmd: ./preprocess_ldas.x c_f2g /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//DE_00720x00360_PE_0720x0360.til LDAS_domain_def.nml /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/clsm/catchment.def GEOSldas4.5_test1 198001010000 50.0 forrtl: severe (64): input conversion error, unit -5, file Internal List-Directed Read Image PC Routine Line Source preprocess_ldas.x 00000000006D28CE Unknown Unknown Unknown preprocess_ldas.x 000000000070113D Unknown Unknown Unknown preprocess_ldas.x 0000000000435F0B ldas_tilecoordrou 426 LDAS_TileCoordRoutines.F90 preprocess_ldas.x 0000000000422DEC createf2g_ 208 preprocess_ldas.F90 preprocess_ldas.x 000000000041C201 MAIN__ 86 preprocess_ldas.F90 preprocess_ldas.x 000000000041BD5E Unknown Unknown Unknown libc-2.11.3.so 00002AAAB5AC4C36 __libc_start_main Unknown Unknown preprocess_ldas.x 000000000041BBE9 Unknown Unknown Unknown Traceback (most recent call last): File "./ldas_setup", line 1661, in status = ld.createLnRstBc() File "./ldas_setup", line 680, in createLnRstBc with open('f2g.txt') as f2gfile : IOError: [Errno 2] No such file or directory: 'f2g.txt' ========== 20190828: 1. Continued working on GEOSldas with CLM4.5: (1) Continue on (6) of yesterday to set up experiment: Emailed Sarith asking if he know what the issue is. He told me to ask Weiyuan. Talked to Weiyuan. He helped me modify the tile file to resolve the issue. (2) I need to reorder the restart file so that the tiles are ascending tile_id order. First, need Sarith's help to create a copy of /discover/nobackup/rreichle/l_data/LandRestarts_for_Regridding/CatchCN/catchcn_internal_dummy for Catchment-CN4.5. Following cn.txt to reorder the restart file: (2.1) Create path: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5 > mkdir -p rst_GEOSldas/DE_00720x00360_PE_0720x0360_reordered > mv clm4.5_DE720 clm4.5_DE720_restore > ln -s clm4.5_DE720_57 clm4.5_DE720 (2.2) Create shell script "reorder_restarts" for reordering: > cd rst_GEOSldas/DE_00720x00360_PE_0720x0360_reordered > nedit reorder_restarts & reorder_restarts reads: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ #!/bin/csh set YYYY = 1980 set YYYYMMDD=`echo ${YYYY}0101` mpirun -np 1 bin/mk_LDASsaRestarts -b /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/ -d ${YYYYMMDD} -e clm4.5_DE720 -l /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/clm4.5_DE720/output/global/ -m catchcn -s 50 -r Y -t DE_00720x00360_PE_0720x0360.til ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > chmod 755 reorder_restarts (2.3) Get a copy of mk_LDASsaRestarts.F90, modify and compile it: > cp /discover/nobackup/fzeng/offline_code/GEOSldas_m4-17_6/src/GEOSldas_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/mk_LDASsaRestarts.F90 . > nedit mk_LDASsaRestarts.F90 & In SUBROUTINE reorder_LDASsa_restarts: (a) L298: tile_coord = trim(EXPDIR)//'rc_out/'//trim(expname)//'.ldas_tilecoord.bin' (b) L310: InNCIO = MAPL_NCIOOpen('/discover/nobackup/rreichle/l_data/LandRestarts_for_Regridding/CatchCN/catchcn_internal_clm45' , rc=rc) (c) L540: rst_file = trim(EXPDIR)//'rs/ens0000/Y'//YYYYMMDD(1:4)//'/M'//YYYYMMDD(5:6)//'/'//trim(ExpName)//& '.ens0000.catchcn_ldas_rst.'//trim(YYYYMMDD)//'_0000z' > cp mk_LDASsaRestarts.F90 /discover/nobackup/fzeng/clm4-to-clm4.5/GEOS5/Heracles-5_4_p3-M3_V24_C05/src/GEOSgcs_GridComp/GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts/. > cd /discover/nobackup/fzeng/clm4-to-clm4.5/GEOS5/Heracles-5_4_p3-M3_V24_C05/src/GEOSgcs_GridComp/GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts > setenv ESMADIR /discover/nobackup/fzeng/clm4-to-clm4.5/GEOS5/Heracles-5_4_p3-M3_V24_C05/ > source $ESMADIR/src/g5_modules > gmake install (2.4) Run "reorder_restarts" to reorder the offline restart file: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/rst_GEOSldas/DE_00720x00360_PE_0720x0360_reordered > ln -s /discover/nobackup/fzeng/clm4-to-clm4.5/GEOS5/Heracles-5_4_p3-M3_V24_C05/src/GEOSgcs_GridComp/GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatch_GridComp/mk_restarts bin > reorder_restarts (2.5) Create a symbolic link under /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/clm4.5_DE720_57/... for setting up the experiment: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/clm4.5_DE720_57/output/global/rs/ens0000/Y1980/M01 > ln -s /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/rst_GEOSldas/DE_00720x00360_PE_0720x0360_reordered/catchcn_internal_rst.19800101 clm4.5_DE720_57.catchcn_internal_rst.19800101_0000 (3) Try setting up the experiment again. > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install/bin > ./ldas_setup setup --runmodel /discover/nobackup/fzeng/Catchment/M2n5P/ test_exeinp.txt test_batinp.txt 11 1980 1985 6 3 1980 1990 11 4 creating dir structure creating restart and bc Correct the tile file if it is an old EASE tile format... cmd: ./preprocess_ldas.x correctease /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//DE_00720x00360_PE_0720x0360.til /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//MAPL_DE_00720x00360_PE_0720x0360.til Creating f2g.txt.... cmd: ./preprocess_ldas.x c_f2g /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//DE_00720x00360_PE_0720x0360.til LDAS_domain_def.nml /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/clsm/catchment.def GEOSldas4.5_test1 198001010000 50.0 Creating domain..., reading white and black lists if there have ones... Finish domain setup... SURFLAY: 50.00000 Writing catparam file : /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_te st1/output/global/rc_out///Y1980/M01/GEOSldas4.5_test1.ldas_catparam.19800101_0 000z.bin linking bcs... Creating and lining restart... cmd: ./process_rst.csh g0620 GEOSldas4.5_test1 /discover/nobackup/fzeng/Catchment/M2n5P /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/ DE_00720x00360_PE_0720x0360.til 2 1 19800101 clm4.5_DE720_57 global /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/ 1 0 WARNING : no file /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5//clm4.5_DE720_57/output/global//rc_out/clm4.5_DE720_57.ldas_tilecoord.bin. DEFAULT GEOSldas restart Please hold on for a while until the restart file is created ..... restart: 1 catchRstFile1: /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/clm4.5_DE720_57/output/global/rs/ens0000/Y1980/M01/clm4.5_DE720_57.catchcn_internal_rst.19800101_0000 catchRstFile: /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rs/ens0000/Y1980/M01/GEOSldas4.5_test1.catchcn_internal_rst.19800101_0000 Updating restart path... creating RC Files Optimizing... decomposition of processes.... cmd: ./preprocess_ldas.x optimize /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/input/tile.data 144 avg_land 471 re adjust the avg_land 442 rms rate: 442.0000 land_distribute: 459 468 453 458 456 452 465 504 472 504 531 520 549 459 460 485 490 450 525 530 533 498 536 527 464 559 452 498 550 608 615 576 540 516 451 560 479 450 518 504 505 453 463 457 466 467 505 443 471 498 456 505 483 560 519 453 521 566 568 563 569 614 631 628 626 618 588 569 548 544 530 499 474 480 564 558 462 457 571 460 506 468 465 534 488 471 482 530 539 475 506 530 529 493 461 448 550 446 474 517 537 442 470 461 475 479 467 570 543 527 541 446 481 462 453 479 464 550 555 530 501 480 483 488 455 493 515 536 465 451 476 462 462 458 99 0 0 0 0 0 0 0 0 0 ['/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc/GEOSldas_CAP.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc/GEOSldas_ExtData.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc/GEOSldas_HIST.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc/GEOSldas_LDAS.rc'] CAP.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run ExtData.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run HIST.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run ./process_hist.csh 2 0 EASE PE720x360-DE /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run/HISTORY.rc 0 0 0 PE720x360-DE LDAS.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run creating gcm style batch Run scripts lenkf.j Experiment directory: /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1 creating batch Run scripts (4) Restore: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5 > rm clm4.5_DE720 > mv clm4.5_DE720_restore clm4.5_DE720 (5) Run the experiment: > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run HISTORY.rc: L6-9: #'tavg1_1D_lnd_Nt' #'tavg1_1D_lfs_Nt' 'tavg1_2D_lfs_Nx' 'tavg1_2D_lnd_Nx' tavg1_2D_lfs_Nx.resolution: 720 360, tavg1_2D_lnd_Nx.resolution: 720 360, Changed L129 and L244 from 'CNROOT' , 'CATCHCN' , to 'CNFROOTC' , 'CATCHCN' , Removed the following line at 2 places: 'CNFSEL' , 'CATCHCN' , 'FSEL' , Added to L149-176 and L264-291: 'CNCO2' , 'CATCHCN' , 'CNFIRE_CNT' , 'CATCHCN' , 'CNSOM_CLOSS' , 'CATCHCN' , 'CNNDEPLOY' , 'CATCHCN' , 'CNDENIT' , 'CATCHCN' , 'CNSMINN_LEACHED' , 'CATCHCN' , 'CNSMINN' , 'CATCHCN' , 'CNFIRE_NLOSS' , 'CATCHCN' , 'CNLEAFN' , 'CATCHCN' , 'CNLEAFC' , 'CATCHCN' , 'CNGROSS_NMIN' , 'CATCHCN' , 'CNNET_NMIN' , 'CATCHCN' , 'CNNFIX_TO_SMINN' , 'CATCHCN' , 'CNACTUAL_IMMOB' , 'CATCHCN' , 'CNFPG' , 'CATCHCN' , 'CNFPI' , 'CATCHCN' , 'CNSMINN_TO_PLANT' , 'CATCHCN' , 'CNSMINN_TO_NPOOL' , 'CATCHCN' , 'CNNDEP_TO_SMINN' , 'CATCHCN' , 'CNTOTVEGN' , 'CATCHCN' , 'CNTOTLITN' , 'CATCHCN' , 'CNTOTSOMN' , 'CATCHCN' , 'CNRETRANSN' , 'CATCHCN' , 'CNRETRANSN_TO_NPOOL' , 'CATCHCN' , 'CNFUELC' , 'CATCHCN' , 'CNTOTLITC' , 'CATCHCN' , 'CNCWDC' , 'CATCHCN' , 'CNROOTC' , 'CATCHCN' , LDAS.rc: Added to the end (L53): LNFM_FILE: ../input/lnfm.data Other preparation: > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out/ > cp /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/lnfm_clim_720x360_DE.data . > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/input/ > ln -s /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out/lnfm_clim_720x360_DE.data lnfm.data Can we do these as standard? Did an interactive run: > interactive.py -A sp3 -n 144 -a g0620 -X --debug > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run > cp lenkf.j lenkf.j.orig > nedit lenkf.j & Add "exit" after L284 "mpirun -map-by core --mca btl ^vader -np $numprocs $GEOSBIN/GEOSldas.x" > ./lenkf.j Crashed. Weiyuan told me that I need to remove fsel from GEOS_LandGridComp.F90. > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp/@GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSphysics_GridComp/GEOSsurface_GridComp/GEOSland_GridComp > cp -p GEOS_LandGridComp.F90 GEOS_LandGridComp.F90.clm4 > nedit GEOS_LandGridComp.F90 & Removed all "CNFSEL" GEOS_CatchCNGridComp.F90: Removed all "CNFSEL" Also checked the fields added to the restart file. 2. Processed output of: clm4.5_DE720: 52 through 57 ========== 20190829: 1. Removed some archived files to release some MSS disk space. > cd /archive/u/fzeng/Catchment/princeton > /bin/rm p0005s_2*.tgz p0005s_3*.tgz p0005s_4*.tgz p0005s_5*.tgz p0005h_4*.tgz p0005r_4*.tgz p0005r_5*.tgz p0005r_6*.tgz > /bin/rm p0006r_5*.tgz p0006r_6*.tgz p0006s_2*.tgz p0006s_3*.tgz p0007r_5*.tgz p0007r_6*.tgz p0007s_3*.tgz p0007s_4*.tgz p0007s_5*.tgz > /bin/rm p0008r_5*.tgz p0008r_6*.tgz p0008r_7*.tgz p0008s_5*.tgz p0009s_5*.tgz 2. Continued working on GEOSldas with CLM4.5: (1) Recompile: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas > ./parallel_build.csh (2) Save a copy of GEOSldas4.5_test1: /discover/nobackup/fzeng/Catchment/M2n5P > mv GEOSldas4.5_test1 GEOSldas4.5_test1_keep (3) Rerun ldas_setup using fewer (e.g. 84) cores: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install/bin > source g5_modules > ./ldas_setup setup --runmodel /discover/nobackup/fzeng/Catchment/M2n5P/ test_exeinp.txt test_batinp.txt creating dir structure creating restart and bc Correct the tile file if it is an old EASE tile format... cmd: ./preprocess_ldas.x correctease /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//DE_00720x00360_PE_0720x0360.til /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//MAPL_DE_00720x00360_PE_0720x0360.til Creating f2g.txt.... cmd: ./preprocess_ldas.x c_f2g /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//DE_00720x00360_PE_0720x0360.til LDAS_domain_def.nml /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/clsm/catchment.def GEOSldas4.5_test1 198001010000 50.0 Creating domain..., reading white and black lists if there have ones... Finish domain setup... SURFLAY: 50.00000 Writing catparam file : /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_te st1/output/global/rc_out///Y1980/M01/GEOSldas4.5_test1.ldas_catparam.19800101_0 000z.bin linking bcs... Creating and lining restart... cmd: ./process_rst.csh g0620 GEOSldas4.5_test1 /discover/nobackup/fzeng/Catchment/M2n5P /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/ DE_00720x00360_PE_0720x0360.til 2 1 19800101 clm4.5_DE720_57 global /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/ 1 0 WARNING : no file /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5//clm4.5_DE720_57/output/global//rc_out/clm4.5_DE720_57.ldas_tilecoord.bin. DEFAULT GEOSldas restart Please hold on for a while until the restart file is created ..... restart: 1 catchRstFile1: /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/clm4.5_DE720_57/output/global/rs/ens0000/Y1980/M01/clm4.5_DE720_57.catchcn_internal_rst.19800101_0000 catchRstFile: /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rs/ens0000/Y1980/M01/GEOSldas4.5_test1.catchcn_internal_rst.19800101_0000 Updating restart path... creating RC Files Optimizing... decomposition of processes.... cmd: ./preprocess_ldas.x optimize /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/input/tile.data 84 avg_land 806 re adjust the avg_land 754 rms rate: 193.0000 land_distribute: 768 761 765 755 756 782 846 858 803 847 803 836 834 843 864 835 801 947 826 760 872 877 845 843 761 756 758 757 763 832 779 770 828 784 834 756 755 755 825 837 837 818 770 919 890 817 786 825 762 875 754 800 779 778 763 854 813 783 785 828 778 779 878 826 779 780 790 862 805 814 783 760 800 848 824 762 841 837 844 828 798 774 783 618 ['/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc/GEOSldas_CAP.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc/GEOSldas_ExtData.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc/GEOSldas_HIST.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc/GEOSldas_LDAS.rc'] CAP.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run ExtData.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run HIST.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run ./process_hist.csh 2 0 EASE PE720x360-DE /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run/HISTORY.rc 0 0 0 PE720x360-DE LDAS.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run creating gcm style batch Run scripts lenkf.j Experiment directory: /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1 creating batch Run scripts (4) Run the experiment: > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run HISTORY.rc: > cp -p ../../GEOSldas4.5_test1_keep/run/HISTORY.rc . LDAS.rc: Added to the end (L53): LNFM_FILE: ../input/lnfm.data Other preparation: > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out/ > cp /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/lnfm_clim_720x360_DE.data . > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/input/ > ln -s /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out/lnfm_clim_720x360_DE.data lnfm.data Did an interactive run: > interactive.py -A sp3 -n 84 -a g0620 -X --debug > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run > cp lenkf.j lenkf.j.orig > nedit lenkf.j & Add "exit" after L284 "mpirun -map-by core --mca btl ^vader -np $numprocs $GEOSBIN/GEOSldas.x" > ./lenkf.j Crashed again, giving error messages similar to yesterday. GEOS_LandGridComp.F90: L1199: changed 'CNROOT' to 'CNFROOTC' Compiled, but crashed again. > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/src/Components/GEOSldas_GridComp > cp -p GEOS_LdasGridComp.F90 GEOS_LdasGridComp.F90.orig > cp -p /gpfsm/dnb32/wjiang/tmp/git-ldas/GEOSldas/src/Components/GEOSldas_GridComp/GEOS_LdasGridComp.F90 . Compiled with debug: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas > ./parallel_build.csh -debug > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install-Debug/bin > source g5_modules > ./ldas_setup setup --runmodel /discover/nobackup/fzeng/Catchment/M2n5P/ ../../install/bin/test_exeinp.txt ../../install/bin/test_batinp.txt cmd: ./preprocess_ldas.x c_f2g /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global/rc_out//DE_00720x00360_PE_0720x0360.til LDAS_domain_def.nml /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/output/global /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/clsm/catchment.def GEOSldas4.5_test1 198001010000 50.0 forrtl: error (182): floating invalid - possible uninitialized real/complex variable. Image PC Routine Line Source preprocess_ldas.x 0000000000D5C56E Unknown Unknown Unknown libpthread-2.11.3 00002AAAB5897850 Unknown Unknown Unknown preprocess_ldas.x 0000000000475C53 ldas_tilecoordrou 403 LDAS_TileCoordRoutines.F90 preprocess_ldas.x 000000000041ED60 createf2g_ 208 preprocess_ldas.F90 preprocess_ldas.x 000000000041BAFE MAIN__ 86 preprocess_ldas.F90 > interactive.py -A sp3 -n 84 -a g0620 -X --debug > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run > module load tool/arm-forge-19.0.3 > ./lenkf.j 2 > module load tool/tview-2018.0.5 > ./lenkf.j 1 Neither worked. ========== 20190830: 1. August report. 2. Continued working on GEOSldas with CLM4.5: (1) Debugging: > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1 > mv build build1 > ln -s /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install-Debug build > interactive.py -A sp3 -n 84 -a g0620 -X --debug > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run > ./lenkf.j Integer*4 Resource Parameter CHOOSEMOSFC: 0 Character Resource Parameter LNFM_FILE: ../input/lnfm.data forrtl: error (182): floating invalid - possible uninitialized real/complex variable. Image PC Routine Line Source GEOSldas.x 0000000006F6B67E Unknown Unknown Unknown libpthread-2.11.3 00002AAAB5898850 Unknown Unknown Unknown GEOSldas.x 0000000005DF70DB geos_catchcngridc 7421 GEOS_CatchCNGridComp.F90 GEOSldas.x 0000000005D04403 geos_catchcngridc 4905 GEOS_CatchCNGridComp.F90 L7421 GEOS_CatchCNGridComp.F90: albdir(:,nv) = albvr(:)*(1.-fsnow(:)) + snovr(:)*fsnow(:) This line is under the "do nv = 1,num_veg" loop. Should "num_veg" be nveg? No. nveg = num_veg in the code. Added print statements and finally found that snovr and snovf are NaN. Need to add this blow below right before the line "albdir(:,nv) = albvr(:)*(1.-fsnow(:)) + snovr(:)*fsnow(:)": call SNOW_ALBEDO(ntiles, N_snow, N_CONST_LAND4SNWALB, ityp_tmp, & elaz(:,nv), ZTH, & RHOFS, & SNWALB_VISMAX, SNWALB_NIRMAX, SLOPE, & WESNN, HTSNNN, SNDZN, & ALBVR, ALBNR, ALBVF, ALBNF, & ! instantaneous snow-free albedos on tiles SNOVR, SNONR, SNOVF, SNONF, & ! instantaneous snow albedos on tiles RCONSTIT, UUU, TPSN1OUT1, DRPAR, DFPAR) Fixed this. Now the issue is in L423 compute_rc.F90. fort: (2): Subscript #2 of the array PARSUN has value 5 which is greater than the upper bound of 4 It's because I put this block below in the wrong place: if(present (fpar_sf)) then ! scaling to match MODIS FPAR parsun(n,nv) = parsun(n,nv) * fpar_sf(n,nv) ! sunlit canopy PAR for leaves per vai parsha(n,nv) = parsha(n,nv) * fpar_sf(n,nv) ! shaded canopy PAR for leaves per vai endif ! save leaf-absorbed PAR for FPAR calculation parabs(n,nv) = parsun(n,nv) * laisun(n,nv) + parsha(n,nv) * laisha(n,nv) Fixed this. It's running! Great! Stopped it at 1980-01-01T09:00:00. (2) Recompile: > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas > ./parallel_build.csh No need to clean. The new executable will be in install/bin. (3) Start the run: > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1 > mv build build2 > mv build1 build > ls -l lrwxrwxrwx 1 fzeng g0620 62 2019-08-29 10:38 build -> /gpfsm/dnb31/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install/ > ls -l build/bin/GEOSldas.x -rwxr-xr-x 1 fzeng g0620 66169420 2019-08-30 15:33 build/bin/GEOSldas.x* > cd run > nedit CAP.rc & BEG_DATE: 19800101 000000 END_DATE: 20190101 000000 JOB_SGMT: 00000600 000000 NUM_SGMT: 8 > interactive.py -A sp3 -n 84 -a g0620 -X --debug > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_test1/run > ./lenkf.j Crashed: Time ----------------------------------- 1980-01-01T15:00:00 end Time ------------------------------- get_forcing(): assuming GEOS-5 forcing data set opening file: ../input/met_forcing/MERRA2_land_forcing/precip_corr_CPCUGPCP22cl im_MERRA2_BMTXS//MERRA2_100/diag/Y1980/M01/MERRA2_100.tavg1_2d_lfo_Nx_corr.1980 0101_1530z.nc4 LDAS ERROR (3000) from repair_forcing: Tair too low LDAS ERROR (3000) from repair_forcing: Tair too low forrtl: error (78): process killed (SIGTERM) Image PC Routine Line Source GEOSldas.x 000000000189BC2E Unknown Unknown Unknown libpthread-2.11.3 00002AAAB5898850 Unknown Unknown Unknown libmlx5-rdmav2.so 00002AAABF24E712 Unknown Unknown Unknown mca_btl_openib.so 00002AAAC1267F91 Unknown Unknown Unknown libopen-pal.so.40 00002AAAB8A15CF4 opal_progress Unknown Unknown libmpi.so.40.10.1 00002AAAB3EF0D44 ompi_request_defa Unknown Unknown libmpi.so.40.10.1 00002AAAB3F4D84F ompi_coll_base_ba Unknown Unknown libmpi.so.40.10.1 00002AAAB3F07881 MPI_Barrier Unknown Unknown libesmf_fullylink 00002AAAB1B19CFF c_esmc_vmbarrier_ Unknown Unknown libesmf_fullylink 00002AAAB2164EB1 esmf_vmmod_mp_esm Unknown Unknown GEOSldas.x 000000000054ADD6 mapl_capgridcompm 1055 MAPL_CapGridComp.F90 GEOSldas.x 000000000054A9AE mapl_capgridcompm 998 MAPL_CapGridComp.F90 GEOSldas.x 000000000054A663 mapl_capgridcompm 720 MAPL_CapGridComp.F90 Tried re-setting up the run. > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install/bin > ls -l GEOSldas.x -rwxr-xr-x 1 fzeng g0620 66169420 2019-08-30 15:33 GEOSldas.x* > cp test_batinp.txt /discover/nobackup/fzeng/Catchment/M2n5P/run/GEOSldas4.5_DE720.bat > cp test_exeinp.txt /discover/nobackup/fzeng/Catchment/M2n5P/run/GEOSldas4.5_DE720.exe > cd /discover/nobackup/fzeng/Catchment/M2n5P/run > nedit GEOSldas4.5_DE720.exe & EXP_ID : GEOSldas4.5_DE720 EXP_DOMAIN : global NUM_ENSEMBLE : 1 BEG_DATE : 19800101 000000 END_DATE : 20190101 000000 JOB_SGMT : 00010000 000000 NUM_SGMT : 4 > cd /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/clm4.5/GEOSldas/install/bin > source g5_modules > ./ldas_setup setup --runmodel /discover/nobackup/fzeng/Catchment/M2n5P/ /discover/nobackup/fzeng/Catchment/M2n5P/run/GEOSldas4.5_DE720.exe /discover/nobackup/fzeng/Catchment/M2n5P/run/GEOSldas4.5_DE720.bat creating dir structure creating restart and bc Correct the tile file if it is an old EASE tile format... cmd: ./preprocess_ldas.x correctease /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global/rc_out//DE_00720x00360_PE_0720x0360.til /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global/rc_out//MAPL_DE_00720x00360_PE_0720x0360.til Creating f2g.txt.... cmd: ./preprocess_ldas.x c_f2g /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global/rc_out//DE_00720x00360_PE_0720x0360.til LDAS_domain_def.nml /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/clsm/catchment.def GEOSldas4.5_DE720 198001010000 50.0 Creating domain..., reading white and black lists if there have ones... Finish domain setup... SURFLAY: 50.00000 Writing catparam file : /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE 720/output/global/rc_out///Y1980/M01/GEOSldas4.5_DE720.ldas_catparam.19800101_0 000z.bin linking bcs... Creating and lining restart... cmd: ./process_rst.csh g0620 GEOSldas4.5_DE720 /discover/nobackup/fzeng/Catchment/M2n5P /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/ DE_00720x00360_PE_0720x0360.til 2 1 19800101 clm4.5_DE720_57 global /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/ 1 0 WARNING : no file /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5//clm4.5_DE720_57/output/global//rc_out/clm4.5_DE720_57.ldas_tilecoord.bin. DEFAULT GEOSldas restart Please hold on for a while until the restart file is created ..... restart: 1 catchRstFile1: /discover/nobackup/fzeng/clm4-to-clm4.5/LDAS/tests/clm4.5/clm4.5_DE720_57/output/global/rs/ens0000/Y1980/M01/clm4.5_DE720_57.catchcn_internal_rst.19800101_0000 catchRstFile: /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global/rs/ens0000/Y1980/M01/GEOSldas4.5_DE720.catchcn_internal_rst.19800101_0000 Updating restart path... creating RC Files Optimizing... decomposition of processes.... cmd: ./preprocess_ldas.x optimize /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/input/tile.data 84 avg_land 806 re adjust the avg_land 754 rms rate: 193.0000 land_distribute: 768 761 765 755 756 782 846 858 803 847 803 836 834 843 864 835 801 947 826 760 872 877 845 843 761 756 758 757 763 832 779 770 828 784 834 756 755 755 825 837 837 818 770 919 890 817 786 825 762 875 754 800 779 778 763 854 813 783 785 828 778 779 878 826 779 780 790 862 805 814 783 760 800 848 824 762 841 837 844 828 798 774 783 618 ['/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/build/etc/GEOSldas_CAP.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/build/etc/GEOSldas_ExtData.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/build/etc/GEOSldas_HIST.rc', '/discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/build/etc/GEOSldas_LDAS.rc'] CAP.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/run ExtData.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/run HIST.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/run ./process_hist.csh 2 0 EASE PE720x360-DE /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/run/HISTORY.rc 0 0 0 PE720x360-DE LDAS.rc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/build/etc /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/run creating gcm style batch Run scripts lenkf.j Experiment directory: /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720 creating batch Run scripts > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720 Checked executable and restart: > ls -l build/bin/GEOSldas.x -rwxr-xr-x 1 fzeng g0620 66169420 2019-08-30 15:33 build/bin/GEOSldas.x > ls -l input/restart/ lrwxrwxrwx 1 fzeng g0620 146 2019-08-30 16:14 catchcn_internal_rst -> /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global/rs/ens0000/Y1980/M01/GEOSldas4.5_DE720.catchcn_internal_rst.19800101_0000 lrwxrwxrwx 1 fzeng g0620 121 2019-08-30 16:14 vegdyn_internal_rst -> /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global/rs/ens0000/GEOSldas4.5_DE720.vegdyn_internal_rst Preparation: > cd run HISTORY.rc: Modified according to GEOSldas4.5_test1/run/HISTORY.rc LDAS.rc: Added to the end (L53): LNFM_FILE: ../input/lnfm.data Other preparation: > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global/rc_out/ > cp /discover/nobackup/fzeng/bcs/Icarus-NL/Icarus-NL_Reynolds/DE_00720x00360_PE_0720x0360/lnfm_clim_720x360_DE.data . > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/input/ > ln -s /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/output/global/rc_out/lnfm_clim_720x360_DE.data lnfm.data Test: > interactive.py -A sp3 -n 84 -a g0620 -X --debug > cd /discover/nobackup/fzeng/Catchment/M2n5P/GEOSldas4.5_DE720/run > cp lenkf.j lenkf.j.orig > nedit lenkf.j & Add "exit" after L284 "mpirun -map-by core --mca btl ^vader -np $numprocs $GEOSBIN/GEOSldas.x" > ./lenkf.j It's running. Stopped it at 1980-01-02T04:30:00. Submit the full jobs: > mv lenkf.j.orig lenkf.j > ./ldas_batchrun.j