========== 20171101: 1. The CTco2_3hrly_dco2sc_dryL_ctrl_d_rst and CTco2_3hrly_dco2sc_dryS_ctrl_d_rst runs were not done correctly. Sarith pointed out that I should call CN_init from process_cn.F90 at the beginning of each day to pass what the driver read for CNCOL and CNPFT from CTRL to catchCN. He is completely right! This is the bug! Fixed the bug. See /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2/process_cn.F90.dCO2SC_L_r_daily_rst For the CTco2_3hrly_dco2sc_dryL_ctrl_d_rst_YYYY runs: /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp clsm_ensdrv_init_routines.F90.r_daily_rst ../clsm_ensdrv_init_routines.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp cnlsm_ensdrv_main.F90.r_daily_rst_L /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Applications/LDAS_App/cnlsm_ensdrv_main.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp ens_driver_routines.F90.dryL ../ens_driver_routines.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp process_cn.F90.dCO2SC_L_r_daily_rst ../process_cn.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp compute_rc.F90 ../../GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/. Save a copy of the Linux directory: /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3 > /bin/cp -pr Linux/ exec/M2n5P_m0002CTco2_dco2sc_dryL_ctrl_d_rst/. Followed (14) in /discover/nobackup/fzeng/Catchment/M2n5P/m0002/README to set up the runs (2001-2014). 2. Compiled the code for CTco2_3hrly_dco2sc_dryS_ctrl_d_rst_YYYY runs. /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp clsm_ensdrv_init_routines.F90.r_daily_rst ../clsm_ensdrv_init_routines.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp cnlsm_ensdrv_main.F90.r_daily_rst_S /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Applications/LDAS_App/cnlsm_ensdrv_main.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp ens_driver_routines.F90.dryS ../ens_driver_routines.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp process_cn.F90.dCO2SC_S_r_daily_rst ../process_cn.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/M2n5P_m0002CTco2 > cp compute_rc.F90 ../../GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp/. Save a copy of the Linux directory: /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3 > /bin/cp -pr Linux/ exec/M2n5P_m0002CTco2_dco2sc_dryS_ctrl_d_rst/. Followed (12) in /discover/nobackup/fzeng/Catchment/M2n5P/m0002/README to set up the runs (2001-2014). 3. Processed the output: modified grid_restore_DC0576xPC0361_monthly.f90 for region L and ran it. ~/Catchment/M2n5P_m0002 > grid_restore_DC0576xPC0361_monthly CTco2_3hrly_dco2sc_dryL_ctrl_d_rst CTco2_3hrly_dco2sc_dryL_ctrl_d_rst_2001 4. Made plots using ~/Catchment/M2n5P_m0002/compare_ts.gs. ========== 20171102: 1. Processed the output: modified grid_restore_DC0576xPC0361_monthly.f90 for region S and ran it. ~/Catchment/M2n5P_m0002 > grid_restore_DC0576xPC0361_monthly CTco2_3hrly_dco2sc_dryS_ctrl_d_rst CTco2_3hrly_dco2sc_dryS_ctrl_d_rst_2001 2. Made plots using ~/Catchment/M2n5P_m0002/compare_ts.gs. 3. Restored the 5 files: /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > cp clsm_ensdrv_init_routines.F90.restore clsm_ensdrv_init_routines.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > cp ens_driver_routines.F90.restore ens_driver_routines.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > cp process_cn.F90.restore process_cn.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Applications/LDAS_App > cp cnlsm_ensdrv_main.F90.restore cnlsm_ensdrv_main.F90 /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSsurface_GridComp/GEOSland_GridComp/GEOScatchCN_GridComp > cp compute_rc.F90.restore compute_rc.F90 4. Investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. 5. GMAO Carbon Meeting #10. ========== 20171103: 1. Small modeling group meeting 2. Meeting with Randy and Eunjee. 3. Oct report. 4. Made more plots using ~/Catchment/M2n5P_m0002/compare_ts.gs: eastern and western halves of region S. 5. Investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. ========== 20171106: 1. Updated Higgins rain data through Nov 5, 2017. 2. Processed November forecast. 3. Investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. 4. Met with Melanie to talk about the super high burned area fraction issue in CLM4.5. ========== 20171107: 1. Continued investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. ========== 20171108: 1. Continued investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. ========== 20171109: 1. Continued investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. ========== 20171110: 1. Open enrollment. 2. Python class 3 lecture. ========== 20171111: 1. Python homework #2. ========== 20171113: 1. Continued investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. ========== 20171114: 1. Continued investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. ========== 20171115: 1. Continued investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. 2. Met with Eunjee to discuss the CO2 paper. ========== 20171116: 1. Continued investigating why CLM4.5 GPP is so low. See /discover/nobackup/fzeng/clm4-to-clm4.5/notes/notes_daily. 2. Slides for the presentation. ========== 20171117: 1. Slides for the presentation. 2. Discussed with Eunjee about NBP. Found that Eunjee's 280ppm spinup (c8 is the last cycle) had not reached equilibrium by running the converge.gs script. ========== 20171120: 1. Slides for the presentation. 2. Discussed with Eunjee about NBP. Found that Eunjee's transient CO2 run (tCO2_c1 through c7?) using annual CO2 from EEA actually did not start from the end of c8, but from the end of c2. This can be told from the time stamps of the directories. That's why we see a jump in NBP from c8 to tCO2_c1. ========== 20171121: 1. Slides for the presentation. 2. Discussed with Eunjee about NBP. Compared the labor, compute time and disk space needed for two options: (1) extend the 280ppm run until it reaches equilibrium and then do the transient run and the experiments. (2) do the experiments on EASEv2 M09 grids using the restart file from my M09 transient CO2 run. -- This will take at least 2.5T of disk space. 3. Met with Randy and Eunjee to talk about the slides, the NBP issue in 2, and Eunjee's AGCM results. ========== 20171122: 1. Modified the driver and set up the run to repeat the last cycle in the transient CO2 run to write out daily mean rzmc, apar and ipar only (no other fields). Daily mean rzmc will be needed later in the run that uses SMAP soil moisture percentiles. Daily mean apar and ipar are for Sarith to compute daily FPAR. (1) Made sure that all the files that I once modified for other experiments are the default ones. /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > xdiff clsm_ensdrv_init_routines.F90 clsm_ensdrv_init_routines.F90.restore & /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > xdiff clsm_ensdrv_out_routines.F90 clsm_ensdrv_out_routines.F90.restore & /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > xdiff ens_driver_routines.F90 ens_driver_routines.F90.restore & /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > xdiff process_cn.F90 process_cn.F90.restore & /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Applications/LDAS_App > xdiff cnlsm_ensdrv_main.F90 cnlsm_ensdrv_main.F90.restore & They are already the default ones. (2) Modified the code following Greg's files in /discover/nobackup/gkwalker/LDASsa_m3-15_2-CN/src/Components/GEOSlana_GridComp/e0004s-wet2. (2.1) clsm_ensdrv_out_routines.F90: In /discover/nobackup/gkwalker/LDASsa_m3-15_2-CN/src/Components/GEOSlana_GridComp/e0004s-wet2/clsm_ensdrv_out_routines.F90: tile_data(n,1) = cat_diagS_avg(n)%rzmc So volumetric (instead of % saturation) rzmc will be saved. /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > cp clsm_ensdrv_out_routines.F90 e0004s_wet2/. /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/e0004s_wet2 > nedit clsm_ensdrv_out_routines.F90 & In driver_inputes_M09_GLOBAL.nml: out_collection_ID = 1 (2.2) clsm_ensdrv_init_routines.F90: discover07:/discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/e0004s_wet2 > cp ../clsm_ensdrv_init_routines.F90 . discover07:/discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/e0004s_wet2 > nedit clsm_ensdrv_init_routines.F90 & Only one change: Changed "N_out_fields_inst = 44 " to "N_out_fields_inst = 1 ". This is the number Catchment fields to write out. (2.3) clsm_ensdrv_glob_param.F90: discover07:/discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/e0004s_wet2 > cp ../clsm_ensdrv_glob_param.F90 . discover07:/discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/e0004s_wet2 > nedit clsm_ensdrv_glob_param.F90 & Two changes: Changed "N_CatchCN_OutFields = 36" to "N_CatchCN_OutFields = 2". This is the number CN fields to write out. Changed "N_bits_shaved = 12 " to "N_bits_shaved = 0 ", following what Greg did. (2.4) process_cn.F90 and compute_rc.F90: /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp > cp -p e0004s_transientCO2/process_cn.F90 e0004s_wet2/. /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/Components/GEOSlana_GridComp/e0004s_wet2 > cp -p ../e0004s_transientCO2/compute_rc.F90 . (3) Compiled the code: "gmake clean" and "gmake install" in GEOScatchCN_GridComp, GEOSlana_GridComp, and Applications_LDAS_App. (4) Set up the run following the steps for setting up e0004s_transientCO2_05 back in July 10th, 2017: (4.1) Recovered the e0004s_transientCO2_04 from ARCHIVE: took a while /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09 > cp /archive/u/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_04.tgz . /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09 > tar xf e0004s_transientCO2_04.tgz (4.2) Created files needed: cd /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/run cp M09_CN_e0004s_transientCO2.exe M09_CN_e0004s_wet2.exe cp M09_e0004s_transientCO2.bat M09_e0004s_wet2.bat nedit M09_CN_e0004s_wet2.exe & Only changed exp_id. Double-checked restart_path: correct! restart_path = /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_04/output/ nedit M09_CN_e0004s_wet2.bat & (only changed the job name) nedit driver_inputs_M09_GLOBAL.nml & out_select_ensavg%tile%daily = .true. ! paths to parameters (boundary conditions) - "resolution" will be appended by LDASsa veg_path = '/discover/nobackup/ltakacs/bcs/Icarus-NL/Icarus-NL_EASE/' alb_path = '/discover/nobackup/ltakacs/bcs/Icarus-NL/Icarus-NL_EASE/' soil_path = '/discover/nobackup/ltakacs/bcs/Icarus-NL/Icarus-NL_EASE/' top_path = '/discover/nobackup/ltakacs/bcs/Icarus-NL/Icarus-NL_EASE/' mwRTM_param_path = '' tile_coord_path = '/discover/nobackup/ltakacs/bcs/Icarus-NL/Icarus-NL_EASE/' catchment_def_path = '/discover/nobackup/ltakacs/bcs/Icarus-NL/Icarus-NL_EASE/' tile_coord_file = 'SMAP_EASEv2_M09_3856x1624.til' catchment_def_file = 'catchment.def' (4.3) Run ldsetup to set up the experiment: cd /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/exec/e0004s_wet2/Linux/bin source /discover/nobackup/fzeng/LDASsa_m3-16_0_p2_CatchCatchCN_for_MERRA3/src/g5_modules ./ldsetup setup /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09 /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/run/M09_CN_e0004s_wet2.exe /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/run/M09_e0004s_wet2.bat --runmodel --monthsperjob 10 --landmodel catchCN (NOTE: don't use the "--submit" option because we need to modify the job scripts, see below) Check the executable and restart file: cd /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_wet2 ls -l build/Linux/bin/LDASsaCN_mpi.x (to make sure the executable is the right one) -rwxr-xr-x 1 fzeng g0620 69683812 2017-11-22 13:11 build/Linux/bin/LDASsaCN_mpi.x* ls -l input/restart/ (to make sure the restart file is the right one) lrwxrwxrwx 1 fzeng g0620 80 2017-11-22 14:36 output -> /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_04/output/ Copy year_co2.txt and the *all.txt files from previous cycle: cd /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_04/run cp -p year_co2.txt *all.txt /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_wet2/run/. cd /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_wet2/run Check if these files are correct, particularly year_co2.txt! cat year_co2.txt (to make sure the year of CO2 is correct) 1981 (correct!) nedit *all.txt & nedit driver_inputs_M09_GLOBAL.nml & (to check if the output frequency and BCs directory are correct.) Modify the job scripts before submission: Under /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_wet2/run: mkdir ../lenkf_orig (Important: lenkf_orig has to be one level up. Otherwise the lenkf.*.j files in lenkf_orig will be counted by edit_lenkf.csh) cp -p lenkf.*.j ../lenkf_orig/. cp ../../e0004s_transientCO2_04/run/edit_lenkf.csh . ./edit_lenkf.csh Check the lenkf.*.j files and they look correct. Did an interactive run to make sure it runs. It's running. Stopped it at date_time_new 19810103_074500z. It wrote out e0004s_wet2.ens_avg.ldas_tile_daily_out.19810101.bin and e0004s_wet2.ens_avg.ldas_tile_daily_out.19810102.bin. Good! Checked the 1st restart file. However, Files e0004s_wet2.ens0000.catchcn_ldas_rst.19810101_0000z and /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_05/output/SMAP_EASEv2_M09_GLOBAL/rs/ens0000/Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z differ Why are they different? They are supposed to be the same. discover32:/discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_wet2 > ls -l input/restart/ total 0 lrwxrwxrwx 1 fzeng g0620 80 2017-11-22 14:36 output -> /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_04/output/ discover32:/discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_05 > ls -l input/restart/ total 0 lrwxrwxrwx 1 fzeng g0620 80 2017-07-10 14:05 output -> /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_04/output/ ls -l /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_04/output/SMAP_EASEv2_M09_GLOBAL/rs/ens0000/ total 0 drwxr-xr-x 3 fzeng g0620 512 2017-07-10 14:03 Y1981/ drwxr-xr-x 3 fzeng g0620 512 2017-06-20 10:39 Y2017/ e0004s_wet2/run/M09_CN_e0004s_wet2.exe and e0004s_transientCO2_05/run/M09_CN_e0004s_transientCO2.exe only differs in exp_id. e0004s_wet2/run/M09_e0004s_wet2.bat and e0004s_transientCO2_05/run/M09_e0004s_transientCO2.bat only differs in job-name. Both e0004s_wet2 and e0004s_transientCO2_05 start from 1981-01-01, so they should be both using the e0004s_transientCO2_04/output/SMAP_EASEv2_M09_GLOBAL/rs/ens0000/Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z. e0004s_wet2 log file (printed out on screen): restart and experiment domains are identical Reading restart file ../input/restart/output/SMAP_EASEv2_M09_GLOBAL//rs/ens0000//Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z Writing restart (or incr) file ../output/SMAP_EASEv2_M09_GLOBAL//rs/ens0000//Y1981/M01/e0004s_wet2.ens0000.catchcn_ldas_rst.19810101_0000z /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_wet2/run > ls -l ../input/restart/output/SMAP_EASEv2_M09_GLOBAL//rs/ens0000//Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z lrwxrwxrwx 1 fzeng g0620 75 2017-07-10 14:04 ../input/restart/output/SMAP_EASEv2_M09_GLOBAL//rs/ens0000//Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z -> ../../Y2017/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.20170101_0000z e0004s_transientCO2_05 log file: restart and experiment domains are identical Reading restart file ../input/restart/output/SMAP_EASEv2_M09_GLOBAL//rs/ens0000//Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z Writing restart (or incr) file ../output/SMAP_EASEv2_M09_GLOBAL//rs/ens0000//Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z /discover/nobackup/fzeng/Catchment/SMAP_EASEv2_M09/e0004s_transientCO2_05/run > ls -l ../input/restart/output/SMAP_EASEv2_M09_GLOBAL//rs/ens0000//Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z lrwxrwxrwx 1 fzeng g0620 75 2017-07-10 14:04 ../input/restart/output/SMAP_EASEv2_M09_GLOBAL//rs/ens0000//Y1981/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.19810101_0000z -> ../../Y2017/M01/e0004s_transientCO2.ens0000.catchcn_ldas_rst.20170101_0000z Emailed Sarith about this. He said: I think you are fine CH is not being used, that aside 4 out of 1684725 ARW parameters - you are good for sure 001-02-01 21:00:00 0 1684725 0 3 : T T 0.33326 0.57445 : ARW1 9 : 2001-02-01 21:00:00 0 1684725 0 4 : F F 4.6857 0.97841 : ARW2 10 : 2001-02-01 21:00:00 0 1684725 0 4 : T F 0.011666 0.74912 : ARW3 11 : 2001-02-01 21:00:00 0 1684725 0 4 : F F 0.0098952 0.047452 : ARW4 28 : 2001-02-01 21:00:00 0 6738900 0 1684726 : F T 4397.0 0.0000 : CH qsub lenkf.0.j NOTE: for this wet2 run, (1) Need to use edit_lenkf.csh to add these lines below to the end of each job file lenkf.N.j (as above): cat year_ts.txt >> year_ts_all.txt cat EEAco2g_ts.txt >> EEAco2g_ts_all.txt cat co2_scalar_ts.txt >> co2_scalar_ts_all.txt qsub lenkf.N+1.j (2) Need to copy edit_lenkf.csh, year_co2.txt, year_ts_all.txt, EEAco2g_ts_all.txt and co2_scalar_ts_all.txt from e0004s_transientCO2_04. 2. Helped Eunjee set up her 280ppm spinup run. 3. Hi Fanwei Please copy the below 2 files to your src directory: /discover/nobackup/smahanam/process_seasonal_forecast.csh /discover/nobackup/smahanam/s2s_fcast.pro Then actually use a high memory node (15-18 I guess) ssh discover15 or ssh discover16 or ssh discover17 or ssh discover18 from your terminal You might need to edit the last line of process_seasonal_forecast.csh to where you want to copy the pdf file (you also need password less ssh to that machine) the plot and the log file will be in the plots directory then ./process_seasonal_forecast.csh (for new forecast for this month) ./process_seasonal_forecast.csh -v fortuna (for old fortuna forecast this month) ./process_seasonal_forecast.csh -v fortuna -d 201710 (for old october forecast) ./process_seasonal_forecast.csh -d 201711 (for new november forecast) It is not ready, I still see some bugs that need to be fixed (Greg might ask you to make some changes and write a log file), just good enough for you to get familiarize Anyway, we need this in the 1st week of Dec, I have plenty of time to finish the last remaining part Happy thanks giving Sarith (3.1) cd ~/geos5/GEOS5_s2s/src cp -p /discover/nobackup/smahanam/process_seasonal_forecast.csh . cp -p /discover/nobackup/smahanam/s2s_fcast.pro . Tried ./process_seasonal_forecast.csh -d 201711 Failed. It seems that I exceeded my quota. Maybe it's writing data to my home directory. (3.2) /discover/nobackup/fzeng > /bin/cp -pr /home/fzeng/geos5/GEOS5_s2s . /discover/nobackup/fzeng/GEOS5_s2s/src > ./process_seasonal_forecast.csh -d 201711 Failed again. See below. SLES11SP1: bash/sh/ksh users: remember to run 'ulimit -s 6000000' and 'ulimit -v unlimited' csh/tcsh users: remember to run 'limit stacksize 6000000' and 'limit vmemoryuse unlimited' SLES11SP3: bash/sh/ksh users: remember to run 'ulimit -s unlimited' and 'ulimit -v unlimited' csh/tcsh users: remember to run 'limit stacksize unlimited' and 'limit vmemoryuse unlimited' IDL Version 8.5 (linux x86_64 m64). (c) 2015, Exelis Visual Information Solutions, Inc., a subsidiary of Harris Corporation. Installation number: 8144. Licensed for use by: Skaters Anonymous % Compiled module: PLOT_S2S_MAPS. % Compiled module: PLOT_ANOM. % Compiled module: COMPUTE_W2_PERC. % Compiled module: PLOT_W2_MAPS. % Compiled module: COLORBAR. % Compiled module: LOAD_COLORS. % Compiled module: SP. % Compiled module: CLOSEPS. % TVLCT: Unable to connect to X Windows display: :0.0 % TVLCT: Unable to open X Windows display. Is your DISPLAY environment variable set correctly? % Execution halted at: LOAD_COLORS 433 /gpfsm/dnb31/fzeng/GEOS5_s2s/src/s2s_fcast.pro % PLOT_S2S_MAPS 19 /gpfsm/dnb31/fzeng/GEOS5_s2s/src/s2s_fcast.pro % $MAIN$ Error: /undefinedfilename in (idl.ps) Operand stack: Execution stack: %interp_exit .runexec2 --nostringval-- --nostringval-- --nostringval-- 2 %stopped_push --nostringval-- --nostringval-- --nostringval-- false 1 %stopped_push Dictionary stack: --dict:1169/3371(ro)(G)-- --dict:0/20(G)-- --dict:70/200(L)-- Current allocation mode is local Last OS error: 2 GPL Ghostscript 8.62: Unrecoverable error, exit code 1 /bin/rm: cannot remove `idl.ps': No such file or directory (3.3) Tried this: ssh -Y discover15 limit stacksize unlimited limit vmemoryuse unlimited cd /discover/nobackup/fzeng/GEOS5_s2s/src ./process_seasonal_forecast.csh -d 201711 Failed again. See below. SLES11SP1: bash/sh/ksh users: remember to run 'ulimit -s 6000000' and 'ulimit -v unlimited' csh/tcsh users: remember to run 'limit stacksize 6000000' and 'limit vmemoryuse unlimited' SLES11SP3: bash/sh/ksh users: remember to run 'ulimit -s unlimited' and 'ulimit -v unlimited' csh/tcsh users: remember to run 'limit stacksize unlimited' and 'limit vmemoryuse unlimited' IDL Version 8.5 (linux x86_64 m64). (c) 2015, Exelis Visual Information Solutions, Inc., a subsidiary of Harris Corporation. Installation number: 8144. Licensed for use by: Skaters Anonymous % Compiled module: PLOT_S2S_MAPS. % Compiled module: PLOT_ANOM. % Compiled module: COMPUTE_W2_PERC. % Compiled module: PLOT_W2_MAPS. % Compiled module: COLORBAR. % Compiled module: LOAD_COLORS. % Compiled module: SP. % Compiled module: CLOSEPS. libGL error: failed to load driver: swrast libGL error: Try again with LIBGL_DEBUG=verbose for more details. % Loaded DLM: NCDF. % Compiled module: MAP_SET. % Compiled module: MAP_CONTINENTS. mv: `idl.ps' and `idl.ps' are the same file mv idl.ps idl.ps <-DONE % Program caused arithmetic error: Floating underflow Actually the /discover/nobackup/fzeng/GEOS5_s2s/plots/GEOS5_oct28_S2S-2_1.pdf was already generated. Sarith said Maybe These two lines are not needed limit stacksize unlimited limit vmemoryuse unlimited ========== 20171124: 1. Checked the e0004s_wet2 run. The EEAco2g_ts_all.txt, co2_scalar_ts_all.txt, and year_ts_all.txt look correct. Created ~/Catchment/SMAP_M09/tile2grid_ease_spinup_wet2_daily.f90 and processed the available output: ~/Catchment/SMAP_M09 > tile2grid_ease_spinup_wet2_daily e0004s_wet2 Created ~/Catchment/SMAP_M09/plot_wet2.gs and made plots of rzmc and FPAR for 15Aug1983. 2. Worked on the slides based on Randy's suggestions. ========== 20171127: 1. Worked on the slides based on Randy's suggestions. ========== 20171128: 1. Worked on the slides based on Randy's suggestions. 2. Met with Randy and continued working on the slides based on Randy's new suggestions. 3. Python class. ========== 20171129: 1. Discover nodes had some problem. They were restored around lunch time and the e0004s_wet2 run resumed by itself. The EEAco2g_ts_all.txt, co2_scalar_ts_all.txt, and year_ts_all.txt look correct. 2. Continued working on the slides based on Randy's new suggestions. 3. Python HW3. ========== 20171130: 1. Continued meeting with Randy and working on the slides. 2. Python HW3.