wiki:access/T-AMIP_GA6N96cable


    1. ACCESS GA6 N96L85(CABLE) Transpose-AMIP II procedure
        1. 0: Get the necessary scripts and datasets on raijin
        2. 1: Create a ACCESS 1.3 N96L38 (A13) climatology of CABLE lsm fields …
        3. 2: Create a GA6 lsm climatology from the A13 CABLE lsm climatology …
        4. 3: Create ACCESS GA6 N96L85(CABLE) T-AMIP ic dumps using this …
        5. 4: Create ACCESS GA6 N96L85(CABLE) T-AMIP 5day hindcasts using these …
        6. 5: Example outputs from ACCESS GA6 N96L85(CABLE) T-AMIP 5day hindcasts …
        7. 6: Transpose-AMIP documentation

ACCESS GA6 N96L85(CABLE) Transpose-AMIP II procedure

The CABLE version of GA6 N96L85 T-AMIP employs the same setup procedures and many input data files (ancillaries, ERA-Interim,...) as the JULES version so please see GA6 N96L85(JULES) Transpose-AMIP II procedure for details.

If you just want to run the T-AMIP experiment, then you only need to do step 4
as the earlier steps used to create the ic dump files have already been done and the relevant outputs, scripts and datasets saved to /projects/access/AMEL/TransposeAMIPII/ga6cable/ic

Here we will show the extra steps required to setup the CABLE version of ACCESS GA6 N96L85 T-AMIP given that we already have the files needed for the JULES version. The main difference with the CABLE setup is that we need to create an appropriate CABLE land surface scheme (lsm) climatology. The steps are:

  • 0: Obtain the scripts, datasets and directories for the procedure
  • 1: Convert required CABLE fields in AMIP dump files to netcdf
  • 2: Create a CABLE lsm climatology from these netcdf files
  • 3: Use this climatology to create ACCESS GA6 N96L85(CABLE) Transpose-AMIP II ic dump files
  • 4: Run ACCESS GA6 N96L85(CABLE) Transpose-AMIP II 5 day forecasts (hindcasts) for the T-AMIP period using these ic dump files
  • 5: Example outputs from the above steps
  • 6: Further documentation

Note:

  • thu27aug15: This GA6N96L85 CABLE procedure is based on the executable accessdev umui job vaipr obtained from Jhan Srbinovsky in March 2015 which is a trial version known to contain bugs
  • Anyone wishing to run this procedure is using it at your own risk and could you please contact Greg Roff (g.roff@bom.gov.au) for access to the latest ACCESS-CABLE executable

0: Get the necessary scripts and datasets on raijin

ssh -X glr548@raijin.nci.org.au
wdir=/short/dp9/glr548/CABLEtest
mkdir ${wdir}
cd ${wdir}
#get the lsm creation scripts/datasets
 cp /projects/access/AMEL/TransposeAMIPII/ga6cable/ic/scripts/step1_and2_lsm/* .
#get the reconfiguration scripts/datasets and directory standard_recon
 cp -r /projects/access/AMEL/TransposeAMIPII/ga6cable/ic/scripts/step3_recon/* .
#get the run scripts/datasets and directory standard_run
 cp -r /projects/access/AMEL/TransposeAMIPII/ga6cable/ic/scripts/step4_run/* .

Here we login, move to a work directory, get required scripts and datasets to completely setup ACCESS GA6 N96L85(CABLE) T-AMIP (note we use dp9/glr548 as the example project/user and the work dir is wdir=/short/dp9/glr548/CABLEtest). Useful modules to load at this time are: 

  module use ~access/modules
  module load ncl nco cdo netcdf ncview
  module load python/2.7.3 pythonlib/netCDF4 pythonlib/ScientificPython

These scripts/datasets and directories are listed below and discussed in later sections 

step1_and2_lsm:
cmulti_control_ga6.csh       cmulti_um_copy_field_ga6.py_orig  convEXTRAP_ga6.tcl       surfFRACvaked.nc
cmulti_control_ga6_orig      control_a13lsmTOga6lsm.ksh        convert_ga6n96cDUMPtonc  testa0_land_only.nc
cmulti_um_copy_field_ga6.py  control_ga6n96cDUMPtonc           endgame_nx192ny144.grid

step3_recon:
c0um_copy_field.py     run_tamipGA6cable_recon       test.astart_orig    umfile.py           umuisubmit_rcf_std_orig
change_calendar365.py  run_tamipGA6cable_recon_orig  um_fileheaders.py   umfile.pyc
gchange_dump_date.py   standard_recon                um_fileheaders.pyc  umuisubmit_rcf_std

step4_run:
cable_start.ksh_std       run_tamipGA6cable_run       standard_run        umuisubmit_run_std_orig
cable_start.ksh_std_orig  run_tamipGA6cable_run_orig  umuisubmit_run_std

1: Create a ACCESS 1.3 N96L38 (A13) climatology of CABLE lsm fields from A13 AMIP dump files = ts_A.nc

cd ${wdir}
emacs control_a13lsmTOga6lsm.ksh&
  #change directories to your directories, in my case these are
   sdir='/short/dp9/glr548/CABLEtest'                #our work dir wdir
   ddir='/short/eg3/hqz548/vafva/M'                  #location of the amip dump files
   odir='/short/dp9/glr548/CABLEtest/cableDUMPtoNC'  #dump to netcdf dir for storage 
  #set control parameters
   do_conv='yes'                                     #does dump->netcdf conversion
   do_mean='yes'                                     #calc climatology from netcdf monthly mean files
   do_a13lsmTOga6lsm='yes'                           #jump for now, will be done in step 2
./control_a13lsmTOga6lsm.ksh

Uses scripts: control_a13lsmTOga6lsm.ksh, convert_ga6n96cDUMPtonc and A13 AMIP dump files /short/eg3/hqz548/vafva/M/vafvaa.da*10

The ksh script control_a13lsmTOga6lsm.ksh uses the convsh script convert_ga6n96cDUMPtonc to convert the required land surface fields found in ACCESS 1.3(CABLE) AMIP monthly dump files to netcdf. You will need to edit control_a13lsmTOga6lsm.ksh to point to your work dir (sdir) and where you want the netcdf files created (odir), which in my case is /short/dp9/glr548/CABLEtest/cableDUMPtoNC. The AMIP run has its output in /short/eg3/hqz548/vafva/M (ddir) and monthly dump files for 23 years. You can of course use a different AMIP run to get similar dump files. A list of the 37 CABLE land surface fields required is in convert_ga6n96cDUMPtonc and is: 

#  /projects/access/umdir/vn8.5/ctldata/STASHmaster/STASHmaster_A
#    |Model |Sectn | Item |Name                                |fnum  |name
#   1|    1 |    0 |    9 |SOIL MOISTURE CONTENT IN A LAYER    |   3  | sm
#   1|    1 |    0 |   20 |DEEP SOIL TEMP AFTER TIMESTEP       |  11  | soiltemp
#   1|    1 |    0 |   23 |SNOW AMOUNT OVER LAND AFT TSTP KG/M2|  13  | snowdepth
#   1|    1 |    0 |  215 |FROZEN SOIL MOISTURE FRAC AFTER TS  |  76  | field1386
#   1|    1 |    0 |  301 |SOIL LAYER 1 TEMPERATURE ON TILES   | 115  | temp
#   1|    1 |    0 |  302 |SOIL LAYER 2 TEMPERATURE ON TILES   | 116  | temp_1
#   1|    1 |    0 |  303 |SOIL LAYER 3 TEMPERATURE ON TILES   | 117  | temp_2
#   1|    1 |    0 |  304 |SOIL LAYER 4 TEMPERATURE ON TILES   | 118  | temp_3
#   1|    1 |    0 |  305 |SOIL LAYER 5 TEMPERATURE ON TILES   | 119  | temp_4
#   1|    1 |    0 |  306 |SOIL LAYER 6 TEMPERATURE ON TILES   | 120  | temp_5
#   1|    1 |    0 |  307 |SOIL MOISTURE LAYER 1 (ON TILES)    | 121  | temp_6
#   1|    1 |    0 |  308 |SOIL MOISTURE LAYER 2 (ON TILES)    | 122  | temp_7
#   1|    1 |    0 |  309 |SOIL MOISTURE LAYER 3 (ON TILES)    | 123  | temp_8
#   1|    1 |    0 |  310 |SOIL MOISTURE LAYER 4 (ON TILES)    | 124  | temp_9
#   1|    1 |    0 |  311 |SOIL MOISTURE LAYER 5 (ON TILES)    | 125  | temp_10
#   1|    1 |    0 |  312 |SOIL MOISTURE LAYER 6 (ON TILES)    | 126  | temp_11
#   1|    1 |    0 |  313 |FROZEN SOIL MOIST FRAC LYR 1 (TILES)| 127  | temp_12
#   1|    1 |    0 |  314 |FROZEN SOIL MOIST FRAC LYR 2 (TILES)| 128  | temp_13
#   1|    1 |    0 |  315 |FROZEN SOIL MOIST FRAC LYR 3 (TILES)| 129  | temp_14
#   1|    1 |    0 |  316 |FROZEN SOIL MOIST FRAC LYR 4 (TILES)| 130  | temp_15
#   1|    1 |    0 |  317 |FROZEN SOIL MOIST FRAC LYR 5 (TILES)| 131  | temp_16
#   1|    1 |    0 |  318 |FROZEN SOIL MOIST FRAC LYR 6 (TILES)| 132  | temp_17
#   1|    1 |    0 |  323 |SNOW TEMPERATURE LAYER 1 (ON TILES) | 133  | temp_18
#   1|    1 |    0 |  324 |SNOW TEMPERATURE LAYER 2 (ON TILES) | 134  | temp_19
#   1|    1 |    0 |  325 |SNOW TEMPERATURE LAYER 3 (ON TILES) | 135  | temp_20
#   1|    1 |    0 |  326 |SNOW DENSITY LAYER 1 (ON TILES)     | 136n | temp_21
#   1|    1 |    0 |  327 |SNOW DENSITY LAYER 2 (ON TILES)     | 137n | temp_22
#   1|    1 |    0 |  328 |SNOW DENSITY LAYER 3 (ON TILES)     | 138n | temp_23
#   1|    1 |    0 |  329 |SNOW MEAN DENSITY (ON TILES)        | 139  | temp_24
#   1|    1 |    0 |  330 |SNOW AGE (ON TILES)                 | 140  | temp_25
#   1|    1 |    0 |  331 |FLAG FOR 3 LEVEL SNOW SCHEME (TILED)| 141n | temp_26
#   1|    1 |    0 |  332 |SNOW DEPTH LAYER 1 (ON TILES)       | 142  | temp_27
#   1|    1 |    0 |  333 |SNOW DEPTH LAYER 2 (ON TILES)       | 143  | temp_28
#   1|    1 |    0 |  334 |SNOW DEPTH LAYER 3 (ON TILES)       | 144  | temp_29
#   1|    1 |    0 |  335 |SNOW MASS LAYER 1 (ON TILES)        | 145n | temp_30
#   1|    1 |    0 |  336 |SNOW MASS LAYER 2 (ON TILES)        | 146  | temp_31
#   1|    1 |    0 |  337 |SNOW MASS LAYER 3 (ON TILES)        | 147n | temp_32
#Note:the fnum column holds the fields location if you xconv a A13 dump file, while
#     the name column holds the ame the conversion gives to this field

The script produces, in the odir, monthly netcdf files vafvaa.da*.nc, monthly means of these in A*.nc, and then a climatology of the monthly means ts_A.nc. The va* and A* files take up a bit of room, so are auto deleted in the script after the climatology is created.

2: Create a GA6 lsm climatology from the A13 CABLE lsm climatology ts_A.nc formed in Step 1 = ts_new00.nc

cd ${wdir}
emacs control_a13lsmTOga6lsm.ksh&
  #set control parameters
   do_conv='no'               #does dump->netcdf conversion                    = already done in step 1
   do_mean='no'               #calc climatology from netcdf monthly mean files = already done in step 1
   do_a13lsmTOga6lsm='yes'    #converts A13 lsm climatology to GA6 lsm climatology
./control_a13lsmTOga6lsm.ksh

Uses scripts/datasets: convEXTRAP_ga6.tcl, endgame_nx192ny144.grid, testa0_land_only.nc, surfFRACvaked.nc

The A13 CABLE lsm climatology ts_A.nc created in step 1 is on the new physics grid while for GA6 we need this to be on the endgame grid. This step does this procedure by processing each field via:

  • convEXTRAP_ga6.tcl is a convsh script to extend fields defined over the land out over the oceans (to allow for the different land-sea masks that are used in A13 and GA6)
  • a cdo remapping via nearest neighbor command then regrids the extrapolated A13 field to the GA6 grid defined in the file endgame_nx192ny144.grid
  • the non-tiled fields (sm soiltemp snowdepth field1386) are then interpolated to the GA6 land only mask given by the netcdf file testa0_land_only.nc
    • the snowdepth field has extra special treatment as all its missing values need to be set to 0.
  • all the remaining fields are tiled fields and they are then interpolated to the GA6 surface fraction tiles given by the netcdf file surfFRACvaked.nc
    • the temp_26 [FLAG FOR 3 LEVEL SNOW SCHEME (TILED)] has extra special treatment as it has integer values
  • all missing and fill values are then defined appropriately for later insertion of these fields into a dummy dump file
  • the individual field files are then merged into a single ACCESS GA6 N96L85(CABLE) lsm climatology ts_new00.nc

3: Create ACCESS GA6 N96L85(CABLE) T-AMIP ic dumps using this ts_new00.nc climatology

cd ${wdir}
mkdir ${wdir}/IC
emacs run_tamipGA6cable_recon&
  #set job output to go to your work dir
    #PBS -o /short/dp9/glr548/CABLEtest/out_recon_tamipGA6cable
  #set a T-AMIP date
    for idate in 2009011500; do
  #point preDIR to the work dir you are using and where the scripts are
    preDIR=/short/dp9/glr548/CABLEtest
qsub run_tamipGA6cable_recon

Uses scripts/datasets/dirs: run_tamipGA6cable_recon, test.astart_orig, c0um_copy_field.py, cmulti_control_ga6.csh, cmulti_um_copy_field_ga6.py, change_calendar365.py, gchange_dump_date.py, umuisubmit_rcf_std, standard_recon, umfile.py, um_fileheaders.py, cable_start.ksh and GA6(JULES) T-AMIP ic dump files /projects/access/AMEL/TransposeAMIPII/ga6/ic/ga6tamip*

The run_tamipGA6cable_recon script is a umui runjob script based on umui job vakef which automatically submits a reconfiguration job for any selected T-AMIP dates. Here we do it for one date 2009011500 and before it submits the reconfiguration job it does some pre-processing in your work dir before submitting the job ie:

  • copy test.astart_orig to adum0, where test.astart_orig is a dummy GA6 N96L85(CABLE) dump file (originally from Jhan)
  • copy /projects/access/AMEL/TransposeAMIPII/ga6/ic/ga6tamip* for your given date to adum0era. This is the GA6 N96L85(JULES) T-AMIP ic I have already created for your chosen date which has the ERA-Interim fields already on the endgame grid
  • c0um_copy_field.py is then used to copy from adum0era to adum0 the 13 ERA-Interim fields listed below: 
    #  /projects/access/umdir/vn8.5/ctldata/STASHmaster/STASHmaster_A
#    |Model |Sectn | Item |Name                             
#   1|    1 |    0 |    2 |U COMPNT OF WIND AFTER TIMESTEP     |
#   1|    1 |    0 |    3 |V COMPNT OF WIND AFTER TIMESTEP     |
#   1|    1 |    0 |    4 |THETA AFTER TIMESTEP                |
#   1|    1 |    0 |   10 |SPECIFIC HUMIDITY AFTER TIMESTEP    |
#   1|    1 |    0 |   24 |SURFACE TEMPERATURE AFTER TIMESTEP  |
#   1|    1 |    0 |   49 |SEA-ICE TEMPERATURE AFTER TIMESTEP  |
#   1|    1 |    0 |  253 |DENSITY*R*R AFTER TIMESTEP          |
#   1|    1 |    0 |  255 |EXNER PRESSURE (RHO) AFTER TIMESTEP |
#   1|    1 |    0 |  256 |ADVECTED U CMPT OF WIND AFTER TS    |
#   1|    1 |    0 |  257 |ADVECTED V CMPT OF WIND AFTER TS    |
#   1|    1 |    0 |  506 |LAND SURFACE TEMP AFTER TIMESTEP    |
#   1|    1 |    0 |  507 |OPEN SEA SURFACE TEMP AFTER TIMESTEP|
#   1|    1 |    0 |  508 |SEA-ICE SURFACE TEMP AFTER TIMESTEP |
  • c0um_copy_field.py is then used to copy from adum0era to adum0 the 10 zeroed cloud fields listed below: 
    #  /projects/access/umdir/vn8.5/ctldata/STASHmaster/STASHmaster_A
#    |Model |Sectn | Item |Name                             
#   1|    1 |    0 |   12 |QCF AFTER TIMESTEP                  |
#   1|    1 |    0 |   13 |CONV CLOUD AMOUNT AFTER TIMESTEP    |
#   1|    1 |    0 |   14 |CONV CLOUD BASE LEVEL NO. AFTER TS  |
#   1|    1 |    0 |   15 |CONV CLOUD TOP LEVEL NO. AFTER TS   |
#   1|    1 |    0 |   16 |CONV CLOUD LIQUID WATER PATH        |
#   1|    1 |    0 |  254 |QCL AFTER TIMESTEP                  |
#   1|    1 |    0 |  265 |AREA CLOUD FRACTION IN EACH LAYER   |
#   1|    1 |    0 |  266 |BULK CLOUD FRACTION IN EACH LAYER   |
#   1|    1 |    0 |  267 |LIQUID CLOUD FRACTION IN EACH LAYER |
#   1|    1 |    0 |  268 |FROZEN CLOUD FRACTION IN EACH LAYER |
  • cmulti_control_ga6.csh calls the python script cmulti_um_copy_field_ga6.py, which also uses the scripts umfile.py and um_fileheaders.py to overwrite the lsm fields in adumo with those in the CABLE climatology ts_new00.nc we created in step 1 (a copy of which is also in the scripts dir listed in Step 0).
    • Note: In creating the CABLE lsm climatology for the GA6 setup from the A13 outputs we found that A13 did not have any grid points in Tile 10 while GA6 does, as it uses a different land-sea mask. To overcome this cmulti_um_copy_field_ga6.py has hardwired dummy lsm values which it uses for Tile 10. We intend toovercome this problem at a later date when we have a GA6 N96L85(CABLE) AMIP run which we can get dump files from to create a new CABLE lsm climatology.
  • change_calendar365.py changes the adum0 calendar from 360d to Gregorian
  • gchange_dump_date.py changes the adum0 date to the correct T-AMIP date
  • adum0 is then renamed as ga6n96tamipCABLE{date}_preRECON, and this file is fed into the reconfiguration job
  • soft links are made to point to appropriate SST/SICE and the new reconfig file just created: GA6N96cablesst, GA6N96cableice and GA6N96cable_preRECON, respectively. Note that the SST/SICE files are the same as used for the GA6 JULES T-AMIP experiment.
  • files in the dir standard_recon are edited eg
    • SCRIPT: to refer to the correct T-AMIP date
    • SHARED: to change the solar constant for the T-AMIP period
    • STASHC: to provide different outputs
  • umuisubmit_rcf_std is edited to use the correct single date and wdir and saved as umuisubmit_rcf_{date} which is what is actually submitted via ./umuisubmit_rcf_{date}
  • the qsub run_tamipGA6cable_recon command results in our case in the wdir outputs:
    • adum0era, umuisubmit_rcf_2009011500, and ga6n96tamipCABLE2009-01-15-h00_preRECON files discussed above and which can be deleted
    • soft links GA6N96cablesst, GA6N96cableice, and GA6N96cable_preRECON also discussed above and can be deleted
    • out_recon_tamipGA6cable which is the std output file. Here we can find information such as which ancillary files we use eg: 
      grep 'IO: Open' out_recon_tamipGA6cable |grep anc|sort | uniq -c
      3 IO: Open: /projects/access/data/ancil/access_cm2_N96/cable_vegfrac_1850.anc on unit  12                              
      3 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrclim.rivstor on unit  12                              
      3 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrclim.sulpvolc85 on unit  12                              
      3 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrparm.hydtopmn on unit  12                              
      3 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrparm.hydtopsd on unit  12                              
      4 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrparm.landfrac on unit  12                              
      4 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrparm.mask on unit  12                              
      5 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrparm.orog on unit  12                              
      3 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrparm.rivseq on unit  12                              
      6 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrparm.soil on unit  12                              
      3 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrparm.soil.dust on unit  12
    • vakef/2009011500 which is a dir holding the reconfiguration run files
    • IC/ga6N96Ctamip2009-01-15-h00 which is the ACCESS GA6 N96L85(CABLE) T-AMIP ic dump, which is a copy of vakef/2009011500/vakef.astart

and will be used for the following T-AMIP run job Note: From the out_recon_tamipGA6cable we can see that the runtime info for this job is: 

                        Resource Usage on 2015-08-14 10:51:21.646754:
        JobId:  1885540.r-man2  
        Project: dp9 
        Exit Status: 0 (Linux Signal 0)
        Service Units: 0.02
        NCPUs Requested: 1                              NCPUs Used: 1
                                                        CPU Time Used: 00:01:02
        Memory Requested: 2000mb                        Memory Used: 115mb
                                                        Vmem Used: 2255mb
        Walltime requested: 00:05:00                    Walltime Used: 00:01:18
        jobfs request: 100mb                            jobfs used: 1mb

and we can see that for 1 T-AMIP date the automatic reconfiguration job can run in the express queue, uses 1 processor and takes ~1.5min to run.

4: Create ACCESS GA6 N96L85(CABLE) T-AMIP 5day hindcasts using these ic dump files

cd /short/dp9/glr548/CABLEtest
emacs run_tamipGA6cable_run&
  #set job output to go to your work dir
   #PBS -o /short/dp9/glr548/CABLEtest/out_run_tamipGA6
  #set a T-AMIP date
   for idate in 2009011500; do
  #point preDIR to the work dir you are using and where the scripts are
   preDIR=/short/dp9/glr548/CABLEtest
qsub run_tamipGA6cable_run

Uses scripts/datasets/dirs: run_tamipGA6cable_run, umuisubmit_run_std, cable_start.ksh_std, and standard_run The run_tamipGA6cable_run script is a umui runjob script based on umui job vakei which automatically submits a run job for any selected T-AMIP dates. Here we do it for one date 2009011500 and what it does is:

  • soft links are made to point to appropriate SST/SICE and the new reconfig file just created: GA6N96cablesst, GA6N96cableice and GA6N96cableIC, respectively. Note that the SST/SICE files are the same as used for the GA6 JULES T-AMIP experiment.
  • files in the dir standard_run are edited eg
    • SCRIPT: to refer to the correct T-AMIP date
    • CNTLGEN: is adjusted to use STEPS_PER_PERIODim=72
    • SHARED: to change the solar constant for the T-AMIP period
    • STASHC: to provide different outputs
  • cable_start.ksh_std has the date and wdir changed and saved as cable_start.ksh
  • umuisubmit_run_std is edited to use the correct single date and wdir and saved as umuisubmit_run_{date} which is what is actually submitted via ./umuisubmit_run_{date}
  • the qsub run_tamipGA6cable_run command results in our case in the wdir outputs:
    • umuisubmit_run_2009011500, cable_start.ksh discussed above and which can be deleted
    • soft links GA6N96cablesst, GA6N96cableice, and GA6N96cableIC which point to the SST, SICE and T-AMIP ic dump file created in step 3 above, all can be deleted after the run
    • out_run_tamipGA6 which is the std output file. Here we can find information such as which ancillary files we use eg: 
      grep 'IO: Open' out_run_tamipGA6  |grep anc|sort | uniq -c
      1 IO: Open: /projects/access/AMEL/TransposeAMIPII/ga6/ga6anc/ga6ancBC_hi_RCP45_2000_2100.N96 on unit 139                              
      1 IO: Open: /projects/access/AMEL/TransposeAMIPII/ga6/ga6anc/ga6ancBio_RCP45_2000_2100.N96 on unit  76                              
      1 IO: Open: /projects/access/AMEL/TransposeAMIPII/ga6/ga6anc/ga6ancOCFF_RCP45_2000_2100.N96 on unit 128                              
      1 IO: Open: /projects/access/AMEL/TransposeAMIPII/ga6/ga6anc/ga6ancsulp_RCP45_2000_2100f.N96 on unit 110                              
      1 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrclim.biog85 on unit 154                              
      1 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrclim.ozone_L85_O85 on unit  30                              
      1 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrclim.sulpdms on unit  95                              
      1 IO: Open: /projects/access/data/ancil/access_cm2_N96/qrclim.sulpoxid85 on unit 116
    • vakei/2009011500 which is a dir holding the run 5d hindcast hindcast output files

Note: From the out_run_tamipGA6 we can see that the runtime info for this job is: 

                        Resource Usage on 2015-08-14 13:11:56.101480:
        JobId:  1886830.r-man2  
        Project: dp9 
        Exit Status: 0 (Linux Signal 0)
        Service Units: 21.76
        NCPUs Requested: 256                            NCPUs Used: 256
                                                        CPU Time Used: 01:14:55
        Memory Requested: 512000mb                      Memory Used: 4242mb
                                                        Vmem Used: 12675mb
        Walltime requested: 00:06:40                    Walltime Used: 00:05:06
        jobfs request: 2048mb                           jobfs used: 8mb

and we can see that for 1 T-AMIP date the automatic run job MUST run in the normal queue, uses 256 processors and takes ~6min to run.

5: Example outputs from ACCESS GA6 N96L85(CABLE) T-AMIP 5day hindcasts using these ic dump files

Example outputs from the above procedure have been placed in /projects/access/AMEL/TransposeAMIPII/ga6cable/ic/scripts directories example_lsm example_recon and example_run. These contain the files: 

example_lsm:
total 751708
drwxr-s---+ 2 glr548 access      4096 Aug 14 13:39 cableDUMPtoNC
-rw-r-----+ 1 glr548 access 769739908 Aug 14 13:39 ts_new00.nc
lrwxrwxrwx  1 glr548 access        49 Aug 14 13:39 tsinp.nc -> /short/dp9/glr548/CABLEtest/cableDUMPtoNC/ts_A.nc

example_recon:
total 2805328
lrwxrwxrwx  1 glr548 access         67 Aug 14 13:39 GA6N96cable_preRECON -> /short/dp9/glr548/CABLEtest/ga6n96tamipCABLE2009-01-15-h00_preRECON
lrwxrwxrwx  1 glr548 access         71 Aug 14 13:39 GA6N96cableice -> /projects/access/AMEL/TransposeAMIPII/ga6/sstice/iceN96_20090101nd59ga6
lrwxrwxrwx  1 glr548 access         71 Aug 14 13:39 GA6N96cablesst -> /projects/access/AMEL/TransposeAMIPII/ga6/sstice/sstN96_20090101nd59ga6
drwxr-s---+ 2 glr548 access       4096 Aug 14 13:39 IC
-rw-------+ 1 glr548 access 1099227136 Aug 14 13:39 adum0era
-rw-------+ 1 glr548 access 2683064320 Aug 14 13:39 ga6n96tamipCABLE2009-01-15-h00_preRECON
-rw-r-----+ 1 glr548 access    4675085 Aug 14 13:39 out_recon_tamipGA6cable
-rwx--x---+ 1 glr548 access      10409 Aug 14 13:39 umuisubmit_rcf_2009011500
drwx--S---+ 3 glr548 access       4096 Aug 14 13:39 vakef

example_run:
total 24688
lrwxrwxrwx  1 glr548 access       57 Aug 14 13:39 GA6N96cableIC -> /short/dp9/glr548/CABLEtest/IC/ga6N96Ctamip2009-01-15-h00
-rw-------+ 1 glr548 access     2131 Aug 14 13:39 cable_start.ksh
-rw-r-----+ 1 glr548 access 25255646 Aug 14 13:39 out_run_tamipGA6
-rwx--x---+ 1 glr548 access    10583 Aug 14 13:39 umuisubmit_run_2009011500
drwx--S---+ 3 glr548 access     4096 Aug 14 13:39 vakei

Typical hindcast plots can be seen via eg: 

xconv /projects/access/AMEL/TransposeAMIPII/ga6cable/ic/scripts/example_run/vakei/2009011500/vakema.pj20090806

and we can create plots of the 5d fcast Boundary Layer Height and 1.5m Temperature fields and these are displayed below GA6N96L85(CABLE) T-AMIP 5d fcast Boundary Layer Height GA6N96L85(CABLE) T-AMIP 5d fcast 1.5m Temperature

6: Transpose-AMIP documentation

Further documentation on ACCESS T-AMIP experiments can be found in /projects/access/AMEL/TransposeAMIPII/docs as:

  • ACCESS Transpose-AMIP: Experimental Procedure and Preliminary Results, Greg Roff (accepted CAWCR Res.Let., Oct 2014) describes in more detail the Transpose-AMIP II experimental design and its application to the ACCESS 1.3 model as well as a companion README file (tamip_access1.3_README.pdf and tamip_access1.3_README.pdf, respectively)
  • GA6 Transpose-AMIP: Procedure and preliminary comparison with ACCESS 1.3, Greg Roff (accepted CAWCR Res.Let., Feb 2015) and its corresponding README file which descibe the GA6N96L85(JULES) T-AMIP setup in more detail (tamip_GA6N96L85_CAWCRresLet.pdf and tamip_GA6N96L85_README.pdf, respectively)
  • A Transpose-AMIP comparison of Land Surface Models MOSES, JULES and CABLE, Greg Roff and Huqiang Zhang, CAWCR Technical Report (in preparation, 2015)

Back to ACCESS Model Experiment Library
Back to Main ACCESS page

[19/11/2014] Review and updates by greg Roff

For further support on this suite, please contact g.roff@…

Last modified 8 years ago Last modified on Aug 28, 2015 10:17:14 AM

Attachments (2)

Download all attachments as: .zip