wiki:ticket/261/TicketSummary

Version 93 (modified by Jin Lee, 2 years ago) (diff)

--

Experimental setup

Overview

Two suites are used: a control (au-aa427) and a trial run without IASI observations (au-aa461). Both suites are based on APS2 ACCESS-G Rose suite, au-aa068 at r1316.

  • Resolution: N512L70
  • PFM resolutions: N108/N216
  • Observation types used,
obsgroup platform note
screen METAR (?), SYNOP
as AMDAR's, AIREP's, TEMP, WIND, wind profilers
atovs NOAA-15, NOAA-18, NOAA-19, MetOp-1, MetOp-2
airs Aqua
iasi MetOp-1 and MetOp-2
cris Suomi-NPP
atms Suomi-NPP
mtsatcsr MTSAT-2
amv GOES-E, GOES-W, Aqua/MODIS, MTSAT-2, METEOSAT-7, METEOSAT-8, METEOSAT-9, METEOSAT-10 ???? need to duble-check ????

For more details see here
surface SYNOP, METAR, ????
gpsro GRACE-A, COSMIC-1, -2, -3, -4, -5, -6, C/NOFS, GRAS-A, GRAS-B For more details see here
scat ASCAT
ssmis SSMIS Note used


  • Experiment period: 00Z 1 August 2015 until 18Z 31 October 2015
  • Spin-up period: 00Z 18 July 2015 until 18Z 31 July 2015
  • Forecast lengths: 12-hour steps up to 5 days (only 00Z-based forecasts are verified)
  • Analysis frequency: 00Z and 12Z
  • Fields to output: Vincent suggested T, q, u, v, Z, MSLP but from our runs instead of q relative humidity is written out
  • Levels: Vincent suggested 1000, 950, 900, 850, 800, 700, 600, 500, 400, 300, 250, 200, 150, 100, 70, 50, 30, 20, 10, 7, 5, 3, 2, 1 hPa but from our run 7, 5, 3, 2, 1 hPa are not available
  • Output in the Grib format on 0.5 deg x 0.5 deg grid
  • Aditional statistics:
    1. SatRad NetCDF writefiles for o-b statistics turned on
    2. o-a statistics from VAR not turned on

Note 1. ReconSST task fails because (I guess) somehow Cylc does not receive the completion of UM job. So I decided to use older Cylc and Rose versions under which this task worked. Following line was used to allow the use of old Cylc and Rose versions,

export CYLC_VERSION=6.4.1; export ROSE_VERSION=2015.04.1

NWP Configuration

Following summarises OPS control file versions used by UKMO (from collab wiki) and what I finally decided to use.

Stationlist

Time period Version
20150717 18Z - 20150720 18Z v396
20150721 00Z - 20150810 18Z v397
20150811 00Z - 20150914 18Z v398
20150915 00Z - 20151019 18Z v400
20151020 00Z - 20151031 18Z v401

Based on the the version used during the last time period - "ukmo/v401" - I modified it and came up with "users/au-aa427/aps2_r00.my00.v401". Some of the changes are,

  • ATOVS_stlist.nl - changed thinning distance in extra-tropics
  • IASI_stlist.nl - ditto
  • MTSATClear_stlist.nl - commented out some stationlist keywords ('DayStart' and 'DayEnd') which were not available in OPS30.0.0
  • Satwind_stlist.nl - commented out some stationlist keywords ('DayStart' and 'DayEnd') which were not available in OPS30.0.0

Screen stationlist

Time period Version
20150717 18Z - 20150720 18Z v126
20150721 00Z - 20150810 18Z v127
20150811 00Z - 20150914 18Z v128
20150915 00Z - 20151019 18Z v129
20151020 00Z - 20151031 18Z v130

Used the version which was used during the last time period - "ukmo/v130".

SatRad coeffs

Time period Version
20150717 18Z - 20150820 18Z v109
20150821 00Z - 20150823 18Z v110
20150824 00Z - 20150921 18Z v111
20150922 00Z - 20151004 18Z v112
20151005 00Z - 20151020 18Z v113
20151021 00Z - 20151031 18Z v114

The version, "ukmo/v114" is what's used during the last period. Because I need to output SatRad NetCDF writefiles I put together "bom/users/au-aa427/aps2_r00_my00.v114" (based on "bom/users/au-aa094/aps2_r00_my00.v98").

RTTOV7 coeffs

Time period Version
20150717 18Z - 20150820 18Z v40
20150821 00Z - 20150823 18Z v41
20150824 00Z - 20151031 18Z v42

Used the version which was used during the last time period - "ukmo/v42"

MetDB Elements

Version Note
v101 bom/common/aps2.r00 is derived from this
v102 Added MVIRIClear_ESACSR.elements, changes for GPSRO TPD
v103 Fix typo in ATMS elements file
v106 Corrected GPSRO elements for TPD

As the collab wiki page for MetDB elements files does not list dates I decided to use "bom/common/aps2.r00" (this is based on "ukmo/v101")

N.B.

  • There is a typo in ATMS_ATMS.elements (compare ATMS_ATMS.elements in v101 and v103) - check ATMS is processed correctly by OPS
  • v103/GPSRO_GPSRO.elements was changed to include tangent point lat, lon and azimuth - check OPS processes GPSRO correctly

Scatwind coeffs

Time period version used
20150717 18Z - 20150908 18Z v24
20150909 00Z - present v25

Used the version which was used during the last time period - "ukmo/v25"

Satwind coeffs

version used note
20150717 18Z - 20151031 18Z v19

Used the version which was used during the last time period - "ukmo/v19"

Sonde coeffs

Time period version used
for a long time v3

Used the version which was used for a long time - "ukmo/v3"

GPSRO coeffs

Time period version used
latest version v14

Used the lastest version - "ukmo/v14"

N.B.

  • Is this O.K.?

Summary of versions of various OPS control files used =

OPS controlfile type Version used Comment
Stationlist bom/common/aps2_r00.v401
Screen stationlist ukmo/v130
SatRad coeffs bom/users/au-aa427/aps2_r00_my00.v114 To output SatRad NetCDF writefiles for o-b created suite-specific control file
RTTOV7 coeffs ukmo/v42
MetDB Elements bom/common/aps2.r00 Need checking
Scatwind coeffs ukmo/v25
Satwind coeffs ukmo/v19
Sonde coeffs ukmo/v3
GPSRO coeffs ukmo/v14 Need to check stdout log output

set_ops_stationlist.ksh

ToDo Use stationlist file from au-aa094 as a starting point. You may need to copy stationlist files from Jasmin mirror to ~access/da as the files may need modification

set_ops_screen_stationlist.ksh

set_ops_control_files.ksh

set_ops_bias_files.ksh

rose-suite.conf

Change CONF_START and CONF_STOP

ODB and OPS versions

  1. ODB_VERSION:
    1. odb30.0.2
  1. OPS version:
    1. OPS30.0.0
    2. https://access-svn.nci.org.au/trac/ops/browser/branches/dev/satda/ops30.0.0
    3. No changes are introduced to OPS code so locally generated AMV's are processed in the same as JMA-produced AMV's

Preparing Bufr files

Bufr files copied: 20150718 00Z till 20151031 18Z

Archiving

  • Model analysis and forecast files are archived to "raijin1:/short/dp9/jtl548/opendap". These moved to MDSS, jtl548/opendap
  • SatRad writefiles are archived to "raijin1:/g/data/dp9/jtl548/glb"
  • deleted subdirectories, au-aa427 and au-aa461 under raijin3:/short/dp9/jtl548/data/mdss/glb

Luke-warm start

  • "luke-warm" start files come from the BNOC APS2 SCS trial suite, "saneg". The suite's archive location is,

    ngamaidm04:/g/ns/lustre/users/bnoc/rto/access_g/saneg/2015_TEST
  • start dump (iau-start-dump) from 20150717 12Z
  • analysis increment (an_inc) from 20150717 18Z
  • soil moisture (an_smc) from 20150717 18Z
  • bgerr (bgerr.new) from 20150717 18Z
  • all the warm-running files are from pre-operational APS2 ACCESS-G, saneg.

Bias coefficient updates

RUN 1: Spin-up for bias correction

  • Start date: 20150717 18Z (luke-warm start; first full OPS, VAR and UM were for the cycle time of 20150718 00Z)
  • End date: 20150731 18Z

Note 1. Initial bias regression coefficients file came from au-aa094 and the file is quite old

Note 2. After the cycle, 20150731 18Z I attempted to update the bias coefficients. However, there was a problem with NOAA-15 as the script, "LaunchBiasCorrection.ksh" did not contain NOAA-15 in the list of the satellites for ATOVS. The script should be updated!

RUN 2: After first update of bias regresssion coefficients

  • Start date: 20150801 00Z
  • End date: 20150831 18Z

RUN 3: After second update of bias regresssion coefficients

  • Start date: 20150901 00Z
  • End date: 20150930 18Z

RUN 4: After third update of bias regresssion coefficients

  • Start date: 20151001 00Z
  • End date: 20151031 18Z

Diary

au-aa427

Cycle time Failed task Reason for failure Action taken
2015071718 get_mtsatcsr bufr2odb failed with stdout,

BUFR TABLES TO BE LOADED B0000000000000010000.TXT,D0000000000000010000.TXT
BUPMRK :
INCREMENT VALUE FOR COMPRESSED DATA TOO BIG.
MY_EXIT-code = 2
reset to succeeded
2015072012 get_mtsatcsr Task failed with stdout,

BUFR TABLES TO BE LOADED B0000000000000010000.TXT,D0000000000000010000.TXT
BUPMRK :
INCREMENT VALUE FOR COMPRESSED DATA TOO BIG.
MY_EXIT-code = 2
reset to succeeded
2015080206 Analysis108 failure at early step (?) rerun task
2015080312 Analysis216 Last VAR routine called before failure is Var_InitMatchCovKE.f90 rerun task
2015080412 Analysis216 Last VAR routine called before failure is Var_InitMatchCovKE.f90 rerun task
2015080718 Analysis216 Last VAR routine called before failure is Var_InitMatchCovKE.f90 rerun task
2015081818 Ops_surface Problem reading ODB? Decided not to assimilate surface observations for this cycle (same should happen with au-aa461). Reset to succeeded
2015090312 Ops_mtsatcsr Size of Bufr file zero reset to succeeded
2015090400 Ops_mtsatcsr Size of Bufr file zero reset to succeeded
2015090406 Ops_mtsatcsr Size of Bufr file zero reset to succeeded
2015090412 Ops_mtsatcsr Size of Bufr file zero reset to succeeded
2015092900 get_amv Bufr files for AVM's are all of zero size reset to succeeded
2015092900 Ops_amv Bufr files for AVM's are all of zero size reset to succeeded
2015100100 rose suite-run When starting the suite made mistake and had to interrupt 'rose suite-run'; this resulted in log files not saved and lost reran 'rose suite-run'

au-aa461

Cycle time Failed task Reason for failure Action taken
2015071718 get_mtsatcsr bufr2odb failed with stdout,

BUFR TABLES TO BE LOADED B0000000000000010000.TXT,D0000000000000010000.TXT
BUPMRK :
INCREMENT VALUE FOR COMPRESSED DATA TOO BIG.
MY_EXIT-code = 2
reset to succeeded
2015072012 get_mtsatcsr bufr2odb failed with stdout,

BUFR TABLES TO BE LOADED B0000000000000010000.TXT,D0000000000000010000.TXT
BUPMRK :
INCREMENT VALUE FOR COMPRESSED DATA TOO BIG.
MY_EXIT-code = 2
reset to succeeded
2015080206 Analysis108 failure at early step (?) rerun task
2015080412 FC and FC_short failure during IAU step: last UM routine called is mpl_allreduce.f90 rerun task
2015080500 Analysis216 Last VAR routine called before failure is Var_InitMatchCovKE.f90 rerun task
2015081400 ReconSST FailureOfReconSST rerun task
2015081818 Ops_surface Problem reading ODB? Decided not to assimilate surface observations for this cycle (same as what happened with au-aa427). Reset to succeeded
2015090312 Ops_mtsatcsr Size of Bufr file zero reset to succeeded
2015090400 Ops_mtsatcsr Size of Bufr file zero reset to succeeded
2015090406 Ops_mtsatcsr Size of Bufr file zero reset to succeeded
2015090412 Ops_mtsatcsr Size of Bufr file zero reset to succeeded
2015092900 get_amv Bufr files for AVM's are all of zero size reset to succeeded
2015092900 Ops_amv Bufr files for AVM's are all of zero size reset to succeeded
2015102012 [OPS] family and other subsequent families Some families seem to be waiting for pre-requites to finish and some pre-requites are not visible on gcylc. To avoid having to do manual triggering decided to warm-start from 2015102012 since the cycle 2015102006 seems to have finished successfully warm-start from 2015102012

Results

Preparing analysis and forecast files for Vincent Guidard