wiki:access/access_ge2_rdsi_info

APS2 ACCESS-GE RDS Information Page








NOTE: GE2 RDSI DATA OLDER THAN 12 MONTHS WILL BE AGGRESSIVELY TRIMMED (Target: February 2018)


ACCESS-GE2 ensemble data

  • The top directory for access_ge RDS data at NCI/raijin is: GE_RDS == /g/data3/dev_aps2/access-ge/
    • Marked for reduction
    • Note: Users need to apply to be in group "na3" to have read access
  • (1) DATA FROM 1st July 2016 to present are in $GE_RDS/gef/$YYYY/$MM/$YYYYMMDDHH
    • Full data for the past 12 months to be kept
  • (2) DATA FROM 10th Sept 2015 to 1st July 2016 are in $GE_RDS/gef_ngamai/$YYYY/$MM/$YYYYMMDDHH
    • Marked for reduction
  • (3) OLD DATA FROM ge2g1 runs (i.e. GE2 running using input from APS1 ACCESS-G system - G1, rather than APS2 - G2)
    • Range from 2013122112 -to- 2015120500
    • Kept in $GE_RDS/hide/GF/
    • Note overlap between data in $GE_RDS/gef_ngamai and $GE_RDS/hide/GF; where duplicates occur the later gef_ngamai G2-input-based version is the one which will be kept
    • GF data from 2013122112/ -to- 2014110512/ are in additional subdirectory nc/ within $YYYYMMDDHH/
    • Data are not 100% complete - there are a few missing files
    • Marked for reduction



New data files (after trimming)

  • Original pd.nc single NetCDF file per ensemble member is divided into 5 files
    • 4 pressure level files containing 5 fields
      • air_temp.nc, geop_ht.nc, relhum.nc, zonal_wnd.nc (2 levels)
    • 1 single level fields file with 5 fields:
      • single_level_fields.nc: mslp, uwnd10m, vwnd10m, temp_scrn, accum_prcp, dewpt_scrn
      • Note that uwnd10m/vwnd10m fields undergo name change from yyyymmddhh onwards, to U10/V10
  • Other pressure levels and other single level fields are being culled from the archive
  • Fields are kept at 6-hourly time intervals rather than 3-hourly in the time dimension
  • Once-daily archives from the 12UTC daily runs are being retained, 00UTC runs are being removed

  • Directory structure of data follows ACCESS_G2 convention
    • $GE_RDS/gef_reduced/YYYYMMDD/HH/cf
    • $GE_RDS/gef_reduced/YYYYMMDD/HH/pf/$ensemble_member_num
  • All files have been converted to netCDF4 and relevant global attributes updated to include metadata identifying which version of GE2 system was run, corresponding to (1), (2), (3) above.



Summary of reduced data

  • single level
    • mslp
    • accum_prcp
    • temp_scrn
    • dewpt_scrn
    • u10
    • v10
  • pressure level
    • zonal_wnd @ 850 hPa
    • zonal_wnd @ 250 hPa
    • air_temp @ 850 hPa
    • relhum @ 700 hPa
    • geop_ht @ 500 hPa



New global attributes for reduced data files

  • NOTE: Global attributes of "reduced data" will vary to reflect ge2 version changes.

EXAMPLE NEW GLOBAL ATTRIBUTES:

// global attributes:
                :Conventions = "CF-1.5,ACDD v1.3" ;
                :title = "BoM APS2 Global Ensemble Forecast data" ;
                :summary = "Reduced archive of BoM APS2 global ensemble N216 10-day forecasts. This is a research trial system, not an operational Bureau system." ;
                :institution = "Australian Bureau of Meteorology" ;
                :expt_id = "ge2_gef_reduced" ;
                :source = "access_gef sms suite" ;
                :platform = "ngamai" ;
                :da_input = "access_g1" ;
                :modl_vrsn = "APS2 ACCESS-GE" ;
                :date_created = "2015091012" ;
                :base_date = "20150910" ;
                :base_time = "12" ;
                :ensemble_member = "001" ;

Full data (NetCDF header summary)

Single level fields: ( 81x325x432 ):
        float topog(time, lat, lon) ;                float sfc_pres(time, lat, lon) ;
        float accum_ls_prcp(time, lat, lon) ;        float accum_ls_snow(time, lat, lon) ;
        float u10(time, lat2, lon2) ;                float v10(time, lat2, lon2) ; 
        float temp_scrn(time, lat, lon) ;            float tmax_scrn(time, lat, lon) ;
        float tmin_scrn(time, lat, lon) ;            float accum_conv_prcp(time, lat, lon) ;
        float accum_conv_snow(time, lat, lon) ;      float accum_prcp(time, lat, lon) ;
        float visibility(time, lat, lon) ;           float fog_fraction(time, lat, lon) ;
        float dewpt_scrn(time, lat, lon) ;           float conv_cld_amt_2d(time, lat, lon) ;
        float low_cld(time, lat, lon) ;              float mid_cld(time, lat, lon) ;
        float hi_cld(time, lat, lon) ;               float ttl_cld(time, lat, lon) ;
        float mslp(time, lat, lon) ;

Multi level fields ( 81x37x325x432)
        float zonal_wnd(time, lvl, lat2, lon2) ;     float merid_wnd(time, lvl, lat2, lon2) ; 
        float omega(time, lvl, lat, lon) ;           float geop_ht(time, lvl, lat, lon) ;
        float air_temp(time, lvl, lat, lon) ;        float relhum(time, lvl, lat, lon) ;

Full ncdump (header) of untrimmed netCDF file

> ncdump -h  ge2_eg.nc
netcdf ge2_eg {
dimensions:
        lon = 432 ;
        lon2 = 432 ;
        lat = 325 ;
        lat2 = 324 ;
        lvl = 37 ;
        time = UNLIMITED ; // (81 currently)
        char_size = 4 ;
variables:
        double time(time) ;
                time:long_name = "time" ;
                time:units = "days since 2017-09-20 12:0:0.0" ;
                time:standard_name = "time" ;
                time:axis = "T" ;
                time:calendar = "gregorian" ;
        char seg_type(time, char_size) ;
                seg_type:long_name = "segment of bmrc header type" ;
        float lat(lat) ;
                lat:long_name = "latitudes" ;
                lat:type = "uniform" ;
                lat:units = "degrees_north" ;
                lat:valid_min = -90.f ;
                lat:valid_max = 90.f ;
                lat:axis = "Y" ;
        float lat2(lat2) ;
                lat2:long_name = "latitudes" ;
                lat2:type = "uniform" ;
                lat2:units = "degrees_north" ;
                lat2:valid_min = -90.f ;
                lat2:valid_max = 90.f ;
                lat2:axis = "Y" ;
        float lon(lon) ;
                lon:long_name = "longitudes" ;
                lon:type = "uniform" ;
                lon:units = "degrees_east" ;
                lon:valid_min = -180.f ;
                lon:valid_max = 360.f ;
                lon:axis = "X" ;
        float lon2(lon2) ;
                lon2:long_name = "longitudes" ;
                lon2:type = "uniform" ;
                lon2:units = "degrees_east" ;
                lon2:axis = "X" ;
        float lvl(lvl) ;
                lvl:long_name = "vertical levels" ;
                lvl:type = "pressure" ;
                lvl:units = "hPa" ;
                lvl:positive = "down" ;
                lvl:axis = "Z" ;
        int base_date(time) ;
                base_date:long_name = "base date (YYYYMMDD) of archive file" ;
                base_date:units = "yyyymmdd" ;
                base_date:WARNING = "DEPRECATED, DO NOT USE" ;
        int base_time(time) ;
                base_time:long_name = "base time (HHMM) of archive file" ;
                base_time:units = "hhmm UTC" ;
                base_time:WARNING = "DEPRECATED, DO NOT USE" ;
        int valid_date(time) ;
                valid_date:long_name = "valid date (YYYYMMDD) of this segment" ;
                valid_date:units = "yyyymmdd" ;
                valid_date:WARNING = "DEPRECATED, DO NOT USE" ;
        int valid_time(time) ;
                valid_time:long_name = "valid time (HHMM) of this segment" ;
                valid_time:units = "hhmm UTC" ;
                valid_time:WARNING = "DEPRECATED, DO NOT USE" ;
        float forc_hrs(time) ;
                forc_hrs:long_name = "forecast hours of this segment" ;
                forc_hrs:units = "hours" ;
                forc_hrs:WARNING = "DEPRECATED, DO NOT USE" ;
        int wrtn_date(time) ;
                wrtn_date:long_name = "date (YYYYMMDD) that this segment was written" ;
                wrtn_date:WARNING = "DEPRECATED, DO NOT USE" ;
        int wrtn_time(time) ;
                wrtn_time:long_name = "time (HHMM) that this segment was written" ;
                wrtn_time:WARNING = "DEPRECATED, DO NOT USE" ;
        float topog(time, lat, lon) ;
                topog:grid_type = "spatial" ;
                topog:level_type = "single" ;
                topog:units = "m" ;
                topog:long_name = "topography height" ;
                topog:stash_code = 33 ;
                topog:accum_type = "instantaneous" ;
                topog:missing_value = 1.e+36f ;
                topog:_FillValue = 1.e+36f ;
        float sfc_pres(time, lat, lon) ;
                sfc_pres:grid_type = "spatial" ;
                sfc_pres:level_type = "single" ;
                sfc_pres:units = "Pa" ;
                sfc_pres:long_name = "surface pressure" ;
                sfc_pres:stash_code = 409 ;
                sfc_pres:accum_type = "instantaneous" ;
                sfc_pres:missing_value = 1.e+36f ;
                sfc_pres:_FillValue = 1.e+36f ;
        float zonal_wnd(time, lvl, lat2, lon2) ;
                zonal_wnd:grid_type = "spatial" ;
                zonal_wnd:level_type = "multi" ;
                zonal_wnd:units = "m s-1" ;
                zonal_wnd:long_name = "zonal wind" ;
                zonal_wnd:stash_code = 15201 ;
                zonal_wnd:accum_type = "instantaneous" ;
                zonal_wnd:missing_value = 1.e+36f ;
                zonal_wnd:_FillValue = 1.e+36f ;
        float merid_wnd(time, lvl, lat2, lon2) ;
                merid_wnd:grid_type = "spatial" ;
                merid_wnd:level_type = "multi" ;
                merid_wnd:units = "m s-1" ;
                merid_wnd:long_name = "meridional wind" ;
                merid_wnd:stash_code = 15202 ;
                merid_wnd:accum_type = "instantaneous" ;
                merid_wnd:missing_value = 1.e+36f ;
                merid_wnd:_FillValue = 1.e+36f ;
        float omega(time, lvl, lat, lon) ;
                omega:grid_type = "spatial" ;
                omega:level_type = "multi" ;
                omega:units = "Pa s-1" ;
                omega:long_name = "vertical velocity in pressure co-ordinates" ;
                omega:stash_code = 15242 ;
                omega:accum_type = "instantaneous" ;
                omega:missing_value = 1.e+36f ;
                omega:_FillValue = 1.e+36f ;
        float geop_ht(time, lvl, lat, lon) ;
                geop_ht:grid_type = "spatial" ;
                geop_ht:level_type = "multi" ;
                geop_ht:units = "m" ;
                geop_ht:long_name = "geopotential height" ;
                geop_ht:stash_code = 16202 ;
                geop_ht:accum_type = "instantaneous" ;
                geop_ht:missing_value = 1.e+36f ;
                geop_ht:_FillValue = 1.e+36f ;
        float air_temp(time, lvl, lat, lon) ;
                air_temp:grid_type = "spatial" ;
                air_temp:level_type = "multi" ;
                air_temp:units = "K" ;
                air_temp:long_name = "temperature" ;
                air_temp:stash_code = 16203 ;
                air_temp:accum_type = "instantaneous" ;
                air_temp:missing_value = 1.e+36f ;
                air_temp:_FillValue = 1.e+36f ;
        float mslp(time, lat, lon) ;
                mslp:grid_type = "spatial" ;
                mslp:level_type = "single" ;
                mslp:units = "Pa" ;
                mslp:long_name = "mean sea level pressure" ;
                mslp:stash_code = 16222 ;
                mslp:accum_type = "instantaneous" ;
                mslp:missing_value = 1.e+36f ;
                mslp:_FillValue = 1.e+36f ;
        float relhum(time, lvl, lat, lon) ;
                relhum:grid_type = "spatial" ;
                relhum:level_type = "multi" ;
                relhum:units = "%" ;
                relhum:long_name = "relative humidity" ;
                relhum:stash_code = 16256 ;
                relhum:accum_type = "instantaneous" ;
                relhum:missing_value = 1.e+36f ;
                relhum:_FillValue = 1.e+36f ;
        float accum_ls_prcp(time, lat, lon) ;
                accum_ls_prcp:grid_type = "spatial" ;
                accum_ls_prcp:level_type = "single" ;
                accum_ls_prcp:units = "kg m-2" ;
                accum_ls_prcp:long_name = "accumulative large scale precipitation" ;
                accum_ls_prcp:stash_code = 4201 ;
                accum_ls_prcp:accum_type = "accumulative" ;
                accum_ls_prcp:accum_units = "hrs" ;
                accum_ls_prcp:accum_value = 3 ;
                accum_ls_prcp:missing_value = 1.e+36f ;
                accum_ls_prcp:_FillValue = 1.e+36f ;
        float accum_ls_snow(time, lat, lon) ;
                accum_ls_snow:grid_type = "spatial" ;
                accum_ls_snow:level_type = "single" ;
                accum_ls_snow:units = "kg m-2" ;
                accum_ls_snow:long_name = "accumulative large scale snowfall" ;
                accum_ls_snow:stash_code = 4202 ;
                accum_ls_snow:accum_type = "accumulative" ;
                accum_ls_snow:accum_units = "hrs" ;
                accum_ls_snow:accum_value = 3 ;
                accum_ls_snow:missing_value = 1.e+36f ;
                accum_ls_snow:_FillValue = 1.e+36f ;
        float u10(time, lat2, lon2) ;
                u10:grid_type = "spatial" ;
                u10:level_type = "single" ;
                u10:units = "m s-1" ;
                u10:long_name = "10m wind u component" ;
                u10:stash_code = 3225 ;
                u10:accum_type = "instantaneous" ;
                u10:missing_value = 1.e+36f ;
                u10:_FillValue = 1.e+36f ;
        float v10(time, lat2, lon2) ;
                v10:grid_type = "spatial" ;
                v10:level_type = "single" ;
                v10:units = "m s-1" ;
                v10:long_name = "10m wind v component" ;
                v10:stash_code = 3226 ;
                v10:accum_type = "instantaneous" ;
                v10:missing_value = 1.e+36f ;
                v10:_FillValue = 1.e+36f ;
        float temp_scrn(time, lat, lon) ;
                temp_scrn:grid_type = "spatial" ;
                temp_scrn:level_type = "single" ;
                temp_scrn:units = "K" ;
                temp_scrn:long_name = "screen level temperature" ;
                temp_scrn:stash_code = 3236 ;
                temp_scrn:accum_type = "instantaneous" ;
                temp_scrn:missing_value = 1.e+36f ;
                temp_scrn:_FillValue = 1.e+36f ;
        float tmax_scrn(time, lat, lon) ;
                tmax_scrn:grid_type = "spatial" ;
                tmax_scrn:level_type = "single" ;
                tmax_scrn:units = "K" ;
                tmax_scrn:long_name = "screen level max temperature" ;
                tmax_scrn:stash_code = 3236 ;
                tmax_scrn:accum_type = "instantaneous" ;
                tmax_scrn:missing_value = 1.e+36f ;
                tmax_scrn:_FillValue = 1.e+36f ;
        float tmin_scrn(time, lat, lon) ;
                tmin_scrn:grid_type = "spatial" ;
                tmin_scrn:level_type = "single" ;
                tmin_scrn:units = "K" ;
                tmin_scrn:long_name = "screen level min temperature" ;
                tmin_scrn:stash_code = 3236 ;
                tmin_scrn:accum_type = "instantaneous" ;
                tmin_scrn:missing_value = 1.e+36f ;
                tmin_scrn:_FillValue = 1.e+36f ;
        float accum_conv_prcp(time, lat, lon) ;
                accum_conv_prcp:grid_type = "spatial" ;
                accum_conv_prcp:level_type = "single" ;
                accum_conv_prcp:units = "kg m-2" ;
                accum_conv_prcp:long_name = "accumulative convective precipitation" ;
                accum_conv_prcp:stash_code = 5201 ;
                accum_conv_prcp:accum_type = "accumulative" ;
                accum_conv_prcp:accum_units = "hrs" ;
                accum_conv_prcp:accum_value = 3 ;
                accum_conv_prcp:missing_value = 1.e+36f ;
                accum_conv_prcp:_FillValue = 1.e+36f ;
        float accum_conv_snow(time, lat, lon) ;
                accum_conv_snow:grid_type = "spatial" ;
                accum_conv_snow:level_type = "single" ;
                accum_conv_snow:units = "kg m-2" ;
                accum_conv_snow:long_name = "accumulative convective snowfall" ;
                accum_conv_snow:stash_code = 5202 ;
                accum_conv_snow:accum_type = "accumulative" ;
                accum_conv_snow:accum_units = "hrs" ;
                accum_conv_snow:accum_value = 3 ;
                accum_conv_snow:missing_value = 1.e+36f ;
                accum_conv_snow:_FillValue = 1.e+36f ;
        float accum_prcp(time, lat, lon) ;
                accum_prcp:grid_type = "spatial" ;
                accum_prcp:level_type = "single" ;
                accum_prcp:units = "kg m-2" ;
                accum_prcp:long_name = "accumulated precipitation" ;
                accum_prcp:stash_code = 5226 ;
                accum_prcp:accum_type = "accumulative" ;
                accum_prcp:accum_units = "hrs" ;
                accum_prcp:accum_value = 3 ;
                accum_prcp:missing_value = 1.e+36f ;
                accum_prcp:_FillValue = 1.e+36f ;
        float visibility(time, lat, lon) ;
                visibility:grid_type = "spatial" ;
                visibility:level_type = "single" ;
                visibility:units = "m" ;
                visibility:long_name = "horizontal visibility" ;
                visibility:stash_code = 3247 ;
                visibility:accum_type = "instantaneous" ;
                visibility:missing_value = 1.e+36f ;
                visibility:_FillValue = 1.e+36f ;
        float fog_fraction(time, lat, lon) ;
                fog_fraction:grid_type = "spatial" ;
                fog_fraction:level_type = "single" ;
                fog_fraction:units = "1" ;
                fog_fraction:long_name = "fog fraction" ;
                fog_fraction:stash_code = 3248 ;
                fog_fraction:accum_type = "instantaneous" ;
                fog_fraction:missing_value = 1.e+36f ;
                fog_fraction:_FillValue = 1.e+36f ;
        float dewpt_scrn(time, lat, lon) ;
                dewpt_scrn:grid_type = "spatial" ;
                dewpt_scrn:level_type = "single" ;
                dewpt_scrn:units = "K" ;
                dewpt_scrn:long_name = "screen level dewpoint temperature" ;
                dewpt_scrn:stash_code = 3250 ;
                dewpt_scrn:accum_type = "instantaneous" ;
                dewpt_scrn:missing_value = 1.e+36f ;
                dewpt_scrn:_FillValue = 1.e+36f ;
        float conv_cld_amt_2d(time, lat, lon) ;
                conv_cld_amt_2d:grid_type = "spatial" ;
                conv_cld_amt_2d:level_type = "single" ;
                conv_cld_amt_2d:units = "-" ;
                conv_cld_amt_2d:long_name = "conv_cld_amt_2d" ;
                conv_cld_amt_2d:stash_code = 5262 ;
                conv_cld_amt_2d:accum_type = "instantaneous" ;
                conv_cld_amt_2d:missing_value = 1.e+36f ;
                conv_cld_amt_2d:_FillValue = 1.e+36f ;
        float low_cld(time, lat, lon) ;
                low_cld:grid_type = "spatial" ;
                low_cld:level_type = "single" ;
                low_cld:units = "1" ;
                low_cld:long_name = "low cloud cover" ;
                low_cld:stash_code = 9203 ;
                low_cld:accum_type = "instantaneous" ;
                low_cld:missing_value = 1.e+36f ;
                low_cld:_FillValue = 1.e+36f ;
        float mid_cld(time, lat, lon) ;
                mid_cld:grid_type = "spatial" ;
                mid_cld:level_type = "single" ;
                mid_cld:units = "1" ;
                mid_cld:long_name = "middle cloud cover" ;
                mid_cld:stash_code = 9204 ;
                mid_cld:accum_type = "instantaneous" ;
                mid_cld:missing_value = 1.e+36f ;
                mid_cld:_FillValue = 1.e+36f ;
        float hi_cld(time, lat, lon) ;
                hi_cld:grid_type = "spatial" ;
                hi_cld:level_type = "single" ;
                hi_cld:units = "1" ;
                hi_cld:long_name = "high cloud cover" ;
                hi_cld:stash_code = 9205 ;
                hi_cld:accum_type = "instantaneous" ;
                hi_cld:missing_value = 1.e+36f ;
                hi_cld:_FillValue = 1.e+36f ;
        float ttl_cld(time, lat, lon) ;
                ttl_cld:grid_type = "spatial" ;
                ttl_cld:level_type = "single" ;
                ttl_cld:units = "1" ;
                ttl_cld:long_name = "total cloud cover" ;
                ttl_cld:stash_code = 9217 ;
                ttl_cld:accum_type = "instantaneous" ;
                ttl_cld:missing_value = 1.e+36f ;
                ttl_cld:_FillValue = 1.e+36f ;

// global attributes:
                :Conventions = "CF-1.5" ;
                :source = "Australian Bureau of Meteorology" ;
                :expt_id = "lttj" ;
}

Links

Contacts

  • Michael Naughton (michael.naughton at bom.gov.au)
  • Asri Sulaiman (asri.sulaiman at bom.gov.au)
Last modified 3 years ago Last modified on Jan 19, 2018 3:53:22 PM