wiki:gadi/transition/Nwp

Version 97 (modified by Zhihong Li, 2 months ago) (diff)

--

Modules

Porting of modules and their applications is being tracked at gadi/transition/access modules and Gadi Software Stack - /apps .



Prebuilds

Prebuilt NWP software packages are being installed on gadi, but please be aware that the directory structure may change in early 2020 based on feedback from suite developers. The suggested directory structure is inspired by the NWP_SHARE layout used at the Bureau:

~access/NWP_SHARE/package-release/X.Y.Z/compiler-mpi/build/{bin,etc,lib,README,...}

The semantic version number X.Y.Z will typically be 1.0.0, but the major (X), minor (Y) or patch (Z) numbers can be incremented if necessary. This allows for multiple installations of the same package-release, which may include different local changes (e.g. bug fixes, build options). Details about the build should be recorded in a README file, including the following information:

  • Source repository and revision
  • Commands used to build (e.g. rose stem --task=...)
  • Optional: cylc/rose versions, original location of the build

For example, a prebuild of ops-2019.02.0 could be installed in ~access/NWP_SHARE/ops-2019.02.0/1.0.0/intel1903-ompi402.



Scientific software packages required by NWP components

GCOM

Version Target machine Details Owner Status
gcom/6.4_ompi.4.0.2 Gadi Needed by UM10.9 which is used in ported PS41 global suite Request for installation sent to cws_help@….
GCOM backwards compatibility means should be able to use 7.0 with UM10.9
gcom/7.0_ompi.2.1.6 Gadi Martin Dix done
gcom/7.0_ompi.3.1.4 Gadi Martin Dix done
gcom/7.0_ompi.4.0.1 Gadi Martin Dix done
gcom/7.0_ompi.4.0.2 Gadi Martin Dix done

RTTOV

Version Target machine Details Owner Status
rttov/11.3b_ifort1903 Gadi Milton Woods done
rttov/12.3_ifort1903
rttov/12.3_ifort1903-debug
Gadi Milton Woods done

odbserver

Version Target machine Details Owner Status
odbserver/0.16.2-ops-intel1903
odbserver/0.16.2-ops-intel1903-debug
Gadi Milton Woods done

shumlib

Version Target machine Details Owner Status
shumlib/2017.10.1 Gadi Needed to build UM10.9 which is used in ported PS41 global suite Martin Dix done
shumlib/2018.6.1 Gadi Martin Dix done
shumlib/2019.10.1 Gadi Martin Dix done



NWP Components

OPS

Version Target machine Details Related ticket Owner Status
ops-2016.11.0 Gadi Needed for GeoCloud assimilation in ACCESS-C3

Decided not to persist with this in the interest of time
Jin Lee in progress
ops-2018.02.2 Raijin * Using intel-fc/2019.3.199 and intel-mpi/2019.3.199 build succeeds; submitting jobs to Broadwell nodes; all ops_create* rose-stem tasks fail at run-time

* Decided to use Intel 2018.3.222 and intel-mpi/2018.3.222, and for this combination build and almost all rose-stem tests succeed
OPS ticket #2260 Jin Lee in progress
ops-2018.02.2 Gadi * Using intel-fc/2019.5.281 and intel-mpi/2019.5.281 build succeeds

* Submitting jobs to Cascade Lake nodes

* All ops_create* and ops_process* rose-stem tasks succeed but rose_ana tasks fail; job.stats from ops_process* tasks are identical to their counterparts on Raijin

* Some issues
OPS ticket #2273 Jin Lee done
ops-2017.07.0 for older APS3 suites gadi https://code.metoffice.gov.uk/svn/ops/main/branches/dev/susanrennie/r11408_ops-2017.07.0_bomdep_gadi OPS ticket #2265 Susan built and stem tests succeeded
ops-2019.02.0_bom_deploy for APS3 gadi https://code.metoffice.gov.uk/svn/ops/main/branches/dev/susanrennie/r11912_ops-2019.02.0_bomdep_gadi OPS ticket #2265 Susan stem tests succeeded and prebuild installed
Head of trunk gadi [https://code.metoffice.gov.uk/trac/ops/ticket/2265 OPS ticket #2265 Milton done

VAR

Version Target machine Details Related ticket Owner Status
head of trunk gadi VAR ticket 719
. Built on broadwell, then built with Intel19, then built on gadi
#719 Susan Rennie committed
var-2018.02.0 Gadi Needed for ported PS41 global suite Jin Lee done
var-2018.07.0 Gadi Needed for NAS suite #735 Monika Krysta Built successfully. Not tested

SURF

Version Target machine Details Related ticket Owner Status
2017.07.0 gadi Jules3.0 built
RPC issue. module command not supported from ksh.
https://code.metoffice.gov.uk/svn/surf/main/branches/dev/susanrennie/surf-2017.07.0_nci_gadi
#256 Susan Rennie done
surf-2018.02.0 Gadi Needed for ported PS41 global suite

A build available; waiting on Martin to build JULES4.4 to complete the test of the build
SURF ticket #260 Jin Lee in progress
2019.02.0 gadi https://code.metoffice.gov.uk/svn/surf/main/branches/dev/susanrennie/surf-2019.02.0_bom_nci
waiting for Jules4.4
#256 Susan Rennie built, half tested
head of trunk gadi https://code.metoffice.gov.uk/svn/surf/main/branches/dev/susanrennie/r1907_256_nci_gadi
waiting for jules4.4 to finish stem tests
#256 Susan Rennie done

UM

Version Target machine Details Related ticket Owner Status
vn10.6_C3_bom_dev (C3) gadi built with openmp using u-az670 Susan Rennie built, not tested
vn10.9 Gadi Needed for ported PS41 global suite UM ticket #5314

Successfully built and now testing executables for correctness
Jin Lee in progress
vn11.1 gadi Needed for u-bn849_gadi_branch #318 as part of the NAS nesting suite u-bl615-gadi_branch Monika Krysta built and ran successfully
vn11.6 Gadi Needed for ported BARPA-RCM suite. Built with u-bm002. Successfully built and to be tested for correctness Chun-Hsu Su built, still testing.

UM UTILS

Version Target machine Details Related ticket Owner Status
10.6 gadi /projects/access/umdir/vn10.6/linux/utilities N/A Martin Dix done
11.1 gadi /projects/access/umdir/vn11.1/linux/utilities N/A Martin Dix done

JULES

Version Target machine Details Related ticket Owner Status
Jules3.0 gadi Built using an old surf31.2 branch from /g/data/dp9/sjr548/surf/intelmpi_r540_gadi N/A Susan Built and tested with surf-2017.07.0
Jules4.4 gadi On Raijin JULES4.4 is installed in /projects/access/nwpdir/share/APS3/JULES/v4.4; need to update rose-stem tests; also needed by SURF 2018.02.0 which in turn is used by PS41 global suite

JULES executable available: ~access/NWP_SHARE/jules-4.4/1.0.0/intel1903-ompi402/build/bin/jules.exe
JULES ticket #971 Martin Dix in progress
Jules trunk gadi Not started

VER

VersionTarget machineDetailsRelated ticketOwnerStatus
18.1.1RaijinBuild using libraries common to Gadi; test executable on Broadwell nodesVER ticket #467Vinod Kumarcompleted
18.1.1GadiBuild using same libraries used on Raijin; test the executable using RESVER ticket #467Vinod Kumarin review
18.3GadiBuild using the same libraries used for 18.1.1, test the executable using RESVER ticket #471Vinod Kumarcompleted



Suites

Global NWP suites

Suite ID Target machine Details Related ticket Owner Status
u-al457 Gadi This is equivalent to PS39 global suite Jin Lee assigned
u-bp659 Gadi This is equivalent to PS41 global standard suite: the parent suite that was for Raijin is u-bp612 (which was derived from u-ay357; this in turn is derived from UKMO PS41 global suite, u-aw771)

Further details
Jin Lee assigned

Global Evaluation Suite (GES)

Suite ID Target machine Details Owner Status
u-al685/r101300_nciport_fix Gadi The suite branch, "r101300_nciport_fix" should be used Jin Lee assigned

ACCESS-C3

Version Target machine Details Owner Status
u-bp794 Gadi This is Gadi-ported equivalent of u-aq055 whose parent is u-al072; control in GeoCloud assimilation; only ported ukv_ops_process_background_geocloud task; instead of ops-2016.11.0 using ops-2017.07.0 Jin Lee done
u-bp825 Gadi This is Gadi-ported equivalent of u-aw499; for testing locally made HIMRAD Bufr files in GeoCloud assimilation; see details under u-bp794 Jin Lee done
u-ba539 gadi C3 in R2, using 2017 versions of components Susan awaiting components

Regional Evaluation Suite (RES)

Suite ID Target machine Details Owner Status
u-at789 Gadi branch: @r141818; testing: job outputs; job logs Vinod Kumar completed

NAS suite

Suite ID Target machine Details Ticket Owner Status
u-bn849_gadi_branch Gadi roses-u #322 Monika Krysta stuck on lack of ops-2019.02.0 build

Nesting Suite

Suite ID Target machine Details Ticket Owner Status
u-ap458 Gadi RA1 setting, UM10.6 Hongyan Zhu done
u-bl615 Gadi RA2M setting, UM11.1 To come Monika Krysta in progress
u-bq575 Gadi All configs, UM11.4 Zhihong Li done

C3 Downscaler

Suite ID Target machine Details Ticket Owner Status
u-as385 gadi Builds own UM 10.6 with openmpi N/A Susan g2nc2 fails in archiving
u-bl807_cvt_raining_set gadi will be directly ported to gadi roses-u #308 Monika Krysta to do

BARPA suites

Suite ID Target machine Details Ticket Owner Status
u-bm002 Gadi BARPA-RCM/12 km suite with GA7.1 setting Chun-Hsu Su in progress
u-bl324 Gadi Creates frames from ERA-Interim and CMIP5 GCMs Chun-Hsu Su done
u-bk244 Gadi Creates ancillaries for u-bm002 Chun-Hsu Su done
u-bp493 Gadi BARPA-CPM suite with RA1 setting Greg Roff, Chun-Hsu Su in progress

CVT suite

Suite ID Target machine Details Ticket Owner Status
u-at958 Gadi needs var build to do Monika Krysta to do

LAM hybrid suite

Suite ID Target machine Details Ticket Owner Status
nci_3dvar_hybrid_lam_aw264_sy Gadi needs component upgrades in the first place to do Monika Krysta to do