wiki:access/UmPartnersTechnicalInfrastructureProject

UM Consortium Technical Infrastructure Collaboration Project

Revision status

  • [Michael Naughton 11/11/2018] Work in progress: This page is currently being updated for 2019-20 plans. Information below is subject to change. Initial update is for Bureau parts only; CSIRO parts will not be changed; i.e. they will still refer to previous CSIRO plans until they are updated.

Overview

The UM Partnership Technical Infrastructure Project (UMTIP) is a collaborative project involving the core and associate UM Partnership members. Project documentation is available on the Technical Infrastructure TRAC wiki, which contains a list of the UMTIP Work Packages. Further top-level programme information is contined in the Technical Advisory Group (TAG) sub-page. The project vision statement therein gives the context, purpose, scope and goals of the project.

Participation of core members (UK Met Office, Bureau-CSIRO, KMA, NCMRWF and NIWA) is part of the UM Licence Agreement. Under the terms of the UM Licence Agreement, the UM core partners have each agreed to 4 Full Time Equivalent (FTE) staff commitment to this programme. In the ACCESS case, the commitment is 2 FTEs each for BoM and CSIRO. The ARCCSS/CLEX is not required to have a formal resource commitment to the partnership, but they are also involved in the project as an UM associate member.

Bureau planned 2018-19 activities are provided below. As far as possible, these contributions have been discussed and agreed with relevant managers in each of the work areas. CSIRO planned 2017-18 activities are also provided, consistent with CSIRO internal project planning.

ACCESS 2018-2019 contributions

For 2018-19, work packages have been divided into primary and secondary priority groups. This wiki page follows the same order as in the UM Partner TI Project 2018-19 Work Plan word document (see links section below). The primary work packages are the major focus of UMTIP activities. Work in the secondary packages is still able to contribute to the UMTIP programme, but it is not being actively managed or monitored. There are 5 high priority areas: TIAN, TICT, TIDA, TISD, TIEX; these are the same as 2017-18, except that TIEX (Exascale-LFRIC development) replaces TIVE (Verification). We also have TIAG in the list below, covering TAG and other management activities.

In the lists below, work is classified into Consortium Development (CD) and Local Implementation (LI) components.

Nominal contributions are rounded up to 0.1, since we are not trying to track contributions to finer than this scale.

TIAG: TAG Advisory Group (and other management contributions)

  • MOSRS TIAG link
  • WP leadis: Keir Bovis, Hilary Oliver, Mick Carter
  • BoM ACCESS contacts and contributors: Michael Naughton, Tony Hirst, Peter May, Helen Cleugh, Robin Bowen
  • BoM FTE's: 0.2 (CD: 0.1, LI: 0.1)
    • CD: Michael Naughton perform role as Bureau TAG contact. (0.1)
    • LI: Michael Naughton, Peter May, Tony Hirst, Robin Bowen engage in management activities to plan and deliver Bureau TIP contribution. (0.1)
  • CSIRO contacts and contributors: Martin Dix, Rachel Law, Helen Cleugh
  • CSIRO FTE's: 0.1 (CD: 0.1)
    • CD: Martin Dix contribution to TAG (0.1)
  • ARCCSS/CLEX contacts and contributors: Scott Wales

Primary Work Packages

TIAN: Stabilising and re-engineering ancillary file system

  • MOSRS TIAN link
  • WP leads: Jamie Kettleborough, Keir Bovis
  • BoM contacts and contributors: Imtiaz Dharssi, Wenming Lu
  • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • CD: Review and provide scientific comment on ANTS work
    • LI: Implement and test ANTS software for Bureau applications
  • CSIRO contacts and contributors: Martin Dix, Arnold Sullivan, Peter Dobrohotoff
  • CSIRO FTE's: 0.2-0.3
    • CD: Review and provide scientific comment on ANTS work
    • LI:

TICT: UM Configuration Testing and system refresh

  • MOSRS TICT link
  • WP leads: Michael Naughton, Glenn Greed
  • BoM contacts and contributors: Michael Naughton, Ilia Bermous, Lawrie Rikus and others
  • BoM FTE's: BoM 0.2 (CD: 0.1, LI: 0.1)
    • CD: Lawrie Rikus working on ACCESS NWP STASH specification and procedures and tools for maintaining STASH settings in shared NWP suites. This will involve engagement with MO developers and partners on STASH practices. (0.1)
    • LI: Keep up with cycle of UM releases. (0.1)
    • Note that Bureau is also engaged in UM optimisation work, which is recorded in the TIHP work package below.
    • Lawrie Rikus, Asri Sulaiman, Ilia Bermous, Milton Woods, Yi Xiao, Wenming Lu all contributing.
  • CSIRO contacts and contributors: Martin Dix
  • ARCCSS contacts and contributors: Scott Wales
  • NCI contacts and contributors: Ben Evans, Dale Roberts and others

TIDA: Data Assimilation and observations capability

  • MOSRS TIDA link
  • WP leads: Peter Steinle, Adam Maycock
  • BoM points of contact and contributors: Andy Smith (0.8), Peter Steinle (0.1), Tan Le (0.2)
  • BoM FTE's: 1.1 (CD: 0.9, LI: 0.2)
    • CD: Develop an observation monitoring system that is suitable for use across the Partnership and provides the functionality of ECMWF obstats monitoring and provides advanced satellite monitoring that satisfies UM partners needs
    • LI: Local tailoring of above system

TISD: Suite Development and Design

  • MOSRS TISD link
  • WP leads: David Matthews, Hilary Oliver
  • BoM points of contact and contributors: Yi Xiao, Michael Naughton, Peter Steinle, Jin Lee, Susan Rennie, Shaun Cooper
  • BOM FTE's: BoM 0.4 (CD: 0.2, LI: 0.2)
    • CD: Collaborate on design, implementation and testing of shared portable versions of the main global and regional NWP and Seasonal Prediction suites. (0.2)
    • LI: Keep in step with latest versions of Met Office NWP and Seasonal suites. (0.2)
    • Yi Xiao, Jin Lee, Susan Rennie, Michael Naughton, Peter Steinle and other Bureau NWP and Seasonal Prediction staff are involved in aspects of suites development and design work.
  • CSIRO points of contact and contributors: Martin Dix
  • ARCCSS points of contact and contributors: Scott Wales

TIEX: Exascale/LFRic activities

  • MOSRS LFRic link (no TIEX WP wiki pages currently exist)
  • WP lead:
  • BoM contacts and contributors: Justin Freeman, Joerg Henrichs, Milton Woods, Mirko Velic
    • BoM FTE's: TBD (CD: ; LI: )
    • Ref. Upcoming (Feb 2018) UM Partnership LFRic investment workshop will discuss work plans.

Secondary Work Packages

TIAV: Data processing and visualisation

  • MOSRS TIAV link
  • WP lead: Raghav Sreevathsa
  • ACCESS contacts and contributors: Martin Dix, Weiqing Qu (tentatively)
  • BOM FTE's: 0.1 (CD: 0.1; LI: 0.0)
    • CD: Bureau to implement, test and review IRIS tools and developments.
    • Bureau to collaborate on IRIS development through Model Data Services (MDS) project, continuing on work commenced during Phil Elson 2016-17 secondment visit. Weiqing Qu nominated as possible Bureau lead for this collaboration.
    • FTE figure is nominal at present time, representing contribution to IRIS development from IRIS enhancements associated with Bureau MDS project work.

TIDS: Data Sharing

  • MOSRS TIDS link
  • WP leads: Jin Lee, Fiona Smith
  • BoM contacts and contributors: Jin Lee, Fiona Smith
  • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • CD: Identify files to be added to Jasmin data server; maintain Bureau TIDS mirror. (0.1)
    • LI: Maintain Bureau mirroring of MOSRS repositories and Bureau ACCESS TRAC systems. (0.1)
    • Jin Lee, Jonathan Thomas, Asri Sulaiman to be primary Bureau contact points for Jasmin and BoM MOSRS mirrors.
  • CSIRO contacts and contributors: Martin Dix
  • ARCCSS/CLEX contacts and contributors: Scott Wales

TIHP: High Performance Optimisation and Benchmarking

  • MOSRS TIHP link; See also MOSRS TICT WP.
  • WP leads: Ben Evans (NCI), Paul Selwood
  • BoM contacts and contributors: Ilia Bermous, Milton Woods, Justin Freeman.
  • NCI contacts and contributors: Ben Evans, Dale Roberts, Rui Yang (ACCESS-Opt project).
  • BoM FTE's: BoM 0.3 (CD: 0.1, LI: 0.2)
    • CD: Contribute Bureau / ACCESS-Opt developments to UM partnership. (0.1)
    • LI: Implement and test latest MO optimisations in ACCESS models. (0.2)
    • CD: Collaborate on benchmark development, testing, sharing. (0.0)
    • OpenMP coverage improvement if something significant is found in the latest sources.
    • Performance improvements in handling transcendental functions.
    • Tune building procedure with the Intel compiler for Raijin/Terra/Australis.
    • Performance tuning of UM models for the APS3 operational upgrade.
    • Investigate performance of the most expensive loops.
    • See ACCESS section in MOSRS TIHP page.

TILI: Land surface data assimilation

  • WP lead:
  • ACCESS contacts and contributors: Imtiaz Dharssi
    • BoM FTE's: 0.0
    • Technical activities in support of transition to NASA LIS.
    • Placeholder -- identified to become a UMTIP project, but not yet active.

TILS: Land surface model interoperability

  • MOSRS TILS link
  • WP lead: Rachel Law
  • ACCESS contacts and contributors: Rachel Law, Jhan Srbinovsky, Ian Harman, Tilo Ziehn, Bernard Pak
  • BoM FTE's: 0.0
    • CD
    • LI
  • CSIRO FTE's: 1.5 (CD: 0.6, LI: 0.9)
    • CD: Coupling meets JULES/UM standards and incorporated into trunk. CABLE in JULES offline as initial case.
    • LI: Coupling of CABLE to UM10.6+ and testing

TIVE: Verification

  • MOSRS TIVE link
  • WP leads: Adam Clayton, Phil Gill
  • BoM contacts: Chris Bridge, Vinod Kumar, Jin Lee
  • BoM FTE's: 0.2 (CD: 0.0; LI: 0.2)
    • LI: Explore Bureau use of VER/VerPy and RMED verification toolkit packages in ACCESS NWP suites. (0.1)
    • LI: Participate in TIVE discussions and activities. (0.1)
    • Chris Bridge to be primary Bureau contact point
    • Vinod Kumar to implement and test RMED Toolbox

Other TI Collaboration Projects

TIRA: Regional reanalysis

  • WP lead: Chun-Hsu Su
  • ACCESS contacts and contributors: Peter Steinle, Greg Kociuba, Nathan Eizenberg
  • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • Development and delivery of reanalysis suite in roses-u; extending UERRA suite with local configuration and tools
    • Reanalysis production run over the Australian domain for period 2000-2016, and report regional evaluation results for comparisons with other regional reanalysis projects.
    • Report to TAG summarising progress and capability.
    • Aligned with Bureau Reanalysis project.

TIOP: Operational Systems

  • WP lead: Tennessee Leeuwenburg
  • BoM Cylc project contact and contributors: Alan Riley, Damian Agius, Hilary Oliver (NIWA)
  • BoM FTE's: 0.2 (CD: 0.2; LI: 0.0)
    • CD: Bureau to take lead on security enhancement of UM TI components. (0.1)
    • CD: Bureau to participate in discussions and meetings on operational technical infratructure aspects. (0.1)
    • Tennessee Leeuwenburg and other ISS experts will be involved in this area, which follows on from visits and contacts since 2015.
    • Tennessee Leeuwenburg presented on this work package at 2017 UM Users Workshop TI session.
    • Bureau has contract with Altair to provide supported Cylc version for Bureau operational and research requirements. Relevant outcomes from this project will be shared with UM Partnership through TISD Suite Design work package. Primary focus is security assurance; development of enhanced capabilities for monitoring and alerting, and generation of reports are also part of this project.
    • Alan Riley is Bureau Project Manager of Cylc Project; Damian Agius is lead programmer for operational Cylc deployment; Hilary Oliver is involved through Altair contract as specialist Cylc consultant.

Working tables

Previous years

  • 2018-19 Feb 2018 version of this page
  • 2017-18 Jul 2017 version of this page
  • 2016-17 Nov 2016 version of this page
  • 2015-16 Aug 2015 version of this page
  • 2014-15 Mar 2015 version of this page
Last modified 4 weeks ago Last modified on Nov 11, 2018 7:51:05 PM