wiki:access/UmPartnersTechnicalInfrastructureProject

Version 92 (modified by Michael Naughton, 6 months ago) (diff)

--

UM Consortium Technical Infrastructure Collaboration Project

Revision status

  • [Michael Naughton 15/02/2019] Work in progress: This page is currently being updated for BoM 2019-20 plans. Information below is subject to change. This update is for Bureau parts only; CSIRO contributions have been preserved unchanged, moved into separate section from BoM contributions.
  • [Michael Naughton 11/11/2018] Work in progress: This page is currently being updated for 2019-20 plans. Information below is subject to change. Initial update is for Bureau parts only; CSIRO parts will not be changed; i.e. they will still refer to previous CSIRO plans until they are updated.

Overview

The UM Partnership Technical Infrastructure Project (UMTIP) is a collaborative project involving the core and associate UM Partnership members. Project documentation is available on the Technical Infrastructure TRAC wiki, which contains a list of the UMTIP Work Packages. Further top-level programme information is contined in the Technical Advisory Group (TAG) sub-page. The project vision statement therein gives the context, purpose, scope and goals of the project.

Participation of core members (UK Met Office, Bureau-CSIRO, KMA, NCMRWF and NIWA) is part of the UM Licence Agreement. Under the terms of the UM Licence Agreement, the UM core partners have each agreed to 4 Full Time Equivalent (FTE) staff commitment to this programme. In the ACCESS case, the commitment is 2 FTEs each for BoM and CSIRO. The ARCCSS/CLEX is not required to have a formal resource commitment to the partnership, but they are also involved in the project as an UM associate member.

Bureau planned 2019-20 activities are provided below. As far as possible, these contributions have been discussed and agreed with relevant managers in each of the work areas. CSIRO planned activities are also provided, consistent with CSIRO internal project planning.

BoM 2019-2020 contributions

For 2018-19, work packages have been divided into primary and secondary priority groups. This wiki page follows the same order as in the UM Partner TI Project 2018-19 Work Plan word document (see links section below). The primary work packages are the major focus of UMTIP activities. Work in the secondary packages is still able to contribute to the UMTIP programme, but it is not being actively managed or monitored. There are 5 high priority areas: TIAN, TICT, TIDA, TISD, TIEX; these are the same as 2017-18, except that TIEX (Exascale-LFRIC development) replaces TIVE (Verification). We also have TIAG in the list below, covering TAG and other management activities.

In the lists below, work is classified into Consortium Development (CD) and Local Implementation (LI) components.

Nominal contributions are rounded up to 0.1, since we are not trying to track contributions to finer than this scale.

TIAG: TAG Advisory Group (and other management contributions)

  • MOSRS TIAG link
  • WP leads: Keir Bovis, Hilary Oliver, Mick Carter
  • BoM ACCESS contacts and contributors: Michael Naughton, Tony Hirst, Peter May, Robin Bowen, Justin Freeman, Milton Woods
  • Manage BoM contribution to UMTIP program
  • BoM FTE's: 0.2 (CD: 0.1, LI: 0.1)
    • CD: Michael Naughton perform role as Bureau TAG contact. (0.1)
    • LI: Michael Naughton, Peter May, Tony Hirst, Robin Bowen engage in management activities to plan and deliver Bureau TIP contribution. (0.1)
  • CSIRO contacts and contributors: Martin Dix, Rachel Law, Helen Cleugh
  • ARCCSS/CLEX contacts and contributors: Scott Wales

High priority work packages

TIAN: Stabilising and re-engineering ancillary file system

  • MOSRS TIAN link
  • WP leads: Jamie Kettleborough, Keir Bovis
  • BoM contacts and contributors: Imtiaz Dharssi, Wenming Lu
  • BoM FTE's: 0.3 (CD: 0.2; LI: 0.1)
    • CD: Wenming ANTS collaboration with Met Office: remote and visit (0.2)
    • CD: Review and provide scientific comment on ANTS work
    • LI: Implement and test ANTS software for Bureau applications (0.1)
  • CSIRO contacts and contributors: Martin Dix, Arnold Sullivan, Peter Dobrohotoff

TICT: UM Configuration Testing and system refresh

  • MOSRS TICT link
  • WP leads: Michael Naughton, Richard Glover
  • BoM contacts and contributors: Michael Naughton, Ilia Bermous, Lawrie Rikus, Milton Woods and others
  • Ilia work on UM optimisation
  • Possible work on updating UM builds to all-in-one versions
  • Possible work on regular BoM Rose-stem testing for UM/OPS/VAR
  • Possible work on STASH
  • BoM FTE's: BoM 0.3 (CD: 0.2, LI: 0.1)
    • CD: Contributions as per list. (0.2)
    • LI: Keep up with cycle of UM releases. (0.1)
    • Note that Bureau UM optimisation work is recorded in the TIHP work package below.
  • CSIRO contacts and contributors: Martin Dix
  • ARCCSS contacts and contributors: Scott Wales
  • NCI contacts and contributors: Ben Evans, Dale Roberts and others

TIDA: Data Assimilation and observations capability

  • MOSRS TIDA link
  • WP leads: Peter Steinle, Adam Maycock
  • WP leads: Peter Steinle, Adam Maycock
  • BoM points of contact and contributors: Andy Smith, Peter Steinle, Fiona Smith, Tan Le et al.
  • Andy Smith work on observations processing and monitoring
  • Fiona Smith et al. work on DA control files
  • Peter Steinle, Jin Lee, Monika Krysta, Susan Rennie participate in RMED DA WG activities
  • BoM points of contact and contributors: Andy Smith (0.8), Peter Steinle (0.1), Tan Le (0.2)
  • BoM FTE's: 1.1 (CD: 0.9, LI: 0.2)
    • CD: Contributions as per list. (0.9)
    • LI: Local tailoring of above system (0.2)

TISD: Suite Development and Design

  • MOSRS TISD link
  • WP leads: Douglas Boyd, Fiona Smith
  • BoM points of contact and contributors: Fiona Smith, Yi Xiao, Michael Naughton, Peter Steinle, Jin Lee, Susan Rennie, Shaun Cooper
  • Collaborate on design, implementation and testing of shared portable versions of the main global and regional NWP and Seasonal Prediction suites.
  • Take lead role in design and implementation of task-by-task documentation for suites
  • BOM FTE's: BoM 0.4 (CD: 0.2, LI: 0.2)
    • CD: Contributions as per list. (0.2)
    • LI: Keep in step with latest versions of Met Office NWP and Seasonal suites. (0.2)
  • CSIRO points of contact and contributors: Martin Dix
  • ARCCSS points of contact and contributors: Scott Wales

TIRS: Rose & Cylc Development

  • WP leads: David Matthews, Hilary Oliver
  • BoM points of contact and contributors: Alan Riley, Tim Pugh, Jacinta Richardson, Damian Agius, Martin Ryan, Milton Woods, Tom Coleman, Chris Down
  • BoM to collaborate and contribute to Rose and Cylc.
  • BoM-Altair Cylc Project possible contributions:
    • Funding Hilary Oliver development work through Altair contract
    • Message broker development
    • Dashboard and reporting functionality
    • Rose and Cylc security evaluation and hardening
    • Enterprise Rose-Cylc support developments
    • BoM Cylc developer involvement in Cylc development
  • BOM FTE's: BoM 1.0 (CD: 0.8, LI: 0.2)
    • CD: Contributions as per list. (0.8)
    • LI: Keep in step with latest versions of Rose & Cylc. (0.2)

TIEX: Exascale/LFRic activities

  • MOSRS LFRic link MOSRS TIAV link
  • WP lead:
  • BoM contacts and contributors: Justin Freeman, Joerg Henrichs, Milton Woods, Mirko Velic
    • BoM FTE's: TBD (CD: 1.1; LI: )
    • Freeman (0.2), Henrichs (0.5), New person (0.5); subject to gaining funding
    • Ref. Separate LFRIC/TIEX planning documents

Lower priority work packages

TIDS: Data Sharing

  • MOSRS TIDS link
  • WP leads: Jin Lee, Fiona Smith
  • BoM contacts and contributors: Jin Lee, Fiona Smith
  • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • CD: Identify files to be added to Jasmin data server; maintain Bureau TIDS mirror. (0.1)
    • LI: Maintain Bureau mirroring of MOSRS repositories and Bureau ACCESS TRAC systems. (0.1)
    • Jin Lee, Jonathan Thomas, Asri Sulaiman to be primary Bureau contact points for Jasmin and BoM MOSRS mirrors.
  • CSIRO contacts and contributors: Martin Dix
  • ARCCSS/CLEX contacts and contributors: Scott Wales

TIHP: High Performance Optimisation and Benchmarking

  • MOSRS TIHP link; See also MOSRS TICT WP.
  • WP leads: Ben Evans (NCI), Paul Selwood
  • BoM contacts and contributors: Ilia Bermous, Milton Woods, Justin Freeman.
  • NCI contacts and contributors: Ben Evans, Dale Roberts, Rui Yang (ACCESS-Opt project).
  • BoM FTE's: BoM 0.3 (CD: 0.1, LI: 0.2)
    • CD: Contribute Bureau / ACCESS-Opt developments to UM partnership. (0.1)
    • LI: Implement and test latest MO optimisations in ACCESS models. (0.2)
    • CD: Collaborate on benchmark development, testing, sharing. (0.0)
    • OpenMP coverage improvement if something significant is found in the latest sources.
    • Performance improvements in handling transcendental functions.
    • Tune building procedure with the Intel compiler for Raijin/Terra/Australis.
    • Performance tuning of UM models for the APS3 operational upgrade.
    • Investigate performance of the most expensive loops.
    • See ACCESS section in MOSRS TIHP page.

TIPP: IMPROVER -- NWP probabilistic post-processing ansd supporting verification

  • MOSRS TIPP link
  • WP lead: Nigel Roberts
  • BoM contacts and contributors: Gary Weymouth, Tom Gale, James Canvin
  • Collaborate on Improver
  • Tom Gale proposed collaboration secondment at Met Office
  • BoM FTE's: 0.0 (TBD)
    • CD
    • LI

TILS: Land surface model interoperability

  • MOSRS TILS link
  • WP lead: Rachel Law
  • ACCESS contacts and contributors: Rachel Law, Jhan Srbinovsky, Ian Harman, Tilo Ziehn, Bernard Pak
  • BoM FTE's: 0.0
    • CD
    • LI

Inactive or other work packages

These may not currently exist as official TI projects.

TIVE: Verification

  • MOSRS TIVE link
  • WP leads: Adam Clayton, Phil Gill
  • BoM contacts: Chris Bridge, Vinod Kumar, Jin Lee
  • BoM FTE's: 0.2 (CD: 0.0; LI: 0.2)
    • LI: Explore Bureau use of VER/VerPy and RMED verification toolkit packages in ACCESS NWP suites. (0.1)
    • LI: Participate in TIVE discussions and activities. (0.1)
    • Chris Bridge to be primary Bureau contact point
    • Vinod Kumar to implement and test RMED Toolbox

TILI: Land surface data assimilation

  • WP lead:
  • ACCESS contacts and contributors: Imtiaz Dharssi
    • BoM FTE's: 0.0
    • Technical activities in support of transition to NASA LIS.
    • Placeholder -- identified to become a UMTIP project, but not yet active.

TIRA: Regional reanalysis

  • WP lead: Chun-Hsu Su
  • ACCESS contacts and contributors: Peter Steinle, Greg Kociuba, Nathan Eizenberg
  • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • Development and delivery of reanalysis suite in roses-u; extending UERRA suite with local configuration and tools
    • Reanalysis production run over the Australian domain for period 2000-2016, and report regional evaluation results for comparisons with other regional reanalysis projects.
    • Report to TAG summarising progress and capability.
    • Aligned with Bureau Reanalysis project.

TIOP: Operational Systems

  • WP lead: Tennessee Leeuwenburg
  • BoM Cylc project contact and contributors: Alan Riley, Damian Agius, Hilary Oliver (NIWA)
  • BoM FTE's: 0.2 (CD: 0.2; LI: 0.0)
    • CD: Bureau to take lead on security enhancement of UM TI components. (0.1)
    • CD: Bureau to participate in discussions and meetings on operational technical infratructure aspects. (0.1)
    • Tennessee Leeuwenburg and other ISS experts will be involved in this area, which follows on from visits and contacts since 2015.
    • Tennessee Leeuwenburg presented on this work package at 2017 UM Users Workshop TI session.
    • Bureau has contract with Altair to provide supported Cylc version for Bureau operational and research requirements. Relevant outcomes from this project will be shared with UM Partnership through TISD Suite Design work package. Primary focus is security assurance; development of enhanced capabilities for monitoring and alerting, and generation of reports are also part of this project.
    • Alan Riley is Bureau Project Manager of Cylc Project; Damian Agius is lead programmer for operational Cylc deployment; Hilary Oliver is involved through Altair contract as specialist Cylc consultant.

Inactive work packages

TIAV: Data processing and visualisation

  • MOSRS TIAV link
  • Bureau to implement, test and review IRIS tools and developments.
  • BOM FTE's: 0.0

CSIRO contributions

For reference, here are sections of last year's version of this document where CSIRO contributions were referenced. Note that these were not updated since May 2017.

TIAG: TAG Advisory Group (and other management contributions)

  • MOSRS TIAG link
  • WP leadis: Keir Bovis, Hilary Oliver, Mick Carter
  • CSIRO contacts and contributors: Martin Dix, Rachel Law, Helen Cleugh
  • CSIRO FTE's: 0.1 (CD: 0.1)
    • CD: Martin Dix contribution to TAG (0.1)

Primary Work Packages

TIAN: Stabilising and re-engineering ancillary file system

  • MOSRS TIAN link
  • WP leads: Jamie Kettleborough, Keir Bovis
  • CSIRO contacts and contributors: Martin Dix, Arnold Sullivan, Peter Dobrohotoff
  • CSIRO FTE's: 0.2-0.3
    • CD: Review and provide scientific comment on ANTS work
    • LI:

TICT: UM Configuration Testing and system refresh

  • MOSRS TICT link
  • WP leads: Michael Naughton, Glenn Greed
  • CSIRO contacts and contributors: Martin Dix

TISD: Suite Development and Design

  • MOSRS TISD link
  • WP leads: David Matthews, Hilary Oliver
  • CSIRO points of contact and contributors: Martin Dix

Secondary Work Packages

TIDS: Data Sharing

  • MOSRS TIDS link
  • WP leads: Jin Lee, Fiona Smith
  • BoM contacts and contributors: Jin Lee, Fiona Smith
  • CSIRO contacts and contributors: Martin Dix

TILS: Land surface model interoperability

  • MOSRS TILS link
  • WP lead: Rachel Law
  • ACCESS contacts and contributors: Rachel Law, Jhan Srbinovsky, Ian Harman, Tilo Ziehn, Bernard Pak
  • CSIRO FTE's: 1.5 (CD: 0.6, LI: 0.9)
    • CD: Coupling meets JULES/UM standards and incorporated into trunk. CABLE in JULES offline as initial case.
    • LI: Coupling of CABLE to UM10.6+ and testing

Working tables and other associated pages

Previous years

  • 2018-19 Feb 2018 version of this page
  • 2017-18 Jul 2017 version of this page
  • 2016-17 Nov 2016 version of this page
  • 2015-16 Aug 2015 version of this page
  • 2014-15 Mar 2015 version of this page