wiki:access/UmPartnersTechnicalInfrastructureProject

Version 71 (modified by Michael Naughton, 2 years ago) (diff)

--

UM Consortium Technical Infrastructure Collaboration Project

Revision status

  • [Rachel Law and Jhan Srbinovsky 16/05/2017] Work in progress: 2017-18 plans: addition of draft CSIRO contributions.
  • [Michael Naughton 12/05/2017] Work in progress: 2017-18 plans: further minor updates with input from Alan Riley, Tony Hirst. This version being reviewed for approval by BoM ESM Program Manager.
  • [Michael Naughton 10/04/2017] Work in progress: 2017-18 plans have been updated after consultation with parties. Still subject to BoM management approval.
  • [Michael Naughton 09/02/2017] Work in progress: This page is currently being updated for 2017-18 plans. Information below is subject to change.

Overview

The UM Consortium Technical Infrastructure Project (UMTIP) is a collaborative project involving the core and associate UM Consortium members. Project documentation is available on the Technical Infrastructure TRAC wiki, which contains a list of the UMTIP Work Packages. Further top-level programme information is contined in the Technical Advisory Group (TAG) sub-page. The project vision statement therein gives the context, purpose, scope and goals of the project.

Participation of core members (UK Met Office, Bureau-CSIRO, KMA, NCMRWF and NIWA) is part of the UM Licence Agreement. Under the terms of the UM Licence Agreement, the UM core partners have each agreed to 4 Full Time Equivalent (FTE) staff commitment to this programme. In the ACCESS case, the commitment is 2 FTEs each for BoM and CSIRO. The ARCCSS is not required to have a formal resource commitment to the partnership, but they are also involved in the project as UM associate member.

Bureau planned 2017-18 activities are provided below. As far as possible, these contributions have been discussed and agreed with relevant managers in each of the work areas. CSIRO planned 2017-18 activities are also provided, consistent with CSIRO internal project planning.

Progress reports

ACCESS 2017-2018 contributions

For 2017-18, the partnership has identified two keynote projects to be major focus of UMTIP activities, in addition to the continuing work in the other work packages. These focus project areas are observations capability, and ancillary file generation, within the TIDA and TIAN work packages, respectively. The following lists the proposed ACCESS contributions to each of the wok packages, arranged in the same alphabetical order as in the main table in the Technical Infrastructure TRAC wiki. In addition, proposed TIOP, TIRA operational aspects and regional reanalysis work packages have been added below to capture work that is not currently covered by the present work packages. The initial version only includes Bureau contributions; CSIRO contributions can also be recorded here, in the same format, if desired.

UM Partners have been asked to nominate work packages where they would take lead role, and work packages where they would be devoting a significant part of a single staff member's effort. For 2017-18, significant Bureau contributions (at least 0.3 FTE's) are proposed in TIAG, TIDA, TISD, TICT/TIHP, TIOP work packages below. Significant CSIRO contributions are proposed for TILS.

Partners have also been asked to classify the work into Consortium Development (CD) and Local Implementation (LI) components; this breakdown is included below.

Nominal contributions are rounded up to 0.1, since we are not trying to track contibutions to finer than this scale.

TIAG: Advisory Group (and other management contributions)

  • MOSRS TIAG link
  • WP leads: Keir Bovis, Michael Naughton
  • ACCESS contacts and contributors: Michael Naughton, Martin Dix, Scott Wales; Peter May, Gary Dietachmayer, Robin Bowen and others
  • BOM FTE's: 0.3 (CD: 0.2, LI: 0.1)
    • CD: Michael Naughton perform role as TAG chair. (0.1)
    • CD: Peter May handle ACCESS TI aspects on UM Consortium Board. (0.1)
    • LI: Michael Naughton, Peter May, Robin Bowen, Gary Dietachmayer engage in management activites to plan and deliver Bureau TIP contribution. (0.1)
  • CSIRO FTE's: 0.1 (CD: 0.1)
    • CD: Martin Dix contribution to TAG (0.1)

TIAN: Stabilising and re-engineering ancillary file system

  • MOSRS TIAN link
  • WP leads: Jamie Kettleborough, Keir Bovis
  • ACCESS contacts and contributors: Martin Dix, Imtiaz Dharssi, Wenming Lu, Arnold Sullivan, Peter Dobrohotoff
  • BOM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • CD: Review and provide scientific comment on ANTS work
    • LI: Implement and test ANTS software for Bureau applications
  • CSIRO FTE's: 0.2-0.3
    • CD: Review and provide scientific comment on ANTS work
    • LI:

TIAV: Data processing and visualisation

  • MOSRS TIAV link
  • WP lead: Raghav Sreevathsa
  • ACCESS contacts and contributors: Martin Dix, Weiqing Qu (tentatively)
  • BOM FTE's: 0.1 (CD: 0.1; LI: 0.0)
    • CD: Bureau to implement, test and review IRIS tools and developments.
    • Bureau to collaborate on IRIS development through Model Data Services (MDS) project, continuing on work commenced during Phil Elson 2016-17 secondment visit. Weiqing Qu nominated as possible Bureau lead for this collaboration.
    • FTE figure is nominal at present time, representing contribution to IRIS development from IRIS enhancements associated with Bureau MDS project work.

TICD: Collaborative sharing of science codes and data

  • MOSRS TICD link
  • WP leads: Keir Bovis, David Matthews
  • ACCESS contacts and contributors: Martin Dix, Jin Lee, Scott Wales, Asri Sulaiman, Jonathan Thomas
  • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • CD: Identify files to be added to Jasmin data server; maintain Bureau TIDS mirror. (0.1)
    • LI: Maintain Bureau mirroring of MOSRS repositories and Bureau ACCESS TRAC systems. (0.1)
    • Jin Lee, Jonathan Thomas, Asri Sulaiman to be primary Bureau contact points for Jasmin and BoM MOSRS mirrors.

TICT: UM Configuration Testing and system refresh

  • MOSRS TICT link
  • WP leads: Michael Naughton, Glenn Greed
  • ACCESS contacts and contributors: Michael Naughton, Scott Wales; Martin Dix, Lawrie Rikus and others
  • BoM FTE's: BoM 0.2 (CD: 0.1, LI: 0.1)
    • CD: Lawrie Rikus working on ACCESS NWP STASH specification and procedures and tools for maintaining STASH settings in shared NWP suites. This will involve engagement with MO developers and partners on STASH practices. (0.1)
    • LI: Keep up with cycle of UM releases. (0.1)
    • Note that Bureau is also engaged in UM optimisation work, which is recorded in the TIHP work package.
    • Lawrie Rikus, Asri Sulaiman, Ilia Bermous, Milton Woods, Yi Xiao, Wenming Lu all contributing.

TIDA: Data Assimilation and observations capability

  • MOSRS TIDA link
  • WP leads: Peter Steinle, Adam Maycock
  • ACCESS points of contact and contributors: Peter Steinle(0.1), Tan Le(0.2), + secondment(0.6)
  • BoM FTE's: 0.9 (CD: 0.6, LI: 0.3)
    • CD: Develop a observation monitoring system that is suitable for use across the Partnership and provides the functionality of EMWF obstat monitoring and the provides advanced satellite monitoring that satisfies UMS needs
    • LI: Local tailoring of above system
    • Ref. Peter's 18-Apr email "DA Technical Infrastructure" and 0216-bom wiki notes.

TIFF: File Formats - STASH, NetCDF and GRIB2

  • MOSRS TIFF link
  • WP lead: Mark Hedley
  • ACCESS contacts and contributors: Martin Dix
  • BOM FTE's:
    • CD
    • LI

TIHP: High Performance Optimisation and Benchmarking

  • MOSRS TIHP link
  • WP leads: Ben Evans (NCI), Paul Selwood
  • ACCESS contacts and contributors: Ilia Bermous, Milton Woods, ACCESS-Opt project members.
  • BoM FTE's: BoM 0.3 (CD: 0.1, LI: 0.2)
    • CD: Contribute Bureau / ACCESS-Opt developments to UM partnership. (0.1)
    • LI: Implement and test latest MO optimisations in ACCESS models. (0.2)
    • CD: Collaborate on benchmark development, testing, sharing. (0.0)
    • OpenMP coverage improvement if something significant is found in the latest sources.
    • Performance improvements in handling transcendental functions.
    • Tune building procedure with the Intel compiler for Raijin/Terra/Australis.
    • Performance tuning of UM models for the APS3 operational upgrade.
    • Investigate performance of the most expensive loops.
    • Ilia Bermous is principal staff member for this work package; Robin Bowen, Milton Woods, Justin Freeman, Michael Naughton, Peter Steinle all contributing.
    • Ben Evans and other NCI ACCESS-Opt staff have major involvement in this work package.
    • Ref: ACCESS section in MOSRS TIHP page.

TILI: Land surface data assimilation

  • WP lead:
  • ACCESS contacts and contributors: Imtiaz Dharssi
    • BoM FTE's: 0.0
    • Technical activities in support of transition to NASA LIS.
    • Placeholder -- identified to become a UMTIP project, but not yet active.

TILS: Land surface model interoperability

  • MOSRS TILS link
  • WP lead: Rachel Law
  • ACCESS contacts and contributors: Rachel Law, Jhan Srbinovsky, Ian Harman, Tilo Ziehn, Bernard Pak
  • BOM FTE's:
    • CD
    • LI
  • CSIRO FTE's: 1.5 (CD: 0.6, LI: 0.9)
    • CD: Coupling meets JULES/UM standards and incorporated into trunk. CABLE in JULES offline as initial case.
    • LI: Coupling of CABLE to UM10.6+ and testing

TISD: Suite Development and Design

  • MOSRS TISD link
  • WP leads: Dave Matthews, Hilary Oliver
  • ACCESS points of contact: Yi Xiao, Martin Dix, Scott Wales; Michael Naughton, Peter Steinle, Jin Lee, Susan Rennie
  • BOM FTE's: BoM 0.6 (*) (CD: 0.3, LI: 0.3)
    • CD: Collaborate on design, implementation and testing of shared portable versions of the main global and regional NWP and Seasonal Prediction suites. (0.2)
    • LI: Keep in step with latest versions of Met Office NWP and Seasonal suites. (0.2)
    • CD/LI: Host visit by Mike Thurlow for global NWP suite collaboration. (0.2)
    • Yi Xiao, Jin Lee, Susan Rennie, Michael Naughton, Peter Steinle and other Bureau NWP and Seasonal Prediction staff are involved in aspects of suites development and design work.

TISU: Small Utilities

  • MOSRS TISU link
  • WP lead: Lawrie Rikus
  • ACCESS points of contact and contributors: Peter Steinle, Martin Dix, Wenming Lu, Gary Dietachmayer, Tan Le, Jin Lee
  • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • CD: implementation of SMOCS into local NWP suites (0.05)
    • LI: Small collection of scripts to manipulate the STASH in rose suites to facilitate local implementation. (0.05)
    • CD: ACCESS to create and manage projects in MOSRS utils svn repository (trac, svn). (0.1)
    • LI: Evaluate Met Office model asessment software (AutoAssess, TRUI, VER, VerPy) with recommendations for next steps in collaboration; overlaps with TIVE work package (when available).
    • This work package is being merged with TIVE work package to reduce reporting and administration.
    • Lawrie Rikus, Susan Rennie, Peter Steinle, Tan Le, Gary Dietachmayer, Wenming Lu, Jin Lee contributors.

TIVE: Verification

  • MOSRS TIVE link
  • WP leads: Adam Clayton, Phil Gill
  • ACCESS contacts: Chris Bridge
  • BoM FTE's: 0.1 (CD: 0.0; LI: 0.2)
    • LI: Explore Bureau use of VER/VerPy and RMED verification toolkit packages in ACCESS NWP suites. (0.2)
    • LI: Participate in TIVE discussions and activities. (0.1)
    • Chris Bridge to be primary Bureau contact point, with several other Bureau NWP suite developers possibly also participating.

Proposed new projects

TIOP: Operational Systems

  • WP lead: Tennessee Leeuwenburg
  • BoM Cylc project contact and contributors: Alan Riley, Damian Agius, Hilary Oliver (NIWA)
  • BoM FTE's: 0.2 (CD: 0.2; LI: 0.0)
    • CD: Bureau to take lead on security enhancement of UM TI components. (0.1)
    • CD: Bureau to participate in discussions and meetings on operational technical infratructure aspects. (0.1)
    • Tennessee Leeuwenburg and other ISS experts will be involved in this area, which follows on from visits and contacts since 2015.
    • Tennessee Leeuwenburg to present on this work package in 2017 UM Users Workshop TI session.
    • Bureau has commenced project with Altair to provide supported Cylc version for Bureau operational and research requirements. Relevant outcomes from this project will be shared with UM Partnership through UMTIP project Operational and Cylc work packages. Primary focus is security assurance; development of enhanced capabilities for monitoring and alerting, and generation of reports are also part of this project.
    • Alan Riley is Bureau Project Manager of Cylc Project; Damian Agius is lead programmer for operational Cylc deployment; Hilary Oliver is involved through Altair contract as specialist Cylc consultant.

TIRA: Regional reanalysis

  • WP lead: Chun-Hsu Su
  • ACCESS contacts and contributors: Peter Steinle, Greg Kociuba, Nathan Eizenberg
  • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • Development and delivery of reanalysis suite in roses-u; extending UERRA suite with local configuration and tools
    • Reanalysis production run over the Australian domain for period 2000-2016, and report regional evaluation results for comparisons with other regional reanalysis projects.
    • Report to TAG summarising progress and capability.
    • Aligned with Bureau Reanalysis project.

TILF: LFRic collaborative engagement

  • WP lead:
  • ACCESS contacts and contributors: Tony Hirst, Tim Pugh, Justin Freeman, Robin Bowen, Milton Woods, Paul Leopardi, Joerg Henrichs
    • BoM FTE's: 0.2 (CD: 0.1; LI: 0.1)
    • Participate in discussions and planned workshop re LFRic UM Partnership collaboration.
    • Not currently a UMTIP project; placeholder to capture this activity and associated effort.

Working tables

Previous years