wiki:access/UmPartnersTechnicalInfrastructureProject

Version 6 (modified by Michael Naughton, 4 years ago) (diff)

--

UM Consortium Technical Infrastructure Collaboration Project

Overview

The UM Consortium Technical Infrastructure Project is a collaborative project involving the core and associate UM Consortium members. Project documentation is available on the Technical Infrastructure TRAC wiki (registration required), in particular, in the Advisory Group sub-page. The project vision statement therein gives the context, purpose, scope and goals of the project.

Participation of core members (UK Met Office, CAWCR, KMA, and NCMRWF) is part of the UM Licence Agreement. Under the terms of the UM Licence Agreement, the UM core partners have each agreed to 4 Full Time Equivalent (FTE) staff commitment to this programme. In the ACCESS case, CAWCR is the core partner, the commitment is 2 FTEs each for BoM and CSIRO. The ARCCSS is not required to have a formal resource commitment to the partnership, but they are also involved in the project as UM associate members.

ACCESS 2015-2016 contributions

Work Packages, leads and ACCESS points of contact.

WP WP description WP lead ACCESS points of contact and contributors BoM CSIRO
TIAG Advisory Group (and other management contributions) Keir Bovis, Michael Naughton Michael Naughton, Martin Dix, Scott Wales; Peter May, Gary Dietachmayer, Robin Bowen and others 0.3 0.1
TIRS Rose development and migration Dave Matthews, Keir Bovis none
TISD Suite Development Dave Matthews, Hilary Oliver Yi Xiao (and Michael Naughton, Peter Steinle, Jin Lee, Martin Dix) 0.3 0.5
TICM Common shared repositories and Trac environments Dave Matthews, Keir Bovis Martin Dix, Scott Wales 0.1 0.1
TICT UM Configuration testing and system refresh Michael Naughton, Glenn Greed Michael Naughton, Scott Wales 0.3
TIFF File Formats – STASH, NetCDF and GRIB2 Mark Hedley Martin Dix 0.3
TIAN Stabilising and re-engineering ancillary file system Jamie Kettleborough Martin Dix, Peter Dobrohotoff 0.2
TICF Coupling Frameworks OASIS-MCT TBC Dave Bi, Scott Wales 0.2
TILS Land-surface model interoperability Rachel Law Rachel Law, Jhan Srbinovsky 0.55
TIAV Data Processing & Visualisation Mark Hedley Martin Dix 0.1 0.1
TIHP HPC Optimisation Ben Evans (NCI), Paul Selwood
(to be confirmed)
Ilia Bermous; ACCESS-Opt project members 0.5
TIDA Data Assimilation Peter Steinle, Adam Maycock Peter Steinle, Tan Le 0.3
TISU Small Utilities Lawrie Rikus Gary Dietcahmayer, Greg Roff, Peter Steinle, Martin Dix, Wenming Lu 0.2
Total 2.1 2.05

Summary of ACCESS 2015-2016 contributions

A large part of the activities for 2015-2016 will be continuation of 2014-2015 work, especially in relation to Rose-Cylc suite development and transition to use the shared repositories.

For 2015-16 each of the UM Partners was asked to nominate work packages where they would take lead role, and work packages where they would be devoting a significant part of a single staff member's effort. For ACCESS, the contributions in TIAG, TICT, TIFF/TIAN, TILS, TIHP, TIDA, TISU work packages are the ones which have been put forward.

The following activities are in progress with ACCESS involvement.

  1. TISU UM productivity and debugging tools

ACCESS to create a wiki resource and associated source repositories with a number of useful tools for model diagnosis and debugging and optimisation. These may include

  • Gary Dietachmayer (gsd) UMExplore python interactive environment
  • Greg Roff and gsd's model input settings comparison tools
  • Lawrie Rikus and gsd's Standard Model Output Comparison System (SMOCS)
  • Martin Dix's file manipulation utilities
  1. TICT UM code improvements and testing
  • Elimination of spurious compiler warning messages from UM compilations (Scott Wales)
  • Simplified UM and Recon build jobs (Michael Naughton)
  • Parallelisation of !CreateBC (Ilia Bermous)
  1. TIHP UM performance and benchmark HPC collaboration framework

ACCESS to help facilitate set-up and maintenance of standard UM HPC benchmark cases and sharing of partners results and performance optimisations.

  1. TIDA Obs monitoring and obs processing diagnostics (Peter Steinle & Adam Maycock)
  1. TIAN NetCDF file usage in Ancil program (Martin Dix, Peter Dobrohotoff)
  1. TILS JULES-CABLE improvements (Rachel Law, Jhan Srbinovsky)

Another collaboration step has been to move the access_wiki to accessdev, which will provide greater flexibility in authorising external users to view ACCESS information, documentation and workshop and training presentations.

Draft Notes for August Highlight Reports

wiki:UmTechnicalInfrastructureProjectAug15Highlights