Changes between Version 6 and Version 7 of Rose/Rose Stem UM


Ignore:
Timestamp:
Nov 24, 2016 4:10:40 PM (5 years ago)
Author:
Martin Dix
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Rose/Rose Stem UM

    v6 v7  
    4040
    4141Results are also available via rosebush at https://accessdev.nci.org.au/rose-bush/suites/accesstester.
     42
     43== Management ==
     44Since the model runs are machine dependent we need to generate our own “known good output” (KGO) rather than using Met Office output. The weakness in our UM rose stem setup is what happens when there’s a code change that’s intended to change the results. At the Met Office the person committing the code change to the trunk has the responsibility of updating the KGOs and the rose-stem variables to point to the new directories, e.g. https://code.metoffice.gov.uk/trac/um/browser/main/trunk/rose-stem/site/meto/variables.rc.
     45
     46The NCI versions of the variables.rc file (https://code.metoffice.gov.uk/trac/um/browser/main/trunk/rose-stem/site/nci/variables.rc) tracks the Met Office variables so when these change our comparisons fail because the new KGO directory is missing.
     47
     48There’s a script admin/rose-stem/kgo_update.py in the UM source tree that automates this at the Met Office by copying fields from the latest run to the KGO directories. It doesn’t work here because the checking fails because it’s trying to use a directory that’s not present. I’ve been intending to come up with a better way to do it here, but haven’t got around to it yet. At the moment I copy the new output manually. Changes aren’t that frequent so this hasn’t been too annoying yet, though it did get a bit hectic just before the vn10.6 release. Ideally we’d do some extra checking that the size of the difference in the results here was similar to the difference at the Met Office, but I’ve only ever done this in a couple of special cases.
     49
     50Some discussion
     51https://code.metoffice.gov.uk/trac/um/ticket/1828
     52
     53Cost estimates of the nightly and weekly tests at https://code.metoffice.gov.uk/trac/um/wiki/NCI_StandardJobs10.6/Resources
     54