Opened 4 years ago

Last modified 4 years ago

#181 accepted

How do we update UM KGOs automatically?

Reported by: Michael Naughton Owned by: Scott Wales
Priority: major Component: Accessdev Server
Keywords: TIWG Cc:

Description


Change History (7)

comment:1 Changed 4 years ago by Michael Naughton

At the met office the code reviewer updates KGOs, but this doesn't work for us

comment:2 Changed 4 years ago by Scott Wales

Keywords: TIWG added

comment:3 Changed 4 years ago by Scott Wales

Owner: set to Scott Wales
Status: newaccepted

comment:4 Changed 4 years ago by Scott Wales

The weekly test suite is currently requiring a number of KGO updates, probably a good point to look at this.

comment:5 Changed 4 years ago by Martin Dix

Created nci_n48_eg/vn10.3 by hand so that the developer group runs.

comment:6 Changed 4 years ago by Martin Dix

kgo_update.py seems to work properly on raijin if I setup ssh-agent so it can get to accessdev and I add

[rose-suite-run]
hosts=accessdev

to $HOME/.metomi/rose.conf.

Then

raijin% rose config rose-suite-run hosts
accessdev

and

raijin% cylc suite-state --host=accessdev um_vn10.3

both work.

raijin% cylc suite-state --host=accessdev -d /home/548/accesstester/cylc-run trunk-nightly

works when run as me so we should be able to update KGOs flagged in the regular testing.

Note that the generous default number of retries means that cylc suite-state takes a long time to fail if given a non-existent suite name.

Use kgo_update.py --new-version to install the files for a new UM version.

comment:7 Changed 4 years ago by Martin Dix

trunk-weekly failed on

rose_ana_nci_n48_nd_noomp_atmos_kgo
rose_ana_nci_n48_nd_noomp_recon_kgo

due to a real change, 1162 at https://code.metoffice.gov.uk/trac/um/wiki/LoseBitComparison/10.4

Our rose-stem/site/nci/variables.rc is set to track the Met Office one

{%- set NCI_N48_ND_KGO          = meto.XC40_N48_ND_KGO                      %}

which now has

{%- set XC40_N48_ND_KGO='001-tkt1162' %}

so the rose-ana task is failing because it's looking for the new directory /g/data/access/KGO/standard_jobs/rose/nci_n48/001-tkt1162, not because the comparison has actually failed.

This means that the kgo_update.py script doesn't work.

An ugly workaround is to reset site/meto/variables.rc to the previous version and rerun the rose-ana tasks so they fail properly. kgo_update.py then works.

Not tracking the Met Office variables is even worse because then we'd have to get a change into the trunk to update our own version variables.

Note: See TracTickets for help on using tickets.