Changes between Version 3 and Version 4 of access/RoseSuitePrebuilds


Ignore:
Timestamp:
Mar 3, 2016 1:58:38 PM (3 years ago)
Author:
Martin Dix
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • access/RoseSuitePrebuilds

    v3 v4  
    44== Creating prebuilds ==
    55
    6 See also section 10 of UMDP X4, https://code.metoffice.gov.uk/doc/um/vn10.1/papers/umdp_X04.pdf
     6See also section 11 of UMDP X4, https://code.metoffice.gov.uk/doc/um/vn10.3/papers/umdp_X04.pdf
    77
    8 Met Office rose stem suites set
     8X4 recommends setting the prebuild to use the source code directly from the repository rather than from a working copy.
    99
    10 {%- set PREBUILD_HPC_ROOT_DIR='/home/h01/frum/cylc-run/vn10.1_prebuilds/share' %}
     10Recommended command is something like
    1111
    12 The PS36 Met Office suite app/fcm_make_um/rose-app.conf specifies a particular configuration
    1312{{{
    14 prebuild=/home/h01/frum/cylc-run/vn10.1_prebuilds/share/fcm_make_metohpc_um_high_omp
     13 rose stem -S PREBUILDS=false --group=fcm_make --source=fcm:um.xm_tr@vn10.4 --name=vn10.4_prebuilds --config=/home/599/mrd599/um_vn10.4/rose-stem
    1514}}}
    1615
    17 Task to create prebuilds for a number of configurations added to branch martindix/vn10.1_nci_rose_stem.
     16At the moment we don't have an fcm-make group in our rose-stem configuration so run the complete group=nci and just hold all the model reconfig and run tasks.
    1817
    19 X4 recommends setting the prebuild to use the source code directly from the repository
     18To get the prebuilds in /g/data/access/prebuilds it's necessary to modify the fcm_make tasks in {{{rose-stem/site/nci/runtime.rc}}} and also the fcm_make_um app. E.g. in runtime.rc, define a new variable in each task
     19{{{
     20    [[fcm_make_nci_um_high_omp]]
     21        [[[environment]]]
     22            NCI_PREBUILD_DIR={{PREBUILD_NCI_ROOT_DIR }}/fcm_make_nci_um_high_omp
    2023
    21 Run this as
     24    [[fcm_make2_nci_um_high_omp]]
     25        [[[environment]]]
     26            NCI_PREBUILD_DIR={{PREBUILD_NCI_ROOT_DIR }}/fcm_make_nci_um_high_omp
     27}}}
    2228
     29Because we're running with PREBUILDS=false, the PREBUILD variable isn't defined so can't use that.
     30
     31In {{{app/fcm_make_um/rose_app.conf}}} add
    2332{{{
    24  CYLC_VERSION=6.3.0 ROSE_VERSION=2015.02.0 rose stem  -S SITE=\'nci\' -S PREBUILDS=false -S UMDIR=\'/projects/access/umdir\'  --group=fcm_make --source=fcm:um.xm_tr@vn10.1 --name=vn10.1_prebuilds --config=/home/599/mrd599/vn10.1_nci_rose_stem/rose-stem
     33dest-orig=$NCI_PREBUILD_DIR
     34dest-cont=$NCI_PREBUILD_DIR
    2535}}}
     36bfeore the {{{[env]}}} section.
    2637
    2738The resulting fcm-make.cfg file has
    2839{{{
    29 extract.location{diff}[um] = fcm:um.xm_tr@vn10.1
     40extract.location{diff}[um] = fcm:um.xm_tr@vn10.4
    3041}}}
    3142rather than the specific directory a normal rose-stem build would have
    3243{{{
    33 extract.location{diff}[um] = /home/599/mrd599/vn10.1_nci_rose_stem
     44extract.location{diff}[um] = /home/599/mrd599/vn10.4_prebuilds
    3445}}}
    35 
    36 Now on accessdev, copy directory {{{~/cylc-run/vn10.1_prebuilds/share/fcm_make_CONFIG}}} to {{{~access/prebuilds_non_svn/vn10.1_prebuilds}}}, where CONFIG is the particular build configuration. Note that directory {{{prebuilds_non_svn}}} is just temporary until #167 is resolved.
    37 
    38 On raijin, copy directory {{{~/cylc-run/vn10.1_prebuilds/share/fcm_make_CONFIG}}} to
    39 {{{~access/prebuilds/vn10.1_prebuilds}}}
    40 
    41 Moving prebuilds is tricky, see https://github.com/metomi/fcm/issues/185
    42 
    43 == Using prebuilds ==
    44 
    45 Use
    46 {{{
    47 PREBUILD_NCI_ROOT_DIR=/projects/access/cylc-run/vn10.1_prebuilds
    48 }}}