NOTES from second porting Meeting, Wed 11am, 17th July 9E Meeting room.

Present: Ivor, mjn, Joan, ttl, ilia, Wen Ming, Zhihong, Xiao, Mdix, ciwt, azs, rab

Configuration Management of systems/suites that go into operation

  • There was a discussion on rationalising the directory structure of operational systems and using SVN to keep track of changes as well as thorough documentation of all components.
  • -- This aim is generally agreeable to all present although there are differences in priorities, and on the best way to proceed.
  • -- It was noted that this subject extend beyond the scope of "porting" although there are arguments that its implementation (at least some of it, eg. using SVN) may aid in the porting work itself.
  • -- This subject is also potentially vast.
  • -- Failure to implement some kind of source control at the very beginning will result with hard to maintain system, detrimental in the long term.
  • -- Need to be able to trace (and rebuild) source of executables.

A round table discussion was initiated to give everyone present chance to present their issues. Many of the issues relate to Source/Config management above. Other issues raised are noted in items of the table below

Issues and Task List updated as discussed during meeting. Some issues migrated to omit list table at the bottom.

2 30 Days Ngamai Acceptance test Commenced from handover date (end June), running a SSP mix of programs (including UM benchmark from solar. Acceptance mainly upon 30 days of running without error. No acceptance test doc. Due to complete on 4th week of July. So far there have been no problems. Side note: So far Raijin have been found to be slower than solar for UM using equivalent number of cores/configrab
3 Setup and rebuild of /apps So far < 50% have been done, but the main ones crucial for porting such as compilers have been done. Ongoing work. /apps group, rab
--3a Logins for BoM users General user access to ngamai is now available, starting from pm Wed 17th July 2013 rab
5 Logins for CAWCR/NMOC migration team See (3a) rab
6 Intel compiler 11.0.83 Strong need, but not straightforward to provide. This may be a difficult issue. Two prong approach is advised. Attempt to use LD_LIBRARY_PATH to tackled this so far failed due to what appear as hardcoded path within the intel 11.0.83 setups. Consultation with various local experts and intel staff so far is unsuccesfull. In the meantime recompilation with v12 have shown very small difference which may be acceptable (Ilia & Xiao). Do not use -Xhost option. Do not use Intel v13 compilers. ilia,rab, group
7 Source Code for UM Migrate SVN repository mirror from solar - cut over during 1st weekend of October. azs
8 Source Code for VAR Migrate SVN repository from solar - cut over during 1st weekend of October. azs
9 Source Code for OPS Migrate SVN repository from solar - cut over during 1st weekend of October. azs
10 Source Code for SURF Migrate SVN repository from solar - cut over during 1st weekend of October. In general, all svn repository will be moved to NCI to allow access from raijin. azs
11 ~access directory Copy solar's to "from_solar" on ngamai. Move to proper place as we go along. Improve where suitable. Interoperability with raijin is important consideration and should be done where possible.access.admin
12 GCOM Libraries Decide naming strategy, identify required versions/compile options, Synchronise with Raijin access.admin, azs,ilia,Martin
13 Migrate Trac databases Cutover from solar to ngamai 1st weekend of Oct. azs
14 UM Small execs Do for vn7.3, 7.5, 7.6, 8.2 and 8.4 Martin
15 Migrate UMUI, VARUI, OPSUI and SCSUI Initially to operate UMUI from solar Zhihong, azs, ilia, xiao, Say
16 CAPS program on ngamai vn8.1 now available and have been setup on Raijin Martin
17 Re-compile/build UM 7.5/7.6 Executables for APS1 - Global, Regional, Access-C ... Documentation of build procedure, UI job id, wiki page of build or similar to UKMO Parallel suite page Ilia, Xiao, azs
--17a ACCESS-G VN7.6 (PS24) Ilia, Xiao, azs
--17b ACCESS-R VN7.6 (PS24) Ilia, Xiao, azs
--17c ACCESS-C Wenming & azs trying out build job from vn7.6, PS24 UK4. UKMO qazga, Xiao's xbdec. Wenming, Ilia, Xiao, azs
--17d ACCESS-TC VN7.6 (PS24) Ilia, Xiao, azs
--17e UKV VN7.6 (PS24) Ilia, Xiao, azs
--17f VAR Compile/build of VAR not done through UI Ilia, Xiao
--17g OPS Compile/build of OPS not done through UI Ilia, Xiao
--17h SURF Compile/build of SURF not done through UI Ilia, Xiao
18 MARS scripts and exes Archiving scripts, converters etc. ttl
19 Porting/Migration website Use NCI access trac. Need NCI userid for everyone Porting Group
20 Web serving and documentation from ngamai Comment rab/Porting Group
21 fcm utility Only fcm2.3 should be required as fcm is backward compatible. fcm 1.5 have been used succssfully on yambuk. Need certain Perl Libraries. Martin
22 Miscellaneous utilities used by ACCESS systems Comment UM Porting group, azs
23 profile.gen.access Should be in /access/scripts, not in /access Xiao
24 UM Ancillaries input data. Since UM ancillaries, in particular for N512 can be quite large, propose that it go into /access/ancils instead of into UMDIR (or into /access/data/ancils ). access.admin, azs
25 Misc UM parameter files A few smallish radiation param, verts, ancil and STASHmasters etc. UM porting group, azs
26 APS1 suite To expand this into more detailed list Joan, ciwt, Xiao
27 APS2 suite APS2 is of secondary importance since it is not operational yet. ciwt, Xiao, Sergei, Joan
28 ACCESS systems/suites not synchronous with operational system Will not be able to address this as part of porting project. Will need to wait until APS3 ROSE based systems. In the meantime, better documentation will help, also better source code tracking/building procedure - See discussion at start of this note. Porting Group
30 NCI Training course on 22nd July There are sessions for new users as well as experienced users. Porting Group
31 Back copy of solar files prior to its decommisioning. Easy to do. Porting Group
32 $CWSHARE Will still be required, though most shared scripts and utilities will be in /access/bin or /access/scripts. Porting Group
34 Higher management's Porting plan. Will be of help for our reference. There is also call for detailed estimates of resources required rab, mjn
35 SMS To be installed as a "module", as part of /apps. - Will be modularised. - Use new NMOC included files from Milton Woods, but CAWCR research may stay with their own set of include files. - put "SMSOUT" into different directory /apps group, Wen Ming
36 Veri Py Part of some SMS suites. New version to be developed for Raijin mjn, Wen Ming
37 Plotting Systems Part of some SMS suites. New version to be developed for Raijin mjn, Wen Ming

  • Bigfont Problem on ngamai. X11 now installed. Need to investigate GHUI2.0 for bigfont problem that still exist with UIs
  • ngamai:/access/from_solar available. Need to swap with 2nd version ( currently /access/fs2 copied using rsync)

1 Oracle Handover of Ngamai to BoM Done on 27th June rab
4 Ngamai Configuration Linux 6.2 Will be identical to solar, but with newer s/w versions. Generally, for all s/w on solar, there will be equivalent on ngamai, but no older version unless necessary. File system setup is similar, different h/w namespaces. There will be filesystem quota. rab
29 STASHMaster File Regression Not possible. Must be due to misunderstanding/mistake Porting Group
33 Suites/Applications to work regardless of user's default login shell and environment Desirable. Porting group, all developers.

Next Meeting is on Wed 11am, 24th July 9E Meeting room.

Last modified 5 years ago Last modified on Oct 20, 2016 2:18:05 PM