EOS devops meeting

Wednesday 4 Mar 2020, 14:55 → 16:00 Europe/Zurich

600/R-001 (CERN)

15:00 → 15:10 Communications

• New releases and describe the main bugs and new features added.
• Planned upgrades and/or interventions

15:00 New releases and hightlighs the main bugs and new features added.

15:05 Planned upgrades and/or interventions an their impact

(maria)

- 10/03/2020 : Fusex will be available for ATLAS in lxplus QA machines.

 

15:10 → 15:20 Main Issues (Incidents/bugs)

e.g:
- Crash:
- when happened?
- what happened?
- how it was solved?
- how can be avoided?

15:20 → 15:30 Main Success (also great features/bugs solved in the software)

e.g.:
- what happened?
- when it happened?
- who is happy about it? :)

(maria)

• The failover in ATLAS was successful with no incidents/surprises.
• Fusex is available for the CMS endpoint in lxplus qa machines, if everything goes well we will move it to prod the following week.

(roberto)

• EOSPROJECT-i00 mgm is running eos 4.7.0 since tuesday. Now updating the fsts. Straight-forward upgrade, no issues. If everything continue like this, will update EOSHOME-i04 and probably other project next week.
• Adding capacity for  EOSPROJECTS/EOSHOME
• With a big help from Cristi, we tested eosmedia conversion to quarkdb and it took around 45m for the full process. Probably we will ask for a 2h slot in order to have some room if something (bad) happens. Still with no hardware for that, I expect to have this sorted this week so I can announce the intervention soon.

Elvin

EOS(PPS) now passed all the HTTP TPC tests and below you can see the result of the "smoke-test":

DOMA-TPC smoke test, started 2020-03-03T12:00+0100, took 67:20.

SOUND ENDPOINTS

SCORE  ENDPOINT        SOFTWARE         WORK-AROUNDS
20     AGLT2           dCache                         [in 01:03]
20     BEIJING         DPM                            [in 02:34]
20     BNL             dCache                         [in 02:12]
20     BRUSSELS        dCache                         [in 01:13]
20     CALTECH2        xrootd-R/HDFS                  [in 02:17]
20     CALTECH         xrootd-D/HDFS                  [in 01:44]
20     DESY-DOMA       dCache                         [in 00:18]
20     DESY-PROM       dCache                         [in 00:13]
20     FNAL            dCache                         [in 00:48]
20     IN2P3           dCache                         [in 00:21]
20     IN2P3-TEST      dCache                         [in 00:26]
20     INFN-T1         StoRM                          [in 00:52]
20     KIT             dCache           [2]           [in 00:34]
20     LRZ-LMU         dCache                         [in 00:42]
20     NDGF            dCache           [2]           [in 00:39]
20     NDGF-PREPROD    dCache           [2]           [in 01:15]
20     NEBRASKA2       xrootd-R/HDFS                  [in 01:10]
20     NEBRASKA        xrootd-D/HDFS                  [in 00:55]
20     PIC-PROD        dCache                         [in 01:42]
20     PRAGUELCG2      DPM                            [in 00:27]
20     PURDUE          xrootd-D/HDFS                  [in 00:49]
20     SARA            dCache           [2]           [in 02:50]
20     SARA-test       dCache                         [in 00:18]
20     TOKYO-LCG2      DPM                            [in 01:22]
20     TRIUMF-DYNAFED  DynaFed/S3                     [in 01:45]
20     TRIUMF-PPS      dCache                         [in 00:49]
20     TRIUMF-PROD     dCache                         [in 10:02]
20     UKI-BRUNEL      DPM                            [in 00:39]
20     UKI-IC          dCache                         [in 00:26]
20     UKI-LANCS       DPM                            [in 00:53]
20     UKI-MAN         DPM                            [in 00:42]
20     UKI-MAN-PROD    DPM                            [in 00:42]
20     UKI-QMUL-DEV    StoRM                          [in 00:37]
20     UKI-QMUL-PROD   StoRM                          [in 00:36]
20     UNI-BONN        xrootd-R/CephFS                [in 00:31]
14     PURDUE2         xrootd-R/HDFS                  [in 01:30]
13     SLAC            xrootd-D/xrootd                [in 01:02]
10     SLAC2           xrootd-R/xrootd                [in 01:21]
7      UCSD            xrootd-R/HDFS                  [in 01:39]
1      CERN            EOS                            [in 00:31]
 

15:30 → 16:00 Round table (Max 2 min per person)

-> 1-2 Objectives for the week - short description
-> Anything blocking?
-> 1- 2 Objectives accomplished