eulake technical coordination

Europe/Zurich

eulake 2nd technical coordination meeting 13 March 2018

Present: Brian (RAL), Crystal (Aarnet), Guido (Aarnet), Antonio (CNAF), Maria (CERN), Simone (CERN), Xavi (CERN)

News and announcements: eulake overall status (Xavi)

- 4 sites configured: Sara, Dubna, CERN-Wigner and CERN-Meyrin

- Very primary put/get tests with two file layouts:

  • "scattered" replicas: 4 (full file) replicas to the four configured sites
  • "striping" files across sites: 5 distributed chunks (3+2) over the 4 sites (5 different diskervers)

- Investigating file auto-conversion

  • File layout automatic transition based on a defined time, ie: sys.lru.convert.match="*:1h"
    • From 2 replicas to 1, or from 2 replicas to 4+2, etc. (allowing file workflows)

Tour de table

- Antonio (CNAF):

  • Agreed to deploy an endpoint of 10TB running an EOS storage daemon. ETA ~ April.

- Brian (RAL):

  • The routing issue with openstack has been solved
  • Reverse hostname resolution issues has been solved
  • The blocking bit is the mysterious blocking at central firewall level of the port 1095. Whereas 1094 looks ok 1097 is not reachable. Xavi suggested to involve CERN network experts to debug this.

- Guido (Aarnet):

  • Discussion about having an inter-continental site in the mini-prototype: The interest of having a (very) remote site in the eulake prototype is of common interest. Also the fact that datalakes R+D is of common interest of WLCG an SKA makes the contribution of Aarnet extremely interesting.
  • Guido offered to provide high-latency (tape) endpoints for testing, this will be very welcome.

- Wybrand/Ron (SARA)

  • The three nodes running EOS storage daemons (fst) are up and running after repeat the registration process in two of them that had some issues.
  • Deployment of a dCache endpoint via NFS mount in the pipeline. This has been observed of major interest in view of the upcoming meetings where the interaction between EOS and dCache will be discussed.   
There are minutes attached to this event. Show them.
    • 16:00 16:05
      News and Announcements 5m
      Speaker: Xavier Espinal Curull (CERN)

      - 4 sites configured: Sara, Dubna, CERN-Wigner and CERN-Meyrin

      - Very primary put/get tests with two file layouts:

      • "scattered" replicas: 4 (full file) replicas to the four configured sites
      • "striping" files across sites: 5 distributed chunks (3+2) over the 4 sites (5 different diskervers)

      - Investigating file auto-conversion

      • File layout automatic transition based on a defined time, ie: sys.lru.convert.match="*:1h"
        • From 2 replicas to 1, or from 2 replicas to 4+2, etc. (allowing file workflows)
    • 16:05 16:25
      Round table 20m
      Speaker: All
    • 16:25 16:30
      AOBs and wrap-up 5m

      Next meetings:

      • 24th April: confirmed