Ceph/CVMFS/Filer Service Meeting

600/R-001 (CERN)



Show room on map
    • 14:00 14:15
      CVMFS 15m
      Speaker: Enrico Bocchi (CERN)
      • CVMFS 2.7.1 is out
        • Stratum 1 and client fixes
        • Support for new MaxMind GeoIP map EULA
      • Ceph outage:
        • No publication possible for all repositories on cinder volumes
        • Client access not impacted
        • Nobody badly complained
      • atlas-nightlies.cern.ch on S3:
        • 3 release managers (2 are their build machines)
        • Happily publishing since last week
      • Replication of S3 repos to Stratum 1 for safety
        • Normally, proxy-pass to S3
        • In case of S3 issues, serve the latest replica from Stratum 1
      • Migration to CC7 + S3:
        • 4 repositories tomorrow (originally scheduled for last Thu)
        • Other 5 to go before end of June
        • 2nd batch of 21 repos by Nov 20 (SLC6 unsupported)
      • Unpacked.cern.ch moving to bigger RM + cvmfs-gateway
      • Frontier-squid for Stratum 1 fronts:
        • 3 new machines in the load-balancer (front0{1..3})
        • 3 old machines to be retired (front15, 16, 23)
        • Running latest/greatest squid with security patch
    • 14:15 14:30
      Ceph: Operations 15m
      • Notable Incidents or Requests 5m
      • Repair Service Liaison 5m
        Speaker: Julien Collet (CERN)


        • Following the beesly incident, repair team has been instructed to halt any intervention (disk replacements) on the cluster.
      • Backend Cluster Maintenance 5m
        Speaker: Theofilos Mouratidis (CERN)
    • 14:30 14:45
      Ceph: Projects, News, Other 15m
      • Backup 5m
        Speaker: Roberto Valverde Cameselle (CERN)
        • Data still to be added to the backup (upper bound)
          • Around ~400TB already in the backup but disabled.
          • Around ~283TB left to be migrated from old user.
          • Total: 783TB
        • New combined S3 backup dashboard [Grafana]
        • cephnethub migration.
          • Starting testing rclone for S3 backup migration. Synced my home folder (1.1M files, 40
            GB) to my home S3 server in around 27m.
      • HPC 5m
        Speaker: Dan van der Ster (CERN)
      • Kopano 5m
        Speaker: Dan van der Ster (CERN)

        Discussing possibility to change from CephFS to RBD for the attachment store. It would limit the impact of any filesystem issues.

      • Upstream News 5m
        Speaker: Dan van der Ster (CERN)
    • 14:45 14:55
      S3 10m
      Speakers: Julien Collet (CERN) , Roberto Valverde Cameselle (CERN)


      • ceph/nethub online:
        • mon/osd and rgw/osd hosts, rgw coming in today: s3-fr-prevessin-1.cern.ch
        • 6.7 PiB available
        • 975 OSDs online
    • 14:55 15:05
      Filer/CephFS 10m
      Speakers: Dan van der Ster (CERN) , Theofilos Mouratidis (CERN)
    • 15:05 15:10
      AOB 5m