Ceph/CVMFS/Filer Service Meeting

600/R-001 (CERN)



Show room on map
    • 1
      Speaker: Enrico Bocchi (CERN)
    • 2
      Ceph Upstream News

      Releases, Tickets, Testing, Board, ...

      Speaker: Dan van der Ster (CERN)
      • v14.2.4 is released, and it is quite stable but has one known MDS bug (https://tracker.ceph.com/issues/41935) caused by an incomplete backport. It's a good time to plan an upgrade for ceph/erin.
      • Recently the "mimic missing slow OSD ops" bug has been fixed (https://tracker.ceph.com/issues/40993)
        • Devs have noticed many more warnings in qa testing since this was merged -- maybe the fix is incomplete (or the fix has revealed other problems that had been masked by the bug).
    • 3
      Ceph Backends & Block Storage

      Cluster upgrades, capacity changes, rebalancing, ...
      News from OpenStack block storage.

      Speaker: Theofilos Mouratidis (National and Kapodistrian University of Athens (GR))


      • On ceph/beesly all balancing/disk replacement is paused due to filestore splitting: https://its.cern.ch/jira/projects/CEPH/issues/CEPH-750
        • Background: Filestore stores objects in XFS, and creates subdirs onces the number of objects in a directory reaches some threshold. This "splitting" adds some small latency whenever it is triggered, so in the past we have worked around this by raising the threshold. Now the threshold is so high, that when the split is triggered it causes a hang of 10s of seconds.
          • I have started a campaign to split the PGs into smaller directories -- this is done offline, while the OSD is stopped, to prevent any slow requests.
          • Should be done by end of this week, after which we can resume balancing/etc...
    • 4
      Ceph Disk Management

      OSD Replacements, Liaison with CF, Failure Predictions

      Speaker: Julien Collet (CERN)
    • 5

      Ops, Use-cases (backup, DB), ...

      Speakers: Julien Collet (CERN) , Roberto Valverde Cameselle (Universidad de Oviedo (ES))
    • 6

      Filer Migration, CephFS/Manila, HPC status and plans.

      Speakers: Dan van der Ster (CERN) , Pablo Llopis Sanmillan (CERN)
      • LSF Filers (itnfs22b, itnfs24b) have been decommissioned following a request from the LSF service.
    • 7
      Speakers: Jose Castro Leon (CERN) , Julien Collet (CERN) , Roberto Valverde Cameselle (Universidad de Oviedo (ES))
    • 8


      • Updated prometheus puppet module to match puppet forge version. 
    • 9