CERN - Swisscom Meetup

Friday 15 Mar 2024, 09:00 → 18:00 Europe/Zurich

513/1-024 (CERN)

Enrico Bocchi (CERN)

Technical exchange on distributed systems for storage, analysis, and workload orchestration, with special focus on selected technologies including Ceph, Hadoop, and Kubernetes.

The meeting fosters open discussions and technical exchange on operational experiences, deployments, applications, use-cases, success stories and disappontments.

09:00 → 09:15 Welcome

Speaker: Enrico Bocchi (CERN)

09:15 → 10:30 Ceph

09:15 Ceph

• Hardware:
  -- Ceph hardware, requirements, trends
  -- Colocation with other service (hyperconverged)
  -- Storage media: HDD vs Flash
  -- Ceph IO patterns on disk
  -- Drop in storage performance for half-dead HDDs
• Operations:
  -- Repairs, hardware interventions
  -- Monitoring
  -- Upgrade -- How, to which version, validation, testing
  -- Massive capacity expansion, replacement
• Business Continuity || Disaster Recovery
• Ceph community:
  -- Resources
  -- Self-Support

Ceph Overview, Swisscom.pdf

Welcome.pdf

10:30 → 11:45 Kubernetes

10:30 Kubernetes

• Kubernetes Ops
  -- Upgrades, Roll-outs
  -- Tooling and relevant CNCF projects to help
• AI/ML workloads
• Interaction with Storage and Network

11:45 → 12:50 Visit to The Low Energy Ion Ring (LEIR)

The Low Energy Ion Ring (LEIR) receives long pulses of lead ions from Linear accelerator 3 (Linac 3) and transforms them into the short, dense bunches suitable for injection to the Large Hadron Collider (LHC).

The Low Energy Ion Ring website

Speaker: Giuseppe Lo Presti (CERN)

12:50 → 13:30 Lunch Break

13:30 → 15:00 HDFS

13:30 Hadoop

• Hadoop:
  -- Experience on the technology
  -- Phase out / replacement plans
• Yarn
• HDFS replacement to Object Storage:
  -- HDFS copy to S3 tool and user guide
  -- Yunikorn replacing Yarn
  -- Trino replacing Hive (initial requirement and design)

13:30 → 15:00 Load Balancing || Caching

13:30 Load Balancing + Caching

• Load balancing techniques:
  -- Round Robin DNS
  -- BGP (aka multi-tier LB)
  -- Openstack Octavia (was Tungsten)
• Caching:
  -- NGINX caching and http_auth_request_module (rgw-cache)
  -- RGW onboard cache (d3n_datacache/)

15:00 → 15:15 Closing Remarks

Speaker: Enrico Bocchi (CERN)

15:15 → 17:30 Discussion overflow (optional)