Login

Apache Airflow in Production: Orchestrating Data Harvesting Pipelines

→ Europe/Zurich
31/3-004 - IT Amphitheatre (CERN)

31/3-004 - IT Amphitheatre

CERN

105
Show room on map
Ignacio Reguero
Webcast
There is a live webcast for this event
Watch
Apache Airflow in Production: Orchestrating Data Harvesting
Zoom Meeting ID
66547005503
Host
Ignacio Reguero
Alternative host
Pascal Pignereau
Useful links
Join via phone
Zoom URL
    • 10:00 AM → 11:00 AM
      Apache Airflow in Production: Orchestrating Data Harvesting Pipelines 1h

      Apache Airflow (https://airflow.apache.org/) is a key tool we use to orchestrate our data harvesting processes and manage production workflows.
      This talk will show how Airflow helps us design, schedule, and monitor harvesting pipelines, with concrete examples from daily operations.
      We will also highlight the main pros and cons we have encountered, including operational and scaling considerations.
      The session is aimed at engineers and technical users interested in practical workflow orchestration.

      Speaker: Joao Ramiro
      Recording