19–25 Oct 2024
Europe/Zurich timezone

Scitags: A Standardized Framework for Traffic Identification and Network Visibility in Data-Intensive Research Infrastructures

21 Oct 2024, 17:09
18m
Room 1.B (Medium Hall B)

Room 1.B (Medium Hall B)

Talk Track 1 - Data and Metadata Organization, Management and Access Parallel (Track 1)

Speakers

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US)) Marian Babik (CERN) Tristan Sullivan (University of Victoria)

Description

High-Energy Physics (HEP) experiments rely on complex, global networks to interconnect collaborating sites, data centers, and scientific instruments. Managing these networks for data-intensive scientific projects presents significant challenges because of the ever-increasing volume of data transferred, diverse project requirements with varying quality of service needs, multi-domain infrastructure, WAN distances, and limited visibility into network traffic flows. This lack of visibility hinders network operators' ability to understand actual user behavior across different network segments, optimize performance, undertake effective traffic engineering and shaping, and effectively debug and troubleshoot issues.

This project addresses these challenges by focusing on improving network visibility through standardized packet marking and flow labeling techniques. We present the Scitags initiative, a collaborative effort formed within the Research Networking Technical Working Group (RNTWG) in 2020. Scitags aims to develop a generic framework and standards for identifying the owner and associated scientific activity of network traffic. This framework extends beyond HEP/WLCG experiments, and it has a potential to benefit all global communities using Research and Education (R&E) networks.

The presentation will detail the current state of the Scitags initiative, including the evolving framework, the underlying technologies being explored (e.g., eBPF, IPv6, HbH, etc.), and the roadmap for production deployment within R&E networks. By enabling improved network visibility, Scitags will empower network operators to optimize performance, troubleshoot issues more effectively, and ultimately support the growing needs of data-intensive scientific collaborations.

Primary authors

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US)) Dale Carder Garhan Attebury (University of Nebraska-Lincoln) Marian Babik (CERN) Shawn Mc Kee (University of Michigan (US)) Tim Chown Tristan Sullivan (University of Victoria)

Co-authors

Andrew Lake Bruno Heinrich Hoeft (KIT - Karlsruhe Institute of Technology (DE)) James Letts (Univ. of California San Diego (US)) Joe Mambretti (International Center for Advanced Internet Research Northwestern University) Karl Newell Michael Lambert (Pittsburgh Supercomputing Center)

Presentation materials