11–13 Mar 2024
CERN
Europe/Zurich timezone

SCION based ScienceDMZ and fast file transfer for HPCCs

13 Mar 2024, 12:30
15m
503/1-001 - Council Chamber (CERN)

503/1-001 - Council Chamber

CERN

162
Show room on map
Lightning talk Technology & Research Technology Bricks: Testing and Resilience

Speaker

Francois Wirz (ETHZ)

Description

Today’s research often relies on a high volume of data. While
universities cannot always provide the computing resources
to process a given amount of data, a high-performance com-
puting cluster (HPCC) offers a cost-effective alternative for re -
searchers.
With a SCION-based Science DMZ, the HPCC and each univer-
sity operate as independent autonomous system (AS), manag-
ing their own cryptographic keys and enforcing their own net-
work rules. Each AS also has its own LightningFilter deployed.
High-volume data transfers between a university and the
HPCC are performed using dedicated, SCION-based systems,
such as Hercules, which route their traffic through Lightning-
Filter instead of the network’s general-purpose firewall.
With LightningFilter, the ASes can control the amount of traf-
fic received from the other ASes or from specific hosts.
For instance, the HPCC can enforce different rate limits for
each university while guaranteeing a certain throughput for
specific hosts. Such limits are important to protect the servic-
es offered from misbehaving hosts that consume more band-
width than agreed and thus partially or completely block oth-
er hosts from reaching the service.

We will present the latest developments on SCION based ScienceDMZ and showcase some early deployments and PoCs.

Primary author

Presentation materials