Speaker
Nicola Pace
Description
The FTS4 Scheduler combines fair resource allocation with database optimizations aimed at improving scalability, throughput, and reliability. The work includes optimizing database triggers and bulk updates, denormalizing frequently accessed counters, and addressing complex deadlock scenarios, including a subtle issue involving unique constraints and transaction isolation. On top of the scheduler, the new FlowController replaces the legacy FTS Optimizer with an extremum-seeking control strategy based on a feedback loop. It continuously adapts transfer concurrency based on observed endpoint behaviour, allowing FTS to improve resource utilization while reacting to overload and protecting storage endpoints.
Author
Co-author
Steven Murray
(CERN)