- Packet marking @300Gbps (see screenshots attached) - Tested integration with ESnet high-touch service, dataset to be published later this week - InMon: SFlow-RT readout of the packet marking from network equipment worked fine (screenshot attached)
- New fireflies dashboard showing data from a production storage (at UNL): . - https://public.stardust.es.net/d/b8dddac0-5b24-4739-9c8d-e88a05c1344f/scientific-network-tags3a-rande-dashboard?orgId=1&from=now-12h&to=now - There is additional data available that is not yet shown both from fireflies as well as from Esnet, e.g. duration of the flows, transfer rates, etc.
- flowd - developed support for packet marking on multiple NICs (tested succesfully @ SC23) - plan to create separate packages for flow labeling and packet marking (flowd and flowd-ebpf) - different deps + EPEL requirements - following SC23 tests we will also refactor the way fireflies are processed and how additional data is added - xrootd http-tpc support was released - FTS, Rucio and gfal2 - waiting for deployment
dCache AGLT2 tests with fireflies - discovered problems also in latest 9.2.5
we hope that this could be fixed in next release (december?)
enabling fireflies is simple - just flip one boolean value
XRootD & support for flowd activity
available since XRootD 5.6.3
already available in EPEL
work in progress with OSG packages
this functionality is already included in EOS that is now being deployed at CERN
Rucio needs to be updated to pass activity for SciTags to FTS-1829
Discuss with experts improvements in the error messages produced by failed transfers.
Stephan Lammel(Fermi National Accelerator Lab. (US))
Gfal upload / download disknode hostname (DMC-1390, rucio#5980), ATLAS would like to have these details in Rucio traces / Monit data. For HTTP-TPC we might get this info from performance markers in the future, but we would like to have this information available also for simple upload/download.
development that's not directly related to DC24 will happen only after this event.
it seems it should not be difficult to provide this functionality (but first FTS developers needs to think what would be the best way to provide real souce/destination hosts)