SC23 was a success - thanks everyone for your help !
- Packet marking @300Gbps (see screenshots attached)
- Tested integration with ESnet high-touch service, dataset to be published later this week (screenshots of Scitags dashboard attached )
- InMon: SFlow-RT worked fine and we have also developed a new dashboard showing flow labeling
- New dashboard showing summary from the fireflies data from production storage (UNL):
. - SC23 instance is at (but might no longer be accessible): https://itcs-p4srv-01.cern.ch/d/b8dddac0-5b24-4739-9c8d-e88a05c1344f/scientific-network-tags-rande-dashboard?orgId=1
- To be moved to ESnet Grafana instance
Developments:
- flowd - developed support for packet marking on multiple NICs (tested succesfully @ SC23)
- plan to create separate packages for flow labeling and packet marking (flowd and flowd-ebpf) - different deps + EPEL requirements
- following SC23 tests will re-work the way fireflies are processed and how additional data is added
- xrootd http-tpc support was released
- fts, rucio and gfal2 are ready - waiting for deployment (hopefully before DC24)
Packet pacing meeting an hour ago (https://indico.cern.ch/event/1347655/)
- Testbed Google sheet ready - please request access and add nodes that will participate
- Testbed commisioning will start soon
- Idea is to come up with list of changes to be done following an initial check of the testbed
- e.g. check if BBR can be enabled, check if perfSONAR commands work (with related changes)
- Develop a script that can check config (and sysctl parameters) that anyone can run before/after submitting tests (TBD)
- Test coordination - looking for test coordinator for each (or multiple) week(s) - first come first served !
- ESnet high-touch testing - would likely require a CSV file to be sent in advance with start/end, src/dst (maybe ports ?) and traceroute in order to be able to start data collection
- High-touch produces pcap files that would need to be analysed further (we're looking for volunteers; python's pandas/polars + jupyterhub; data will be in apache arrow / feather format)
