WLCG Throughput Call

Wednesday 31 May 2017, 10:00 → 11:00 America/Detroit

31/2-029 (CERN)

Next WLCG Throughput meeting. Topics for today include:

1. perfSONAR v4.0
   • Update progress and issues 
2. Network Measurement Platform status and updates
3. Update on Analytics
4. Round-table 
5. AOB and next meeting

Please use Vidyo to connect.

NA Throughput Meeting

=====================

 

31-May-2017

 

Attending:  Dave, Ilija, Shawn, Marian, Phillipe, Saul, Duncan, Garhan, Andy

 

https://indico.cern.ch/event/640627/

 

perfSONAR v4.0

  - Update progress and issues 

    Shawn reported on OSG networking upgrades and data loss

 

 

Network Measurement Platform status and updates

    Marian reported on ps_etf and meshconfig.grid.iu.edu.  Review of the services monitored (https://etf-ps.cern.ch/etf/check_mk). Also reported on new dashboards in monit-grafana.cern.ch at https://monit-grafana.cern.ch/dashboard/db/lhcopn?orgId=14 (requires CERN SSO login) and perfSONAR infrastructure dashboard in Kibana

 

Update on Analytics

    Ilija reported on work to find changes in packet-loss, throughput, etc.  See paper https://arxiv.org/pdf/1508.01280.pdf

    Trying this method on CERN-BNL link analysis.   Machine-learning also being tried on perfSONAR data to find anomalies in

    our data. (Someone working on Titan...need details)

 

Round-table 

    Saul mentioned that MGHPP is down for maintenance and this was an opportunity to go to 100G.  When site is back up it will be

    using 100G.  Shawn asked about using that path for LHCONE; Saul: yes, should be used.

 

    Andy: minor update to pScheduler in the next few days (intermittent lock-up fix).  IPv6 may be having some issues.

 

    Marian: Question about Docker support for the full toolkit?   Andy: being discussed if this will be done at next week's

    face-to-face in Ann Arbor.

 

    Lots of Q&A and account setup for meshconfig.

 

AOB and next meeting

 

    Demo of OpenvSwitch / OpenFlow  + OpenStack?

 

    Watch email for next meeting date.

 

 

Log from Vidyo:

 

Shawn Mc Kee: (5/31/2017 10:11:29 AM)

Kibana dashboard monitorng for perfSONAR: 

(dev) https://atlas-kibana-dev.mwt2.org/app/kibana

Ilija Vukotic: (10:13 AM)

http://atlas-kibana-dev.mwt2.org/app/kibana#/dashboard/bfd9ce90-4542-11e7-a5be-63230ea2b639?_g=(refreshInterval%3A(display%3AOff%2Cpause%3A!f%2Cvalue%3A0)%2Ctime%3A(from%3Anow-7d%2Cmode%3Aquick%2Cto%3Anow))

Shawn Mc Kee: (10:15 AM)

The meshconfig (now production) from OSG:

https://meshconfig.grid.iu.edu/

https://monit-grafana.cern.ch/dashboard/db/perfsonar?orgId=14

Ilija Vukotic: (10:40 AM)

https://arxiv.org/pdf/1508.01280.pdf

Shawn Mc Kee: (10:52 AM)

https://meshconfig.grid.iu.edu/

http://maddash.aglt2.org/maddash-webui/index.cgi?dashboard=USATLAS%20Mesh%20Config

https://psmad.grid.iu.edu/maddash-webui/index.cgi?dashboard=UK%20Mesh%20Config

Garhan Attebury: (11:11 AM)

https://perfsonar-itb.grid.iu.edu/WLCGperfSONAR/check_mk/index.py?start_url=view.py%3Fhost%3Dhcc-ps02.unl.edu%26selection%3Dac5883be-8dcc-4e6d-a513-71078d16fdb1%26service%3DperfSONAR%2520esmond%2520Freshness%2520Trace%2520Direct%26site%3DWLCGperfSONAR%26view_name%3Dservice

Marian Babik: (11:12 AM)

https://etf-ps.cern.ch/etf/check_mk/index.py?start_url=%2Fetf%2Fcheck_mk%2Fview.py%3Fview_name%3Dsearchhost%26host_regex%3Dunl.edu%26filled_in%3Dfilter%26hostnameoralias%3Dunl.edu