Login

HTCondor Workshop Autumn 2023

18–22 Sept 2023
IJCLab
Europe/Paris timezone

Support

Contribution List

45 out of 45 displayed
Export to PDF
  1. 26. Welcome
    Christoph Beyer
    19/09/2023, 09:00
    Miscellaneous
  2. 27. Welcome and housekeeping
    Michel Jouvin (Université Paris-Saclay (FR))
    19/09/2023, 09:05
    Miscellaneous
  3. 43. IJCLab in a nutshell
    Valerie CHAMBERT, Valerie Chambert (Universite de Paris-Sud 11 (FR))
    19/09/2023, 09:15
  4. 11. HTCSS Vocabulary, Architecture, and User View
    Todd Tannenbaum (University of Wisconsin Madison (US))
    19/09/2023, 09:30
    Miscellaneous
    Workshop Session
  5. 40. Data and Security intro
    MIRON LIVNY
    19/09/2023, 11:00
  6. 14. Pelican: Data Federations and HTCSS
    Brian Paul Bockelman (University of Wisconsin Madison (US))
    19/09/2023, 11:10
    The Data Story
    Data and Security
  7. 12. IGWN Data Story
    Peter Couvares, Mr Peter Couvares (California Institute of Technology)
    19/09/2023, 11:35
    The Data Story
    Data and Security
  8. 24. Token Taxonomy
    Brian Paul Bockelman (University of Wisconsin Madison (US))
    19/09/2023, 12:10
    Security and Tokens
    Data and Security

    mixing them up… IDTOKENS for daemons, others for jobs, issued from OAuth vs Vault vs self signed vs ...

    Go to contribution page
  9. 25. (Sci)Tokens authentication in HTCondor-CE (incl new features)
    James Frey (University of Wisconsin Madison (US))
    19/09/2023, 14:00
    Security and Tokens
    Data and Security
  10. 13. Getting Your Data with HTCondor
    Brian Paul Bockelman (University of Wisconsin Madison (US))
    19/09/2023, 14:35
    The Data Story
    Data and Security
  11. 34. Data and Security Wrap Up
    MIRON LIVNY
    19/09/2023, 15:10
  12. 37. Welcome drink
    19/09/2023, 18:30

    La Part des Anges is an excellent and friendly Wine Bar.

    Tapas/apetizers offered, drinks at your charge
    Possibility to have a diner afterward on an individual basis

    https://osm.org/go/0BOQg93_M?node=6574870872

    Go to contribution page
  13. 41. Jobs and Access Points Introduction
    MIRON LIVNY
    20/09/2023, 09:00
  14. 33. Talk of all the Tools
    Gregory Thain
    20/09/2023, 09:10
    HTCondor presentations and tutorials
    Jobs and Access Points
  15. 45. Visit of ThomX and SUPRATECH facilities
    20/09/2023, 10:00

    2 groups of 15

    Go to contribution page
  16. 16. Linux tuning for large scale APs
    Gregory Thain
    20/09/2023, 11:00
    The Access Point Story
    Jobs and Access Points
  17. 18. What Are My Jobs Doing?
    James Frey (University of Wisconsin Madison (US))
    20/09/2023, 11:35
    The Access Point Story
    Jobs and Access Points
  18. 15. Whirlwind Tour: Job Placement Options
    Gregory Thain
    20/09/2023, 12:05
    The Access Point Story
    Jobs and Access Points
  19. 17. HTCondor Services for Non-Humans
    James Frey (University of Wisconsin Madison (US))
    20/09/2023, 14:00
    The Access Point Story
    Jobs and Access Points
  20. 36. Jobs and Access Points Wrap Up
    MIRON LIVNY
    20/09/2023, 14:25
  21. 1. News from the DESY Clusters
    Thomas Hartmann (Deutsches Elektronen-Synchrotron (DE))
    20/09/2023, 14:50
    HTCondor user presentations
    HTCondor User Presentations

    With the ever changing IT and political landscapes also the HTC clusters at DESY are evolving with these changes. We will give an overview and status, what over the past year is new and where we plan to go with our compute clusters. Efficient utilization of resources has become even more pressing following recent geopolitical turmoil and with climate change becoming even more pressing, for...

    Go to contribution page
  22. 32. Deployment of HTCondor at GRIF
    Dr Emmanouil Vamvakopoulos (Université Paris-Saclay (FR))
    20/09/2023, 15:15
    HTCondor user presentations
    HTCondor User Presentations

    In this communication, we are going to present the multiple HTCondor instances that have been deployed at GRIF for several years. GRIF is a distributed Tier-2 WLCG/EGI site made of four (4) different subsites (IJCLab, IRFU, LLR, LPNHE), in different locations of the Paris region. The worst network latency between the subsites is within 2-4 msec with three (3) of them connected with a...

    Go to contribution page
  23. 8. CERN Update
    Ben Jones (CERN)
    20/09/2023, 16:10
    HTCondor user presentations
    HTCondor User Presentations
  24. 31. Office Hours
    20/09/2023, 16:40
  25. 10. What’s New, What’s Coming Up
    Todd Tannenbaum (University of Wisconsin Madison (US))
    21/09/2023, 09:00
    Miscellaneous
    Workshop Session
  26. 23. Energy Savings: Roosters and Condors, oh my!
    Todd Tannenbaum (University of Wisconsin Madison (US))
    21/09/2023, 09:45
    The Pool Story
    Workshop Session
  27. 44. Visit of ThomX and SUPRATECH facilities
    21/09/2023, 10:05

    By groups of 15

    Go to contribution page
  28. 5. Reaching new scales in the CMS Global pool
    Marco Mascheroni (Univ. of California San Diego (US))
    21/09/2023, 11:25
    HTCondor user presentations
    HTCondor User Presentations

    The computing resource needs of LHC experiments, such as CMS, are expected to continue growing significantly over the next decade, during the Run 3 and especially the HL-LHC era. The SI team manages a set of federated HTCondor pools, currently aggregating around 400k CPU cores distributed worldwide, supporting the simultaneous execution of over 200k CMS computing tasks. In order to detect and...

    Go to contribution page
  29. 2. The Virgo Data Quality Reports: an HTCondor automated framework to vet gravitational-wave candidates
    Dr Nicolas Arnaud (IJCLab (Université Paris-Saclay and CNRS/IN2P3))
    21/09/2023, 11:50
    HTCondor user presentations
    HTCondor User Presentations

    Transient gravitational-wave (GW) signals have been discovered since 2015 by the LVK global network of giant, ground-based, interferometric detectors. It currently includes four instruments: the LIGO Hanford and LIGO Livingston detectors located in the USA, the Virgo detector in Italy – hosted by the European Gravitational Observatory (EGO) –, and the KAGRA detector in Japan. A key component...

    Go to contribution page
  30. 7. Energy savings by power modulation of a HTC pool
    Christoph Beyer
    21/09/2023, 12:10
    HTCondor user presentations
    HTCondor User Presentations

    Energy prices are reaching an all time high in europe and we are speculating at the same time to get a more elaborated billing model that calculates a real time electricity price depending on the availability of electricity on the market. As the price is predictable roughly 30h in forehand it seems to be desirable to not only know more about the energy consumption of a condor pool but also to...

    Go to contribution page
  31. 6. Multi-tenancy HTCondor for the European Weather Cloud
    Francesco Murdaca (EUMETSAT)
    21/09/2023, 13:45
    HTCondor user presentations
    HTCondor User Presentations

    The European Weather Cloud (EWC) is the cloud-based collaboration platform for meteorological application development and operations in Europe and enables the digital transformation of the European Meteorological Infrastructure. Among the services to be provided to the meteorological community, batch processing has been requested for several type of analysis using satellite data. HTCondor has...

    Go to contribution page
  32. 4. Just-in-time matching of workflows for the DUNE experiment
    Andrew McNab (University of Manchester)
    21/09/2023, 14:10
    HTCondor user presentations
    HTCondor User Presentations

    The DUNE experiment is a large international particle physics
    project which is currently under construction at Fermilab in
    Illinois and SURF in South Dakota, with prototypes at CERN. The
    experiment relies on Fermilab’s investment in HTCondor and
    GlideInWMS, and on the LArSoft ecosystem of applications
    software. Initially data management was done with Fermilab’s SAM
    system but this is...

    Go to contribution page
  33. 3. The journey to modern storage.
    David Handelman
    21/09/2023, 14:35
    HTCondor user presentations
    HTCondor User Presentations

    About a year a go we had a project that needs 20PB of low performance storage 20GBs throughout. We ended up buying 40PB with 2.7TBs throughout.
    I would lime to share with you the journey from open source storage to commercial storage.

    Choosing the technology, creating network to support this throughout, benchamrking, understand the needs and at the end real world vs the benchmark.

    I...

    Go to contribution page
  34. 39. Thoughts on EDIA in dHTC Cyber-Infrastructure
    Matthew West
    21/09/2023, 15:00
    HTCondor user presentations
    Equality,Diversity, Inclusion & Accessibility

    Making space for new groups within our existing dHTC infrastructure community is essential for "democratizing computation." This talk calls on participants to reflect on why so many research computing conferences have such homogeneous attendees. Some are long-term structural issues beyond our scope, but this should not absolve us from taking proactive measures to rectify this problem where possible.

    Go to contribution page
  35. 46. Discussion on EDIA
    21/09/2023, 15:10
  36. 38. Social Diner
    21/09/2023, 19:15
  37. 42. Pools and Execution Points Intro
    MIRON LIVNY
    22/09/2023, 09:00
  38. 22. Collector Overviews
    James Frey (University of Wisconsin Madison (US))
    22/09/2023, 09:05
  39. 19. Microarchitecture
    Gregory Thain
    22/09/2023, 09:40
    The Execution Point Story
    Pools and Execution Points
  40. 21. What are glideins using my cluster for? Monitoring via the CE
    Todd Tannenbaum (University of Wisconsin Madison (US))
    22/09/2023, 10:15
  41. 20. Advanced debugging with eBPF and Linux perf tools
    Gregory Thain
    22/09/2023, 11:00
    The Execution Point Story
    Pools and Execution Points
  42. 35. Pools and Execution Points Wrap Up
    MIRON LIVNY
    22/09/2023, 11:50
  43. 28. Wrap Up and Goodbye
    Chris Brew (Science and Technology Facilities Council STFC (GB))
    22/09/2023, 12:10
    Miscellaneous
  44. 29. Lightning Talks
    Miscellaneous
    Lightning Talks
  45. 30. Show your Toolbox
    Miscellaneous
    Show your Toolbox