11th Quattor Workshop

Europe/London
cern (see detailed agenda) (CERN)

cern (see detailed agenda)

CERN

Michel Jouvin (LAL) , Veronique Lefebure (CERN)
Description
This workshop is the main meeting of the Quattor community. Its main goal is discussing main issues, roadmap and community organization. It brings together Quattor developers and users and is open to everybody interested by Quattor. The two first days are really intended for internal discussions when the third day is devoted to tutorials and hands-on sessions. Remote participation to the meeting will be available. Use the EVO Connection menu to join.
Participants
  • Alastair Bland
  • Antonio Perez Perez
  • Cal Loomis
  • Eric Fede
  • Fernando Lucas Rodriguez
  • Giacomo Tenaglia
  • Guillaume PHILIPPON
  • Ian Peter Collier
  • Ignas Butenas
  • Ivan Fedorko
  • James Adams
  • Jerome Pansanel
  • Jorge Amando Molina-Perez
  • Joris Maes
  • Kenneth Hoste
  • Loic Brarda
  • Luis Fernando Munoz Mejias
  • Michel Jouvin
  • Nick Williams
  • Shkelzen Rugovac
  • Stephane Francis A Gerard
  • Tomasz Wolak
  • Veronique Lefebure
  • Vitor Emanuel Gomes Gouveia
  • Wayne Salter
  • Weizhen Wang
  • Wouter Depypere
    • 9:30 AM 10:30 AM
      Introduction 40/R-B10

      40/R-B10

      CERN

      20
      Show room on map
      • 9:30 AM
        Welcome 20m
        Speaker: Veronique Lefebure (CERN)
      • 9:50 AM
        Quattor Update 25m
        Main actions and facts since the last workshop. Evolution of the community.
        Speaker: Michel Jouvin (LAL / IN2P3)
        Slides
      • 10:15 AM
        Discussion 15m
    • 10:30 AM 11:00 AM
      Coffee Break 30m 40/R-B10

      40/R-B10

      CERN

      20
      Show room on map
    • 11:00 AM 12:30 PM
      Core Tools 40/R-B10

      40/R-B10

      CERN

      20
      Show room on map
      • 11:00 AM
        Status of Quattor Configuration Modules 1h
        This presentation will give a report on components available (number, main purposes..), identify the critical ones and those that urgently need some refactoring/rewriting or maintenance.
        Slides
      • 12:00 PM
        Aquilon + QRD Status ? 30m
        Speaker: Nick Williams (Morgan Stanley)
    • 12:30 PM 2:00 PM
      Lunch 1h 30m restaurant 2

      restaurant 2

    • 2:00 PM 4:00 PM
      QWG Templates and monitoring 513/1-024

      513/1-024

      CERN

      50
      Show room on map
      • 2:00 PM
        QWG Update 20m
        Changes in QWG templates since last workshop and planned new features
        Speaker: Michel Jouvin (LAL / IN2P3)
        Slides
      • 2:20 PM
        Status of monitoring templates 15m
        Speaker: Ronald Starink (Unknown)
        Slides
      • 2:35 PM
        Lemon - The LHC Era Monitoring system at CERN 55m
        The LHC Era Monitoring (Lemon) system is addressing requirements for large scale infrastructure monitoring and is used in the CERN Computing Centre. Although Lemon is not directly integrated into Quattor, it is nonetheless a part of the Extremely Large Fabric management system (ELFms) tool suite and used by several Quattor community members. We would like to share our experience, present on-going development activities as well as options open for future CERN CC monitoring. Depending on the time available we may address questions from Lemon users in the Quattor community.
        Speaker: Ivan Fedorko (Conseil Europeen Recherche Nucl. (CERN))
        Slides
      • 3:30 PM
        Discussion on Pan annotations 30m
        Goal : agreement on how to use Pan annotations, which tags to use, which tools to compile and present them.
    • 4:00 PM 4:30 PM
      Coffee Break 30m 513-1-024

      513-1-024

    • 4:30 PM 5:30 PM
      Site Experiences 513/1-024

      513/1-024

      CERN

      50
      Show room on map
      • 4:30 PM
        Quattor in CMS (a CMS for CMS). 30m
        The CMS online cluster consists of more than 2500 computers, mostly under Scientific Linux CERN, running the 10000 applications instances responsible for the data acquisition and experiment control on a 24/7 basis. The evolving nature of the acquisition applications requires an easy management and configuration infrastructure suitable for large scale installation and fast configuration turnaround. Quattor was chosen as the Configuration Management System for CMS. Online computers, under Quattor, can be fully reinstalled and configured from scratch in 6 to 25 minutes. Full reconfiguration of the cluster takes smaller times. More than 1000 computers can be reinstalled concurrently in less than 60 minutes and the infrastructure is easily scalable to reduce the installation time and accommodate for more computers at the same time. Several tools have been created to leverage the knowledge of Quattor for daily tasks and to allow it to be used by for non privileged users. In this presentation we will revise the details of the CMS Quattor infrastructure, its performance and the tools created to ease administration and overcome the shortcomings of Quattor.
        Speaker: Dr Jose Antonio Coarasa Perez (CERN)
        Slides
    • 9:00 AM 10:00 AM
      Development Tools and Process 513/1-024

      513/1-024

      CERN

      50
      Show room on map
      • 9:00 AM
        End of current sprint 1h
        Speaker: Michel Jouvin (LAL / IN2P3)
    • 10:00 AM 10:30 AM
      Core Tools 513/1-024

      513/1-024

      CERN

      50
      Show room on map
      • 10:00 AM
        Pan Compiler Status 30m
        Status and roadmap for the pan compiler.
        Speaker: Cal Loomis (CNRS/LAL)
        Slides
    • 10:30 AM 11:00 AM
      Coffee Break 30m
    • 11:00 AM 12:30 PM
      Security Management 513/1-024

      513/1-024

      CERN

      50
      Show room on map
      • 11:00 AM
        SINDES development 1h
        SINDES, Secure INformation DElivery System, is a tool that can be used together with Quattor to ensure enough level of privacy in storing and delivering confidential files. Written in 2005, SINDES is now being reviewed in view of enhancing and/or rewriting it. We propose to describe short-term enhancements to the current system (access control, improved logging, clearing old certificates, publishing the CRL) with some functional details and explanation about how it changes the application. Apart from that, the requirements collected from the CERN users of SINDES will be presented (file modifications, history, machine upload, unattended installations, support for different OS) . Each request for enhancement will be followed by a possible list of solutions and will be discussed whether it is possible to implement in current SINDES. At the end, the proposal of the architecture of the new SINDES will be shown. Moreover, some implementation details will be proposed and prototype system will be presented. The presentation will be followed by a discussion/brainstorming session with the whole Quattor Community.
        Speaker: Jan Dudziec (CERN)
      • 12:00 PM
        Quattor and CERN security 30m
        In this talk, we'll provide a small overview of how CERN deals and prevents with security vulnerabilities, and how Quattor is used in plenty of them.
        Speaker: Mr Luis Fernando Munoz Mejias (CERN)
        Slides
    • 12:30 PM 2:00 PM
      Lunch 1h 30m restaurant 2

      restaurant 2

    • 2:00 PM 3:30 PM
      Development Tools and Process 513/1-024

      513/1-024

      CERN

      50
      Show room on map
      • 2:00 PM
        Maven-based build tools 30m
        Current status of the maven-based build tools for Quattor.
        Speaker: Cal Loomis (CNRS/LAL)
        Slides
      • 2:30 PM
        Discussion on development process 1h
        Discussion on community organization (eg. monthly meeting) and scrum development process started after last workshop (sprint interval, standup interval)...
        Speaker: Michel Jouvin (LAL / IN2P3)
        Slides
    • 3:30 PM 4:00 PM
      Coffee Break 30m 513-1-024

      513-1-024

    • 4:00 PM 5:30 PM
      RHEL6 Discussion 513/1-024

      513/1-024

      CERN

      50
      Show room on map
      • 4:00 PM
        CERN experience and problems with RHEL6 15m
      • 4:15 PM
        AUTH experience and success with FC 14 15m
      • 4:30 PM
        Discussion 1h
        Major issues, workplan, specific needs for RHEL6, impact on component development
    • 8:00 PM 11:00 PM
      Dinner Ferney-Voltaire

      Ferney-Voltaire

      CERN

      Looking at https://www.hotelfranceferney.fr/5.html
      Waiting for a proposal from the restaurant.

    • 9:00 AM 12:30 PM
      Tutorials and Hands-on 222-R-001

      222-R-001

      CERN

      • 9:00 AM
        StratusLab Cloud Tutorial 1h
        Tutorial showing the StratusLab cloud developments as well as interactions with the Quattor toolkit.
        Speaker: Cal Loomis (CNRS/LAL)
        Slides
      • 10:00 AM
        Preparing glite updates in QWG 45m
        Discussion/Tutorial on what is required to prepare templates for new gLite updates in QWG to allow more sites to contribute to teh effort.
        Speaker: Michel Jouvin (LAL / IN2P3)
      • 10:45 AM
        Coffee Break 30m
      • 11:15 AM
        Tutorial: PAN language 1h
        I think that a tutorial on the PAN language would be useful (we could record it for later usage for new comers). With main features and best practices and how to improve compilation performance. Could Cal provide it ?
        Speaker: Cal Loomis (CNRS/LAL)
        Paper
        Slides
    • 12:30 PM 2:00 PM
      Lunch 1h 30m Restaurant 1

      Restaurant 1

      CERN

    • 2:00 PM 4:00 PM
      Tutorials and Hands-on 222-R-001

      222-R-001

      CERN

      • 2:00 PM
        tutorial: NCM-components 45m
        I would propose to have another tutorial that presents all existing CORE components, what they do and examples of how to use them. Also some guide lines about how to write new components ?
        Speakers: Luis Fernando Munoz Mejias (Facultad de Ciencias - Universidad Autonoma de Madrid) , Michel Jouvin (LAL / IN2P3)
      • 2:45 PM
        example of quattor settings such that the authorized_keys for root/users account stay and don't get removed (nor changed) after re-configuring ncm component 30m
        example of quattor settings such that the authorized_keys for root/users account stay and don't get removed (nor changed) after re-configuring ncm component.
        Speaker: Luis Fernando Munoz Mejias (Facultad de Ciencias - Universidad Autonoma de Madrid)
      • 3:15 PM
        example of quattor settings for RAID disk configurations (e.g. RAID 1, 6,10, 6E...) 45m
        example of quattor settings for RAID disk configurations (e.g. RAID 1, 6,10,6E...)
        Speaker: Michel Jouvin (LAL / IN2P3)
    • 4:00 PM 5:00 PM
      Development Tools and Process 222-R-001

      222-R-001

      CERN

      • 4:00 PM
        Continuous integration server 30m
        Demo + discussion
      • 4:30 PM
        Pan annotation 30m
        Follow-up of Thursday morning discussion (https://trac.lal.in2p3.fr/Quattor/ticket/238)