11th Quattor Workshop

16 Mar 2011, 08:00 → 18 Mar 2011, 18:00 Europe/London

cern (see detailed agenda) (CERN)

Michel Jouvin (LAL), Veronique Lefebure (CERN)

This workshop is the main meeting of the Quattor community. Its main goal is discussing main issues, roadmap and community organization. It brings together Quattor developers and users and is open to everybody interested by Quattor. The two first days are really intended for internal discussions when the third day is devoted to tutorials and hands-on sessions. Remote participation to the meeting will be available. Use the EVO Connection menu to join.

Wednesday 16 March

09:30 → 10:30 Introduction

09:30 Welcome

Speaker: Veronique Lefebure (CERN)

09:50 Quattor Update

Main actions and facts since the last workshop. Evolution of the community.

Speaker: Michel Jouvin (LAL / IN2P3)

Slides Quattor_Status_Report.pdf

10:15 Discussion

10:30 → 11:00 Coffee Break

11:00 → 12:30 Core Tools

11:00 Status of Quattor Configuration Modules

This presentation will give a report on components available (number, main purposes..), identify the critical ones and those that urgently need some refactoring/rewriting or maintenance.

Slides status.pdf

12:00 Aquilon + QRD Status ?

Speaker: Nick Williams (Morgan Stanley)

12:30 → 14:00 Lunch

14:00 → 16:00 QWG Templates and monitoring

14:00 QWG Update

Changes in QWG templates since last workshop and planned new features

Speaker: Michel Jouvin (LAL / IN2P3)

Slides QWG2.pdf

14:20 Status of monitoring templates

Speaker: Ronald Starink (Unknown)

Slides nagios_templates_(2).pdf

14:35 Lemon - The LHC Era Monitoring system at CERN

The LHC Era Monitoring (Lemon) system is addressing requirements for large scale infrastructure monitoring and is used in the CERN Computing Centre. Although Lemon is not directly integrated into Quattor, it is nonetheless a part of the Extremely Large Fabric management system (ELFms) tool suite and used by several Quattor community members. We would like to share our experience, present on-going development activities as well as options open for future CERN CC monitoring. Depending on the time available we may address questions from Lemon users in the Quattor community.

Speaker: Ivan Fedorko (Conseil Europeen Recherche Nucl. (CERN))

Slides Lemon_for_Quattor_5.pdf Lemon_for_Quattor_5.pptx

15:30 Discussion on Pan annotations

Goal : agreement on how to use Pan annotations, which tags to use, which tools to compile and present them.

16:00 → 16:30 Coffee Break

16:30 → 17:30 Site Experiences

16:30 Quattor in CMS (a CMS for CMS).

The CMS online cluster consists of more than 2500 computers, mostly under Scientific Linux CERN, running the 10000 applications instances responsible for the data acquisition and experiment control on a 24/7 basis. The evolving nature of the acquisition applications requires an easy management and configuration infrastructure suitable for large scale installation and fast configuration turnaround. Quattor was chosen as the Configuration Management System for CMS. Online computers, under Quattor, can be fully reinstalled and configured from scratch in 6 to 25 minutes. Full reconfiguration of the cluster takes smaller times. More than 1000 computers can be reinstalled concurrently in less than 60 minutes and the infrastructure is easily scalable to reduce the installation time and accommodate for more computers at the same time. Several tools have been created to leverage the knowledge of Quattor for daily tasks and to allow it to be used by for non privileged users. In this presentation we will revise the details of the CMS Quattor infrastructure, its performance and the tools created to ease administration and overcome the shortcomings of Quattor.

Speaker: Dr Jose Antonio Coarasa Perez (CERN)

Slides QuattorInCMS-JACoarasa-reduced.pdf QuattorInCMS-JACoarasa-reduced.ppt

Thursday 17 March

09:00 → 10:00 Development Tools and Process

09:00 End of current sprint

Speaker: Michel Jouvin (LAL / IN2P3)

10:00 → 10:30 Core Tools

10:00 Pan Compiler Status

Status and roadmap for the pan compiler.

Speaker: Cal Loomis (CNRS/LAL)

Slides 20110317-panc-v1.pdf 20110317-panc-v1.ppt

10:30 → 11:00 Coffee Break

11:00 → 12:30 Security Management

11:00 SINDES development

SINDES, Secure INformation DElivery System, is a tool that can be used together with Quattor to ensure enough level of privacy in storing and delivering confidential files. Written in 2005, SINDES is now being reviewed in view of enhancing and/or rewriting it. We propose to describe short-term enhancements to the current system (access control, improved logging, clearing old certificates, publishing the CRL) with some functional details and explanation about how it changes the application. Apart from that, the requirements collected from the CERN users of SINDES will be presented (file modifications, history, machine upload, unattended installations, support for different OS) . Each request for enhancement will be followed by a possible list of solutions and will be discussed whether it is possible to implement in current SINDES. At the end, the proposal of the architecture of the new SINDES will be shown. Moreover, some implementation details will be proposed and prototype system will be presented. The presentation will be followed by a discussion/brainstorming session with the whole Quattor Community.

Speaker: Jan Dudziec (CERN)

Slides

• sindes_for_qw11(2).pdf
• sindes_for_qw11_2.png
• sindes_for_qw11.png

12:00 Quattor and CERN security

In this talk, we'll provide a small overview of how CERN deals and prevents with security vulnerabilities, and how Quattor is used in plenty of them.

Speaker: Mr Luis Fernando Munoz Mejias (CERN)

Slides security.pdf

12:30 → 14:00 Lunch

14:00 → 15:30 Development Tools and Process

14:00 Maven-based build tools

Current status of the maven-based build tools for Quattor.

Speaker: Cal Loomis (CNRS/LAL)

Slides 20110317-maven-build-tools-v1.pdf 20110317-maven-build-tools-v1.ppt

14:30 Discussion on development process

Discussion on community organization (eg. monthly meeting) and scrum development process started after last workshop (sprint interval, standup interval)...

Speaker: Michel Jouvin (LAL / IN2P3)

Slides Scrum_report.pdf

15:30 → 16:00 Coffee Break

16:00 → 17:30 RHEL6 Discussion

16:00 CERN experience and problems with RHEL6

16:15 AUTH experience and success with FC 14

16:30 Discussion

Major issues, workplan, specific needs for RHEL6, impact on component development

20:00 → 23:00 Dinner

Looking at https://www.hotelfranceferney.fr/5.html
Waiting for a proposal from the restaurant.

Friday 18 March

09:00 → 12:30 Tutorials and Hands-on

09:00 StratusLab Cloud Tutorial

Tutorial showing the StratusLab cloud developments as well as interactions with the Quattor toolkit.

Speaker: Cal Loomis (CNRS/LAL)

Slides http://stratuslab.eu/doku.php/release:download http://stratuslab.eu/doku.php/tutorial:machinelifecycle

10:00 Preparing glite updates in QWG

Discussion/Tutorial on what is required to prepare templates for new gLite updates in QWG to allow more sites to contribute to teh effort.

Speaker: Michel Jouvin (LAL / IN2P3)

10:45 Coffee Break

11:15 Tutorial: PAN language

I think that a tutorial on the PAN language would be useful (we could record it for later usage for new comers). With main features and best practices and how to improve compilation performance. Could Cal provide it ?

Speaker: Cal Loomis (CNRS/LAL)

Paper pan-demo.tar.gz

Slides 20110318-pan-tutorial.pdf 20110318-pan-tutorial.ppt

12:30 → 14:00 Lunch

14:00 → 16:00 Tutorials and Hands-on

14:00 tutorial: NCM-components

I would propose to have another tutorial that presents all existing CORE components, what they do and examples of how to use them. Also some guide lines about how to write new components ?

Speakers: Luis Fernando Munoz Mejias (Facultad de Ciencias - Universidad Autonoma de Madrid), Michel Jouvin (LAL / IN2P3)

14:45 example of quattor settings such that the authorized_keys for root/users account stay and don't get removed (nor changed) after re-configuring ncm component

example of quattor settings such that the authorized_keys for root/users account stay and don't get removed (nor changed) after re-configuring ncm component.

Speaker: Luis Fernando Munoz Mejias (Facultad de Ciencias - Universidad Autonoma de Madrid)

15:15 example of quattor settings for RAID disk configurations (e.g. RAID 1, 6,10, 6E...)

example of quattor settings for RAID disk configurations (e.g. RAID 1, 6,10,6E...)

Speaker: Michel Jouvin (LAL / IN2P3)

16:00 → 17:00 Development Tools and Process

16:00 Continuous integration server

Demo + discussion

16:30 Pan annotation

Follow-up of Thursday morning discussion (https://trac.lal.in2p3.fr/Quattor/ticket/238)