11th Quattor Workshop

16 Mar 2011, 08:00 → 18 Mar 2011, 18:00 Europe/London

cern (see detailed agenda) (CERN)

Michel Jouvin (LAL), Veronique Lefebure (CERN)

This workshop is the main meeting of the Quattor community. Its main goal is discussing main issues, roadmap and community organization. It brings together Quattor developers and users and is open to everybody interested by Quattor. The two first days are really intended for internal discussions when the third day is devoted to tutorials and hands-on sessions. Remote participation to the meeting will be available. Use the EVO Connection menu to join.

Wednesday, 16 March

Introduction

1 Welcome

Speaker: Veronique Lefebure (CERN)

2 Quattor Update

Main actions and facts since the last workshop. Evolution of the community.

Speaker: Michel Jouvin (LAL / IN2P3)

Slides Quattor_Status_Report.pdf

3 Discussion

10:30 Coffee Break

Core Tools

4 Status of Quattor Configuration Modules

This presentation will give a report on components available (number, main purposes..), identify the critical ones and those that urgently need some refactoring/rewriting or maintenance.

Slides status.pdf

5 Aquilon + QRD Status ?

Speaker: Nick Williams (Morgan Stanley)

12:30 Lunch

QWG Templates and monitoring

6 QWG Update

Changes in QWG templates since last workshop and planned new features

Speaker: Michel Jouvin (LAL / IN2P3)

Slides QWG2.pdf

7 Status of monitoring templates

Speaker: Ronald Starink (Unknown)

Slides nagios_templates_(2).pdf

8 Lemon - The LHC Era Monitoring system at CERN

The LHC Era Monitoring (Lemon) system is addressing requirements for large scale infrastructure monitoring and is used in the CERN Computing Centre. Although Lemon is not directly integrated into Quattor, it is nonetheless a part of the Extremely Large Fabric management system (ELFms) tool suite and used by several Quattor community members. We would like to share our experience, present on-going development activities as well as options open for future CERN CC monitoring. Depending on the time available we may address questions from Lemon users in the Quattor community.

Speaker: Ivan Fedorko (Conseil Europeen Recherche Nucl. (CERN))

Slides Lemon_for_Quattor_5.pdf Lemon_for_Quattor_5.pptx

9 Discussion on Pan annotations

Goal : agreement on how to use Pan annotations, which tags to use, which tools to compile and present them.

16:00 Coffee Break

Site Experiences

10 Quattor in CMS (a CMS for CMS).

The CMS online cluster consists of more than 2500 computers, mostly under Scientific Linux CERN, running the 10000 applications instances responsible for the data acquisition and experiment control on a 24/7 basis. The evolving nature of the acquisition applications requires an easy management and configuration infrastructure suitable for large scale installation and fast configuration turnaround. Quattor was chosen as the Configuration Management System for CMS. Online computers, under Quattor, can be fully reinstalled and configured from scratch in 6 to 25 minutes. Full reconfiguration of the cluster takes smaller times. More than 1000 computers can be reinstalled concurrently in less than 60 minutes and the infrastructure is easily scalable to reduce the installation time and accommodate for more computers at the same time. Several tools have been created to leverage the knowledge of Quattor for daily tasks and to allow it to be used by for non privileged users. In this presentation we will revise the details of the CMS Quattor infrastructure, its performance and the tools created to ease administration and overcome the shortcomings of Quattor.

Speaker: Dr Jose Antonio Coarasa Perez (CERN)

Slides QuattorInCMS-JACoarasa-reduced.pdf QuattorInCMS-JACoarasa-reduced.ppt

Thursday, 17 March

Development Tools and Process

11 End of current sprint

Speaker: Michel Jouvin (LAL / IN2P3)

Core Tools

12 Pan Compiler Status

Status and roadmap for the pan compiler.

Speaker: Cal Loomis (CNRS/LAL)

Slides 20110317-panc-v1.pdf 20110317-panc-v1.ppt

10:30 Coffee Break

Security Management

13 SINDES development

SINDES, Secure INformation DElivery System, is a tool that can be used together with Quattor to ensure enough level of privacy in storing and delivering confidential files. Written in 2005, SINDES is now being reviewed in view of enhancing and/or rewriting it. We propose to describe short-term enhancements to the current system (access control, improved logging, clearing old certificates, publishing the CRL) with some functional details and explanation about how it changes the application. Apart from that, the requirements collected from the CERN users of SINDES will be presented (file modifications, history, machine upload, unattended installations, support for different OS) . Each request for enhancement will be followed by a possible list of solutions and will be discussed whether it is possible to implement in current SINDES. At the end, the proposal of the architecture of the new SINDES will be shown. Moreover, some implementation details will be proposed and prototype system will be presented. The presentation will be followed by a discussion/brainstorming session with the whole Quattor Community.

Speaker: Jan Dudziec (CERN)

Slides

• sindes_for_qw11(2).pdf
• sindes_for_qw11_2.png
• sindes_for_qw11.png

14 Quattor and CERN security

In this talk, we'll provide a small overview of how CERN deals and prevents with security vulnerabilities, and how Quattor is used in plenty of them.

Speaker: Mr Luis Fernando Munoz Mejias (CERN)

Slides security.pdf

12:30 Lunch

Development Tools and Process

15 Maven-based build tools

Current status of the maven-based build tools for Quattor.

Speaker: Cal Loomis (CNRS/LAL)

Slides 20110317-maven-build-tools-v1.pdf 20110317-maven-build-tools-v1.ppt

16 Discussion on development process

Discussion on community organization (eg. monthly meeting) and scrum development process started after last workshop (sprint interval, standup interval)...

Speaker: Michel Jouvin (LAL / IN2P3)

Slides Scrum_report.pdf

15:30 Coffee Break

RHEL6 Discussion

17 CERN experience and problems with RHEL6

18 AUTH experience and success with FC 14

19 Discussion

Major issues, workplan, specific needs for RHEL6, impact on component development

Dinner

Looking at https://www.hotelfranceferney.fr/5.html
Waiting for a proposal from the restaurant.

Friday, 18 March

Tutorials and Hands-on

20 StratusLab Cloud Tutorial

Tutorial showing the StratusLab cloud developments as well as interactions with the Quattor toolkit.

Speaker: Cal Loomis (CNRS/LAL)

Slides http://stratuslab.eu/doku.php/release:download http://stratuslab.eu/doku.php/tutorial:machinelifecycle

21 Preparing glite updates in QWG

Discussion/Tutorial on what is required to prepare templates for new gLite updates in QWG to allow more sites to contribute to teh effort.

Speaker: Michel Jouvin (LAL / IN2P3)

10:45 Coffee Break

22 Tutorial: PAN language

I think that a tutorial on the PAN language would be useful (we could record it for later usage for new comers). With main features and best practices and how to improve compilation performance. Could Cal provide it ?

Speaker: Cal Loomis (CNRS/LAL)

Paper pan-demo.tar.gz

Slides 20110318-pan-tutorial.pdf 20110318-pan-tutorial.ppt

12:30 Lunch

Tutorials and Hands-on

23 tutorial: NCM-components

I would propose to have another tutorial that presents all existing CORE components, what they do and examples of how to use them. Also some guide lines about how to write new components ?

Speakers: Luis Fernando Munoz Mejias (Facultad de Ciencias - Universidad Autonoma de Madrid), Michel Jouvin (LAL / IN2P3)

24 example of quattor settings such that the authorized_keys for root/users account stay and don't get removed (nor changed) after re-configuring ncm component

example of quattor settings such that the authorized_keys for root/users account stay and don't get removed (nor changed) after re-configuring ncm component.

Speaker: Luis Fernando Munoz Mejias (Facultad de Ciencias - Universidad Autonoma de Madrid)

25 example of quattor settings for RAID disk configurations (e.g. RAID 1, 6,10, 6E...)

example of quattor settings for RAID disk configurations (e.g. RAID 1, 6,10,6E...)

Speaker: Michel Jouvin (LAL / IN2P3)

Development Tools and Process

26 Continuous integration server

Demo + discussion

27 Pan annotation

Follow-up of Thursday morning discussion (https://trac.lal.in2p3.fr/Quattor/ticket/238)