Workshop on adapting applications and computing services to multi-core and virtualization

from to (Europe/Zurich)
at CERN ( 40-S2-A01 )
Description
Preparatory workshop towards drawing up a roadmap for providing IT services which allow LHC experiment applications to exploit multi-core and virtualization capabilities. Applications being developed to exploit new hardware architectures and virtualization technology impose new requirements on the computing services provided by the local computer centers or by the Grids. The goal of this workshop is to discuss these new requirements and to have a first exploration of the possible solutions that service providers could offer to the LHC experiments.

Contacts: Pere Mato (CERN) , Predrag Buncic (CERN) , Vincenzo Innocente (CERN) , Denise Heagerty (CERN)

EVO conference has been booked at Universe community
24-June: http://evo.vrvs.org/evoGate/koala.jnlp?meeting=M2MvMB2a2iDaDn9I9lDM92
25-26 June: http://evo.vrvs.org/evoGate/koala.jnlp?meeting=M9MIMi2e2BDeD89e99DD99 
Material:
Go to day
  • Wednesday, 24 June 2009
    • 13:30 - 18:30 Welcome and Technology session
      Convener: Predrag Buncic (CERN)
      • 13:30 Introduction to the Workshop 15'
        Speaker: Pere Mato
        Material: Slides powerpoint file pdf file
      • 13:45 VMware virtual datacenter operating system and cloud computing 45'
        - Virtual Datacenter OS - Foundation for the Cloud
        - VMware vSphere Architecture advantages and benefits
        - How to transform your datacenters to vSphere Architecture
        
        Speaker: Ralf von Gunten (VMware (Sr. Systems Engineer))
        Material: Slides powerpoint file pdf file
      • 14:30 Cisco Unified Computing System 45'
        - Cisco Datacenter Vision
        - Unified Computing Systems overview
        - Unified Computing Systems business benefits and technical advantages
        
        Speaker: Vincent Meoni (Cisco (DataCenter Systems Engineer))
        Material: Slides powerpoint file pdf file
      • 15:15 From Application to Appliance - Tackling the “Last Mile” of IT Process Automation 45'
        Speaker: Erik Troan (rPath (CTO))
        Material: Slides powerpoint file pdf file
      • 16:00 coffee break 30'
      • 16:30 Using Linux KVM and KSM in scientific computing environments 45'
        Linux as Hypervisor with KVM is particularly performant  virtualization technology to use in scientific computing environments, thanks especially to its (out of sync) secondary MMU management of the shadow page tables and it support for CPUs with EPT or NPT. 
        
        In addition KVM leverages: the efficiency, testing and reliability of the huge pool of Linux Kernel device drivers, the close integration of the KVM shadow page tables management
        with the Linux Virtual Memory subsystem that allows KVM to take advantage of kernel features like swapping and KSM in a fully transparent way and much more. 
        
        Speaker: Andrea Arcangeli (RedHat)
        Material: Slides pdf file
      • 17:15 Scheduling for mixed parallel and sequential workload 45'
        The talk will cover various techniques within the LSF Workload Management system for promoting higher efficiency with a non-homogeneous workload:
        - How to guarantee that parallel jobs can run in a mixed sequential/parallel environment  (slot reservation /memory reservation/backfill)
        - How to maximize the efficiency on multicpu/multicore machines by using CPU binding
        - How to maximize the efficiency of very short jobs by using sub-scheduling (Session Scheduler)
        - How to maximize the efficiency of memory usage
        - How to maximize the efficiency of distributed parallel jobs: taking in account the compute farm topology
        
        Speaker: Mr. Robert Lurin (Platform)
        Material: Slides powerpoint file pdf file
      • 18:00 Discussion 30'
  • Thursday, 25 June 2009
    • 09:00 - 12:30 New Application Requirements
      Convener: Dr. Pere Mato (CERN)
      • 09:00 Adapting LHC Applications to Multi-core architectures 30'
        Speaker: vincenzo innocente (CERN)
        Material: Slides powerpoint file pdf file
      • 09:30 Experience with multi- and many-core at openlab 30'
        The presentation would focus on the current hardware, future hardware, scalability issues and the experience we've had with both software and hardware in the area of multi-/many-core
        Speaker: Andrzej Nowak (CERN)
        Material: slides pdf file
      • 10:00 Virtualizing LHC Applications 45'
        Speaker: Predrag Buncic (CERN)
        Material: Slides powerpoint file pdf file
      • 10:45 coffee break 30'
      • 11:15 ATLAS experience with multi-core and virtualization 40'
        Speaker: Paolo Calafiura (LBNL)
        Material: Slides pdf file
      • 11:55 LHCb End-User Experience 15'
        Speaker: Thomas Ruf (CERN)
        Material: Slides pdf file
    • 14:00 - 18:00 Computing Services
      Convener: Denise Heagerty (CERN)
      • 14:00 Next generation of virtual infrastructure with Hyper-V 20'
        Internet Services group provides the hardware and OS layers for services operated by different CERN organizational units. Within this framework, a user can ask for a new virtual server from a web browser and have it ready within 15 minutes. The latest release of the virtual infrastructure is based on Hyper-V, Microsoft Virtual Machine Manager, management SOAP web services and user web interface. This talk will present this approach and will discuss the evolution of the Microsoft Hypervisor from the perspective of both the end-user and the system administrator.
        
        Speaker: Juraj Sucik (CERN)
        Material: Slides powerpoint file pdf file
      • 14:20 Virtualisation from a security perspective 20'
        A look at some of the security issues around virtualization, covering both newly-added concerns as well as potential security benefits from using virtualization.
        
        Speaker: Jan Iven (CERN)
        Material: Slides presentation file pdf file
      • 14:40 Possibilities and limitations of virtualization from a networking perspective 20'
        This talk will address: types of networks for data centers and their impact on VM deployment, IPv4 address space limitation, VM migration and network infrastructure/services to support VMs at CERN.
        Speaker: Jose Carlos Luna Duran (CERN)
        Material: Slides powerpoint file pdf file
      • 15:00 Virtualisation of Batch Services at CERN 30'
        In this talk we will present a load-driven virtual machine provisioning mechanism based on Platform Virtual Machine Orchestrator (VMO). LSF and VMO are coupled to manage virtual machines that meet the requirements of the jobs. The underlying infrastructure uses Quattor/LANDB/CDB and LEMON monitoring which makes this virtual machine prototype compatible with the existing operations procedures.
        
        Speaker: Sebastien Goasguen (Clemson University)
        Material: Slides pdf file
      • 15:30 coffee break 30'
      • 16:00 Practical aspects of multi-core job submission at CERN 15'
        Speaker: Mr. Ricardo Manuel Salgueiro Domingues da Silva (IT-FIO)
        Material: Slides powerpoint file pdf file
      • 16:15 Discussion 1h45'
    • 20:00 - 20:20 Workshop Dinner
      Please use the following doodle poll to register to the dinner http://www.doodle.com/qkkbscitdac3gh6q  
      Transport can be organized.
      Location: Auberge Communale de Satigny ( Restaurant )
  • Friday, 26 June 2009
    • 09:00 - 11:00 Grid Services
      Convener: vincenzo innocente (CERN)
      • 09:00 Nimbus: Open Source IaaS Cloud Computing Software 30'
        Nimbus is an open source cloud computing toolkit that allows you to turn your cluster into an Infrastructure-as-a-Service (IaaS) cloud.
        Speaker: Kate Keahey (Mathematics & CS Division, Argonne National Laboratory)
        Material: Slides powerpoint file pdf file
      • 09:30 EGEE MPI working group 30'
        In the original LHC Computing Grid, it was not possible to run parallel jobs which rely on communication between concurrent processes. Upon request of the user community, an MPI implementation on the Grid has been created. Recently, an MPI working group has been setup to investigate the bottlenecks with this MPI implementation both for system administrators and for users.
        
        Another task of this working group is to write recommendations for improvements and extensions. One of the extensions is a the mechanism for the user to request all cores on a single node.
        Speaker: Jeroen Engelberts
        Material: Slides powerpoint file pdf file
      • 10:00 Evolution of OSG to support virtualization and multi-core applications 30'
        Speaker: Daniel Charles Bradley (High Energy Physics)
        Material: Slides powerpoint file pdf file
      • 10:30 The INFN experience with virtualized computing services and perspectives for integration of Grid and Cloud services in EGI (European Grid Initiative) 30'
        In this talk we'll describe how INFN approached the problem of virtualizing existing computing farms, the technology and performance studies that were carried out, and a framework for the integration of both Grid and Cloud virtualized services into a distributed computing infrastructure like EGI.
        
        
        Speaker: Davide Salomoni (INFN-CNAF)
        Material: Slides powerpoint file pdf file
    • 11:00 - 11:15 coffee break
    • 11:15 - 12:30 Summary, final discussion and wrap-up
      Convener: vincenzo innocente (CERN)
      • 11:15 Summary of the workshop 20'
        Speaker: Denise Heagerty (CERN)
        Material: Slides powerpoint file pdf file
      • 11:35 Dynamic Cluster Partitioning for Worker Nodes 5'
        Speaker: Yves Kemp (DESY)
        Material: Slides pdf file
      • 11:40 Discussion 50'