Workshop on adapting applications and computing services to multi-core and virtualization

Europe/Zurich
40-S2-A01 (CERN)

40-S2-A01

CERN

Description
Preparatory workshop towards drawing up a roadmap for providing IT services which allow LHC experiment applications to exploit multi-core and virtualization capabilities. Applications being developed to exploit new hardware architectures and virtualization technology impose new requirements on the computing services provided by the local computer centers or by the Grids. The goal of this workshop is to discuss these new requirements and to have a first exploration of the possible solutions that service providers could offer to the LHC experiments. Contacts: Pere Mato (CERN) , Predrag Buncic (CERN) , Vincenzo Innocente (CERN) , Denise Heagerty (CERN) EVO conference has been booked at Universe community 24-June: http://evo.vrvs.org/evoGate/koala.jnlp?meeting=M2MvMB2a2iDaDn9I9lDM92 25-26 June: http://evo.vrvs.org/evoGate/koala.jnlp?meeting=M9MIMi2e2BDeD89e99DD99
Summary Document
  • Wednesday, 24 June 2009
    • 13:30 18:30
      Welcome and Technology session
      • 13:30
        Introduction to the Workshop 15m
        Speaker: Pere Mato
        Slides
      • 13:45
        VMware virtual datacenter operating system and cloud computing 45m
        • Virtual Datacenter OS - Foundation for the Cloud
        • VMware vSphere Architecture advantages and benefits
        • How to transform your datacenters to vSphere Architecture
        Speaker: Ralf von Gunten (VMware (Sr. Systems Engineer))
        Slides
      • 14:30
        Cisco Unified Computing System 45m
        • Cisco Datacenter Vision
        • Unified Computing Systems overview
        • Unified Computing Systems business benefits and technical advantages
        Speaker: Vincent Meoni (Cisco (DataCenter Systems Engineer))
        Slides
      • 15:15
        From Application to Appliance - Tackling the “Last Mile” of IT Process Automation 45m
        Speaker: Erik Troan (rPath (CTO))
        Slides
      • 16:00
        coffee break 30m
      • 16:30
        Using Linux KVM and KSM in scientific computing environments 45m

        Linux as Hypervisor with KVM is particularly performant virtualization technology to use in scientific computing environments, thanks especially to its (out of sync) secondary MMU management of the shadow page tables and it support for CPUs with EPT or NPT.

        In addition KVM leverages: the efficiency, testing and reliability of the huge pool of Linux Kernel device drivers, the close integration of the KVM shadow page tables management
        with the Linux Virtual Memory subsystem that allows KVM to take advantage of kernel features like swapping and KSM in a fully transparent way and much more.

        Speaker: Andrea Arcangeli (RedHat)
        Slides
      • 17:15
        Scheduling for mixed parallel and sequential workload 45m

        The talk will cover various techniques within the LSF Workload Management system for promoting higher efficiency with a non-homogeneous workload:
        - How to guarantee that parallel jobs can run in a mixed sequential/parallel environment (slot reservation /memory reservation/backfill)
        - How to maximize the efficiency on multicpu/multicore machines by using CPU binding
        - How to maximize the efficiency of very short jobs by using sub-scheduling (Session Scheduler)
        - How to maximize the efficiency of memory usage
        - How to maximize the efficiency of distributed parallel jobs: taking in account the compute farm topology

        Speaker: Robert Lurin (Platform)
        Slides
      • 18:00
        Discussion 30m
  • Thursday, 25 June 2009
    • 09:00 12:30
      New Application Requirements
      • 09:00
        Adapting LHC Applications to Multi-core architectures 30m
        Speaker: vincenzo innocente (CERN)
        Slides
      • 09:30
        Experience with multi- and many-core at openlab 30m

        The presentation would focus on the current hardware, future hardware, scalability issues and the experience we've had with both software and hardware in the area of multi-/many-core

        Speaker: Andrzej Nowak (CERN)
        slides
      • 10:00
        Virtualizing LHC Applications 45m
        Speaker: Predrag Buncic (CERN)
        Slides
      • 10:45
        coffee break 30m
      • 11:15
        ATLAS experience with multi-core and virtualization 40m
        Speaker: Paolo Calafiura (LBNL)
        Slides
      • 11:55
        LHCb End-User Experience 15m
        Speaker: Thomas Ruf (CERN)
        Slides
    • 14:00 18:00
      Computing Services
      • 14:00
        Next generation of virtual infrastructure with Hyper-V 20m

        Internet Services group provides the hardware and OS layers for services operated by different CERN organizational units. Within this framework, a user can ask for a new virtual server from a web browser and have it ready within 15 minutes. The latest release of the virtual infrastructure is based on Hyper-V, Microsoft Virtual Machine Manager, management SOAP web services and user web interface. This talk will present this approach and will discuss the evolution of the Microsoft Hypervisor from the perspective of both the end-user and the system administrator.

        Speaker: Juraj Sucik (CERN)
        Slides
      • 14:20
        Virtualisation from a security perspective 20m

        A look at some of the security issues around virtualization, covering both newly-added concerns as well as potential security benefits from using virtualization.

        Speaker: Jan Iven (CERN)
        Slides
      • 14:40
        Possibilities and limitations of virtualization from a networking perspective 20m

        This talk will address: types of networks for data centers and their impact on VM deployment, IPv4 address space limitation, VM migration and network infrastructure/services to support VMs at CERN.

        Speaker: Jose Carlos Luna Duran (CERN)
        Slides
      • 15:00
        Virtualisation of Batch Services at CERN 30m

        In this talk we will present a load-driven virtual machine provisioning mechanism based on Platform Virtual Machine Orchestrator (VMO). LSF and VMO are coupled to manage virtual machines that meet the requirements of the jobs. The underlying infrastructure uses Quattor/LANDB/CDB and LEMON monitoring which makes this virtual machine prototype compatible with the existing operations procedures.

        Speaker: Sebastien Goasguen (Clemson University)
        Slides
      • 15:30
        coffee break 30m
      • 16:00
        Practical aspects of multi-core job submission at CERN 15m
        Speaker: Ricardo Manuel Salgueiro Domingues da Silva (IT-FIO)
        Slides
      • 16:15
        Discussion 1h 45m
    • 20:00 20:20
      Workshop Dinner Restaurant (Auberge Communale de Satigny)

      Restaurant

      Auberge Communale de Satigny

      chemin de Merdisel 4 1242 Satigny

      Please use the following doodle poll to register to the dinner http://www.doodle.com/qkkbscitdac3gh6q
      Transport can be organized.

  • Friday, 26 June 2009
    • 09:00 11:00
      Grid Services
      • 09:00
        Nimbus: Open Source IaaS Cloud Computing Software 30m

        Nimbus is an open source cloud computing toolkit that allows you to turn your cluster into an Infrastructure-as-a-Service (IaaS) cloud.

        Speaker: Kate Keahey (Mathematics & CS Division, Argonne National Laboratory)
        Slides
      • 09:30
        EGEE MPI working group 30m

        In the original LHC Computing Grid, it was not possible to run parallel jobs which rely on communication between concurrent processes. Upon request of the user community, an MPI implementation on the Grid has been created. Recently, an MPI working group has been setup to investigate the bottlenecks with this MPI implementation both for system administrators and for users.

        Another task of this working group is to write recommendations for improvements and extensions. One of the extensions is a the mechanism for the user to request all cores on a single node.

        Speaker: Jeroen Engelberts
        Slides
      • 10:00
        Evolution of OSG to support virtualization and multi-core applications 30m
        Speaker: Daniel Charles Bradley (High Energy Physics)
        Slides
      • 10:30
        The INFN experience with virtualized computing services and perspectives for integration of Grid and Cloud services in EGI (European Grid Initiative) 30m

        In this talk we'll describe how INFN approached the problem of virtualizing existing computing farms, the technology and performance studies that were carried out, and a framework for the integration of both Grid and Cloud virtualized services into a distributed computing infrastructure like EGI.

        Speaker: Davide Salomoni (INFN-CNAF)
        Slides
    • 11:00 11:15
      coffee break
    • 11:15 12:30
      Summary, final discussion and wrap-up
      • 11:15
        Summary of the workshop 20m
        Speaker: Denise Heagerty (CERN)
        Slides
      • 11:35
        Dynamic Cluster Partitioning for Worker Nodes 5m
        Speaker: Yves Kemp (DESY)
        Slides
      • 11:40
        Discussion 50m