Database TEG Workshop

chaired by Dario Barberis (Genoa University/INFN), Dave Dykstra (Fermi National Accelerator Lab. (US))
from to (Europe/Zurich)
at CERN
Description Technical Evolution Groups – Mandate
To reassess the implementation of the grid infrastructures that we use in the light of the experience with LHC data, and technology evolution, but never forgetting the important successes and lessons, and ensuring that any evolution does not disrupt our successful operation.
 
The work should:
  • Document a strategy for evolution of the technical implementation of the WLCG distributed computing infrastructure.
  • This strategy should provide a clear statement of needs for WLCG, which can also be used to provide input to any external middleware and infrastructure projects.
 
The work should, in each technical area, take into account the current understanding of:
  • Experiment and site needs in the light of experience with real data, operational needs (effort, functionality, security, etc.), and constraints;
  • Lessons learned over several years in terms of deployability of software;
  • Evolution of technology over the last several years;
  • Partnership and capabilities of the various middleware providers.
It should also consider issues of:
  • Long term support and sustainability of the solutions;
  • Achieving commonalities between experiments where possible;
  • Achieving commonalities across all WLCG supporting infrastructures (EGI-related, OSG, NDGF, etc).
Deliverables
  • Assessment of the current situation with middleware, operations, and support structure
  • Strategy document setting out a plan and needs for the next 2-5 years
Databases Working Group Topics
The bullets represent the topics that should be included in the discussions, but are not exclusive.
  • NOSQL vs Oracle, MySQL, etc
  • Frontier, squids, vs 3D/Streams, GoldenGate, DataGuard etc
  • CORAL, COOL
  • What is framework for deploying new applications that need a DB? (e.g. if dev has used a random db, how is that made into a service?)
----------------

We do not want to repeat information from the June 2011 Database Futures Workshop (http://indico.cern.ch/conferenceTimeTable.py?confId=130874), especially things describing the current situation, although a quick refresher on plans shared then can be helpful.  We want to focus on what should be changing over the next 2-5 years, both things currently planned and especially things not yet planned but which are lacking or could be improved or could be better shared between experiments.  Bring proposals, or describe ideas during discussion time, or at least talk about what the needs will be if not the solutions.  Set your sights on after the long 2013 shutdown and later.

----------------

Doodle poll for Tuesday's dinner:
http://www.doodle.com/8xbymnm4fpxsviwv
Please sign up by Monday mid-afternoon.

Go to day
  • Monday, 7 November 2011
    • 14:00 - 14:20 Introduction
      Conveners: Dr. Dario Barberis (Universita e INFN (IT)), Dr. Dave Dykstra (Fermi National Accelerator Lab. (US))
      Location: 40-S2-C01 - Salle Curie
      Material: slides pdf file
    • 14:20 - 18:00 Conditions data, COOL, CORAL, Frontier and database replication and remote access issues
      Location: 40-S2-C01 - Salle Curie
      • 14:20 COOL and CORAL: a critical review 30'
        Speaker: Andrea Valassi (CERN)
        Material: Slides powerpoint file pdf file
      • 14:50 ATLAS use of COOL/CORAL 20'
        Speaker: Andrea Formica (CEA - Centre d'Etudes de Saclay (FR))
        Material: Slides pdf file
      • 15:10 CMS Conditions evolution 20'
        Speaker: Giacomo Govi (Fermi National Accelerator Lab. (US))
        Material: Slides pdf file
      • 15:30 LHCb conditions evolution 20'
        Speaker: Marco Clemencic (CERN)
        Material: Slides presentation file pdf file
      • 16:00 Coffee break 30'
      • 16:30 Oracle database replication, backup and archiving technologies 30'
        Speaker: Eva Dafonte Perez (CERN)
        Material: Slides powerpoint file pdf file
      • 17:00 Frontier evolution 20'
        Speaker: Dave Dykstra (Fermi National Accelerator Lab. (US))
        Material: Slides powerpoint file pdf file
      • 17:20 ATLAS Frontier plans 10'
        Speaker: Dr. Dario Barberis (Universita e INFN (IT))
        Material: Slides pdf file
      • 17:30 Discussion 30'
  • Tuesday, 8 November 2011
    • 11:00 - 12:00 Computing seminar: Oracle NoSQL developments
      Location: 503-1-001 - Council Chamber
      Material: more information link
    • 14:00 - 18:15 Relational and NoSQL databases for distributed applications, requirements and deployment models
      Location: 160-1-009
      • 14:00 Oracle DB operations: issues, lessons learned and future plans 30'
        Speaker: Luca Canali (CERN)
        Material: Slides powerpoint file pdf file
      • 14:30 ATLAS Oracle applications and Oracle 11g functionality enhancements 30'
        Speaker: Gancho Dimitrov (Brookhaven National Laboratory (US))
        Material: Slides powerpoint file pdf file
      • 15:00 Structured storage for ATLAS database applications 45'
        Speaker: Mario Lassnig (CERN)
        Material: Slides pdf file
      • 15:45 Coffee break 45'
      • 16:30 CMS experiences with NoSQL tools and plans 30'
        Speaker: Simon Metson (University of Bristol (GB))
        Material: Slides pdf file
      • 17:00 LHCb offline experience with relational databases and usage of a hybrid database model for metadata storage 30'
        Speaker: Zoltan Mathe (University College Dublin (IE))
        Material: Slides pdf file
      • 17:30 Discussion 45'
    • 19:30 - 22:00 Dinner ( Auberge Communale de Meyrin, Avenue de Vaudagne 43, Meyrin - Meet at the entrance to B.40 at 19:15 )
  • Wednesday, 9 November 2011
    • 14:00 - 15:25 Usage, evolution and requirements of Online Databases
      Location: 513-1-024
      • 14:00 Evolution of PVSS 30'
        Speaker: Dr. Piotr Golonka (CERN)
        Material: Slides presentation file pdf file
      • 14:30 CMS Online evolution 5'
        Speaker: Frank Glege (CERN)
        Material: Slides powerpoint file pdf file
      • 14:35 CMS Online Conditions evolution 10'
        Speaker: Dave Dykstra (Fermi National Accelerator Lab. (US))
        Material: Slides powerpoint file pdf file
      • 14:45 ALICE online databases 20'
        Speaker: Peter Chochula (CERN)
        Material: Slides powerpoint file pdf file
      • 15:05 Evolution of ATLAS online databases 20'
        Speaker: Rainer Bartoldus (SLAC National Accelerator Laboratory (US))
        Material: Slides pdf file
    • 15:30 - 16:00 Coffee break
    • 16:00 - 17:30 Discussion and workshop wrap-up
      Location: 513-1-024
      Material: slides powerpoint file pdf file