WAN data access and caching meeting

chaired by Simone Campana (CERN/IT/GS), Torre Wenaus (BNL)
Monday, 10 September 2012 from to (Europe/Zurich)
at CERN ( 3162-2-E01 )
ATLAS Computing Control Room, P1
Description During the June 2012 ATLAS Software and Computing Week it was decided to set up an R&D activity for WAN data access and caching. This area was addressed at the Dubna TIM in June 2011 and has seen much progress since in event layout optimization, ROOT support for cached WAN data access, systematic I/O performance studies and testing tools, and maturation of the xrootd federation which can provide a good basis for WAN direct access and caching at the file and subfile levels.
Motivations for establishing an R&D effort to track and push forward this area include the readiness of the ATLAS event I/O software stack to support WAN direct I/O; the potential to improve distributed analysis and storage efficiency; readiness of storage service endpoints such as xrootd and EOS to support WAN direct access; and its relevance to emerging areas such as storage access from cloud resources, and event servers/consumer schemes as an alternative to file-oriented processing.
This half day meeting will provide a face to face (and remote) kickoff for this R&D area, surveying the state of activities relevant to the topic, the status of the initial objectives established in June, status and plans for activities benefitting from or dependent on WAN data access, and establishing objectives and priorities for the next months.

Regarding wishlists/requirements, the idea is that designated people keep their ears open on a particular topic and note items down as they emerge from discussion. We then go over them in the final closeout session.

Torre's talk at the June S&C week
Video Services
Vidyo public room : ADC_Development_indico_205586 More Info | Join Now!
Go to day
  • Monday, 10 September 2012
    • 14:00 - 14:15 Introduction 15'
      Speaker: Dr. Torre Wenaus (Brookhaven National Laboratory (US))
      Material: Slides powerpoint file pdf file
    • 14:15 - 14:45 Update on WAN data access and caching in ROOT 30'
      Speaker: Fons Rademakers (CERN)
      Material: Slides pdf file
    • 14:45 - 15:05 Update on ATLAS storage layout and performance 20'
      Speakers: Peter Van Gemmeren, Dr. David Malon (Argonne National Laboratory (US))
      Material: Slides powerpoint file pdf file
    • 15:05 - 15:25 WAN data access in the xrootd federation 20'
      Speaker: Robert GARDNER (UNIVERSITY OF CHICAGO)
      Material: Slides pdf file
    • 15:25 - 15:45 Metrics & monitoring: HC based testing/benchmarking, site-site cost matrix 20'
      Speaker: Ilija Vukotic (University of Chicago (US))
      Material: Slides powerpoint file pdf file
    • 15:45 - 16:05 Metrics & monitoring: Understanding of workflows, DQ2 traces, file read fractions,... 20'
      Speaker: Doug Benjamin (Duke University (US))
      Material: Slides powerpoint file pdf file
    • 16:05 - 16:20 PanDA readiness for WAN data access and caching 15'
      Speaker: Tadashi Maeno (Brookhaven National Laboratory (US))
      Material: Slides pdf file
    • 16:20 - 16:30 Standard protocol alternatives 10'
      Speaker: Dr. Rodney Walker (Ludwig-Maximilians-Univ. Muenchen (DE))
      Material: Slides pdf file
    • 16:30 - 16:40 Coffee
    • 16:40 - 17:20 Discussion reviewing of status of initial June objectives 40'
      Speaker: Dr. Torre Wenaus (Brookhaven National Laboratory (US))
    • 17:20 - 17:35 Skimming and event services 15'
      Speaker: Dr. Jack Cranshaw (Argonne National Laboratory (US))
      Material: Slides powerpoint file pdf file
    • 17:35 - 17:50 Tiered storage and federation for dCache 15'
      Speaker: Guenter Duckeck (Ludwig-Maximilians-Univ. Muenchen (DE))
      Material: Slides pdf file
    • 17:50 - 18:50 Closeout discussion 1h0'
      Review of wishlists/requirements for I/O framework, xrootd federation, DDM system, PanDA, monitoring (system and user), DA/PAT, ...
              - what do we need from these systems?
              - what requirements come from WAN data access (eg. what restrictions on DA in order to use WAN data access (eg. efficient I/O is mandatory))
      Define objectives for next ~6 months
      Speaker: Dr. Torre Wenaus (Brookhaven National Laboratory (US))