Indico celebrates its 20th anniversary! Check our blog post for more information!

 
Focus on:  Hide Contributions
Login

Big Data processing and analysis challenges in mega-science experiments

→ Europe/Moscow
NRC KI and JINR

NRC KI and JINR

29.01 NRC KI 30.01 JINR
Alexei Klimentov (Brookhaven National Laboratory (US)), Vladimir Korenkov (Joint Inst. for Nuclear Research (RU))
How to come to NRC KI
how to find LIT JINR
link to hotel aerostar
link to hotel Pekin
link to Mariott (Tverskaya Yamskaya)
Схема проезда к НИЦ КИ
  • Thursday 29 January
    • Welcome. Dr.V.Velikhov, NRC-KI vice-director; Dr.V.Demin, NBICS vice-director Room 378 (Bldg.190)

      Room 378

      Bldg.190

      Bldg.190 Room 378
      Introduction and logistics. A.Klimentov
    • Database Technologies Room 274 (Bldg.190)

      Room 274

      Bldg.190

      Bldg.190 Room 274
      Convener: Dr Maria Grigorieva (NRC KI)
      slides

      Topics for discussion:

      1. Our experience of the developing of Hybrid SQL/NoSQL Storage, and NoSQL database integration in BigPanDA monitor

      2. Database performance tests : SQL - NoSQL, NoSQL - NoSQL

      3. Technology evaluation tests results for NoSQL databases: MongoDB, HBase, Cassandra, Dremel, CouchDB, MariaDB

      4. Experience of using Hadoop/Spark/MapReduce in PanDA Infrasctucture. Use cases.

      5. Foreseen performance and possible changes in PanDA Oracle archived database schema during/after the LHC Run2

      6. Query routing strategy in BigPanDA applications (BigPanDA Monitor in particular)

      7. How to implement cross database requests in heterogeneous architecture

      8. Strategies of the data modelling for NoSQL databases 

    • EOS and Data Store
      Convener: Eygene Ryabinkin (National Research Centre Kurchatov Institute (RU))
    • PanDA@NRC-KI room 278 (Bldg.190)

      room 278

      Bldg.190

      Bldg.190 Room 278
      Convener: Ruslan Mashinistov (Russian Academy of Sciences (RU))
      • 1
        PanDA @ NRC-KI
        PanDA instance installation and commissioning status PanDA for ATLAS PanDA beyond LHC and HEP
        Speaker: Ruslan Mashinistov (Russian Academy of Sciences (RU))
        Slides
      • 2
        Discussion
        PanDA beyond ATLAS : ALICE Do we need version w/o VOMS, Grid Services… Do we need Light weight DDM Staging and I/O matters
    • webFTS 234 (Bldg.190)

      234

      Bldg.190

      Bldg.190 Room 234
      Convener: Mr Andrey Kiryanov (B.P. Konstantinov Petersburg Nuclear Physics Institute - PNPI ()
      • 3
        Introduction: current status of FTS3/WebFTS
        Speaker: Oliver Keeble (CERN)
        Slides
      • 4
        FTS readiness for transfers to/from non-Grid resources (VOMS/non-VOMS credentials, etc.)
      • 5
        Impact of Federated Identity support in WebFTS for non-Grid users
        Slides
      • 6
        FTS & HPC: old/new APIs, lightweight clients, Python client library for PanDA integration
      • 7
        Usage scenario for Titan: requirements from both sides
        Speakers: Mr Andrey Kiryanov (B.P. Konstantinov Petersburg Nuclear Physics Institute - PNPI (), Danila Oleynik (Joint Inst. for Nuclear Research (RU))
      • 8
        Feature requests for FTS/WebFTS
    • Meeting with Big Data Lab PhD students (round table) 207 (Bldg.190)

      207

      Bldg.190

      Bldg.190 Room 207
      Conveners: Alberto Pace (CERN), Dr Markus Schulz (CERN), Massimo Lamanna (CERN), Prof. Shantenu Jha (Rutgers U), Simon C. LIN (Academia Sinica)
      round table panel and participants list
    • BigPanDA Room 378 (Bldg.190)

      Room 378

      Bldg.190

      Bldg.190 Room 378
      Convener: Dr Alexei Klimentov (Brookhaven National Laboratory (US))
      • 9
        Introduction
      • 10
        webFTS highlights
        Speakers: Mr Andrey Kiryanov (B.P. Konstantinov Petersburg Nuclear Physics Institute - PNPI (), Dr Markus Schulz (CERN), Oliver Keeble (CERN)
      • 11
        Database session highlights
        Speakers: Gancho Dimitrov (CERN), Dr Maria Grigorieva (NRC KI), Ms Marina Golosova (NRC KI), Dr Mario Lassnig (CERN)
        Slides
      • 12
        PanDA session highlights
        Speakers: Danila Oleynik (Joint Inst. for Nuclear Research (RU)), Kaushik De (University of Texas at Arlington (US)), Ruslan Mashinistov (Russian Academy of Sciences (RU))
        Slides
      • 13
        PanDA HPC pilot
        Speakers: Danila Oleynik (Joint Inst. for Nuclear Research (RU)), Prof. Shantenu Jha (Rutgers U)
        Slides
        • a) HPC pilot @NRC KI supercomputer
          Speaker: Alexey Poyda (Kurchatov Institute)
          Slides
      • 14
        webFTS integration with PanDA
        Speakers: Mr Andrey Kiryanov (B.P. Konstantinov Petersburg Nuclear Physics Institute - PNPI (), Danila Oleynik (Joint Inst. for Nuclear Research (RU)), Kaushik De (University of Texas at Arlington (US)), Oliver Keeble (CERN)
        • a) FTS & HPC: lightweight clients, Python client library for PanDA integration
          Slides
        • b) Usage scenario for Titan: requirements from both sides
    • 13:30
      Lunch
    • Modeling Distributed Computing Systems 207 (Bldg.190)

      207

      Bldg.190

      Bldg.190, Room 207
      Conveners: Dr Eugene Burnaev (IPPI RAS), Kaushik De (University of Texas at Arlington (US)), Prof. Shantenu Jha (Rutgers U)
    • Nano-,bio-,information and cognitive technologies Institute seminar 322 (Bldg.348)

      322

      Bldg.348

      Bldg. 348 Room 322
      • 15
        "PanDA,  A New Paradigm for Computing in HEP"
        Speaker: Kaushik De (University of Texas at Arlington (US))
        Slides
      • 16
        CERN and Computing
        Speaker: Alberto Pace (CERN)
        Slides
    • visit to I.V.Kurchatov museum and NRC KI Supercomputing center
      doodle poll to visit I.V.Kurchatov museum
      doodle poll to visit NRC KI Tier1 and supercomputi
    • 17:00
      Leave to JINR by bus from NRC KI
  • Friday 30 January
    • 17
      Welcome from Prof.N.Rusakovich, JINR Chief Scientific Secretary
    • Modeling in mega-projects
      • 18
        NICA mega-project
        Speaker: Prof. O.Rohachevsky (JINR)
      • 19
        Modeling of grid-cloud systems
        Speaker: Prof. Gennady Ososkov (JINR)
    • 11:10
      coffee break
    • BigPanDA project
      • 20
        Project overview : Growing PanDA ecosystem, PanDA beyond ATLAS, prospects for ALICE, COMPASS, NICA.
        Speaker: Kaushik De (University of Texas at Arlington (US))
        Slides
      • 21
        Towards an Abstractions-driven and Standards-based Next-generation of Distributed Cyberinfrastructure
        Speaker: Prof. Shantenu Jha (Rutgers University)
      • 22
        Network awareness
        Speaker: Artem Petrosyan (Joint Inst. for Nuclear Research (RU))
        Slides
    • 14:00
      lunch
    • Monitoring
    • Reports on Tier1
      • 29
        ASGC TW Tier-1
        Speaker: Simon Lin (Academia Sinica (TW))
        Slides
      • 30
        NRC KI RF Tier-1
        Speaker: Dr Vassily Velikhov (NRC KI)
      • 31
        JINR Tier-1
        Speaker: Dr Tatiana Strizh (JINR)
    • 16:20
      tea break
    • 32
      Presentation of the heterogeneous cluster of LIT
      Speaker: Dr D.Podgainy (JINR)
    • Excursion in LIT
    • Beer party
      doodle poll
  • Saturday 31 January
    • Technical splinter meetings
      • 33
        Distributed Modeling splinter meeting
Powered by Indico v3.3.5-pre