Visit of J.P. Morgan Big Data Team in Geneva

Monday 7 May 2018, 14:00 → 18:00 Europe/Zurich

513/1-024 (CERN)

The aim of this meeting is meet and share experience on data management and data engineering work between CERN teams and J.P. Morgan team (organised by the Geneva office)

14:00 → 14:05 Welcome to JP Morgan team visiting

Introduction of the people present to the meeting and overview of the agenda for the afternoon

Speakers: Eric Grancher (CERN), Luca Canali (CERN), Massimiliano Chiorboli, Massimo Lamanna (CERN)

Visit_JPMOrgan_BigData_GenevaWelcome.pdf

Visit_JPMOrgan_BigData_GenevaWelcome.pptx

14:05 → 15:05 Presentation of JP Morgan's work

Speakers: Massimiliano Chiorboli, Michael Muller, Jozef Slezacek, Tanjona Rafidison, Harish Rao

15:05 → 16:05 Presentation of CERN's work

Various teams presenting, including highlights of work on Hadoop, Spark, Kafka, SWAN.

Tentative split:
- Luca, general intro 5 min
- Danilo/Enric, 15 min SWAN
- Zbyszek, 20 min on infrastructure and Hadoop and Spark service
- Luna/Manuel 15 min on Kafka/streaming
- Vagg, 15 min CMS Bigdata + brief mention of IT Monitoring, Security use cases and work on Spark on k8s

Speakers: Danilo Piparo (CERN), Jose Carlos Luna Duran (CERN), Luca Canali (CERN), Manuel Martin Marquez (CERN), Massimo Lamanna (CERN), Vaggelis Motesnitsalis (CERN), Zbigniew Baranowski (CERN)

BigData at CERN_JP.pdf

BigData at CERN_JP.pptx

EOS+CERNBox

EOS+CERNBox

Intro_Data_Analytics_CERNIT_20180507.pdf

Intro_Data_Analytics_CERNIT_20180507.pptx

Kafka@CERN.pdf

SWAN talks and publications

Tools_Development_ and_Projects_JPMorgan.pdf

16:05 → 16:20 Coffee break

16:20 → 17:30 Q&A , presentations, backup material

A study of data representation in Hadoop to optimize data storage and search performance for the ATLAS EventIndex

BigData_Solutions_at_CERN_KT_Forum_20170929.pdf

HUF_SWAN_Spark_Integration.pdf

HUF_SWAN_Spark_Integration.pptx

ITMM_Data_Analytics_CERNIT_20180305.pdf

17:30 → 17:50 Visit of the CERN Data Center

Convener: Vaggelis Motesnitsalis (CERN)