Indico will be unavailable for around five minutes after 18:00 CEST (16:00 UTC), due to a software update.
Workshops

Spark - a modern approach for distributed analytics

by Mr. Prasanth Kothuri (CERN) , Mr. Kacper Surdy

Europe/Zurich
31-3-004 - IT Amphitheatre (CERN)

31-3-004 - IT Amphitheatre

CERN

105
Show room on map
Description

The Hadoop ecosystem is the leading opensource platform for distributed storing and processing big data. It is a very popular system for implementing data warehouses and data lakes. Spark has also emerged to be one of the leading engines for data analytics. The Hadoop platform is available at CERN as a central service provided by the IT department.

By attending the session, a participant will acquire knowledge of the essential concepts need to benefit from the parallel data processing offered by Spark framework. The session is structured around practical examples and tutorials.

Main topics:

  • Architecture overview - work distribution, concepts of a worker and a driver
  • Computing concepts of transformations and actions
  • Data processing APIs - RDD, DataFrame, and SparkSQL
From the same series
1 2 4
Registration
Participants
Webcast
There is a live webcast for this event
Your browser is out of date!

Update your browser to view this website correctly. Update my browser now

×