14-18 May 2018
University of Wisconsin-Madison
America/Chicago timezone

Evolution of the Hadoop and Spark platform for HEP

May 17, 2018, 3:20 PM
20m
Chamberlin Hall (University of Wisconsin-Madison)

Chamberlin Hall

University of Wisconsin-Madison

Madison, USA 43°4'25.8024''N 89°24'18.7776''W 43.073834, -89.405216
Basic IT Services Basic IT services

Speaker

Zbigniew Baranowski (CERN)

Description

The interest in using Big Data solutions based on Hadoop ecosystem is constantly growing in HEP community. This drives the need for increased reliability and availability of the central Hadoop service and underlying infrastructure provided to the community by the CERN IT department.
This contribution will report on the overall status of the Hadoop platform and the recent enhancements and features introduced in many areas including the service configuration, availability, alerting, monitoring and data protection, in order to meet the new requirements posed by the users community.

Desired length 20

Primary author

Presentation materials