Nov 4 – 8, 2019
Adelaide Convention Centre
Australia/Adelaide timezone

Evolution of the CloudVeneto.it private cloud to support research and innovation

Nov 7, 2019, 3:30 PM
1h
Hall F (Adelaide Convention Centre)

Hall F

Adelaide Convention Centre

Poster Track 7 – Facilities, Clouds and Containers Posters

Speaker

Marco Zanetti (Universita e INFN, Padova (IT))

Description

CloudVeneto.it was initially funded and deployed by INFN in 2014 for serving the computational and storage demands of INFN research projects mainly related to HEP and Nuclear Physics. It is an OpenStack-based scientific cloud with resources spread across two different sites connected with a high speed optical link: the INFN Padova Unit and the INFN Legnaro National Laboratories. The infrastructure has grown throughout the years with additional funds from ten University of Padova departments, and nowadays supports a broader range of scientific and engineering disciplines. Its hardware resources provide around 2000 computational cores and 300 TB of storage to about 250 users working for more than 70 projects. In the last months we enhanced the cloud platform in two ways: 1) by integrating a number of heterogeneous GPU cards to address the special needs of user communities whose computations involve machine learning training; 2) by enabling the users to simply deploy on-demand Kubernetes clusters for Big Data analytics applications taking advantage of the operator framework. In particular, the Kubernetes operators for Apache Kafka and Spark platforms were integrated to address real-time data ingestion and streaming processing on the cloud. The article will describe the technical details of the these two solutions and their integration with the cloud infrastructure.

Consider for promotion No

Primary authors

Paolo Andreetto (INFN, Sezione di Padova) Fulvia Costa (INFN, Sezione di Padova) Alberto Crescente (INFN, Sezione di Padova) Sergio Fantinel (INFN, Lab. Naz. di Legnaro) Federica Fanzago (INFN, Sezione di Padova) Paolo Emilio Mazzon (PNC, Università di Padova) Matteo Menguzzato (DFA, Università di Padova) Giampietro Sella (DISC, Università di Padova) Massimo Sgaravatto (INFN, Sezione di Padova) Sergio Traldi (INFN, Sezione di Padova) Marco Verlato (INFN, Sezione di Padova) Lisa Zangrando (INFN, Sezione di Padova) Marco Zanetti (Universita e INFN, Padova (IT))

Presentation materials

There are no materials yet.