In this seminar we present the current status about developing a vision of the potential for HTTP's use by HEP computing, and we present an overview of the use of HTTP-based protocols for storage access & management, cataloguing, federation and transfer.
The support of HTTP/WebDAV, provided by frameworks for scientific data access like DPM, dCache, STORM, GFAL2, FTS3 and foreseen for XROOTD, can be seen as a coherent ensemble – an ecosystem – that is based on a single, standard protocol, where the HEP-related features are covered, and the door is open to standard solutions and tools provided by third parties, in the context of the Web and Cloud technologies.
Among the results are a contribution of our fully standard and full-featured DAVIX client library to ROOT 5 and 6, and the design of a plugin that adds HTTP/WebDav support to the XROOTD framework. At the same time, the Dynamic Federations project gives the possibility of clustering HTTP/WebDAV resources across LANs and WANs in a very efficient and scalable way, thus allowing one to build large federations of HTTP-based storage sites or file metadata databases.
The application domain goes from large scale, Grid-like computing to data access from laptops, profiting from tools that are shared with the Web community, like browsers, clients libraries and others.
The overall goal is to leverage standards and standard practices, and use them to contribute the components that are needed to fulfill the complex problem of Data Access in HEP while using technologies and toolsets that are attractive also for non-HEP communities, making long term sustainability a closer goal.
Many of the mentioned components are already available, and the idea is to contribute the parts that can make possible an ecosystem of services and applications, where the HEP-related features are covered, and the door is open for joining standard solutions and tools provided by third parties, in the context of the Web and Cloud technologies.