Nov 4 – 8, 2019
Adelaide Convention Centre
Australia/Adelaide timezone

Third-party transfers in WLCG using HTTP

Nov 5, 2019, 11:15 AM
Riverbank R8 (Adelaide Convention Centre)

Riverbank R8

Adelaide Convention Centre

Oral Track 4 – Data Organisation, Management and Access Track 4 – Data Organisation, Management and Access


Brian Paul Bockelman (University of Nebraska Lincoln (US))


Since its earliest days, the Worldwide LHC Computational Grid (WLCG) has relied on GridFTP to transfer data between sites. The announcement that Globus is dropping support of its open source Globus Toolkit (GT), which forms the basis for several FTP client and servers, has created an opportunity to reevaluate the use of FTP. HTTP-TPC, an extension to HTTP compatible with WebDAV, has arisen as a strong contender for an alternative approach.

In this paper, we describe the HTTP-TPC protocol itself, along with the current status of its support in different implementations, and the interoperability testing done within the WLCG DOMA working group’s TPC activity. This protocol also provides the first real use-case for token-based authorisation. We will demonstrate the benefits of such authorisation by showing how it allows HTTP-TPC to support new technologies (such as OAuth, OpenID Connect, Macaroons and SciTokens) without changing the protocol. We will also discuss the next steps for HTTP-TPC, improving documentation and plans to use the protocol for WLCG transfers.

Consider for promotion No

Primary authors

Paul Millar Andrea Ceccanti (Universita e INFN, Bologna (IT)) Fabrizio Furano (CERN) Dmitry Litvintsev (FNAL) Brian Paul Bockelman (University of Nebraska Lincoln (US)) Alessandra Forti (University of Manchester (GB))

Presentation materials