CMS data distributed analysis with CRAB3

13 Apr 2015, 17:30
15m
B250 (B250)

B250

B250

oral presentation Track4: Middleware, software development and tools, experiment frameworks, tools for distributed computing Track 4 Session

Speaker

Marco Mascheroni (Universita & INFN, Milano-Bicocca (IT))

Description

The CMS Remote Analysis Builder (CRAB) provides the service for managing analysis tasks isolating users from the technical details of the distributed Grid infrastructure. Throughout the LHC Run 1, CRAB has been successfully employed by an average 350 distinct users every week executing about 200,000 jobs per day. In order to face the new challenges posed by the LHC Run 2, CRAB has been significantly re-factored. The pieces of the new system are a lightweight client, a central server exposing a REST interface accepting user requests, a number of servers dealing with user analysis tasks and submitting jobs to the CMS resource provisioning system, and a central service to asynchronously move user data from the execution node to the desired storage location. The new system improves the robustness, scalability and sustainability of the service. This contribution will give an overview of the new system, reporting the status, experience and lessons learnt from the commissioning phase and the production rollout for the initial data taking. It will address all aspects of the project from development to operations and support.

Primary author

Marco Mascheroni (Universita & INFN, Milano-Bicocca (IT))

Co-authors

Andres Jorge Tanasijczuk (Univ. of California San Diego (US)) Anna Elizabeth Woodard (University of Notre Dame (US)) Brian Paul Bockelman (University of Nebraska (US)) Diego Ciangottini (Universita e INFN (IT)) Dr Eric Vaandering (Fermi National Accelerator Lab. (US)) Hassen Riahi (CERN) Jose Hernandez Calama (Centro de Investigaciones Energ. Medioambientales y Tecn. - (ES) Justas Balcas (Vilnius University (LT)) Matthias Wolf (University of Notre Dame (US)) Mohd Nizam Bin Yusli (University of Malaya (MY)) Preslav Borislavov Konstantinov (Bulgarian Academy of Sciences (BG)) Stefano Belforte (Universita e INFN (IT))

Presentation materials