Oct 10 – 14, 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Expanding the user base beyond HEP for the Ganga distributed analysis user interface

Oct 13, 2016, 12:15 PM
GG C2 (San Francisco Mariott Marquis)


San Francisco Mariott Marquis

Oral Track 3: Distributed Computing Track 3: Distributed Computing


Dr Robert Andrew Currie (Imperial College Sci., Tech. & Med. (GB))


This talk will present the result of recent developments to support new users from the Large Scale Survey Telescope (LSST) group on the GridPP DIRAC instance. I will describe a workflow used for galaxy shape identification analyses whilst highlighting specific challenges as well as the solutions currently being explored. The result of this work allows this community to make best use of available computing resources.

The LSST workflow is CPU limited, producing a large amount of highly distributed output which is managed and collected in an automated way for the user. We have made use of the Ganga distributed analysis user interface to manage physics-driven workflows with large numbers of user generated jobs.

I will also present the successes of working with a new user community to take advantage of HEP related computing resources as this community migrates to make use of a more distributed computing environment.

Primary Keyword (Mandatory) Experience/plans from outside experimental HEP/NP
Secondary Keyword (Optional) Outreach
Tertiary Keyword (Optional) Preservation of analysis and data

Primary authors

Dr Robert Andrew Currie (Imperial College Sci., Tech. & Med. (GB)) Ulrik Egede (Imperial College Sci., Tech. & Med. (GB))


Alexander John Richards (Imperial College Sci., Tech. & Med. (GB)) Mark Slater (Birmingham University) Dr Matt Williams (University of Birmingham (GB))

Presentation materials