10–14 Oct 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

GRACC: New Generation of the OSG Accounting

11 Oct 2016, 15:30
1h 15m
San Francisco Marriott Marquis

San Francisco Marriott Marquis

Poster Track 7: Middleware, Monitoring and Accounting Posters A / Break

Speakers

Derek John Weitzel (University of Nebraska (US)) Robert Quick (Indiana University)

Description

Throughout the last decade the Open Science Grid (OSG) has been fielding requests from user communities, resource owners, and funding agencies to provide information about utilization of OSG resources. Requested data include traditional “accounting” - core-hours utilized - as well as user’s certificate Distinguished Name, their affiliations, and field of science. The OSG accounting service, Gratia, developed in 2006, is able to provide this information and much more. However, with the rapid expansion and transformation of the OSG resources and access to them, we are faced with several challenges in adapting and maintaining the current accounting service. The newest changes include, but are not limited to, acceptance of users from numerous university campuses, whose jobs are flocking to OSG resources, expansion into new types of resources (public and private clouds, allocation-based HPC resources, and GPU farms), migration to pilot-based systems, and migration to multicore environments. In order to have a scalable, sustainable and expandable accounting service for the next few years, we are embarking on the development of the next-generation OSG accounting service, GRACC, that will be based on open-source technology and will be compatible with the existing system. It will consist of swappable, independent components, such as Logstash, Elasticsearch, Grafana, and RabbitMQ, that communicate through a data exchange. GRACC will continue to interface EGI and XSEDE accounting services and provide information in accordance with existing agreements. We will present the current architecture and working prototype.

Primary Keyword (Mandatory) Accounting and information
Secondary Keyword (Optional) Monitoring

Primary authors

Dr Bo Jayatilaka (Fermi National Accelerator Lab. (US)) Derek John Weitzel (University of Nebraska (US)) Kevin Retzke (Fermilab) Robert Quick (Indiana University) Tanya Levshina

Co-authors

Brian Paul Bockelman (University of Nebraska (US)) Mr Chander Sehgal Frank Wuerthwein (Univ. of California San Diego (US)) Mr Juan Felipe Mosquera Morales (Fermi National Accelerator Lab)

Presentation materials