149557 Conferences false [["minutes", "Minutes"], ["notes", "Notes"], ["paper", "Paper"], ["poster", "Poster"], ["slides", "Slides"], ["summary", "Summary"]] Brookhaven National Laboratory (US) jd@bnl.gov 22874 chep2012@bnl.gov CHEP False New York City, NY, USA

2012-05-21T06:00:00 2012-05-25T18:00:00 2011-08-02T14:01:11 2012-06-19T20:27:46 US/Eastern Unknown mernst@bnl.gov CERN dirk.duellmann@cern.ch 131 false [["minutes", "Minutes"], ["notes", "Notes"], ["paper", "Paper"], ["poster", "Poster"], ["slides", "Slides"], ["summary", "Summary"]] Distributed Processing and Analysis on Grids and Clouds (track 3) 0 Parallel Fermi National Accelerator Laboratory parag@fnal.gov Fermi National Accelerator Laboratory parag@fnal.gov FERMI NATIONAL ACCELERATOR LABORATORY garzoglio@fnal.gov Fermi National Accelerator Lab. (US) burt@fnal.gov Illinois Institute of Technology scarletmars@gmail.com UW Madison zmiller@cs.wisc.edu UW Madison cweiss@cs.wisc.edu Argonne National Laboratory kettimut@mcs.anl.gov University of Chicago lukasz@ci.uchicago.edu Kimmel Center

None

Room 914 2012-05-22T17:25:00 2012-05-22T17:50:00 00:25 Grid computing has enabled scientific communities to effectively share computing resources distributed over many independent sites. Several such communities, or Virtual Organizations (VO), in the Open Science Grid and the European Grid Infrastructure use the glideinWMS system to run complex application work-flows. GlideinWMS is a pilot-based workload management system (WMS) that creates on demand, dynamically-sized overlay Condor batch system on Grid resources. While the WMS addresses the management of compute resources, however, data management in the Grid is still the responsibility of the VO. In general, large VOs have resources to develop complex custom solutions, while small VOs would rather push this responsibility to the infrastructure. The latter requires a tight integration of the WMS and the data management layers, an approach still not common in modern Grids. In this paper we describe a solution developed to address this shortcoming in the context of Center for Enabling Distributed Petascale Science (CEDPS) by integrating glideinWMS with Globus Online (GO). GO is a fast, reliable file transfer service that makes it easy for any user to move data. The solution eliminates the need for the users to provide custom data transfer solutions in the application by making this functionality part of the glideinWMS infrastructure. To achieve this, glideinWMS uses the file transfer plug-in architecture of Condor. The paper describes the system architecture and how this solution can be extended to support data transfer services other than GO when used with Condor or glideinWMS. slides doc http://indico.cern.ch/images/word.png word file ppt http://indico.cern.ch/images/powerpoint.png powerpoint file pdf http://indico.cern.ch/images/pdf_small.png pdf file odt http://indico.cern.ch/images/writer.png writer file odp http://indico.cern.ch/images/impress.png presentation file ods http://indico.cern.ch/images/calc.png spreadsheet file other http://indico.cern.ch/images/file_small.png unknown type file link http://indico.cern.ch/images/link.png link 0 http://cdsweb.cern.ch/record/1460681 link http://cdsweb.cern.ch/record/1460681 doc http://indico.cern.ch/images/word.png word file ppt http://indico.cern.ch/images/powerpoint.png powerpoint file pdf http://indico.cern.ch/images/pdf_small.png pdf file odt http://indico.cern.ch/images/writer.png writer file odp http://indico.cern.ch/images/impress.png presentation file ods http://indico.cern.ch/images/calc.png spreadsheet file other http://indico.cern.ch/images/file_small.png unknown type file link http://indico.cern.ch/images/link.png link 2013-05-23 2013-05-24