2–6 Mar 2009
Le Ciminiere, Catania, Sicily, Italy
Europe/Rome timezone

Grid Interoperation: SRM-SRB Development

3 Mar 2009, 11:00
20m
Raffaello (80) (Le Ciminiere, Catania, Sicily, Italy)

Raffaello (80)

Le Ciminiere, Catania, Sicily, Italy

Viale Africa 95100 Catania
Oral Grid Services exploiting and extending gLite middleware Data Management

Speaker

Mr Wei-Long Ueng (Academia Sinica Grid Computing)

Description

Storage Resource Manager (SRM) is based on a common interface specification, which is a widely adopted interface to the storage management system of production grids currently. With the heterogeneity of the Grid, the best way to share data is to integrate data sources through SRM. In this project, the SRM services for SRB is developed, to make the popular SRB data grid system interoperable with the EGEE infrastructure and support the SRM services for SRB, such as space reservation and VO support etc.

URL for further information

http://lists.grid.sinica.edu.tw/apwiki/SRM-SRB

Keywords

Grid Interoperability, Data Grid, Storage Element, Storage Resource Manager, Storage Resource Broker

Conclusions and Future Work

In this project, we built on a GridFTP server, an AMGA Server developed for SRB, to make an SRB look like a Classic Storage Element. This allowed the gLite tools to transfer files between SRMs and SRBs. Thus gLite is able to take advantage of SRB federation among different administrative zones. The roadmap of this project is to implement the SRM functions for SRB based on SRM v2.2 at the first phase. Next, the interoperation between SRB and DPM, dCache, Castor, etc. will be realized.

Detailed analysis

The standard SRM services for SRB were developed to make the popular SRB data grid system interoperable with the gLite e-infrastructure. AMGA is used to implement the File catalog and to provide uniform interface for replication management and to the backend database. In the first phase, targeted use cases are to: 1) Make SRB an archival system of gLite-based e-Infrastructure, 2) Support flexible lifetime policy for files - volatile, durable, and permanent, and 3) Impose the VO-based resource policy and security control to SRB as the Grid infrastructure. Other than the basic directory, permission and data access functions, user authorization, web service interface, GridFTP deployment, and SRB-DSI have been implemented.

Impact

SRM and SRB are both ways of accessing the storage available on a grid—either using tapes, disks or disk arrays. Usually, storage elements running SRB can’t be seen by a grid running SRM, and vice versa. Most grids run one or the other technology, but if different grids are to interoperate, the two standards need to work together. File exchange between gLite and SRB is enabled. We used the GridFTP protocol and advanced data management tools from the EGEE project to transfer data between SRM and SRBs. The core middleware position of gLite is enforced by the uniform SRM interfaces to major mass storage systems and even data grid system like SRB. The specification of SRM is further endorsed and outreached. Dynamic space reservation and VO support capabilities are imposed onto SRB. This interoperation between the two most commonly deployed data solutions, SRM and SRB, achieved by this project, is a great step forward towards achieving at pragmatic solutions for achieving interoperation.

Authors

Mr Fu-Ming Tsai (Academia Sinica Grid Computing) Mr Wei-Long Ueng (Academia Sinica Grid Computing)

Co-authors

Mr Eric Yen (Academia Sinica Grid Computing) Mr Ethan Lin (Academia Sinica Grid Computing) Mr Hsin-Yen Chen (Academia Sinica Grid Computing) Dr Simon Lin (Academia Sinica Grid Computing)

Presentation materials