Description
Software development tools for distributed computing (1/2) (90 mins)
Rosa M. Badia (BSC), Andre Merzky (CCT LSU), Krzysztof Kurowski (PSNC)
The rise of Virtualized and Distributed infrastructures and the emergence of multi-core processing capabilities have led to a new challenge to accomplish - the effective use of compute resources through the design and orchestration of distributed applications. This skill was once considered to preserve high performance and parallel computing, but the new high throughput computing infrastructures offer substantial capacity to support user needs for scalability and agility. As legacy, monolithic applications are replaced with service oriented applications, questions arise about the key steps to be taken in architecture and design to maximize the usefulness of the infrastructures and what lesson can be learned from industry leaders in the design of distributed applications. The workshop aims at bringing some clarity to the challenge of developing distributed applications, a clear understanding of the tools available to support the software designer and the collection of the best practices across European community.
The workshop proposed includes two sessions; each session introduces a topic emphasizing the adherence to standards and give practical examples of use also from industry to strengthen the relevance for a broad audience. The first session covers the DRMAA OGF standard from a use case driven point of view. It covers both, industrial and academic/research experience on using the submission and control of jobs Standard, providing an opportunity for academic and industry participants not only to get familiar with the standard, but also to actively join the session within a tutorial, to rise their awareness of creating good applications for submitting and controlling jobs in a distributed environment.
The workshop continues with a talk on the SAGA OGF standard; the aim is to discuss in particular the SAGA API as an effective way of developing distributed applications. The salient features of the API and several real examples of distributed applications and tools that have been developed using SAGA are going to be highlighted. The first session end with a description of the ETICS Test System. The ETICS System is an advanced build and test system designed to facilitate the management of complex distributed software in general and grid software in particular. The ETICS Multi-Node feature allows users to automate the deployment of tests spanning multiple nodes handling their communication and synchronization. The presentation describes how to exploit this feature to perform standard compliance and interoperability tests of distributed software. Some practical examples will be given based on our experience in testing different BES implementations.
The second session analyses the multicore and GPU programming; while for many years Graphics Processing Unit was only used to perform graphical operations, a new trend of using GPU for handling computation traditionally performed by CPU is arising. Similarly, new multicore processor devices had appeared in the recent years, becoming a revolution in the way computation have been done since now. Both approaches, multicore and GPUs, require right now additional effort from programmers. The session will cover trends in programming for these two new approaches to computation and show potential usage in distributed environments.
Agenda:
16:00-16:10 Welcome and Introduction - key objectives and expected outcomes, Chair of the Community Outreach Seminar
16:10-17:30 Programming with DRMAA and SAGA Krzysztof Kurowski, Poznan Supercomputing and Networking Center, Poland; Andre Merzky, CCT, Louisana State University, USA
• Introduction and DRMAA overview, Krzysztof Kurowski, Poznan Supercomputing and Networking Center, Poland
• DRMAA - Experience from collaboration with Fedstage System, Pawel Lichocki, Poznan Supercomputing and Networking Center, Poland
• SAGA standards landscape (Thilo Kielmann)
• SAGA applications (Shantenu Jha)
17:30-18:00 Validation of standard compliance and interoperability of grid software using the ETICS Test System, Lorenzo Dini, CERN
18:00-19:00 Multicore and GPU programming Rosa M. Badia, Barcelona Supercomputing Center, Spain
• Multicore programming environments, CellSs and SMPSs, Rosa M. Badia, Barcelona Supercomputing Center, Spain
• GPU programming with CUDA, Antonino Tumeo, Politecnico di Milano
Location: Galilei
