HEPiX Spring 2015 Workshop

Getting the most from the farm at the Sanger Institute

23 Mar 2015, 16:55

25m

Martin Wood Lecture Theatre, Parks Road (Physics Department, Oxford University)

End-User IT Services & Operating Systems End-user Services and Operating Systems

Speaker

Mr Emyr James (Wellcome Trust, Sanger Institute)

Description

The Wellcome Trust Sanger Institute is a charitably funded genomic research centre. A leader in the Human Genome Project, it is now focused on understanding the role of genetics in health and disease. Large amounts of data is produced at the institute by next-generation sequencing machines. The data is then stored, processed and analysed on the institute's computing cluster. The main compute farm has 14,000 cores and has of the order of 20PB of storage in a mix of NFS, lustre and iRODS. Two of the main challenges from a systems administration point-of-view is helping the users to get the best out of the computing resources available and to manage their storage use effectively We present examples of how the human genetics informatics team is providing tools and reports to facilitate this effort. On the compute side we generate a weekly usage report which is used as a point of discussion in a standup style meeting of the user community, and on the storage side we discuss tools we have developed which provide an easy visualisation of utilisation using treemaps.

Presentation materials

Slides

hepix_Emyr.pdf