23–27 Mar 2015
Physics Department, Oxford University
Europe/London timezone

Getting the most from the farm at the Sanger Institute

23 Mar 2015, 16:55
25m
Martin Wood Lecture Theatre, Parks Road (Physics Department, Oxford University)

Martin Wood Lecture Theatre, Parks Road

Physics Department, Oxford University

End-User IT Services & Operating Systems End-user Services and Operating Systems

Speaker

Mr Emyr James (Wellcome Trust, Sanger Institute)

Description

The Wellcome Trust Sanger Institute is a charitably funded genomic research centre. A leader in the Human Genome Project, it is now focused on understanding the role of genetics in health and disease. Large amounts of data is produced at the institute by next-generation sequencing machines. The data is then stored, processed and analysed on the institute's computing cluster. The main compute farm has 14,000 cores and has of the order of 20PB of storage in a mix of NFS, lustre and iRODS. Two of the main challenges from a systems administration point-of-view is helping the users to get the best out of the computing resources available and to manage their storage use effectively We present examples of how the human genetics informatics team is providing tools and reports to facilitate this effort. On the compute side we generate a weekly usage report which is used as a point of discussion in a standup style meeting of the user community, and on the storage side we discuss tools we have developed which provide an easy visualisation of utilisation using treemaps.

Primary author

Mr Emyr James (Wellcome Trust, Sanger Institute)

Co-author

Dr Joshua Randall (Wellcome Trust, Sanger Institute)

Presentation materials