10–14 Oct 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Experience on HTCondor batch system for HEP and other research fields at KISTI-GSDC

13 Oct 2016, 14:30
15m
Sierra B (San Francisco Mariott Marquis)

Sierra B

San Francisco Mariott Marquis

Oral Track 6: Infrastructures Track 6: Infrastructures

Speaker

Sang Un Ahn (KiSTi Korea Institute of Science & Technology Information (KR))

Description

Global Science experimental Data hub Center (GSDC) at Korea Institute of Science and Technology Information (KISTI) located at Daejeon in South Korea is the unique data center in the country which helps with its computing resources fundamental research fields deal with the large-scale of data. For historical reason, it has run Torque batch system while recently it starts running HTCondor for new systems. Having different kinds of batch systems implies inefficiency in terms of resource management and utilization. We conducted a research on resource management with HTCondor for several user scenarios corresponding to the user environments that currently GSDC supports. A recent research on the resource usage patterns at GSDC is considered in this research to build the possible user scenarios. Checkpointing and Super-Collector model of HTCondor give us more efficient and flexible way to manage resources and Grid Gate provided by HTCondor helps interface with Grid environment. The overview on the essential features of HTCondor exploited in this work will be described and the practical examples for HTCondor cluster configuration in our cases will be presented.

Primary Keyword (Mandatory) Computing facilities
Secondary Keyword (Optional) Distributed workload management

Primary author

Sang Un Ahn (KiSTi Korea Institute of Science & Technology Information (KR))

Co-authors

Mr Amol Jaikar (Korea Institute of Science and Technology Information) Mr Byungyun Kong (KISTI Korea Institute of Science & Technology Information (KR)) Ilyeon Yeo (KiSTi Korea Institute of Science & Technology Information (KR)) Mr Jin Kim (Korea Institute of Science and Technology Information) Sangwook Bae (KiSTi Korea Institute of Science & Technology Information (KR))

Presentation materials