Data Organisation, Management and Access (DOMA) in Astronomy, Genomics and High Energy Physics

Name: Data Organisation, Management and Access (DOMA) in Astronomy, Genomics and High Energy Physics
Start: 2017-11-16T08:30:00-05:00
End: 2017-11-17T22:10:00-05:00
Location: No location set

16 Nov 2017, 08:30 → 17 Nov 2017, 22:10 America/New_York

Carlos Maltzahn (University of California, Santa Cruz), Ian Fisk (Simons Foundation), Peter Elmer (Princeton University (US))

Description

This workshop will focus on the current research practices and future needs for Data Organization, Management and Access (DOMA) across the fields of Astronomy, Genomics and High Energy Physics. We will discuss and identify possibilities for integration across the different fields, as well as opportunities for common research and development activities.

The workshop will take place on 16-17 Nov, 2017 at the Flatiron Institute (Simons Foundation) in New York City.

Live Notes

Breakout session documents: Hearts, Diamonds, Clubs

Slide deck of all meeting participants and their introductions/interests

Group photo (click for larger version):

Sponsors

This event is being jointly organised by the S2I2-HEP Conceptualization project and by the Flatiron Institute (Simons Foundation), including travel support for some participants. The S2I2-HEP project is supported by National Science Foundation grants ACI-1558216, ACI-1558219, and ACI-1558233.

Thursday 16 November
- Thu 16 Nov
- Fri 17 Nov
- 08:30 → 09:00
  
  Breakfast 30m
- 09:00 → 09:10
  
  Workshop Introduction 10m
  
  Speakers: Carlos Maltzahn (University of California, Santa Cruz), Ian Fisk (Fermi National Accelerator Lab. (US)), Peter Elmer (Princeton University (US))
- 09:10 → 09:30
  
  DOMA for the Large Synoptic Survey Telescope (LSST) 20m
  
  Speaker: Donald Petravick (U)
  
  DP-Flatiron-Institute.pdf
  
  DP-Flatiron-Institute.pptx
- 09:50 → 10:10
  
  Experience with Genomics multi-PB sample 20m
  
  Speaker: Natalia Volfovsky (Simons Foundation)
  
  DOMA_workshop_Natalia.pdf
  
  DOMA_workshop_Natalia.pptx
- 10:30 → 11:00
  
  Coffee Break 30m
- 11:05 → 11:20
  
  Deep Learning Astronomical Survey Data 15m
  
  Speaker: Shawfeng Dong (University of California at Santa Cruz)
  
  Deep_Learning_DOMA.pdf
- 11:30 → 11:50
  
  DOMA in High Energy Physics 20m
  
  Speaker: Oliver Gutsche (Fermi National Accelerator Lab. (US))
  
  171116 - DOMA workshop - HEP Data Management Introduction.pdf
  
  LHC Movie
- 12:05 → 12:25
  
  Data Management for XENON1T and South Pole Telescope 20m
  
  Speaker: Dr Benedikt Riedel (University of Chicago)
  
  2017.11.16 S2I2-Simons Foundation Data Management.pdf
  
  Data Management for XENON1T and South Pole Telescope
- 12:30 → 13:30
  
  Lunch 1h
- 13:30 → 13:45
  
  Analysis of Data Handling of Astronomy Simulation 15m
  
  Speaker: Shy Genel (Flatiron Institute)
  
  DOMA slides Genel public.pdf
  
  DOMA slides Genel public.pptx
- 13:55 → 14:20
  
  Current practices and challenges of genomics in the cloud 25m
  
  Speaker: Brian O'Connor (University of California at Santa Cruz)
  
  20171116-BOConnor-DOMA-New-York.pdf
  
  google slides
- 14:30 → 14:45
  
  Analysis of Observational Data in Astronomy 15m
  
  Speaker: Lauren Anderson (Flatiron Institute)
  
  DOMA_Anderson.pdf
- 15:00 → 15:15
  
  DOMA R&D for the High-Luminosity Large Hadron Collider (HL-LHC) 15m
  
  Speaker: Maria Girone (CERN)
  
  DOMA_Talk.pdf
  
  DOMA_Talk.pptx
- 15:30 → 16:00
  
  Coffee Break 30m
- 16:00 → 16:15
  
  SkyhookDB: Leveraging object storage toward database elasticity in the cloud. 15m
  
  Speaker: Jeff Lefevre (University of California at Santa Cruz)
  
  google slides
  
  jlefevre-skyhookdb-20171116-flatiron.pdf
- 16:15 → 16:35
  
  From Data Federations to Data Lakes 20m
  
  Speaker: Brian Paul Bockelman (University of Nebraska Lincoln (US))
  
  DataFederationsToDataLakes.pdf
- 16:35 → 16:50
  
  Data Management with Columnwise Stores 15m
  
  Speaker: Jim Pivarski (Princeton University)
  
  pivarski-columnwise.pdf
- 16:50 → 17:05
  
  Multi-Institutional Open Storage Research InfraStructure (MI-OSiRIS) 15m
  
  Speaker: Shawn Mc Kee (University of Michigan (US))
  
  DOMA-OSiRIS-ShawnMcKee.pdf
  
  DOMA-OSiRIS-ShawnMcKee.pptx
- 18:00 → 22:00
  
  Social Dinner - Merakia, 5 West 21st St 4h
  
  https://www.merakia.com/
Friday 17 November
- Thu 16 Nov
- Fri 17 Nov
- 08:30 → 09:00
  
  Breakfast 30m
- 09:00 → 09:20
  
  Ceph successes and challenges with open source distributed storage 20m
  
  Speakers: Carlos Maltzahn (University of California, Santa Cruz), Sage Weil (Redhat)
  
  20171116-CM-DOMA.pptx.pdf
- 09:20 → 09:40
  
  A perspective on the challenges and opportunities of data management and sharing 20m
  
  Speaker: H. Birali Runesha (University of Chicago)
  
  DOMA_Flatiron_Institute_Nov17.pdf
- 09:40 → 09:55
  
  Research Data in the Cloud 15m
  
  Speaker: Kevin Jorissen (Amazon Web Services)
  
  NYC - Research Data - Jorissen - 11.16.2017.pdf
  
  NYC - Research Data - Jorissen - 11.16.2017.pptx
- 09:55 → 10:10
  
  Storage-class memory (SCM)-centric Systems Paradigm 15m
  
  General purpose CPU-centric architectures and interfaces are becoming a limiting factor in the age of big data and Compute-intensive applications. A paradigm shift to storage-class memory (SCM) at the center approach, with magnitudes of order in expandable capacity, attached to heterogeneous computation devices, through modern interfaces, can be tailored for purpose-built solutions.
  
  Speaker: Shaun Astarabadi (Western Digital)
  
  SCM-Centric-Systems-DOMA-Nov2017.pdf
- 10:15 → 10:30
  
  Sciunits: Reusable Research Objects 15m
  
  Speaker: Tanu Malik (Depaul University)
  
  HEP-DOMA.pdf
- 10:30 → 11:00
  
  Coffee Break 30m
- 11:00 → 12:30
  
  Breakout Sessions 1h 30m
- 12:30 → 13:30
  
  Lunch 1h
- 13:30 → 14:30
  
  Breakout Sessions 1h
- 14:30 → 15:30
  
  Summary session 1h

Choose timezone

Data Organisation, Management and Access (DOMA) in Astronomy, Genomics and High Energy Physics