INFN/CERN on LLM as a Service

→ Europe/Zurich
31/S-028 (CERN)

31/S-028

CERN

30
Show room on map
Description

INFN CERN Exchange on LLM as a Service

Zoom Meeting ID
65615091604
Host
Juan Manuel Guijarro
Useful links
Join via phone
Zoom URL
    • 09:00 → 10:00
      Welcome and objectives 1h
      • Introduction by INFN (30 mins)
      • Introduction by CERN ML team (30 mins)
    • 10:00 → 10:30
      Coffee break 30m
    • 10:30 → 12:30
      ALICE visit 2h
    • 12:30 → 13:30
      Lunch Break 1h
    • 13:30 → 14:30
      Infrastructure and model serving 1h
      • GPU resources, deployment architecture, model selection, inference frameworks, scaling, and resource sharing.
      • Authentication, permissions, handling sensitive information, logging, and conditions for using external versus locally hosted models.
      • Discussion on Monitoring, availability, user support, quotas, usage accounting, and evaluating model quality, latency, and efficiency.
    • 14:30 → 15:00
      Coffee break 30m
    • 15:00 → 16:30
      Demonstrations and technical exchange 1h 30m
      • Short demonstrations from both teams, practical lessons learned, and discussion of retrieval-augmented generation (RAG) and API integration.
      • Identify shared interests, possible joint tests or benchmarks, contact persons, and follow-up actions.
    • 16:30 → 18:30