ADC Weekly

→ Europe/Zurich
3196/R-023 (CERN)

3196/R-023

CERN

15
Show room on map
Alessandro Di Girolamo (CERN), Andrej Filipcic (Jozef Stefan Institute (SI))
https://indico.cern.ch/event/307176/
minutes


------>>>>> MC and Group production status and news 2

Andrej: 400M FS is single core mc11
Emmanoueli: the 400M FS is full chain, new MC, not only simul.

good to have estimate (even with the disclaimer!) ! can we try also the diskspace? Jose said he will.

------>>>>> DPD prod:
need to finalize the cache, failed today.
2 trains, one slow (not really data reduction but similar to this) one fast (similar how it will be the xAOD) .
mainly one/two week of workload. but important to get it done when is submitted.

------>>>>> Rucio migration - status update
DRChecker: we will evaluate with AA if it's easy to migrate or if we just drop it. we have to update the info in the monitoring ticket.
 https://its.cern.ch/jira/browse/ADCMONITOR-316

------>>>>> Pilot
FAX are calculated in popularity , but are they calculated properly? the storage is remote, is not the "local" storage… to be checked by Paul.
--> agreed Paul will release the pilot today.


------>>>>> Exporting system libraries for ATLAS on special facilities


slide3:
1option what's the difference respect to today?
2option 3 bullet: which CVMFS release? will it be fixed?
3option: will you link to specific versions?


cernVM with all the lib installed, the best option would be to re-use this approach with parrot.

Andrej: slide6 very heavy solutions, in sys like ubuntu. slide4 is the direction to go.
AleDS: indeed. we all agree.

AleDS will send email to ADC dev to discuss this in a dev meeting to be ready for a proposal for the SW week.

------>>>>> ADCoS report
data loss in MPPMU:
instructions to clean dark data: we will make an email and a presentation next week to re-explain

- BNL DDM TEST needs to be updated in the DQ2 DB

------>>>>> Reprocessing
Alastair: the overlay is on data or mc? most probably data, but Alastair will ask Bruno/Till

------>>>>>
AOB:
IN2P3-CC noticed too much pressure from pilot factory when no activity-- to be discussed with Jose/John/Peter .
Ranking of sites: could it be that if a site is not running because of lack of jobs then the ones that are running are preferred to run also the "few" jobs in the pipeline/submitted just after?
not clear from https://twiki.cern.ch/twiki/bin/view/PanDA/PandaBrokerage . We will ask Tadashi


DAST: Farida many complains from users because we can access log files.
Ale: could it be that it was the blue pandamon? the blue doesn't work, the pink does… if not, please send us an email.

Frontier: intervention on both BNL and IN2P3-CC the 6th. IN2P3-CC can postpone, thanks.
There are minutes attached to this event. Show them.
    • 15:40 → 16:00
      MC and Group production status and news 20m
      Speakers: Claire Gwenlan (University of Oxford (GB)), Jose Enrique Garcia Navarro (Instituto de Fisica Corpuscular (ES)), Nurcan Ozturk (University of Texas at Arlington (US)), Paul James Laycock (University of Liverpool (GB)), Wolfgang Ehrenfeld (Universitaet Bonn (DE))
      DPD production
      MC Production
    • 16:00 → 16:25
      Hot topics
      • 16:00
        Rucio migration - status update 10m
        Speakers: David Cameron (University of Oslo (NO)), Tomas Kouba (Acad. of Sciences of the Czech Rep. (CZ)), Vincent Garonne (CERN)
        Slides
      • 16:10
        pilot news 5m
        Speaker: Paul Nilsson (University of Texas at Arlington (US))
        Slides
    • 16:25 → 16:40
      Exporting system libraries for ATLAS on special facilities 15m
      Speakers: Alessandro De Salvo (Universita e INFN, Roma I (IT)), Robert William Gardner Jr (University of Chicago (US))
    • 16:40 → 16:55
      AMOD/ADCoS report 15m
      Slides
    • 16:55 → 17:00
      Reprocessing status 5m
      Speakers: Bruno Lenzi (CERN), David Michael South (Deutsches Elektronen-Synchrotron (DE))
      Reprocessing Activities, 29/04/2014
        Bruno Lenzi, Till Eifert, David South

      *** 2010 MinBias reprocessing
        - reco 99% done, 3 jobs waiting for intervention
          (https://savannah.cern.ch/bugs/index.php?104376)
        - AOD merging and TAG production running
        - DESD_MBIAS processing almost done, merging running

      *** DESD_ZMUMU reprocessing: done
        - Renaming from ESD to DESD_ZMUMU requested, under discussion by ADC experts
        - http://savannah.cern.ch/bugs/?104331

      *** RPVLL reprocessing: reco done, merging 99% done
        - Merging issues to be clarified
        - Validation progressing well for other periods, should be done by next week
        - Data transfers to exotics group ongoing, still waiting to hear from tau CP

      *** (Possible) reprocessing request: ZeroBias overlay for JetEtMiss
        - 75M events
        - Will be discussed on OAB on Monday

      *** AOD2AOD reprocessing
        - To follow up with ProdSys2 and TF4

      *** Conditions
        - RUN1-05 not yet validated for 2011
        - To follow up change of database, probably will not be used in the DC14 reprocessing

      *** DQ
        - HIST production from AOD works in 17.2, output needs to be validated
        - To follow up for rel 19


      Just to complete, there was also an issue with lost AODs, during a period when there was only one replica (soon after the datasets had been created).
      We were requested to resubmit a few tasks:

      data12_8TeV.00201006.physics_Egamma.recon.AOD.r4644_tid01295268_00
      data12_8TeV.00213250.physics_JetTauEtmiss.recon.AOD.r4065_tid01204572_00
      data12_8TeV.00204025.physics_HadDelayed.recon.AOD.r4487_tid01250831_00
      data12_8TeV.00206971.physics_HadDelayed.recon.AOD.r4487_tid01250850_00
      data12_8TeV.00212858.physics_HadDelayed.recon.AOD.r4487_tid01248367_00
      data12_8TeV.00201289.physics_JetTauEtmiss.recon.AOD.r4644_tid01295183_00
    • 17:00 → 17:05
      AOB 5m
      • network reports (if any)
        - for T2(D)s against T1s - for T1s against T2Ds
      • Analysis Availability Reports