-- HarryRenshall - 10 May 2010

Experiment and Tier 0+1 Site Service Challenge Resource Requirements and Capacity up to 2009. From 2010 the C-RSG Approved and Installed Tier 0+1 Capacities.

Last Updated 3.12.2010: Change 4Q2010 attached 'Capacity Available and Required' spreadsheet with revised November installed values from PIC and add 1Q2010 (initially a copy of 4Q2010.

Updated 8.11.2010: Change 4Q2010 attached 'Capacity Available and Required' spreadsheet with revised October installed values from PIC.

Updated 8.10.2010: Change 3Q2010 attached 'Capacity Available and Required' spreadsheet with revised September installed values from PIC and add 4Q2010 initially as a copy of 3Q2010.

Updated 13.09.2010: Update 3Q2010 attached 'Capacity Available and Required' spreadsheet with changes from ASGC, PIC, IN2P3, NL-T1, RAL and BNL.

Updated 10.08.2010: Add 3Q2010 attached 'Capacity Available and Required' spreadsheet with installed values reported to the MB of 13 July 2010.

Updated 5.07.2010: Change 2Q2010 attached 'Capacity Available and Required' spreadsheet with revised June installed values from PIC.

Updated 8.06.2010: Change 2Q2010 attached 'Capacity Available and Required' spreadsheet with revised May installed values from PIC.

Updated 10.05.2010: Add table of 2Q2010 Tier 0 and 1 site shares offered (to be installed by 1 June 2010) and also the C-RSG approved experiment requirement values normalised to sum to 100% of the experiment requests.

Updated 02.03.2010: Change 1Q2010 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 17.02.2010: Correct rounding errors in the site shares in the 'Capacity Available and Required' spreadsheets for 4Q2009 and 1Q2010.

Updated 09.02.2010: Add table of 2Q2009 to 1Q2010 Tier 1 site shares offered as a percentage of experiment requests and also the values normalised to sum to 100% of the experiment requests. These normalised percentages were used to attribute the site shares of the CRSG approved total Tier-1 site resources as laid out in the attached 2Q2009 to 1Q2010 'Capacity Available and Approved' spreadsheets.

Updated 08.02.2010: Change 4Q2009 attached 'Capacity Available and Required' spreadsheet to show 'Capacity Available and Approved' showing the resources approved for 2009/10 by the Autumn 2009 CRRB. CPU values are still in KSi2K. Also add the 1Q2010 spreadsheet with the same values except the CPU values are in HEP-SPEC06. Note that the 2010 capacity increases are due on 1 June rather than the usual 1 April.

Updated 07.01.2010: Change 4Q2009 attached 'Capacity Available and Required' spreadsheet with revised installed values from NL-T1 and PIC.

Updated 14.12.2009: Change 4Q2009 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 06.11.2009: Add 4Q2009 attached 'Capacity Available and Required' spreadsheet. Requirements and pledges are those approved in the Autumn 2008 C-RRB. Revised 2009 requirements are awaiting C-RRB approval. Installed capacity updates from September 2009. cpu is in KSi2K.

Updated 12.10.2009: Update 3Q2009 attached 'Capacity Available and Required' spreadsheet. Requirements and pledges are those approved in the Autumn 2008 C-RRB. Revised 2009 requirements are awaiting C-RRB approval. Installed capacity updates from September 2009. cpu is in KSi2K.

Updated 10.8.2009: Add 3Q2009 attached 'Capacity Available and Required' spreadsheet. Requirements and pledges are still those for 2008/9 since full 2009 pledge installations are not due till September 2009 and revised 2009 requirements are awaiting C-RSG review and C-RRB approval.

Updated 13.7.2009: Change 2Q2009 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 08.6.2009: Add 2Q2009 attached 'Capacity Available and Required' spreadsheet. Pledges and experiment requirements stay those from April 2008 for now. Full 2009/10 pledges due for installation by September 2009 and experiment requirements may change in agreement with the C-RRB.

Updated 20.4.2009: Change 1Q2009 attached 'Capacity Available and Required' spreadsheet with revised installed values from NL-T1 (allocated disk increase).

Updated 9.2.2009: Change 4Q2008 (for increased NL-T1 CPU from October) and 1Q2009 attached 'Capacity Available and Required' spreadsheet with lower installed CPU and DISK values from ASGC due to installation delays (expected availability end February).

Updated 12.1.2009: Change 4Q2008 and 1Q2009 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 9.12.2008: Change 4Q2008 and 1Q2009 attached 'Capacity Available and Required' spreadsheets with revised installed values from ASGC, CNAF and FZK.

Updated 30.10.2008: Change 4Q2008 and 1Q2009 attached 'Capacity Available and Required' spreadsheets with revised installed values from NL-T1.

Updated 10.10.2008: Change 3Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 23.09.2008: Change 3Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from ASGC, CERN, IN2P3,RAL and NL-T1. Add 4Q2008 spreadsheet with predicted increases to 2008 pledges from IN2P3, FNAL and PIC and add 1Q2009 spreadsheet with predicted increases from ASGC, IN2P3, NL-T1 and BNL.

Updated 8.09.2008: Change 3Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 3.09.2008: Change 3Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from ASGC, IN2P3, FZK, CNAF, RAL and NL-T1.

Updated 8.8.2008: Change 3Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 14.7.2008: Change 2Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from NL-T1 and add first release of 3Q2008 spreadsheet.

Updated 8.7.2008: Change 2Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 24.6.2008: Change 2Q2008 attached 'Capacity Available and Required' spreadsheet with revised allocated values from lcg office accounting feedback.

Updated 9.6.2008: Change 2Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from PIC.

Updated 28.5.2008: Change 2Q2008 attached 'Capacity Available and Required' spreadsheet with revised installed values from CNAF, FZK, NDGF, NL-T1 and PIC.

Updated 29.4.2008: Change 2Q2008 attached 'Capacity Available and Required' spreadsheet with revised (downwards) 2008/9 pledges from RAL.

Updated 7.4.2008: Change 1Q2008 attached 'Capacity Available and Required' spreadsheet with March updates from PIC.

Updated 10.3.2008: Change 1Q2008 and 2Q2008 attached 'Capacity Available and Required' spreadsheets with updates from PIC and TRIUMF.

Updated 12.2.2008: Change 1Q2008 and 2Q2008 attached 'Capacity Available and Required' spreadsheets with updates from NL-T1.

Updated 5.2.2008: Change 1Q2008 and 2Q2008 attached 'Capacity Available and Required' spreadsheets with recent updates from all of the Tier 1 sites.

Updated 8.1.2008: Change 4Q2007 installed resources numbers for PIC.

Updated 6.12.2007: Add new currently installed resources numbers for RAL, FNAL, CNAF and PIC. Change planned installations for 1Q2008 and 2Q2008 for CERN, CNAF, RAL, FNAL and NDGF.

Updated 7.11.2007: Add separate Tier-1 Experiment resource pledges for the period from 1 April 2008 as there are significant changes from 2007. Add 2007/8 Site Capacity Growth Plans as new links in the site plans for ASGC, IN2P3, FZK, BNL, TRIUMF and PIC. Update the 'Capacity available and required' tables attached below for 4Q2007, 1Q2008 and 2Q2008 with these plans. Note that in these tables for the current quarter the installed capacity is that actually deployed while for future quarters the installed capacity is that planned to be deployed by the start (or soon after) of the quarter. Edit PIC installed/allocated capacities for October.

Updated 29.10.2007: Add first version of 2Q2008 'Capacity Available and Required' tables using site pledges for 1 April 2008 and revised experiment resource requirements and site shares.

Updated 05.10.2007: Change 3Q2007 and 4Q2007 'Capacity available and required' tables to update PIC and IN2P3 installed and allocated resources for September 2007 (IN2P3 have added 40% of 2Q2008 Pledges).

Updated 09.08.2007: Change 3Q2007 and 4Q2007 'Capacity available and required' tables to update IN2P3 and PIC installed and allocated resources for July 2007.

Updated 31.07.2007: Change 3Q2007 and 4Q2007 'Capacity available and required' tables to update Tier-0 installed cpu and ALICE Tier-1 requirements on CERN.

Update 16.07.2007: Change 3Q2007 and 4Q2007 'Capacity available and required' tables with updates from IN2P3, PIC, FZK, BNL, CNAF, NDGF and ASGC.

Updated 09.07.2007: Change 2Q2007 'Capacity available and required' tables with June accounting updates from IN2P3, PIC, FZK, BNL, CNAF, NDGF and ASGC.

Updated 05.06.2007: Change 2Q2007 and 3Q2007 'Capacity available and required' tables with reduced LHCb disk requirements at PIC and small installed resources changes at PIC and IN2P3. Add the 4Q2007 table where ALICE requirements over 3Q2007 increase by 33%, ATLAS and CMS stay constant and LHCb CPU requirement drops. Globally 4Q2007 pledges match requirements but the reported installed capacity lags behind.

Updated 25.05.2007: Change the CMS site shares to the 2008 disk pledge values.

Updated 14.05.2007: Add 3Q2007 'Capacity available and required' table which includes the site pledges as from 1 July 2007. Update RAL 2Q2007 values to those reported by site for May since the values for April accounting have now been copied.

Updated 07.05.2007: Change 2Q2007 'Capacity available and required' table with new installed and allocated values for April from IN2P3, RAL and PIC. Note these will be copied into the April accounting on 8 May (this was done).

Updated 30.04.2007: Add comment to 1Q2007 that values are for start of quarter. Later tables will be dynamically updated. For 2Q2007 update SARA-Nikhef disk resources and update site experiment disk allocations from the March accounting returns.

Updated 17.04.2007: FZK revised cpu and tape pledges for 2007/2008 already available at start of 2Q2007.

Updated 10.04.2007: New version of the 2Q2007 'Capacity available and required' table changing the planned 200 TB of installed disk at PIC to the current actual value of 70 TB for feedback into the March accounting. Increases are expected during this quarter. Also correct (down) the ATLAS Tier-0 and CAF 2Q2007 requirements.

Updated 28.3.2007: New versions of the 1Q2007 and 2Q2007 'Capacity available and required' tables. For 1Q2007 the only change was to give the 2006/7 pledges (for up to end June 2006) rather than the 2007/2008 pledges. The 2Q2007 has this change plus some site updates and new values from Alice and LHCb and now reports the installed capacity taken from the January accounting. This is in preparation for these tables to become the definitive ones for installed and allocated (for disk) capacity reports.

Updated 6.3.2007: Add plans for CMS 5-week cycles (started 12 February) and CSA07 (July) and indicators of ALICE p-p (starting April) and LHCb (June-July) dress-rehearsals. Changes done in both experiment and site views but the plans are not thought to imply changes in the 1Q2007 and 2Q2007 experiment resource requirements apart from a transient 5TB per site in March increase in Atlas disk space. A spreadsheet for 3Q2007 is in preparation.

Updated 1.03.2007: Change Atlas shares to values revised in November 2006 as part of the review of the LCG resources 'megatable'. Include detailed Atlas plans, including at the site level, for Feb/March data distribution tests and indicators of later plans.

Updated 09.02.2007: Replace 1Q2007 and 2Q2007 Capacity available and required spreadsheets after site updates at the January workshop and add spreadsheets of the increases. No changes to experiment requirements have yet been made but they are expected to be mostly for extra cpu during service challenges/rehearsals.

Updated 15.01.2007: Move the ATLAS Tier0 export tests from 15 Jan to new preliminary date of end Feb.

Here are the 2006 Twiki UpDates.

The high level experiment plans are here:

AlicePlans

AtlasPlans

CmsPlans

LhcbPlans

CernPlans

CCRC'08 Coordination

Specific information on the CCRC'08 Service Challenge is here in Ccrc08Plans. This includes membership of the coordination team and the current High Level Milestones.

Tier 1 Site Resource Requirements Timetables for 2006/2007/2008

Resource percentages shown here are the approximate averages of the cpu and disk percentages declared by each site/experiment to the LCG project office (see draft revised CERN-LCG-PEB-2005-11 from the LCG Documents page at http://lcg.web.cern.ch/LCG/planning/phase2_resources/P2PRCcaps211007_V2.pdf ) and are shown separately for 2007 and 2008 as there were some large changes. Where experiments have specified different individual Tier 1 resource usage in an activity or globally these numbers have been used and can be seen under the individual experiment and site plans for that activity. For ALICE and CMS the 2008 requirements are underfunded while for ATLAS and LHCb they are overfunded. For ALICE, CMS and LHCb the Tier-1 shares normalised to 100% of the experiments requirements are shown on the experiment and site pages and are used in calculating service challenge data rates and volumes. ATLAS use an internally decided set of shares.

A useful source of information, where the emphasis is on DAQ but with implications on the Tier 1 sites that are included in these pages, can be found in the DAQ Tier0-Tier1 planning document of B.Panzer at https://twiki.cern.ch/twiki/bin/view/Main/DaqTierZeroTierOnePlanning . Calculations of the inter-site data rates (Tier-1 to/from Tier-1 and Tier-2) expected during the 2008 physics run can be found at http://cern.ch/LCG/documents/Megatable240107.xls .

For 2007 and first half of 2008 the cpu and cumulative disk and tape requirements for the currently scheduled production and service challenge activities per quarter per site are presented (see the 'Capacity_Available_and_required' links at the end of this page) in a spreadsheet showing also the LCG 2007/8 planned to be pledged (known per year - taken from the MoU http://lcg.web.cern.ch/LCG/C-RRB/MoU/WLCGMoU.pdf ) and available site resources. Sites and experiments are requested to mail me 'Harry.Renshall@cern.ch' of any innacuracies and with their capacity increase and requirements plans. The experiment requirements are for known activities and do not include those for individual or sub-group members of experiments nor for unscheduled activities such as event reprocessing to validate a new software release or urgent generation of special Monte Carlo samples. Typically these add 10 to 20% to the requirement and site experiment team users should be consulted.

2007/1Q2008 Tier-1 Site resource offers averaging cpu+disk+tape:

SiteASGC-Taiwan.		To provide 6.2% of ATLAS resources	To provide 12% of CMS resources.
SiteBNL-Brookhaven		To provide 23% of ATLAS Resources
SiteCNAF-Bologna	To provide 7% of ALICE Resources	To provide 10% of ATLAS Resources	To provide 16% of CMS resources	To provide 11% of LHCB resources
SiteFNAL-FermiLab			To provide 36% of CMS resources
SiteFZK-Karlsruhe	To provide 20% of ALICE Resources	To provide 10% of ATLAS resources	To provide 12% of CMS resources	To provide 10% of LHCB resources
SiteIN2P3-Lyon	To provide 9% of ALICE resources	To provide 13% of ATLAS Resources	To provide 10% of CMS resources	To provide 27% of LHCB resources
SiteNDGF-Nordic Data Grid Facility	To provide 6% of ALICE Resources	To provide 4.5% of ATLAS Resources
SiteNIKHEF-Amsterdam	To provide 3% of ALICE Resources but no request for 2006	To provide 12.5% of ATLAS Resources		To provide 23% of LHCB Resources
SitePIC-Barcelona		To Provide 4.5% of ATLAS Resources	To provide 6% of CMS resources	To provide 6% of LHCB Resources
SiteRAL-Rutherford Appleton Lab	To provide 1% of ALICE Resources	To provide 12% of ATLAS Resources	To provide 8% of CMS Resources	To provide 15% of LHCB Resources
SiteTRIUMF-Vancouver		To provide 4.3% of ATLAS Resources
SiteUSA-Tier1	To provide 7% of ALICE Resources from 2007

2Q2008/1Q2009 Tier-1 Site resource offers averaging cpu+disk only:

SiteASGC-Taiwan.		To provide 9% of ATLAS resources	To provide 12.5% of CMS resources.
SiteBNL-Brookhaven		To provide 28% of ATLAS Resources
SiteCNAF-Bologna	To provide 7% of ALICE Resources	To provide 4.5% of ATLAS Resources	To provide 8.5% of CMS resources	To provide 16.5% of LHCB resources
SiteFNAL-FermiLab			To provide 35.5% of CMS resources
SiteFZK-Karlsruhe	To provide 25% of ALICE Resources	To provide 10% of ATLAS resources	To provide 10.5% of CMS resources	To provide 17.5% of LHCB resources
SiteIN2P3-Lyon	To provide 9% of ALICE resources	To provide 11% of ATLAS Resources	To provide 10% of CMS resources	To provide 27% of LHCB resources
SiteNDGF-Nordic Data Grid Facility	To provide 12% of ALICE Resources	To provide 5.5% of ATLAS Resources
SiteNIKHEF-Amsterdam	To provide 3.5% of ALICE Resources	To provide 17% of ATLAS Resources		To provide 56% of LHCB Resources
SitePIC-Barcelona		To Provide 5% of ATLAS Resources	To provide 5% of CMS resources	To provide 9% of LHCB Resources
SiteRAL-Rutherford Appleton Lab	To provide 1% of ALICE Resources	To provide 16.5% of ATLAS Resources	To provide 7.5% of CMS Resources	To provide 66.5% of LHCB Resources
SiteTRIUMF-Vancouver		To provide 5% of ATLAS Resources
SiteUSA-Tier1	To provide 7% of ALICE Resources

2Q2009/1Q2010(to June 1 2010) Tier-1 Site resource offers averaging cpu+disk only. Values in brackets are those normalised to sum to 100%:

SiteASGC-Taiwan.		To provide 7 (7)% of ATLAS resources	To provide 15 (16.5)% of CMS resources.
SiteBNL-Brookhaven		To provide 27 (27)% of ATLAS Resources
SiteCNAF-Bologna	To provide 6.5 (10.6)% of ALICE Resources	To provide 5 (5)% of ATLAS Resources	To provide 9.5 (10.5)% of CMS resources	To provide 10.5 (10.5)% of LHCB resources
SiteFNAL-FermiLab			To provide 29 (32)% of CMS resources
SiteFZK-Karlsruhe	To provide 24 (39)% of ALICE Resources	To provide 10 (10)% of ATLAS resources	To provide 11 (12)% of CMS resources	To provide 16.5 (16.5)% of LHCB resources
SiteIN2P3-Lyon	To provide 8 (13)% of ALICE resources	To provide 11 (11)% of ATLAS Resources	To provide 11 (12)% of CMS resources	To provide 27 (27)% of LHCB resources
SiteNDGF-Nordic Data Grid Facility	To provide 9.5 (15.5)% of ALICE Resources	To provide 4.5 (4.5)% of ATLAS Resources
SiteNIKHEF-Amsterdam	To provide 5 (8.1)% of ALICE Resources	To provide 16 (16)% of ATLAS Resources		To provide 25 (25)% of LHCB Resources
SitePIC-Barcelona		To Provide 4 (4)% of ATLAS Resources	To provide 6 (7)% of CMS resources	To provide 6 (6)% of LHCB Resources
SiteRAL-Rutherford Appleton Lab	To provide 1.5 (2.5)% of ALICE Resources	To provide 10.5 (10.5)% of ATLAS Resources	To provide 9.5 (10)% of CMS Resources	To provide 15 (15)% of LHCB Resources
SiteTRIUMF-Vancouver		To provide 5 (5)% of ATLAS Resources
SiteUSA-Tier1	To provide 7 (11)% of ALICE Resources

• Tier1_Capacity_Jan_2007_workshop_increases_and_Required_1Q2007.xls: Tier 1 Capacity increases from Jan 2007 workshop and Requirements 1Q2007

• Tier_1_Capacity_Jan_2007_workshop_increases_and_Required_2Q2007.xls: Tier 1 Capacity increases from Jan workshop and requirements 2Q2007 (NB: requirements part now out of date - new values are in 2Q2007 spreadsheet).

• Tier1_Capacity_Available_and_Required_1Q2007.xls: Tier 1 Capacity and Requirements 1Q2007 updated after Jan 2007 workshop. Pledges are those till June 2007.

• Tier_1_Capacity_Available_and_Required_2Q2007.xls: T1 Capacity and requirements 2Q2007 updated after Jan 2007 workshop and for new MB reporting.

• Tier_1_Capacity_Available_and_Required_3Q2007.xls: T1 Capacity and requirements 3Q2007. Pledges are those from 1 July 2007.

• Tier_1_Capacity_Available_and_Required_4Q2007.xls: T1 Capacity and requirements 4Q2007. Pledges are those from 1 July 2007.

• Tier_1_Capacity_Available_and_Required_1Q2008.xls: T1 Capacity and requirements 1Q2008. Pledges are those from 1 July 2007.

• Tier_1_Capacity_Available_and_Required_2Q2008.xls: T1 Capacity and requirements 2Q2008. Pledges are those from 1 April 2008.

• Tier_1_Capacity_Available_and_Required_3Q2008.xls: T1 Capacity and requirements 3Q2008. Pledges are those from 1 April 2008.

• Tier_1_Capacity_Available_and_Required_4Q2008.xls: T1 Capacity and requirements 4Q2008. Pledges are those from 1 April 2008.

• Tier_1_Capacity_Available_and_Required_1Q2009.xls: T1 Capacity and requirements 1Q2009. Pledges are those from 1 April 2008.

• Tier_1_Capacity_Available_and_Required_2Q2009.xls: T1 Capacity and requirements 2Q2009. Pledges and experiment requirements remain those from 1 April 2008 for now. Full 2009 pledge installation should be by September 2009.

• Tier_1_Capacity_Available_and_Required_3Q2009.xls: T1 Capacity and requirements 3Q2009. Pledges and experiment requirements (cpu in KSi2K) remain those from 1 April 2008 for now. Installed capacity updates (cpu is in KSi2K) as reported in September 2009.

• Tier_1_Capacity_Available_and_Required_4Q2009.xls: T0+1 Capacity and requirements 4Q2009. Pledges and C-RSG approved experiment requirements (cpu in KSi2K) are those from the 2009 Autumn CRRB. Installed capacity updates (cpu is in KSi2K) as reported in December 2009

• Tier_1_Capacity_Available_and_Required_1Q2010.xls: T0+1 Capacity and requirements 1Q2010. Pledges and C-RSG approved experiment requirements (cpu in HS06) are those from The Autumn 2009 CRRB. Installed capacity updates (cpu is in HEPSPEC-06) as reported in December 2009

• Tier_1_Capacity_Available_and_Required_2Q2010.xls: T0+1 Capacity and requirements 2Q2010. Pledges and C-RSG approved experiment requirements (cpu in HS06) are those from The Autumn 2009 CRRB. Installed capacity updates (cpu is in HEPSPEC-06) as reported in March 2010.

• Tier_1_Capacity_Available_and_Required_3Q2010.xls: T0+1 Capacity and requirements 3Q2010. Pledges and C-RSG approved experiment requirements (cpu in HS06) are those from The Autumn 2009 CRRB. Installed capacity updates (cpu is in HEPSPEC-06) as reported in July/August 2010.

• Tier_1_Capacity_Available_and_Required_4Q2010.xls: T0+1 Capacity and requirements 4Q2010. Pledges and C-RSG approved experiment requirements (cpu in HS06) are those from The Autumn 2009 CRRB. Installed capacity updates (cpu is in HEPSPEC-06) as reported in September/November 2010.

• Tier_1_Capacity_Available_and_Required_1Q2011.xls: T0+1 Capacity and requirements 1Q2011 (initially a copy of 4Q2010). Pledges and C-RSG approved experiment requirements (cpu in HS06) are those from The Autumn 2009 CRRB. Installed capacity updates (cpu is in HEPSPEC-06) as reported in September/November 2010.