WLCG/EGI accounting technical meeting
https://codimd.web.cern.ch/s/oaS7-C9Pt
Attended:
Maria, Adrian, Dirk, Michael, Alessandro, Julia
EGI Portal
-
Duplication-avoiding patch: The progress on the duplication-avoiding patch is unclear, as Greg is currently away. This will be followed up with him once he returns.
-
CERN double-counting issue in May: The issue has been fixed in CRIC but not yet in the EGI Portal. Adrian suggested that Maria republish the May data and check how it is reflected in the portal. If the issue persists, a GGUS ticket should be opened.
AUDITOR Deployment Campaign
If we aim to launch the deployment campaign early next year, two main prerequisites need to be addressed:
-
Testing workflow (very high priority): We need a complete and fully functional testing workflow in place before launching the campaign. Adrian reported that a message queue and a test repository instance are already available and connected, but there is currently no user interface (UI). Completing this workflow is a very high priority, as the campaign cannot start without it.
-
AUDITOR documentation and deployment support: We need a central, official location where all AUDITOR deployment instructions are collected, potentially on the EGI Confluence. Julia has already shared some information, including links to AUDITOR documentation, for the pioneer sites. Michael will ensure that the documentation is complete. Alessandro and Michael will follow up on this.
They will also ensure that AUDITOR is available in UMD with a corresponding support unit.
In addition, Michael will contact Sam from Glasgow to check whether the template used for UK sites that have already migrated, or are currently migrating, could also be useful for other sites.
-
Site tutorials: Julia and Michael will follow up with CMS and ATLAS to discuss the organisation of site tutorials during the corresponding computing events of the two experiments.
APEL Validation Page
Adrian reported that the APEL validation page now displays information about the reporting tool.
For AUDITOR sites, migration to AUDITOR version 11.2 is required for this information to become visible on the APEL validation page.
Julia will contact sites that have already migrated but whose AUDITOR reporting tool is still not visible on the validation page.
AUDITOR Plans
Maria asked about the follow-up to site feedback collected after the WLCG Workshop. A number of additional proposals were also reported by Nikos following the HEPiX meeting.
It was agreed that AUDITOR will present its development plans at the next WLCG Operations Coordination meeting in December.
Calculation of Wallclock Time
This topic needs further discussion within WLCG to agree on how wallclock time should be calculated.
One question is whether the calculation should be adjusted to account for periods during which a job is not actually running, but its allocated slot is available to other jobs, even though these periods fall between the job's recorded start and end timestamps.
Although this adjustment is technically feasible, it would require different configurations at individual sites and could introduce confusion. Furthermore, the overall impact of this issue is not yet clear. In any case, achieving a very high level of accuracy may not be realistic, for example , there is another potentially more significant issue : wallclock time is currently calculated using the number of cores requested at job submission. However, the actual number of cores allocated to a job may vary depending on the site's configuration. This discrepancy could have a more substantial impact on the accuracy of the calculation.