Choose timezone
Your profile timezone:
BiLD meeting
→
Europe/Zurich
2-R-014 (CERN)
2-R-014
CERN
Description
Dial-in numbers: +41227676000 (English-US, Main)
Access codes: 0146874 (Leader)
0135655 (Participant)
Participant site: https://audioconf.cern.ch/call/0135655
These minutes are produced even if the meeting did not really take place. They are created from comments and questions to single developers.
--- Next Release of LHCbDIRAC (Federico):
the next release of LHCbDIRAC will contain many changes, especially for what regards the workflow. What is probably the most significant change is the use of the XML summary to collect information from the application, that will substitute the analysis of the logs. A complete list of changes will be available in the release notes as usual, and changes to the DB, and new agents will be announced in the savannah tasks as well.
For this release, that will require some careful certification tests, I would like to aim at the following:
1) be in sync with what is in the trunk: even if this is not a mandatory operation, I think that we diverged a bit too much, in the past year, from what has been tagged. After a survey:
Accounting
no diff, we can tag the trunk
Core
many changes, but we can tag the trunk
DataManagement
many changes, but we can tag the trunk
Interfaces
many changes, but we can tag the trunk
NewBookkeepingSystem:
has to be understood if we can tag the trunk
ProductionManagementSystem:
I think we can tag the trunk (TBC)
ResourceStatusSystem:
We can't tag the trunk (not today, at least)
SAMSystem:
can tag the trunk
TransformationSystem
can tag the trunk
Workflow:
many changes, but we can tag the trunk
WMS:
can tag the trunk
2) Pose a time limit on when the pre-release has to come out. This time limit will be at the end of this week. So, please do not start developing new features in these days: from now on, only fixes.
There have been no disagreement from this original plan.
--- Reports from Developers:
-- Core (Federico):
New Production XML log analysis
New Unit tests for new functionalities
Production Data creation cleaned
-- DMS (Elisa, Krzys):
- Popularity service: discussions to focus on the objectives for LHCb and starting the development of the new service in LHCbDirac. Summary of the activity in the twiki page https://twiki.cern.ch/twiki/bin/view/Main/ElisaLanciottiWorkDiracTasksPopularity2
- DataManagement/StorageHistoryAgent: put in production the latest version before Christmas, where the bug for LFN size and files plots is corrected. Running fine, with an execution time of about 6 hours (this is fine, given that the accounting bin width is 24h).
- DataManagement/SEUsageAgent: applied some improvements to the agent for consistency checks, to produce separated lists for replicas of failover and archive types not registered in LFC. Under validation.
- certification of new DMS agents (TransferAgent, RemovalAgent and RegistrationAgent) using volhcb13 installation
-- RSS (Mario):
SVN: 27 tasks
23 tasks assigned to 'ubeda'
4 tasks assigned to 'dirac-rss'
GITHub: 14 issues
6 issues assigned to 'ubeda'
4 issues assigned to 'vbmithr'
plus 3 or 4 unnasigned
Commited:
- Bug in SiteGateway :: pull 387 )
- CacheFeederAgent is too verbose :: pull 404
- Synchronizer is buggy ( issue 424 ) :: pull 425
- Add logs to CleanerAgent ( issue 412 ) :: pull 426
- Old RSS Policies removal ( task 25186 ) :: rev 46373
- Policy.Actions.EmptyAction.ActionBase ( issue 421 ) :: pull 422
Tagged:
- Bug in SiteGateway :: v6r2-pre4
- CacheFeederAgent is too verbose :: v6r2-pre4
- Policy.Actions.EmptyAction.ActionBase :: v6r2-pre4
Foreseen work for this week:
- LFC mirrors replication test published through SLS ( task 19923 ) ~ currently assigned to Stefan
- Notifications not sent ( issue 429 ) ~ already fixed, I'm testing it.
- TransferQuality policy and CacheFeederAgent ( task 25155 ) ~ policies and commands done, CacheFeederAgent done, StEl and RS InspectorAgents doublechecked. Only SS and SeS missing.
- Open an issue and a task for the migration from CS to RSS. Involve Federico, Elisa, Andrei, Ricardo ?, and myself. And start pushing for it.
- Remove NeedConfirmation in RSS ( task 25236 )
-- Bookkeeping (Zoltan):
Task:
25281: Change behaviour of the Step Manager page (ongoing) the bkk part is ready
- two new parameter added to the getAvailableSteps method.
- the query is changed in order to take into account this two parameter.
24950: Change step of production (ongoing)
The OutputFileTypes added to the getAvailableSteps method in order to be able make filters on the output file types of all the steps.
25282: adding filters to the steps
- allow to filter on steps using all the available parameters
I did not opened a task:
1. I set up a production instance based on oracle 11g database in order to make tests. I discovered a few problem which has been fixed by the Oracle IT support:
a.)https://cern.service-now.com/service-portal/view-incident.do?n=INC094245
b.)https://cern.service-now.com/service-portal/view-incident.do?n=INC093925
2. I made a lot of tests using the new oracle11g database which are available in my PC. It is not required to make them public. Maybe when we move to oracle11g I will make a presentation in order to present what we had before and what we have now. I can use the plots to show the performances.
3. I started to review the Bookkeeping API. I made a document which is discussed with Philippe.
This week and next week plan:
1.) I will start the implementation (changes) of the 3 which mentioned above.
2.) I have to count how many database are we using. At the moment I am lost. Identify the development and certification db.
3.) I will work on small task
4.) We will move the oracle11g and I will have to do test after the migration.
--- Next Release of LHCbDIRAC (Federico):
the next release of LHCbDIRAC will contain many changes, especially for what regards the workflow. What is probably the most significant change is the use of the XML summary to collect information from the application, that will substitute the analysis of the logs. A complete list of changes will be available in the release notes as usual, and changes to the DB, and new agents will be announced in the savannah tasks as well.
For this release, that will require some careful certification tests, I would like to aim at the following:
1) be in sync with what is in the trunk: even if this is not a mandatory operation, I think that we diverged a bit too much, in the past year, from what has been tagged. After a survey:
Accounting
no diff, we can tag the trunk
Core
many changes, but we can tag the trunk
DataManagement
many changes, but we can tag the trunk
Interfaces
many changes, but we can tag the trunk
NewBookkeepingSystem:
has to be understood if we can tag the trunk
ProductionManagementSystem:
I think we can tag the trunk (TBC)
ResourceStatusSystem:
We can't tag the trunk (not today, at least)
SAMSystem:
can tag the trunk
TransformationSystem
can tag the trunk
Workflow:
many changes, but we can tag the trunk
WMS:
can tag the trunk
2) Pose a time limit on when the pre-release has to come out. This time limit will be at the end of this week. So, please do not start developing new features in these days: from now on, only fixes.
There have been no disagreement from this original plan.
--- Reports from Developers:
-- Core (Federico):
New Production XML log analysis
New Unit tests for new functionalities
Production Data creation cleaned
-- DMS (Elisa, Krzys):
- Popularity service: discussions to focus on the objectives for LHCb and starting the development of the new service in LHCbDirac. Summary of the activity in the twiki page https://twiki.cern.ch/twiki/bin/view/Main/ElisaLanciottiWorkDiracTasksPopularity2
- DataManagement/StorageHistoryAgent: put in production the latest version before Christmas, where the bug for LFN size and files plots is corrected. Running fine, with an execution time of about 6 hours (this is fine, given that the accounting bin width is 24h).
- DataManagement/SEUsageAgent: applied some improvements to the agent for consistency checks, to produce separated lists for replicas of failover and archive types not registered in LFC. Under validation.
- certification of new DMS agents (TransferAgent, RemovalAgent and RegistrationAgent) using volhcb13 installation
-- RSS (Mario):
SVN: 27 tasks
23 tasks assigned to 'ubeda'
4 tasks assigned to 'dirac-rss'
GITHub: 14 issues
6 issues assigned to 'ubeda'
4 issues assigned to 'vbmithr'
plus 3 or 4 unnasigned
Commited:
- Bug in SiteGateway :: pull 387 )
- CacheFeederAgent is too verbose :: pull 404
- Synchronizer is buggy ( issue 424 ) :: pull 425
- Add logs to CleanerAgent ( issue 412 ) :: pull 426
- Old RSS Policies removal ( task 25186 ) :: rev 46373
- Policy.Actions.EmptyAction.ActionBase ( issue 421 ) :: pull 422
Tagged:
- Bug in SiteGateway :: v6r2-pre4
- CacheFeederAgent is too verbose :: v6r2-pre4
- Policy.Actions.EmptyAction.ActionBase :: v6r2-pre4
Foreseen work for this week:
- LFC mirrors replication test published through SLS ( task 19923 ) ~ currently assigned to Stefan
- Notifications not sent ( issue 429 ) ~ already fixed, I'm testing it.
- TransferQuality policy and CacheFeederAgent ( task 25155 ) ~ policies and commands done, CacheFeederAgent done, StEl and RS InspectorAgents doublechecked. Only SS and SeS missing.
- Open an issue and a task for the migration from CS to RSS. Involve Federico, Elisa, Andrei, Ricardo ?, and myself. And start pushing for it.
- Remove NeedConfirmation in RSS ( task 25236 )
-- Bookkeeping (Zoltan):
Task:
25281: Change behaviour of the Step Manager page (ongoing) the bkk part is ready
- two new parameter added to the getAvailableSteps method.
- the query is changed in order to take into account this two parameter.
24950: Change step of production (ongoing)
The OutputFileTypes added to the getAvailableSteps method in order to be able make filters on the output file types of all the steps.
25282: adding filters to the steps
- allow to filter on steps using all the available parameters
I did not opened a task:
1. I set up a production instance based on oracle 11g database in order to make tests. I discovered a few problem which has been fixed by the Oracle IT support:
a.)https://cern.service-now.com/service-portal/view-incident.do?n=INC094245
b.)https://cern.service-now.com/service-portal/view-incident.do?n=INC093925
2. I made a lot of tests using the new oracle11g database which are available in my PC. It is not required to make them public. Maybe when we move to oracle11g I will make a presentation in order to present what we had before and what we have now. I can use the plots to show the performances.
3. I started to review the Bookkeeping API. I made a document which is discussed with Philippe.
This week and next week plan:
1.) I will start the implementation (changes) of the 3 which mentioned above.
2.) I have to count how many database are we using. At the moment I am lost. Identify the development and certification db.
3.) I will work on small task
4.) We will move the oracle11g and I will have to do test after the migration.
There are minutes attached to this event.
Show them.