From: noc-managers-bounces@mailman.egi.eu
[mailto:noc-managers-bounces@mailman.egi.eu] On Behalf Of Tiziana
Ferrari
Sent: 08 November 2010 16:05
To: EGI-InSPIRE SA1; NGI Operations Centre managers
Subject: [Noc-managers] checking BDII freshness

Dear all

at the Operations Management Meeting that took place on Oct 26, it was 
decided that the BDII freshness Nagios test should start to generate 
alarms in the operations dashboard as of Dec 01. This mail is to provide

more information on this test, and on how to check if site and top bdii 
instances are affected. Thanks to P. Veronesi (BDII 2nd line support) 
for the technical information provided below.

The test checks that the freshness of the site/top-level BDII, and 
raises an alarm if age exceeds 1 h. In particular, the test makes a ldap

query to retrive the modifyTimestamp attribute. This entry should always

be fairly recent (warning if between 1200s and 3600s, critical if
higher).
example of ldap query:
#  ldapsearch -x -LLL -h BDII_HOSTNAME -p 2170 -b o=infosys -x +

The decision to enable alarms in case of failures is a followup of the 
BDII issue affecting the update process (both of site and top-level 
BDII) that was reported in:
https://gus.fzk.de/ws/ticket_info.php?ticket=61511

(see also the thread on the lcg-rollout list about "top-bdii issue - 
dying bdii-update process")

The information published by bdii services (at each level) should be 
updated to be useful. Status information about the BDII itself is 
available by querying the o=infosys root for the UpdateStats object. 
This entry contains a number of metrics relating to the latest update 
such as the time to update the database and the total number of entries.

Information about BDII freshness can be obtained from gstat 2.0:

- TOP-BDII Freshness on GSTAT2.0: 
http://gstat-prod.cern.ch/gstat/service/bdii_top/
- SITE-BDII Freshness on GSTAT2.0: 
http://gstat-prod.cern.ch/gstat/service/bdii_site/

More references:
the gLite Information System architecture: 
https://twiki.cern.ch/twiki/bin/view/EGEE/InformationSystemOverview
An overview about how bdii works: 
https://twiki.cern.ch/twiki/bin/view/EGEE/BDII

Please feel free to ask in case more information is needed.
Tiziana

-- 
Tiziana Ferrari
EGI.eu Operations
Science Park 105, 1098 XG Amsterdam, NL
tel: 0031 (0)6 3037 2691