Speaker
M. GALLAS
(CERN)
Description
Software Quality Assurance is an integral part of the software
development process of the LCG Project and includes several activities
such as automatic testing, test coverage reports, static software
metrics reports, bug tracker, usage statistics and compliance to build,
code and release policies.
As a part of QA activity all levels of the sw-testing should be run as
a part of automatic process, the SPI project delivers a general
test-framework solution based on open source software together with
test document templates and software testing policies. The
test-framework solution is built on QMtest, Oval and the X-Unit family
(CppUnit, PyUnit, JUnit). The specific languages testing features are
covered at the unit-testing level with the X-Unit family, the
validation testing activity can be done through Oval. And Qmtest
offers a way to integrate all the tests and write custom python tests,
having a nice web interface for running and browse the test results.
Test coverage reports allow to understand to which extent software
products are tested and they are based on the approach used by Linux
Testing Project. Code size and development effort of the software is
estimated using sloccount utility based on standard development
models. Statistics are automatically extracted from the savannah
bug tracker which enables to analyze the evolution of the quality,
amount of feedback from the users etc. Finally the compliance with the
standard LCG policies is verified. It includes the build and CVS
repository structure and the standard release procedure.
