FOSSology Project Logo FOSSology
Advancing open source analysis and development
 

Release Testing and Criteria

This page documents the minimum set of criteria and tests that must pass before a FOSSology release can be made.

As additional issues are discovered and our testing becomes more mature, expect this list to grow, and expect that more of these tests will become automated.

Unit test coverage

All new code (committed as part of 1.2 release and beyond) must have unit tests written for it.

  • License regression tests (based on Eddy tests) should all pass
  • Code coverage analyzer?

Linux Distros

We will test on the following Linux distros: (more detailed test requirements below)

  • Current Debian release
  • Previous Debian release
  • Current Fedora release
  • Latest RHEL4/CentOS4 without yum (end of life is Feb 2012) (RHEL4 is based on Fedora Core 3)
  • Latest RHEL5/CentOS5 using yum (end of life is March 2014) (RHEL5 is based on Fedora Core 6)
  • Ubuntu?? - separate testing or just test on Debian?

(see http://www.redhat.com/security/updates/errata/ for RHEL support policies)

Test Plan

On all distros listed above the following will be tested:

Test Criteria
Clean install from native distro packaging (.deb on Debian, .rpm on Fedora/RHEL No errors or obvious failures
Run SimpleTest automated tests All tests pass or have well-documented exceptions
Upgrade from previous release No errors or obvious failures, all existing data is maintained

On the current Debian release the following will be tested in addition:

Test Criteria
Multi-system clean install from native distro packaging No errors or obvious failures
Fedora distro analysis No errors or obvious failures, spot-check the license analysis for errors

References

Here are links to relevant documentation for testing FOSSology

 
release_testing.txt · Last modified: 2009/08/13 08:16 by danger

Copyright (C) 2007-2009 Hewlett-Packard Development Company, L.P.
FOSSology Project documentation is licensed under the GNU Free Documentation License Version 1.2
Recent changes RSS feed Valid XHTML 1.0 Valid CSS3 Driven by DokuWiki