This task captures our need for automated test tools that can be released with FOSSology. (HP has a handful of tests/tools that we use internally, but either we’re unable to release, or they’re very immature and need cleaning up/growing up).

Specifically:

• License Unit Tests - A set of unit tests that can be run against FOSSology or any other license detection tool to ascertain the accuracy of the tool. These are a set of pass/fail tests, each consisting of...

1. License text sample (a snipped of text, source code, etc)
2. License reference - a URL or other pointer to the actual license
3. Set of return values (regexps?) that when reported, result in a “pass”
4. License name
5. Test case name
6. Other criteria?

• UI Unit Tests - A set of php unit tests to validate the operation of the UI

1. SimpleTest - already began, but needs lots of work
2. Selenium - Already begun, but needs lots of work

• Real-world project test cases - a set of test cases of open source projects we can run through the tool to validate that we’re reporting the correct licenses (also to be used to test other license detectors)