[Chandler-dev] Sane defaults for new Chandler testing framework

[Mikeal Rogers]

Hiya,

Many of you have probably seen the commits we've been making to the  
test_framework branch.

QA has written an entirely new test framework and new logger for  
chandler testing. We also have a variety of new features. Some of the  
new features require your input as to what sane defaults should be  
when running chandler tests.

The relevant new features are:

Level masking :: There is now a suite, test, action, and report level  
to all test output. Masking can be set so that only a certain level  
and up is shown.

"" Reports are individual pass/fails. Reports are encapsulated in an  
Action. Actions are encapsulated in Tests, and Test are encapsulated  
in Suites. """

Debug settings :: Currently we are only exposing 4 debug settings,  
the settings are for (log failures only, log failures only and do not  
observe masking, log all output, log all output and do not observe  
masking)

stdout and file output options :: We now log to standard out (and  
flush after every line :) ) and we can log to a file if the correct  
options are specified.

All of these can be easily set manually, but the question we have is  
"what should the defaults be when running individual tests and the  
functional test suite?".

-Mikeal
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.osafoundation.org/pipermail/chandler-dev/attachments/20060523/edae66a9/attachment.html