[Windmill-dev] result discrepancies

[Mikeal Rogers]

I'm fixing the old tinderbox code paths to work with the changes to  
the convergence library and the new python test framework.

I noticed a discrepancy between the new XMLRPC based framework and  
the old JSON framework.

The old tests obviously couldn't implement their own framework as  
they were just JSON text files. In order to calculate the number of  
failed and passed tests we hooked in to convergence's resolution  
suites. This means that the total number of tests passed and failed  
were equal to the number of actions in all tests.

Since the new XMLRPC based framework define their own pass/fail  
paths, and can conditionally assert ( block failure call if a  
condition is met ) we can't trust the test resolution suites list of  
failures as real test failures.

I hooked up some new code for frameworks to tell windmill when they  
are done testing and when they have test passes and failures, but  
this means that the number of tests passed and failed is now equal to  
the number of test files, or in a broader context the number of  
passed suites.

I'm ok with leaving the JSON tests as they are and just having a  
different pass/fail context for other frameworks, but I wanted to  
make sure this didn't obviously break anyone's code.

-Mikeal