[Cosmo-dev] Collaborative QA for Preview

[Mikeal Rogers]

> I agree that more automation will help in some areas.   I would  
> like to get to a point where Cosmo developers could run windmill  
> tests against their changes before those changes get checked in.    
> When I worked on Chandler, I used to run the functional tests  
> before I checked in a unit of work, and it saved me from  
> embarrassment many a time.

We were hoping to have this by the end of today, we're now shooting  
for end of day tomorrow.

The documentation for downloading windmill and running tests is all  
in place, but I added a feature at the last minute that allows us to  
run all the cosmo tests at once and Adam is updating the tests to run  
better when they are run as a suite. We would have had it done  
already but like half the div id's in the cosmo UI were changed and  
we're having to update a lot of the tests after today's checkpoint.

Expect an email before the end of the week detailing how developers  
can run windmill tests before checkin.

> One area where automation will not help is in interop testing  
> between Chandler and Cosmo.  This is an are where we could do with  
> some more testing by humans.

Until after preview, I expect interop between Chandler and Cosmo will  
be 99% manual testing.

But, the next release of windmill will get the cosmo tests ready for  
tinderbox integration, and part of that work is a rich xmlrpc  
interface so that python client code can execute Chandler and Cosmo  
UI tests in tandem, each firing a test that changes some data or  
state and then verifies the change in the other product, along with  
the other cosmo protocol tests that verify the same changes propagate  
to other public interfaces (atom, caldav, etc). This is going to take  
a little work in the Chandler test system but I see us having it  
ready sometime shortly after preview.

-Mikeal

-------------- next part --------------
A non-text attachment was scrubbed...
Name: PGP.sig
Type: application/pgp-signature
Size: 186 bytes
Desc: This is a digitally signed message part
Url : http://lists.osafoundation.org/pipermail/cosmo-dev/attachments/20070227/086c3178/PGP.pgp