[cosmo-dev] Cosmo .10 testing status

Adam Christian adam at osafoundation.org
Tue Nov 27 13:39:09 PST 2007


My piece of this is the automated tests, bug validation, and manual  
walk through of a small set of things on multiple platforms. I believe  
Mikeals process does include Protocol and Migration.

Adam

On Nov 27, 2007, at 11:44 AM, Jared Rhine wrote:

>> I am still in the process of automated testing...
>
> Sorry, could you repeat the specific automation list?
>
> (Full list is, I believe: Unit, Windmill, Protocol, Migration)
>
> Is the status:
>
> Unit: Done by tinderbox
> Windmill: Done before RC
> Protocol: Being done now
> Migration: 0.10 includes a schema change, so being done now.
>
> There seems to be an emerging consensus that with our new capability  
> to do "one-button build" test instances, we can (and should) move  
> from:
>
>  (old): "cook RC, put on qacosmo, then kickoff formal testing"
>
> to
>
>  (new): "push 'next release button', confirm automated testing and  
> sanity test of new features against that tree, then cook RC".
>
> We did the Windmill validation before the RC this time, a nifty  
> innovation.  I propose that we continue to do that; it just makes  
> sense (of course, it will be done automatically by Tinderbox by at  
> least a subset of supported browsers).
>
> It seems to also make sense to go further all do all "basic  
> automated validation" on a branch before cutting an RC.  So can we  
> also say "let's do protocol tests against the push-button instance  
> before RC"?
>
> I can see possibly removing "migration testing" from the "pre-RC"  
> list of things to do.  Depends on exactly how much we want to do  
> before vs after an RC is cut.  I can also see including it, assuming  
> we don't repeat after the RC is cut.
>
> -- Jared
>
> _______________________________________________
> cosmo-dev mailing list
> cosmo-dev at lists.osafoundation.org
> http://lists.osafoundation.org/mailman/listinfo/cosmo-dev



More information about the cosmo-dev mailing list