[cosmo-dev] Pre-RC automation tests

[Matthew Eernisse]

Mikeal,

I think what Ted meant was not "we're not catching any large bugs." 
Rather I think he meant "There are still some big, showstopping bugs our 
tests are missing."

You're right, we are catching some before the show actually starts -- 
but we've also missed some that leave us groping for those brown paper 
bags. :)



Matthew


Mikeal Rogers wrote:
>> Based on the last few releases - 0.8/0.8.1 and 0.9/0.9.1  it seems 
>> like we haven't yet reached the point where our automation is able to 
>> catch showstopping brown paper bag bugs.    I think that we'd be well 
>> served to have an impromptu collaborative QA session at some point in 
>> the process, either in the final pre-RC stage that we are discussing 
>> now, or for the first RC.
>>
> 
> Why do you think that we're not catching brown paper bag bugs with the 
> automated tests?
> 
> mde is running the automated tests locally while developing new UI 
> features on his branch.
> 
> If the UI changes too dramatically some of the tests break and need to 
> be fixed, but any large obvious breaks in functionality are definitely 
> picked up by the automated tests and fixed before we ever cut an RC.
> 
> -Mikeal
> _______________________________________________
> cosmo-dev mailing list
> cosmo-dev at lists.osafoundation.org
> http://lists.osafoundation.org/mailman/listinfo/cosmo-dev
>