[cosmo-dev] Pre-RC automation tests
mde at osafoundation.org
Wed Nov 28 16:37:52 PST 2007
I think what Ted meant was not "we're not catching any large bugs."
Rather I think he meant "There are still some big, showstopping bugs our
tests are missing."
You're right, we are catching some before the show actually starts --
but we've also missed some that leave us groping for those brown paper
Mikeal Rogers wrote:
>> Based on the last few releases - 0.8/0.8.1 and 0.9/0.9.1 it seems
>> like we haven't yet reached the point where our automation is able to
>> catch showstopping brown paper bag bugs. I think that we'd be well
>> served to have an impromptu collaborative QA session at some point in
>> the process, either in the final pre-RC stage that we are discussing
>> now, or for the first RC.
> Why do you think that we're not catching brown paper bag bugs with the
> automated tests?
> mde is running the automated tests locally while developing new UI
> features on his branch.
> If the UI changes too dramatically some of the tests break and need to
> be fixed, but any large obvious breaks in functionality are definitely
> picked up by the automated tests and fixed before we ever cut an RC.
> cosmo-dev mailing list
> cosmo-dev at lists.osafoundation.org
More information about the cosmo-dev