[cosmo-dev] Pre-RC automation tests

[Randy Letness]

>>>
>> I believe we have been doing collaborative migration test session or 
>> every release that has significant data migration involved. And we 
>> should continue doing that. Having said that,  I don't believe those 
>> sessions have really helped us catch any of "brown paper bag" bugs 
>> (for those wanting to know what is a brown paper bag bug see below ) 
>> or atleast not that I recall.
>> We don't land up finding most of these crafty bugs up until people 
>> start using the app for their daily workflows.
>> As for doing the QA sessions, I vote for doing them once an RC is 
>> done. Migration testing is sort of open ended and we can't stall 
>> creating an RC till all of migration testing is completely.
>
> Doing them once we cut an RC is fine by me.

And lets try to get max participation on them too.  I know manual 
testing isn't fun but I think if we have everyone banging on the server 
for an hour, we would feel more confident that there aren't any show 
stoppers once we release.

-Randy