[Chandler-dev] Checkin process when the tree isn't green?

[Andi Vajda]

On Tue, 19 Sep 2006, Heikki Toivonen wrote:

> I have a sort of related question regarding test failures. Should we
> stop further tests as soon as we see the first failure? This would
> shorten Tinderbox cycle time when there was a problem. What we currently
> do is that we run all unit tests, and if those passed, we run all
> functional tests (and if those passed, perf boxes run all perf tests).

Definitely, given the dependencies we have between functional tests, there is 
no point in running the ones after a failure.

Now, if these dependencies were documented in the code, that is, the test 
framework knew which ones to skip once a failure was detected, it could 
proceed with the later ones that don't depend on the earlier one that just 
failed.

Andi..