[Chandler-dev] Functional Test failure on Leopard

[D John Anderson]

On Oct 30, 2007, at 9:59 AM, bear wrote:

> D John Anderson wrote:
>> I'm running the new recorded scripts in a branch and will check it  
>> in to the trunk as soon as it runs reliably on the tinderboxes.  
>> Unfortunately, the new recorded scripts tests are catching bugs in  
>> rt.py and the tinderboxes themselves (random false positives and  
>> false negatives) that look unrelated to recorded scripts, so I'm  
>> blocked until I can get some help fixing them.
>
> That is yet unproven - rt.py and tinderbox are running the tests  
> the exact same way in both trunk and the recorded_scripts branch  
> and we are giving you help in finding out what is wrong in so far  
> as we can with rt and tinderbox.

Yes, I agree. As I mentioned to you and Heikki in my earlier email,  
the only think I know for sure is that running rt.py -r on the  
recorded_scripts branch consistently fails on Windows when run on my  
machine and Dan's machine, but randomly reports success on the  
recorded_scripts tinderbox and also randomly reports the wrong error.

This made me suspect a bug in the tinderbox, and it might also be the  
source of a bug Dan noticed on the previous recorded script framework  
where the tests would consistently fail for him but the tinderbox  
would report success.

One last obstacle to checking in the new recorded script is that we  
still haven't been able to run the Linux tinderbox, so we might run  
into a snag with those tests. I know you've been busy working on this  
and so I expect it will be up pretty soon.

>
> I'll say it again - rt.py just reports what the return code from  
> Chandler is and dumps the log files.  Tinderbox does exactly the  
> same from rt.py.
>
> The only new bugs in the process were to the Chandler launcher  
> where some environment variables were shown to need changes and one  
> of those has been made and the other will be pushed to trunk today.
>
>
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
>
> Open Source Applications Foundation "chandler-dev" mailing list
> http://lists.osafoundation.org/mailman/listinfo/chandler-dev