[Chandler-dev] Maximum acceptable std dev for perf test?
heikki at osafoundation.org
Tue Apr 17 16:24:13 PDT 2007
I did some checks on how variable our performance test really are (from
current results today):
min std dev 0.00%
max std dev 78.57%
In other words, about half of the performance tests actually have less
than 6% standard deviation. Unfortunately, some platforms are worse than
others; on Windows only one test has a standard deviation under 5%.
What is the threshold standard deviation where the test becomes
meaningless to you?
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 254 bytes
Desc: OpenPGP digital signature
Url : http://lists.osafoundation.org/pipermail/chandler-dev/attachments/20070417/564c7a0e/signature.pgp
More information about the chandler-dev