One issue we might want to discuss is the selection and sizing of the benchmarks.

All benchmarks are autosized to run at least 600ms right now, and then those 600ms runs are repeated up to 100 times to obtain measurements. But 600ms might be too short for some benchmarks, if the GC only kicks in rarely for them, I don't know.

About the selection of benchmarks, the ToolInteraction went up, but that is a very high level benchmark, and might also be influenced heavily by refactorings in Morphic. So maybe the benchmark isn't all that useful, or I should stop tracking trunk with the benchmark images, and instead stay on the release.

What do you think?

On Mon, 10 Oct 2016 at 21:48 Tim Felgentreff <timfelgentreff@gmail.com> wrote:
Indeed, "up" is "slower", but I will think how to add some indication of that the overview page nonetheless. I guess it isn't in there by default, because the speed center website is agnostic to what kinds of benchmarks you use, and writing it on each tiny chart may look messy. But I'll try it out and see how it looks :)

cheers,
Tim



On Mon, 10 Oct 2016 at 20:26 Bert Freudenberg <bert@freudenbergs.de> wrote:
On Mon, Oct 10, 2016 at 7:40 PM, Eliot Miranda <eliot.miranda@gmail.com> wrote:
On Tue, Jul 26, 2016 at 11:56 PM, Tim Felgentreff <timfelgentreff@gmail.com> wrote:

  http://speed.squeak.org/timeline/#/?exe=1,5&ben=grid&env=2&revs=50&equid=on

Would it be possible to add so me indication to the page of what is faster?  From the graphs I can't tell if higher is faster or longer.  There are no labels :-(

If you click on one of the tiny charts you get a full chart with labels. In all of the benchmarks, "up" means "more seconds" means "slower".

- Bert -