+ 1 Let us learn from the pypy guys.
i proposing to collect and put existing benchmarks into VMMaker repository.
The idea is simple: when we will have an automated build server, then we could run benchmarks on a successful build and log the numbers to a file(s), so we could compare them between different builds or different VMs, and keep track of history, like many other projects do.
-- Best regards, Igor Stasenko AKA sig.