Thue-Morse and performance: Squeak v.s. Strongtalk v.s. VisualWorks

Andreas Raab andreas.raab at gmx.de
Sun Dec 17 10:52:36 UTC 2006


Klaus D. Witzel wrote:
> I'm disappointed, Strongtalk was always advertised as being the fastest 
> Smalltalk available "...executes Smalltalk much faster than any other 
> Smalltalk implementation...", and now it shows to be in almost the same 
> class as Squeak is :) :(
> 
> Can somebody reproduce the figures, any other results? Have I done 
> something wrong?

Yes. First, you are equating the result of a single micro-benchmark with 
overall system performance. Micro-benchmarks are used to measure 
specific aspects of a particular implementation. Your benchmark measures 
highly polymorphic send performance. Which is not typical for Smalltalk 
code to begin with.

In other words, your claim is based on measuring a single atypical 
performance characteristic. This has *nothing* to do with "Smalltalk 
performance". If you want to measure "Smalltalk performance" you should 
run a number of the standard benchmarks (Richards, Slopstone) that come 
with Strongtalk and compare those.

Quite honestly, I'm surprised to see a person like you who obviously 
understands enough about dynamic systems to measure PIC effects to make 
such unsubstantiated claims. I would expect that you know how to 
evaluate the results of a micro-benchmarks, and I would in particular 
expect that you know that 80-90% of all call-sites in realistic code are 
mono-morphic to begin with which render your benchmark results 
absolutely useless for "Smalltalk code".

Cheers,
   - Andreas



More information about the Squeak-dev mailing list