[squeak-dev] Squeak Full Test run - some stats

Levente Uzonyi leves at caesar.elte.hu
Sat Jul 14 09:58:27 UTC 2018


Is that a Stack VM? That could explain why it takes more than just a few 
minutes to run the full test suite.

Levente

On Fri, 13 Jul 2018, Chris Cunningham wrote:

> Hi.
> I'm trying to run the full test suite in Squeak, and it takes a while.  So, I've timed it and noted which parts are slow.
> 
> Full test suite in Test Runner (except the "Help System-*" tests - more on that later) took 26:21.798 - just under a 1/2 hour.
> 
> The top 6 test classes (those taking over a minute each):
>   05:11.612  PureBehaviorTest
>   03:15.047  DecompilerTests
>   03:09.779  TraitTest
>   03:01.287  TraitMethodDescriptionTest
>   02:19.789  TraitCompositionTest
>   01:12.013  TraitFileOutTest
> So, about 2/3rds of the time on those tests.
> 
> Testing environment:
>   Squeak5.2alpha
>   latest update: #18145
>   Image format 68021 (64 bit)
>   Croquet Closure Stack VM [StackInterpreterPrimitives VMMaker.oscog-eem.2203]
>   Win32 built on Apr 27 2017 03:08:19 GMT Compiler: 4.2.1 Compatible Clang 3.9.1 (tags/RELEASE_391/final)
>   platform sources revision VM: 201704270225 
> hardware:
>   Processors: AMD FX(tm)-6300 Six-Core Processor             
> Identifier: AMD64 Family 21 Model 2 Stepping 0
> ~MHZ: 3516
>   Operating System: Windows 10 Home (Build 9200 )
> 
> Results:
>   4479 run, 4426 passes, 29 expected failures, 23 failures, 0 errors, 1 unexpected passes
> Issues:
> [IMAGE]
> 
> So, what are the 'normal' failing tests that I should ignore, if any?
> 
> If you are interested in how the timing was done, I loaded this package (recently created for another purpose):
>    MCHttpRepository
> location: 'http://www.squeaksource.com/CBCTimeLogging'
> user: ''
> password: ''
> Load "Time Logging" (at least version cbc.2)
> Load "Test logging sunit integration" (at least version cbc.1)
> 
> Then, any runs of tests in TestRunner should log the it takes.  The following commands show the results as noted above:
>   (TimeLogging globalTimingLogs category: #testRunner) categoryTime. 
>   (((TimeLogging globalTimingLogs category: #testRunner) slowestGroupTimes select: [:sgt| sgt second >= 1 minute]) collect: #printString) joinSeparatedBy: String cr.
> 
> * About the "Help-System-*" tests, they manage to block the TestRunner with a failure in showing one of the UI's, which after moving a window or two locked up the image. Not nice.  Will follow up in another
> message.
> 
> Also, why does Test Runner not keep a progress bar showing all of the time?  It is unnerving now knowing if it is running or not - several times it just seems locked while it is doing things in the
> background.
> 
> Thanks,
> cbc
> 
>


More information about the Squeak-dev mailing list