[squeak-dev] Mutation Testing
Nicolas Chillo
nchillo at gmail.com
Tue Sep 22 21:45:45 UTC 2009
John,
Thanks for the application feedback. We will take a look at those bugs.
We expect to have an oficial release at soon.
Thanks again and congrats for your well programed test suite ;-)
Nicolas Chillo
On Tue, Sep 22, 2009 at 6:43 PM, Hernan Wilkinson <
hernan.wilkinson at gmail.com> wrote:
> Hi John
> great! so you covered all the cases!!.... it means you are a great
> programmer or mutation testing is not good :-) haha.
> Seriously, it is great you could try it and thank you for the report.
> We will check to see if we can do something to avoid changing the memory
> ceiling.
>
> Bye,
> Hernan.
>
>
> On Tue, Sep 22, 2009 at 6:28 PM, John M McIntosh <
> johnmci at smalltalkconsulting.com> wrote:
>
>> Although I didn't get to see the presentation on Mutation Testing at ESUG,
>> I did have a chance to
>> see it the following week after my XtC talk in London. At the time I had
>> promised to try it out.
>>
>> http://www.slideshare.net/esug/mutation-testing
>>
>> My Fractions Calculator has 105 Sunits to confirm the keyboard state
>> machine works, the calculator grammar via Smacc is sane,
>> and the math results are as defined by either Wolfram Alpha, or Microsoft
>> Excel rules. Actually the number of tests are 210 because they are
>> subclassed for Excel, but running just the Wolfram Alpha based ones were
>> sufficient to test the code base.
>>
>> I had two problems, one where the RBParser choked on
>> #(#foo:. #bar:.)
>> Oops the code really should have been #(#foo: #bar:) or {#foo:. #bar:.},
>> still it shouldn't have given a walkback.
>>
>> The second was that I had to increase the memory ceiling of the macintosh
>> squeak carbon VM from 512MB to 1.5GB via the info.plist
>> so that a recursive error situation would not make the VM run out of
>> memory before the Mutation testing runtime monitor would kill the
>> runaway task.
>>
>> As a result over the 105 SUnits it reported:
>>
>> It made 874 mutants, 873 got killed, 1 was terminated.
>>
>> Which means I don't have any head scratching this afternoon.
>>
>> --
>>
>> ===========================================================================
>> John M. McIntosh <johnmci at smalltalkconsulting.com> Twitter:
>> squeaker68882
>> Corporate Smalltalk Consulting Ltd. http://www.smalltalkconsulting.com
>>
>> ===========================================================================
>>
>>
>>
>>
>>
>>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20090922/47da81e0/attachment.htm
More information about the Squeak-dev
mailing list
|