[squeak-dev] Neural based evolutive testing (was: The Trunk: Kernel-nice.1402.mcz)
kirtai+st at gmail.com
Wed May 19 00:27:15 UTC 2021
On 18/05/2021 20:44, Nicolas Cellier wrote:
> Hi Douglas,
> If the number of failing cases is one out of 1,000,000 or more, the
> probability to find one is infinitesimal.
> The percentage of failure in the sqrt case was even smaller (it
> requires crafting the trailing bits of integer whose highBit > 100)...
> I don't believe that fuzz testing is really the effective way in this context.
> Only the setup is effective (very simple and cheap - though we have to
> bound our LargePositiveInteger...).
> Shooting in the dark is effective only in crowded places.
> White box testing is certainly much more effective in such cases.
Oh yeah, in this context it may not work well. I was just pointing out
that it can be useful.
Not to mention that even one in a million chances are likely to be
smoked out with hundreds of millions (or more) fuzz tests.
More information about the Squeak-dev