[squeak-dev] [TEST PLANS] We need your support for making Squeak better

Edgar J. De Cleene edgardec2005 at gmail.com
Fri May 25 10:18:01 UTC 2018


+1
I start mail with my experiments


On 25/05/2018, 04:21, "Marcel Taeumel" <marcel.taeumel at hpi.de> wrote:

> Dear Squeakers,
> 
> we, the Squeak community, are aiming to do a new release soon.  To ensure as
> high a quality release as possible we'd like to test it adequately.  This
> implies testing across all supported platforms, and possibly on some
> unsupported ones too. :-)  While we have a fairly strong test suite, it does
> not cover all areas of the system, and not all tests are included such as FFI
> tests are in its separate package. And of course currently we have about 100
> expected failures, 40 unexpected failures, and 10 errors in the base test
> suite. 
> 
> So we, the board, would like
> 
>   - volunteers to offer to TEST PLATFORMS, different versions of Windows,
> Raspberry Pi, the many flavors of Linux, etc.  Once we have a release
> candidate we will want to do a clean install on the platform and then run
> tests.
>   - the community to develop a set of TEST PLANS for testing those parts of
> the system not tested by the test suite
>   - a REVIEW of the test failures and errors. Are any obsolete? Are any
> platform-specific? Can we triage them into those that are tractable with
> little effort, those that are tractable with a lot of effort, those that are
> insoluble, etc...? Of the expected failures, which are due to fixable bugs,
> fundamental limitations, etc?
> 
> So, the data we need to collect includes volunteers, a platform matrix, test
> plans, and reviews of existing failures and errors.
> 
> ***
> 
> To complement Squeak's automated tests, we want to create a MANUAL TEST PLAN.
> Such a manual plan can be used by any volunteering Squeaker to put any
> upcoming release "to the acid test." ;-) As a result, our release process gets
> more robust, and the final release artifact can become of higher quality.
> 
> As a first step, we want YOU to write down some frequent interactions that you
> do on a regular basis. You know, things like "I do always do this when adding
> a class" or "I really need this to do my taxes". It may be a keyboard
> shortcut, a familiar entry in the world menu, or that lovely button in the
> upper right corner of tool so-and-so. We want to know!
> 
> How does it work? Well, we want to guide you a little bit so that things do
> not get out of hand ... content-wise. ;-) Here are the rules:
> 
> 1) Give that interaction a name (or title) to express the goal you want to
> achieve.
> 2) Briefly describe the starting context. Is the world empty?
> 3) Divide that interaction into no more than 5 steps so that everybody can
> click or push his or her way through the Squeak image as quickly as possible.
> 4) Briefly add some details about the things you should now see or experience.
> 
> Here is an example:
> 
> GOAL: "I want to calculate 3+4 in Squeak."
> CONTEXT: "The world is empty."
> STEPS
>  - Left click into the world, a menu should appear.
>  - Choose "workspace" from the upper items in the menu.
>  - A workspace window appears, and I click into it's text area.
>  - I type "3+7" and hit [CMD]+[P].
> RESULT: "I see a 7."
> 
> Our idea is to generalize and summarize the most common interactions into a
> manual test plan for everybody to play around with and report back to the
> list. When you create a new test, please send it to the list by replying to
> this email thread. :-)
> 
> Best,
> Marcel
> (for the Squeak Oversight Board)

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squeakfoundation.org/pipermail/squeak-dev/attachments/20180525/5b8b6a93/attachment.html>


More information about the Squeak-dev mailing list