I think the need you're addressing could be better met with some
organizing structure on top of TestCases... and that would be useful. I
remember the mess it was to find a few score of RB TestCases not
working, and then finding out that they are actually in implicit layers
- the parser should be fixed before the refactorings, and so forth.
Would have been nice if the layers were explicit.

Daniel

julian at beta4.com wrote:
> 
> --Boundary_(ID_ChVxD6muqUYtESkMpHGkEQ)
> Content-type: TEXT/PLAIN
> Content-transfer-encoding: 7BIT
> 
> from preamble:
> 
> "Change Set:		SUnit-expected-failures-jf
> Date:			30 July 2003
> Author:			Julian Fitzell
> 
> Add the notion of expected failures to SUnit TestCases (this is against
> SUnit 3.0 but may also work against 3.1 - just not actually tested
> there).
> 
> You can define an #expectedFailures method on a test case that should
> return a collection of selectors that are expected not to pass. 
> Failures or errors in these tests will not cause the test case to report
> failure.  If a test that is unexpectedly passes, this is also reported
> as a failure.
> 
> The idea of expected failures in general is that you can write tests in
> advance to describe what an interface should look.  You can then mark
> them as expected failures before committing code.  This avoids the
> problem of other developers not knowing which tests they have broken and
> which are just expected to be failing currently.
> 
> This is quite a preliminary hack to get it working.  The UIs need to be
> updated so that unexpected passes are identified differently in the list
> of failures, for example.
> 
> I'm throwing this out there just because I may not have time to do
> anymore in the next few weeks and I figured someone might have some
> comments.  I'm almost tempted to write my own testing framework so this
> feels like slightly less of a hack, but we'll see if there's ever time
> for that. :)"!
> 
> --Boundary_(ID_ChVxD6muqUYtESkMpHGkEQ)
> Content-type: application/octet-stream; NAME=SUnit-expected-failures-jf.cs.gz
> Content-transfer-encoding: base64
> Content-disposition: attachment; filename=SUnit-expected-failures-jf.cs.gz
> 
> H4sIAAAAAAAAAL1XS2/bOBA+66D/MEkPSlDHddZJ21XRQ5A2QHpp0KRYLILsgrZGNmtK9FJU
> XBf58TtDUn7Ej3Rbd4EAkcnhzDffvMjkwugCrv+pUYy67VPQOSTJ8TGcjY1U8Fun000SuFXC
> YmWhHmf0kcKz0+PXnTvQJXQ78KFWUycIwsJJ2j1OT1/BuEj24v3zoSgHCNdo0yi6/lxKe4Rf
> x9i3mB3lQqraYHX0JY/fsdYoiha1xWe1HWrDy7QmRQkX0n5DpeL4LMvADhFKbSVhIMiNVmi0
> gtXgDMINAT8XFS0d2KGsgP7EQMiS3PEC3XYHerWFQkxBqErDRJvRTKbbPoYj+FLTJ5kD0be1
> UASR+UAHw+BhO47/1DX0CWSGuSwR6OtZA+qiwVQgeZQxbcKdpwMVkgrirRrqWmVg0NaGt/ta
> KToc3KuQf2hTeWFhcO4xoyJnx6Kq2gAzW9oAGsNHZMko2RCZrGAilXKH+qJ21nERiyYIY21s
> QySpvMwbuM448VeXjXUigg1j1YIZuUyhV0LoBC3MdMXxDVmTGYr1MSOkAyzRCMWKnLVpoHVi
> pG08IDGR3Yuy7/BmWPWN7CFMHDUlbVs0uaDdQKrSekR+NBEij0sKNsWYvgpGuIqkh7kmkvu6
> KKS1shzQZ8Zk3LCX4l7LrHLUjY3uKdJC/mjOBYJzj0qPkYhnkkelnvDxyVD2hwE/yU1hKO4R
> ekaPCIwosyDAkXW5NoNEHpJvDMyhqI3B0qqp49IT/k/N1AiCgkoWshSGtfdHfHSAFDDrMpqO
> O/wIny8JG850+6LOgMLmKJ9HN8TWoaKolVbmklYzmefoYYTkAiUJM3HQENiCnBPwqyjGiuN+
> mRQkZzwXLlN0bX3xeH976NPx0pUhM+cIsrLwQdZE0rTgmASLBJKSFCcwQRxVjsJLyOWArLMr
> BWqqwkIOhkETL7l4Em4uFEYkVKE5rbEYB6p9mhVT0JPSRYvx5kYU6JqCo4jA54iqIqdHpFex
> DWJCYVUxBcKR33ItZYIJFVuFhDr33iaUbfeUJs4x5ogpb0N6uL8Xx/Fe06xCq6guqAFCcuOB
> JFBZIpQWPlzAqxfdzgvXdY+76UmHuu3jdhNHf8GZMUwnTvZg78fVd38n9b6Yrigj4mj/c+nc
> 5UA0vYlTcTEbJuiyL+fxstIKW7ztFzk/Q//aZ8gHpHDeHC7mvaGvaqr11IXlOhg95FRxvnnn
> PmFVK7vs3lm/T1i3Onh6ssDfO8zp/7muS8t4luD4vQoq+Q3nlP6Q1Zfp8apVF7QD37hbs2o6
> DCSncJuioDbxAO7fPCRMwx38JKJHPLDe9Sxc+bawexK8YrbnOk/2pN8/7fPLtPOKAJi6nLna
> mCbv4Pl8JITfYajuxPfOSzLtZgLZPfhoMmoQ2fl88lPdpp75Bt9hHEUiy86USgPONwsrDdbF
> NY+XV2iUGla2myyZT4n3bGE5UR5t7jJVHqtmm01MfnWyrLgeutMm5y8Wc2fX7i+2+XmS/u8U
> rHaJ5b1f5P1/7hTf0yEv+TnwAj6RKhqSW+qWsUgSlkKRb3EUMPwNa2u4HUezAG0WCUm8SWA7
> 8itDt97t/J0S5jGLfSxTENfWoCjiaPYR8YXqqrauaSz1HHCnSI70v3kkmLBUC5I36xSspMh2
> Tc1DYruyhem8RV2yeqffpHh9NW+H+v06581xO9ow8Z9S9z1UJqs3+OSJ9PlUl+X2SXUahiTV
> BWVPc4+Mowd3HePvK18DD3H0aCV9C9bU9AqIbm9nJyEouwMCH1U1FRPnpXO3r7heA8e8nenU
> iUW3aSUHJT0PH/zvWVnRtFuA1XabqzByepuGzaDHGX7/Vdo/pB2mXuDuzkmsBeXi5LcJlP9Y
> QBUWQimvA/UErO3A2ivcyvyGqKWuFzrQssm77VF/4t5/4vvcUFTeGDXb5b7wNtzVvW2/9nxj
> tR5uB3Oui7GwskfvXDvdkoj8FMHZ5F9729idoXxhxm6Y7a0NQ283IF5z027YX3cJb619nzjj
> /wI+MD0f2hMAAA==
> 
> --Boundary_(ID_ChVxD6muqUYtESkMpHGkEQ)
> MIME-version: 1.0
> Content-type: text/plain; charset=us-ascii
> Content-transfer-encoding: 7BIT
> 
> 
> 
> --Boundary_(ID_ChVxD6muqUYtESkMpHGkEQ)--