Re: Worrisome bug trend

From: Johannes Schindelin <johannes.schindelin@gmx.de>
Date: Feb 27, 2007, 20:44 UTC
Message-ID: <Pine.LNX.4.63.0702272143340.22628@wbgn013.biozentrum.uni-wuerzburg.de>
In-Reply-To: <7vodnfcoy1.fsf@assigned-by-dhcp.cox.net>

Hi,

On Tue, 27 Feb 2007, Junio C Hamano wrote:

Show 19 quoted lines

> Sam Vilain <sam@vilain.net> writes:
> 
> > Junio C Hamano wrote:
> >> I take that as a sign that git hasn't been exercised well and
> >> yet more ancient bugs are sleeping, waiting to be triggered, not
> >> as a sign that we are very careful and adding only small number
> >> of risky new code in the releases.
> >>   
> >
> > No! It's a sign that there aren't enough tests :)
> >
> > Maybe investigate the coverage of the test suite?
> 
> I know we cover most of the success (expected) cases for things
> we care about, but at the same time I personally find that tests
> for failure cases (insane input, dataset expected to fail) are
> missing.
> 
> We do not need investigation.  We need a volunteer.

Maybe a Summer of Code project?

> And perhaps a new patch/feature acceptance criteria that requires both 
> expected behaviour and expected failure tests, but I am lazy ;-).

I think that's okay. Many, many new features and bug fixes come with tests. I think that we do not have _few_ tests. At least not comparing to other projects (especially commercial ones...).

Ciao, Dscho