Re: Worrisome bug trend

From: Junio C Hamano <junkio@cox.net>
Date: Feb 27, 2007, 20:42 UTC
Message-ID: <7vodnfcoy1.fsf@assigned-by-dhcp.cox.net>
In-Reply-To: <45E493D3.7060407@vilain.net>

Sam Vilain <sam@vilain.net> writes:

Show 10 quoted lines

> Junio C Hamano wrote:
>> I take that as a sign that git hasn't been exercised well and
>> yet more ancient bugs are sleeping, waiting to be triggered, not
>> as a sign that we are very careful and adding only small number
>> of risky new code in the releases.
>>   
>
> No! It's a sign that there aren't enough tests :)
>
> Maybe investigate the coverage of the test suite?

I know we cover most of the success (expected) cases for things we care about, but at the same time I personally find that tests for failure cases (insane input, dataset expected to fail) are missing.

We do not need investigation.  We need a volunteer.

And perhaps a new patch/feature acceptance criteria that requires both expected behaviour and expected failure tests, but I am lazy ;-).