threads / rfc / 21777

RFC patcht7011: Mark fixed test as such

Subject: [RFC/PATCH] t7011: Mark fixed test as such

## tl;dr

6 messages between Nov 28, 2009 and Nov 30, 2009. Diffs are folded; open one to read it.

replies: 5people: 2as markdown or json

Michael J Gruber· Nov 28, 2009, 18:24 UTC · lore

Test 16/17 had been fixed since its introduction in b4d1690 (Teach Git to respect skip-worktree bit (reading part), 2009-08-20). So, mark it as expect_success rather than expect_failure.

Signed-off-by: Michael J Gruber <git@drmicha.warpmail.net>
---
I'm actually wondering about 17/17 as well.
If commit is called with a file name then shouldn't it simply commit the
current state of the file in the worktree, no matter what the index or
skip-worktree say? I therefore think 17/17 should be expect_success
and have no test_must_fail.
 t/t7011-skip-worktree-reading.sh |    2 +-
 1 files changed, 1 insertions(+), 1 deletions(-)
Show changes to t/t7011-skip-worktree-reading.sh +1 −1
diff --git a/t/t7011-skip-worktree-reading.sh b/t/t7011-skip-worktree-reading.sh
index e996928..8960dd9 100755
--- a/t/t7011-skip-worktree-reading.sh
+++ b/t/t7011-skip-worktree-reading.sh
@@ -148,7 +148,7 @@ test_expect_success 'git-rm succeeds on skip-worktree absent entries' '
 	git rm 1
 '
 
-test_expect_failure 'commit on skip-worktree absent entries' '
+test_expect_success 'commit on skip-worktree absent entries' '
 	git reset &&
 	setup_absent &&
 	test_must_fail git commit -m null 1
-- 
1.6.6.rc0.274.g71380
Nguyen Thai Ngoc Duy· Nov 29, 2009, 08:47 UTC · re: Michael J Gruber · lore

Re: [RFC/PATCH] t7011: Mark fixed test as such

On 11/29/09, Michael J Gruber <git@drmicha.warpmail.net> wrote:
Show 5 quoted lines
> Test 16/17 had been fixed since its introduction in b4d1690 (Teach Git
>  to respect skip-worktree bit (reading part), 2009-08-20). So, mark it as
>  expect_success rather than expect_failure.
>
>  Signed-off-by: Michael J Gruber <git@drmicha.warpmail.net>
No ACK. See below.
Show 6 quoted lines
>  ---
>  I'm actually wondering about 17/17 as well.
>  If commit is called with a file name then shouldn't it simply commit the
>  current state of the file in the worktree, no matter what the index or
>  skip-worktree say? I therefore think 17/17 should be expect_success
>  and have no test_must_fail.

Both 16/17 and 17/17 ensure that Git won't look at files on worktree if they are marked as skip-worktree (by definition of skip-worktree, you can safely ignore worktree, otherwise you would not mark them as such). 16/17 happens to pass, not because it does not touch worktree, but because the base index does not have "1", which happens to is the same situation in 16/17 (test commit when "1" is gone). The result is OK but it is actually not (17/17 shows this clearer as it commits the worktree version).

-- 
Duy
Michael J Gruber· Nov 29, 2009, 13:57 UTC · re: Nguyen Thai Ngoc Duy · lore

Re: [RFC/PATCH] t7011: Mark fixed test as such

Nguyen Thai Ngoc Duy venit, vidit, dixit 29.11.2009 09:47:
Show 24 quoted lines
> On 11/29/09, Michael J Gruber <git@drmicha.warpmail.net> wrote:
>> Test 16/17 had been fixed since its introduction in b4d1690 (Teach Git
>>  to respect skip-worktree bit (reading part), 2009-08-20). So, mark it as
>>  expect_success rather than expect_failure.
>>
>>  Signed-off-by: Michael J Gruber <git@drmicha.warpmail.net>
> 
> No ACK. See below.
> 
>>  ---
>>  I'm actually wondering about 17/17 as well.
>>  If commit is called with a file name then shouldn't it simply commit the
>>  current state of the file in the worktree, no matter what the index or
>>  skip-worktree say? I therefore think 17/17 should be expect_success
>>  and have no test_must_fail.
> 
> Both 16/17 and 17/17 ensure that Git won't look at files on worktree
> if they are marked as skip-worktree (by definition of skip-worktree,
> you can safely ignore worktree, otherwise you would not mark them as
> such). 16/17 happens to pass, not because it does not touch worktree,
> but because the base index does not have "1", which happens to is the
> same situation in 16/17 (test commit when "1" is gone). The result is
> OK but it is actually not (17/17 shows this clearer as it commits the
> worktree version).

On 16/17, I really cannot agree. You explain that you expect the test to succeed (we agree here), but that it succeeds for the wrong reasons. So it should be either "expect_success", or the test itself should be changed so that it really tests what it intends to, otherwise it raises a wrong "FIXED". I suggested and submitted the former.

On 17/17, it's not clear what should happen. "skip-worktree" says ignore the worktree and look in the index instead of accessing worktree files. But "git commit file" says ignore the index and stage and commit the file from the worktree directly. And that is exactly what happens:

You say "git commit file". That means "ignore the index". That also means that git ignores the skip-worktree bit which is set in the index. Therefore, file is committed with the content is has in the worktree.

I'm going by the documentation for git-update-index and git-commit. It could be that they are wrong, too, but they agree with the code, so what's the reference for saying both code and documentation are wrong?

Michael
Nguyen Thai Ngoc Duy· Nov 30, 2009, 01:56 UTC · re: Michael J Gruber · lore

Re: [RFC/PATCH] t7011: Mark fixed test as such

On Sun, Nov 29, 2009 at 8:57 PM, Michael J Gruber <git@drmicha.warpmail.net> wrote:

Show 31 quoted lines
> Nguyen Thai Ngoc Duy venit, vidit, dixit 29.11.2009 09:47:
>> On 11/29/09, Michael J Gruber <git@drmicha.warpmail.net> wrote:
>>> Test 16/17 had been fixed since its introduction in b4d1690 (Teach Git
>>>  to respect skip-worktree bit (reading part), 2009-08-20). So, mark it as
>>>  expect_success rather than expect_failure.
>>>
>>>  Signed-off-by: Michael J Gruber <git@drmicha.warpmail.net>
>>
>> No ACK. See below.
>>
>>>  ---
>>>  I'm actually wondering about 17/17 as well.
>>>  If commit is called with a file name then shouldn't it simply commit the
>>>  current state of the file in the worktree, no matter what the index or
>>>  skip-worktree say? I therefore think 17/17 should be expect_success
>>>  and have no test_must_fail.
>>
>> Both 16/17 and 17/17 ensure that Git won't look at files on worktree
>> if they are marked as skip-worktree (by definition of skip-worktree,
>> you can safely ignore worktree, otherwise you would not mark them as
>> such). 16/17 happens to pass, not because it does not touch worktree,
>> but because the base index does not have "1", which happens to is the
>> same situation in 16/17 (test commit when "1" is gone). The result is
>> OK but it is actually not (17/17 shows this clearer as it commits the
>> worktree version).
>
> On 16/17, I really cannot agree. You explain that you expect the test to
> succeed (we agree here), but that it succeeds for the wrong reasons. So
> it should be either "expect_success", or the test itself should be
> changed so that it really tests what it intends to, otherwise it raises
> a wrong "FIXED". I suggested and submitted the former.

That was my bad in setting up the environment for 16/17. I will fix that in the next roll of nd/sparse.

Show 10 quoted lines
> On 17/17, it's not clear what should happen. "skip-worktree" says ignore
> the worktree and look in the index instead of accessing worktree files.
> But "git commit file" says ignore the index and stage and commit the
> file from the worktree directly. And that is exactly what happens:
>
> You say "git commit file".
> That means "ignore the index".
> That also means that git ignores the skip-worktree bit which is set in
> the index.
> Therefore, file is committed with the content is has in the worktree.

To me, no command should break out skip-worktree mask. In reality I would expect that case 17/17 only happens when a user accidentally leaves a file that is marked skip-worktree and tries to commit it. An error would be more appropriate to keep consistency with other commands ("git diff HEAD -- 1" would show nothing before committing), and to warn the user that he/she is stepping on the border. He/she can then choose to extend worktree area if still wants to commit that file. How does that sound?

> I'm going by the documentation for git-update-index and git-commit. It
> could be that they are wrong, too, but they agree with the code, so
> what's the reference for saying both code and documentation are wrong?

Both code and documentation are for Git without skip-worktree. If you agree with my reasoning above, I will update documentation to reflect this too.

-- 
Duy
Michael J Gruber· Nov 30, 2009, 12:49 UTC · re: Nguyen Thai Ngoc Duy · lore

Re: [RFC/PATCH] t7011: Mark fixed test as such

Nguyen Thai Ngoc Duy venit, vidit, dixit 30.11.2009 02:56:
Show 64 quoted lines
> On Sun, Nov 29, 2009 at 8:57 PM, Michael J Gruber
> <git@drmicha.warpmail.net> wrote:
>> Nguyen Thai Ngoc Duy venit, vidit, dixit 29.11.2009 09:47:
>>> On 11/29/09, Michael J Gruber <git@drmicha.warpmail.net> wrote:
>>>> Test 16/17 had been fixed since its introduction in b4d1690 (Teach Git
>>>>  to respect skip-worktree bit (reading part), 2009-08-20). So, mark it as
>>>>  expect_success rather than expect_failure.
>>>>
>>>>  Signed-off-by: Michael J Gruber <git@drmicha.warpmail.net>
>>>
>>> No ACK. See below.
>>>
>>>>  ---
>>>>  I'm actually wondering about 17/17 as well.
>>>>  If commit is called with a file name then shouldn't it simply commit the
>>>>  current state of the file in the worktree, no matter what the index or
>>>>  skip-worktree say? I therefore think 17/17 should be expect_success
>>>>  and have no test_must_fail.
>>>
>>> Both 16/17 and 17/17 ensure that Git won't look at files on worktree
>>> if they are marked as skip-worktree (by definition of skip-worktree,
>>> you can safely ignore worktree, otherwise you would not mark them as
>>> such). 16/17 happens to pass, not because it does not touch worktree,
>>> but because the base index does not have "1", which happens to is the
>>> same situation in 16/17 (test commit when "1" is gone). The result is
>>> OK but it is actually not (17/17 shows this clearer as it commits the
>>> worktree version).
>>
>> On 16/17, I really cannot agree. You explain that you expect the test to
>> succeed (we agree here), but that it succeeds for the wrong reasons. So
>> it should be either "expect_success", or the test itself should be
>> changed so that it really tests what it intends to, otherwise it raises
>> a wrong "FIXED". I suggested and submitted the former.
> 
> That was my bad in setting up the environment for 16/17. I will fix
> that in the next roll of nd/sparse.
> 
>> On 17/17, it's not clear what should happen. "skip-worktree" says ignore
>> the worktree and look in the index instead of accessing worktree files.
>> But "git commit file" says ignore the index and stage and commit the
>> file from the worktree directly. And that is exactly what happens:
>>
>> You say "git commit file".
>> That means "ignore the index".
>> That also means that git ignores the skip-worktree bit which is set in
>> the index.
>> Therefore, file is committed with the content is has in the worktree.
> 
> To me, no command should break out skip-worktree mask. In reality I
> would expect that case 17/17 only happens when a user accidentally
> leaves a file that is marked skip-worktree and tries to commit it. An
> error would be more appropriate to keep consistency with other
> commands ("git diff HEAD -- 1" would show nothing before committing),
> and to warn the user that he/she is stepping on the border. He/she can
> then choose to extend worktree area if still wants to commit that
> file. How does that sound?
> 
>> I'm going by the documentation for git-update-index and git-commit. It
>> could be that they are wrong, too, but they agree with the code, so
>> what's the reference for saying both code and documentation are wrong?
> 
> Both code and documentation are for Git without skip-worktree. If you
> agree with my reasoning above, I will update documentation to reflect
> this too.

Thanks for the clarification. I see the background behind 17/17 now. I think git-commit.txt needs a careful update then, because the explanation of a common feature (git commit file) should not get confusing because of a not so common feature (skip-worktree/sparse co).

Regarding 16/17: Seeing a FIXED is very misleading. I caught it during my work on a patch series and was confused. FIXED usually occurs only while working on a fix, before adjusting the test. So, unless the reroll of nd/sparse is to happen very soon, I still suggest marking it as expect_success as proposed, and then modifying the test during the reroll.

Cheers, Michael

Nguyen Thai Ngoc Duy· Nov 30, 2009, 13:18 UTC · re: Michael J Gruber · lore

Re: [RFC/PATCH] t7011: Mark fixed test as such

On 11/30/09, Michael J Gruber <git@drmicha.warpmail.net> wrote:
Show 5 quoted lines
>  Regarding 16/17: Seeing a FIXED is very misleading. I caught it during
>  my work on a patch series and was confused. FIXED usually occurs only
>  while working on a fix, before adjusting the test. So, unless the reroll
>  of nd/sparse is to happen very soon, I still suggest marking it as
>  expect_success as proposed, and then modifying the test during the reroll.

I won't work on it until this weekend. If you insist, then better put command "true" after test_must_fail to indicate that the test is broken (could be line-wrapped by gmail, but it's simple enough to recreate)

Show changes to t/t7011-skip-worktree-reading.sh +1 −0
diff --git a/t/t7011-skip-worktree-reading.sh b/t/t7011-skip-worktree-reading.sh
index e996928..da8dcbb 100755
--- a/t/t7011-skip-worktree-reading.sh
+++ b/t/t7011-skip-worktree-reading.sh
@@ -152,6 +152,7 @@ test_expect_failure 'commit on skip-worktree
absent entries' '
 	git reset &&
 	setup_absent &&
 	test_must_fail git commit -m null 1
+	true
 '

 test_expect_failure 'commit on skip-worktree dirty entries' '
-- 
Duy

← back to recent threads