threads / bug / 38707

Git merge driver / attributes bug in 2.3.1?

Subject: Git merge driver / attributes bug in 2.3.1?

## tl;dr

8 messages between Mar 5, 2015 and Mar 9, 2015.

replies: 7people: 3as markdown or json

Gondek, Andreas· Mar 5, 2015, 13:30 UTC · lore
Hello,
after upgrading the Git installation on one of our development servers from 1.9.0-rc3 to 2.3.1 we are experiencing strange behavior of merge drivers.
A merge driver registered as "* merge=<name_of_merge_driver>" in the .gitattributes is now executed even if there isn't any merge conflict. This only happens for files that are part of the merge.
This is reproducible in test repositories.
Greetings

Andreas Gondek Applications ________________________________

Deutsche WertpapierService Bank AG
ITTAS
Derendorfer Allee 2
40476 Düsseldorf
Tel.: +49 69 5099 9503
Fax: +49 69 5099 85 9503
E-Mail: Andreas.Gondek@dwpbank.de
http://www.dwpbank.de
Deutsche WertpapierService Bank AG | Wildunger Straße 14 | 60487 Frankfurt am Main
Sitz der AG: Frankfurt am Main, HRB 56913 | USt.-ID: DE 813759005
Vorstand: Thomas Klanten, Dr. Christian Tonnesen
Aufsichtsrat: Wilfried Groos (Vors.) 
Junio C Hamano· Mar 5, 2015, 18:55 UTC · re: Gondek, Andreas · lore

Re: Git merge driver / attributes bug in 2.3.1?

"Gondek, Andreas" <Andreas.Gondek@dwpbank.de> writes:
> after upgrading the Git installation on one of our development servers
> from 1.9.0-rc3 to 2.3.1 we are experiencing strange behavior of merge
> drivers.
Do you see the same with something slightly older, like say v2.2.0?

The only change that I can think of offhand that may be related is 6ea358f7 (ll-merge.c: refactor `read_merge_config()` to use `git_config_string()`, 2014-08-13) that went into v2.2.0, but I don't immediately see how that would be related X-<.

Michael J Gruber· Mar 6, 2015, 11:25 UTC · re: Gondek, Andreas · lore

Re: Git merge driver / attributes bug in 2.3.1?

Gondek, Andreas venit, vidit, dixit 05.03.2015 14:30:
Show 11 quoted lines
> Hello,
> 
> after upgrading the Git installation on one of our development
> servers from 1.9.0-rc3 to 2.3.1 we are experiencing strange behavior
> of merge drivers.
> 
> A merge driver registered as "* merge=<name_of_merge_driver>" in the
> .gitattributes is now executed even if there isn't any merge
> conflict. This only happens for files that are part of the merge.
> 
> This is reproducible in test repositories.
Can you share a minimal test repo?
I've been trying to reproduce this, unsuccessfully so far.

I guess it depends on how exactly those files are "part of the merge", and how the merge driver is set up. (I've tried with and without recursive.)

Michael
Gondek, Andreas· Mar 6, 2015, 13:31 UTC · re: Michael J Gruber · lore

AW: Git merge driver / attributes bug in 2.3.1?

The archive contains my test repository, the merge driver and the .gitconfig of the user. We don't have a global .gitconfig.
Mit freundlichen Grüßen

Andreas Gondek Applications ________________________________

Deutsche WertpapierService Bank AG
ITTAS
Derendorfer Allee 2
40476 Düsseldorf
Tel.: +49 69 5099 9503
Fax: +49 69 5099 85 9503
E-Mail: Andreas.Gondek@dwpbank.de
http://www.dwpbank.de
Deutsche WertpapierService Bank AG | Wildunger Straße 14 | 60487 Frankfurt am Main 
Sitz der AG: Frankfurt am Main, HRB 56913 | USt.-ID: DE 813759005 
Vorstand: Thomas Klanten, Dr. Christian Tonnesen
Aufsichtsrat: Wilfried Groos (Vors.)
-----Ursprüngliche Nachricht-----
Von: Michael J Gruber [mailto:git@drmicha.warpmail.net] 
Gesendet: Freitag, 6. März 2015 12:26
An: Gondek, Andreas; git@vger.kernel.org
Betreff: Re: Git merge driver / attributes bug in 2.3.1?
Gondek, Andreas venit, vidit, dixit 05.03.2015 14:30:
Show 11 quoted lines
> Hello,
> 
> after upgrading the Git installation on one of our development servers 
> from 1.9.0-rc3 to 2.3.1 we are experiencing strange behavior of merge 
> drivers.
> 
> A merge driver registered as "* merge=<name_of_merge_driver>" in the 
> .gitattributes is now executed even if there isn't any merge conflict. 
> This only happens for files that are part of the merge.
> 
> This is reproducible in test repositories.
Can you share a minimal test repo?
I've been trying to reproduce this, unsuccessfully so far.
I guess it depends on how exactly those files are "part of the merge", and how the merge driver is set up. (I've tried with and without recursive.)
Michael
Michael J Gruber· Mar 6, 2015, 14:12 UTC · re: Gondek, Andreas · lore

Re: Git merge driver / attributes bug in 2.3.1?

Gondek, Andreas venit, vidit, dixit 06.03.2015 14:31:
> The archive contains my test repository, the merge driver and the .gitconfig of the user. We don't have a global .gitconfig.
Thanks for the test repo!

Alas, the merge driver gets executed with v1.9.0-rc3, v1.8.5 and v1.7.0, at least over here - as it should be because of the conflict: two patches changing the same file. That conflict can be resolved automatically by the internal driver, of course. Maybe something else changed during the upgrade?

Michael
Junio C Hamano· Mar 6, 2015, 21:30 UTC · re: Michael J Gruber · lore

Re: Git merge driver / attributes bug in 2.3.1?

Michael J Gruber <git@drmicha.warpmail.net> writes:
Show 10 quoted lines
> Gondek, Andreas venit, vidit, dixit 06.03.2015 14:31:
>> The archive contains my test repository, the merge driver and the
> .gitconfig of the user. We don't have a global .gitconfig.
>
> Thanks for the test repo!
>
> Alas, the merge driver gets executed with v1.9.0-rc3, v1.8.5 and v1.7.0,
> at least over here - as it should be because of the conflict: two
> patches changing the same file. That conflict can be resolved
> automatically by the internal driver, of course.

That matches my expectation. The whole point to have the merge driver plug-in mechanism is to allow overriding the internal textual 3-way file-level merge, so we would have always called out to the custom driver when the tree-level merge machinery says that the content needs a file-level merge [*1*].

[Footnote]

*1* This is a tangent, but I've been wondering if we want some cases where the tree-level merge machinery currently says that there is no need for file-level merge to be fed to the merge driver.

Specifically, the tree-level merge machinery considers a case where you and the other party changed the files identically to be cleanly merged, but for contents of certain nature, that may not be always desirable.

Imagine that I and my wife are sharing a note to record what is in our refrigerator. After I buy a carton of milk, I'd do

    $ echo "1 carton of milk" >>fridge.txt
    $ git commit && git push
and my wife would do the same.
    $ echo "1 carton of milk" >>fridge.txt
    $ git commit && git push
which would not fast-forward, and then she would
    $ git pull

which would result in only one carton of milk in our fridge, even though when both of us got home, we will realize that we now have two of them.

Gondek, Andreas· Mar 9, 2015, 09:02 UTC · re: Junio C Hamano · lore

AW: Git merge driver / attributes bug in 2.3.1?

We used a merge driver to create a conflict semaphore file whenever a merge conflict occurs in Atlassian Stash. This worked for several month until we got to update our Git version because of another problem.
If I understand it correctly, a merge driver is executed before the normal internal merge happens? So I would need to call a git merge-file in my merge driver, test the result and return the exit code of the git merge-file?
Greetings

Andreas Gondek Applications ________________________________

Deutsche WertpapierService Bank AG
ITTAS
Derendorfer Allee 2
40476 Düsseldorf
Tel.: +49 69 5099 9503
Fax: +49 69 5099 85 9503
E-Mail: Andreas.Gondek@dwpbank.de
http://www.dwpbank.de
Deutsche WertpapierService Bank AG | Wildunger Straße 14 | 60487 Frankfurt am Main 
Sitz der AG: Frankfurt am Main, HRB 56913 | USt.-ID: DE 813759005 
Vorstand: Thomas Klanten, Dr. Christian Tonnesen
Aufsichtsrat: Wilfried Groos (Vors.)
-----Ursprüngliche Nachricht-----
Von: Junio C Hamano [mailto:gitster@pobox.com] 
Gesendet: Freitag, 6. März 2015 22:30
An: Michael J Gruber
Cc: Gondek, Andreas; git@vger.kernel.org
Betreff: Re: Git merge driver / attributes bug in 2.3.1?
Michael J Gruber <git@drmicha.warpmail.net> writes:
Show 10 quoted lines
> Gondek, Andreas venit, vidit, dixit 06.03.2015 14:31:
>> The archive contains my test repository, the merge driver and the
> .gitconfig of the user. We don't have a global .gitconfig.
>
> Thanks for the test repo!
>
> Alas, the merge driver gets executed with v1.9.0-rc3, v1.8.5 and 
> v1.7.0, at least over here - as it should be because of the conflict: 
> two patches changing the same file. That conflict can be resolved 
> automatically by the internal driver, of course.
That matches my expectation.  The whole point to have the merge driver plug-in mechanism is to allow overriding the internal textual 3-way file-level merge, so we would have always called out to the custom driver when the tree-level merge machinery says that the content needs a file-level merge [*1*].
[Footnote]
*1* This is a tangent, but I've been wondering if we want some cases where the tree-level merge machinery currently says that there is no need for file-level merge to be fed to the merge driver.
Specifically, the tree-level merge machinery considers a case where you and the other party changed the files identically to be cleanly merged, but for contents of certain nature, that may not be always desirable.
Imagine that I and my wife are sharing a note to record what is in our refrigerator.  After I buy a carton of milk, I'd do
    $ echo "1 carton of milk" >>fridge.txt
    $ git commit && git push
and my wife would do the same.
    $ echo "1 carton of milk" >>fridge.txt
    $ git commit && git push
which would not fast-forward, and then she would
    $ git pull
which would result in only one carton of milk in our fridge, even though when both of us got home, we will realize that we now have two of them.
Michael J Gruber· Mar 9, 2015, 09:35 UTC · re: Gondek, Andreas · lore

Re: Git merge driver / attributes bug in 2.3.1?

Gondek, Andreas venit, vidit, dixit 09.03.2015 10:02:
> We used a merge driver to create a conflict semaphore file whenever a
> merge conflict occurs in Atlassian Stash. This worked for several
> month until we got to update our Git version because of another
> problem.

That is the first issue: Can you reproduce with an older Git and your test repo the effect that you wanted to achieve?

I have tried a few older Git's with your test repo, and I always get the same behavior as with current Git (and as we would expect). So, something else has to be going on here.

> If I understand it correctly, a merge driver is executed before the
> normal internal merge happens? So I would need to call a git
> merge-file in my merge driver, test the result and return the exit
> code of the git merge-file?

First, the tree level merge checks whether the two sides introduce different changes to the same files. If not a simple tree level merge is done (which may or may not be OK, see Junio's shopping list example).

If yes (different changes to the same files), a merge driver is used, either an external one if specified, or the internal 3-way merge driver. But I'm not a merge expert ;)

If I understand correctly, you want to use the external merge driver to signal a conflict that git may miss otherwise?

On a side note, this discussion and the shopping list example show how badly a tool like git-dep(endency) can go wrong, just like the automatic merge. Just imagine a library change on one branch, and the introduction of a new call site following the old library calling convention on another branch. No dependency detected, clean tree-level merge by git, and fails to compile (hopefully) or run (worse). Automatic mergers can only guess, they are no code analyzers.

Michael

← back to recent threads