git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH v2 10/10] fetch: stop clobbering existing tags without --force

From
Ævar Arnfjörð Bjarmason <avarab@gmail.com>
Date
Jul 31, 2018, 13:07 UTC
Message-ID
<20180731130718.25222-11-avarab@gmail.com>
In-Reply-To
<20180429202100.32353-1-avarab@gmail.com>

Change "fetch" to treat "+" in refspecs (aka --force) to mean we should clobber a local tag of the same name.

This changes the long-standing behavior of "fetch" added in 853a3697dc ("[PATCH] Multi-head fetch.", 2005-08-20), before this change all tag fetches effectively had --force enabled. See the git-fetch-script code in fast_forward_local() with the comment:

    > Tags need not be pointing at commits so there is no way to
    > guarantee "fast-forward" anyway.

That commit and the rest of the history of "fetch" shows that the "+" (--force) part of refpecs was only conceived for branch updates, while tags have accepted any changes from upstream unconditionally and clobbered the local tag object. Changing this behavior has been discussed as early as 2011[1].

The current behavior doesn't make sense to me, it easily results in local tags accidentally being clobbered. We could namespace our tags per-remote and not locally populate refs/tags/*, but as with my 97716d217c ("fetch: add a --prune-tags option and fetch.pruneTags config", 2018-02-09) it's easier to work around the current implementation than to fix the root cause.

So this change implements suggestion #1 from Jeff's 2011 E-Mail[1], "fetch" now only clobbers the tag if either "+" is provided as part of the refspec, or if "--force" is provided on the command-line.

This also makes it nicely symmetrical with how "tag" itself works when creating tags. I.e. we refuse to clobber any existing tags unless "--force" is supplied. Now we can refuse all such clobbering, whether it would happen by clobbering a local tag with "tag", or by fetching it from the remote with "fetch".

It's still not at all nicely symmetrical with how "git push" works, as discussed in the updated pull-fetch-param.txt documentation, but this change brings them more into line with one another. I don't think there's any reason "fetch" couldn't fully converge with the behavior used by "push", but that's a topic for another change.

One of the tests added in 31b808a032 ("clone --single: limit the fetch refspec to fetched branch", 2012-09-20) is being changed to use --force where a clone would clobber a tag. This changes nothing about the existing behavior of the test.

1. https://public-inbox.org/git/20111123221658.GA22313@sigill.intra.peff.net/
Signed-off-by: Ævar Arnfjörð Bjarmason <avarab@gmail.com>
---
 Documentation/fetch-options.txt    | 15 ++++++++++-----
 Documentation/pull-fetch-param.txt | 20 +++++++++++++++-----
 builtin/fetch.c                    | 20 +++++++++++++-------
 t/t5516-fetch-push.sh              |  5 +++--
 t/t5612-clone-refspec.sh           |  4 ++--
 5 files changed, 43 insertions(+), 21 deletions(-)
diff --git a/Documentation/fetch-options.txt b/Documentation/fetch-options.txt
index 97d3217df9..5b624caf58 100644
--- a/Documentation/fetch-options.txt
+++ b/Documentation/fetch-options.txt
@@ -49,11 +49,16 @@ endif::git-pull[]
 
 -f::
 --force::
-	When 'git fetch' is used with `<rbranch>:<lbranch>`
-	refspec, it refuses to update the local branch
-	`<lbranch>` unless the remote branch `<rbranch>` it
-	fetches is a descendant of `<lbranch>`.  This option
-	overrides that check.
+	When 'git fetch' is used with `<src>:<dst>` refspec it may
+	refuse to update the local branch as discussed
+ifdef::git-pull[]
+	in the `<refspec>` part of the linkgit:git-fetch[1]
+	documentation.
+endif::git-pull[]
+ifndef::git-pull[]
+	in the `<refspec>` part below.
+endif::git-pull[]
+	This option overrides that check.
 
 -k::
 --keep::
diff --git a/Documentation/pull-fetch-param.txt b/Documentation/pull-fetch-param.txt
index f1fb08dc68..acb8e1a4f0 100644
--- a/Documentation/pull-fetch-param.txt
+++ b/Documentation/pull-fetch-param.txt
@@ -33,11 +33,21 @@ name.
 it requests fetching everything up to the given tag.
 +
 The remote ref that matches <src>
-is fetched, and if <dst> is not an empty string, the local
-ref that matches it is fast-forwarded using <src>.
-If the optional plus `+` is used, the local ref
-is updated even if it does not result in a fast-forward
-update.
+is fetched, and if <dst> is not an empty string, an attempt
+is made to update the local ref that matches it.
++
+Whether that update is allowed without `--force` depends on the ref
+namespace it's being fetched to, and the type of object being
+fetched. If it's a commit under `refs/heads/*` only fast-forwards are
+allowed.
++
+By having the optional leading `+` to a refspec (or using `--force`
+command line option) you can tell Git to update the local ref even if
+it is not allowed by its respective namespace clobbering rules.
++
+Before Git version 2.19 tag objects under `refs/tags/*` would not be
+protected from updates, but since then the `+` (or `--force`) syntax
+is required to clobber them.
 +
 [NOTE]
 When the remote branch you want to fetch is known to
diff --git a/builtin/fetch.c b/builtin/fetch.c
index ac06f6a576..683f70d71e 100644
--- a/builtin/fetch.c
+++ b/builtin/fetch.c
@@ -113,7 +113,7 @@ static struct option builtin_fetch_options[] = {
 		 N_("append to .git/FETCH_HEAD instead of overwriting")),
 	OPT_STRING(0, "upload-pack", &upload_pack, N_("path"),
 		   N_("path to upload pack on remote end")),
-	OPT__FORCE(&force, N_("force overwrite of local branch"), 0),
+	OPT__FORCE(&force, N_("force overwrite of local reference"), 0),
 	OPT_BOOL('m', "multiple", &multiple,
 		 N_("fetch from multiple remotes")),
 	OPT_SET_INT('t', "tags", &tags,
@@ -664,12 +664,18 @@ static int update_local_ref(struct ref *ref,
 
 	if (!is_null_oid(&ref->old_oid) &&
 	    starts_with(ref->name, "refs/tags/")) {
-		int r;
-		r = s_update_ref("updating tag", ref, 0);
-		format_display(display, r ? '!' : 't', _("[tag update]"),
-			       r ? _("unable to update local ref") : NULL,
-			       remote, pretty_ref, summary_width);
-		return r;
+		if (force || ref->force) {
+			int r;
+			r = s_update_ref("updating tag", ref, 0);
+			format_display(display, r ? '!' : 't', _("[tag update]"),
+				       r ? _("unable to update local ref") : NULL,
+				       remote, pretty_ref, summary_width);
+			return r;
+		} else {
+			format_display(display, '!', _("[rejected]"), _("would clobber existing tag"),
+				       remote, pretty_ref, summary_width);
+			return 1;
+		}
 	}
 
 	current = lookup_commit_reference_gently(&ref->old_oid, 1);
diff --git a/t/t5516-fetch-push.sh b/t/t5516-fetch-push.sh
index 8912312be7..8647f9cc9e 100755
--- a/t/t5516-fetch-push.sh
+++ b/t/t5516-fetch-push.sh
@@ -1015,7 +1015,7 @@ test_force_fetch_tag () {
 	tag_type_description=$1
 	tag_args=$2
 
-	test_expect_success "fetch will clobber an existing $tag_type_description" "
+	test_expect_success "fetch will not clobber an existing $tag_type_description without --force" "
 		mk_test testrepo heads/master &&
 		mk_child testrepo child1 &&
 		mk_child testrepo child2 &&
@@ -1027,7 +1027,8 @@ test_force_fetch_tag () {
 			git add file1 &&
 			git commit -m 'file1' &&
 			git tag $tag_args Tag &&
-			git -C ../child1 fetch origin tag Tag
+			test_must_fail git -C ../child1 fetch origin tag Tag &&
+			git -C ../child1 fetch origin '+refs/tags/*:refs/tags/*'
 		)
 	"
 }
diff --git a/t/t5612-clone-refspec.sh b/t/t5612-clone-refspec.sh
index fac5a73851..6ea8f50dae 100755
--- a/t/t5612-clone-refspec.sh
+++ b/t/t5612-clone-refspec.sh
@@ -104,7 +104,7 @@ test_expect_success 'clone with --no-tags' '
 test_expect_success '--single-branch while HEAD pointing at master' '
 	(
 		cd dir_master &&
-		git fetch &&
+		git fetch --force &&
 		git for-each-ref refs/remotes/origin |
 		sed -e "/HEAD$/d" \
 		    -e "s|/remotes/origin/|/heads/|" >../actual
@@ -115,7 +115,7 @@ test_expect_success '--single-branch while HEAD pointing at master' '
 	test_cmp expect actual &&
 	(
 		cd dir_master &&
-		git fetch --tags &&
+		git fetch --tags --force &&
 		git for-each-ref refs/tags >../actual
 	) &&
 	git for-each-ref refs/tags >expect &&
-- 
2.18.0.345.g5c9ce644c3
Previous: Ævar Arnfjörð BjarmasonNext: Junio C Hamano
Message 99 of 101 in “Fetching tags overwrites existing tags”
  1. Wink SavilleApr 24, 2018
  2. Jacob KellerApr 24, 2018
  3. Junio C HamanoApr 25, 2018
  4. Jacob KellerApr 25, 2018
  5. Wink SavilleApr 25, 2018
  6. Wink SavilleApr 26, 2018
  7. Junio C HamanoApr 26, 2018
  8. Junio C HamanoApr 26, 2018
  9. Teach remote add the --prefix-tags optionWink Saville, Apr 27, 2018
  10. Wink SavilleApr 27, 2018
  11. Bryan TurnerApr 27, 2018
  12. Jacob KellerMay 4, 2018
  13. Jacob KellerApr 28, 2018
  14. Teach remote add the --remote-tags optionWink Saville, Apr 28, 2018
  15. Wink SavilleApr 28, 2018
  16. Wink SavilleApr 28, 2018
  17. 0/3 Optional sub hierarchy for remote tagsWink Saville, May 1, 2018
  18. 1/3 Teach remote add the --remote-tags optionWink Saville, May 1, 2018
  19. Ævar Arnfjörð BjarmasonMay 1, 2018
  20. Kaartic SivaraamMay 8, 2018
  21. 2/3 Teach tag to list remote-tagsWink Saville, May 1, 2018
  22. 3/3 Test git remote add -f --remote-tagsWink Saville, May 1, 2018
  23. Ævar Arnfjörð BjarmasonMay 1, 2018
  24. Jacob KellerMay 1, 2018
  25. Wink SavilleMay 1, 2018
  26. Junio C HamanoMay 1, 2018
  27. Jacob KellerMay 2, 2018
  28. Junio C HamanoMay 1, 2018
  29. Ævar Arnfjörð BjarmasonApr 27, 2018
  30. 0/8 "git fetch" should not clobber existing tags without --forceÆvar Arnfjörð Bjarmason, Apr 29, 2018
  31. 1/8 push tests: remove redundant 'git push' invocationÆvar Arnfjörð Bjarmason, Apr 29, 2018
  32. 2/8 push tests: fix logic error in "push" test assertionÆvar Arnfjörð Bjarmason, Apr 29, 2018
  33. 3/8 push tests: add more testing for forced tag pushingÆvar Arnfjörð Bjarmason, Apr 29, 2018
  34. Kaartic SivaraamMay 7, 2018
  35. Junio C HamanoMay 8, 2018
  36. Junio C HamanoMay 8, 2018
  37. Kaartic SivaraamMay 8, 2018
  38. Kaartic SivaraamMay 8, 2018
  39. 4/8 push tests: assert re-pushing annotated tagsÆvar Arnfjörð Bjarmason, Apr 29, 2018
  40. Junio C HamanoMay 8, 2018
  41. SZEDER GáborMay 8, 2018
  42. 6/8 fetch tests: correct a comment "remove it" -> "remove them"Ævar Arnfjörð Bjarmason, Apr 29, 2018
  43. 5/8 push doc: correct lies about how push refspecs workÆvar Arnfjörð Bjarmason, Apr 29, 2018
  44. Junio C HamanoMay 8, 2018
  45. 8/8 fetch: stop clobbering existing tags without --forceÆvar Arnfjörð Bjarmason, Apr 29, 2018
  46. Junio C HamanoMay 8, 2018
  47. 7/8 fetch tests: add a test clobbering tag behaviorÆvar Arnfjörð Bjarmason, Apr 29, 2018
  48. 00/10 "git fetch" should not clobber existing tags without --forceÆvar Arnfjörð Bjarmason, Jul 31, 2018
  49. 0/7 Prep for "git fetch" should not clobber existing tags without --forceÆvar Arnfjörð Bjarmason, Aug 13, 2018
  50. Junio C HamanoAug 13, 2018
  51. Ævar Arnfjörð BjarmasonAug 13, 2018
  52. 0/6 "git fetch" should not clobber existing tags without --forceÆvar Arnfjörð Bjarmason, Aug 30, 2018
  53. 0/9 git fetch" should not clobber existing tags without --forceÆvar Arnfjörð Bjarmason, Aug 31, 2018
  54. 1/9 fetch: change "branch" to "reference" in --force -h outputÆvar Arnfjörð Bjarmason, Aug 31, 2018
  55. 2/9 push tests: make use of unused $1 in test descriptionÆvar Arnfjörð Bjarmason, Aug 31, 2018
  56. Junio C HamanoAug 31, 2018
  57. Ævar Arnfjörð BjarmasonAug 31, 2018
  58. 3/9 push tests: use spaces in interpolated stringÆvar Arnfjörð Bjarmason, Aug 31, 2018
  59. 4/9 fetch tests: add a test for clobbering tag behaviorÆvar Arnfjörð Bjarmason, Aug 31, 2018
  60. 5/9 push doc: remove confusing mention of remote mergerÆvar Arnfjörð Bjarmason, Aug 31, 2018
  61. 6/9 push doc: move mention of "tag <tag>" later in the proseÆvar Arnfjörð Bjarmason, Aug 31, 2018
  62. 7/9 push doc: correct lies about how push refspecs workÆvar Arnfjörð Bjarmason, Aug 31, 2018
  63. 8/9 fetch: document local ref updates with/without --forceÆvar Arnfjörð Bjarmason, Aug 31, 2018
  64. 9/9 fetch: stop clobbering existing tags without --forceÆvar Arnfjörð Bjarmason, Aug 31, 2018
  65. 1/6 fetch: change "branch" to "reference" in --force -h outputÆvar Arnfjörð Bjarmason, Aug 30, 2018
  66. 2/6 push tests: correct quoting in interpolated stringÆvar Arnfjörð Bjarmason, Aug 30, 2018
  67. Junio C HamanoAug 30, 2018
  68. 3/6 fetch tests: add a test for clobbering tag behaviorÆvar Arnfjörð Bjarmason, Aug 30, 2018
  69. Junio C HamanoAug 30, 2018
  70. 4/6 push doc: correct lies about how push refspecs workÆvar Arnfjörð Bjarmason, Aug 30, 2018
  71. Junio C HamanoAug 30, 2018
  72. Ævar Arnfjörð BjarmasonAug 30, 2018
  73. Junio C HamanoAug 31, 2018
  74. Ævar Arnfjörð BjarmasonAug 31, 2018
  75. 5/6 fetch: document local ref updates with/without --forceÆvar Arnfjörð Bjarmason, Aug 30, 2018
  76. 6/6 fetch: stop clobbering existing tags without --forceÆvar Arnfjörð Bjarmason, Aug 30, 2018
  77. Junio C HamanoAug 30, 2018
  78. 2/7 push tests: remove redundant 'git push' invocationÆvar Arnfjörð Bjarmason, Aug 13, 2018
  79. 3/7 push tests: fix logic error in "push" test assertionÆvar Arnfjörð Bjarmason, Aug 13, 2018
  80. 4/7 push tests: add more testing for forced tag pushingÆvar Arnfjörð Bjarmason, Aug 13, 2018
  81. 5/7 push tests: assert re-pushing annotated tagsÆvar Arnfjörð Bjarmason, Aug 13, 2018
  82. 6/7 fetch tests: correct a comment "remove it" -> "remove them"Ævar Arnfjörð Bjarmason, Aug 13, 2018
  83. 7/7 pull doc: fix a long-standing grammar errorÆvar Arnfjörð Bjarmason, Aug 13, 2018
  84. 1/7 fetch tests: change "Tag" test tag to "testTag"Ævar Arnfjörð Bjarmason, Aug 13, 2018
  85. 01/10 fetch tests: change "Tag" test tag to "testTag"Ævar Arnfjörð Bjarmason, Jul 31, 2018
  86. 02/10 push tests: remove redundant 'git push' invocationÆvar Arnfjörð Bjarmason, Jul 31, 2018
  87. 03/10 push tests: fix logic error in "push" test assertionÆvar Arnfjörð Bjarmason, Jul 31, 2018
  88. 04/10 push tests: add more testing for forced tag pushingÆvar Arnfjörð Bjarmason, Jul 31, 2018
  89. 05/10 push tests: assert re-pushing annotated tagsÆvar Arnfjörð Bjarmason, Jul 31, 2018
  90. 06/10 push doc: correct lies about how push refspecs workÆvar Arnfjörð Bjarmason, Jul 31, 2018
  91. Junio C HamanoJul 31, 2018
  92. Ævar Arnfjörð BjarmasonAug 30, 2018
  93. Junio C HamanoAug 30, 2018
  94. Ævar Arnfjörð BjarmasonAug 30, 2018
  95. 08/10 fetch tests: add a test clobbering tag behaviorÆvar Arnfjörð Bjarmason, Jul 31, 2018
  96. Junio C HamanoJul 31, 2018
  97. 07/10 fetch tests: correct a comment "remove it" -> "remove them"Ævar Arnfjörð Bjarmason, Jul 31, 2018
  98. 09/10 pull doc: fix a long-standing grammar errorÆvar Arnfjörð Bjarmason, Jul 31, 2018
  99. 10/10 fetch: stop clobbering existing tags without --forceÆvar Arnfjörð Bjarmason, Jul 31, 2018
  100. Junio C HamanoJul 31, 2018
  101. Wink SavilleMay 1, 2018

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.