git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH v3 1/1] upload-pack.c: fix filter spec quoting bug

From
Jacob Vosmaer <jacob@gitlab.com>
Date
Jan 25, 2021, 23:09 UTC
Message-ID
<20210125230952.15468-2-jacob@gitlab.com>
In-Reply-To
<20210125230952.15468-1-jacob@gitlab.com>

This fixes a bug that occurs when you combine partial clone and uploadpack.packobjectshook. You can reproduce it as follows:

git clone -u 'git -c uploadpack.allowfilter '\ '-c uploadpack.packobjectshook=env '\ 'upload-pack' --filter=blob:none --no-local \ src.git dst.git

Be careful with the line endings because this has a long quoted string as the -u argument.

The error I get when I run this is:

Cloning into '/tmp/broken'... remote: fatal: invalid filter-spec ''blob:none'' error: git upload-pack: git-pack-objects died with error. fatal: git upload-pack: aborting due to possible repository corruption on the remote side. remote: aborting due to possible repository corruption on the remote side. fatal: early EOF fatal: index-pack failed

The problem is an unnecessary and harmful layer of quoting. I tried digging through the history of this function and I think this quoting was there from the start. My best guess is that it stems from a misunderstanding what use_shell=1 means. The code seems to assume it means "arguments get joined into one big string, then fed to /bin/sh". But that is not what it means: use_shell=1 means that the first argument in the arguments array may be a shell script and if so should be passed to /bin/sh. All other arguments are passed as normal arguments.

The solution is simple: never quote the filter spec.

This commit removes the conditional quoting and adds a test for partial clone in t5544.

Signed-off-by: Jacob Vosmaer <jacob@gitlab.com>
---
 t/t5544-pack-objects-hook.sh | 9 +++++++++
 upload-pack.c                | 9 +--------
 2 files changed, 10 insertions(+), 8 deletions(-)
diff --git a/t/t5544-pack-objects-hook.sh b/t/t5544-pack-objects-hook.sh
index 4357af1525..f5ba663d64 100755
--- a/t/t5544-pack-objects-hook.sh
+++ b/t/t5544-pack-objects-hook.sh
@@ -59,4 +59,13 @@ test_expect_success 'hook does not run from repo config' '
 	test_path_is_missing .git/hook.stdout
 '
 
+test_expect_success 'hook works with partial clone' '
+	clear_hook_results &&
+	test_config_global uploadpack.packObjectsHook ./hook &&
+	test_config_global uploadpack.allowFilter true &&
+	git clone --bare --no-local --filter=blob:none . dst.git &&
+	git -C dst.git rev-list --objects --missing=print HEAD >objects &&
+	grep "^?" objects
+'
+
 test_done
diff --git a/upload-pack.c b/upload-pack.c
index 3b66bf92ba..eae1fdbc55 100644
--- a/upload-pack.c
+++ b/upload-pack.c
@@ -305,14 +305,7 @@ static void create_pack_file(struct upload_pack_data *pack_data,
 	if (pack_data->filter_options.choice) {
 		const char *spec =
 			expand_list_objects_filter_spec(&pack_data->filter_options);
-		if (pack_objects.use_shell) {
-			struct strbuf buf = STRBUF_INIT;
-			sq_quote_buf(&buf, spec);
-			strvec_pushf(&pack_objects.args, "--filter=%s", buf.buf);
-			strbuf_release(&buf);
-		} else {
-			strvec_pushf(&pack_objects.args, "--filter=%s", spec);
-		}
+		strvec_pushf(&pack_objects.args, "--filter=%s", spec);
 	}
 	if (uri_protocols) {
 		for (i = 0; i < uri_protocols->nr; i++)
-- 
2.30.0
Previous: Jacob VosmaerNext: Ævar Arnfjörð Bjarmason
Message 3 of 24 in “Re: [PATCH v2] upload-pack.c: fix filter spec quoting bug”
  1. Jeff KingJan 25, 2021
  2. 0/1 upload-pack.c: fix filter spec quoting bugJacob Vosmaer, Jan 25, 2021
  3. 1/1 upload-pack.c: fix filter spec quoting bugJacob Vosmaer, Jan 25, 2021
  4. Ævar Arnfjörð BjarmasonJan 26, 2021
  5. Jacob VosmaerJan 26, 2021
  6. Junio C HamanoJan 26, 2021
  7. Jeff KingJan 26, 2021
  8. upload-pack.c: fix filter spec quoting bugJacob Vosmaer, Jan 28, 2021
  9. Junio C HamanoJan 26, 2021
  10. Jeff KingJan 26, 2021
  11. Junio C HamanoJan 26, 2021
  12. Junio C HamanoJan 26, 2021
  13. Jacob VosmaerJan 28, 2021
  14. Jacob VosmaerJan 28, 2021
  15. Jeff KingJan 28, 2021
  16. Jacob VosmaerFeb 1, 2021
  17. Junio C HamanoJan 28, 2021
  18. 0/1 upload-pack.c: fix filter spec quoting bugJacob Vosmaer, Feb 1, 2021
  19. 1/1 upload-pack.c: fix filter spec quoting bugJacob Vosmaer, Feb 1, 2021
  20. Junio C HamanoFeb 2, 2021
  21. 1/1 t5544: clarify 'hook works with partial clone' testJacob Vosmaer, Feb 2, 2021
  22. Eric SunshineFeb 2, 2021
  23. t5544: clarify 'hook works with partial clone' testJacob Vosmaer, Feb 2, 2021
  24. Junio C HamanoFeb 2, 2021

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.