git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH v5 04/14] fetch: add object filtering for partial fetch

From
JHJeff Hostetler <git@jeffhostetler.com>
Date
Nov 21, 2017, 21:15 UTC
Message-ID
<20171121211528.21891-5-git@jeffhostetler.com>
In-Reply-To
<20171121211528.21891-1-git@jeffhostetler.com>
From: Jeff Hostetler <jeffhost@microsoft.com>

Teach fetch to use the list-objects filtering parameters to allow a "partial fetch" following a "partial clone".

Signed-off-by: Jeff Hostetler <jeffhost@microsoft.com>
---
 builtin/fetch.c | 20 ++++++++++++++++++++
 1 file changed, 20 insertions(+)
diff --git a/builtin/fetch.c b/builtin/fetch.c
index 1b1f039..29d3807 100644
--- a/builtin/fetch.c
+++ b/builtin/fetch.c
@@ -18,6 +18,7 @@
 #include "argv-array.h"
 #include "utf8.h"
 #include "packfile.h"
+#include "list-objects-filter-options.h"
 
 static const char * const builtin_fetch_usage[] = {
 	N_("git fetch [<options>] [<repository> [<refspec>...]]"),
@@ -55,6 +56,7 @@ static int recurse_submodules_default = RECURSE_SUBMODULES_ON_DEMAND;
 static int shown_url = 0;
 static int refmap_alloc, refmap_nr;
 static const char **refmap_array;
+static struct list_objects_filter_options filter_options;
 
 static int git_fetch_config(const char *k, const char *v, void *cb)
 {
@@ -160,6 +162,7 @@ static struct option builtin_fetch_options[] = {
 			TRANSPORT_FAMILY_IPV4),
 	OPT_SET_INT('6', "ipv6", &family, N_("use IPv6 addresses only"),
 			TRANSPORT_FAMILY_IPV6),
+	OPT_PARSE_LIST_OBJECTS_FILTER(&filter_options),
 	OPT_END()
 };
 
@@ -1044,6 +1047,9 @@ static struct transport *prepare_transport(struct remote *remote, int deepen)
 		set_option(transport, TRANS_OPT_DEEPEN_RELATIVE, "yes");
 	if (update_shallow)
 		set_option(transport, TRANS_OPT_UPDATE_SHALLOW, "yes");
+	if (filter_options.choice)
+		set_option(transport, TRANS_OPT_LIST_OBJECTS_FILTER,
+			   filter_options.filter_spec);
 	return transport;
 }
 
@@ -1242,6 +1248,20 @@ static int fetch_multiple(struct string_list *list)
 	int i, result = 0;
 	struct argv_array argv = ARGV_ARRAY_INIT;
 
+	if (filter_options.choice) {
+		/*
+		 * We currently only support partial-fetches to the remote
+		 * used for the partial-clone because we only support 1
+		 * promisor remote, so we DO NOT allow explicit command
+		 * line filter arguments for multi-fetches.
+		 *
+		 * Note that the loop below will spawn background fetches
+		 * for each remote and one of them MAY INHERIT the proper
+		 * partial-fetch settings, so everything is consistent.
+		 */
+		die(_("partial-fetch is not supported on multiple remotes"));
+	}
+
 	if (!append && !dry_run) {
 		int errcode = truncate_fetch_head();
 		if (errcode)
-- 
2.9.3
Previous: Jeff HostetlerNext: Jeff Hostetler
Message 3 of 15 in “Parial clone part 3: clone, fetch, fetch-pack, upload-pack, and tests”
  1. 00/14 Parial clone part 3: clone, fetch, fetch-pack, upload-pack, and testsJeff Hostetler, Nov 21, 2017
  2. 01/14 upload-pack: add object filtering for partial cloneJeff Hostetler, Nov 21, 2017
  3. 04/14 fetch: add object filtering for partial fetchJeff Hostetler, Nov 21, 2017
  4. 09/14 fetch: add from_promisor and exclude-promisor-objects parametersJeff Hostetler, Nov 21, 2017
  5. 06/14 pack-objects: test support for blob filteringJeff Hostetler, Nov 21, 2017
  6. 05/14 remote-curl: add object filtering for partial cloneJeff Hostetler, Nov 21, 2017
  7. 07/14 fetch-pack: test support excluding large blobsJeff Hostetler, Nov 21, 2017
  8. 08/14 partial-clone: define partial clone settings in configJeff Hostetler, Nov 21, 2017
  9. 10/14 t5500: add fetch-pack tests for partial cloneJeff Hostetler, Nov 21, 2017
  10. 12/14 t5500: more tests for partial clone and fetchJeff Hostetler, Nov 21, 2017
  11. 11/14 t5601: test for partial cloneJeff Hostetler, Nov 21, 2017
  12. 14/14 fetch-pack: restore save_commit_buffer after useJeff Hostetler, Nov 21, 2017
  13. 13/14 unpack-trees: batch fetching of missing blobsJeff Hostetler, Nov 21, 2017
  14. 02/14 clone, fetch-pack, index-pack, transport: partial cloneJeff Hostetler, Nov 21, 2017
  15. 03/14 fetch: refactor calculation of remote listJeff Hostetler, Nov 21, 2017

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.