git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH v4 04/15] fetch: add object filtering for partial fetch

From
JHJeff Hostetler <git@jeffhostetler.com>
Date
Nov 16, 2017, 18:17 UTC
Message-ID
<20171116181723.62033-5-git@jeffhostetler.com>
In-Reply-To
<20171116181723.62033-1-git@jeffhostetler.com>
From: Jeff Hostetler <jeffhost@microsoft.com>

Teach fetch to use the list-objects filtering parameters to allow a "partial fetch" following a "partial clone".

Signed-off-by: Jeff Hostetler <jeffhost@microsoft.com>
---
 builtin/fetch.c | 20 ++++++++++++++++++++
 1 file changed, 20 insertions(+)
diff --git a/builtin/fetch.c b/builtin/fetch.c
index 1b1f039..fb9af7c 100644
--- a/builtin/fetch.c
+++ b/builtin/fetch.c
@@ -18,6 +18,7 @@
 #include "argv-array.h"
 #include "utf8.h"
 #include "packfile.h"
+#include "list-objects-filter-options.h"
 
 static const char * const builtin_fetch_usage[] = {
 	N_("git fetch [<options>] [<repository> [<refspec>...]]"),
@@ -55,6 +56,7 @@ static int recurse_submodules_default = RECURSE_SUBMODULES_ON_DEMAND;
 static int shown_url = 0;
 static int refmap_alloc, refmap_nr;
 static const char **refmap_array;
+static struct list_objects_filter_options filter_options;
 
 static int git_fetch_config(const char *k, const char *v, void *cb)
 {
@@ -160,6 +162,7 @@ static struct option builtin_fetch_options[] = {
 			TRANSPORT_FAMILY_IPV4),
 	OPT_SET_INT('6', "ipv6", &family, N_("use IPv6 addresses only"),
 			TRANSPORT_FAMILY_IPV6),
+	OPT_PARSE_LIST_OBJECTS_FILTER(&filter_options),
 	OPT_END()
 };
 
@@ -1044,6 +1047,9 @@ static struct transport *prepare_transport(struct remote *remote, int deepen)
 		set_option(transport, TRANS_OPT_DEEPEN_RELATIVE, "yes");
 	if (update_shallow)
 		set_option(transport, TRANS_OPT_UPDATE_SHALLOW, "yes");
+	if (filter_options.choice)
+		set_option(transport, TRANS_OPT_LIST_OBJECTS_FILTER,
+			   filter_options.raw_value);
 	return transport;
 }
 
@@ -1242,6 +1248,20 @@ static int fetch_multiple(struct string_list *list)
 	int i, result = 0;
 	struct argv_array argv = ARGV_ARRAY_INIT;
 
+	if (filter_options.choice) {
+		/*
+		 * We currently only support partial-fetches to the remote
+		 * used for the partial-clone because we only support 1
+		 * promisor remote, so we DO NOT allow explicit command
+		 * line filter arguments for multi-fetches.
+		 *
+		 * Note that the loop below will spawn background fetches
+		 * for each remote and one of them MAY INHERIT the proper
+		 * partial-fetch settings, so everything is consistent.
+		 */
+		die(_("partial-fetch is not supported on multiple remotes"));
+	}
+
 	if (!append && !dry_run) {
 		int errcode = truncate_fetch_head();
 		if (errcode)
-- 
2.9.3
Previous: Jeff HostetlerNext: Jeff Hostetler
Message 5 of 19 in “Parial clone part 3: clone, fetch, fetch-pack, upload-pack, and tests”
  1. 00/15 Parial clone part 3: clone, fetch, fetch-pack, upload-pack, and testsJeff Hostetler, Nov 16, 2017
  2. 01/15 upload-pack: add object filtering for partial cloneJeff Hostetler, Nov 16, 2017
  3. 02/15 clone, fetch-pack, index-pack, transport: partial cloneJeff Hostetler, Nov 16, 2017
  4. 05/15 remote-curl: add object filtering for partial cloneJeff Hostetler, Nov 16, 2017
  5. 04/15 fetch: add object filtering for partial fetchJeff Hostetler, Nov 16, 2017
  6. 07/15 fetch-pack: test support excluding large blobsJeff Hostetler, Nov 16, 2017
  7. 03/15 fetch: refactor calculation of remote listJeff Hostetler, Nov 16, 2017
  8. 08/15 partial-clone: define partial clone settings in configJeff Hostetler, Nov 16, 2017
  9. 11/15 t5500: add fetch-pack tests for partial cloneJeff Hostetler, Nov 16, 2017
  10. 10/15 fetch: add from_promisor and exclude-promisor-objects parametersJeff Hostetler, Nov 16, 2017
  11. 14/15 unpack-trees: batch fetching of missing blobsJeff Hostetler, Nov 16, 2017
  12. 13/15 t5500: more tests for partial clone and fetchJeff Hostetler, Nov 16, 2017
  13. 12/15 t5601: test for partial cloneJeff Hostetler, Nov 16, 2017
  14. 15/15 fetch-pack: restore save_commit_buffer after useJeff Hostetler, Nov 16, 2017
  15. 06/15 pack-objects: test support for blob filteringJeff Hostetler, Nov 16, 2017
  16. 09/15 fetch-pack: test support excluding large blobsJeff Hostetler, Nov 16, 2017
  17. Junio C HamanoNov 17, 2017
  18. Jonathan TanNov 21, 2017
  19. Jeff HostetlerNov 21, 2017

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.