{"thread":{"id":"66590","subject":"[PATCH] technical/partial-clone: narrow the one-at-a-time fetch limitation","startedAt":"2026-10-19T16:03:00Z","lastAt":"2026-10-19T16:03:00Z","messageCount":1,"participants":["Aleksei Sviridkin"],"isPatch":true,"patchVersion":1,"patchTotal":null},"messages":[{"id":"555432","messageId":"20261019160300.15789-1-f@lex.la","threadId":"66590","inReplyTo":null,"subject":"[PATCH] technical/partial-clone: narrow the one-at-a-time fetch limitation","fromName":"Aleksei Sviridkin","fromEmail":"f@lex.la","sentAt":"2026-10-19T16:03:00Z","receivedAt":"2026-10-19T16:03:00Z","isPatch":true,"sender":{"key":"f@lex.la","avatar":"https://avatars.githubusercontent.com/u/1366514?v=4"},"body":"The design doc says twice that dynamic object fetching is slow because\nobjects are fetched one at a time, without saying which code path that\ndescribes.\n\nOnly the object lookup fallback in odb.c works that way. The other ten\ncall sites of promisor_remote_get_direct() collect the missing objects\nfirst and hand the whole array to one fetch subprocess per promisor\nremote.\n\nThe bullet also still names fetch-pack, which 7ca3c0ac37\n(promisor-remote: lazy-fetch objects in subprocess, 2020-08-17)\nreplaced with a \"git fetch\" subprocess.\n\nSigned-off-by: Aleksei Sviridkin <f@lex.la>\n---\nRepost of the patch from September 3. Only the log message changed; the\ndiff is the same and still applies to master.\n\nI am very sorry about the unreadable message. Your guess is right: it\nwas machine-written and I signed it off without reading it as a reader\nwould.\n\nUnrelated to this patch, since the subject of messages going unanswered\ncame up. I sent a security report to git-security on September 3, a\nfollow-up on September 16 with you in To, and one more to you directly\non September 26. The same day as the follow-up I also filed it through\nGitHub's private vulnerability reporting, where it still sits in triage,\nuntouched. Nothing back on any of them, 46 days now. The documented\nprocess says the list aims for an initial assessment within a few days,\nand that a report judged not to need an embargo comes back as a redirect\nto this list, so silence does not look like one of the expected answers.\nIt is not a contrived unreachable path, it is something I ran into doing\nordinary work, which is why I would like to know if anyone is looking.\nIs that channel working, and if not, where should this go instead.\n\n Documentation/technical/partial-clone.adoc | 16 +++++++++-------\n 1 file changed, 9 insertions(+), 7 deletions(-)\n\ndiff --git a/Documentation/technical/partial-clone.adoc b/Documentation/technical/partial-clone.adoc\nindex 18718a3840..d5fd1420e5 100644\n--- a/Documentation/technical/partial-clone.adoc\n+++ b/Documentation/technical/partial-clone.adoc\n@@ -141,8 +141,10 @@ remote and then retry the object lookup.  This allows objects to be\n For efficiency reasons, no check as to whether the missing object is\n actually a promisor object is performed.\n +\n-Dynamic object fetching tends to be slow as objects are fetched one at\n-a time.\n+This fallback asks for a single object per request, so it is slow when\n+many objects are missing.  Code that can name several missing objects at\n+once passes the whole list to promisor_remote_get_direct(), which\n+requests the set rather than one object at a time.\n \n - `checkout` (and any other command using `unpack-trees`) has been taught\n   to bulk pre-fetch all required missing blobs in a single batch.\n@@ -247,11 +249,11 @@ remote in a specific order.\n - Repack essentially treats promisor and non-promisor packfiles as 2\n   distinct partitions and does not mix them.\n \n-- Dynamic object fetching invokes fetch-pack once *for each item*\n-  because most algorithms stumble upon a missing object and need to have\n-  it resolved before continuing their work.  This may incur significant\n-  overhead -- and multiple authentication requests -- if many objects are\n-  needed.\n+- Dynamic object fetching invokes a \"git fetch\" subprocess once *for\n+  each item* when it goes through the object lookup fallback, because\n+  the object has to be resolved before the work can continue.  This may\n+  incur significant overhead -- and multiple authentication requests --\n+  if many objects are needed.\n \n - Dynamic object fetching currently uses the existing pack protocol V0\n   which means that each object is requested via fetch-pack.  The server\n-- \n2.56.0\n\n\n"}]}