git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH RFC 0/3] cat-file: make remote-object-info request in batches

From
Junio C Hamano <gitster@pobox.com>
Date
Oct 27, 2026, 19:12 UTC
Message-ID
<xmqqld7jj6u5.fsf@gitster.g>
In-Reply-To
<20261027-remote-object-info-batch-v1-0-ea7a1f0b1df1@gmail.com>
Pablo Sabater <pabloosabaterr@gmail.com> writes:
Show 7 quoted lines
> A noticeable difference can be seen from a 10k OID batch to a 50k batch.
> After that the difference isn't as noticeable (the number of batches to
> be requested isn't that big).
>
> I propose 50k OIDs as the default number of OIDs for the
> remote-object-info batches. Coincidentally, git backfill's default batch
> size is 50k as well though it's unrelated.

Interesting. We cannot share any code with backfill as we only retrieve info on objects while backfill does grab the objects themselves, but using the same number may make it easy to explain in the documentation.

Show 6 quoted lines
> I have barely done any benchmarking before, so I would appreciate
> any feedback on the one in patch 2. Is there a better way to do it,
> or other things I should take into account?
>
> Should the server also check for a limit on the number of OIDs it
> accepts in a single object-info request?

What I am more curious about is how this updated code interacts with existing code (i.e., updated "cat-file --batch" clients with deployed servers, and vice versa).

Previous: Pablo SabaterNext: Pablo Sabater
Message 10 of 12 in “cat-file: make remote-object-info request in batches”
  1. 0/3 cat-file: make remote-object-info request in batchesPablo Sabater, Oct 27, 2026
  2. 1/3 cat-file: extract the transport ownership from get_remote_info()Pablo Sabater, Oct 27, 2026
  3. Junio C HamanoOct 27, 2026
  4. Pablo SabaterOct 27, 2026
  5. Junio C HamanoOct 28, 2026
  6. Pablo SabaterOct 28, 2026
  7. Junio C HamanoOct 28, 2026
  8. 2/3 cat-file: make remote-object-info request in batchesPablo Sabater, Oct 27, 2026
  9. 3/3 cat-file: add --remote-max-batch optionPablo Sabater, Oct 27, 2026
  10. Junio C HamanoOct 27, 2026
  11. Pablo SabaterOct 27, 2026
  12. Junio C HamanoOct 27, 2026

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.