[PATCH 0/3] Batch prefetching
- From
Elijah Newren via GitGitGadget <gitgitgadget@gmail.com>
- Date
- Apr 16, 2026, 22:48 UTC
- Message-ID
- <pull.2089.git.1776379694.gitgitgadget@gmail.com>
Partial clones provide a trade-off for users: avoid downloading blobs upfront, at the expense of needing to download them later as they run other commands. This tradeoff can sometimes incur a more severe cost than expected, particularly if needed blobs are discovered as they are accessed, resulting in downloading blobs one at a time. Some commands like checkout, diff, and merge do batch prefetches of necessary blobs, since that can dramatically reduce the pain of on-demand loading. Extend this ability to two more commands: cherry and grep.
This series was spurred by a report where git cherry jobs were each doing hundreds of single-blob fetches, at a cost of 3s each. Batching those downloads should dramatically speed up their jobs. (And I decided to fix up git grep similarly while at it.)
I'll also note that git backfill with revisions and/or pathspecs could also improve things for these users, but since backfill is a manual command users would have to run and requires users to try to figure out which data is needed (a challenge in the case of cherry), it still makes sense to provide smarter behavior for folks who don't choose to manually run backfill.
Also, correct a documentation typo I noticed in patch-ids.h (related to code I was using for the git cherry fixes) as a preparatory fixup.
Elijah Newren (3): patch-ids.h: add missing trailing parenthesis in documentation comment builtin/log: prefetch necessary blobs for `git cherry` grep: prefetch necessary blobs
builtin/grep.c | 142 ++++++++++++ builtin/log.c | 125 +++++++++++ investigations/cherry-prefetch-design-spec.md | 210 ++++++++++++++++++ patch-ids.h | 2 +- t/t3500-cherry.sh | 18 ++ t/t7810-grep.sh | 35 +++ 6 files changed, 531 insertions(+), 1 deletion(-) create mode 100644 investigations/cherry-prefetch-design-spec.md
base-commit: 9f223ef1c026d91c7ac68cc0211bde255dda6199 Published-As: https://github.com/gitgitgadget/git/releases/tag/pr-2089%2Fnewren%2Fbatch-prefetching-v1 Fetch-It-Via: git fetch https://github.com/gitgitgadget/git pr-2089/newren/batch-prefetching-v1 Pull-Request: https://github.com/gitgitgadget/git/pull/2089
-- gitgitgadget