git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Perf bug: rev-list w/ 2+ paths relatively slow with commit-graph

From
Junio C Hamano <gitster@pobox.com>
Date
Jun 24, 2025, 13:32 UTC
Message-ID
<xmqqo6ud2rk9.fsf@gitster.g>
In-Reply-To
<E6A4C972-9675-47AE-B5CE-75103DB1D153@gmail.com>
Lidong Yan <yldhome2d2@gmail.com> writes:
Show 10 quoted lines
>> It looks like that the necessary changes are probably fairly well
>> isolated to two functions, i.e., prepare_to_use_bloom_filter() and
>> forbid_bloom_filters().  Right now, for a pathspec that has one
>> element "dir/file", the code uses two bloom keys for "dir" and
>> "dir/file", but if we have "dir1/file1" as well, then it does look
>> like a matter of using two more (and the bloom_keys[] array is
>> designed to be variable length).
>
> I believe the issue here is that revs->bloom_keys[] represents an
> AND condition, whereas what we actually want is an OR.

Yeah, you're right. bloom.c:bloom_filter_contains() is called repeatedly by check_maybe_different_in_bloom_filter() to see if all the bloom_keys[] appear to judge if it is possible that the path is changed by the commit.

So if we wanted to extend in the way we discussed in the message you are respoinding to, revs->bloom_keys[] needs to become an array of bloom_keys[], one for each literal pathspec element, and then we can extend check_maybe_different_in_bloom_filter() to run the current logic for each literal pathspec element, and combine the results by ORing them. The way revision.c:release_revisions() releases the bloom keys also need to be updated.

Previous: Lidong Yan
Message 7 of 7 in “Perf bug: rev-list w/ 2+ paths relatively slow with commit-graph”
  1. Kai KoponenJun 23, 2025
  2. Kai KoponenJun 23, 2025
  3. Junio C HamanoJun 23, 2025
  4. Kai KoponenJun 23, 2025
  5. Junio C HamanoJun 23, 2025
  6. Lidong YanJun 24, 2025
  7. Junio C HamanoJun 24, 2025

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.