git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH 3.5/4] object-file: fix mmap() leak in odb_source_loose_read_object_stream()

From
Jeff King <peff@peff.net>
Date
Mar 7, 2026, 02:24 UTC
Message-ID
<20260307022459.GA693632@coredump.intra.peff.net>
In-Reply-To
<xmqqqzpwv3t7.fsf@gitster.g>
On Fri, Mar 06, 2026 at 05:14:28PM -0800, Junio C Hamano wrote:
Show 23 quoted lines
> Jeff King <peff@peff.net> writes:
> 
> > @@ -1600,6 +1600,7 @@ BASIC_CFLAGS += -DSHA1DC_FORCE_ALIGNED_ACCESS
> >  endif
> >  ifneq ($(filter leak,$(SANITIZERS)),)
> >  BASIC_CFLAGS += -O0
> > +NO_MMAP = CatchMapLeaks
> >  SANITIZE_LEAK = YesCompiledWithIt
> >  endif
> >  ifneq ($(filter address,$(SANITIZERS)),)
> 
> And of course, this "breaks" the leaks job at CI without being the
> true culprit.
> 
>     https://github.com/git/git/actions/runs/22786105918/job/66103114142
> 
> My bisection between v2.52.0 and v2.53.0 with the following
> 
>     $ git bisect start v2.53.0 v2.52.0
>     $ git bisect run sh :doit
> 
> where :doit has the shell script attached at the end of this message
> blames this commit.  I didn't dig further than that.

Interesting. I ran my tests on "master", which would include v2.53.0, and it came up clean. But I use gcc locally; switching to clang does indeed report a leak for me.

Even more curiously, if I try testing the tip of jch, then gcc does find the same leak! Bisecting, it starts to find the leak as of 1f3fd68e06 (odb/source: make `read_object_stream()` function pluggable, 2026-03-05).

There is a real leak here; the fix is below. But curiously, it is _not_ the fault of the commit you found by bisection.

In the test in question, we die() shortly after the leak happens. We've definitely left the function that holds the pointer to the leaked buffer, so it's a true leak. But my guess is that the leak detector doesn't quite know which parts of stack memory are valid or not when we die(), so it scans the whole thing looking for plausible pointers to allocations. If it gets "lucky", then the stale out-of-scope pointer is still in stack memory, and we consider it still reachable.

And whether that happens or not can depend on the compiler, or even compile options. And as the code is refactored to use the more abstract odb API (and call more functions), it is increasingly likely that something else has re-used that bit of stack memory.

So that's why the leak "appears" in 4c89d31494 (streaming: rely on object sources to create object stream, 2025-11-23) for clang, and 1f3fd68e06 (odb/source: make `read_object_stream()` function pluggable, 2026-03-05) for gcc. But it was really there all along.

Anyway, here's the fix. It should probably be slotted in before patch 4 (which turns on NO_MMAP for leak-check builds).

-- >8 --
Subject: object-file: fix mmap() leak in odb_source_loose_read_object_stream()

We mmap() a loose object file, storing the result in the local variable "mapped", which is eventually assigned into our stream struct as "st.mapped". If we hit an error, we jump to an error label which does:

  munmap(st.mapped, st.mapsize);

to clean up. But this is wrong; we don't assign st.mapped until the end of the function, after all of the "goto error" jumps. So this munmap() is never cleaning up anything (st.mapped is always NULL, because we initialize the struct with calloc).

Instead, we should feed the local variable to munmap().

This leak is due to 595296e124 (streaming: allocate stream inside the backend-specific logic, 2025-11-23), which introduced the local variable. Before that, we assigned the mmap result directly into st.mapped. It was probably switched there so that we do not have to allocate/free the struct when the map operation fails (e.g., because we don't have the loose object). Before that commit, the struct was passed in from the caller, so there was no allocation at all.

You can see the leak in the test suite by building with:
  make SANITIZE=leak NO_MMAP=1 CC=clang

and running t1060. We need NO_MMAP so that the mmap() is backed by an actual malloc(), which allows LSan to detect it. And the leak seems not to be detected when compiling with gcc, probably due to some internal compiler decisions about how the stack memory is written.

Signed-off-by: Jeff King <peff@peff.net>
---
 object-file.c | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/object-file.c b/object-file.c
index 3094140055..ab2fb9c4eb 100644
--- a/object-file.c
+++ b/object-file.c
@@ -2197,7 +2197,7 @@ int odb_source_loose_read_object_stream(struct odb_read_stream **out,
 	return 0;
 error:
 	git_inflate_end(&st->z);
-	munmap(st->mapped, st->mapsize);
+	munmap(mapped, mapsize);
 	free(st);
 	return -1;
 }
-- 
2.53.0.791.g8baeb4ea4d
Previous: Junio C HamanoNext: Junio C Hamano
Message 14 of 25 in “memory leak when cloning a repository”
  1. Jacob KellerMar 5, 2026
  2. Jeff KingMar 5, 2026
  3. 0/4 plugging some mmap() leaksJeff King, Mar 5, 2026
  4. 1/4 check_connected(): delay opening new_packJeff King, Mar 5, 2026
  5. Jacob KellerMar 5, 2026
  6. 2/4 check_connected(): fix leak of pack-index mmapJeff King, Mar 5, 2026
  7. Jacob KellerMar 5, 2026
  8. 3/4 pack-revindex: avoid double-loading .rev filesJeff King, Mar 5, 2026
  9. 4/4 Makefile: turn on NO_MMAP when building with LSanJeff King, Mar 5, 2026
  10. Jacob KellerMar 6, 2026
  11. 5/4 meson: turn on NO_MMAP when building with LSanJeff King, Mar 6, 2026
  12. Ramsay JonesMar 6, 2026
  13. Junio C HamanoMar 7, 2026
  14. 5/4 object-file: fix mmap() leak in odb_source_loose_read_object_stream()Jeff King, Mar 7, 2026
  15. Junio C HamanoMar 7, 2026
  16. Patrick SteinhardtMar 10, 2026
  17. Ramsay JonesMar 6, 2026
  18. Jeff KingMar 6, 2026
  19. Ramsay JonesMar 6, 2026
  20. Junio C HamanoMar 6, 2026
  21. Ramsay JonesMar 6, 2026
  22. Junio C HamanoMar 6, 2026
  23. Ramsay JonesMar 6, 2026
  24. Junio C HamanoMar 7, 2026
  25. Jacob KellerMar 5, 2026

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.