git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 1/4] use_pack: attempt to handle ENOMEM from mmap

From
Jeff King <peff@peff.net>
Date
Jun 30, 2021, 02:30 UTC
Message-ID
<YNvXTf6PG2zhbjdh@coredump.intra.peff.net>
In-Reply-To
<20210629081108.28657-2-e@80x24.org>
On Tue, Jun 29, 2021 at 08:11:05AM +0000, Eric Wong wrote:
Show 22 quoted lines
> Since use_pack() can already safely munmap packs to respect
> core.packedGitLimit, attempt to gracefully handle ENOMEM
> errors the same way by unmapping a window and retrying.
> 
> This benefits unprivileged users who lack permissions to raise
> the `sys.vm.max_map_count' sysctl and/or RLIMIT_DATA resource
> limit.
> 
> I've also verified it is safe to release a pack here by
> unconditionally calling unuse_one_window() before
> xmmap_gently():
> 
> 	--- a/packfile.c
> 	+++ b/packfile.c
> 	@@ -649,6 +649,7 @@ unsigned char *use_pack(struct packed_git *p,
> 					&& unuse_one_window(p))
> 					; /* nothing */
> 				do {
> 	+				unuse_one_window(p);
> 					win->base = xmmap_gently(NULL, win->len,
> 						PROT_READ, MAP_PRIVATE,
> 						p->pack_fd, win->offset);

I don't find that test-diff all that compelling, because we don't know which window will get unused. I.e., if there is one that will get racily unused, we might not hit it. I think it would be a lot more interesting for finding problems if it did:

  while (unuse_one_window(p)) ;
to clear them all.

That said, I think this must be obviously correct because the code above will potentially have just called unuse_one_window(p) already. So at least if not obviously correct, no more buggy than the previous code. :)

-Peff
Previous: Eric WongNext: Eric Wong
Message 6 of 15 in “gracefully handling mmap failures”
  1. 0/4 gracefully handling mmap failuresEric Wong, Jun 29, 2021
  2. 2/4 map_loose_object_1: attempt to handle ENOMEM from mmapEric Wong, Jun 29, 2021
  3. Jeff KingJun 30, 2021
  4. Ævar Arnfjörð BjarmasonJun 30, 2021
  5. 1/4 use_pack: attempt to handle ENOMEM from mmapEric Wong, Jun 29, 2021
  6. Jeff KingJun 30, 2021
  7. 3/4 check_packed_git_idx: attempt to handle ENOMEM from mmapEric Wong, Jun 29, 2021
  8. 3/4 check_packed_git_idx: attempt to handle ENOMEM from mmapEric Wong, Jun 29, 2021
  9. Junio C HamanoJun 29, 2021
  10. Eric WongJun 29, 2021
  11. 4/4 xmmap: inform Linux users of tuning knobs on ENOMEMEric Wong, Jun 29, 2021
  12. xmmap: inform Linux users of tuning knobs on ENOMEMEric Wong, Jun 30, 2021
  13. Jeff KingJun 30, 2021
  14. Eric WongJun 30, 2021
  15. Jeff KingJun 30, 2021

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.