git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Closing fds twice when using remote helpers

From
Mike Hommey <mh@glandium.org>
Date
May 15, 2019, 10:56 UTC
Message-ID
<20190515105609.sucfjvuumeyyrmjb@glandium.org>
Hi,

I started getting a weird error message during some test case involving git-cinnabar, which is a remote-helper to access mercurial repositories.

The error says: fatal: mmap failed: Bad file descriptor

... which was not making much sense. Some debugging later, and it turns out this is what happens:

- start_command is called for fast-import
- start_command is called again for git-remote-hg, passing the
  fast_import->out as cmd->in.
- in start_command, we end up on the line of code that does
  close(cmd->in), so fast_import->out/cmd->in is now closed
- much later, in disconnect_helper, we call close(data->helper->out),
  where data->helper is the cmd for fast-import, and that fd was already
closed above.
- Except, well, fds being what they are, we in fact just closed a fd
  from a packed_git->pack_fd. So, when use_pack is later called, and
  tries to mmap data from that pack, it fails because the file
  descriptor was closed.
I'm not entirely sure how to address this... Any ideas?

Relatedly, use_pack calls xmmap, which does its own error handling and die()s in case of error, but then goes on to do its own check with a different error message (which, in fact, could be more useful in other cases). It seems like it should call xmmap_gently instead.

Cheers,
Mike
Next: Ævar Arnfjörð Bjarmason
Message 1 of 10 in “Closing fds twice when using remote helpers”
  1. Mike HommeyMay 15, 2019
  2. Ævar Arnfjörð BjarmasonMay 15, 2019
  3. Johannes SixtMay 15, 2019
  4. Mike HommeyMay 15, 2019
  5. Jeff KingMay 15, 2019
  6. Mike HommeyMay 16, 2019
  7. Jeff KingMay 16, 2019
  8. Mike HommeyMay 16, 2019
  9. Jeff KingMay 16, 2019
  10. Mike HommeyMay 16, 2019

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.