git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [RFC 4/4 v3] Add cat-blob report fifo from fast-import to remote-helper.

From
Jonathan Nieder <jrnieder@gmail.com>
Date
Jul 22, 2012, 21:24 UTC
Message-ID
<20120722212424.GA680@burratino>
In-Reply-To
<5489458.8D23shS0RV@flomedio>
Hi,
Florian Achleitner wrote:
> On Windows, processses are not forked but spawned from new and therefore can't 
> inherit pipe file descriptors.
Ok, this is what I didn't understand (and still don't understand).

Yes, on Windows processes are spawned instead of forked. But does that mean they can't inherit pipes? How do pipelines in the shell work at all, then?

I thought what Hannes said was rather that the current C runtime used by Git for Windows doesn't take care of inherited file descriptors, period, other than 0, 1, and 2. This has nothing to do with the fork/spawn distinction. So while --cat-blob-fd or some other mechanism could be made to work on Windows in the future, *relying* on --cat-blob-fd on Windows today is a no-go, since it rely on file descriptors >2 and break the remote helper infrastructure completely there.

That does not force us into a corner at all. We have multiple options. Here is what I propose:

Remote helpers declare using a capability (e.g., "bidi-import") that they would like a bidirectional communication channel with fast-import. Git tells the remote helper that its request has been granted by using a different command (e.g., "bidi-import") instead of "import" to start the import process.

The responses from fast-import come on stdin (file descriptor 0), so in principle it should be possible to implement this interface on Windows. The interface is portable, even if the initial implementation isn't.

Existing remote helpers using the "import" capability would be unaffected and would work as before.

On Windows, Git would not take advantage of the bidi-import capability for now. Windows support is an added complication and we have enough to do this summer.

Then interested people using Windows would be able to experiment using whatever mechanism they please (CRT support for inherited file descriptors >2, fifos, sockets, some other Windows-specific thing) to implement the bidi-import capability. Once that is implemented, they automatically get support for remote helpers that rely on the bidirectional communication functionality.

What do you think?

Thanks for explaining, Jonathan

Previous: Florian AchleitnerNext: Jonathan Nieder
Message 51 of 57 in “[RFC 0/4]”
  1. Florian AchleitnerJun 4, 2012
  2. 1/4 Implement a basic remote helper vor svn in C.Florian Achleitner, Jun 4, 2012
  3. 2/4 Integrate remote-svn into svn-fe/Makefile.Florian Achleitner, Jun 4, 2012
  4. 3/4 Add svndump_init_fd to allow reading dumps from arbitrary FDs.Florian Achleitner, Jun 4, 2012
  5. 4/4 Add cat-blob report pipe from fast-import to remote-helper.Florian Achleitner, Jun 4, 2012
  6. David Michael BarrJun 5, 2012
  7. Jeff KingJun 5, 2012
  8. David Michael BarrJun 5, 2012
  9. Jeff KingJun 5, 2012
  10. Florian AchleitnerJun 5, 2012
  11. Jeff KingJun 6, 2012
  12. Florian AchleitnerJun 6, 2012
  13. Johannes SixtJun 5, 2012
  14. Jeff KingJun 5, 2012
  15. Florian AchleitnerJun 5, 2012
  16. Johannes SixtJun 5, 2012
  17. David Michael BarrJun 5, 2012
  18. 0/4 Florian Achleitner, Jun 29, 2012
  19. 1/4 Implement a basic remote helper for svn in C.Florian Achleitner, Jun 29, 2012
  20. Jonathan NiederJul 2, 2012
  21. Jonathan NiederJul 6, 2012
  22. Florian AchleitnerJul 6, 2012
  23. Florian AchleitnerJul 26, 2012
  24. Jonathan NiederJul 26, 2012
  25. Florian AchleitnerJul 26, 2012
  26. Jonathan NiederJul 28, 2012
  27. Florian AchleitnerJul 30, 2012
  28. Jonathan NiederJul 30, 2012
  29. Florian AchleitnerJul 30, 2012
  30. Jonathan NiederJul 30, 2012
  31. Florian AchleitnerJul 31, 2012
  32. Jonathan NiederJul 31, 2012
  33. Florian AchleitnerAug 1, 2012
  34. Jonathan NiederAug 1, 2012
  35. Florian AchleitnerAug 12, 2012
  36. Jonathan NiederAug 12, 2012
  37. Florian AchleitnerAug 12, 2012
  38. Jonathan NiederAug 12, 2012
  39. Jonathan NiederAug 12, 2012
  40. Junio C HamanoJul 26, 2012
  41. Florian AchleitnerJul 30, 2012
  42. Steven MichalskeJul 26, 2012
  43. 2/4 Integrate remote-svn into svn-fe/Makefile.Florian Achleitner, Jun 29, 2012
  44. 3/4 Add svndump_init_fd to allow reading dumps from arbitrary FDs.Florian Achleitner, Jun 29, 2012
  45. 4/4 Add cat-blob report fifo from fast-import to remote-helper.Florian Achleitner, Jun 29, 2012
  46. Florian AchleitnerJul 21, 2012
  47. Jonathan NiederJul 21, 2012
  48. Florian AchleitnerJul 21, 2012
  49. Jonathan NiederJul 21, 2012
  50. Florian AchleitnerJul 22, 2012
  51. Jonathan NiederJul 22, 2012
  52. Jonathan NiederJul 21, 2012
  53. Jonathan NiederJul 26, 2012
  54. Florian AchleitnerJul 26, 2012
  55. Jonathan NiederJul 26, 2012
  56. Florian AchleitnerJul 27, 2012
  57. Jonathan NiederJul 28, 2012

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.