git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH v3 0/2] Do not lock temporary files via child processes on Windows

From
Johannes Schindelin <johannes.schindelin@gmx.de>
Date
Aug 22, 2016, 12:47 UTC
Message-ID
<cover.1471869985.git.johannes.schindelin@gmx.de>
In-Reply-To
<cover.1471531799.git.johannes.schindelin@gmx.de>

This issue was originally reported and fixed in https://github.com/git-for-windows/git/pull/755

The problem is that file handles to temporary files (such as index.lock) were inherited by spawned processes. If those spawned processes do not exit before the parent process wants to delete or rename them, we are in big trouble.

The original use case triggering the bug is a merge driver that does not quit, but listen to subsequent merge requests.

However, the same issue turned up in Lars Schneider's work on making clean/smudge filters batchable (i.e. more efficient by avoiding possibly thousands of child processes, one per file).

Changes since v2:
- O_CLOEXEC is defined in git-compat-util.h unless already defined
- we now handle EINVAL by trying again without O_CLOEXEC
Ben Wijen (2):
  t6026-merge-attr: child processes must not inherit index.lock handles
  mingw: ensure temporary file handles are not inherited by child
    processes
 compat/mingw.h        |  4 ++++
 git-compat-util.h     |  4 ++++
 lockfile.h            |  4 ++++
 t/t6026-merge-attr.sh | 13 +++++++++++++
 tempfile.c            |  7 ++++++-
 tempfile.h            |  4 ++++
 6 files changed, 35 insertions(+), 1 deletion(-)
Published-As: https://github.com/dscho/git/releases/tag/mingw-index-lock-v3
Fetch-It-Via: git fetch https://github.com/dscho/git mingw-index-lock-v3
Interdiff vs v2:
 diff --git a/git-compat-util.h b/git-compat-util.h
 index f52e00b..db89ba7 100644
 --- a/git-compat-util.h
 +++ b/git-compat-util.h
 @@ -667,6 +667,10 @@ void *gitmemmem(const void *haystack, size_t haystacklen,
  #define getpagesize() sysconf(_SC_PAGESIZE)
  #endif
  
 +#ifndef O_CLOEXEC
 +#define O_CLOEXEC 0
 +#endif
 +
  #ifdef FREAD_READS_DIRECTORIES
  #ifdef fopen
  #undef fopen
 diff --git a/tempfile.c b/tempfile.c
 index db3981d..2990c92 100644
 --- a/tempfile.c
 +++ b/tempfile.c
 @@ -120,7 +120,12 @@ int create_tempfile(struct tempfile *tempfile, const char *path)
  	prepare_tempfile_object(tempfile);
  
  	strbuf_add_absolute_path(&tempfile->filename, path);
 -	tempfile->fd = open(tempfile->filename.buf, O_RDWR | O_CREAT | O_EXCL | O_CLOEXEC, 0666);
 +	tempfile->fd = open(tempfile->filename.buf,
 +			    O_RDWR | O_CREAT | O_EXCL | O_CLOEXEC, 0666);
 +	if (O_CLOEXEC && tempfile->fd < 0 && errno == EINVAL)
 +		/* Try again w/o O_CLOEXEC: the kernel might not support it */
 +		tempfile->fd = open(tempfile->filename.buf,
 +				    O_RDWR | O_CREAT | O_EXCL, 0666);
  	if (tempfile->fd < 0) {
  		strbuf_reset(&tempfile->filename);
  		return -1;
-- 
2.10.0.rc0.115.ged054c0

base-commit: 2632c897f74b1cc9b5533f467da459b9ec725538
Previous: Johannes SchindelinNext: Johannes Schindelin
Message 18 of 21 in “Do not lock temporary files via child processes on Windows”
  1. 0/2 Do not lock temporary files via child processes on WindowsJohannes Schindelin, Aug 17, 2016
  2. 1/2 t6026-merge-attr: child processes must not inherit index.lock handlesJohannes Schindelin, Aug 17, 2016
  3. Junio C HamanoAug 17, 2016
  4. 2/2 mingw: ensure temporary file handles are not inherited by child processesJohannes Schindelin, Aug 17, 2016
  5. Eric SunshineAug 17, 2016
  6. Johannes SchindelinAug 18, 2016
  7. Lars SchneiderAug 17, 2016
  8. Junio C HamanoAug 17, 2016
  9. Johannes SchindelinAug 18, 2016
  10. Eric WongAug 18, 2016
  11. Junio C HamanoAug 18, 2016
  12. Eric WongAug 18, 2016
  13. Junio C HamanoAug 19, 2016
  14. Johannes SchindelinAug 22, 2016
  15. 0/2 Do not lock temporary files via child processes on WindowsJohannes Schindelin, Aug 18, 2016
  16. 2/2 mingw: ensure temporary file handles are not inherited by child processesJohannes Schindelin, Aug 18, 2016
  17. 1/2 t6026-merge-attr: child processes must not inherit index.lock handlesJohannes Schindelin, Aug 18, 2016
  18. 0/2 Do not lock temporary files via child processes on WindowsJohannes Schindelin, Aug 22, 2016
  19. 1/2 t6026-merge-attr: child processes must not inherit index.lock handlesJohannes Schindelin, Aug 22, 2016
  20. 2/2 mingw: ensure temporary file handles are not inherited by child processesJohannes Schindelin, Aug 22, 2016
  21. Eric WongAug 22, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.