git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 1/3] compat/mingw: share file handles created via `CreateFileW()`

From
Patrick Steinhardt <ps@pks.im>
Date
Oct 24, 2024, 06:30 UTC
Message-ID
<ZxnpmPbKDNiQl66p@pks.im>
In-Reply-To
<ZxkxAvLeMtxstVdS@nand.local>
On Wed, Oct 23, 2024 at 01:23:14PM -0400, Taylor Blau wrote:
Show 30 quoted lines
> On Wed, Oct 23, 2024 at 05:04:58PM +0200, Patrick Steinhardt wrote:
> > Unless told otherwise, Windows will keep other processes from reading,
> > writing and deleting files when one has an open handle that was created
> > via `CreateFileW()`. This behaviour can be altered via `FILE_SHARE_*`
> > flags such that other processes _can_ read and/or modify such a file.
> > This sharing mechanism is quite important in the context of Git, as we
> > assume POSIX semantics all over the place.
> >
> > There are two calls where we don't set up those flags though:
> >
> >   - We don't set `FILE_SHARE_DELETE` when creating a file for appending
> >     via `mingw_open_append()`. This makes it impossible to delete the
> >     file from another process or to replace it via an atomic rename.
> >
> >   - When opening a file such that we can change its access/modification
> >     times. This makes it impossible to perform any kind of operation
> >     on this file at all from another process. While we only open the
> >     file for a short amount of time to update its timestamps, this still
> >     opens us up for a race condition with another process.
> >
> > Adapt both of these callsites to pass all three sharing flags.
> 
> Interesting, and especially so noting that we *do* call CreateFileW()
> with the FILE_SHARE_DELETE flag in other functions like create_watch(),
> mingw_open_existing(), mingw_getcwd(), etc.
> 
> Why didn't we call CreateFileW() with FILE_SHARE_DELETE in the below two
> functions? I assume Johannes Schindelin and/or Johannes Sixt (both CC'd)
> would know the answer. Regardless, it would be interesting and useful
> (IMHO) to include such a detail in the commit message.
Hard to tell, but I think it's basically an oversight.
  - `mingw_utime()` was originally implemented via `_wopen()`, which
    doesn't give you full control over the sharing mode. It was then
    refactored via 090a3085bc (t/helper/test-chmtime: update mingw to
    support chmtime on directories, 2022-03-02) to use `CreateFileW()`.
    This refactoring wasn't quite to the old code, because we use no
    sharing flags at all. But in fact, `_wopen()` calls `_wsopen()` with
    `_SH_DENYNO`, which ultimately translates to `FILE_SHARE_READ |
    `FILE_SHARE_WRITE`. So we lost the read/write sharing with that
    conversion.
  - `mingw_open_append()` was introduced via d641097589 (mingw: enable
    atomic O_APPEND, 2018-08-13) and had `FILE_SHARE_READ |
    FILE_SHARE_WRITE` since the beginning.

Why we didn't set `FILE_SHARE_DELETE` is a different question though, and none that I can answer based on the commit messages. I would claim that it's likely an oversight and wasn't done intentionally, but I cannot say for sure.

Anyway, I'll include the above information in the commit message.
Patrick
Previous: Taylor BlauNext: Johannes Sixt
Message 7 of 44 in “compat/mingw: implement POSIX-style atomic renames”
  1. 0/3 compat/mingw: implement POSIX-style atomic renamesPatrick Steinhardt, Oct 23, 2024
  2. 1/3 compat/mingw: share file handles created via `CreateFileW()`Patrick Steinhardt, Oct 23, 2024
  3. Kristoffer HaugsbakkOct 23, 2024
  4. Taylor BlauOct 23, 2024
  5. Taylor BlauOct 23, 2024
  6. Taylor BlauOct 23, 2024
  7. Patrick SteinhardtOct 24, 2024
  8. Johannes SixtOct 27, 2024
  9. Taylor BlauOct 27, 2024
  10. 2/3 compat/mingw: allow deletion of most opened filesPatrick Steinhardt, Oct 23, 2024
  11. Kristoffer HaugsbakkOct 23, 2024
  12. Taylor BlauOct 23, 2024
  13. Patrick SteinhardtOct 24, 2024
  14. Taylor BlauOct 23, 2024
  15. 3/3 compat/mingw: support POSIX semantics for atomic renamesPatrick Steinhardt, Oct 23, 2024
  16. Kristoffer HaugsbakkOct 23, 2024
  17. Patrick SteinhardtOct 24, 2024
  18. Kristoffer HaugsbakkOct 24, 2024
  19. Patrick SteinhardtOct 24, 2024
  20. Taylor BlauOct 23, 2024
  21. Taylor BlauOct 23, 2024
  22. 0/3 compat/mingw: implement POSIX-style atomic renamesPatrick Steinhardt, Oct 24, 2024
  23. 1/3 compat/mingw: share file handles created via `CreateFileW()`Patrick Steinhardt, Oct 24, 2024
  24. 2/3 compat/mingw: allow deletion of most opened filesPatrick Steinhardt, Oct 24, 2024
  25. Johannes SixtOct 27, 2024
  26. Patrick SteinhardtOct 27, 2024
  27. Taylor BlauOct 27, 2024
  28. Taylor BlauOct 27, 2024
  29. 3/3 compat/mingw: support POSIX semantics for atomic renamesPatrick Steinhardt, Oct 24, 2024
  30. Johannes SixtOct 27, 2024
  31. Patrick SteinhardtOct 27, 2024
  32. Johannes SixtOct 27, 2024
  33. Patrick SteinhardtOct 27, 2024
  34. Johannes SixtOct 27, 2024
  35. Taylor BlauOct 27, 2024
  36. Taylor BlauOct 24, 2024
  37. Johannes SixtOct 27, 2024
  38. 0/3 compat/mingw: implement POSIX-style atomic renamesPatrick Steinhardt, Oct 27, 2024
  39. 1/3 compat/mingw: share file handles created via `CreateFileW()`Patrick Steinhardt, Oct 27, 2024
  40. 2/3 compat/mingw: allow deletion of most opened filesPatrick Steinhardt, Oct 27, 2024
  41. 3/3 compat/mingw: support POSIX semantics for atomic renamesPatrick Steinhardt, Oct 27, 2024
  42. Junio C HamanoNov 6, 2024
  43. Johannes SixtNov 6, 2024
  44. Junio C HamanoNov 6, 2024

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.