git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH v3 14/21] read-cache: touch shared index files when used

From
Junio C Hamano <gitster@pobox.com>
Date
Jan 31, 2017, 21:09 UTC
Message-ID
<xmqqbmunq6mg.fsf@gitster.mtv.corp.google.com>
In-Reply-To
<xmqqy3xrqbkr.fsf@gitster.mtv.corp.google.com>
Junio C Hamano <gitster@pobox.com> writes:
> Yes, but you need to realize that "it is better not to bother users
> with a report of failure to touch in read-only repository" and "we
> ignore all failures".

Sorry about an unfinished sentence here. "need to realize that ... and ... are different things."

Show 18 quoted lines
> ... It is very similar
> to a situation where you ... run "status".
> The command first runs the equivalent of "update-index --refresh"
> only in-core, and it attempts to write the updated index because
> (1) it paid the cost of doing the refreshing already, and (2) if it
> can write into the index, it will help future operations in the
> repository.  But it does not report a failure to write the index
> exactly because it is merely doing an opportunistic write.
>
> And in the "we read from the split index, and we attempt to touch
> the underlying shared one to update its timestamp" case, it is OK
> not to report if we failed to touch.
> ...
> ... On the
> other hand, if you added new information, i.e. wrote the split index
> based on it, it is a good indication that the <split,shared> index
> pair has information that is more valuable.  We must warn in that
> case.

This reminds us of a third case. What should happen if we are doing the "opportunistic writing of the index" in "git status", managed to write the split index, but failed to touch the shared one?

In the ideal world, I think we should do the following sequence:
 - "status" tries to write cache to the file.
 - we try to write and on any error, we return error to the caller,
   who is already prepared to ignore it and stay silent.
    - as the first step of writing the index, we first try to touch
      the shared one.  If it fails, we return an error here without
      writing the split one out.
    - then we try to write the split one out.  If this fails, we
      also return an error.
    - otherwise, both touching of the shared one and writing of the
      split one are successful.  
 - "status" finishes the opportunistic refreshing of the index, by
   either ignoring an error silently (if either touching of shared
   one or writing of split one fails) or writing the refreshed index
   out successfully.

It is OK to swap the order of touching the shared one and writing of the split one in the above sequence, as long as an error in either step signals a failure to the opportunistic caller.

I do not offhand know if the split-index code is structured in such a way to allow the above sequence easily, or it needs refactoring.

If such a restructuring is required, it might not be within the scope of the series and I am OK if you just left the NEEDSWORK comment that describes the above (i.e. what we should be doing) as an in-code comment so that we can pick it up later. The whole point of the step 14/21 on the other hand is to make sure that a shared index that is still in active use will not go stale, and from that point of view, such a "punting" may not be a good idea---it deliberately finishes the series knowing that it does not adequately do what it promises to do.

So, ... I dunno.
Previous: Junio C HamanoNext: Christian Couder
Message 41 of 56 in “Add configuration options for split-index”
  1. 00/21 Add configuration options for split-indexChristian Couder, Dec 26, 2016
  2. 01/21 config: mark an error message up for translationChristian Couder, Dec 26, 2016
  3. 02/21 config: add git_config_get_split_index()Christian Couder, Dec 26, 2016
  4. 03/21 split-index: add {add,remove}_split_index() functionsChristian Couder, Dec 26, 2016
  5. 04/21 read-cache: add and then use tweak_split_index()Christian Couder, Dec 26, 2016
  6. 09/21 config: add git_config_get_max_percent_split_change()Christian Couder, Dec 26, 2016
  7. 10/21 read-cache: regenerate shared index if necessaryChristian Couder, Dec 26, 2016
  8. Junio C HamanoDec 27, 2016
  9. Christian CouderJan 2, 2017
  10. 05/21 update-index: warn in case of split-index incoherencyChristian Couder, Dec 26, 2016
  11. 11/21 t1700: add tests for splitIndex.maxPercentChangeChristian Couder, Dec 26, 2016
  12. 15/21 config: add git_config_get_expiry() from gc.cChristian Couder, Dec 26, 2016
  13. 12/21 Documentation/config: add splitIndex.maxPercentChangeChristian Couder, Dec 26, 2016
  14. Junio C HamanoDec 27, 2016
  15. Christian CouderJan 2, 2017
  16. 19/21 read-cache: use freshen_shared_index() in read_index_from()Christian Couder, Dec 26, 2016
  17. 20/21 Documentation/config: add splitIndex.sharedIndexExpireChristian Couder, Dec 26, 2016
  18. Junio C HamanoDec 27, 2016
  19. Christian CouderJan 2, 2017
  20. 17/21 t1700: test shared index file expirationChristian Couder, Dec 26, 2016
  21. 21/21 Documentation/git-update-index: explain splitIndex.*Christian Couder, Dec 26, 2016
  22. Junio C HamanoDec 27, 2016
  23. Christian CouderJan 2, 2017
  24. 18/21 read-cache: refactor read_index_from()Christian Couder, Dec 26, 2016
  25. 16/21 read-cache: unlink old sharedindex filesChristian Couder, Dec 26, 2016
  26. 14/21 read-cache: touch shared index files when usedChristian Couder, Dec 26, 2016
  27. Junio C HamanoDec 27, 2016
  28. Christian CouderJan 2, 2017
  29. Junio C HamanoJan 7, 2017
  30. Duy NguyenJan 9, 2017
  31. Junio C HamanoJan 9, 2017
  32. Duy NguyenJan 19, 2017
  33. Junio C HamanoJan 19, 2017
  34. Duy NguyenJan 20, 2017
  35. Christian CouderJan 23, 2017
  36. Junio C HamanoJan 23, 2017
  37. Christian CouderJan 25, 2017
  38. Junio C HamanoJan 25, 2017
  39. Christian CouderJan 31, 2017
  40. Junio C HamanoJan 31, 2017
  41. Junio C HamanoJan 31, 2017
  42. 13/21 sha1_file: make check_and_freshen_file() non staticChristian Couder, Dec 26, 2016
  43. Junio C HamanoDec 27, 2016
  44. 07/21 Documentation/config: add information for core.splitIndexChristian Couder, Dec 26, 2016
  45. 08/21 Documentation/git-update-index: talk about core.splitIndex config varChristian Couder, Dec 26, 2016
  46. Junio C HamanoDec 27, 2016
  47. Christian CouderJan 2, 2017
  48. Junio C HamanoJan 7, 2017
  49. Duy NguyenJan 9, 2017
  50. Christian CouderJan 23, 2017
  51. Junio C HamanoJan 23, 2017
  52. 06/21 t1700: add tests for core.splitIndexChristian Couder, Dec 26, 2016
  53. Junio C HamanoDec 27, 2016
  54. Christian CouderJan 2, 2017
  55. Junio C HamanoJan 3, 2017
  56. Christian CouderDec 26, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.