git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 10/14] (RFC-only) config: finish config_fn_t refactor

From
Glen Choo <chooglen@google.com>
Date
May 8, 2023, 21:00 UTC
Message-ID
<kl6lr0rq1qt8.fsf@chooglen-macbookpro.roam.corp.google.com>
In-Reply-To
<230501.868re8jna4.gmgdl@evledraar.gmail.com>
Ævar Arnfjörð Bjarmason <avarab@gmail.com> writes:
Show 21 quoted lines
> On Fri, Apr 21 2023, Glen Choo via GitGitGadget wrote:
>
>> From: Glen Choo <chooglen@google.com>
>
> I like the general goal of this series, i.e. to get rid of the "reader"
> callback, and pass stuff more explicitly.
>
> But as I pointed out in
> https://lore.kernel.org/git/RFC-cover-0.5-00000000000-20230317T042408Z-avarab@gmail.com/
> I think this part (and the preceding two commits) are really taking is
> down the wrong path.
>
> To demonstrate why, here's a patch-on-top of this topic as a whole where
> I renamed the "kvi" struct members. I've excluded config.c itself (as
> its internals aren't interesting for the purposes of this discussion):
>
> [Patch showing used kvi members...]
>
> So, as this shows us your 08/14 has gone through the effort of passing
> this "kvi" info to every single callback, but it's only this handful
> that actually needs this information.

The attached patch misses the majority of "kvi" users, which use it in die_bad_number(). This change happens in Patch 13/14, where the whole "kvi" is passed into config.c machinery. It's still a much smaller number of config callbacks than the ones changed in these few patches, but it's more than a handful, I'd think.

> So, even if we *can* get this to work I don't think it's worth it,
> especially as this would preclude giving these config callbacks some
> "lighter" API that doesn't take the trouble of recording and ferrying
> this information to them.
I assume the "lighter API" refers to the current API?

If I'm reading this correctly, your concern isn't primarily about reducing churn, it's YAGNI - since most callers don't need this info, they should be able to reap the benefits of an API that doesn't provide that info. Thus, you're proposing to having both the current API and a new kvi-based one?

If so, I don't think that's a good route to take:
- Having both *_kvi() and "old" variants will add bloat to an already
  bloated config API. Even without further changes, we'd need to add
  *_kvi() to at least config_with_options() and repo_config(), as well
  as all of the functions that config_with_options() uses under the
  hood (some of which are public).
  To some extent, this can be managed by shrinking the config API (e.g.
  like your suggestion to get rid of git_config_from_file() [1]), but
  IMO that needs more discussion.
- What benefit is the old API giving us vs the new one? It won't be any
  faster since the machinery will need to support the new API, and even
  if it were, the benefit would be tiny. In some cases it might be nice
  to use the config callback in a non-config setting, but this patch
  shows that those are rare and can be easily worked around.
- I strongly suspect that we'd already like "kvi" in more places, and if
  we made it readily available, we would add these additional callers.
  E.g. we already use it to give additional diagnostics when failing to
  parse a number, and there's no reason why we shouldn't do this when
  doing other kinds of parsing (e.g. date in git_config_expiry_date() or
  color in color_parse_mem()).

If your concern really is primarily about churn and we actually want to move everything to the new API eventually, wouldn't it be better to bite the bullet and take a one time, well-scoped churn cost instead of a longer migration?

[1] https://lore.kernel.org/git/230307.86wn3szrzu.gmgdl@evledraar.gmail.com/
Show 5 quoted lines
> I think this should also neatly answer some of your outstanding
> questions. Especially as the above shows that the only non-test caller
> that needs "linenr" is the builtin/config.c caller that my proposed RFC
> (linked above) tackled directly. Most of these callbacks just need the
> more basic "scope".

I didn't see where builtin/config.c was handled in the above link. Perhaps you meant a different RFC, https://github.com/avar/git/commit/0233297a359bbda43a902dd0213aacdca82faa34?

Show 15 quoted lines
> So, in particular:
>
>> Here's an exhaustive list of all of the changes:
>>
>> * Cases that need a judgement call
>>
>>   - trace2/tr2_cfg.c:tr2_cfg_set_fl()
>>
>>     This function needs to account for tr2_cfg_cb() now using "kvi".
>>     Since this is only called (indirectly) by git_config_set(), config
>>     source information has never been available here, so just pass NULL.
>>     It will be tr2_cfg_cb()'s responsibility to not use "kvi".
>
> Just adding a "CONFIG_SCOPE_IN_PROCESS", "CONFIG_SCOPE_SET" or whatever
> you'd want to call it seems to make much more sense here, no? 
CONFIG_SCOPE_SET makes sense.
Show 10 quoted lines
>>   - builtin/checkout.c:checkout_main()
>>
>>     This calls git_xmerge_config() as a shorthand for parsing a CLI arg.
>>     "kvi" doesn't apply, so just pass NULL. This might be worth
>>     refactoring away, since git_xmerge_config() can call
>>     git_default_config().
>
> Another example of a caller which never actually cares about this data,
> so if it doesn't need to have it passed to it, it doesn't need to fake
> it up either.

Here's a case of YAGNI I mentioned above and I agree it would be nice to not have to fake a "kvi". However, git_xmerge_config() can call git_defualt_config() so this seems more like it's abusing the config callback to parse a CLI arg. A better resolution would be to have a function dedicated to parsing "merge.conflictstyle".

Show 53 quoted lines
>> * Hard for cocci to catch
>>
>>   - urlmatch.c
>>
>>     Manually refactor the custom config callbacks in "struct
>>     urlmatch_config".
>>
>>   - diff.h, fsck.h, grep.h, ident.h, xdiff-interface.h
>>
>>     "struct key_value_info" hasn't been defined yet, so forward declare
>>     it. Alternatively, maybe these files should "#include config.h".
>
> All of these problems go away if you don't insist on changing every
> single caller, you'll just have a step where you remove the current
> global in favor of some "config callback with kvi" info, and "make" will
> spot those callers that aren't converted yet.
>
> Those changes will be trivial enough (just the callers I noted above) to
> not require the tricky cocci patch in 08/14.
>
>> * Likely deficiencies in .cocci patch
>>
>>   - submodule-config.c:gitmodules_cb()
>>
>>     Manually refactor a parse_config() call that gets missed because it
>>     uses a different "*data" arg.
>>
>>   - grep.h, various
>>
>>     Manually refactor grep_config() calls. Not sure why these don't get
>>     picked up.
>>
>>   - config.c:git_config_include(), http.c:http_options()
>>
>>     Manually add "kvi" where it was missed. Not sure why they get missed.
>>
>>   - builtin/clone.c:write_one_config()
>>
>>     Manually refactor a git_clone_config() call. Probably got missed
>>     because I didn't include git_config_parse_parameter().
>>
>>   - ident.h
>>
>>     Remove the UNUSED attribute. Not sure why this is the only instance
>>     of this.
>>
>>   - git-compat-util.h, compat/mingw.[h|c]
>>
>>     Manually refactor noop_core_config(), platform_core_config() and
>>     mingw_core_config(). I can probably add these as "manual fixups" in
>>     cocci.
>
> ditto.

Yeah, there was definitely more cocci trickery than I'd like. Btw, if you comments on the .cocci file itself, feel free to share. I obviously just hacked together something based on a very rudimentary understanding of cocci and I'd love suggestions on how to improve.

Previous: Jonathan TanNext: Glen Choo via GitGitGadget
Message 16 of 115 in “[RFC] config: remove global state from config iteration”
  1. 00/14 [RFC] config: remove global state from config iterationGlen Choo via GitGitGadget, Apr 21, 2023
  2. 01/14 config.c: introduce kvi_fn(), use it for configsetsGlen Choo via GitGitGadget, Apr 21, 2023
  3. 02/14 config.c: use kvi for CLI configGlen Choo via GitGitGadget, Apr 21, 2023
  4. Ævar Arnfjörð BjarmasonMay 1, 2023
  5. 06/14 config: inline git_color_default_configGlen Choo via GitGitGadget, Apr 21, 2023
  6. 03/14 config: use kvi for config filesGlen Choo via GitGitGadget, Apr 21, 2023
  7. 04/14 config: add kvi.path, use it to evaluate includesGlen Choo via GitGitGadget, Apr 21, 2023
  8. 05/14 config: pass source to config_parser_event_fn_tGlen Choo via GitGitGadget, Apr 21, 2023
  9. 07/14 urlmatch.h: use config_fn_t typeGlen Choo via GitGitGadget, Apr 21, 2023
  10. 08/14 (RFC-only) config: add kvi arg to config_fn_tGlen Choo via GitGitGadget, Apr 21, 2023
  11. 10/14 (RFC-only) config: finish config_fn_t refactorGlen Choo via GitGitGadget, Apr 21, 2023
  12. Ævar Arnfjörð BjarmasonMay 1, 2023
  13. Jonathan TanMay 5, 2023
  14. Glen ChooMay 9, 2023
  15. Jonathan TanMay 11, 2023
  16. Glen ChooMay 8, 2023
  17. 11/14 config: remove current_config_(line|name|origin_type)Glen Choo via GitGitGadget, Apr 21, 2023
  18. 14/14 config: remove config_reader from configset_add_valueGlen Choo via GitGitGadget, Apr 21, 2023
  19. 12/14 config: remove current_config_scope()Glen Choo via GitGitGadget, Apr 21, 2023
  20. 09/14 (RFC-only) config: apply cocci to config_fn_t implementationsGlen Choo via GitGitGadget, Apr 21, 2023
  21. 13/14 config: pass kvi to die_bad_number()Glen Choo via GitGitGadget, Apr 21, 2023
  22. 00/14 [RFC] config: remove global state from config iterationGlen Choo via GitGitGadget, May 30, 2023
  23. 01/14 config: inline git_color_default_configGlen Choo via GitGitGadget, May 30, 2023
  24. 02/14 urlmatch.h: use config_fn_t typeGlen Choo via GitGitGadget, May 30, 2023
  25. 03/14 (RFC-only) config: add kvi arg to config_fn_tGlen Choo via GitGitGadget, May 30, 2023
  26. Phillip WoodJun 1, 2023
  27. Glen ChooJun 1, 2023
  28. Phillip WoodJun 2, 2023
  29. Glen ChooJun 2, 2023
  30. Phillip WoodJun 5, 2023
  31. Glen ChooJun 9, 2023
  32. 08/14 builtin/config.c: test misuse of format_config()Glen Choo via GitGitGadget, May 30, 2023
  33. 06/14 config.c: pass kvi in configsetsGlen Choo via GitGitGadget, May 30, 2023
  34. Jonathan TanJun 1, 2023
  35. 05/14 (RFC-only) config: finish config_fn_t refactorGlen Choo via GitGitGadget, May 30, 2023
  36. Jonathan TanJun 1, 2023
  37. 07/14 config: provide kvi with config filesGlen Choo via GitGitGadget, May 30, 2023
  38. Jonathan TanJun 1, 2023
  39. Jonathan TanJun 1, 2023
  40. 04/14 (RFC-only) config: apply cocci to config_fn_t implementationsGlen Choo via GitGitGadget, May 30, 2023
  41. 09/14 config.c: provide kvi with CLI configGlen Choo via GitGitGadget, May 30, 2023
  42. Jonathan TanJun 1, 2023
  43. Glen ChooJun 2, 2023
  44. 10/14 trace2: plumb config kviGlen Choo via GitGitGadget, May 30, 2023
  45. Jonathan TanJun 1, 2023
  46. 12/14 config.c: remove config_reader from configsetsGlen Choo via GitGitGadget, May 30, 2023
  47. 13/14 config: add kvi.path, use it to evaluate includesGlen Choo via GitGitGadget, May 30, 2023
  48. Jonathan TanJun 2, 2023
  49. 14/14 config: pass source to config_parser_event_fn_tGlen Choo via GitGitGadget, May 30, 2023
  50. Jonathan TanJun 2, 2023
  51. Glen ChooJun 2, 2023
  52. 11/14 config: pass kvi to die_bad_number()Glen Choo via GitGitGadget, May 30, 2023
  53. Jonathan TanJun 1, 2023
  54. Glen ChooJun 2, 2023
  55. 00/12 config: remove global state from config iterationGlen Choo via GitGitGadget, Jun 20, 2023
  56. 02/12 urlmatch.h: use config_fn_t typeGlen Choo via GitGitGadget, Jun 20, 2023
  57. Junio C HamanoJun 20, 2023
  58. 01/12 config: inline git_color_default_configGlen Choo via GitGitGadget, Jun 20, 2023
  59. Junio C HamanoJun 20, 2023
  60. 04/12 config.c: pass ctx in configsetsGlen Choo via GitGitGadget, Jun 20, 2023
  61. Junio C HamanoJun 20, 2023
  62. 05/12 config: pass ctx with config filesGlen Choo via GitGitGadget, Jun 20, 2023
  63. 06/12 builtin/config.c: test misuse of format_config()Glen Choo via GitGitGadget, Jun 20, 2023
  64. Junio C HamanoJun 20, 2023
  65. Glen ChooJun 20, 2023
  66. Jonathan TanJun 23, 2023
  67. Jeff KingJun 24, 2023
  68. Glen ChooJun 28, 2023
  69. 07/12 config.c: pass ctx with CLI configGlen Choo via GitGitGadget, Jun 20, 2023
  70. Jonathan TanJun 23, 2023
  71. Glen ChooJun 23, 2023
  72. 08/12 trace2: plumb config kviGlen Choo via GitGitGadget, Jun 20, 2023
  73. Jonathan TanJun 23, 2023
  74. 10/12 config.c: remove config_reader from configsetsGlen Choo via GitGitGadget, Jun 20, 2023
  75. Jonathan TanJun 23, 2023
  76. Junio C HamanoJun 23, 2023
  77. 03/12 config: add ctx arg to config_fn_tGlen Choo via GitGitGadget, Jun 20, 2023
  78. 11/12 config: add kvi.path, use it to evaluate includesGlen Choo via GitGitGadget, Jun 20, 2023
  79. 12/12 config: pass source to config_parser_event_fn_tGlen Choo via GitGitGadget, Jun 20, 2023
  80. Junio C HamanoJun 20, 2023
  81. 09/12 config: pass kvi to die_bad_number()Glen Choo via GitGitGadget, Jun 20, 2023
  82. Junio C HamanoJun 21, 2023
  83. Glen ChooJun 21, 2023
  84. Jonathan TanJun 23, 2023
  85. Junio C HamanoJun 23, 2023
  86. Glen ChooJun 23, 2023
  87. 00/12 config: remove global state from config iterationGlen Choo via GitGitGadget, Jun 26, 2023
  88. 01/12 config: inline git_color_default_configGlen Choo via GitGitGadget, Jun 26, 2023
  89. 02/12 urlmatch.h: use config_fn_t typeGlen Choo via GitGitGadget, Jun 26, 2023
  90. 04/12 config.c: pass ctx in configsetsGlen Choo via GitGitGadget, Jun 26, 2023
  91. 06/12 builtin/config.c: test misuse of format_config()Glen Choo via GitGitGadget, Jun 26, 2023
  92. 05/12 config: pass ctx with config filesGlen Choo via GitGitGadget, Jun 26, 2023
  93. 07/12 config.c: pass ctx with CLI configGlen Choo via GitGitGadget, Jun 26, 2023
  94. 08/12 trace2: plumb config kviGlen Choo via GitGitGadget, Jun 26, 2023
  95. 03/12 config: add ctx arg to config_fn_tGlen Choo via GitGitGadget, Jun 26, 2023
  96. 11/12 config: add kvi.path, use it to evaluate includesGlen Choo via GitGitGadget, Jun 26, 2023
  97. 12/12 config: pass source to config_parser_event_fn_tGlen Choo via GitGitGadget, Jun 26, 2023
  98. 10/12 config.c: remove config_reader from configsetsGlen Choo via GitGitGadget, Jun 26, 2023
  99. 09/12 config: pass kvi to die_bad_number()Glen Choo via GitGitGadget, Jun 26, 2023
  100. Junio C HamanoJun 26, 2023
  101. 00/11 config: remove global state from config iterationGlen Choo via GitGitGadget, Jun 28, 2023
  102. 01/11 config: inline git_color_default_configGlen Choo via GitGitGadget, Jun 28, 2023
  103. 02/11 urlmatch.h: use config_fn_t typeGlen Choo via GitGitGadget, Jun 28, 2023
  104. 04/11 config.c: pass ctx in configsetsGlen Choo via GitGitGadget, Jun 28, 2023
  105. 05/11 config: pass ctx with config filesGlen Choo via GitGitGadget, Jun 28, 2023
  106. 06/11 config.c: pass ctx with CLI configGlen Choo via GitGitGadget, Jun 28, 2023
  107. 07/11 trace2: plumb config kviGlen Choo via GitGitGadget, Jun 28, 2023
  108. 03/11 config: add ctx arg to config_fn_tGlen Choo via GitGitGadget, Jun 28, 2023
  109. 09/11 config.c: remove config_reader from configsetsGlen Choo via GitGitGadget, Jun 28, 2023
  110. 10/11 config: add kvi.path, use it to evaluate includesGlen Choo via GitGitGadget, Jun 28, 2023
  111. 11/11 config: pass source to config_parser_event_fn_tGlen Choo via GitGitGadget, Jun 28, 2023
  112. 08/11 config: pass kvi to die_bad_number()Glen Choo via GitGitGadget, Jun 28, 2023
  113. Jonathan TanJun 28, 2023
  114. Junio C HamanoJun 28, 2023
  115. Phillip WoodJul 11, 2023

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.