git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCHv2] attr: convert to new threadsafe API

From
Stefan Beller <sbeller@google.com>
Date
Oct 12, 2016, 20:02 UTC
Message-ID
<CAGZ79kaBhXHLDEK0XMLjm3QofmtaGZspA3EEx5x4-qCYY--wZA@mail.gmail.com>
In-Reply-To
<xmqqfuo15yjm.fsf@gitster.mtv.corp.google.com>
On Wed, Oct 12, 2016 at 9:20 AM, Junio C Hamano <gitster@pobox.com> wrote:
Show 25 quoted lines
> Stefan Beller <sbeller@google.com> writes:
>
>>> I am not sure if the updates to the callers fulfill that purpose.
>>> For example, look at this hunk.
>>>
>>>> @@ -111,6 +111,7 @@ static int write_archive_entry(const unsigned char *sha1, const char *base,
>>>>       struct archiver_args *args = c->args;
>>>>       write_archive_entry_fn_t write_entry = c->write_entry;
>>>>       static struct git_attr_check *check;
>>>> +     static struct git_attr_result result;
>>>
>>> As we discussed, this caller, even when threaded, will always want
>>> to ask for a fixed two attributes, so "check" being static and
>>> shared across threads is perfectly fine.  But we do not want to see
>>> "result" shared, do we?
>>
>> Well all of the hunks in the patch are not threaded, so they
>> don't follow a threading pattern, but the static pattern to not be
>> more expensive than needed.
>
> Is it too invasive a change to make them as if they are thread-ready
> users of API that happen to know their callers are not threading?
> It would be ideal if we can prepare them so that the way they
> interact with the attr subsystem will not have to change after this
> step.

As far as I see the future, we do not need to change those in the future, unless we add the threading to the current callers, which is usually a very invasive thing?

Show 22 quoted lines
>
>>> In other words, ideally, I think this part of the patch should
>>> rather read like this:
>>>
>>>         static struct git_attr_check *check;
>>>         struct git_attr_result result[2];
>>>
>>>         ...
>>>         git_attr_check_initl(&check, "export-ignore", "export-subst", NULL);
>>>         if (!git_check_attr(path_without_prefix, check, result)) {
>>>                 ... use result[0] and result[1] ...
>>>
>>> For sanity checking, it is OK to add ARRAY_SIZE(result) as the final
>>> and extra parameter to git_check_attr() so that the function can
>>> make sure it matches (or exceeds) check->nr.
>>
>> That seems tempting from a callers perspective; I'll look into that.
>
> For callers that prepare "check" and "result" before asking
> check-attr about the attributes in "check" for many paths, it is OK
> to use your "allocate with attr_result_init()" pattern.  The "result"
> still needs to be made non-static, though.

I do not see why we would want to have a non static result for non threaded callers.

Show 16 quoted lines
>
> But many callers do not follow that; rather they do
>
>         loop to iterate over paths {
>                 call a helper func to learn attr X for path
>                 use the value of attr X
>         }
>
> using a callchain that embeds a helper function deep inside, and
> "check" is kept in the helper, check-attr function is called from
> there, and "result" is not passed from the caller to the helper
> (obviously, because it does not exist in the current API).  See the
> callchain that leads down to convert.c::convert_attrs() for a
> typical example.  When converted to the new API, it needs to have a
> new "result" structure every time it is called, and cannot reuse the
> one that was used in its previous call.

Why would that be? i.e. I do not understand the reasoning/motivation as well as what you propose to change here. Do you think of the result being held at the top of the call chain (and there it may be just allocated on the stack) and passed down all the way to convert_attrs, that writes into that result?

Currently the static result in convert_attrs just works fine (as all tests pass) and that is not the place where we'd add threading to?

Threading would be added in dir.c, a new place that will use attrs.

Maybe instead of discussing the meaning of this patch further, I should rebase the "pathspecs can ask for attributes" patches to either experience the problems myself or at least have a series that has a meaningful endgoal. I thought this preparatory series may be better than sending an even larger series.

Thanks, Stefan

Previous: Junio C HamanoNext: Junio C Hamano
Message 5 of 16 in “[PATCHv2] attr: convert to new threadsafe API”
  1. Stefan BellerOct 11, 2016
  2. Junio C HamanoOct 12, 2016
  3. Stefan BellerOct 12, 2016
  4. Junio C HamanoOct 12, 2016
  5. Stefan BellerOct 12, 2016
  6. Junio C HamanoOct 12, 2016
  7. Junio C HamanoOct 12, 2016
  8. Johannes SixtOct 12, 2016
  9. Junio C HamanoOct 12, 2016
  10. Stefan BellerOct 12, 2016
  11. Junio C HamanoOct 12, 2016
  12. Jacob KellerOct 12, 2016
  13. Stefan BellerOct 12, 2016
  14. Junio C HamanoOct 12, 2016
  15. Stefan BellerOct 12, 2016
  16. Junio C HamanoOct 12, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.