git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 2/8] protocol: introduce protocol extention mechanisms

From
BWBrandon Williams <bmwill@google.com>
Date
Sep 18, 2017, 17:02 UTC
Message-ID
<20170918170207.GF144331@google.com>
In-Reply-To
<CAGZ79kaeWsWdhoC7VDy-YkL1wVWqaQ9=TQUti9HfwjbT2poQdw@mail.gmail.com>
On 09/13, Stefan Beller wrote:
Show 53 quoted lines
> On Wed, Sep 13, 2017 at 2:54 PM, Brandon Williams <bmwill@google.com> wrote:
> > Create protocol.{c,h} and provide functions which future servers and
> > clients can use to determine which protocol to use or is being used.
> >
> > Also introduce the 'GIT_PROTOCOL' environment variable which will be
> > used to communicate a colon separated list of keys with optional values
> > to a server.  Unknown keys and values must be tolerated.  This mechanism
> > is used to communicate which version of the wire protocol a client would
> > like to use with a server.
> >
> > Signed-off-by: Brandon Williams <bmwill@google.com>
> > ---
> >  Documentation/config.txt | 16 +++++++++++
> >  Documentation/git.txt    |  5 ++++
> >  Makefile                 |  1 +
> >  cache.h                  |  7 +++++
> >  protocol.c               | 72 ++++++++++++++++++++++++++++++++++++++++++++++++
> >  protocol.h               | 15 ++++++++++
> >  6 files changed, 116 insertions(+)
> >  create mode 100644 protocol.c
> >  create mode 100644 protocol.h
> >
> > diff --git a/Documentation/config.txt b/Documentation/config.txt
> > index dc4e3f58a..d5b28a32c 100644
> > --- a/Documentation/config.txt
> > +++ b/Documentation/config.txt
> > @@ -2517,6 +2517,22 @@ The protocol names currently used by git are:
> >      `hg` to allow the `git-remote-hg` helper)
> >  --
> >
> > +protocol.version::
> 
> It would be cool to set a set of versions that are good. (I am not sure
> if that can be deferred to a later patch.)
> 
>   Consider we'd have versions 0,1,2,3,4 in the future:
>   In an ideal world the client and server would talk using v4
>   as it is the most advanced protocol, right?
>   Maybe a security/performance issue is found on the server side
>   with say protocol v3. Still no big deal as we are speaking v4.
>   But then consider an issue is found on the client side with v4.
>   Then the client would happily talk 0..3 while the server would
>   love to talk using 0,1,2,4.
> 
> The way I think about protocol version negotiation is that
> both parties involved have a set of versions that they tolerate
> to talk (they might understand more than the tolerated set, but the
> user forbade some), and the goal of the negotiation is to find
> the highest version number that is part of both the server set
> and client set. So quite naturally with this line of thinking the
> configuration is to configure a set of versions, which is what
> I propose here. Maybe even in the wire format, separated
> with colons?

I'm sure it wouldn't take too much to change this to be a multi-valued config. Because after this series there is just v0 and v1 I didn't think through this case too much. If others agree then I can go ahead and make it so in a reroll.

Show 15 quoted lines
> 
> > +       If set, clients will attempt to communicate with a server using
> > +       the specified protocol version.  If unset, no attempt will be
> > +       made by the client to communicate using a particular protocol
> > +       version, this results in protocol version 0 being used.
> 
> This sounds as if we're going to be really shy at first and only
> users that care will try out new versions at their own risk.
> From a users POV this may be frustrating as I would imagine that
> people want to run
> 
>   git config --global protocol.version 2
> 
> to try it out and then realize that some of their hosts do not speak
> 2, so they have to actually configure it per repo/remote.

The point would be to be able to set this globally, not per-repo. Even if a repo doesn't speak v2 then it should be able to gracefully degrade to v1 without the user having to do anything. The reason why there is this escape hatch is if doing the protocol negotiation out of band causing issues with communicating with a server that it can be shut off.

Show 9 quoted lines
> > +       Supported versions:
> 
> > +* `0` - the original wire protocol.
> 
> In the future this may be misleading as it doesn't specify the date of
> when it was original. e.g. are capabilities already supported in "original"?
> 
> Maybe phrase it as "wire protocol as of v2.14" ? (Though this sounds
> as if new capabilities added in the future are not allowed)

Yeah I can see how this could be misleading, though I'm not sure how best to word it to avoid that.

Show 9 quoted lines
> 
> 
> > +
> > +extern enum protocol_version parse_protocol_version(const char *value);
> > +extern enum protocol_version get_protocol_version_config(void);
> > +extern enum protocol_version determine_protocol_version_server(void);
> > +extern enum protocol_version determine_protocol_version_client(const char *server_response);
> 
> Here is a good place to have some comments.
-- 
Brandon Williams
Previous: Stefan BellerNext: Stefan Beller
Message 5 of 161 in “protocol transition”
  1. 0/8 protocol transitionBrandon Williams, Sep 13, 2017
  2. 1/8 pkt-line: add packet_write functionBrandon Williams, Sep 13, 2017
  3. 2/8 protocol: introduce protocol extention mechanismsBrandon Williams, Sep 13, 2017
  4. Stefan BellerSep 13, 2017
  5. Brandon WilliamsSep 18, 2017
  6. Stefan BellerSep 18, 2017
  7. Brandon WilliamsSep 18, 2017
  8. Stefan BellerSep 18, 2017
  9. 3/8 daemon: recognize hidden request argumentsBrandon Williams, Sep 13, 2017
  10. Stefan BellerSep 13, 2017
  11. Brandon WilliamsSep 18, 2017
  12. Jonathan TanSep 21, 2017
  13. Jonathan TanSep 21, 2017
  14. Brandon WilliamsSep 21, 2017
  15. 5/8 connect: teach client to recognize v1 server responseBrandon Williams, Sep 13, 2017
  16. 4/8 upload-pack, receive-pack: introduce protocol version 1Brandon Williams, Sep 13, 2017
  17. 6/8 connect: tell server that the client understands v1Brandon Williams, Sep 13, 2017
  18. 8/8 i5700: add interop test for protocol transitionBrandon Williams, Sep 13, 2017
  19. 7/8 http: tell server that the client understands v1Brandon Williams, Sep 13, 2017
  20. 5/8 connect: die when a capability line comes after a refBrandon Williams, Sep 20, 2017
  21. Jeff KingSep 20, 2017
  22. Brandon WilliamsSep 20, 2017
  23. Jonathan NiederSep 20, 2017
  24. Junio C HamanoSep 21, 2017
  25. connect: in ref advertisement, shallows are lastJonathan Tan, Sep 21, 2017
  26. connect: in ref advertisement, shallows are lastJonathan Tan, Sep 21, 2017
  27. Brandon WilliamsSep 22, 2017
  28. connect: in ref advertisement, shallows are lastJonathan Tan, Sep 22, 2017
  29. Junio C HamanoSep 22, 2017
  30. Junio C HamanoSep 22, 2017
  31. Brandon WilliamsSep 22, 2017
  32. connect: in ref advertisement, shallows are lastJonathan Tan, Sep 22, 2017
  33. Brandon WilliamsSep 22, 2017
  34. Jonathan TanSep 22, 2017
  35. Junio C HamanoSep 24, 2017
  36. connect: in ref advertisement, shallows are lastJonathan Tan, Sep 26, 2017
  37. Brandon WilliamsSep 26, 2017
  38. 0/9 protocol transitionBrandon Williams, Sep 26, 2017
  39. 2/9 pkt-line: add packet_write functionBrandon Williams, Sep 26, 2017
  40. 3/9 protocol: introduce protocol extention mechanismsBrandon Williams, Sep 26, 2017
  41. Junio C HamanoSep 27, 2017
  42. Junio C HamanoSep 27, 2017
  43. Brandon WilliamsSep 29, 2017
  44. Brandon WilliamsSep 28, 2017
  45. Stefan BellerSep 27, 2017
  46. Brandon WilliamsSep 28, 2017
  47. 1/9 connect: in ref advertisement, shallows are lastBrandon Williams, Sep 26, 2017
  48. 6/9 connect: teach client to recognize v1 server responseBrandon Williams, Sep 26, 2017
  49. Junio C HamanoSep 27, 2017
  50. Brandon WilliamsSep 27, 2017
  51. Junio C HamanoSep 27, 2017
  52. Brandon WilliamsSep 28, 2017
  53. 7/9 connect: tell server that the client understands v1Brandon Williams, Sep 26, 2017
  54. Junio C HamanoSep 27, 2017
  55. Junio C HamanoSep 27, 2017
  56. Brandon WilliamsSep 29, 2017
  57. Brandon WilliamsSep 28, 2017
  58. 9/9 i5700: add interop test for protocol transitionBrandon Williams, Sep 26, 2017
  59. 8/9 http: tell server that the client understands v1Brandon Williams, Sep 26, 2017
  60. Junio C HamanoSep 27, 2017
  61. Brandon WilliamsSep 27, 2017
  62. 5/9 upload-pack, receive-pack: introduce protocol version 1Brandon Williams, Sep 26, 2017
  63. Junio C HamanoSep 27, 2017
  64. Brandon WilliamsSep 27, 2017
  65. 4/9 daemon: recognize hidden request argumentsBrandon Williams, Sep 26, 2017
  66. Junio C HamanoSep 27, 2017
  67. Brandon WilliamsSep 27, 2017
  68. Brandon WilliamsSep 28, 2017
  69. 00/10 protocol transitionBrandon Williams, Oct 3, 2017
  70. 04/10 daemon: recognize hidden request argumentsBrandon Williams, Oct 3, 2017
  71. Jonathan TanOct 10, 2017
  72. Brandon WilliamsOct 13, 2017
  73. 03/10 protocol: introduce protocol extention mechanismsBrandon Williams, Oct 3, 2017
  74. Simon RuderichOct 6, 2017
  75. Junio C HamanoOct 6, 2017
  76. Martin ÅgrenOct 6, 2017
  77. Junio C HamanoOct 6, 2017
  78. Martin ÅgrenOct 6, 2017
  79. Stefan BellerOct 6, 2017
  80. Martin ÅgrenOct 8, 2017
  81. Brandon WilliamsOct 10, 2017
  82. Jonathan NiederOct 10, 2017
  83. Stefan BellerOct 10, 2017
  84. Junio C HamanoOct 11, 2017
  85. Brandon WilliamsOct 13, 2017
  86. Martin ÅgrenOct 9, 2017
  87. Jonathan TanOct 10, 2017
  88. 02/10 pkt-line: add packet_write functionBrandon Williams, Oct 3, 2017
  89. Jonathan TanOct 10, 2017
  90. 05/10 upload-pack, receive-pack: introduce protocol version 1Brandon Williams, Oct 3, 2017
  91. Jonathan TanOct 10, 2017
  92. Brandon WilliamsOct 13, 2017
  93. 01/10 connect: in ref advertisement, shallows are lastBrandon Williams, Oct 3, 2017
  94. Jonathan TanOct 10, 2017
  95. 09/10 i5700: add interop test for protocol transitionBrandon Williams, Oct 3, 2017
  96. 08/10 http: tell server that the client understands v1Brandon Williams, Oct 3, 2017
  97. 10/10 ssh: introduce a 'simple' ssh variantBrandon Williams, Oct 3, 2017
  98. Jonathan NiederOct 3, 2017
  99. Brandon WilliamsOct 16, 2017
  100. 0/5 Coping with unrecognized ssh wrapper scripts in GIT_SSHJonathan Nieder, Oct 23, 2017
  101. 1/5 connect: split git:// setup into a separate functionJonathan Nieder, Oct 23, 2017
  102. Stefan BellerOct 23, 2017
  103. diff: add option to ignore whitespaces for move detection onlyStefan Beller, Oct 24, 2017
  104. Brandon WilliamsOct 24, 2017
  105. Junio C HamanoOct 25, 2017
  106. Junio C HamanoOct 25, 2017
  107. Brandon WilliamsOct 25, 2017
  108. Junio C HamanoOct 24, 2017
  109. Stefan BellerOct 24, 2017
  110. 2/5 connect: split ssh command line options into separate functionJonathan Nieder, Oct 23, 2017
  111. Stefan BellerOct 23, 2017
  112. 3/5 ssh: 'auto' variant to select between 'ssh' and 'simple'Jonathan Nieder, Oct 23, 2017
  113. Jonathan TanOct 23, 2017
  114. Jonathan NiederOct 23, 2017
  115. Brandon WilliamsOct 23, 2017
  116. Jonathan TanOct 23, 2017
  117. 0/5 Coping with unrecognized ssh wrapper scripts in GIT_SSHJonathan Nieder, Oct 23, 2017
  118. 1/5 connect: split git:// setup into a separate functionJonathan Nieder, Oct 23, 2017
  119. Junio C HamanoOct 24, 2017
  120. Jonathan NiederNov 15, 2017
  121. Junio C HamanoNov 17, 2017
  122. 2/5 connect: split ssh command line options into separate functionJonathan Nieder, Oct 23, 2017
  123. Junio C HamanoOct 24, 2017
  124. 3/5 ssh: 'auto' variant to select between 'ssh' and 'simple'Jonathan Nieder, Oct 23, 2017
  125. Brandon WilliamsOct 23, 2017
  126. Stefan BellerOct 23, 2017
  127. 4/5 ssh: 'simple' variant does not support -4/-6Jonathan Nieder, Oct 23, 2017
  128. 5/5 ssh: 'simple' variant does not support --portJonathan Nieder, Oct 23, 2017
  129. Junio C HamanoOct 24, 2017
  130. Jonathan NiederOct 23, 2017
  131. Stefan BellerOct 23, 2017
  132. Jonathan NiederOct 23, 2017
  133. Junio C HamanoOct 24, 2017
  134. Johannes SchindelinOct 25, 2017
  135. Stefan BellerOct 25, 2017
  136. Jonathan NiederOct 25, 2017
  137. Junio C HamanoOct 30, 2017
  138. Johannes SchindelinOct 30, 2017
  139. 4/5 ssh: 'simple' variant does not support -4/-6Jonathan Nieder, Oct 23, 2017
  140. 5/5 ssh: 'simple' variant does not support --portJonathan Nieder, Oct 23, 2017
  141. Stefan BellerOct 23, 2017
  142. 07/10 connect: tell server that the client understands v1Brandon Williams, Oct 3, 2017
  143. Jonathan TanOct 10, 2017
  144. Brandon WilliamsOct 13, 2017
  145. 06/10 connect: teach client to recognize v1 server responseBrandon Williams, Oct 3, 2017
  146. Junio C HamanoOct 4, 2017
  147. Documentation: document Extra ParametersJonathan Tan, Oct 10, 2017
  148. Brandon WilliamsOct 13, 2017
  149. 00/11 protocol transitionBrandon Williams, Oct 16, 2017
  150. 01/11 connect: in ref advertisement, shallows are lastBrandon Williams, Oct 16, 2017
  151. 02/11 pkt-line: add packet_write functionBrandon Williams, Oct 16, 2017
  152. 03/11 protocol: introduce protocol extension mechanismsBrandon Williams, Oct 16, 2017
  153. Kevin DaudtOct 16, 2017
  154. 06/11 connect: teach client to recognize v1 server responseBrandon Williams, Oct 16, 2017
  155. 04/11 daemon: recognize hidden request argumentsBrandon Williams, Oct 16, 2017
  156. 09/11 i5700: add interop test for protocol transitionBrandon Williams, Oct 16, 2017
  157. 08/11 http: tell server that the client understands v1Brandon Williams, Oct 16, 2017
  158. 05/11 upload-pack, receive-pack: introduce protocol version 1Brandon Williams, Oct 16, 2017
  159. 07/11 connect: tell server that the client understands v1Brandon Williams, Oct 16, 2017
  160. 10/11 ssh: introduce a 'simple' ssh variantBrandon Williams, Oct 16, 2017
  161. 11/11 Documentation: document Extra ParametersBrandon Williams, Oct 16, 2017

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.