git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[BUG?] protocol.version=2 sends HTTP "Expect" headers

From
Jeff King <peff@peff.net>
Date
Oct 31, 2018, 16:03 UTC
Message-ID
<20181031160353.GA17267@sigill.intra.peff.net>

Since 959dfcf42f (smart-http: Really never use Expect: 100-continue, 2011-03-14), we try to avoid sending "Expect" headers, since some proxies apparently don't handle them well. There we have to explicitly tell curl not to use them.

The exception is large requests with GSSAPI, as explained in c80d96ca0c (remote-curl: fix large pushes with GSSAPI, 2013-10-31).

However, Jon Simons noticed that when using protocol.version=2, we've started sending Expect headers again. That's because rather than going through post_rpc(), we push the stateless data through a proxy_state struct. And in proxy_state_init(), when we set up the headers, we do not disable curl's Expect handling.

So a few questions:
  - is this a bug or not? I.e., do we still need to care about proxies
    that can't handle Expect? The original commit was from 2011. Maybe
    things are better now. Or maybe that's blind optimism.
    Nobody has complained yet, but that's probably just because v2 isn't
    widely deployed yet.
  - if it is a bug, how can we handle it like the v0 code? There we
    enable it only for GSSAPI on large requests. But I'm not sure we can
    know here whether the request is large, since we're inherently just
    streaming through chunked data. It looks like post_rpc tries to read
    a single packet first, and considers anything over 64k to be large.
  - alternatively, should we just leave it on for v2, and provide a
    config switch to disable it if you have a crappy proxy? I don't know
    how widespread the problem is, but I can imagine that the issue is
    subtle enough that most users wouldn't even know.

I think I've convinced myself that we probably do need to do the "peek at the first packet" thing like post_rpc() does, but I think it might be tricky with the way the proxy_state code is structured.

Thoughts from people with more HTTP knowledge/experience?
-Peff
Next: brian m. carlson
Message 1 of 3 in “[BUG?] protocol.version=2 sends HTTP "Expect" headers”
  1. Jeff KingOct 31, 2018
  2. brian m. carlsonNov 1, 2018
  3. Jeff KingNov 1, 2018

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.