git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Clone hangs when done over http with --reference

From
Konstantin Ryabitsev <konstantin@linuxfoundation.org>
Date
May 13, 2015, 21:04 UTC
Message-ID
<20150513210436.GA7407@gmail.com>

I have a reproducible case where git clone --reference hangs when performed over http://, but not when performed over git://

The repository in question is very large, which possibly plays a role in this. Unfortunately, I was not able to reproduce this with any other repository, so if anyone wants to try this, they will have to suffer through 2.5GB downloads.

To reproduce on the client:

git clone --mirror \ http://source.codeaurora.org/mirrors/chromium.googlesource.com/chromium/src (completes after downloading ~2.5GB)

git clone --reference ./src.git --mirror \ http://source.codeaurora.org/quic/chrome4sdp/chromium/src.git foo.git (this hangs forever)

If you do this over git:// protocol, it will work:

git clone --reference ./src.git --mirror \ git://source.codeaurora.org/quic/chrome4sdp/chromium/src.git foo.git (completes after downloading ~100MB)

It will also work if you clone the same repo without --reference. Both repositories pass fsck checks.

I reproduced it with git-2.4.0 on the server, and it appears to be unrelated to the Apache/Nginx versions nor various httpd daemon settings, at least not in my testing. No errors are generated in the logs. The process just appears to be stuck not doing anything.

To reproduce locally, simply set up these two repositories in /var/lib/git (one can be a --reference clone of the other -- it didn't matter in my tests), and put this in /etc/httpd/conf.d/git.conf, assuming Fedora or Centos7 system:

SetEnv GIT_PROJECT_ROOT /var/lib/git SetEnv GIT_HTTP_EXPORT_ALL 1

AliasMatch ^/git/(.*/objects/[0-9a-f]{2}/[0-9a-f]{38})$ /var/lib/git/$1 AliasMatch ^/git/(.*/objects/pack/pack-[0-9a-f]{40}.(pack|idx))$ /var/lib/git/$1

ScriptAlias /git/ /usr/libexec/git-core/git-http-backend/
<Directory "/var/lib/git">
    AllowOverride None
    Options None
    Require all granted
</Directory>
<Directory "/usr/libexec/git-core">
    AllowOverride None
    Options None
    Require all granted
</Directory>

Not sure what is going on, but it appears that the hang is on the server. Hope someone can figure it out.

Best,
-- 
Konstantin Ryabitsev
Linux Foundation Collab Projects
Montréal, Québec
Next: Jeff King
Message 1 of 24 in “Clone hangs when done over http with --reference”
  1. Konstantin RyabitsevMay 13, 2015
  2. Jeff KingMay 14, 2015
  3. http-backend: fix die recursion with custom handlerJeff King, May 14, 2015
  4. Jeff KingMay 15, 2015
  5. Konstantin RyabitsevMay 14, 2015
  6. Jeff KingMay 14, 2015
  7. 0/2 fix http deadlock on giant ref negotiationsJeff King, May 15, 2015
  8. 1/2 http-backend: fix die recursion with custom handlerJeff King, May 15, 2015
  9. 2/2 http-backend: spool ref negotiation requests to bufferJeff King, May 15, 2015
  10. Junio C HamanoMay 15, 2015
  11. Konstantin RyabitsevMay 15, 2015
  12. 0/3 fix http deadlock on giant ref negotiationsJeff King, May 20, 2015
  13. 1/3 http-backend: fix die recursion with custom handlerJeff King, May 20, 2015
  14. 2/3 t5551: factor out tag creationJeff King, May 20, 2015
  15. 3/3 http-backend: spool ref negotiation requests to bufferJeff King, May 20, 2015
  16. Konstantin RyabitsevMay 26, 2015
  17. Jeff KingMay 26, 2015
  18. Junio C HamanoMay 26, 2015
  19. Jeff KingMay 15, 2015
  20. Dennis KaarsemakerMay 15, 2015
  21. Jeff KingMay 15, 2015
  22. Dennis KaarsemakerMay 15, 2015
  23. Jeff KingMay 15, 2015
  24. Dennis KaarsemakerMay 15, 2015

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.