{"thread":{"id":"16802","subject":"Very slow clone time over http","startedAt":"2008-12-19T22:33:08Z","lastAt":"2008-12-19T22:33:08Z","messageCount":1,"participants":["demerphq"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"98384","messageId":"9b18b3110812191433l4eb70ccdw8693037045823aef@mail.gmail.com","threadId":"16802","inReplyTo":null,"subject":"Very slow clone time over http","fromName":"demerphq","fromEmail":"demerphq@gmail.com","sentAt":"2008-12-19T22:33:08Z","receivedAt":"2008-12-19T22:33:08Z","isPatch":false,"sender":{"key":"demerphq@gmail.com","avatar":null},"body":"Hi,\n\nI've been working on the migration of the perl5 repositories from\nperforce to git, which is soon to be officially released.\n\nWe have set up a server with http/git/ssh access, and we had hoped\nalso rsync access.\n\nHowever, it appears that clone using the rsync:// protocol is broken,\nand now we are discovering that http cloning is extremely slow. I\nreported our experiences with rsync in a previous mail, and now im\nreporting the http performance issue.\n\nWhen we strace the clone we observe (to quote our sysadmin):\n\n\"git seems to be stuck for 10 minutes after downloading\"\n\"no output, strace shows it's having sex with the memory allocator\"\n\"sex with memory allocator\" ==> loads of memory allocation/dealoccation\n\nA provisional release of the conversion is available at\n\n   http://dromedary.booking.com/perl.git\n\nWe are using git 1.6.0.5 on another more or less equivalent host, with\nthe same problems, and dromedary is using git version\n1.6.0.4.724.ga0d3a. However we believe that the problem is actually on\nthe client side. The pack download itself appears to be quite fast,\nhowever there is an extremely long pause (minutes) after which a HUGE\namount of essentially imcomprehensible output is generated about\nwalking packs or some such.\n\nTiming a clone via http gets us number like:\n\nreal    7m42.459s\nuser    3m42.154s\nsys     0m12.641s\n\nWheras using the git:// protocol gets us times like:\n\nreal    4m6.162s\nuser    0m43.595s\nsys     0m4.852s\n\nThe client these numbers are from is git version 1.6.0.3.\n\nSo it take approximately twice the time via http as it does via git.\nThis seems somewhat strange. Is there anything we can do to improve\nthis? Repack? Anything like that?\n\nA post about the github system suggests that this is not an isolated problem.\n\n   http://github.com/blog/92-http-cloning\n\nif there is anything we can do to help resolve this issue please let us know.\n\ncheers,\nYves\n\n-- \nperl -Mre=debug -e \"/just|another|perl|hacker/\"\n"}]}