git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Cloning speed comparison

From
Daniel Barkalow <barkalow@iabervon.org>
Date
Aug 15, 2005, 17:50 UTC
Message-ID
<Pine.LNX.4.63.0508151321270.12816@iabervon.org>
In-Reply-To
<20050813015402.GC20812@pasky.ji.cz>
On Sat, 13 Aug 2005, Petr Baudis wrote:
Show 16 quoted lines
>   Hello,
> 
>   I've wondered how slow the protocols other than rsync are, and the
> (well, a bit dubious; especially wrt. caching on the remote side)
> results are:
> 
> 	git	clone-pack:ssh	25s
> 	git	rsync		27s
> 	git	http-pull	47s
> 	git	dumb-http	54s
> 	git	ssh-pull	660s
> 
> 	cogito	clone-pack:ssh	35s (!)
> 	cogito	rsync		140s
> 	cogito	ssh-pull	480s
> 	cogito	http-pull	extrapolated to about an hour!

I should be able to get http-pull down to the neighborhood of (current) ssh-pull; http-pull is that slow (when the source repository isn't packed) because it's entirely sequential, rather than overlapping requests like ssh-pull now does.

I should also be able to get ssh-pull down to the area of clone-pack, but that's lower-priority, since there's clone-pack.

(I've written an untested patch for local-pull, which I'll be testing, cleaning, and submitting tonight, assuming my newly-arrived monitor actually works)

Show 8 quoted lines
>   PS:
> 	With the latest git version as of time of writing this:
> 	$ time cg-clone git+ssh://pasky@localhost/home/pasky/WWW/dev/git/.g cogito
> 	...
> 	progress: 5759 objects, 10292457 bytes
> 	$ time cg-clone http://localhost/~pasky/dev/git/.g cogito
> 	...
> 	progress: 8681 objects, 14881571 bytes

I've noticed that ssh connections don't actually disconnect at the end with recent versions of ssh sometimes. In my experience, this occasionally happens with git, but always happens with scp, suggesting that it's an ssh bug of some sort; I've also only noticed this with openssh 3.9_p1 with some of Gentoo's -r2 patches.

	-Daniel
*This .sig left intentionally blank*
Previous: H. Peter AnvinNext: Junio C Hamano
Message 9 of 11 in “Cloning speed comparison”
  1. Petr BaudisAug 13, 2005
  2. Linus TorvaldsAug 13, 2005
  3. Petr BaudisAug 13, 2005
  4. Linus TorvaldsAug 13, 2005
  5. H. Peter AnvinAug 13, 2005
  6. Linus TorvaldsAug 13, 2005
  7. H. Peter AnvinAug 13, 2005
  8. H. Peter AnvinAug 13, 2005
  9. Daniel BarkalowAug 15, 2005
  10. Junio C HamanoAug 15, 2005
  11. Daniel BarkalowAug 15, 2005

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.