From: Petr Baudis Date: Thu, 07 Jul 2005 14:45:01 GMT Subject: Re: [ANNOUNCE] Cogito-0.12 Message-ID: <20050707144501.GG19781@pasky.ji.cz> In-Reply-To: <42CBC822.30701@didntduck.org> Dear diary, on Wed, Jul 06, 2005 at 02:01:38PM CEST, I got a letter where Brian Gerst told me that... > Petr Baudis wrote: > > Also, I've deprecated rsync, as I explained in another mail. Use > >cg-branch-chg to change the branch URLs to some more sensible scheme - > >most likely HTTP, or SSH if you want to push as well. > > I really question removing rsync before HTTP pulls become more > effecient. It won't happen. Or rather, I hope the HTTP pulls become more efficient soon. Actually, perhaps Linus has something done already, my workstation is a bit derailed now so I couldn't pull from him in the last few days (hopefully will sort that out today). > I did a complete pull of cogito from kernel.org, and http > took over 50 minutes to pull everything, while rsync was done in just > over 1 minute. I dared not even try to pull the full kernel at that speed. > > I suspect that part of the problem is that the pull methods are doing a > depth first search, so we can't request the next object until the > current object is fully received and parsed. Changing to a breadth > first search would allow multiple requests in flight and asynchronous > processing which should speed things up. I am exploring using the > curl_multi_* functions to do this, but this will require changes to > common code in pull.c. Hmm, yes, I guess Linus won't be touching the HTTP backend at all. ;-) I suggest you to check the last development in Linus' branch and sync with Daniel Barkalow, who promised improving the pull tools as well. -- Petr "Pasky" Baudis Stuff: http://pasky.or.cz/ be careful, some twit might quote you out of context..