Re: Multi-threaded 'git clone'
- From
- David Lang <david@lang.hm>
- Date
- Feb 16, 2015, 15:31 UTC
- Message-ID
- <alpine.DEB.2.02.1502160727480.23770@nftneq.ynat.uz>
- In-Reply-To
- <20150216150305.GA8279@peff.net>
On Mon, 16 Feb 2015, Jeff King wrote:
Show 11 quoted lines
> On Mon, Feb 16, 2015 at 05:31:13AM -0800, David Lang wrote: > >> I think it's an interesting question to look at, but before you start >> looking at changing the architecture of the current code, I would suggest >> doing a bit more analisys of the problem to see if the bottleneck is really >> where you think it is. >> >> First measure, then optimize :-) > > Yes, very much so. Fortunately some people have already done some of > this work. :)
nice summary
> Then the server streams the data to the client. It might do some light > work transforming the data as it comes off the disk, but most of it is > just blitted straight from disk, and the network is the bottleneck.
Depending on how close to full the WAN link is, it may be possible to improve this with multiple connections (again, referencing bbcp), but there's also the question of if it's worth trying to use the entire WAN for a single user. The vast majority of the time the server is doing more than one thing and would rather let any individual user wait a bit and service the other users.
David Lang