git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Cloning speed comparison

From
Daniel Barkalow <barkalow@iabervon.org>
Date
Aug 15, 2005, 21:27 UTC
Message-ID
<Pine.LNX.4.63.0508151652290.21501@iabervon.org>
In-Reply-To
<7vacjjx70u.fsf@assigned-by-dhcp.cox.net>
On Mon, 15 Aug 2005, Junio C Hamano wrote:
Show 14 quoted lines
> Daniel Barkalow <barkalow@iabervon.org> writes:
> 
> > I should be able to get http-pull down to the neighborhood of 
> > (current) ssh-pull; http-pull is that slow (when the source repository 
> > isn't packed) because it's entirely sequential, rather than overlapping 
> > requests like ssh-pull now does.
> 
> I like those prefetch() and process() code in pull.c very much.
> 
> I have been wondering if increasing parallelism more by
> prefetching beyond the immediate parents of the current commit,
> in "if (get_history)" part of process_commit().  Maybe it is not
> worth it because doing a commit, its associated tree(s) and its
> parents would already give us enough parallelism already.

It is actually already maxing out the parallelism; it has a FIFO of objects which it needs, and calls prefetch() when it enqueues an object and fetch() when it dequeues it. It only cares about the dependancies for this purpose, not the types.

	-Daniel
*This .sig left intentionally blank*
Previous: Junio C Hamano
Message 11 of 11 in “Cloning speed comparison”
  1. Petr BaudisAug 13, 2005
  2. Linus TorvaldsAug 13, 2005
  3. Petr BaudisAug 13, 2005
  4. Linus TorvaldsAug 13, 2005
  5. H. Peter AnvinAug 13, 2005
  6. Linus TorvaldsAug 13, 2005
  7. H. Peter AnvinAug 13, 2005
  8. H. Peter AnvinAug 13, 2005
  9. Daniel BarkalowAug 15, 2005
  10. Junio C HamanoAug 15, 2005
  11. Daniel BarkalowAug 15, 2005

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.