git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: 'sparse' clone idea

From
Jakub Narebski <jnareb@gmail.com>
Date
Jun 14, 2006, 09:44 UTC
Message-ID
<e6olpv$77s$1@sea.gmane.org>
In-Reply-To
<Pine.LNX.4.63.0606141110001.15673@wbgn013.biozentrum.uni-wuerzburg.de>
Johannes Schindelin wrote:
Show 22 quoted lines
> On Wed, 14 Jun 2006, Jakub Narebski wrote:
> 
>> I wonder if 'sparse clone' idea described below would avoid the most
>> difficult part of 'shallow clone' idea, namely the [sometimes] need to
>> un-cauterize history. See: (<7vac8lidwi.fsf@assigned-by-dhcp.cox.net>).
> 
> I do not think that is the hardest problem. The hardest thing is to tell 
> the server in an efficient manner which objects we have.
> 
> Example:
> 
> A - B - C - D
>     ^ cutoff
>         ^ current HEAD
> 
> Suppose B is your fake root, C is your HEAD, you want to fetch D. Now, 
> make it a difficult example: both A and D contain a certain blob Z, but 
> neither B nor C do. You have to tell the server _in an efficient manner_ 
> to send Z also.
> 
> And by efficient manner I mean: you may not bring the server down just 
> because 5 people with shallow clones decide to fetch from it.

Nah, that I think is solved. Check the mentioned post by Junio C Hamano in the "Re: Figured out how to get Mozilla into git" post:

 http://permalink.gmane.org/gmane.comp.version-control.git/21603

(although it would need extension to the git protocol). Client and server do graft exchange both ways, limiting the commit ancestry graph the both ends walk to the intersection of the fake view of the ancestry graph both ends have. Then server uses those virtual grafts to calculate which objects to send.

The rest is done (or should be done) by history grafting code.
Show 5 quoted lines
>>  * merge bases for all commits in full, and in the sparse part,
>>    _including_ merge bases themselves
> 
> Hmmm. You cannot know _all_ merge bases beforehand, because you do not 
> decide where other people fork off.
By all merge bases I mean merge bases for all commits in full part, merge
bases for all commits in full part and commits pointed by tags in sparse
part, merge bases for all commits in full part and tagged in sparse part
and merge bases in sparse part etc. recursively.
 
>>  * all roots
> 
> Why?
Just in case, as an ultimate merge bases.
 
> P.S.: I think the problems of a lazy clone are much easier to solve...

I still think that the correct idea for the lazy clone is to have soft grafts, so you have to solve at least part of shallo clone/sparse clone problems first.

-- 
Jakub Narebski
Warsaw, Poland
ShadeHawk on #git
Previous: Johannes Schindelin
Message 3 of 3 in “'sparse' clone idea”
  1. Jakub NarebskiJun 14, 2006
  2. Johannes SchindelinJun 14, 2006
  3. Jakub NarebskiJun 14, 2006

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.