git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Narrow clone implementation difficulty estimate

From
Nguyen Thai Ngoc Duy <pclouds@gmail.com>
Date
May 16, 2009, 05:17 UTC
Message-ID
<fcaeb9bf0905152217g418c7f38w229f71dd047bb466@mail.gmail.com>
In-Reply-To
<m38wl0klxt.fsf@localhost.localdomain>
On Thu, May 14, 2009 at 8:39 PM, Jakub Narebski <jnareb@gmail.com> wrote:
Show 31 quoted lines
> Alexander Gavrilov <angavrilov@gmail.com> writes:
>
>> We are considering using Git to manage a large set of mostly binary
>> files (large images, pdf files, open-office documents, etc). The
>> amount of data is such that it is infeasible to force every user
>> to download all of it, so it is necessary to implement a partial
>> retrieval scheme.
>>
>> In particular, we need to decide whether it is better to invest
>> effort into implementing Narrow Clone, or partitioning and
>> reorganizing the data set into submodules (the latter may prove
>> to be almost impossible for this data set). We will most likely
>> develop a new, very simplified GUI for non-technical users,
>> so the details of both possible approaches will be hidden
>> under the hood.
>
> First, there were quite complete, although as far as I know newer
> accepted into git, work on narrow / sparse / subtree / partial
> *checkout*.  IIRC the general idea about extening or (ab)using
> assume-unchanged mechanism was accepted, but the problem was in the
> user interface details (I think that porcelain part was quite well
> accepted, except hesitation whether to use/extend existing flag, or
> create new for the purpose of narrow checkout).  You can search
> archive for that
>  http://article.gmane.org/gmane.comp.version-control.git/89900
>  http://article.gmane.org/gmane.comp.version-control.git/90016
>  http://article.gmane.org/gmane.comp.version-control.git/77046
>  http://article.gmane.org/gmane.comp.version-control.git/50256
>  ...
> should give you some idea what to search for. This is of course
> only part of solution.

FWIW I still maintain the patch series as a merged branch "tp/sco" under my branch "inst" here

http://repo.or.cz/w/git/pclouds.git?a=shortlog;h=refs/heads/inst
-- 
Duy
Previous: Jakub Narebski
Message 3 of 3 in “Narrow clone implementation difficulty estimate”
  1. Alexander GavrilovMay 14, 2009
  2. Jakub NarebskiMay 14, 2009
  3. Nguyen Thai Ngoc DuyMay 16, 2009

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.