git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [QUESTION] Access to a huge GIT repository.

From
Junio C Hamano <junkio@cox.net>
Date
Nov 16, 2005, 20:35 UTC
Message-ID
<7vwtj85o1y.fsf@assigned-by-dhcp.cox.net>
In-Reply-To
<46a038f90511161201h54c5fa73l20b5dcf3b5c19399@mail.gmail.com>
Martin Langhoff <martin.langhoff@gmail.com> writes:
Show 8 quoted lines
> On 11/17/05, Junio C Hamano <junkio@cox.net> wrote:
>> The underlying network transfer program, 'git-clone-pack', can
>> be told to clone only specified branches.  If somebody is
>> interested, updating the 'git-clone' wrapper to use it should
>> not be too hard -- obviously this needs to be done for other
>> transports as well, though.
>
> cg-clone already does this.

Yes, but it can be improved. It does fetch-pack for git native transports, which means the receiving end expands the pack. I think we would either need to teach cg-clone to tell cg-fetch that it is cloning and invoke git-clone-pack, or add an optional "do not expand" option to git-fetch-pack (git-clone-pack always keeps the downloaded pack unexpanded). Huge pack transfer spends long time on the downloader side unpacking the pack.

> If you just pull tagrefs and all the objects needed for them, chances
> are you'll get the whole repo anyway ;-)

Yes, that's why we changed ls-remote to report the magic ^{} entries and it is used in cg-fetch::fetch_tags.

Previous: Linus Torvalds
Message 22 of 22 in “[QUESTION] Access to a huge GIT repository.”
  1. FranckNov 16, 2005
  2. Linus TorvaldsNov 16, 2005
  3. FranckNov 17, 2005
  4. Linus TorvaldsNov 17, 2005
  5. FranckNov 17, 2005
  6. Linus TorvaldsNov 17, 2005
  7. FranckNov 19, 2005
  8. Lukas SandströmNov 19, 2005
  9. Junio C HamanoNov 19, 2005
  10. Linus TorvaldsNov 19, 2005
  11. Junio C HamanoNov 19, 2005
  12. FranckNov 21, 2005
  13. Junio C HamanoNov 21, 2005
  14. FranckNov 22, 2005
  15. Junio C HamanoNov 22, 2005
  16. FranckNov 22, 2005
  17. Junio C HamanoNov 22, 2005
  18. FranckNov 22, 2005
  19. Junio C HamanoNov 16, 2005
  20. Martin LanghoffNov 16, 2005
  21. Linus TorvaldsNov 16, 2005
  22. Junio C HamanoNov 16, 2005

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.