git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Resumable clone/Gittorrent (again) - stable packs?

From
ZHZenaan Harkness <zen@freedbms.net>
Date
Jan 6, 2011, 02:29 UTC
Message-ID
<AANLkTikv+L5Da7A5VM7BAgnue=m0O_-nHmHchJzfGxJa@mail.gmail.com>
Bittorrent requires some stability around torrent files.

Can packs be generated deterministically? If not by two separate repos, what about by one particular repo?

For Linus' linux-2.6.git, that repo is considered 'canonical' by many.

Pack-torrents could be ~1MiB, ~10MiB, ~100Mib, ~1GiB, or as configured in a particular repo, which repo is the canonical location for pack-torrents for all who consider that particular repo as canonical.

Perhaps a heuristic/ algorithm: once ten 10MiB (sequentially generated) pack-torrents are floating around, they could be simply concatenated to create a 100MiB pack-torrent, with a deterministic name and SHA etc, so that all those 10MiB pack-torrent files that torrent clients have, can be re-used and locally combined into the 100MiB torrent as needed, on demand.

Same for 100MiB -> 1GiB pack-torrents.

Individual extra commits: While "small" number of additional commits go into a repo, clients fall back to git-fetch, _after .

If Linus linus-2.6.git (currently configured "canonical" repo) goes offline, simply configure a new remote canonical repo.

Branches: Other "branches" repos of linux-2.6.git could create their own consistent 50MiB (or as configured) pack-torrents which are commits-only-missing-from-linux-2.6 pack-torrents (ie, those missing from that repo's "canonical" upstream).

This would require clients have a recursive torrent locator (I start at linux-net.git, which requires linux-2.6.git, so I go get those packs as well as the linux-net.git packs).

Perhaps have a system-wide or user-wide git repo/ torrent config, or check with user running git-clone linux-net.git "Do you have an existing git.vger.kernel.org/linux-2.6.git archive?".

Zen
Next: Shawn Pearce
Message 1 of 22 in “Re: Resumable clone/Gittorrent (again) - stable packs?”
  1. Zenaan HarknessJan 6, 2011
  2. Shawn PearceJan 6, 2011
  3. John WyzerJan 10, 2011
  4. Sam VilainJan 10, 2011
  5. Nguyen Thai Ngoc DuyJan 11, 2011
  6. J.H.Jan 11, 2011
  7. Nguyen Thai Ngoc DuyJan 11, 2011
  8. Nicolas PitreJan 6, 2011
  9. Zenaan HarknessJan 7, 2011
  10. Nicolas PitreJan 7, 2011
  11. Jeff KingJan 7, 2011
  12. Jeff KingJan 7, 2011
  13. Zenaan HarknessJan 7, 2011
  14. Ilari LiusvaaraJan 7, 2011
  15. Jeff KingJan 7, 2011
  16. Ilari LiusvaaraJan 7, 2011
  17. Jeff KingJan 7, 2011
  18. Ilari LiusvaaraJan 7, 2011
  19. Jeff KingJan 7, 2011
  20. Sam VilainJan 10, 2011
  21. Nguyen Thai Ngoc DuyJan 10, 2011
  22. Nicolas PitreJan 10, 2011

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.