git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [RFC] Add support for downloading blobs on demand

From
Jakub Narębski <jnareb@gmail.com>
Date
Feb 7, 2017, 21:56 UTC
Message-ID
<04cdd7ae-3349-470f-39c6-7f8723fdcae8@gmail.com>
In-Reply-To
<002701d2816e$f4682fa0$dd388ee0$@gmail.com>

I'd like to point to two (or rather one and a half) solutions that I got aware of when watching streaming of "Git Merge 2017"[0]. There should be here people who were there; and hopefully video of those presentations and slides / notes would be soon available.

[0]: http://git-merge.com/

First tool that I'd like to point to is Git Virtual File System, or GVFS in short (which unfortunately shares abbreviation with GNOME Virtual File System).

The presentation was "Scaling Git at Microsoft" by Saeed Noursalehi, Microsoft. You can read about this solution in ArsTechnica article[1], and on Microsoft blog[2]. The code (or early version of thereof) is also available[3] - I wonder why on GitHub and not Codeplex...

[1]: https://arstechnica.com/information-technology/2017/02/microsoft-hosts-the-windows-source-in-a-monstrous-300gb-git-repository/ [2]: https://blogs.msdn.microsoft.com/visualstudioalm/2017/02/03/announcing-gvfs-git-virtual-file-system/ [3]: https://github.com/Microsoft/GVFS

The second presentation that might be of some interest is "Scaling Mercurial at Facebook: Insights from the Other Side" by Durham Goode, Facebook. The code is supposedly available as open-source; though I don't know how useful their 'blob storage' solution would be of use for your problem.

HTH
-- 
Jakub Narębski
Previous: Ben PeartNext: Ben Peart
Message 11 of 13 in “[RFC] Add support for downloading blobs on demand”
  1. Ben PeartJan 13, 2017
  2. Shawn PearceJan 13, 2017
  3. Ben PeartJan 17, 2017
  4. Martin FickJan 17, 2017
  5. Stefan BellerJan 17, 2017
  6. Ben PeartJan 18, 2017
  7. Jeff KingJan 17, 2017
  8. Ben PeartJan 17, 2017
  9. Christian CouderFeb 5, 2017
  10. Ben PeartFeb 7, 2017
  11. Jakub NarębskiFeb 7, 2017
  12. Ben PeartFeb 8, 2017
  13. Ben PeartFeb 23, 2017

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.