git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [RFC] Native access to Git LFS cache

From
Duy Nguyen <pclouds@gmail.com>
Date
Jun 28, 2016, 15:50 UTC
Message-ID
<CACsJy8BLhO3R=8rAqLwAXc3LGLVVr4KGtWOm4MAh7bKDMn+uPw@mail.gmail.com>
In-Reply-To
<alpine.DEB.2.20.1606281513380.12947@virtualbox>

On Tue, Jun 28, 2016 at 3:14 PM, Johannes Schindelin <Johannes.Schindelin@gmx.de> wrote:

Show 36 quoted lines
> Hi Duy,
>
> On Tue, 28 Jun 2016, Duy Nguyen wrote:
>
>> On Tue, Jun 28, 2016 at 11:40 AM, Johannes Schindelin
>> <Johannes.Schindelin@gmx.de> wrote:
>> >
>> > On Mon, 27 Jun 2016, Duy Nguyen wrote:
>> >
>> >> On Mon, Jun 27, 2016 at 7:38 AM,  <larsxschneider@gmail.com> wrote:
>> >> > ## Proposed solution
>> >> > Git LFS caches its objects under .git/lfs/objects. Most of the time
>> >> > Git LFS objects are already available in the cache (e.g. if you
>> >> > switch branches back and forth). I implemented these "cache hits"
>> >> > natively in Git.  Please note that this implementation is just a
>> >> > quick and dirty proof of concept. If the Git community agrees that
>> >> > this kind of approach would be acceptable then I will start to work
>> >> > on a proper patch series with cross platform support and unit
>> >> > tests.
>> >>
>> >> Would it be possible to move all this code to a separate daemon?
>> >> Instead of spawning a new process to do the filtering, you send a
>> >> command "convert this" over maybe unix socket and either receive the
>> >> whole result over the socket, or receive a path of the result.
>> >
>> > Unix sockets are not really portable...
>>
>> It's the same situation as index-helper. I expect you guys will
>> replace the transport with named pipe or similar.
>
> Yes, I will have to work on that. But I might need to ask for a change in
> the design if I hit some obstacle there: named pipes are not the same at
> all as Unix sockets.
>
> Read: it will be painful, and not a general solution. So every new Unix
> socket that you introduce will introduce new problems for me.

I thought we could have a drop-in replacement (or maybe a higher abstraction that would be sufficient for git). Thanks for pointing it out.

-- 
Duy
Previous: Duy NguyenNext: Junio C Hamano
Message 8 of 11 in “[RFC] Native access to Git LFS cache”
  1. larsxschneider@gmail.comJun 27, 2016
  2. Duy NguyenJun 27, 2016
  3. Johannes SchindelinJun 28, 2016
  4. Duy NguyenJun 28, 2016
  5. Johannes SchindelinJun 28, 2016
  6. Lars SchneiderJun 28, 2016
  7. Duy NguyenJun 28, 2016
  8. Duy NguyenJun 28, 2016
  9. Junio C HamanoJun 27, 2016
  10. Lars SchneiderJun 28, 2016
  11. Christian CouderJun 28, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.