git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [RFC/PATCH v2 00/10] Add initial experimental external ODB support

From
Christian Couder <christian.couder@gmail.com>
Date
Jun 30, 2016, 09:49 UTC
Message-ID
<CAP8UFD03=fy2hXrZcT_7VP630CqAOHKz61T5GDKsT2f+v5Rnsg@mail.gmail.com>
In-Reply-To
<20160629200142.GA17878@dcvr.yhbt.net>
On Wed, Jun 29, 2016 at 10:01 PM, Eric Wong <e@80x24.org> wrote:
Show 15 quoted lines
> Christian Couder <christian.couder@gmail.com> wrote:
>> Design discussion about performance
>> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>>
>> Yeah, it is not efficient to fork/exec a command to just read or write
>> one object to or from the external ODB. Batch calls and/or using a
>> daemon and/or RPC should be used instead to be able to store regular
>> objects in an external ODB. But for now the external ODB would be all
>> about really big files, where the cost of a fork+exec should not
>> matter much. If we later want to extend usage of external ODBs, yeah
>> we will probably need to design other mechanisms.
>
> I would also investigate switching run_command to use vfork+exec
> or posix_spawn for performance (keeping in mind vfork
> caveats documented at https://ewontfix.com/7/ )
Thanks Eric for this idea and the test!
Previous: Eric Wong
Message 13 of 13 in “Add initial experimental external ODB support”
  1. 00/10 Add initial experimental external ODB supportChristian Couder, Jun 28, 2016
  2. 01/10 Add initial external odb supportChristian Couder, Jun 28, 2016
  3. 02/10 external odb foreachChristian Couder, Jun 28, 2016
  4. 05/10 t0400: add test for 'put' commandChristian Couder, Jun 28, 2016
  5. 06/10 external odb: add write supportChristian Couder, Jun 28, 2016
  6. 07/10 external-odb: accept only blobs for nowChristian Couder, Jun 28, 2016
  7. 03/10 t0400: use --batch-all-objects to get all objectsChristian Couder, Jun 28, 2016
  8. 08/10 t0400: add test for external odb write supportChristian Couder, Jun 28, 2016
  9. 10/10 Add t0410 to test external ODB transferChristian Couder, Jun 28, 2016
  10. 04/10 t0400: add 'put' command to odb-helper scriptChristian Couder, Jun 28, 2016
  11. 09/10 Add GIT_NO_EXTERNAL_ODB env variableChristian Couder, Jun 28, 2016
  12. Eric WongJun 29, 2016
  13. Christian CouderJun 30, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.