git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Make `git fetch --all` parallel?

From
Ævar Arnfjörð Bjarmason <avarab@gmail.com>
Date
Oct 11, 2016, 23:16 UTC
Message-ID
<CACBZZX6pFbu_CWMG+OTxx8L2OEy4X4RqGfQ_+z4zFOhS-zx8zA@mail.gmail.com>
In-Reply-To
<20161011225942.tvqbbzxglvu7lldi@sigill.intra.peff.net>
On Wed, Oct 12, 2016 at 12:59 AM, Jeff King <peff@peff.net> wrote:
> I'm not altogether convinced that parallel fetch would be that much
> faster, though.

I have local aliases to use GNU parallel for stuff like this, on my git.git which has accumulated 17 remotes:

    $ time parallel -j1 'git fetch {}' ::: $(git remote)
    real    0m18.265s
    $ time parallel -j8 'git fetch {}' ::: $(git remote)
    real    0m2.957s

In that case I didn't have any new objects to fetch, but just doing the negotiation in parallel was a lot faster.

So there's big wins in some cases.
Previous: Jeff KingNext: Stefan Beller
Message 8 of 12 in “Make `git fetch --all` parallel?”
  1. Ram RachumOct 11, 2016
  2. Stefan BellerOct 11, 2016
  3. Junio C HamanoOct 11, 2016
  4. Stefan BellerOct 11, 2016
  5. Stefan BellerOct 11, 2016
  6. Junio C HamanoOct 11, 2016
  7. Jeff KingOct 11, 2016
  8. Ævar Arnfjörð BjarmasonOct 11, 2016
  9. Stefan BellerOct 11, 2016
  10. Jeff KingOct 12, 2016
  11. Jeff KingOct 12, 2016
  12. Stefan BellerOct 12, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.