git/list[1] front-page[2] threads[3] people[4] search[5] about
 

fast-import: multiple processes possible?

From
IZIan Zimmerman <itz@buug.org>
Date
Nov 27, 2010, 22:07 UTC
Message-ID
<8739qmzaha.fsf@matica.localdomain>

Hi, I have a user question, I hope that's ok. Actually, the end goal is development of a fast-import frontend. The fast-import manpage says that it is safe to run "any other" git operation concurrently with fast-import. It doesn't say if it is possible and safe to run another copy of fast-import itself.

The reason I'd like to do this is speedup. With sequential approach my frontend can only load each core on my system about 50%. If I could run multiple imports concurrently I could make it close to 100%, especially when feeding it blobs (which take most of the time).

Thanks for the advice.
-- 
Ian Zimmerman <itz@buug.org>
gpg public key: 1024D/C6FF61AD 
fingerprint: 66DC D68F 5C1B 4D71 2EE5  BD03 8A00 786C C6FF 61AD
Ham is for reading, not for eating.
Next: Shawn Pearce
Message 1 of 2 in “fast-import: multiple processes possible?”
  1. Ian ZimmermanNov 27, 2010
  2. Shawn PearceNov 27, 2010

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.