git/list[1] front-page[2] threads[3] people[4] search[5] about
 

git-fast-import

From
Jon Smirl <jonsmirl@gmail.com>
Date
Aug 6, 2006, 02:51 UTC
Message-ID
<9e4733910608051951g42bc4a5dv560c12e0a9add163@mail.gmail.com>

git-fast-import works great. I parsed and built my pack file in 1:45hr. That's way better than 24hr. I am still IO bound but that seems to be an issue with not being able to read ahead 150K small files. CPU utilization averages about 50%.

I didn't bother reading the sha ids back from fast-import, instead I computed them in the python code. Python has a C library function for sha1. That decouple the processes from each other. They would run in parallel on SMP.

My pack file is 980MB compared to 680MB from other attempts. I am still missing entries for the trees and commits.

-- 
Jon Smirl
jonsmirl@gmail.com
Next: Shawn Pearce
Message 1 of 3 in “git-fast-import”
  1. Jon SmirlAug 6, 2006
  2. Shawn PearceAug 6, 2006
  3. Jon SmirlAug 6, 2006

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.