git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Speed up git-svn fetch

From
Adam Roben <aroben@apple.com>
Date
Apr 23, 2008, 19:17 UTC
Message-ID
<1208978273-98146-1-git-send-email-aroben@apple.com>

I first sent this patch series 6 months ago today [1], then resent it after some comments from Junio, Johannes, and Brian [2]. Here it is again, addressing further comments from Junio and Eric.

The point of the series is to speed up git-svn fetch on Cygwin, where forking is quite slow. In my informal testing, this patch seems to speed things up by ~1.4-~1.7x. We accomplish this by having a single long-lived git-cat-file process and a single long-lived git-hash-object process for the duration of the git-svn invocation.

This series is based on top of next.
-Adam
--
 Documentation/git-cat-file.txt    |   43 +++++++-
 Documentation/git-hash-object.txt |    5 +-
 builtin-cat-file.c                |  153 ++++++++++++++++++++++++---
 git-svn.perl                      |   42 ++++----
 hash-object.c                     |   44 ++++++++-
 perl/Git.pm                       |  208 ++++++++++++++++++++++++++++++++++++-
 t/t1006-cat-file.sh               |  181 ++++++++++++++++++++++++++++++++
 t/t1007-hash-object.sh            |  139 +++++++++++++++++++++++++
 t/t5303-hash-object.sh            |   35 ------
 9 files changed, 768 insertions(+), 82 deletions(-)
Next: Adam Roben
Message 1 of 19 in “Speed up git-svn fetch”
  1. Adam RobenApr 23, 2008
  2. 01/11 Add tests for git cat-fileAdam Roben, Apr 23, 2008
  3. 02/11 git-cat-file: Small refactor of cmd_cat_fileAdam Roben, Apr 23, 2008
  4. 03/11 git-cat-file: Make option parsing a little more flexibleAdam Roben, Apr 23, 2008
  5. 04/11 git-cat-file: Add --batch-check optionAdam Roben, Apr 23, 2008
  6. 05/11 git-cat-file: Add --batch optionAdam Roben, Apr 23, 2008
  7. 06/11 Move git-hash-object tests from t5303 to t1007Adam Roben, Apr 23, 2008
  8. 07/11 Add more tests for git hash-objectAdam Roben, Apr 23, 2008
  9. 08/11 git-hash-object: Add --stdin-paths optionAdam Roben, Apr 23, 2008
  10. 09/11 Git.pm: Add command_bidi_pipe and command_close_bidi_pipeAdam Roben, Apr 23, 2008
  11. 10/11 Git.pm: Add hash_and_insert_object and cat_blobAdam Roben, Apr 23, 2008
  12. 11/11 git-svn: Speed up fetchAdam Roben, Apr 23, 2008
  13. Junio C HamanoApr 25, 2008
  14. Eric WongApr 25, 2008
  15. Junio C HamanoApr 25, 2008
  16. Junio C HamanoApr 25, 2008
  17. Junio C HamanoMay 6, 2008
  18. Adam RobenApr 23, 2008
  19. Eric WongApr 25, 2008

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.