git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: performance on repack

From
Jon Smirl <jonsmirl@gmail.com>
Date
Aug 16, 2007, 16:13 UTC
Message-ID
<9e4733910708160913i29e18e80v107bcc3732e9db95@mail.gmail.com>
In-Reply-To
<alpine.LFD.0.999.0708161103080.16727@xanadu.home>
On 8/16/07, Nicolas Pitre <nico@cam.org> wrote:
Show 11 quoted lines
> On Thu, 16 Aug 2007, David Kastrup wrote:
> > If I understand correctly, delta indices
> > for the search window are kept, and the current file is compared
> > against them.  Locality might be better if just one delta index gets
> > calculated and then compared with all _upcoming_ delta candidates in
> > one go.
>
> This appears so obvious that I attempted that a while ago already.
>
> The idea turned up to be so complex to implement correctly and produced
> suboptimal results in practice that I abandoned it.

In practice it doesn't really matter what you do. Most developers have a decent amount of RAM. Disks run at 50MB/sec or more. The entire pack file ends up in the kernel disk cache within a few seconds.

Turning the twenty minute delta search into 6-7 minutes is a much more obvious win.

Show 13 quoted lines
>
> See http://marc.info/?l=git&m=114610715706599&w=2 for the details if
> you're interested.
>
> PS: please at least CC me when replying to my mails
>
>
> Nicolas
> -
> To unsubscribe from this list: send the line "unsubscribe git" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
-- 
Jon Smirl
jonsmirl@gmail.com
Previous: Nicolas PitreNext: Nicolas Pitre
Message 23 of 30 in “performance on repack”
  1. Jon SmirlAug 11, 2007
  2. David KastrupAug 11, 2007
  3. Linus TorvaldsAug 11, 2007
  4. Jon SmirlAug 11, 2007
  5. Martin KoeglerAug 12, 2007
  6. Jon SmirlAug 12, 2007
  7. Shawn O. PearceAug 14, 2007
  8. Jon SmirlAug 14, 2007
  9. Shawn O. PearceAug 14, 2007
  10. Jon SmirlAug 14, 2007
  11. Nicolas PitreAug 14, 2007
  12. Nicolas PitreAug 14, 2007
  13. Jon SmirlAug 15, 2007
  14. Nicolas PitreAug 15, 2007
  15. Shawn O. PearceAug 15, 2007
  16. Jon SmirlAug 15, 2007
  17. Martin KoeglerAug 15, 2007
  18. Jon SmirlAug 15, 2007
  19. Nicolas PitreAug 15, 2007
  20. Jon SmirlAug 15, 2007
  21. David KastrupAug 16, 2007
  22. Nicolas PitreAug 16, 2007
  23. Jon SmirlAug 16, 2007
  24. Nicolas PitreAug 16, 2007
  25. Nicolas PitreAug 15, 2007
  26. Nicolas PitreAug 15, 2007
  27. Nicolas PitreAug 30, 2007
  28. Nicolas PitreAug 30, 2007
  29. Jon SmirlAug 30, 2007
  30. Jon SmirlSep 1, 2007

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.