git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: git-daemon memory usage, disconnection.

From
David Woodhouse <dwmw2@infradead.org>
Date
Apr 19, 2006, 15:27 UTC
Message-ID
<1145460469.11909.25.camel@pmac.infradead.org>
In-Reply-To
<Pine.LNX.4.64.0604190749160.3701@g5.osdl.org>
On Wed, 2006-04-19 at 07:59 -0700, Linus Torvalds wrote:
> Well, you've probably got two issues: 
> 
>  - it looks like you aren't packing your archives (which explains why the 
>    disk accesses are horrid, which in turn explains the "D" part).

Hm, good point. They're fairly new trees -- I had foolishly assumed that they would at least start off packed. That isn't the case though -- perhaps it should be? Did the original clone receive a pack on the wire and then _split_ it?

If the tools would automatically pack when the number of unpacked objects reaches a threshold, that would be useful.

Since this repo is only available through git:// and git+ssh:// URLs, I can safely use git-repack's '-a -d' options, right?

I'll do 'git-repack -l' nightly and 'git-repack -a -d -l' weekly -- does that seem sane?

Show 8 quoted lines
>    For a git server, you _really_ want all trees to be mostly packed, or 
>    you want absolutely tons of memory (and 256kB is definitely not "tons"
>    as far as git is concerned).
> 
> Well, the way things work under UNIX, you normally don't notice that the 
> other end isn't interested until you try to write, and you get a "nobody 
> is listening". And sadly, the packing stuff does most (not all) of the 
> heavy lifting before it can even start to write things out.

Well, it does that with SIGALRM happening periodically, theoretically for the purpose of providing progress output. Perhaps we could do a getpeername() or something else to check on the output fd each time?

-- 
dwmw2
Previous: Linus TorvaldsNext: Linus Torvalds
Message 3 of 4 in “git-daemon memory usage, disconnection.”
  1. David WoodhouseApr 19, 2006
  2. Linus TorvaldsApr 19, 2006
  3. David WoodhouseApr 19, 2006
  4. Linus TorvaldsApr 19, 2006

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.