git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: Another bench on gitweb (also on gitweb caching)

From
JJ.H. <warthog19@eaglescrag.net>
Date
Feb 13, 2008, 00:57 UTC
Message-ID
<1202864250.17207.22.camel@localhost.localdomain>
In-Reply-To
<20080213004528.GB31455@c3sl.ufpr.br>
Show 16 quoted lines
> > > I found out those VERY interesting, so instead of trying to think a
> > > new way to store gitweb config, we should think a way to cache those
> > > information.
> > 
> > Below there are my thoughts about caching information for gitweb:
> > 
> > First, the basis of each otimisation is checking the bottlenecks.
> > I think it was posted sometime there that the pages taking most load
> > are projects list and feeds. 
> > 
> > Kernel.org even run modified version of gitweb, with some caching
> > support; Cgit (git web interface in C) also has caching support.
> 
> Is this gitweb version for kernel.org available somewhere?
> > 
> > 

It's available from my git tree on kernel.org http://git.kernel.org/?p=git/warthog9/gitweb.git;a=summary

or
git://git.kernel.org/pub/scm/git/warthog9/gitweb.git

Mind you my performance on the non-cache state is not going to be any better than normal gitweb, however the performance on a cache-hit is orders of magnitude faster - though at a rather expensive cost - disk space. There is currently something like 20G of disk being used on one of kernel.org's machines providing the cache (this does get flushed on occasion - I think) but that is providing caching for everything that kernel.org has in it's git trees (or 255188 unique urls currently). My code base is now, horribly, out of date with respect to mainline but it works and it's been solid and reasonably reliable (though I do know of two bugs in it right now I need to track down - one with respect to a failure of the script - and one that is an array out of bounds error)

- John
Previous: Bruno Cesar RibasNext: J.H.
Message 5 of 11 in “Another bench on gitweb”
  1. Bruno Cesar RibasFeb 10, 2008
  2. Jakub NarebskiFeb 12, 2008
  3. Bruno Cesar RibasFeb 13, 2008
  4. Bruno Cesar RibasFeb 13, 2008
  5. J.H.Feb 13, 2008
  6. J.H.Feb 13, 2008
  7. Jakub NarebskiFeb 13, 2008
  8. J.H.Feb 13, 2008
  9. Jakub NarebskiFeb 14, 2008
  10. J.H.Feb 14, 2008
  11. Jakub NarebskiFeb 15, 2008

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.