git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [RFC/PATCH] gitweb: Paginate project list

From
Jakub Narebski <jnareb@gmail.com>
Date
May 11, 2008, 23:51 UTC
Message-ID
<200805120151.20741.jnareb@gmail.com>
In-Reply-To
<1210485210.11526.145.camel@localhost.localdomain>
On Sun, 11 May 2008, J.H. wrote:
Show 13 quoted lines
> 
> On Sun, 2008-05-11 at 00:32 +0200, Jakub Narebski wrote:
>> On Sun, 10 May 2008, J.H. <warthog19@eaglescrag.net> wrote:
>>
>> BTW. why do you think that kernel.org would be better to have project
>> list pagination turned off?
> 
> If we have caching on I'd rather leave it as a single page, much easier
> to search on and with firefox /<project or name> then <ctrl>+g a couple
> of times is really fast to find what I need.  Also means less to cache
> (good for us) and faster access for most.  I'm going to guess leaving it
> as a single page, unless it gets *very* unwieldy, will be how we leave
> it.

First, you can cache individual pages of projects list output with small overhead if number of projects per page is large enough. Second, see my earlier patch adding project search capability to gitweb (it is server-side search, though). Searching needs caching data, not output, while pagination only can be done with both.

As to single-page projects list being being unwieldy... You should take into account how large the page is (having page size in megabytes isn't too good), how much time it takes to download (and not only generate), and how much time it takes for web browser to render it.

How many repositories is "too many", that I'm not sure about...
Show 13 quoted lines
>>> It might also be advantageous to generate the entire list and stash that
>>> somewhere, (session on the host side?) and run the pagination out of
>>> that.
>> 
>> First, when using $projectslist file with new (second patch in series,
>> "gitweb: Allow project description in project_index file" most of data
>> (well, all except age) would be filled by parsing single file.
>> 
>> Second, the idea is to cache results of filled in @$projlist e.g. using
>> Storable, i.e. cache Perl data and not final HTML output.
> 
> I approve of that plan, caching all the html is kinda expensive *hides
> the 20G of gitweb cache he has*
Caching output (HTML) has the advantage of being simple, and avoiding
time to generate page.  Caching data has the advantage of taking less
disk space due to being able to reuse the same data for different pages.
 
-- 
Jakub Narebski
Poland
Previous: J.H.Next: Jakub Narebski
Message 11 of 20 in “gitweb: Simplify git_project_list_body”
  1. gitweb: Simplify git_project_list_bodyJakub Narebski, May 1, 2008
  2. gitweb: Allow project description in project_index fileJakub Narebski, May 2, 2008
  3. Miklos VajnaMay 2, 2008
  4. gitweb: Allow project description in project_index fileJakub Narebski, May 3, 2008
  5. Miklos VajnaMay 4, 2008
  6. gitweb: Project searchJakub Narebski, May 9, 2008
  7. gitweb: Paginate project listJakub Narebski, May 10, 2008
  8. J.H.May 10, 2008
  9. Jakub NarebskiMay 10, 2008
  10. J.H.May 11, 2008
  11. Jakub NarebskiMay 11, 2008
  12. Jakub NarebskiMay 12, 2008
  13. Lars HjemliMay 12, 2008
  14. Jakub NarebskiMay 13, 2008
  15. Lars HjemliMay 13, 2008
  16. Jakub NarebskiMay 13, 2008
  17. Kristian HøgsbergMay 13, 2008
  18. Lars HjemliMay 13, 2008
  19. Jakub NarebskiMay 13, 2008
  20. Jakub NarebskiMay 14, 2008

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.