git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: GitGitGadget on git/git, was Re: Should we auto-close PRs on git/git?

From
EWEric Wong <e@80x24.org>
Date
Nov 26, 2019, 23:58 UTC
Message-ID
<20191126235822.GA19066@dcvr>
In-Reply-To
<nycvar.QRO.7.76.6.1911262350240.31080@tvgsbejvaqbjf.bet>
Johannes Schindelin <Johannes.Schindelin@gmx.de> wrote:
Show 32 quoted lines
> Hi Eric,
> 
> On Tue, 26 Nov 2019, Eric Wong wrote:
> 
> > Johannes Schindelin <Johannes.Schindelin@gmx.de> wrote:
> > > On Tue, 26 Nov 2019, Eric Wong wrote:
> > > > Johannes Schindelin <Johannes.Schindelin@gmx.de> wrote:
> > > > > The biggest obstacle is that at least one of those Pipelines requires
> > > > > access to a clone of public-inbox.org/git, and cloning that is rather
> > > > > expensive. Even a shallow fetch would be super expensive, by virtue of
> > > > > _all_ the mails being blobs reachable from the tip commit's tree.
> > > >
> > > > Fwiw, lore.kernel.org/git/$EPOCH.git ought to be somewhat cheaper,
> > > > but it's a different (more scalable) format which requires SQLite:
> > > >
> > > > 	https://public-inbox.org/public-inbox-v2-format.html
> > >
> > > Is this incremental? GitGitGadget needs this to be incremental ;-)
> >
> > Incremental as far as "git fetch" goes?  Of course :>
> > The "m" file is overwritten with every commit, so the tree size
> > stays at 1 (tree growth was a major scalability problem in v1).
> 
> Let me try again:
> 
> GitGitGadget "reads" the mail via the incremental clone, remembering the
> hash of the latest processed commit. When the Azure Pipeline runs, it
> first fetches, and if the commit is still the same, does nothing but exit
> with success. If the commit is different, it looks at the mails that were
> added, via `git log -p <previous-tip-commit>..<tip-commit>`.
> 
> Is that possible with the v2 format?

Of course, yes. The Xapian and SQLite indexing also works the same way "git log prev..tip" and storing the latest commit hash.

Previous: Johannes SchindelinNext: Junio C Hamano
Message 19 of 22 in “Should we auto-close PRs on git/git?”
  1. Emily ShafferNov 9, 2019
  2. Junio C HamanoNov 9, 2019
  3. Stephen SmithNov 13, 2019
  4. Johannes SchindelinNov 12, 2019
  5. Jeff KingNov 13, 2019
  6. Johannes SchindelinNov 13, 2019
  7. Jeff KingNov 14, 2019
  8. Johannes SchindelinNov 14, 2019
  9. GitGitGadget on git/git, was Re: Should we auto-close PRs on git/git?Johannes Schindelin, Nov 18, 2019
  10. Jeff KingNov 21, 2019
  11. Johannes SchindelinNov 22, 2019
  12. Johannes SchindelinNov 22, 2019
  13. Jeff KingNov 25, 2019
  14. Johannes SchindelinNov 26, 2019
  15. Eric WongNov 26, 2019
  16. Johannes SchindelinNov 26, 2019
  17. Eric WongNov 26, 2019
  18. Johannes SchindelinNov 26, 2019
  19. Eric WongNov 26, 2019
  20. Junio C HamanoNov 27, 2019
  21. Eric WongNov 27, 2019
  22. Emily ShafferNov 13, 2019

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.