Re: [RFC/PATCH] Added a remote helper to interact with mediawiki, pull & clone handled

From: Jeff King <peff@peff.net>
Date: Jun 2, 2011, 22:49 UTC
Message-ID: <20110602224931.GA28189@sigill.intra.peff.net>
In-Reply-To: <BANLkTi=eYg3uT1hQZO03i4MLyhRkPzXK6w@mail.gmail.com>

On Thu, Jun 02, 2011 at 10:28:33PM +0200, Arnaud Lacurie wrote:

Show 10 quoted lines

> > Overall, it's looking pretty good. I like that I can resume a
> > half-finished import via "git fetch". Though I do have one complaint:
> > running "git fetch" fetches the metainfo for every revision of every
> > page, just as it does for an initial clone. Is there something in the
> > mediawiki API to say "show me revisions since N" (where N would be the
> > mediawiki revision of the tip of what we imported)?
> 
> I am not sure I understand your question. Because actually, we are
> supporting this, thanks to git notes. Like when you git fetch after a
> clone, it checks only the last revisions

Sorry, I was partially wrong in what I wrote above. I was resuming a failed import (because of the bogus timestamp), so the numbers of revisions were still high, and I thought they were the same as in the original version. I see now doing a fetch on the completed import that it properly finds 0 revisions for each page. So that's good.

However, it does still take O(number of pages) requests just to find out that there is nothing to fetch. For the git wiki, this takes on the order of 1.5 minutes to do an empty fetch. When getting the list of pages, I wonder if there is a way in the mediawiki API to say "show me only pages which have been modified since rev N".

-Peff