Re: Fetching 24 Linux commits = 1.2 GiB

From: Martin Wilck <mwilck@suse.com>
Date: Apr 21, 2020, 10:02 UTC
Message-ID: <6cb9d009026cfb9918b2ceab3e43ec1cbc303de4.camel@suse.com>
In-Reply-To: <a5bce92f-ad19-75d4-1e34-dacc73321536@suse.cz>

On Thu, 2020-04-16 at 08:31 +0200, Jiri Slaby wrote:

Show 22 quoted lines

> On 15. 04. 20, 15:56, Konstantin Ryabitsev wrote:
> > 
> I tried hard, but cannot reproduce. I noticed a difference between
> 2.25.1 and 2.25.1+protocol.version=2, though:
> 
> $ git config protocol.version 1 # the default in 2.25
> $ git fetch
> git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
> 8f3d9f354286745c751374f5f1fcafee6b3f3136
> error: Server does not allow request for unadvertised object
> 8f3d9f354286745c751374f5f1fcafee6b3f3136
> $ git config protocol.version 2
> $ git fetch
> git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
> 8f3d9f354286745c751374f5f1fcafee6b3f3136
> remote: Enumerating objects: 1433262, done.
> ...
> 
> Doing fetch v5.7-rc1 (which is 8f3d9f3 above) with proto 1 works. So
> the
> server obviously advertises different set of objects with proto 1 and
> 2.

I just had the same issue with several kernel repos. The affected repo is a bare clone of Linus' kernel repo, plus "stable" and various maintainer repos as additional remotes.

Interestingly, a single "git fetch --dry-run" with protol version 1 "fixed" the issue. I hadn't expected that to happen, so unfortunately I hadn't made a backup of the repo before. As this is a 50GB bare repo, I'd appreciate instructions on how exactly to archive/upload it for debugging if this should happen again.

mwilck@apollon:linux.git[BARE:master]> git fetch --dry-run -v net Looking up git.kernel.org ... done. Connecting to git.kernel.org (port 9418) ... 136.144.49.103 done. remote: Enumerating objects: 7331255, done. remote: Counting objects: 100% (7331255/7331255), done. remote: Compressing objects: 100% (1113751/1113751), done. ^C mwilck@apollon:linux.git[BARE:master]> git config --get protocol.version mwilck@apollon:linux.git[BARE:master]> git config protocol.version 1 mwilck@apollon:linux.git[BARE:master]> git fetch --dry-run -v net Looking up git.kernel.org ... done. Connecting to git.kernel.org (port 9418) ... 136.144.49.103 done. remote: Enumerating objects: 71, done. remote: Counting objects: 100% (71/71), done. remote: Compressing objects: 100% (48/48), done. remote: Total 53 (delta 42), reused 0 (delta 0) Unpacking objects: 100% (53/53), 8.06 KiB | 5.00 KiB/s, done. ^C

(this fixed the issue despite "--dry-run" and myself interrupting the process).

mwilck@apollon:linux.git[BARE:master]> git config protocol.version 2
mwilck@apollon:linux.git[BARE:master]> git fetch --dry-run -v net
Looking up git.kernel.org ... done.
Connecting to git.kernel.org (port 9418) ... 136.144.49.103 done.
From git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
   9bacd25..a460fc5      master       -> net/master
 = [up to date]          v2.6.11      -> v2.6.11
...

Regards Martin