# HELP: GIT Cloning failed 4 messages from 2006-08-22 to 2006-08-22. Participants: Ju, Seokmann, Sean, Phillip Susi. Thread: https://gitlist.dev/t/5357 ## Ju, Seokmann, 2006-08-22 19:25 Subject: HELP: GIT Cloning failed Message-ID: <890BF3111FB9484E9526987D912B261932E35B@NAMAIL3.ad.lsil.com> URL: https://gitlist.dev/e/890BF3111FB9484E9526987D912B261932E35B%40NAMAIL3.ad.lsil.com ``` Hi, Recently, I found that cloning from GIT server has been failed. I'm using following script for it. --- ... rm -r /home/git/kernels/2.4/linux-2.4.git cg-clone http://www.kernel.org/pub/scm/linux/kernel/git/marcelo/linux-2.4.git/ /home/git/kernels/2.4/linux-2.4.git/ sync rm -r /home/git/kernels/2.4/linux-2.6.git cg-clone http://www.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6.git/ /home/git/kernels/2.4/linux-2.6.git/ sync rm -r /home/git/kernels/2.4/scsi-misc-2.6.git cg-clone http://www.kernel.org/pub/scm/linux/kernel/git/marcelo/scsi-misc-2.6.git /home/git/kernels/2.4/scsi-misc-2.6.git sync ... --- In the script, I'm cloning 3 different sources. First two sources getting successfully cloned, however, last one is getting failed with following error messages, --- Fetching head... Fetching objects... Getting alternates list for http://www.kernel.org/pub/scm/linux/kernel/git/jejb/scsi-misc-2.6.git Also look at http://www.kernel.or Error: The requested URL returned error: 502 (curl_result = 22, http_code = 502, sha1 = 1039f0760e...) Getting pack list for http://www.kernel.org/pub/scm/linux/kernel/git/jejb/scsi-misc-2.6.git/ Getting pack list for http://www.kernel.or Error: The requested URL returned error: 502 Error: Unable to find 27fd37621... Under http://www.kernel.org/pub/scsm/linux/kernel/git/jejb/scsi-misc-2.6.git/ Cannot obtain needed blob 27fd37621... While processing commit 4041b9cd87... Progress: 8 objects, 13120 bytes Cg-fetch: objects fetch failed --- Above script worked without any problem when I started several months ago and I'm not sure when did it stop working. I'm using _cron_ utility on my Linux box for scheduled execution of the script. Any comment would be appreciated. Thank you, Seokmann ``` ## Sean, 2006-08-22 20:08 Subject: Re: HELP: GIT Cloning failed Message-ID: URL: https://gitlist.dev/e/BAYC1-PASMTP03D3DD61899A6464D26765AE460%40CEZ.ICE In-Reply-To: <890BF3111FB9484E9526987D912B261932E35B@NAMAIL3.ad.lsil.com> ``` On Tue, 22 Aug 2006 13:25:23 -0600 "Ju, Seokmann" wrote: Ju, > Above script worked without any problem when I started several months > ago and I'm not sure when did it stop working. > I'm using _cron_ utility on my Linux box for scheduled execution of the > script. > > Any comment would be appreciated. It looks like the jejb scsi-misc archive might not have been configured properly for http transfers. There's a script below which just uses git commands (not cogito) and the native git protocol which tests out okay here. A few comments though: - Apparently the scsi misc tree you want is actually under "jejb" rather than "marcelo" which you had in your script. - It's better to use the native git protocol when possible (well, the benefits are less on initial clone, but it's still a good practice) - You're causing a lot of unnecessary traffic for kernel.org by cloning a fresh copy of all these trees, it would be much better to clone just _once_ and then simply "git pull" in any updates. - Two of the trees you're cloning are very close in content to each other (linux-2.6 & scsi-misc-2.6) so you can use the git "--reference" option to share local objects saving disk space (and reducing bandwidth needs even further) Cheers, Sean #!/bin/sh cd /home/git/kernels/2.4 || exit BASE="git://www.kernel.org/pub/scm/linux/kernel/git" rm -rf linux-2.4 linux-2.6 scsi-misc-2.6 git clone $BASE/marcelo/linux-2.4 git clone $BASE/torvalds/linux-2.6 git clone --reference linux-2.6 $BASE/jejb/scsi-misc-2.6 ``` ## Sean, 2006-08-22 20:08 Subject: Re: HELP: GIT Cloning failed Message-ID: <20060822160822.b112421a.seanlkml__6732.01446556977$1156277346$gmane$org@sympatico.ca> URL: https://gitlist.dev/e/20060822160822.b112421a.seanlkml__6732.01446556977%241156277346%24gmane%24org%40sympatico.ca In-Reply-To: <890BF3111FB9484E9526987D912B261932E35B@NAMAIL3.ad.lsil.com> ``` On Tue, 22 Aug 2006 13:25:23 -0600 "Ju, Seokmann" wrote: Ju, > Above script worked without any problem when I started several months > ago and I'm not sure when did it stop working. > I'm using _cron_ utility on my Linux box for scheduled execution of the > script. > > Any comment would be appreciated. It looks like the jejb scsi-misc archive might not have been configured properly for http transfers. There's a script below which just uses git commands (not cogito) and the native git protocol which tests out okay here. A few comments though: - Apparently the scsi misc tree you want is actually under "jejb" rather than "marcelo" which you had in your script. - It's better to use the native git protocol when possible (well, the benefits are less on initial clone, but it's still a good practice) - You're causing a lot of unnecessary traffic for kernel.org by cloning a fresh copy of all these trees, it would be much better to clone just _once_ and then simply "git pull" in any updates. - Two of the trees you're cloning are very close in content to each other (linux-2.6 & scsi-misc-2.6) so you can use the git "--reference" option to share local objects saving disk space (and reducing bandwidth needs even further) Cheers, Sean #!/bin/sh cd /home/git/kernels/2.4 || exit BASE="git://www.kernel.org/pub/scm/linux/kernel/git" rm -rf linux-2.4 linux-2.6 scsi-misc-2.6 git clone $BASE/marcelo/linux-2.4 git clone $BASE/torvalds/linux-2.6 git clone --reference linux-2.6 $BASE/jejb/scsi-misc-2.6 ``` ## Phillip Susi, 2006-08-22 21:08 Subject: Re: HELP: GIT Cloning failed Message-ID: <44EB7239.50105@cfl.rr.com> URL: https://gitlist.dev/e/44EB7239.50105%40cfl.rr.com In-Reply-To: <890BF3111FB9484E9526987D912B261932E35B@NAMAIL3.ad.lsil.com> ``` Is there a reason that you regularly delete and re-download the entire repository, rather than simply doing a git pull to update your existing clone? Ju, Seokmann wrote: > Hi, > > Recently, I found that cloning from GIT server has been failed. > I'm using following script for it. > --- > ... > rm -r /home/git/kernels/2.4/linux-2.4.git > cg-clone > http://www.kernel.org/pub/scm/linux/kernel/git/marcelo/linux-2.4.git/ > /home/git/kernels/2.4/linux-2.4.git/ > sync > rm -r /home/git/kernels/2.4/linux-2.6.git > cg-clone > http://www.kernel.org/pub/scm/linux/kernel/git/torvalds/linux-2.6.git/ > /home/git/kernels/2.4/linux-2.6.git/ > sync > rm -r /home/git/kernels/2.4/scsi-misc-2.6.git > cg-clone > http://www.kernel.org/pub/scm/linux/kernel/git/marcelo/scsi-misc-2.6.git > /home/git/kernels/2.4/scsi-misc-2.6.git > sync > ... > --- > > In the script, I'm cloning 3 different sources. First two sources > getting successfully cloned, however, last one is getting failed with > following error messages, > --- > Fetching head... > Fetching objects... > Getting alternates list for > http://www.kernel.org/pub/scm/linux/kernel/git/jejb/scsi-misc-2.6.git > Also look at http://www.kernel.or > Error: The requested URL returned error: 502 (curl_result = 22, > http_code = 502, sha1 = 1039f0760e...) > Getting pack list for > http://www.kernel.org/pub/scm/linux/kernel/git/jejb/scsi-misc-2.6.git/ > Getting pack list for http://www.kernel.or > Error: The requested URL returned error: 502 > Error: Unable to find 27fd37621... Under > http://www.kernel.org/pub/scsm/linux/kernel/git/jejb/scsi-misc-2.6.git/ > Cannot obtain needed blob 27fd37621... > While processing commit 4041b9cd87... > Progress: 8 objects, 13120 bytes > Cg-fetch: objects fetch failed > --- > > Above script worked without any problem when I started several months > ago and I'm not sure when did it stop working. > I'm using _cron_ utility on my Linux box for scheduled execution of the > script. > > Any comment would be appreciated. > > Thank you, > > Seokmann ```