# cloning a namespace downloads all the objects

3 messages from 2012-11-16 to 2012-11-16. Participants: Sitaram Chamarty, Junio C Hamano, Jeff King.
Thread: https://gitlist.dev/t/32127

## Sitaram Chamarty, 2012-11-16 16:34

Subject: cloning a namespace downloads all the objects
Message-ID: <CAMK1S_hdsgXoPcSn__htpGCpmCsAGb9j+m+SvxtO_69eqC92gA@mail.gmail.com>
URL: https://gitlist.dev/e/CAMK1S_hdsgXoPcSn__htpGCpmCsAGb9j%2Bm%2BSvxtO_69eqC92gA%40mail.gmail.com

```
Hi,

I have a repo on a server, which contains, as namespaces, the contents
of several different repos of varying sizes.  When I run a clone
command for the smallest of the namespaces (I have a script that
intercepts the clone and sets GIT_NAMESPACE appropriately), I get the
correct set of refs, but *all* the objects from *all* the namespaces.

And since no refs from the other namespaces have come down, a 'git gc
--prune=now', run immediately after, reduces the size of
".git/objects" to the size I would expect for just that small
namespace.

In effect, it is bringing down data that is not reachable and will be
wiped out on the next gc.

Is this expected?

-- 
Sitaram

```

## Junio C Hamano, 2012-11-16 16:43

Subject: Re: cloning a namespace downloads all the objects
Message-ID: <7vvcd57b32.fsf@alter.siamese.dyndns.org>
URL: https://gitlist.dev/e/7vvcd57b32.fsf%40alter.siamese.dyndns.org
In-Reply-To: <CAMK1S_hdsgXoPcSn__htpGCpmCsAGb9j+m+SvxtO_69eqC92gA@mail.gmail.com>

```
Sitaram Chamarty <sitaramc@gmail.com> writes:

> Hi,
>
> I have a repo on a server, which contains, as namespaces, the contents
> of several different repos of varying sizes.  When I run a clone
> command for the smallest of the namespaces (I have a script that
> intercepts the clone and sets GIT_NAMESPACE appropriately), I get the
> correct set of refs, but *all* the objects from *all* the namespaces.
>
> And since no refs from the other namespaces have come down, a 'git gc
> --prune=now', run immediately after, reduces the size of
> ".git/objects" to the size I would expect for just that small
> namespace.
>
> In effect, it is bringing down data that is not reachable and will be
> wiped out on the next gc.
>
> Is this expected?

I do not think so.

This was done with a series between a1bea2c (ref namespaces:
infrastructure, 2011-07-05) and bf7930c (ref namespaces: tests,
2011-07-21); Josh, care to comment on and to look into it?

```

## Jeff King, 2012-11-16 17:34

Subject: Re: cloning a namespace downloads all the objects
Message-ID: <20121116173416.GA13268@sigill.intra.peff.net>
URL: https://gitlist.dev/e/20121116173416.GA13268%40sigill.intra.peff.net
In-Reply-To: <7vvcd57b32.fsf@alter.siamese.dyndns.org>

```
On Fri, Nov 16, 2012 at 08:43:13AM -0800, Junio C Hamano wrote:

> > I have a repo on a server, which contains, as namespaces, the contents
> > of several different repos of varying sizes.  When I run a clone
> > command for the smallest of the namespaces (I have a script that
> > intercepts the clone and sets GIT_NAMESPACE appropriately), I get the
> > correct set of refs, but *all* the objects from *all* the namespaces.
> >
> > And since no refs from the other namespaces have come down, a 'git gc
> > --prune=now', run immediately after, reduces the size of
> > ".git/objects" to the size I would expect for just that small
> > namespace.
> >
> > In effect, it is bringing down data that is not reachable and will be
> > wiped out on the next gc.
> >
> > Is this expected?
> 
> I do not think so.
> 
> This was done with a series between a1bea2c (ref namespaces:
> infrastructure, 2011-07-05) and bf7930c (ref namespaces: tests,
> 2011-07-21); Josh, care to comment on and to look into it?

I'd guess that the "create_full_pack" logic in create_pack_file is to
blame. The client asked for everything we advertised, so we pass "--all"
to pack-objects rather than giving it the specific list of tips.

We'd have to either fix that logic, or teach the pack-objects subprocess
to respect GIT_NAMESPACE when processing --all.

-Peff

```
