threads / discuss / 18994

What's going on here? Bad repo, no error locally?

Subject: What's going on here? Bad repo, no error locally?

## tl;dr

7 messages between Apr 22, 2009 and Apr 22, 2009.

replies: 6people: 5as markdown or json

John Dlugosz· Apr 22, 2009, 00:18 UTC · lore

Developer B runs git fsck --full, gets no errors but one dangling blob. Does a push. No errors. Now, on the upstream repo, I run fsck, and find a bunch of danglings (as always) and a missing blob. Any fetch from that repo will fail, due to that missing blob.

What's going on? How can I fix his local repository, other than blow it away and start over, and copy his current files over and rebuild the few commits of interest?

--John

TradeStation Group, Inc. is a publicly-traded holding company (NASDAQ GS: TRAD) of three operating subsidiaries, TradeStation Securities, Inc. (Member NYSE, FINRA, SIPC and NFA), TradeStation Technologies, Inc., a trading software and subscription company, and TradeStation Europe Limited, a United Kingdom, FSA-authorized introducing brokerage firm. None of these companies provides trading or investment advice, recommendations or endorsements of any kind. The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited.
  If you received this in error, please contact the sender and delete the material from any computer.

Bryan Donlan· Apr 22, 2009, 04:21 UTC · re: John Dlugosz · lore

Re: What's going on here? Bad repo, no error locally?

On Tue, Apr 21, 2009 at 8:18 PM, John Dlugosz <JDlugosz@tradestation.com> wrote:

Show 9 quoted lines

> Developer B runs git fsck --full, gets no errors but one dangling blob.
> Does a push.  No errors.
> Now, on the upstream repo, I run fsck, and find a bunch of danglings (as
> always) and a missing blob.
> Any fetch from that repo will fail, due to that missing blob.
>
> What's going on?  How can I fix his local repository, other than blow it
> away and start over, and copy his current files over and rebuild the few
> commits of interest?

Extract the object on developer B's workstation: git cat-file blob <object ID> > blob.dat

Copy it to upstream, then do: git hash-object -w blob.dat

If all goes well, hash-object will give you back the blob's ID, and the repository will fsck cleanly again.

John M. Dlugosz· Apr 22, 2009, 04:37 UTC · re: Bryan Donlan · lore

Re: What's going on here? Bad repo, no error locally?

Bryan Donlan wrote:

Show 8 quoted lines

> Extract the object on developer B's workstation:
> git cat-file blob <object ID>  > blob.dat
> 
> Copy it to upstream, then do:
> git hash-object -w blob.dat
> 
> If all goes well, hash-object will give you back the blob's ID, and
> the repository will fsck cleanly again.

Thanks, I was looking through the manual for that but wasn't sure how to put it together.

But, what could be wrong with B's repo that makes this happen repetetly? I assumed it was network SNAFU, but after restoring the upstream repo, his push did it again.

--John

Bryan Donlan· Apr 22, 2009, 04:52 UTC · re: John M. Dlugosz · lore

Re: What's going on here? Bad repo, no error locally?

On Wed, Apr 22, 2009 at 12:37 AM, John M. Dlugosz <ngnr63q02@sneakemail.com> wrote:

Show 17 quoted lines

> Bryan Donlan wrote:
>>
>> Extract the object on developer B's workstation:
>> git cat-file blob <object ID>  > blob.dat
>>
>> Copy it to upstream, then do:
>> git hash-object -w blob.dat
>>
>> If all goes well, hash-object will give you back the blob's ID, and
>> the repository will fsck cleanly again.
>
> Thanks, I was looking through the manual for that but wasn't sure how to put
> it together.
>
> But, what could be wrong with B's repo that makes this happen repetetly?  I
> assumed it was network SNAFU, but after restoring the upstream repo, his
> push did it again.

Theoretically, this should never happen :) Are you accessing the repo directly through a file share, or through a git-daemon connection? If the former, could something like a virus scanner be deleting loose objects, perhaps?

Junio C Hamano· Apr 22, 2009, 05:06 UTC · re: John Dlugosz · lore

Re: What's going on here? Bad repo, no error locally?

"John Dlugosz" <JDlugosz@TradeStation.com> writes:

Show 7 quoted lines

> Developer B runs git fsck --full, gets no errors but one dangling blob.
> Does a push.  No errors.
> Now, on the upstream repo, I run fsck, and find a bunch of danglings (as
> always) and a missing blob.
> Any fetch from that repo will fail, due to that missing blob.
>
> What's going on?  How can I fix his local repository, other than...

It sounds like there is nothing to fix in "his local repository"; the error is in your "upstream repo".

The dangling objects can happen if you push over dumb transport and interrupt in the middle, or you force a push of a rewound branch, so it does not necessarily indicate any errors, but a missing object is always an error.

John Dlugosz· Apr 22, 2009, 15:59 UTC · re: Junio C Hamano · lore

RE: What's going on here? Bad repo, no error locally?

> The dangling objects can happen if you push over dumb transport and
> interrupt in the middle, or you force a push of a rewound branch, so

it

> does not necessarily indicate any errors, but a missing object is
> always an error.

Thanks.

That's what I thought danglings were. But why doesn't gc get rid of them?

TradeStation Group, Inc. is a publicly-traded holding company (NASDAQ GS: TRAD) of three operating subsidiaries, TradeStation Securities, Inc. (Member NYSE, FINRA, SIPC and NFA), TradeStation Technologies, Inc., a trading software and subscription company, and TradeStation Europe Limited, a United Kingdom, FSA-authorized introducing brokerage firm. None of these companies provides trading or investment advice, recommendations or endorsements of any kind. The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited.
  If you received this in error, please contact the sender and delete the material from any computer.

Brandon Casey· Apr 22, 2009, 16:30 UTC · re: John Dlugosz · lore

Re: What's going on here? Bad repo, no error locally?

John Dlugosz wrote:

Show 11 quoted lines

>> The dangling objects can happen if you push over dumb transport and
>> interrupt in the middle, or you force a push of a rewound branch, so
> it
>> does not necessarily indicate any errors, but a missing object is
>> always an error.
> 
> 
> Thanks.
> 
> That's what I thought danglings were.  But why doesn't gc get rid of
> them?

Jeff already explained why in his email to you about "dangling commits ...".

What you may not realize (and Jeff hinted at) is that unreferenced objects are created often. This is because the object must be created _before_ the reference to the object is created. The existence of a reference to an object is what differentiates a dangling,unreferenced object from one that is not dangling,unreferenced. Usually, an unreferenced object exists in the repository for a very short time before becoming referenced by the creation of a commit which references it. But, there is always some period of time that an object exists in the repository as a dangling,unreferenced object. That is why gc does not delete all dangling,unreferenced objects that it encounters immediately. As Jeff pointed out, it only deletes those that are two weeks old by default.

-brandon