# [PATCH] fetch: fix duplicate remote parallel fetch bug 3 messages from 2023-01-19 to 2023-01-19. Participants: Calvin Wan, Junio C Hamano. Thread: https://gitlist.dev/t/59124 ## Calvin Wan, 2023-01-19 22:05 Subject: [PATCH] fetch: fix duplicate remote parallel fetch bug Message-ID: <20230119220538.1522464-1-calvinwan@google.com> URL: https://gitlist.dev/e/20230119220538.1522464-1-calvinwan%40google.com ``` Fetching in parallel from a remote group with a duplicated remote results in the following: error: cannot lock ref '': is at but expected This doesn't happen in serial since fetching from the same remote that has already been fetched from is a noop. Therefore, remove any duplicated remotes after remote groups are parsed. Signed-off-by: Calvin Wan --- builtin/fetch.c | 1 + t/t5506-remote-groups.sh | 9 +++++++++ 2 files changed, 10 insertions(+) diff --git a/builtin/fetch.c b/builtin/fetch.c index b06e454cbd..508ab2670c 100644 --- a/builtin/fetch.c +++ b/builtin/fetch.c @@ -2225,6 +2225,7 @@ int cmd_fetch(int argc, const char **argv, const char *prefix) argv++; } } + string_list_remove_duplicates(&list, 0); if (negotiate_only) { struct oidset acked_commits = OIDSET_INIT; diff --git a/t/t5506-remote-groups.sh b/t/t5506-remote-groups.sh index 5bac03ede8..0e176175a3 100755 --- a/t/t5506-remote-groups.sh +++ b/t/t5506-remote-groups.sh @@ -99,4 +99,13 @@ test_expect_success 'updating remote name updates that remote' ' ! repo_fetched two ' +test_expect_success 'updating group in parallel with a duplicate remote does not fail (fetch)' ' + mark fetch-group-duplicate && + update_repo one && + git config --add remotes.duplicate one && + git config --add remotes.duplicate one && + git -c fetch.parallel=2 remote update duplicate && + repo_fetched one +' + test_done -- 2.39.0.246.g2a6d74b583-goog ``` ## Junio C Hamano, 2023-01-19 22:40 Subject: Re: [PATCH] fetch: fix duplicate remote parallel fetch bug Message-ID: URL: https://gitlist.dev/e/xmqq8rhy172q.fsf%40gitster.g In-Reply-To: <20230119220538.1522464-1-calvinwan@google.com> ``` Calvin Wan writes: > Fetching in parallel from a remote group with a duplicated remote results > in the following: > > error: cannot lock ref '': is at but expected > > This doesn't happen in serial since fetching from the same remote that > has already been fetched from is a noop. Therefore, remove any duplicated > remotes after remote groups are parsed. > > Signed-off-by: Calvin Wan > --- > builtin/fetch.c | 1 + > t/t5506-remote-groups.sh | 9 +++++++++ > 2 files changed, 10 insertions(+) > > diff --git a/builtin/fetch.c b/builtin/fetch.c > index b06e454cbd..508ab2670c 100644 > --- a/builtin/fetch.c > +++ b/builtin/fetch.c > @@ -2225,6 +2225,7 @@ int cmd_fetch(int argc, const char **argv, const char *prefix) > argv++; > } > } > + string_list_remove_duplicates(&list, 0); As it always is possible to edit .git/config manually, it is necessary to perform deduplication like this patch does on the consumer side of the list, but do you know if our tool create duplication, or is it entirely something the end-user does manually? If it is the former, I am wondering if we should also fix such a code path that does so in the first place. Will queue. Thanks. ``` ## Calvin Wan, 2023-01-19 23:44 Subject: Re: [PATCH] fetch: fix duplicate remote parallel fetch bug Message-ID: URL: https://gitlist.dev/e/CAFySSZA6MgjejnoBa7HrXAQBNb1zE93aASVZogabAK_ArDNmnA%40mail.gmail.com In-Reply-To: ``` > As it always is possible to edit .git/config manually, it is > necessary to perform deduplication like this patch does on the > consumer side of the list, but do you know if our tool create > duplication, or is it entirely something the end-user does manually? I checked git-remote and there is protection against duplication there, but I'm unsure if there are other places where remotes are being added/renamed. I discovered the bug initially by using git-config. ```