# [PATCH] bundle-uri: plug leak in unbundle_from_file() 9 messages from 2024-08-26 to 2024-10-10. Participants: Toon Claes, Patrick Steinhardt, Junio C Hamano. Thread: https://gitlist.dev/t/62003 ## Toon Claes, 2024-08-26 08:30 Subject: [PATCH] bundle-uri: plug leak in unbundle_from_file() Message-ID: <20240826083052.1542228-1-toon@iotcl.com> URL: https://gitlist.dev/e/20240826083052.1542228-1-toon%40iotcl.com ``` When the function returns early, the variable bundle_ref is not released through strbuf_release(). Fix this leak. And while at it, remove assignments in the conditions of the "if" statements as suggested in the CodingGuidelines. Signed-off-by: Toon Claes --- bundle-uri.c | 16 +++++++++++----- 1 file changed, 11 insertions(+), 5 deletions(-) diff --git a/bundle-uri.c b/bundle-uri.c index 1e0ee156ba..eb49cba182 100644 --- a/bundle-uri.c +++ b/bundle-uri.c @@ -367,17 +367,21 @@ static int unbundle_from_file(struct repository *r, const char *file) struct strbuf bundle_ref = STRBUF_INIT; size_t bundle_prefix_len; - if ((bundle_fd = read_bundle_header(file, &header)) < 0) - return 1; + bundle_fd = read_bundle_header(file, &header); + if (bundle_fd < 0) { + result = 1; + goto cleanup; + } /* * Skip the reachability walk here, since we will be adding * a reachable ref pointing to the new tips, which will reach * the prerequisite commits. */ - if ((result = unbundle(r, &header, bundle_fd, NULL, - VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)))) - return 1; + result = unbundle(r, &header, bundle_fd, NULL, + VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)); + if (result) + goto cleanup; /* * Convert all refs/heads/ from the bundle into refs/bundles/ @@ -406,6 +410,8 @@ static int unbundle_from_file(struct repository *r, const char *file) 0, UPDATE_REFS_MSG_ON_ERR); } +cleanup: + strbuf_release(&bundle_ref); bundle_header_release(&header); return result; } -- 2.46.0 ``` ## Patrick Steinhardt, 2024-08-26 09:51 Subject: Re: [PATCH] bundle-uri: plug leak in unbundle_from_file() Message-ID: URL: https://gitlist.dev/e/ZsxQBEpfChQozhF7%40tanuki In-Reply-To: <20240826083052.1542228-1-toon@iotcl.com> ``` On Mon, Aug 26, 2024 at 10:30:52AM +0200, Toon Claes wrote: > When the function returns early, the variable bundle_ref is not released > through strbuf_release(). > > Fix this leak. And while at it, remove assignments in the conditions of > the "if" statements as suggested in the CodingGuidelines. > > Signed-off-by: Toon Claes > --- > bundle-uri.c | 16 +++++++++++----- > 1 file changed, 11 insertions(+), 5 deletions(-) > > diff --git a/bundle-uri.c b/bundle-uri.c > index 1e0ee156ba..eb49cba182 100644 > --- a/bundle-uri.c > +++ b/bundle-uri.c > @@ -367,17 +367,21 @@ static int unbundle_from_file(struct repository *r, const char *file) > struct strbuf bundle_ref = STRBUF_INIT; > size_t bundle_prefix_len; > > - if ((bundle_fd = read_bundle_header(file, &header)) < 0) > - return 1; > + bundle_fd = read_bundle_header(file, &header); > + if (bundle_fd < 0) { > + result = 1; > + goto cleanup; > + } > > /* > * Skip the reachability walk here, since we will be adding > * a reachable ref pointing to the new tips, which will reach > * the prerequisite commits. > */ > - if ((result = unbundle(r, &header, bundle_fd, NULL, > - VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)))) > - return 1; > + result = unbundle(r, &header, bundle_fd, NULL, > + VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)); > + if (result) > + goto cleanup; This changes the returned error code from `1` to whatever `unbundle()` returns. Is this intentional? If so, the commit message should explain why this change is safe. Other than that this looks good to me, and the fix does not conflict with any of my leak-plugging series. Thanks! Patrick ``` ## Junio C Hamano, 2024-08-26 16:06 Subject: Re: [PATCH] bundle-uri: plug leak in unbundle_from_file() Message-ID: URL: https://gitlist.dev/e/xmqqle0jmfpf.fsf%40gitster.g In-Reply-To: ``` Patrick Steinhardt writes: > On Mon, Aug 26, 2024 at 10:30:52AM +0200, Toon Claes wrote: >> When the function returns early, the variable bundle_ref is not released >> through strbuf_release(). >> >> Fix this leak. And while at it, remove assignments in the conditions of >> the "if" statements as suggested in the CodingGuidelines. > ... >> - if ((result = unbundle(r, &header, bundle_fd, NULL, >> - VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)))) >> - return 1; >> + result = unbundle(r, &header, bundle_fd, NULL, >> + VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)); >> + if (result) >> + goto cleanup; > > This changes the returned error code from `1` to whatever `unbundle()` > returns. Is this intentional? If so, the commit message should explain > why this change is safe. Thanks for reviewing carefully. Both of two callers of unbundle_from_file() are used as the condition of an if() statement, so unbundle() that signals an error with -1 wouldn't be a problem, I would think. It may not be a bad idea as a #leftoverbits item, after the dust settles, to clean up the calling convention in this file (may not be limited to the code path that reaches this function) to follow the usual "signal success with 0, failures are signalled with a negative value". Then we can just return the value we got from a failing read_bundle_header(), just the same way we return the value we got from a failing unbundle(). > Other than that this looks good to me, and the fix does not conflict > with any of my leak-plugging series. Yup. Thanks, both. ``` ## Toon Claes, 2024-10-01 18:58 Subject: Re: [PATCH] bundle-uri: plug leak in unbundle_from_file() Message-ID: <87ikubsl9a.fsf@iotcl.com> URL: https://gitlist.dev/e/87ikubsl9a.fsf%40iotcl.com In-Reply-To: ``` Junio C Hamano writes: > Thanks for reviewing carefully. > > Both of two callers of unbundle_from_file() are used as the > condition of an if() statement, so unbundle() that signals an error > with -1 wouldn't be a problem, I would think. Hi Junio, I've noticed this patch wasn't picked up yet. Is there anything you want me to change and have me sent another version, or is it good to go in? -- Toon ``` ## Junio C Hamano, 2024-10-01 19:29 Subject: Re: [PATCH] bundle-uri: plug leak in unbundle_from_file() Message-ID: URL: https://gitlist.dev/e/xmqqfrpfvcyu.fsf%40gitster.g In-Reply-To: <87ikubsl9a.fsf@iotcl.com> ``` Toon Claes writes: > Junio C Hamano writes: > >> Thanks for reviewing carefully. >> >> Both of two callers of unbundle_from_file() are used as the >> condition of an if() statement, so unbundle() that signals an error >> with -1 wouldn't be a problem, I would think. > > Hi Junio, > > I've noticed this patch wasn't picked up yet. Is there anything you want > me to change and have me sent another version, or is it good to go in? I am waiting for a reroll with an updated log message, i.e, what Patrick pointed out in his review. I only said "yeah, this looks safe", and never meant "it is so obvious there is no need for extra explanation in the log message". Thanks. ``` ## Toon Claes, 2024-10-10 09:12 Subject: [PATCH v2] bundle-uri: plug leak in unbundle_from_file() Message-ID: <20241010091249.1895960-1-toon@iotcl.com> URL: https://gitlist.dev/e/20241010091249.1895960-1-toon%40iotcl.com In-Reply-To: <20240826083052.1542228-1-toon@iotcl.com> ``` The function `unbundle_from_file()` has two memory leaks: - We do not release the `struct bundle_header header` when hitting errors because we return early without any cleanup. - We do not release the `struct strbuf bundle_ref` at all. Plug these leaks by creating a common exit path where both of these variables are released. While at it, refactor the code such that the variable assignments do not happen inside the conditional statement itself according to our coding style. Signed-off-by: Toon Claes --- bundle-uri.c | 18 +++++++++++++----- 1 file changed, 13 insertions(+), 5 deletions(-) diff --git a/bundle-uri.c b/bundle-uri.c index 4b1a2e2937..0df66e2872 100644 --- a/bundle-uri.c +++ b/bundle-uri.c @@ -368,17 +368,23 @@ static int unbundle_from_file(struct repository *r, const char *file) struct strbuf bundle_ref = STRBUF_INIT; size_t bundle_prefix_len; - if ((bundle_fd = read_bundle_header(file, &header)) < 0) - return 1; + bundle_fd = read_bundle_header(file, &header); + if (bundle_fd < 0) { + result = 1; + goto cleanup; + } /* * Skip the reachability walk here, since we will be adding * a reachable ref pointing to the new tips, which will reach * the prerequisite commits. */ - if ((result = unbundle(r, &header, bundle_fd, NULL, - VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)))) - return 1; + result = unbundle(r, &header, bundle_fd, NULL, + VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)); + if (result) { + result = 1; + goto cleanup; + } /* * Convert all refs/heads/ from the bundle into refs/bundles/ @@ -407,6 +413,8 @@ static int unbundle_from_file(struct repository *r, const char *file) 0, UPDATE_REFS_MSG_ON_ERR); } +cleanup: + strbuf_release(&bundle_ref); bundle_header_release(&header); return result; } Range-diff against v1: 1: f30f393e05 ! 1: 19714d860c bundle-uri: plug leak in unbundle_from_file() @@ Metadata ## Commit message ## bundle-uri: plug leak in unbundle_from_file() - When the function returns early, the variable bundle_ref is not released - through strbuf_release(). + The function `unbundle_from_file()` has two memory leaks: - Fix this leak. And while at it, remove assignments in the conditions of - the "if" statements as suggested in the CodingGuidelines. + - We do not release the `struct bundle_header header` when hitting + errors because we return early without any cleanup. + + - We do not release the `struct strbuf bundle_ref` at all. + + Plug these leaks by creating a common exit path where both of these + variables are released. + + While at it, refactor the code such that the variable assignments do not + happen inside the conditional statement itself according to our coding + style. Signed-off-by: Toon Claes @@ bundle-uri.c: static int unbundle_from_file(struct repository *r, const char *fi - return 1; + result = unbundle(r, &header, bundle_fd, NULL, + VERIFY_BUNDLE_QUIET | (fetch_pack_fsck_objects() ? VERIFY_BUNDLE_FSCK : 0)); -+ if (result) ++ if (result) { ++ result = 1; + goto cleanup; ++ } /* * Convert all refs/heads/ from the bundle into refs/bundles/ -- 2.46.0.46.g406f326d27 ``` ## Toon Claes, 2024-10-10 09:15 Subject: Re: [PATCH] bundle-uri: plug leak in unbundle_from_file() Message-ID: <875xq0s4in.fsf@iotcl.com> URL: https://gitlist.dev/e/875xq0s4in.fsf%40iotcl.com In-Reply-To: ``` Junio C Hamano writes: > Both of two callers of unbundle_from_file() are used as the > condition of an if() statement, so unbundle() that signals an error > with -1 wouldn't be a problem, I would think. > It may not be a bad idea as a #leftoverbits item, after the dust > settles, to clean up the calling convention in this file (may not be > limited to the code path that reaches this function) to follow the > usual "signal success with 0, failures are signalled with a negative > value". Then we can just return the value we got from a failing > read_bundle_header(), just the same way we return the value we got > from a failing unbundle(). I just submitted v2 which preserves the original return values as before. I'll leave changing any return value to a #leftoverbits series to addresses them together. -- Toon ``` ## Patrick Steinhardt, 2024-10-10 12:55 Subject: Re: [PATCH v2] bundle-uri: plug leak in unbundle_from_file() Message-ID: URL: https://gitlist.dev/e/ZwfOsoC35x-wyn7S%40pks.im In-Reply-To: <20241010091249.1895960-1-toon@iotcl.com> ``` On Thu, Oct 10, 2024 at 11:12:49AM +0200, Toon Claes wrote: > The function `unbundle_from_file()` has two memory leaks: > > - We do not release the `struct bundle_header header` when hitting > errors because we return early without any cleanup. > > - We do not release the `struct strbuf bundle_ref` at all. > > Plug these leaks by creating a common exit path where both of these > variables are released. > > While at it, refactor the code such that the variable assignments do not > happen inside the conditional statement itself according to our coding > style. Thanks, this version looks good to me. We now avoid any discussion around the changed error code completely, and the commit message seems reasonable to me. Thanks! Patrick ``` ## Junio C Hamano, 2024-10-10 18:47 Subject: Re: [PATCH v2] bundle-uri: plug leak in unbundle_from_file() Message-ID: URL: https://gitlist.dev/e/xmqq8quvlrqa.fsf%40gitster.g In-Reply-To: ``` Patrick Steinhardt writes: > On Thu, Oct 10, 2024 at 11:12:49AM +0200, Toon Claes wrote: >> The function `unbundle_from_file()` has two memory leaks: >> >> - We do not release the `struct bundle_header header` when hitting >> errors because we return early without any cleanup. >> >> - We do not release the `struct strbuf bundle_ref` at all. >> >> Plug these leaks by creating a common exit path where both of these >> variables are released. >> >> While at it, refactor the code such that the variable assignments do not >> happen inside the conditional statement itself according to our coding >> style. > > Thanks, this version looks good to me. We now avoid any discussion > around the changed error code completely, and the commit message seems > reasonable to me. > > Thanks! > > Patrick Thanks, both of you. Will queue. ```