[GSoC PATCH v3 2/5] pack-write: add helper to fill promisor file after repack
- From
LorenzoPegorari <lorenzo.pegorari2002@gmail.com>
- Date
- Apr 6, 2026, 00:24 UTC
- Message-ID
- <3cd15429194c763727fbfd5981ba38c1dc2cc907.1775431990.git.lorenzo.pegorari2002@gmail.com>
- In-Reply-To
- <cover.1775431990.git.lorenzo.pegorari2002@gmail.com>
A ".promisor" file may contain ref names (and their associated hashes) that were fetched at the time the corresponding packfile was downloaded. This information is used for debugging reasons. This information is stored as lines structured like this: "<oid> <ref>".
Create a `copy_promisor_content()` helper function that allows this debugging info to not be lost after a `repack`, by coping it inside a new ".promisor" file.
The function logic is the following:
* Take all ".promisor" files contained inside the given `repo`.
* Ignore those whose name is contained inside the given `strset
not_repacked_names`, which basically acts as a "promisor ignorelist"
(intended to be used for packfiles that have not been repacked).
* Read each line of the remaining ".promisor" files, which can be:
* "<oid> <ref>" if the ".promisor" file was never repacked. If so,
add the time at which the ".promisor" file was last modified <time>
to the line to create the string: "<oid> <ref> <time>".
* "<oid> <ref> <time>" if the ".promisor" file was repacked. If so,
don't modify it.
* Ignore the line if its <oid> is not present inside the
"<packtmp>-<dest_hex>.idx" file.
* If the destination file "<packtmp>-<dest_hex>.promisor" does not
already contain the line, append it to the file.The function assumes that the contents of all ".promisor" files are correctly formed.
The time of last data modification is used in place of the time of file creation, because the former is much easier to obtain than the latter one.
Signed-off-by: LorenzoPegorari <lorenzo.pegorari2002@gmail.com> --- repack-promisor.c | 119 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 119 insertions(+)
diff --git a/repack-promisor.c b/repack-promisor.c index 90318ce150..6da452e8ff 100644 --- a/repack-promisor.c +++ b/repack-promisor.c @@ -34,6 +34,125 @@ static int write_oid(const struct object_id *oid, return 0; } +/* + * Go through all .promisor files contained in repo (excluding those whose name + * appears in not_repacked_basenames, which acts as a ignorelist), and copies + * their content inside the destination file "<packtmp>-<dest_hex>.promisor". + * Each line of a never repacked .promisor file is: "<oid> <ref>" (as described + * in the write_promisor_file() function). + * After a repack, the copied lines will be: "<oid> <ref> <time>", where <time> + * is the time at which the .promisor file was last modified. + * Only the lines whose <oid> is present inside "<packtmp>-<dest_hex>.idx" will + * be copied. + * The contents of all .promisor files are assumed to be correctly formed. + */ +static void copy_promisor_content(struct repository *repo, + const char *dest_hex, + const char *packtmp, + struct strset *not_repacked_basenames) +{ + char *dest_idx_name; + char *dest_promisor_name; + FILE *dest; + struct strset dest_content = STRSET_INIT; + struct strbuf dest_to_write = STRBUF_INIT; + struct strbuf source_promisor_name = STRBUF_INIT; + struct strbuf line = STRBUF_INIT; + struct object_id dest_oid; + struct packed_git *dest_pack, *p; + int err; + + dest_idx_name = mkpathdup("%s-%s.idx", packtmp, dest_hex); + get_oid_hex_algop(dest_hex, &dest_oid, repo->hash_algo); + dest_pack = parse_pack_index(repo, dest_oid.hash, dest_idx_name); + + /* Open the .promisor dest file, and fill dest_content with its content */ + dest_promisor_name = mkpathdup("%s-%s.promisor", packtmp, dest_hex); + dest = xfopen(dest_promisor_name, "r+"); + while (strbuf_getline(&line, dest) != EOF) + strset_add(&dest_content, line.buf); + + repo_for_each_pack(repo, p) { + FILE *source; + struct stat source_stat; + + if (!p->pack_promisor) + continue; + + if (not_repacked_basenames && + strset_contains(not_repacked_basenames, pack_basename(p))) + continue; + + strbuf_reset(&source_promisor_name); + strbuf_addstr(&source_promisor_name, p->pack_name); + strbuf_strip_suffix(&source_promisor_name, ".pack"); + strbuf_addstr(&source_promisor_name, ".promisor"); + + if (stat(source_promisor_name.buf, &source_stat)) + die(_("File not found: %s"), source_promisor_name.buf); + + source = xfopen(source_promisor_name.buf, "r"); + + while (strbuf_getline(&line, source) != EOF) { + struct strbuf **parts; + struct object_id oid; + + /* Split line into <oid>, <ref> and <time> (if <time> exists) */ + parts = strbuf_split_max(&line, ' ', 3); + + /* Ignore the lines where <oid> doesn't appear in the dest_pack */ + strbuf_rtrim(parts[0]); + get_oid_hex_algop(parts[0]->buf, &oid, repo->hash_algo); + if (!find_pack_entry_one(&oid, dest_pack)) + continue; + + /* If <time> doesn't exist, retrieve it and add it to line */ + if (!parts[2]) { + struct tm tm; + localtime_r(&source_stat.st_mtim.tv_sec, &tm), + strbuf_addch(&line, ' '); + strbuf_addftime(&line, "%Y/%m/%d-%H:%M:%S", &tm, 0, 0); + } + + /* + * Add the finalized line to dest_to_write and dest_content if it + * wasn't already present inside dest_content + */ + if (strset_add(&dest_content, line.buf)) { + strbuf_addbuf(&dest_to_write, &line); + strbuf_addch(&dest_to_write, '\n'); + } + + strbuf_list_free(parts); + } + + err = ferror(source); + err |= fclose(source); + if (err) + die(_("Could not read '%s' promisor file"), source_promisor_name.buf); + } + + /* If dest_to_write is not empty, then there are new lines to append */ + if (dest_to_write.len) { + if (fseek(dest, 0L, SEEK_END)) + die_errno(_("fseek failed")); + fprintf(dest, "%s", dest_to_write.buf); + } + + err = ferror(dest); + err |= fclose(dest); + if (err) + die(_("Could not write '%s' promisor file"), dest_promisor_name); + + close_pack_index(dest_pack); + free(dest_idx_name); + free(dest_promisor_name); + strset_clear(&dest_content); + strbuf_release(&dest_to_write); + strbuf_release(&source_promisor_name); + strbuf_release(&line); +} + static void finish_repacking_promisor_objects(struct repository *repo, struct child_process *cmd, struct string_list *names,
-- 2.53.0.585.g1533fa96a8