# [PATCH 6/6] is_kept_pack(): final clean-up 17 messages from 2009-02-28 to 2009-03-20. Participants: Junio C Hamano, Kjetil Barvik, Brandon Casey. Thread: https://gitlist.dev/t/18062 ## Junio C Hamano, 2009-02-28 09:15 Subject: [PATCH 0/6] "git repack -a -d" improvements Message-ID: URL: https://gitlist.dev/e/cover.1235812035.git.gitster%40pobox.com In-Reply-To: ``` This is series removes the linear search in "ignore_packed" list when "git repack -a -d" is run to consolidate many packfiles that are not marked to be kept with ".keep". It is oversplit for easier review; in the final form, I think it should be two patch series, 1/6 and the rest. The current mechanism is to pass the name of packfiles that are not marked to be kept with --unpacked= command line option. This list is used to a few internal functions to pretend as if the objects found in named packs exist in loose form and subject to repacking. This look-up is linear and found to be very inefficient. [1/6] is a preparatory and an unrelated bugfix to git-repack script. [2/6] refactors public interface has_sha1_pack() that takes an optional "ignore_packed" list. Most callers pass NULL, so it introduces a new function has_sha1_kept_pack() and migrate the minority caller to this interface while losing the argument from the original function and callers that currently pass NULL. [3/6] temporarily makes the the extra argument to has_sha1_kept_pack() function to pass "ignore_packed" list from a list of char* to a pointer to struct rev_info, solely to make the refactoring done in [4/6] easier to follow. Most of the effects of this patch will be removed at the end. [4/6] identifies three places that use "ignore_packed" list to tell if a pack is on the list or not, and introduces a helper function to do so. The helper is conveniently called is_kept_pack(), even though at this stage the list does not necessarily mean a list of "unkept" packs yet. [5/6] removes --unpacked= parameter, and adds --kept-pack-only option. The sole user of --unpacked=, git-repack, is updated to pass this option instead of listing the "unkept" packfiles on the command line. [6/6] reverts most of the effects of [3/6] made solely for reviewability and removes is_kept_pack() helper function, which now is merely a lookup of a structure member "p->pack_keep". I think we probably could get rid of --honor-pack-keep mechanism after this series, but I didn't look very deeply into it. Junio C Hamano (6): git-repack: resist stray environment variable has_sha1_pack(): refactor "pretend these packs do not exist" interface has_sha1_kept_pack(): take "struct rev_info" Consolidate ignore_packed logic more Simplify is_kept_pack() is_kept_pack(): final clean-up builtin-count-objects.c | 2 +- builtin-fsck.c | 2 +- builtin-pack-objects.c | 14 ++-------- builtin-prune-packed.c | 2 +- cache.h | 4 +- diff.c | 2 +- git-repack.sh | 6 ++++- revision.c | 25 +++++++------------ revision.h | 6 +--- sha1_file.c | 60 ++++++++++++++++++++-------------------------- 10 files changed, 51 insertions(+), 72 deletions(-) ``` ## Junio C Hamano, 2009-02-28 09:15 Subject: [PATCH 1/6] git-repack: resist stray environment variable Message-ID: <2478dc84b5fb2617bfab3a8f65f1270de578b94a.1235812035.git.gitster@pobox.com> URL: https://gitlist.dev/e/2478dc84b5fb2617bfab3a8f65f1270de578b94a.1235812035.git.gitster%40pobox.com In-Reply-To: ``` The script used $args and $existing without initializing it to empty. It would have been confused by an environment variable the end user had before running it. Signed-off-by: Junio C Hamano --- git-repack.sh | 1 + 1 files changed, 1 insertions(+), 0 deletions(-) diff --git a/git-repack.sh b/git-repack.sh index 458a497..8600015 100755 --- a/git-repack.sh +++ b/git-repack.sh @@ -60,6 +60,7 @@ case ",$all_into_one," in args='--unpacked --incremental' ;; ,t,) + args= existing= if [ -d "$PACKDIR" ]; then for e in `cd "$PACKDIR" && find . -type f -name '*.pack' \ | sed -e 's/^\.\///' -e 's/\.pack$//'` -- 1.6.2.rc2.99.g9f3bb ``` ## Junio C Hamano, 2009-02-28 09:15 Subject: [PATCH 2/6] has_sha1_pack(): refactor "pretend these packs do not exist" interface Message-ID: URL: https://gitlist.dev/e/cd673c1f17228d272c4b7f81fbb28bc31cf0cac6.1235812035.git.gitster%40pobox.com In-Reply-To: ``` Most of the callers of this function except only one pass NULL to its last parameter, ignore_packed. Introduce has_sha1_kept_pack() function that has the function signature and the semantics of this function, and convert the sole caller that does not pass NULL to call this new function. All other callers and has_sha1_pack() lose the ignore_packed parameter. Signed-off-by: Junio C Hamano --- builtin-count-objects.c | 2 +- builtin-fsck.c | 2 +- builtin-prune-packed.c | 2 +- cache.h | 3 ++- diff.c | 2 +- revision.c | 3 ++- sha1_file.c | 32 +++++++++++++++++++++++++------- 7 files changed, 33 insertions(+), 13 deletions(-) diff --git a/builtin-count-objects.c b/builtin-count-objects.c index 91b5487..c095e8d 100644 --- a/builtin-count-objects.c +++ b/builtin-count-objects.c @@ -61,7 +61,7 @@ static void count_objects(DIR *d, char *path, int len, int verbose, hex[40] = 0; if (get_sha1_hex(hex, sha1)) die("internal error"); - if (has_sha1_pack(sha1, NULL)) + if (has_sha1_pack(sha1)) (*packed_loose)++; } } diff --git a/builtin-fsck.c b/builtin-fsck.c index 30971ce..491375d 100644 --- a/builtin-fsck.c +++ b/builtin-fsck.c @@ -158,7 +158,7 @@ static void check_reachable_object(struct object *obj) * do a full fsck */ if (!obj->parsed) { - if (has_sha1_pack(obj->sha1, NULL)) + if (has_sha1_pack(obj->sha1)) return; /* it is in pack - forget about it */ printf("missing %s %s\n", typename(obj->type), sha1_to_hex(obj->sha1)); errors_found |= ERROR_REACHABLE; diff --git a/builtin-prune-packed.c b/builtin-prune-packed.c index 10cb8df..2d5b2cd 100644 --- a/builtin-prune-packed.c +++ b/builtin-prune-packed.c @@ -23,7 +23,7 @@ static void prune_dir(int i, DIR *dir, char *pathname, int len, int opts) memcpy(hex+2, de->d_name, 38); if (get_sha1_hex(hex, sha1)) continue; - if (!has_sha1_pack(sha1, NULL)) + if (!has_sha1_pack(sha1)) continue; memcpy(pathname + len, de->d_name, 38); if (opts & DRY_RUN) diff --git a/cache.h b/cache.h index 42f2f27..c1539bf 100644 --- a/cache.h +++ b/cache.h @@ -565,7 +565,8 @@ extern int check_sha1_signature(const unsigned char *sha1, void *buf, unsigned l extern int move_temp_to_file(const char *tmpfile, const char *filename); -extern int has_sha1_pack(const unsigned char *sha1, const char **ignore); +extern int has_sha1_pack(const unsigned char *sha1); +extern int has_sha1_kept_pack(const unsigned char *sha1, const char **ignore); extern int has_sha1_file(const unsigned char *sha1); extern int has_loose_object_nonlocal(const unsigned char *sha1); diff --git a/diff.c b/diff.c index f91f256..a34d26c 100644 --- a/diff.c +++ b/diff.c @@ -1743,7 +1743,7 @@ static int reuse_worktree_file(const char *name, const unsigned char *sha1, int * objects however would tend to be slower as they need * to be individually opened and inflated. */ - if (!FAST_WORKING_DIRECTORY && !want_file && has_sha1_pack(sha1, NULL)) + if (!FAST_WORKING_DIRECTORY && !want_file && has_sha1_pack(sha1)) return 0; len = strlen(name); diff --git a/revision.c b/revision.c index 45fd7a3..746eeed 100644 --- a/revision.c +++ b/revision.c @@ -1485,7 +1485,8 @@ enum commit_action simplify_commit(struct rev_info *revs, struct commit *commit) { if (commit->object.flags & SHOWN) return commit_ignore; - if (revs->unpacked && has_sha1_pack(commit->object.sha1, revs->ignore_packed)) + if (revs->unpacked && + has_sha1_kept_pack(commit->object.sha1, revs->ignore_packed)) return commit_ignore; if (revs->show_all) return commit_show; diff --git a/sha1_file.c b/sha1_file.c index 88035a0..ac4375d 100644 --- a/sha1_file.c +++ b/sha1_file.c @@ -1874,7 +1874,8 @@ int matches_pack_name(struct packed_git *p, const char *name) return 0; } -static int find_pack_entry(const unsigned char *sha1, struct pack_entry *e, const char **ignore_packed) +static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, + const char **ignore_packed) { static struct packed_git *last_found = (void *)1; struct packed_git *p; @@ -1934,6 +1935,17 @@ static int find_pack_entry(const unsigned char *sha1, struct pack_entry *e, cons return 0; } +static int find_pack_entry(const unsigned char *sha1, struct pack_entry *e) +{ + return find_pack_ent(sha1, e, NULL); +} + +static int find_kept_pack_entry(const unsigned char *sha1, struct pack_entry *e, + const char **ignore_packed) +{ + return find_pack_ent(sha1, e, ignore_packed); +} + struct packed_git *find_sha1_pack(const unsigned char *sha1, struct packed_git *packs) { @@ -1975,7 +1987,7 @@ int sha1_object_info(const unsigned char *sha1, unsigned long *sizep) struct pack_entry e; int status; - if (!find_pack_entry(sha1, &e, NULL)) { + if (!find_pack_entry(sha1, &e)) { /* Most likely it's a loose object. */ status = sha1_loose_object_info(sha1, sizep); if (status >= 0) @@ -1983,7 +1995,7 @@ int sha1_object_info(const unsigned char *sha1, unsigned long *sizep) /* Not a loose object; someone else may have just packed it. */ reprepare_packed_git(); - if (!find_pack_entry(sha1, &e, NULL)) + if (!find_pack_entry(sha1, &e)) return status; } return packed_object_info(e.p, e.offset, sizep); @@ -1995,7 +2007,7 @@ static void *read_packed_sha1(const unsigned char *sha1, struct pack_entry e; void *data; - if (!find_pack_entry(sha1, &e, NULL)) + if (!find_pack_entry(sha1, &e)) return NULL; data = cache_or_unpack_entry(e.p, e.offset, size, type, 1); if (!data) { @@ -2395,17 +2407,23 @@ int has_pack_file(const unsigned char *sha1) return 1; } -int has_sha1_pack(const unsigned char *sha1, const char **ignore_packed) +int has_sha1_pack(const unsigned char *sha1) +{ + struct pack_entry e; + return find_pack_entry(sha1, &e); +} + +int has_sha1_kept_pack(const unsigned char *sha1, const char **ignore_packed) { struct pack_entry e; - return find_pack_entry(sha1, &e, ignore_packed); + return find_kept_pack_entry(sha1, &e, ignore_packed); } int has_sha1_file(const unsigned char *sha1) { struct pack_entry e; - if (find_pack_entry(sha1, &e, NULL)) + if (find_pack_entry(sha1, &e)) return 1; return has_loose_object(sha1); } -- 1.6.2.rc2.99.g9f3bb ``` ## Junio C Hamano, 2009-02-28 09:15 Subject: [PATCH 3/6] has_sha1_kept_pack(): take "struct rev_info" Message-ID: URL: https://gitlist.dev/e/b8431b033f9e60f87a75b864612873307a3e5966.1235812035.git.gitster%40pobox.com In-Reply-To: ``` Its "ignore_packed" parameter always comes from struct rev_info. This patch makes the function take a pointer to the surrounding structure, so that the refactoring in the next patch becomes easier to review. There is an unfortunate header file dependency and the easiest workaround is to temporarily move the function declaration from cache.h to revision.h; this will be moved back to cache.h once the function loses this "ignore_packed" parameter altogether in the later part of the series. Signed-off-by: Junio C Hamano --- cache.h | 1 - revision.c | 2 +- revision.h | 2 ++ sha1_file.c | 16 +++++++++------- 4 files changed, 12 insertions(+), 9 deletions(-) diff --git a/cache.h b/cache.h index c1539bf..8e43f38 100644 --- a/cache.h +++ b/cache.h @@ -566,7 +566,6 @@ extern int check_sha1_signature(const unsigned char *sha1, void *buf, unsigned l extern int move_temp_to_file(const char *tmpfile, const char *filename); extern int has_sha1_pack(const unsigned char *sha1); -extern int has_sha1_kept_pack(const unsigned char *sha1, const char **ignore); extern int has_sha1_file(const unsigned char *sha1); extern int has_loose_object_nonlocal(const unsigned char *sha1); diff --git a/revision.c b/revision.c index 746eeed..795e0c0 100644 --- a/revision.c +++ b/revision.c @@ -1486,7 +1486,7 @@ enum commit_action simplify_commit(struct rev_info *revs, struct commit *commit) if (commit->object.flags & SHOWN) return commit_ignore; if (revs->unpacked && - has_sha1_kept_pack(commit->object.sha1, revs->ignore_packed)) + has_sha1_kept_pack(commit->object.sha1, revs)) return commit_ignore; if (revs->show_all) return commit_show; diff --git a/revision.h b/revision.h index 91f1944..9304296 100644 --- a/revision.h +++ b/revision.h @@ -158,4 +158,6 @@ enum commit_action { extern enum commit_action simplify_commit(struct rev_info *revs, struct commit *commit); +extern int has_sha1_kept_pack(const unsigned char *sha1, const struct rev_info *); + #endif diff --git a/sha1_file.c b/sha1_file.c index ac4375d..f963c3c 100644 --- a/sha1_file.c +++ b/sha1_file.c @@ -16,6 +16,8 @@ #include "refs.h" #include "pack-revindex.h" #include "sha1-lookup.h" +#include "diff.h" +#include "revision.h" #ifndef O_NOATIME #if defined(__linux__) && (defined(__i386__) || defined(__PPC__)) @@ -1875,7 +1877,7 @@ int matches_pack_name(struct packed_git *p, const char *name) } static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, - const char **ignore_packed) + const struct rev_info *revs) { static struct packed_git *last_found = (void *)1; struct packed_git *p; @@ -1887,9 +1889,9 @@ static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, p = (last_found == (void *)1) ? packed_git : last_found; do { - if (ignore_packed) { + if (revs->ignore_packed) { const char **ig; - for (ig = ignore_packed; *ig; ig++) + for (ig = revs->ignore_packed; *ig; ig++) if (matches_pack_name(p, *ig)) break; if (*ig) @@ -1941,9 +1943,9 @@ static int find_pack_entry(const unsigned char *sha1, struct pack_entry *e) } static int find_kept_pack_entry(const unsigned char *sha1, struct pack_entry *e, - const char **ignore_packed) + const struct rev_info *revs) { - return find_pack_ent(sha1, e, ignore_packed); + return find_pack_ent(sha1, e, revs); } struct packed_git *find_sha1_pack(const unsigned char *sha1, @@ -2413,10 +2415,10 @@ int has_sha1_pack(const unsigned char *sha1) return find_pack_entry(sha1, &e); } -int has_sha1_kept_pack(const unsigned char *sha1, const char **ignore_packed) +int has_sha1_kept_pack(const unsigned char *sha1, const struct rev_info *revs) { struct pack_entry e; - return find_kept_pack_entry(sha1, &e, ignore_packed); + return find_kept_pack_entry(sha1, &e, revs); } int has_sha1_file(const unsigned char *sha1) -- 1.6.2.rc2.99.g9f3bb ``` ## Junio C Hamano, 2009-02-28 09:15 Subject: [PATCH 4/6] Consolidate ignore_packed logic more Message-ID: <386cb77210cdb09cd808698d21d0e796cd77f26f.1235812035.git.gitster@pobox.com> URL: https://gitlist.dev/e/386cb77210cdb09cd808698d21d0e796cd77f26f.1235812035.git.gitster%40pobox.com In-Reply-To: ``` This refactors three loops that check if a given packfile is on the ignore_packed list into a function is_kept_pack(). The function returns false for a pack on the list, and true for a pack not on the list, because this list is solely used by "git repack" to pass list of packfiles that do not have corresponding .keep files, i.e. a packfile not on the list is "kept". Signed-off-by: Junio C Hamano --- builtin-pack-objects.c | 12 ++---------- cache.h | 1 - revision.h | 1 + sha1_file.c | 24 ++++++++++++++---------- 4 files changed, 17 insertions(+), 21 deletions(-) diff --git a/builtin-pack-objects.c b/builtin-pack-objects.c index fb5e14d..7e7719b 100644 --- a/builtin-pack-objects.c +++ b/builtin-pack-objects.c @@ -1915,11 +1915,7 @@ static void add_objects_in_unpacked_packs(struct rev_info *revs) const unsigned char *sha1; struct object *o; - for (i = 0; i < revs->num_ignore_packed; i++) { - if (matches_pack_name(p, revs->ignore_packed[i])) - break; - } - if (revs->num_ignore_packed <= i) + if (is_kept_pack(p, revs)) continue; if (open_pack_index(p)) die("cannot open pack index"); @@ -1955,11 +1951,7 @@ static void loosen_unused_packed_objects(struct rev_info *revs) const unsigned char *sha1; for (p = packed_git; p; p = p->next) { - for (i = 0; i < revs->num_ignore_packed; i++) { - if (matches_pack_name(p, revs->ignore_packed[i])) - break; - } - if (revs->num_ignore_packed <= i) + if (is_kept_pack(p, revs)) continue; if (open_pack_index(p)) diff --git a/cache.h b/cache.h index 8e43f38..23c16d0 100644 --- a/cache.h +++ b/cache.h @@ -747,7 +747,6 @@ extern void *unpack_entry(struct packed_git *, off_t, enum object_type *, unsign extern unsigned long unpack_object_header_gently(const unsigned char *buf, unsigned long len, enum object_type *type, unsigned long *sizep); extern unsigned long get_size_from_delta(struct packed_git *, struct pack_window **, off_t); extern const char *packed_object_info_detail(struct packed_git *, off_t, unsigned long *, unsigned long *, unsigned int *, unsigned char *); -extern int matches_pack_name(struct packed_git *p, const char *name); /* Dumb servers support */ extern int update_server_info(int); diff --git a/revision.h b/revision.h index 9304296..af414e5 100644 --- a/revision.h +++ b/revision.h @@ -159,5 +159,6 @@ enum commit_action { extern enum commit_action simplify_commit(struct rev_info *revs, struct commit *commit); extern int has_sha1_kept_pack(const unsigned char *sha1, const struct rev_info *); +extern int is_kept_pack(const struct packed_git *, const struct rev_info *); #endif diff --git a/sha1_file.c b/sha1_file.c index f963c3c..6e0a462 100644 --- a/sha1_file.c +++ b/sha1_file.c @@ -1858,7 +1858,7 @@ off_t find_pack_entry_one(const unsigned char *sha1, return 0; } -int matches_pack_name(struct packed_git *p, const char *name) +static int matches_pack_name(const struct packed_git *p, const char *name) { const char *last_c, *c; @@ -1876,6 +1876,17 @@ int matches_pack_name(struct packed_git *p, const char *name) return 0; } +int is_kept_pack(const struct packed_git *p, const struct rev_info *revs) +{ + int i; + + for (i = 0; i < revs->num_ignore_packed; i++) { + if (matches_pack_name(p, revs->ignore_packed[i])) + return 0; + } + return 1; +} + static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, const struct rev_info *revs) { @@ -1889,15 +1900,8 @@ static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, p = (last_found == (void *)1) ? packed_git : last_found; do { - if (revs->ignore_packed) { - const char **ig; - for (ig = revs->ignore_packed; *ig; ig++) - if (matches_pack_name(p, *ig)) - break; - if (*ig) - goto next; - } - + if (revs->ignore_packed && !is_kept_pack(p, revs)) + goto next; if (p->num_bad_objects) { unsigned i; for (i = 0; i < p->num_bad_objects; i++) -- 1.6.2.rc2.99.g9f3bb ``` ## Junio C Hamano, 2009-02-28 09:15 Subject: [PATCH 5/6] Simplify is_kept_pack() Message-ID: <03a9683d22eca52bc2b2b9b09258a143e76416f6.1235812035.git.gitster@pobox.com> URL: https://gitlist.dev/e/03a9683d22eca52bc2b2b9b09258a143e76416f6.1235812035.git.gitster%40pobox.com In-Reply-To: ``` This removes --unpacked= parameter from the revision parser, and rewrites its use in git-repack to pass a single --kept-pack-only option instead. The new --kept-pack-only option means just that. When this option is given, is_kept_pack() that used to say "not on the --unpacked= list" now says "the packfile has corresponding .keep file". Signed-off-by: Junio C Hamano --- builtin-pack-objects.c | 6 +++--- git-repack.sh | 5 ++++- revision.c | 20 +++++--------------- revision.h | 8 +++----- sha1_file.c | 30 +++--------------------------- 5 files changed, 18 insertions(+), 51 deletions(-) diff --git a/builtin-pack-objects.c b/builtin-pack-objects.c index 7e7719b..150258b 100644 --- a/builtin-pack-objects.c +++ b/builtin-pack-objects.c @@ -1915,7 +1915,7 @@ static void add_objects_in_unpacked_packs(struct rev_info *revs) const unsigned char *sha1; struct object *o; - if (is_kept_pack(p, revs)) + if (is_kept_pack(p)) continue; if (open_pack_index(p)) die("cannot open pack index"); @@ -1951,7 +1951,7 @@ static void loosen_unused_packed_objects(struct rev_info *revs) const unsigned char *sha1; for (p = packed_git; p; p = p->next) { - if (is_kept_pack(p, revs)) + if (is_kept_pack(p)) continue; if (open_pack_index(p)) @@ -2149,7 +2149,7 @@ int cmd_pack_objects(int argc, const char **argv, const char *prefix) continue; } if (!strcmp("--unpacked", arg) || - !prefixcmp(arg, "--unpacked=") || + !strcmp("--kept-pack-only", arg) || !strcmp("--reflog", arg) || !strcmp("--all", arg)) { use_internal_rev_list = 1; diff --git a/git-repack.sh b/git-repack.sh index 8600015..a736009 100755 --- a/git-repack.sh +++ b/git-repack.sh @@ -68,10 +68,13 @@ case ",$all_into_one," in if [ -e "$PACKDIR/$e.keep" ]; then : keep else - args="$args --unpacked=$e.pack" existing="$existing $e" fi done + if test -n "$existing" + then + args="--kept-pack-only" + fi if test -n "$args" -a -n "$unpack_unreachable" -a \ -n "$remove_redundant" then diff --git a/revision.c b/revision.c index 795e0c0..3cfd653 100644 --- a/revision.c +++ b/revision.c @@ -963,16 +963,6 @@ static void add_message_grep(struct rev_info *revs, const char *pattern) add_grep(revs, pattern, GREP_PATTERN_BODY); } -static void add_ignore_packed(struct rev_info *revs, const char *name) -{ - int num = ++revs->num_ignore_packed; - - revs->ignore_packed = xrealloc(revs->ignore_packed, - sizeof(const char *) * (num + 1)); - revs->ignore_packed[num-1] = name; - revs->ignore_packed[num] = NULL; -} - static int handle_revision_opt(struct rev_info *revs, int argc, const char **argv, int *unkc, const char **unkv) { @@ -1072,12 +1062,12 @@ static int handle_revision_opt(struct rev_info *revs, int argc, const char **arg revs->edge_hint = 1; } else if (!strcmp(arg, "--unpacked")) { revs->unpacked = 1; - free(revs->ignore_packed); - revs->ignore_packed = NULL; - revs->num_ignore_packed = 0; - } else if (!prefixcmp(arg, "--unpacked=")) { + revs->kept_pack_only = 0; + } else if (!strcmp(arg, "--kept-pack-only")) { revs->unpacked = 1; - add_ignore_packed(revs, arg+11); + revs->kept_pack_only = 1; + } else if (!prefixcmp(arg, "--unpacked=")) { + die("--unpacked= no longer supported."); } else if (!strcmp(arg, "-r")) { revs->diff = 1; DIFF_OPT_SET(&revs->diffopt, RECURSIVE); diff --git a/revision.h b/revision.h index af414e5..f63596f 100644 --- a/revision.h +++ b/revision.h @@ -47,7 +47,8 @@ struct rev_info { blob_objects:1, edge_hint:1, limited:1, - unpacked:1, /* see also ignore_packed below */ + unpacked:1, + kept_pack_only:1, boundary:2, left_right:1, rewrite_parents:1, @@ -75,9 +76,6 @@ struct rev_info { missing_newline:1; enum date_mode date_mode; - const char **ignore_packed; /* pretend objects in these are unpacked */ - int num_ignore_packed; - unsigned int abbrev; enum cmit_fmt commit_format; struct log_info *loginfo; @@ -159,6 +157,6 @@ enum commit_action { extern enum commit_action simplify_commit(struct rev_info *revs, struct commit *commit); extern int has_sha1_kept_pack(const unsigned char *sha1, const struct rev_info *); -extern int is_kept_pack(const struct packed_git *, const struct rev_info *); +extern int is_kept_pack(const struct packed_git *); #endif diff --git a/sha1_file.c b/sha1_file.c index 6e0a462..e8a9517 100644 --- a/sha1_file.c +++ b/sha1_file.c @@ -1858,33 +1858,9 @@ off_t find_pack_entry_one(const unsigned char *sha1, return 0; } -static int matches_pack_name(const struct packed_git *p, const char *name) +int is_kept_pack(const struct packed_git *p) { - const char *last_c, *c; - - if (!strcmp(p->pack_name, name)) - return 1; - - for (c = p->pack_name, last_c = c; *c;) - if (*c == '/') - last_c = ++c; - else - ++c; - if (!strcmp(last_c, name)) - return 1; - - return 0; -} - -int is_kept_pack(const struct packed_git *p, const struct rev_info *revs) -{ - int i; - - for (i = 0; i < revs->num_ignore_packed; i++) { - if (matches_pack_name(p, revs->ignore_packed[i])) - return 0; - } - return 1; + return p->pack_keep; } static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, @@ -1900,7 +1876,7 @@ static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, p = (last_found == (void *)1) ? packed_git : last_found; do { - if (revs->ignore_packed && !is_kept_pack(p, revs)) + if (revs->kept_pack_only && !is_kept_pack(p)) goto next; if (p->num_bad_objects) { unsigned i; -- 1.6.2.rc2.99.g9f3bb ``` ## Junio C Hamano, 2009-02-28 09:15 Subject: [PATCH 6/6] is_kept_pack(): final clean-up Message-ID: <69e020ae00ebd3f7ae3c2f35acb139361417ef64.1235812035.git.gitster@pobox.com> URL: https://gitlist.dev/e/69e020ae00ebd3f7ae3c2f35acb139361417ef64.1235812035.git.gitster%40pobox.com In-Reply-To: ``` Now is_kept_pack() is just a member lookup into a structure, we can write it as such. Also rewrite the sole caller of has_sha1_kept_pack() to switch on the criteria the callee uses (namely, revs->kept_pack_only) between calling has_sha1_kept_pack() and has_sha1_pack(), so that these two callees do not have to take a pointer to struct rev_info as an argument. This removes the header file dependency issue temporarily introduced by the earlier commit, so we revert changes associated to that as well. Signed-off-by: Junio C Hamano --- builtin-pack-objects.c | 4 ++-- cache.h | 1 + revision.c | 4 +++- revision.h | 3 --- sha1_file.c | 22 +++++++--------------- 5 files changed, 13 insertions(+), 21 deletions(-) diff --git a/builtin-pack-objects.c b/builtin-pack-objects.c index 150258b..b2e4626 100644 --- a/builtin-pack-objects.c +++ b/builtin-pack-objects.c @@ -1915,7 +1915,7 @@ static void add_objects_in_unpacked_packs(struct rev_info *revs) const unsigned char *sha1; struct object *o; - if (is_kept_pack(p)) + if (p->pack_keep) continue; if (open_pack_index(p)) die("cannot open pack index"); @@ -1951,7 +1951,7 @@ static void loosen_unused_packed_objects(struct rev_info *revs) const unsigned char *sha1; for (p = packed_git; p; p = p->next) { - if (is_kept_pack(p)) + if (p->pack_keep) continue; if (open_pack_index(p)) diff --git a/cache.h b/cache.h index 23c16d0..0a3d523 100644 --- a/cache.h +++ b/cache.h @@ -566,6 +566,7 @@ extern int check_sha1_signature(const unsigned char *sha1, void *buf, unsigned l extern int move_temp_to_file(const char *tmpfile, const char *filename); extern int has_sha1_pack(const unsigned char *sha1); +extern int has_sha1_kept_pack(const unsigned char *sha1); extern int has_sha1_file(const unsigned char *sha1); extern int has_loose_object_nonlocal(const unsigned char *sha1); diff --git a/revision.c b/revision.c index 3cfd653..6d8ac46 100644 --- a/revision.c +++ b/revision.c @@ -1476,7 +1476,9 @@ enum commit_action simplify_commit(struct rev_info *revs, struct commit *commit) if (commit->object.flags & SHOWN) return commit_ignore; if (revs->unpacked && - has_sha1_kept_pack(commit->object.sha1, revs)) + (revs->kept_pack_only + ? has_sha1_kept_pack(commit->object.sha1) + : has_sha1_pack(commit->object.sha1))) return commit_ignore; if (revs->show_all) return commit_show; diff --git a/revision.h b/revision.h index f63596f..b9fa9c2 100644 --- a/revision.h +++ b/revision.h @@ -156,7 +156,4 @@ enum commit_action { extern enum commit_action simplify_commit(struct rev_info *revs, struct commit *commit); -extern int has_sha1_kept_pack(const unsigned char *sha1, const struct rev_info *); -extern int is_kept_pack(const struct packed_git *); - #endif diff --git a/sha1_file.c b/sha1_file.c index e8a9517..7ead56c 100644 --- a/sha1_file.c +++ b/sha1_file.c @@ -16,8 +16,6 @@ #include "refs.h" #include "pack-revindex.h" #include "sha1-lookup.h" -#include "diff.h" -#include "revision.h" #ifndef O_NOATIME #if defined(__linux__) && (defined(__i386__) || defined(__PPC__)) @@ -1858,13 +1856,8 @@ off_t find_pack_entry_one(const unsigned char *sha1, return 0; } -int is_kept_pack(const struct packed_git *p) -{ - return p->pack_keep; -} - static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, - const struct rev_info *revs) + int kept_pack_only) { static struct packed_git *last_found = (void *)1; struct packed_git *p; @@ -1876,7 +1869,7 @@ static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, p = (last_found == (void *)1) ? packed_git : last_found; do { - if (revs->kept_pack_only && !is_kept_pack(p)) + if (kept_pack_only && !p->pack_keep) goto next; if (p->num_bad_objects) { unsigned i; @@ -1919,13 +1912,12 @@ static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, static int find_pack_entry(const unsigned char *sha1, struct pack_entry *e) { - return find_pack_ent(sha1, e, NULL); + return find_pack_ent(sha1, e, 0); } -static int find_kept_pack_entry(const unsigned char *sha1, struct pack_entry *e, - const struct rev_info *revs) +static int find_kept_pack_entry(const unsigned char *sha1, struct pack_entry *e) { - return find_pack_ent(sha1, e, revs); + return find_pack_ent(sha1, e, 1); } struct packed_git *find_sha1_pack(const unsigned char *sha1, @@ -2395,10 +2387,10 @@ int has_sha1_pack(const unsigned char *sha1) return find_pack_entry(sha1, &e); } -int has_sha1_kept_pack(const unsigned char *sha1, const struct rev_info *revs) +int has_sha1_kept_pack(const unsigned char *sha1) { struct pack_entry e; - return find_kept_pack_entry(sha1, &e, revs); + return find_kept_pack_entry(sha1, &e); } int has_sha1_file(const unsigned char *sha1) -- 1.6.2.rc2.99.g9f3bb ``` ## Kjetil Barvik, 2009-02-28 12:29 Subject: Re: [PATCH 0/6] "git repack -a -d" improvements Message-ID: <8663iuwxrb.fsf@broadpark.no> URL: https://gitlist.dev/e/8663iuwxrb.fsf%40broadpark.no In-Reply-To: ``` * Junio C Hamano writes: | [2/6] refactors public interface has_sha1_pack() that takes an optional | "ignore_packed" list. Most callers pass NULL, so it introduces a new | function has_sha1_kept_pack() and migrate the minority caller to this | interface while losing the argument from the original function and callers | that currently pass NULL. [...] | [4/6] identifies three places that use "ignore_packed" list to tell if a | pack is on the list or not, and introduces a helper function to do so. | The helper is conveniently called is_kept_pack(), even though at this | stage the list does not necessarily mean a list of "unkept" packs yet. OK, patch 2/6 failed for me when I was doing 'git am' to import the patch-series, so sorry if do not see all bits of the patch correctly. Would it be an improvment to change the signature of the currently find_sha1_pack() function to: struct packed_git * find_pack_entry(const unsigned char *sha1, off_t *sha1_pack_offset, struct packed_git *packs) - The currently existing 'struct pack_entry *e' parameter is only used to retrn the offset, so make it more clear. The struct pack_entry can probably be deleted from the sha1_file.c file. - When the 'git repack -a -d' command is used, one has to compute the list of allowed pack-files to look into, and give this list to find_pack_entry(). - The currently named find_sha1_pack() function can then be deleted. - For example, when this function is now used in sha1_object_info() it can be called like this: found_pack = find_pack_entry(sha1, &offset, packed_git); -- kjetil ``` ## Junio C Hamano, 2009-02-28 17:41 Subject: Re: [PATCH 0/6] "git repack -a -d" improvements Message-ID: <7vfxhyfohx.fsf@gitster.siamese.dyndns.org> URL: https://gitlist.dev/e/7vfxhyfohx.fsf%40gitster.siamese.dyndns.org In-Reply-To: <8663iuwxrb.fsf@broadpark.no> ``` Kjetil Barvik writes: > OK, patch 2/6 failed for me when I was doing 'git am' to import the > patch-series, so sorry if do not see all bits of the patch correctly. Ah, I should have mentioned that the series was meant to apply to v1.6.0.6 (and merged upwards). I am off to dentist so I won't have time to think about below until I get back. > Would it be an improvment to change the signature of the currently > find_sha1_pack() function to: > > struct packed_git * > find_pack_entry(const unsigned char *sha1, off_t *sha1_pack_offset, > struct packed_git *packs) > > - The currently existing 'struct pack_entry *e' parameter is only > used to retrn the offset, so make it more clear. The struct > pack_entry can probably be deleted from the sha1_file.c file. > > - When the 'git repack -a -d' command is used, one has to compute > the list of allowed pack-files to look into, and give this list to > find_pack_entry(). > > - The currently named find_sha1_pack() function can then be deleted. > > - For example, when this function is now used in sha1_object_info() > it can be called like this: > > found_pack = find_pack_entry(sha1, &offset, packed_git); > > -- kjetil ``` ## Brandon Casey, 2009-03-18 20:59 Subject: Re: [PATCH] t7700-repack: repack -a now works properly, expect success from test Message-ID: URL: https://gitlist.dev/e/EblkEXbcYUWby1OEDup9n0l6lbwNL-4-jyt02Cjab2pqLqekAUji0w%40cipher.nrlssc.navy.mil In-Reply-To: <7Vazs5mFk91IKAarOd0wrBNmYj7eSJxVIcR0PEQxJl8R0aQmQDEqSJMphMrXhmVu570fijupQ34@cipher.nrlssc.navy.mil> ``` Brandon Casey wrote: > Since Junio's keep-pack series was merged in at aec81306, git-repack now > properly packs objects from alternate repositories even when the local > repository contains packs. > > Signed-off-by: Brandon Casey > --- > > > Well, I finally got some time last week to take a look at this issue, and > what do I find, but you've already fixed it. Did you even realize? :) > > > I was too busy to notice the emails on the subject last month... > > http://article.gmane.org/gmane.comp.version-control.git/111758 > > Junio C Hamano wrote: >> I think we probably could get rid of --honor-pack-keep mechanism after >> this series, but I didn't look very deeply into it. > > This makes sense, but doesn't seem to be working. Possibly the way > --kept-pack-only is implemented, it only deals with commits. So if the > commit object is _not_ in a kept pack, but the trees and/or blobs that it > references _are_, then both the commit and the trees/blobs will be added to > the list of objects to pack even though the trees/blobs should not be. > > The test in t7700 is contrived, and creates two pack files; one marked with > .keep which contains a single blob object that is missing from the other. > Then the test repacks and checks whether the blob object was placed into the > new pack. The --honor-pack-keep mechanism handles this case since it works > on the back end and checks whether each object that is added to the objects > list exists in a kept pack, and skips it if so. > > Disclaimer: I have not taken the time to fully understand revision.c Hmm, I think there are a couple of new issues. 1) The --kept-pack-only mechanism does not operate solely on "local" packs now. This means that objects residing in an alternate pack which has a .keep file will not be repacked with repack -a. My current opinion is that .keep files in an alternate object database should not be honored since the user may not have any control over them. This seems to be in line with your statement about this feature affecting locally existing packs from the Release Notes: git-gc spent excessive amount of time to decide if an object appears in a locally existing pack 2) The 'repack unpacked objects' and 'loosen unpacked objects' mechanisms now do not operate solely on local packs. I think this means that objects residing in alternate not-kept packs will be repacked when '-A -d' is used, and will be loosened when '-a -d' is used. I have a test for #1 above. I'll think about a test for #2. I wonder if we'll ever be interested in non-local keep files? If not, then why not set pack_keep _only_ for local packs? diff --git a/sha1_file.c b/sha1_file.c index 4563173..a595eac 100644 --- a/sha1_file.c +++ b/sha1_file.c @@ -881,9 +881,11 @@ struct packed_git *add_packed_git(const char *path, int pat } memcpy(p->pack_name, path, path_len); - strcpy(p->pack_name + path_len, ".keep"); - if (!access(p->pack_name, F_OK)) - p->pack_keep = 1; + if (local) { + strcpy(p->pack_name + path_len, ".keep"); + if (!access(p->pack_name, F_OK)) + p->pack_keep = 1; + } strcpy(p->pack_name + path_len, ".pack"); if (stat(p->pack_name, &st) || !S_ISREG(st.st_mode)) { I'd also change the name from pack_keep to something that identivies it as local. The alternative would require that find_pack_ent() differentiate between local kept packs and alternate kept packs. -brandon ``` ## Brandon Casey, 2009-03-20 03:47 Subject: [PATCH 0/5] repack improvements Message-ID: URL: https://gitlist.dev/e/t_s5aa51o2kq_ePRWgLTEkVg4HqH1dQa6_mVq4djPPG4Vxylm2hNqmx7fPC2W5AsfcXg83DYbGc%40cipher.nrlssc.navy.mil In-Reply-To: ``` As I mentioned in a previous email, the recent changes to pack-objects/rev-list partially fixed one repacking flaw, but introduced 2 others. There were actually two emails, but the first one never made it to the list. There existed a flaw that prevented repack from properly repacking objects contained in packs from alternate repositories if the local repository contained any non-kept packs. This was fixed by the --kept-pack-only feature, in exchange for not being able to pack objects contained in alternate packs which had a keep file. Since the user may not have control over the referenced object database, I think it is fair not to the honor the keep files in that case. Additionally, if repack told pack-objects to loosen unreferenced objects, it would even loosen objects residing in alternate packs. They would then be immediately deleted by the call to prune-packed though. The solution I chose is actually to fall back to the --honor-pack-keep option and to stop using the --kept-pack-only option. pack-objects already iterates over every object added for packing and searches the pack array to check whether it is already packed, so for the case where no keep files are used, there is actually one less iteration through the pack array for each commit. But one more (?) for each object referenced by a commit that is packed in a pack with a .keep file. So this keeps the local and keep_pack decision making in pack-objects. The other way would be to move the --local option over into rev-list and teach the pack lookup machinery to differentiate between local and non-local packs. Not sure which is better, but this was easier. I think there is still one case where an object will be loosened unnecessarily. If an unreferenced object exists in a local pack _and_ in an alternate object database, then I believe it will be loosened and then pruned. To fix it, loosen_unused_packed_objects and add_objects_in_unpacked_packs would have to iterate through the non-local packs to check whether they contained the object before loosening/repacking it. Probably won't happen often in practice though. Also, I think the --kept-pack-only option is now not necessary. The last patch removes the --kept-pack-only feature /ducks and can be dropped if you think this feature may be useful in the future. Brandon Casey (5): t7700-repack: add two new tests demonstrating repacking flaws git-repack.sh: don't use --kept-pack-only option to pack-objects pack-objects: only repack or loosen objects residing in "local" packs t7700-repack: repack -a now works properly, expect success from test Remove --kept-pack-only option and associated infrastructure builtin-pack-objects.c | 5 ++--- cache.h | 1 - git-repack.sh | 6 +----- revision.c | 9 +-------- revision.h | 1 - sha1_file.c | 21 +-------------------- t/t7700-repack.sh | 46 +++++++++++++++++++++++++++++++++++++++++++++- 7 files changed, 50 insertions(+), 39 deletions(-) ``` ## Brandon Casey, 2009-03-20 03:47 Subject: [PATCH 1/5] t7700-repack: add two new tests demonstrating repacking flaws Message-ID: URL: https://gitlist.dev/e/t_s5aa51o2kq_ePRWgLTEpak5ue1ZM7YICzIF-RsnmN68psiOC0Tnz9bsH5tTxgVEU0bxG-OtJ8%40cipher.nrlssc.navy.mil In-Reply-To: ``` 1) The new --kept-pack-only mechansim of rev-list/pack-objects has replaced --unpacked=. This new mechansim does not operate solely on "local" packs now. The result is that objects residing in an alternate pack which has a .keep file will not be repacked with repack -a. This flaw is only apparent when a commit object is the one residing in an alternate kept pack. 2) The 'repack unpacked objects' and 'loosen unpacked objects' mechanisms of pack-objects, i.e. --keep-unreachable and --unpack-unreachable, now do not operate solely on local packs. The --keep-unreachable option no longer has any callers, but --unpack-unreachable is used when repack is called with '-A -d' and the local repo has existing packs. In this case, objects residing in alternate, not-kept packs will be loosened, and then immediately deleted by repack's call to prune-packed. The test must manually call pack-objects to avoid the call to prune-packed that is made by repack when -d is used. --- t/t7700-repack.sh | 44 ++++++++++++++++++++++++++++++++++++++++++++ 1 files changed, 44 insertions(+), 0 deletions(-) diff --git a/t/t7700-repack.sh b/t/t7700-repack.sh index f5682d6..e869995 100755 --- a/t/t7700-repack.sh +++ b/t/t7700-repack.sh @@ -88,5 +88,49 @@ test_expect_failure 'packed obs in alt ODB are repacked when local repo has pack done ' +test_expect_failure 'packed obs in alternate ODB kept pack are repacked' ' + # swap the .keep so the commit object is in the pack with .keep + for p in alt_objects/pack/*.pack + do + base_name=$(basename $p .pack) + if test -f alt_objects/pack/$base_name.keep + then + rm alt_objects/pack/$base_name.keep + else + touch alt_objects/pack/$base_name.keep + fi + done + git repack -a -d && + myidx=$(ls -1 .git/objects/pack/*.idx) && + test -f "$myidx" && + for p in alt_objects/pack/*.idx; do + git verify-pack -v $p | sed -n -e "/^[0-9a-f]\{40\}/p" + done | while read sha1 rest; do + if ! ( git verify-pack -v $myidx | grep "^$sha1" ); then + echo "Missing object in local pack: $sha1" + return 1 + fi + done +' + +test_expect_failure 'packed unreachable obs in alternate ODB are not loosened' ' + rm -f alt_objects/pack/*.keep && + mv .git/objects/pack/* alt_objects/pack/ && + csha1=$(git rev-parse HEAD^{commit}) && + git reset --hard HEAD^ && + sleep 1 && + git reflog expire --expire=now --expire-unreachable=now --all && + # The pack-objects call on the next line is equivalent to + # git repack -A -d without the call to prune-packed + git pack-objects --honor-pack-keep --non-empty --all --reflog \ + --unpack-unreachable .git/objects/info/alternates && + test_must_fail git show $csha1 +' + test_done -- 1.6.2.16.geb16e ``` ## Brandon Casey, 2009-03-20 03:47 Subject: [PATCH 2/5] git-repack.sh: don't use --kept-pack-only option to pack-objects Message-ID: URL: https://gitlist.dev/e/t_s5aa51o2kq_ePRWgLTEg6KbvKii55gDA1y-1oKgx9KP4EKyrqg8sDFaph97G5MPoLgUx_vx48%40cipher.nrlssc.navy.mil In-Reply-To: ``` The --kept-pack-only option to pack-objects treats all kept packs as equal. This results in objects that reside in an alternate pack that has a .keep file, not being packed into a newly created pack when the user specifies the -a option to repack. Since the user may not have any control over the alternate database, git should not refrain from repacking those objects even though they are in a pack with a .keep file. This fixes the 'packed obs in alternate ODB kept pack are repacked' test in t7700. --- git-repack.sh | 6 +----- t/t7700-repack.sh | 2 +- 2 files changed, 2 insertions(+), 6 deletions(-) diff --git a/git-repack.sh b/git-repack.sh index 0144c2d..1782a23 100755 --- a/git-repack.sh +++ b/git-repack.sh @@ -71,11 +71,7 @@ case ",$all_into_one," in existing="$existing $e" fi done - if test -n "$existing" - then - args="--kept-pack-only" - fi - if test -n "$args" -a -n "$unpack_unreachable" -a \ + if test -n "$existing" -a -n "$unpack_unreachable" -a \ -n "$remove_redundant" then args="$args $unpack_unreachable" diff --git a/t/t7700-repack.sh b/t/t7700-repack.sh index e869995..1242c9d 100755 --- a/t/t7700-repack.sh +++ b/t/t7700-repack.sh @@ -88,7 +88,7 @@ test_expect_failure 'packed obs in alt ODB are repacked when local repo has pack done ' -test_expect_failure 'packed obs in alternate ODB kept pack are repacked' ' +test_expect_success 'packed obs in alternate ODB kept pack are repacked' ' # swap the .keep so the commit object is in the pack with .keep for p in alt_objects/pack/*.pack do -- 1.6.2.16.geb16e ``` ## Brandon Casey, 2009-03-20 03:47 Subject: [PATCH 3/5] pack-objects: only repack or loosen objects residing in "local" packs Message-ID: URL: https://gitlist.dev/e/t_s5aa51o2kq_ePRWgLTEvwR8O51ATzGH2_NEfAeCgOx3i1IYGfgLg3-dTPOh68RhaeQgBB9s2g%40cipher.nrlssc.navy.mil In-Reply-To: ``` These two features were invented for use by repack when repack will delete the local packs that have been made redundant. The packs accessible through alternates are not deleted by repack, so the objects contained in them are still accessible after the local packs are deleted. They do not need to be repacked into the new pack or loosened. For the case of loosening they would immediately be deleted by the subsequent prune-packed that is called by repack anyway. This fixes the test 'packed unreachable obs in alternate ODB are not loosened' in t7700. --- builtin-pack-objects.c | 4 ++-- t/t7700-repack.sh | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/builtin-pack-objects.c b/builtin-pack-objects.c index 1c6d2c4..22d69ef 100644 --- a/builtin-pack-objects.c +++ b/builtin-pack-objects.c @@ -1966,7 +1966,7 @@ static void add_objects_in_unpacked_packs(struct rev_info *revs) const unsigned char *sha1; struct object *o; - if (p->pack_keep) + if (!p->pack_local || p->pack_keep) continue; if (open_pack_index(p)) die("cannot open pack index"); @@ -2002,7 +2002,7 @@ static void loosen_unused_packed_objects(struct rev_info *revs) const unsigned char *sha1; for (p = packed_git; p; p = p->next) { - if (p->pack_keep) + if (!p->pack_local || p->pack_keep) continue; if (open_pack_index(p)) diff --git a/t/t7700-repack.sh b/t/t7700-repack.sh index 1242c9d..31e6d22 100755 --- a/t/t7700-repack.sh +++ b/t/t7700-repack.sh @@ -113,7 +113,7 @@ test_expect_success 'packed obs in alternate ODB kept pack are repacked' ' done ' -test_expect_failure 'packed unreachable obs in alternate ODB are not loosened' ' +test_expect_success 'packed unreachable obs in alternate ODB are not loosened' ' rm -f alt_objects/pack/*.keep && mv .git/objects/pack/* alt_objects/pack/ && csha1=$(git rev-parse HEAD^{commit}) && -- 1.6.2.16.geb16e ``` ## Brandon Casey, 2009-03-20 03:47 Subject: [PATCH 4/5] t7700-repack: repack -a now works properly, expect success from test Message-ID: URL: https://gitlist.dev/e/t_s5aa51o2kq_ePRWgLTEtCnzveAKdblNoXw2p9yc1N22fpuARDjOh9wRXpwEKvultyJoNzUWBY%40cipher.nrlssc.navy.mil In-Reply-To: ``` Thanks to Junio's rework of the --unpacked= option of pack-objects/rev-list git-repack now properly packs objects from alternate repositories even when the local repository contains packs. --- t/t7700-repack.sh | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/t/t7700-repack.sh b/t/t7700-repack.sh index 31e6d22..28fc87a 100755 --- a/t/t7700-repack.sh +++ b/t/t7700-repack.sh @@ -69,7 +69,7 @@ test_expect_success 'packed obs in alt ODB are repacked even when local repo is done ' -test_expect_failure 'packed obs in alt ODB are repacked when local repo has packs' ' +test_expect_success 'packed obs in alt ODB are repacked when local repo has packs' ' rm -f .git/objects/pack/* && echo new_content >> file1 && git add file1 && -- 1.6.2.16.geb16e ``` ## Brandon Casey, 2009-03-20 03:47 Subject: [PATCH 5/5] Remove --kept-pack-only option and associated infrastructure Message-ID: URL: https://gitlist.dev/e/t_s5aa51o2kq_ePRWgLTEuhVqJ8uEP2M4mNXlcR5bTOSGntvtmK1-2zwj9VIPyIUzDg3JDg57Nk%40cipher.nrlssc.navy.mil In-Reply-To: ``` This option to pack-objects/rev-list was created to improve the -A and -a options of repack. It was found to be lacking in that it did not provide the ability to differentiate between local and non-local kept packs, and found to be unnecessary since objects residing in local kept packs can be filtered out by the --honor-pack-keep option. --- builtin-pack-objects.c | 1 - cache.h | 1 - revision.c | 9 +-------- revision.h | 1 - sha1_file.c | 21 +-------------------- 5 files changed, 2 insertions(+), 31 deletions(-) diff --git a/builtin-pack-objects.c b/builtin-pack-objects.c index 22d69ef..24f96f0 100644 --- a/builtin-pack-objects.c +++ b/builtin-pack-objects.c @@ -2200,7 +2200,6 @@ int cmd_pack_objects(int argc, const char **argv, const char *prefix) continue; } if (!strcmp("--unpacked", arg) || - !strcmp("--kept-pack-only", arg) || !strcmp("--reflog", arg) || !strcmp("--all", arg)) { use_internal_rev_list = 1; diff --git a/cache.h b/cache.h index 39789ee..a94cf67 100644 --- a/cache.h +++ b/cache.h @@ -646,7 +646,6 @@ extern int check_sha1_signature(const unsigned char *sha1, void *buf, unsigned l extern int move_temp_to_file(const char *tmpfile, const char *filename); extern int has_sha1_pack(const unsigned char *sha1); -extern int has_sha1_kept_pack(const unsigned char *sha1); extern int has_sha1_file(const unsigned char *sha1); extern int has_loose_object_nonlocal(const unsigned char *sha1); diff --git a/revision.c b/revision.c index f5771c7..b6215cc 100644 --- a/revision.c +++ b/revision.c @@ -1106,10 +1106,6 @@ static int handle_revision_opt(struct rev_info *revs, int argc, const char **arg revs->edge_hint = 1; } else if (!strcmp(arg, "--unpacked")) { revs->unpacked = 1; - revs->kept_pack_only = 0; - } else if (!strcmp(arg, "--kept-pack-only")) { - revs->unpacked = 1; - revs->kept_pack_only = 1; } else if (!prefixcmp(arg, "--unpacked=")) { die("--unpacked= no longer supported."); } else if (!strcmp(arg, "-r")) { @@ -1679,10 +1675,7 @@ enum commit_action simplify_commit(struct rev_info *revs, struct commit *commit) { if (commit->object.flags & SHOWN) return commit_ignore; - if (revs->unpacked && - (revs->kept_pack_only - ? has_sha1_kept_pack(commit->object.sha1) - : has_sha1_pack(commit->object.sha1))) + if (revs->unpacked && has_sha1_pack(commit->object.sha1)) return commit_ignore; if (revs->show_all) return commit_show; diff --git a/revision.h b/revision.h index ad123d7..6e98b71 100644 --- a/revision.h +++ b/revision.h @@ -50,7 +50,6 @@ struct rev_info { edge_hint:1, limited:1, unpacked:1, - kept_pack_only:1, boundary:2, left_right:1, rewrite_parents:1, diff --git a/sha1_file.c b/sha1_file.c index 4563173..a354f06 100644 --- a/sha1_file.c +++ b/sha1_file.c @@ -1919,8 +1919,7 @@ off_t find_pack_entry_one(const unsigned char *sha1, return 0; } -static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, - int kept_pack_only) +static int find_pack_entry(const unsigned char *sha1, struct pack_entry *e) { static struct packed_git *last_found = (void *)1; struct packed_git *p; @@ -1932,8 +1931,6 @@ static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, p = (last_found == (void *)1) ? packed_git : last_found; do { - if (kept_pack_only && !p->pack_keep) - goto next; if (p->num_bad_objects) { unsigned i; for (i = 0; i < p->num_bad_objects; i++) @@ -1973,16 +1970,6 @@ static int find_pack_ent(const unsigned char *sha1, struct pack_entry *e, return 0; } -static int find_pack_entry(const unsigned char *sha1, struct pack_entry *e) -{ - return find_pack_ent(sha1, e, 0); -} - -static int find_kept_pack_entry(const unsigned char *sha1, struct pack_entry *e) -{ - return find_pack_ent(sha1, e, 1); -} - struct packed_git *find_sha1_pack(const unsigned char *sha1, struct packed_git *packs) { @@ -2456,12 +2443,6 @@ int has_sha1_pack(const unsigned char *sha1) return find_pack_entry(sha1, &e); } -int has_sha1_kept_pack(const unsigned char *sha1) -{ - struct pack_entry e; - return find_kept_pack_entry(sha1, &e); -} - int has_sha1_file(const unsigned char *sha1) { struct pack_entry e; -- 1.6.2.16.geb16e ``` ## Brandon Casey, 2009-03-20 04:05 Subject: Re: [PATCH 0/5] repack improvements Message-ID: URL: https://gitlist.dev/e/dScXoJvh_LpnaE6p5tEN_KvxO5pPkaKR22Ui_s7wX-kVOZUWyvMieQ%40cipher.nrlssc.navy.mil In-Reply-To: ``` Sorry, I forgot the sign-off on these patches. If you decide to apply, please add it or tell me to resend. thanks, -brandon ```