git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 3/9] builtin/cat-file: support "blob:none" objects filter

From
Karthik Nayak <karthik.188@gmail.com>
Date
Feb 27, 2025, 11:26 UTC
Message-ID
<CAOLa=ZR9yJqvDwnJ2t9y0MRNQfZFpWPssgsE1QrpbhEzDBB3Og@mail.gmail.com>
In-Reply-To
<20250221-pks-cat-file-object-type-filter-v1-3-0852530888e2@pks.im>
Patrick Steinhardt <ps@pks.im> writes:
Show 21 quoted lines
> Implement support for the "blob:none" filter in git-cat-file(1), which
> causes us to omit all blobs.
>
> Signed-off-by: Patrick Steinhardt <ps@pks.im>
> ---
>  Documentation/git-cat-file.adoc |  2 ++
>  builtin/cat-file.c              | 11 ++++++++++-
>  t/t1006-cat-file.sh             | 33 +++++++++++++++++++++++++++++++--
>  3 files changed, 43 insertions(+), 3 deletions(-)
>
> diff --git a/Documentation/git-cat-file.adoc b/Documentation/git-cat-file.adoc
> index 7c1c888079a..c11952d9eca 100644
> --- a/Documentation/git-cat-file.adoc
> +++ b/Documentation/git-cat-file.adoc
> @@ -86,6 +86,8 @@ OPTIONS
>  	Omit objects from the list of printed objects. This can only be used in
>  	combination with one of the batched modes. The '<filter-spec>' may be
>  	one of the following:
> ++
> +The form '--filter=blob:none' omits all blobs.
>
Shouldn't this be '--objects-filter' ?
Show 13 quoted lines
>  --path=<path>::
>  	For use with `--textconv` or `--filters`, to allow specifying an object
> diff --git a/builtin/cat-file.c b/builtin/cat-file.c
> index 723644fbba8..8e5572ba43e 100644
> --- a/builtin/cat-file.c
> +++ b/builtin/cat-file.c
> @@ -472,7 +472,8 @@ static void batch_object_write(const char *obj_name,
>  	if (!data->skip_object_info) {
>  		int ret;
>
> -		if (use_mailmap)
> +		if (use_mailmap ||
> +		    opt->objects_filter.choice == LOFC_BLOB_NONE)

So since we support selective filters, we'd have to add this type only for those filters. In other words, there is no generic way to do this.

Show 80 quoted lines
>  			data->info.typep = &data->type;
>
>  		if (pack)
> @@ -492,6 +493,10 @@ static void batch_object_write(const char *obj_name,
>  		switch (opt->objects_filter.choice) {
>  		case LOFC_DISABLED:
>  			break;
> +		case LOFC_BLOB_NONE:
> +			if (data->type == OBJ_BLOB)
> +				return;
> +			break;
>  		default:
>  			BUG("unsupported objects filter");
>  		}
> @@ -1032,6 +1037,10 @@ int cmd_cat_file(int argc,
>  	switch (batch.objects_filter.choice) {
>  	case LOFC_DISABLED:
>  		break;
> +	case LOFC_BLOB_NONE:
> +		if (!batch.enabled)
> +			usage(_("objects filter only supported in batch mode"));
> +		break;
>  	default:
>  		usagef(_("objects filter not supported: '%s'"),
>  		       list_object_filter_config_name(batch.objects_filter.choice));
> diff --git a/t/t1006-cat-file.sh b/t/t1006-cat-file.sh
> index 48840a13561..97533225982 100755
> --- a/t/t1006-cat-file.sh
> +++ b/t/t1006-cat-file.sh
> @@ -1354,7 +1354,22 @@ test_expect_success PERL '--batch-command info is unbuffered by default' '
>  '
>
>  test_expect_success 'setup for objects filter' '
> -	git init repo
> +	git init repo &&
> +	(
> +		# Seed the repository with three different sets of objects:
> +		#
> +		#   - The first set is fully packed and has a bitmap.
> +		#   - The second set is packed, but has no bitmap.
> +		#   - The third set is loose.
> +		#
> +		# This ensures that we cover all these types as expected.
> +		cd repo &&
> +		test_commit first &&
> +		git repack -Adb &&
> +		test_commit second &&
> +		git repack -d &&
> +		test_commit third
> +	)
>  '
>
>  test_expect_success 'objects filter with unknown option' '
> @@ -1365,7 +1380,7 @@ test_expect_success 'objects filter with unknown option' '
>  	test_cmp expect err
>  '
>
> -for option in blob:none blob:limit=1 object:type=tag sparse:oid=1234 tree:1 sparse:path=x
> +for option in blob:limit=1 object:type=tag sparse:oid=1234 tree:1 sparse:path=x
>  do
>  	test_expect_success "objects filter with unsupported option $option" '
>  		case "$option" in
> @@ -1385,4 +1400,18 @@ do
>  	'
>  done
>
> +test_objects_filter () {
> +	filter="$1"
> +
> +	test_expect_success "objects filter: $filter" '
> +		git -C repo cat-file --batch-check="%(objectname)" --batch-all-objects --objects-filter="$filter" >actual &&
> +		sort actual >actual.sorted &&
> +		git -C repo rev-list --objects --no-object-names --all --filter="$filter" --filter-provided-objects >expect &&
> +		sort expect >expect.sorted &&
> +		test_cmp expect.sorted actual.sorted
> +	'
> +}
> +
> +test_objects_filter "blob:none"
> +
Nice, this builds up for the upcoming commits too.
>  test_done
>
> --
> 2.48.1.683.gf705b3209c.dirty
Previous: Toon ClaesNext: Patrick Steinhardt
Message 5 of 44 in “builtin/cat-file: allow filtering objects in batch mode”
  1. 0/9 builtin/cat-file: allow filtering objects in batch modePatrick Steinhardt, Feb 21, 2025
  2. 1/9 builtin/cat-file: rename variable that tracks usagePatrick Steinhardt, Feb 21, 2025
  3. 3/9 builtin/cat-file: support "blob:none" objects filterPatrick Steinhardt, Feb 21, 2025
  4. Toon ClaesFeb 26, 2025
  5. Karthik NayakFeb 27, 2025
  6. 2/9 builtin/cat-file: wire up an option to filter objectsPatrick Steinhardt, Feb 21, 2025
  7. Toon ClaesFeb 26, 2025
  8. Patrick SteinhardtFeb 28, 2025
  9. Junio C HamanoFeb 28, 2025
  10. Patrick SteinhardtMar 3, 2025
  11. Karthik NayakFeb 27, 2025
  12. 4/9 builtin/cat-file: support "blob:limit=" objects filterPatrick Steinhardt, Feb 21, 2025
  13. 5/9 builtin/cat-file: support "object:type=" objects filterPatrick Steinhardt, Feb 21, 2025
  14. Toon ClaesFeb 26, 2025
  15. Patrick SteinhardtFeb 28, 2025
  16. 6/9 pack-bitmap: expose function to iterate over bitmapped objectsPatrick Steinhardt, Feb 21, 2025
  17. Junio C HamanoFeb 24, 2025
  18. Patrick SteinhardtFeb 25, 2025
  19. Junio C HamanoFeb 25, 2025
  20. Taylor BlauFeb 27, 2025
  21. Patrick SteinhardtFeb 28, 2025
  22. Taylor BlauFeb 27, 2025
  23. Junio C HamanoFeb 27, 2025
  24. Taylor BlauFeb 27, 2025
  25. 8/9 builtin/cat-file: deduplicate logic to iterate over all objectsPatrick Steinhardt, Feb 21, 2025
  26. 7/9 pack-bitmap: introduce function to check whether a pack is bitmappedPatrick Steinhardt, Feb 21, 2025
  27. Taylor BlauFeb 27, 2025
  28. 9/9 builtin/cat-file: use bitmaps to efficiently filter by object typePatrick Steinhardt, Feb 21, 2025
  29. Karthik NayakFeb 27, 2025
  30. Taylor BlauFeb 27, 2025
  31. 00/11 builtin/cat-file: allow filtering objects in batch modePatrick Steinhardt, Apr 2, 2025
  32. 01/11 builtin/cat-file: rename variable that tracks usagePatrick Steinhardt, Apr 2, 2025
  33. 02/11 builtin/cat-file: introduce function to report object statusPatrick Steinhardt, Apr 2, 2025
  34. 03/11 builtin/cat-file: wire up an option to filter objectsPatrick Steinhardt, Apr 2, 2025
  35. 04/11 builtin/cat-file: support "blob:none" objects filterPatrick Steinhardt, Apr 2, 2025
  36. 05/11 builtin/cat-file: support "blob:limit=" objects filterPatrick Steinhardt, Apr 2, 2025
  37. 06/11 builtin/cat-file: support "object:type=" objects filterPatrick Steinhardt, Apr 2, 2025
  38. 07/11 pack-bitmap: allow passing payloads to `show_reachable_fn()`Patrick Steinhardt, Apr 2, 2025
  39. 08/11 pack-bitmap: add function to iterate over filtered bitmapped objectsPatrick Steinhardt, Apr 2, 2025
  40. 09/11 pack-bitmap: introduce function to check whether a pack is bitmappedPatrick Steinhardt, Apr 2, 2025
  41. 10/11 builtin/cat-file: deduplicate logic to iterate over all objectsPatrick Steinhardt, Apr 2, 2025
  42. 11/11 builtin/cat-file: use bitmaps to efficiently filter by object typePatrick Steinhardt, Apr 2, 2025
  43. Karthik NayakApr 3, 2025
  44. Junio C HamanoApr 8, 2025

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.