git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 5/6] builtin/repo: add disk size info to keyvalue stucture output

From
Patrick Steinhardt <ps@pks.im>
Date
Dec 15, 2025, 05:33 UTC
Message-ID
<aT-djS-TrQJxxV8i@pks.im>
In-Reply-To
<54kuvik2ecbkygjp57osmqjxiy7xtyjeffbzavuxbhuvta2oc5@mkqufah7cb3z>
On Fri, Dec 12, 2025 at 02:40:24PM -0600, Justin Tobler wrote:
Show 44 quoted lines
> On 25/12/10 07:28AM, Patrick Steinhardt wrote:
> > On Tue, Dec 09, 2025 at 04:58:19PM -0600, Justin Tobler wrote:
> > > @@ -106,16 +137,12 @@ test_expect_success SHA1 'keyvalue and nul format' '
> > >  		objects.tags.inflated=132
> > >  		EOF
> > >  
> > > -		git repo structure --format=keyvalue >out 2>err &&
> > > +		git repo structure --format=keyvalue >out.raw 2>err &&
> > >  
> > > -		test_cmp expect out &&
> > > -		test_line_count = 0 err &&
> > > +		# Strip object disk usage from output due to platform variance.
> > > +		grep -v "objects\..*\.disk=" out.raw >out &&
> > >  
> > > -		# Replace key and value delimiters for nul format.
> > > -		tr "\n=" "\0\n" <expect >expect_nul &&
> > > -		git repo structure --format=nul >out 2>err &&
> > > -
> > > -		test_cmp expect_nul out &&
> > > +		test_cmp expect out &&
> > >  		test_line_count = 0 err
> > >  	)
> > >  '
> > 
> > We could test disk sizes here test if we use git-rev-list(1) to compute
> > disk size by type:
> > 
> >     git rev-list --disk-usage HEAD --objects --filter=object:type=blob
> >     git rev-list --disk-usage HEAD --objects --filter=object:type=commit
> >     git rev-list --disk-usage HEAD --objects --filter=object:type=tag
> >     git rev-list --disk-usage HEAD --objects --filter=object:type=tree
> > 
> > The `--disk-usage` option also supports `--disk-usage=human`, which we
> > can use in the next commit to verify that our computations are the same
> > across git-rev-list(1) and git-repo(1).
> 
> So, I'm not sure we can use git-rev-list(1) in the manner suggested
> above. It looks like user-specified objects are always included in the
> output. When using "HEAD" this means the referenced object will always
> be included regardless of the filter used. In practice, this means
> reported disk-usage when filtering by trees or blobs will likely be
> inflated by objects not specified by the filter. As far as I am aware,
> there is not a way to suppress user-specified objects in git-rev-list(1)
> output.
There is, you can use "--filter-provided-objects".
Show 10 quoted lines
> I am somewhat curious if always including user-specified objects in
> git-rev-list(1) output regardless of the specified filter is
> intentional. Looking at git-rev-list(1) --filter documentation:
> 
>   The form --filter=object:type=(tag|commit|tree|blob) omits all objects
>   which are not of the requested type.
> 
> doesn't indicate this limitation. From looking at the code in
> list-objects-filter.c:list_objects_filter__filter_object() though, it
> does somewhat seem like this behavior is intentional.

It is intentional, but I've been bitten by it in the past. Hence I introduced the above option in 9cf68b27d5 (rev-list: allow filtering of provided items, 2021-04-19).

Patrick
Previous: Justin ToblerNext: Justin Tobler
Message 16 of 80 in “builtin/repo: add object size info to structure output”
  1. 0/6 builtin/repo: add object size info to structure outputJustin Tobler, Dec 9, 2025
  2. 1/6 builtin/repo: group per-type object values into structJustin Tobler, Dec 9, 2025
  3. 2/6 builtin/repo: humanise count values in structure outputJustin Tobler, Dec 9, 2025
  4. Patrick SteinhardtDec 10, 2025
  5. Justin ToblerDec 10, 2025
  6. Junio C HamanoDec 11, 2025
  7. Justin ToblerDec 12, 2025
  8. 3/6 builtin/repo: add inflated object info to keyvalue structure outputJustin Tobler, Dec 9, 2025
  9. 4/6 builtin/repo: add inflated object info to structure tableJustin Tobler, Dec 9, 2025
  10. Patrick SteinhardtDec 10, 2025
  11. Justin ToblerDec 10, 2025
  12. 5/6 builtin/repo: add disk size info to keyvalue stucture outputJustin Tobler, Dec 9, 2025
  13. Patrick SteinhardtDec 10, 2025
  14. Justin ToblerDec 10, 2025
  15. Justin ToblerDec 12, 2025
  16. Patrick SteinhardtDec 15, 2025
  17. Justin ToblerDec 15, 2025
  18. Junio C HamanoDec 10, 2025
  19. Lucas Seiki OshiroDec 10, 2025
  20. Justin ToblerDec 12, 2025
  21. Junio C HamanoDec 12, 2025
  22. 6/6 builtin/repo: add object disk size info to structure tableJustin Tobler, Dec 9, 2025
  23. Patrick SteinhardtDec 10, 2025
  24. Justin ToblerDec 10, 2025
  25. 0/7 builtin/repo: add object size info to structure outputJustin Tobler, Dec 12, 2025
  26. 1/7 builtin/repo: group per-type object values into structJustin Tobler, Dec 12, 2025
  27. 2/7 strbuf: split out logic to humanise byte valuesJustin Tobler, Dec 12, 2025
  28. Patrick SteinhardtDec 15, 2025
  29. Justin ToblerDec 15, 2025
  30. Junio C HamanoDec 15, 2025
  31. Justin ToblerDec 15, 2025
  32. Jiang XinDec 16, 2025
  33. Junio C HamanoDec 16, 2025
  34. Jiang XinDec 16, 2025
  35. Justin ToblerDec 16, 2025
  36. 3/7 builtin/repo: humanise count values in structure outputJustin Tobler, Dec 12, 2025
  37. Patrick SteinhardtDec 15, 2025
  38. 4/7 builtin/repo: add inflated object info to keyvalue structure outputJustin Tobler, Dec 12, 2025
  39. Patrick SteinhardtDec 15, 2025
  40. Justin ToblerDec 15, 2025
  41. 5/7 builtin/repo: add inflated object info to structure tableJustin Tobler, Dec 12, 2025
  42. 6/7 builtin/repo: add disk size info to keyvalue stucture outputJustin Tobler, Dec 12, 2025
  43. Patrick SteinhardtDec 15, 2025
  44. 7/7 builtin/repo: add object disk size info to structure tableJustin Tobler, Dec 12, 2025
  45. 0/7 builtin/repo: add object size info to structure outputJustin Tobler, Dec 15, 2025
  46. 1/7 builtin/repo: group per-type object values into structJustin Tobler, Dec 15, 2025
  47. 2/7 strbuf: split out logic to humanise byte valuesJustin Tobler, Dec 15, 2025
  48. Junio C HamanoDec 16, 2025
  49. Justin ToblerDec 16, 2025
  50. 3/7 builtin/repo: humanise count values in structure outputJustin Tobler, Dec 15, 2025
  51. Patrick SteinhardtDec 16, 2025
  52. 4/7 builtin/repo: add inflated object info to keyvalue structure outputJustin Tobler, Dec 15, 2025
  53. 5/7 builtin/repo: add inflated object info to structure tableJustin Tobler, Dec 15, 2025
  54. 6/7 builtin/repo: add disk size info to keyvalue stucture outputJustin Tobler, Dec 15, 2025
  55. 7/7 builtin/repo: add object disk size info to structure tableJustin Tobler, Dec 15, 2025
  56. Patrick SteinhardtDec 16, 2025
  57. Justin ToblerDec 16, 2025
  58. 0/7 builtin/repo: add object size info to structure outputJustin Tobler, Dec 16, 2025
  59. 1/7 builtin/repo: group per-type object values into structJustin Tobler, Dec 16, 2025
  60. 2/7 strbuf: split out logic to humanise byte valuesJustin Tobler, Dec 16, 2025
  61. Junio C HamanoDec 16, 2025
  62. Justin ToblerDec 16, 2025
  63. 4/7 builtin/repo: add inflated object info to keyvalue structure outputJustin Tobler, Dec 16, 2025
  64. Patrick SteinhardtDec 17, 2025
  65. Justin ToblerDec 17, 2025
  66. 3/7 builtin/repo: humanise count values in structure outputJustin Tobler, Dec 16, 2025
  67. 5/7 builtin/repo: add inflated object info to structure tableJustin Tobler, Dec 16, 2025
  68. 6/7 builtin/repo: add disk size info to keyvalue stucture outputJustin Tobler, Dec 16, 2025
  69. 7/7 builtin/repo: add object disk size info to structure tableJustin Tobler, Dec 16, 2025
  70. Patrick SteinhardtDec 17, 2025
  71. Justin ToblerDec 17, 2025
  72. 0/7 builtin/repo: add object size info to structure outputJustin Tobler, Dec 17, 2025
  73. 1/7 builtin/repo: group per-type object values into structJustin Tobler, Dec 17, 2025
  74. 2/7 strbuf: split out logic to humanise byte valuesJustin Tobler, Dec 17, 2025
  75. 4/7 builtin/repo: add inflated object info to keyvalue structure outputJustin Tobler, Dec 17, 2025
  76. 3/7 builtin/repo: humanise count values in structure outputJustin Tobler, Dec 17, 2025
  77. 5/7 builtin/repo: add inflated object info to structure tableJustin Tobler, Dec 17, 2025
  78. 6/7 builtin/repo: add disk size info to keyvalue stucture outputJustin Tobler, Dec 17, 2025
  79. 7/7 builtin/repo: add object disk size info to structure tableJustin Tobler, Dec 17, 2025
  80. Patrick SteinhardtDec 18, 2025

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.