git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH] Prevent megablobs from gunking up git packs

From
Nicolas Pitre <nico@cam.org>
Date
May 23, 2007, 01:58 UTC
Message-ID
<alpine.LFD.0.99.0705222154560.3366@xanadu.home>
In-Reply-To
<7v3b1o758u.fsf@assigned-by-dhcp.cox.net>
On Tue, 22 May 2007, Junio C Hamano wrote:
Show 19 quoted lines
> Jakub Narebski <jnareb@gmail.com> writes:
> 
> > No, I was thinking about separate _kept_ pack (so it would be not 
> > repacked unless -f option is given) containing _only_ the large blobs.
> > The only difference between this and your proposal is that megablobs
> > would be in their mergablobs pack, but not loose.
> 
> I am not sure about the "unless -f option is given" part, but a
> single .kept pack that contains only problematic blobs would be
> an interesting experiment.
> 
>  (0) prepare object names of problematic blobs, in huge.txt, one
>      object name per line;
> 
>  (1) prepare a single pack that has them:
> 
>      $ N=$(git-pack-object --depth=0 --window=0 pack <huge.txt)
>      $ echo 'Huge blobs -- do not repack' >pack-$N.keep
>      $ mv pack-$N.* .git/object/pack/.

If you're going to keep this pack, I think it might be worth attempting deltas between those blobs anyway. If they ever deltify you'll gain in disk space. And if they don't, well, you wasted the CPU cycles only once. Unless you know for sure they're unlikely to deltify well.

Nicolas
Previous: Junio C HamanoNext: Nicolas Pitre
Message 10 of 24 in “Prevent megablobs from gunking up git packs”
  1. Prevent megablobs from gunking up git packsDana How, May 22, 2007
  2. Shawn O. PearceMay 22, 2007
  3. Dana HowMay 22, 2007
  4. Junio C HamanoMay 22, 2007
  5. Dana HowMay 22, 2007
  6. Jakub NarebskiMay 22, 2007
  7. Dana HowMay 22, 2007
  8. Jakub NarebskiMay 22, 2007
  9. Junio C HamanoMay 23, 2007
  10. Nicolas PitreMay 23, 2007
  11. Nicolas PitreMay 22, 2007
  12. Dana HowMay 22, 2007
  13. Junio C HamanoMay 23, 2007
  14. Dana HowMay 23, 2007
  15. Junio C HamanoMay 24, 2007
  16. Shawn O. PearceMay 24, 2007
  17. Johannes SchindelinMay 24, 2007
  18. david@lang.hmMay 24, 2007
  19. Johannes SchindelinMay 24, 2007
  20. Shawn O. PearceMay 25, 2007
  21. Geert BoschMay 24, 2007
  22. Dana HowMay 24, 2007
  23. Shawn O. PearceMay 25, 2007
  24. Nicolas PitreMay 25, 2007

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.