git/list[1] front-page[2] threads[3] people[4] search[5] about
 

About Summer of code idea -- better big-file support

From
徐迪 <xudifsd@gmail.com>
Date
Mar 19, 2011, 13:15 UTC
Message-ID
<AANLkTi=Z_4cGBSPQW2YVuj=dd8mcO4YQ0G2owknt7vfw@mail.gmail.com>
Hi, there

I am wondering start implementing the idea about better big-file support during summer of code. Here are my idea: often gigantic files is media file, such as rmvb, swf, pdf, dll, etc. And those file themselves are already being compressed, as we all know, git uses zlib to compress all the object in repository, and it is the common sense that if we use zlib to compress those file, the compress ratio will be unbelievable low, from my test if we compress 521MiB mkv file it will be 520MiB after compressed, how ridiculous it is! Also I test that if we use "git hash-object" to calculate SHA-1, and copy all content to repository, it will costs 1 minutes, once we use "git hash-object -w" it will costs 2 minutes. So we sacrificed a lot, but gained a little. So, how do you guys think about that we can test the file type, and then decide to use zlib or not? Cheer Di

Next: Nguyen Thai Ngoc Duy
Message 1 of 5 in “About Summer of code idea -- better big-file support”
  1. 徐迪Mar 19, 2011
  2. Nguyen Thai Ngoc DuyMar 19, 2011
  3. 徐迪Mar 19, 2011
  4. Nguyen Thai Ngoc DuyMar 19, 2011
  5. 徐迪Mar 20, 2011

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.