git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: EXT :Re: GIT and large files

From
KKKonstantin Khomoutov <flatworm@users.sourceforge.net>
Date
May 20, 2014, 19:01 UTC
Message-ID
<20140520230134.25cbbffe1b0ce95de60024a5@domain007.com>
In-Reply-To
<C755E6FBF6DC4447BEF161CE48BDE0BD2F0CD670@XMBVAG73.northgrum.com>

On Tue, 20 May 2014 18:18:08 +0000 "Stewart, Louis (IS)" <louis.stewart@ngc.com> wrote:

> From you response then there is a method to only obtain the Project,
> Directory and Files (which could hold 80 GBs of data) and not the
> rest of the Repository that contained the full overall Projects?
Please google the phrase "Git shallow cloning".
I would also recommend to read up on git-annex [1].
You might also consider using Subversion as it seems you do not need
most benefits Git has over it and want certain benefits Subversion has
over Git:
* You don't need a distributed VCS (as you don't want each developer to
  have a full clone).
* You only need a single slice of the repository history at any given
  revision on a developer's machine, and this is *almost* what
  Subversion does: it will keep the so-called "base" (or "pristine")
  versions of files comprising the revision you will check out, plus
  the checked out files theirselves.  So, twice the space of the files
  comprising a revision.
* Subversion allows you to check out only a single folder out of the
  entire revision.
* IIRC, subversion supports locks, when a developer might tell the
  server they're editing a file, and this will prevent other devs from
  locking the same file.  This might be used to serialize editions of
  huge and/or unmergeable files.  Git can't do that (without
  non-standard tools deployed on the side or a centralized "meeting
  point" repository).

My point is that while Git is fantastic for managing source code projects and project of similar types with regard to their contents, it seems your requirements are mainly not suitable for the use case Git is best tailored for. Your apparent lack of familiarity with Git might as well bite you later should you pick it right now. At least please consider reading a book or some other introduction-level material on Git to get the feeling of typical workflows used with it.

1. https://git-annex.branchable.com/
Previous: Stewart, Louis (IS)Next: Thomas Braun
Message 8 of 10 in “GIT and large files”
  1. Stewart, Louis (IS)May 20, 2014
  2. Jason PyeronMay 20, 2014
  3. Marius Storm-OlsenMay 20, 2014
  4. Junio C HamanoMay 20, 2014
  5. Stewart, Louis (IS)May 20, 2014
  6. Junio C HamanoMay 20, 2014
  7. Stewart, Louis (IS)May 20, 2014
  8. Konstantin KhomoutovMay 20, 2014
  9. Thomas BraunMay 20, 2014
  10. Stewart, Louis (IS)May 20, 2014

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.