# Initial git clone behaviour 3 messages from 2016-01-06 to 2016-01-06. Participants: Eric Curtin, Junio C Hamano. Thread: https://gitlist.dev/t/41137 ## Eric Curtin, 2016-01-06 22:26 Subject: Initial git clone behaviour Message-ID: URL: https://gitlist.dev/e/CANpvso58uPtMcz_L0D%3DWBcCj%2BmSLLYZ5LpfO1i5yLo-jrb6bsA%40mail.gmail.com ``` Hi Guys, I am not a git developer or a git expert but just a change I would love to see. When I clone a really large repository (like the linux kernel for example) initially on a brand new machine, it can take quite a while before I can start working with the code. Often I do a standard git clone: git clone (name of repo) Followed by a depth=1 clone in parallel, so I can get building and working with the code asap: git clone --depth=1 (name of repo) Could we change the default behavior of git so that we initially get all the current files quickly so that we can start working them and then getting the rest of the data? At least a user could get to work quicker this way. Any disadvantages of this approach? Maybe I am not the first to suggest something like this. ``` ## Junio C Hamano, 2016-01-06 23:14 Subject: Re: Initial git clone behaviour Message-ID: URL: https://gitlist.dev/e/CAPc5daXeNay1uF%3DqQ%3DG82kyu37uHhy-uEOWU6tz_bPYfFam%3DrA%40mail.gmail.com In-Reply-To: ``` On Wed, Jan 6, 2016 at 2:26 PM, Eric Curtin wrote: > > Often I do a standard git clone: > > git clone (name of repo) > > Followed by a depth=1 clone in parallel, so I can get building and > working with the code asap: > > git clone --depth=1 (name of repo) > > Could we change the default behavior of git so that we initially get > all the current files quickly so that we can start working them and > then getting the rest of the data? At least a user could get to work > quicker this way. Any disadvantages of this approach? It would put more burden on a shared and limited resource (i.e. the server side). For example, I just tried a depth=1 clone of Linus's repository from git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git which transferred ~150MB pack data to check out 52k files in 90 seconds. On the other hand, a full clone transferred ~980MB pack data and it took 170 seconds to complete. You can already see that a full clone is highly optimized--it does not take even twice the time of getting the most recent checkout to grab 10 years worth of development (562k of commits). This efficiency comes from some tradeoffs, and one of them is that not all the data necessary to check out the latest tree contents can be stored near the beginning of the pack data. So "we'll checkout the tip while the remainder of the data is still incoming" would not be a workable, unless you are willing to destroy the full-clone performance. ``` ## Eric Curtin, 2016-01-06 23:24 Subject: Re: Initial git clone behaviour Message-ID: URL: https://gitlist.dev/e/CANpvso4NZZcAYfQZPt0i2G%2BMWD4ppga0XQZwYDhq1syA2f1GJw%40mail.gmail.com In-Reply-To: ``` On 6 January 2016 at 23:14, Junio C Hamano wrote: > On Wed, Jan 6, 2016 at 2:26 PM, Eric Curtin wrote: >> >> Often I do a standard git clone: >> >> git clone (name of repo) >> >> Followed by a depth=1 clone in parallel, so I can get building and >> working with the code asap: >> >> git clone --depth=1 (name of repo) >> >> Could we change the default behavior of git so that we initially get >> all the current files quickly so that we can start working them and >> then getting the rest of the data? At least a user could get to work >> quicker this way. Any disadvantages of this approach? > > It would put more burden on a shared and limited resource (i.e. > the server side). > > For example, I just tried a depth=1 clone of Linus's repository from > > git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git > > which transferred ~150MB pack data to check out 52k files in 90 seconds. > > On the other hand, a full clone transferred ~980MB pack data and it took > 170 seconds to complete. You can already see that a full clone is highly > optimized--it does not take even twice the time of getting the most recent > checkout to grab 10 years worth of development (562k of commits). > > This efficiency comes from some tradeoffs, and one of them is that not > all the data necessary to check out the latest tree contents can be stored > near the beginning of the pack data. So "we'll checkout the tip while the > remainder of the data is still incoming" would not be a workable, unless > you are willing to destroy the full-clone performance. Ok, my internet connection at home is pretty terrible then! I don't get nowhere near these timings. It takes over an hour to do a full clone from my house. And approx 30 mins for the depth=1 (approx, did not time it). That all makes sense I guess, probably not a good idea to regress the full time performance for the sake of this use case. Was just a query really! ```