{"thread":{"id":"25223","subject":"git-upload-pack bandwidth cap over SSH?","startedAt":"2010-09-24T14:47:05Z","lastAt":"2010-09-24T19:42:32Z","messageCount":5,"participants":["Joshua Jensen","Matthieu Moy","Tay Ray Chuan"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"151486","messageId":"4C9CB9E9.8010901@workspacewhiz.com","threadId":"25223","inReplyTo":null,"subject":"git-upload-pack bandwidth cap over SSH?","fromName":"Joshua Jensen","fromEmail":"jjensen@workspacewhiz.com","sentAt":"2010-09-24T14:47:05Z","receivedAt":"2010-09-24T14:47:05Z","isPatch":false,"sender":{"key":"jjensen@workspacewhiz.com","avatar":"https://avatars.githubusercontent.com/u/111687?v=4"},"body":" Our Git repository central server is running on some kind of \nenterprise VM software. I can push repository changes through the \nGitolite-monitored SSH tunnel at 10+ megabytes per second.\n\nA 'git pull' operation (even a fresh clone of the packed repository) \nalways caps at 1.55 MiB/s, according to the \"Receiving objects\" line in \nthe status text.\n\nThinking it might be a hardware issue (half duplex?), I installed \nVirtualBox on my Windows 7 64-bit machine and then made an Ubuntu \nGitolite install. Running on my local hardware, the push is roughly 12 \nmegabytes per second. The 'git pull' downstream again caps at 1.55 MiB/s.\n\nI've been troubleshooting this for months.\n\nAre there any configuration settings within Git that may limit the \ngit-upload-pack operation's speed?\n\nI realize this could be a MinGW issue via the msysGit client.\n\nUpdate: I just copied a large file via 'scp', and the downstream still \ncapped at 1.55-ish megabytes per second. So it isn't Git.\n\nI guess I'll post this anyway out of desperation.\n\nDoes anyone have any thoughts?\n\nJosh\n"},{"id":"151507","messageId":"vpq39szazgr.fsf@bauges.imag.fr","threadId":"25223","inReplyTo":"4C9CB9E9.8010901@workspacewhiz.com","subject":"Re: git-upload-pack bandwidth cap over SSH?","fromName":"Matthieu Moy","fromEmail":"matthieu.moy@grenoble-inp.fr","sentAt":"2010-09-24T16:16:52Z","receivedAt":"2010-09-24T16:16:52Z","isPatch":false,"sender":{"key":"matthieu.moy@grenoble-inp.fr","avatar":"https://gravatar.com/avatar/72c8a2705971a25dfaff23cece15130d405685845d911aedd5667ace277f3fc5?d=mp&s=160"},"body":"Joshua Jensen writes:\n\n> Update: I just copied a large file via 'scp', and the downstream still\n> capped at 1.55-ish megabytes per second. So it isn't Git.\n\nWhat's the CPU usage on both sides?\n\nTo benchmark SSH, you can also do things like (on Unix) :\n\n ssh host 'head -c 100000000 /dev/zero' | wc -c\n\n(to make sure you're not benchmarking your hard drive)\n\n-- \nMatthieu Moy\nhttp://www-verimag.imag.fr/~moy/\n"},{"id":"151530","messageId":"AANLkTinLL_pP=cvKcv=WtbqfacMKqris8sVe+Hb5=f-5@mail.gmail.com","threadId":"25223","inReplyTo":"4C9CB9E9.8010901@workspacewhiz.com","subject":"Re: git-upload-pack bandwidth cap over SSH?","fromName":"Tay Ray Chuan","fromEmail":"rctay89@gmail.com","sentAt":"2010-09-24T19:13:09Z","receivedAt":"2010-09-24T19:13:09Z","isPatch":false,"sender":{"key":"rctay89@gmail.com","avatar":"https://avatars.githubusercontent.com/u/61553?v=4"},"body":"Hi,\n\nOn Fri, Sep 24, 2010 at 10:47 PM, Joshua Jensen\n wrote:\n> Thinking it might be a hardware issue (half duplex?), I installed VirtualBox\n> on my Windows 7 64-bit machine and then made an Ubuntu Gitolite install.\n>  Running on my local hardware, the push is roughly 12 megabytes per second.\n>  The 'git pull' downstream again caps at 1.55 MiB/s.\n\nWhere's the git repository living in? A VirtualBox hdd? Shared folder?\nSamba share?\n\n> Update: I just copied a large file via 'scp', and the downstream still\n> capped at 1.55-ish megabytes per second.  So it isn't Git.\n\nYou might probably get better help on VirtualBox's forum.\n\n-- \nCheers,\nRay Chuan\n"},{"id":"151532","messageId":"4C9CFC56.3030501@workspacewhiz.com","threadId":"25223","inReplyTo":"4C9CB9E9.8010901@workspacewhiz.com","subject":"Re: git-upload-pack bandwidth cap over SSH?","fromName":"Joshua Jensen","fromEmail":"jjensen@workspacewhiz.com","sentAt":"2010-09-24T19:30:30Z","receivedAt":"2010-09-24T19:30:30Z","isPatch":false,"sender":{"key":"jjensen@workspacewhiz.com","avatar":"https://avatars.githubusercontent.com/u/111687?v=4"},"body":" ----- Original Message -----\nFrom: Joshua Jensen\nDate: 9/24/2010 8:47 AM\n> Our Git repository central server is running on some kind of \n> enterprise VM software. I can push repository changes through the \n> Gitolite-monitored SSH tunnel at 10+ megabytes per second.\n>\n> A 'git pull' operation (even a fresh clone of the packed repository) \n> always caps at 1.55 MiB/s, according to the \"Receiving objects\" line \n> in the status text.\n>\n> Thinking it might be a hardware issue (half duplex?), I installed \n> VirtualBox on my Windows 7 64-bit machine and then made an Ubuntu \n> Gitolite install. Running on my local hardware, the push is roughly \n> 12 megabytes per second. The 'git pull' downstream again caps at 1.55 \n> MiB/s.\n>\n> Are there any configuration settings within Git that may limit the \n> git-upload-pack operation's speed?\n>\n> I realize this could be a MinGW issue via the msysGit client.\n>\n> Update: I just copied a large file via 'scp', and the downstream still \n> capped at 1.55-ish megabytes per second. So it isn't Git.\nReplying to my own message... I take that back. I'm not sure what I was \nseeing, but I can consistently run scp and copy files at 6+ megabytes \nper second.\n\nWith that in mind, I'm back to looking at Git's pull performance over \nSSH. It never exceeds 1.55 MiB/s.\n\nJosh\n"},{"id":"151536","messageId":"4C9CFF28.3050506@workspacewhiz.com","threadId":"25223","inReplyTo":"4C9CFC56.3030501@workspacewhiz.com","subject":"Re: git-upload-pack bandwidth cap over SSH?","fromName":"Joshua Jensen","fromEmail":"jjensen@workspacewhiz.com","sentAt":"2010-09-24T19:42:32Z","receivedAt":"2010-09-24T19:42:32Z","isPatch":false,"sender":{"key":"jjensen@workspacewhiz.com","avatar":"https://avatars.githubusercontent.com/u/111687?v=4"},"body":" ----- Original Message -----\nFrom: Joshua Jensen\nDate: 9/24/2010 1:30 PM\n> ----- Original Message -----\n> From: Joshua Jensen\n> Date: 9/24/2010 8:47 AM\n>> Our Git repository central server is running on some kind of \n>> enterprise VM software. I can push repository changes through the \n>> Gitolite-monitored SSH tunnel at 10+ megabytes per second.\n>>\n>> A 'git pull' operation (even a fresh clone of the packed repository) \n>> always caps at 1.55 MiB/s, according to the \"Receiving objects\" line \n>> in the status text.\n> Replying to my own message... I take that back. I'm not sure what I \n> was seeing, but I can consistently run scp and copy files at 6+ \n> megabytes per second.\n>\n> With that in mind, I'm back to looking at Git's pull performance over \n> SSH. It never exceeds 1.55 MiB/s.\nI'm taking this over to the msysGit mailing list. I used a Linux \nmachine to clone the same repository, and it receives objects at 6 \nmegabytes per second.\n\nSorry for the noise.\n\nJosh\n"}]}