{"thread":{"id":"24273","subject":"[GSoC update extra!] git-remote-svn: Week 9","startedAt":"2010-07-02T21:57:52Z","lastAt":"2010-07-03T19:47:33Z","messageCount":3,"participants":["Ramkumar Ramachandra","Tay Ray Chuan"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"144724","messageId":"20100702215752.GD2306@debian","threadId":"24273","inReplyTo":null,"subject":"[GSoC update extra!] git-remote-svn: Week 9","fromName":"Ramkumar Ramachandra","fromEmail":"artagnon@gmail.com","sentAt":"2010-07-02T21:57:52Z","receivedAt":"2010-07-02T21:57:52Z","isPatch":false,"sender":{"key":"r@artagnon.com","avatar":"https://avatars.githubusercontent.com/u/37226?v=4"},"body":"Hi,\n\nI figured that I haven't posted a recent update about the RA\nsvnclient, so here it is. The good news is that using a combination of\ntrial-and-error and twisted logic, I seem to have to fix the memory\nleaks and pool lifetime issues. I also managed to ouput the\ntext-content-length header by writing the dump to a temporary file and\nstat'ing it. Unfortunately, the headers are still malformed, and this\nrequires some more work to get right. The client runs successfully and\nmanages to dump 5000 revisions of the ASF repository:\n\n11.34s user 3.50s system 21% cpu 1:07.69 total\n\nThat's about 75 revisions per second, which isn't too bad I hope. This\nis over the network, and my internet connection isn't all that fast.\n\nThe bad news is that the client seems to signal SIGABRT when it\nfinishes its work for some strange reason. Fortunately, I suspect that\nthis is a trivial issue where I'm leaking some error or forgetting to\nclean up something. Hopefully, I'll be able to resolve this and fix\nthe dump headers within the next few days. After that, I'll scrub the\nhistory clean and roll a series.\n\n-- Ram\n"},{"id":"144736","messageId":"AANLkTintNXXpyS5LpG6K7ltg-t6Mz0IuYT7GxMkFkVwa@mail.gmail.com","threadId":"24273","inReplyTo":"20100702215752.GD2306@debian","subject":"Re: [GSoC update extra!] git-remote-svn: Week 9","fromName":"Tay Ray Chuan","fromEmail":"rctay89@gmail.com","sentAt":"2010-07-03T08:36:10Z","receivedAt":"2010-07-03T08:36:10Z","isPatch":false,"sender":{"key":"rctay89@gmail.com","avatar":"https://avatars.githubusercontent.com/u/61553?v=4"},"body":"Hi,\n\nOn Sat, Jul 3, 2010 at 5:57 AM, Ramkumar Ramachandra <artagnon@gmail.com> wrote:\n> [snip]\n> The client runs successfully and\n> manages to dump 5000 revisions of the ASF repository:\n>\n> 11.34s user 3.50s system 21% cpu 1:07.69 total\n>\n> That's about 75 revisions per second, which isn't too bad I hope. This\n> is over the network, and my internet connection isn't all that fast.\n\nI wonder if you could mirror the test SVN repository locally with\nsvnsync so that we can a) spare their bandwidth b) minimize the effect\nof network bottlenecks on stats - I'm sure you could get more\nimpressive stats that way.\n\nEven better, having the SVN repo and the \"exported\" git repo on\nseparate hard disks to minimize I/O as a bottleneck.\n\n(Great work, by the way.)\n\n-- \nCheers,\nRay Chuan\n"},{"id":"144751","messageId":"20100703194733.GA3092@debian","threadId":"24273","inReplyTo":"AANLkTintNXXpyS5LpG6K7ltg-t6Mz0IuYT7GxMkFkVwa@mail.gmail.com","subject":"Re: [GSoC update extra!] git-remote-svn: Week 9","fromName":"Ramkumar Ramachandra","fromEmail":"artagnon@gmail.com","sentAt":"2010-07-03T19:47:33Z","receivedAt":"2010-07-03T19:47:33Z","isPatch":false,"sender":{"key":"r@artagnon.com","avatar":"https://avatars.githubusercontent.com/u/37226?v=4"},"body":"Hi Tay,\n\nTay Ray Chuan writes:\n> Hi,\n> \n> On Sat, Jul 3, 2010 at 5:57 AM, Ramkumar Ramachandra <artagnon@gmail.com> wrote:\n> > [snip]\n> > The client runs successfully and\n> > manages to dump 5000 revisions of the ASF repository:\n> >\n> > 11.34s user 3.50s system 21% cpu 1:07.69 total\n> >\n> > That's about 75 revisions per second, which isn't too bad I hope. This\n> > is over the network, and my internet connection isn't all that fast.\n> \n> I wonder if you could mirror the test SVN repository locally with\n> svnsync so that we can a) spare their bandwidth b) minimize the effect\n> of network bottlenecks on stats - I'm sure you could get more\n> impressive stats that way.\n\nExcellent idea. Unfortunately, I don't have enough disk space to\nmirror the whole ASF repository on my laptop- I'll try it when I get\nback to my desktop (in 15~20 days).\n\nIn my prelimiary benchmark, I also found that I beat `svnsync` over\nthe same network connection :)\n\n> Even better, having the SVN repo and the \"exported\" git repo on\n> separate hard disks to minimize I/O as a bottleneck.\n\nUnfortunately, a lot of middleware components are missing and we\ncannot export it to a Git repository just yet- see my previous email\nabout this [1]. Great idea though- will try it in future.\n\n> (Great work, by the way.)\n\nThanks, and thanks for the feedback! :)\n\n[1]: http://article.gmane.org/gmane.comp.version-control.git/150035\n\n-- Ram\n"}]}