{"thread":{"id":"42677","subject":"Filters should be parallelized if needed","startedAt":"2016-06-21T07:57:50Z","lastAt":"2016-06-21T10:04:14Z","messageCount":2,"participants":["LUCAS Thomas (EXT)","Lars Schneider"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"289732","messageId":"ABCC694798EF214E91DB2ACCA61703690BBADA33@MMXDC2642.hermes.si.socgen","threadId":"42677","inReplyTo":null,"subject":"Filters should be parallelized if needed","fromName":"LUCAS Thomas (EXT)","fromEmail":"thomas.lucas-ext@sgcib.com","sentAt":"2016-06-21T07:50:46Z","receivedAt":"2016-06-21T07:57:50Z","isPatch":false,"sender":{"key":"thomas.lucas-ext@sgcib.com","avatar":null},"body":"Setup:\n- 2.9.0.windows.1 x64 on a windows 7 16g ram, ssd\n- No particular installation settings, default.\n\nDetails:\n- Running git from either a cmd or GitExtensions,  I encountered an issue while staging or checkout of lfs files. I am processing 3000 files for a total of 500MB.\nFiles are proccessed sequentially which is too slow for this amount of files, while lfs offer in some cases a way to run it from the command line in parallel, I think the git filters should be run in parallel. I think there is no need (or I am forgetting something) to run it sequentially.\n\nIf I were to use a filter processing files in a parallel way, I would have my time to checkout these files be reduced from 1h30min to 1min30s.\n\nWhat actually happened instead?\n- This is a no go for our enterprise to use git-lfs because this is too slow.\n\nI can't give you my repository because it is confidential.\n\nAnyway, I hope you can do something about it.\n*************************************************************************\nThis message and any attachments (the \"message\") are confidential, intended solely for the addresse(s), and may contain legally privileged information.\nAny unauthorized use or dissemination is prohibited. E-mails are susceptible to alteration.   \nNeither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or\nfalsified.\nPlease visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.\n                              ************\nCe message et toutes les pieces jointes (ci-apres le \"message\") sont confidentiels et susceptibles de contenir des informations couvertes \npar le secret professionnel. \nCe message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.\nTout message electronique est susceptible d'alteration. \nLa SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.\nVeuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.\n*************************************************************************\n\n"},{"id":"289736","messageId":"A61012AD-BC22-4640-AE99-000D99D7375F@gmail.com","threadId":"42677","inReplyTo":"ABCC694798EF214E91DB2ACCA61703690BBADA33@MMXDC2642.hermes.si.socgen","subject":"Re: Filters should be parallelized if needed","fromName":"Lars Schneider","fromEmail":"larsxschneider@gmail.com","sentAt":"2016-06-21T09:36:37Z","receivedAt":"2016-06-21T10:04:14Z","isPatch":false,"sender":{"key":"larsxschneider@gmail.com","avatar":"https://avatars.githubusercontent.com/u/477434?v=4"},"body":"\n> On 21 Jun 2016, at 09:50, LUCAS Thomas (EXT) <thomas.lucas-ext@sgcib.com> wrote:\n> \n> Setup:\n> - 2.9.0.windows.1 x64 on a windows 7 16g ram, ssd\n> - No particular installation settings, default.\n> \n> Details:\n> - Running git from either a cmd or GitExtensions,  I encountered an issue while staging or checkout of lfs files. I am processing 3000 files for a total of 500MB.\n> Files are proccessed sequentially which is too slow for this amount of files, while lfs offer in some cases a way to run it from the command line in parallel, I think the git filters should be run in parallel. I think there is no need (or I am forgetting something) to run it sequentially.\n> \n> If I were to use a filter processing files in a parallel way, I would have my time to checkout these files be reduced from 1h30min to 1min30s.\n> \n> What actually happened instead?\n> - This is a no go for our enterprise to use git-lfs because this is too slow.\n> \n> I can't give you my repository because it is confidential.\n> \n> Anyway, I hope you can do something about it.\n\nHi Lucas,\n\nthis is a known issue and there are a few ideas how to improve the situation:\nhttps://github.com/github/git-lfs/issues/1059\nhttps://github.com/github/git-lfs/issues/931#issuecomment-172939381\n\nI am not sure if anyone is working on the batch/parallel smudge filter processing\nalready (I might have some time for that later this year). AFAIK this is not\na trivial change.\n\nThat being said, I think the Git mailing list is the wrong place to discuss GitLFS\nissues as these two projects are separate. I recommend to raise an issue here:\nhttps://github.com/github/git-lfs/issues\n\nCheers,\nLars\n\n"}]}