git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Filters should be parallelized if needed

From
LELUCAS Thomas (EXT) <thomas.lucas-ext@sgcib.com>
Date
Jun 21, 2016, 07:50 UTC
Message-ID
<ABCC694798EF214E91DB2ACCA61703690BBADA33@MMXDC2642.hermes.si.socgen>
Setup:
- 2.9.0.windows.1 x64 on a windows 7 16g ram, ssd
- No particular installation settings, default.
Details:
- Running git from either a cmd or GitExtensions,  I encountered an issue while staging or checkout of lfs files. I am processing 3000 files for a total of 500MB.
Files are proccessed sequentially which is too slow for this amount of files, while lfs offer in some cases a way to run it from the command line in parallel, I think the git filters should be run in parallel. I think there is no need (or I am forgetting something) to run it sequentially.
If I were to use a filter processing files in a parallel way, I would have my time to checkout these files be reduced from 1h30min to 1min30s.
What actually happened instead?
- This is a no go for our enterprise to use git-lfs because this is too slow.
I can't give you my repository because it is confidential.
Anyway, I hope you can do something about it.
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addresse(s), and may contain legally privileged information.
Any unauthorized use or dissemination is prohibited. E-mails are susceptible to alteration.   
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
                              ************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes 
par le secret professionnel. 
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration. 
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
Next: Lars Schneider
Message 1 of 2 in “Filters should be parallelized if needed”
  1. LUCAS Thomas (EXT)Jun 21, 2016
  2. Lars SchneiderJun 21, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.