git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH v4 5/5] diff-lib: parallelize run_diff_files for submodules

From
Calvin Wan <calvinwan@google.com>
Date
Nov 30, 2022, 18:11 UTC
Message-ID
<CAFySSZD8NjOHpM6PBCVxBzB-m2WuBCTppZWB0waP9svo=O1C0A@mail.gmail.com>
In-Reply-To
<kl6lr0xlqtrc.fsf@chooglen-macbookpro.roam.corp.google.com>
On Tue, Nov 29, 2022 at 2:29 PM Glen Choo <chooglen@google.com> wrote:
Show 27 quoted lines
>
> Jonathan Tan <jonathantanmy@google.com> writes:
>
> > Calvin Wan <calvinwan@google.com> writes:
> >>  submodule.c                        | 154 +++++++++++++++++++++++++++++
> >
> > I think the way to implement this is to have a parallel implementation,
> > and then have the serial implementation call the parallel implementation's
> > functions, or have a common set of functions that both the parallel
> > implementation and the serial implementation call. Here, it seems that
> > the parallel implementation exists completely separate from the serial
> > implementation, with no code shared. That makes it both more difficult to
> > review, and also makes it difficult to make changes to how we diff submodules
> > in the future (since we would have to make changes in two parts of the code).
>
> It seems that most of the code is copied from is_submodule_modified(),
> so a possible way to do this would be:
>
> - Split is_submodule_modified() into 2 functions, one that sets up the
>   "git status --porcelain=2" process (named something like
>   setup_status_porcelain()) and one that parses its output (this is
>   parse_status_porcelain() in Patch 2). The serial implementation
>   (is_submodule_modified()) uses both of these and has some extra logic
>   to run the child process.
>
> - Refactor get_next_submodule_status() (from this patch) to use
>   setup_status_porcelain().
That sounds like a reasonable plan to me. Thanks!
Previous: Glen ChooNext: Elijah Newren
Message 24 of 26 in “submodule: parallelize diff”
  1. 0/5 submodule: parallelize diffCalvin Wan, Nov 8, 2022
  2. Glen ChooNov 23, 2022
  3. Junio C HamanoJan 15, 2023
  4. Calvin WanJan 17, 2023
  5. 1/5 run-command: add duplicate_output_fn to run_processes_parallel_optsCalvin Wan, Nov 8, 2022
  6. Jonathan TanNov 28, 2022
  7. Calvin WanNov 30, 2022
  8. Elijah NewrenNov 29, 2022
  9. Calvin WanNov 30, 2022
  10. Glen ChooNov 29, 2022
  11. Ævar Arnfjörð BjarmasonNov 30, 2022
  12. Phillip WoodNov 30, 2022
  13. Calvin WanNov 30, 2022
  14. Phillip WoodNov 30, 2022
  15. Ævar Arnfjörð BjarmasonNov 30, 2022
  16. 2/5 submodule: strbuf variable renameCalvin Wan, Nov 8, 2022
  17. 3/5 submodule: move status parsing into functionCalvin Wan, Nov 8, 2022
  18. 4/5 diff-lib: refactor match_stat_with_submoduleCalvin Wan, Nov 8, 2022
  19. Phillip WoodNov 30, 2022
  20. Calvin WanNov 30, 2022
  21. 5/5 diff-lib: parallelize run_diff_files for submodulesCalvin Wan, Nov 8, 2022
  22. Jonathan TanNov 28, 2022
  23. Glen ChooNov 29, 2022
  24. Calvin WanNov 30, 2022
  25. Elijah NewrenNov 29, 2022
  26. Calvin WanNov 30, 2022

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.