git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 5/6] submodule: improve submodule_has_commits

From
Junio C Hamano <gitster@pobox.com>
Date
May 1, 2017, 03:37 UTC
Message-ID
<xmqqmvaxgscr.fsf@gitster.mtv.corp.google.com>
In-Reply-To
<20170428235402.162251-6-bmwill@google.com>
Brandon Williams <bmwill@google.com> writes:
Show 27 quoted lines
>  	oid_array_for_each_unique(commits, check_has_commit, &has_commit);
> +
> +	if (has_commit) {
> +		/*
> +		 * Even if the submodule is checked out and the commit is
> +		 * present, make sure it is reachable from a ref.
> +		 */
> +		struct child_process cp = CHILD_PROCESS_INIT;
> +		struct strbuf out = STRBUF_INIT;
> +
> +		argv_array_pushl(&cp.args, "rev-list", "-n", "1", NULL);
> +		oid_array_for_each_unique(commits, append_oid_to_argv, &cp.args);
> +		argv_array_pushl(&cp.args, "--not", "--all", NULL);
> +
> +		prepare_submodule_repo_env(&cp.env_array);
> +		cp.git_cmd = 1;
> +		cp.no_stdin = 1;
> +		cp.dir = path;
> +
> +		if (capture_command(&cp, &out, 1024) || out.len)
> +			has_commit = 0;
> +
> +		strbuf_release(&out);
> +	}
> +
>  	return has_commit;
>  }

The "check-has-commit" we see in the pre-context is "we contaminated our in-core object store by tentatively borrowing from submodule's object store---now do we see these commits in our in-core view?" Which is a wrong thing to do from two separate point of view. Even though the commit in question may be visible in our contaminated view, there is no guarantee that the commit exists in the object store of the correct submodule. And of course the commit may exist but may not be anchored by any ref.

This patch fixes the latter, and if we remove that check-has-commit call before it, we can fix the former at the same time.

There is value in leaving the check-has-commit code if we anticipate that we would very often have to say "no, the submodule does not have these commits"---a cheap but wrong check it does can be used as an optimization. If we do not have the commit object anywhere, there is no chance we have it in the object store of the correct submodule and have it reachable from a ref, so we can fail without spawning rev-list which is expensive.

Previous: Brandon WilliamsNext: Brandon Williams
Message 14 of 33 in “changed submodules”
  1. 0/6 changed submodulesBrandon Williams, Apr 28, 2017
  2. 1/6 submodule: rename add_sha1_to_arrayBrandon Williams, Apr 28, 2017
  3. Junio C HamanoMay 1, 2017
  4. 4/6 submodule: change string_list changed_submodule_pathsBrandon Williams, Apr 28, 2017
  5. Junio C HamanoMay 1, 2017
  6. Brandon WilliamsMay 1, 2017
  7. 3/6 submodule: remove add_oid_to_argvBrandon Williams, Apr 28, 2017
  8. 2/6 submodule: rename free_submodules_sha1sBrandon Williams, Apr 28, 2017
  9. 5/6 submodule: improve submodule_has_commitsBrandon Williams, Apr 28, 2017
  10. Stefan BellerApr 29, 2017
  11. Brandon WilliamsApr 30, 2017
  12. Stefan BellerMay 1, 2017
  13. Brandon WilliamsMay 1, 2017
  14. Junio C HamanoMay 1, 2017
  15. Brandon WilliamsMay 1, 2017
  16. 6/6 submodule: refactor logic to determine changed submodulesBrandon Williams, Apr 28, 2017
  17. Stefan BellerApr 29, 2017
  18. Brandon WilliamsMay 1, 2017
  19. Junio C HamanoMay 1, 2017
  20. 0/6 changed submodulesBrandon Williams, May 2, 2017
  21. 1/6 submodule: rename add_sha1_to_arrayBrandon Williams, May 2, 2017
  22. Stefan BellerMay 2, 2017
  23. Brandon WilliamsMay 2, 2017
  24. 2/6 submodule: rename free_submodules_sha1sBrandon Williams, May 2, 2017
  25. 3/6 submodule: remove add_oid_to_argvBrandon Williams, May 2, 2017
  26. 5/6 submodule: improve submodule_has_commitsBrandon Williams, May 2, 2017
  27. Stefan BellerMay 2, 2017
  28. Brandon WilliamsMay 2, 2017
  29. Stefan BellerMay 2, 2017
  30. Brandon WilliamsMay 2, 2017
  31. Brandon WilliamsMay 2, 2017
  32. 6/6 submodule: refactor logic to determine changed submodulesBrandon Williams, May 2, 2017
  33. 4/6 submodule: change string_list changed_submodule_pathsBrandon Williams, May 2, 2017

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.