git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 3/5] tree-walk: micro-optimization in tree_entry_interesting

From
Nguyen Thai Ngoc Duy <pclouds@gmail.com>
Date
Apr 3, 2011, 04:01 UTC
Message-ID
<20110403040119.GA18104@do>
In-Reply-To
<1301535481-1085-3-git-send-email-dpmcgee@gmail.com>
On Wed, Mar 30, 2011 at 08:37:59PM -0500, Dan McGee wrote:
Show 15 quoted lines
> In the case of a wide breadth top-level tree (~2400 entries, all trees
> in this case), we can see a noticeable cost in the profiler calling
> strncmp() here. Most of the time we are at the base level of the
> repository, so base is "" and baselen == 0, which means we will always
> test true. Break out this one tiny case so we can short circuit the
> strncmp() call.
> 
> This resulted in an ~11% improvement (43 to 38 secs) for a reasonable
> log operation on the Arch Linux Packages SVN clone repository, which
> contained 117220 commits and the aforementioned 2400 top-level objects:
>     git log -- autogen/trunk pacman/trunk/ wget/trunk/
> 
> Negligible slowdown was noted with other repositories (e.g. linux-2.6).
> 
> Signed-off-by: Dan McGee <dpmcgee@gmail.com>
Ack.

On my (slower) laptop, the same command with vanilla git -O3 takes 95 secs. Your patch cuts it down to 82 secs.

I tried inlining strncmp with a version from glibc. Without your patch it takes 88 secs. With your patch, it takes 86 secs (still worse than your patch alone). A better strncmp version must be used on my system, I suspect.

--8<--
diff --git a/tree-walk.c b/tree-walk.c
index 322becc..0859b5c 100644
--- a/tree-walk.c
+++ b/tree-walk.c
@@ -457,6 +457,55 @@ int get_tree_entry(const unsigned char *tree_sha1, const char *name, unsigned ch
 	return retval;
 }
 
+static inline int inline_strncmp(const char *s1, const char *s2, size_t n)
+{
+	unsigned char c1 = '\0';
+	unsigned char c2 = '\0';
+
+	if (n == 0)
+		return 0;
+
+	if (n >= 4) {
+		size_t n4 = n >> 2;
+		do {
+			c1 = (unsigned char) *s1++;
+			c2 = (unsigned char) *s2++;
+			if (c1 == '\0' || c1 != c2)
+				return c1 - c2;
+			c1 = (unsigned char) *s1++;
+			c2 = (unsigned char) *s2++;
+			if (c1 == '\0' || c1 != c2)
+				return c1 - c2;
+			c1 = (unsigned char) *s1++;
+			c2 = (unsigned char) *s2++;
+			if (c1 == '\0' || c1 != c2)
+				return c1 - c2;
+			c1 = (unsigned char) *s1++;
+			c2 = (unsigned char) *s2++;
+			if (c1 == '\0' || c1 != c2)
+				return c1 - c2;
+		} while (--n4 > 0);
+		n &= 3;
+	}
+
+	while (n > 0) {
+		c1 = (unsigned char) *s1++;
+		c2 = (unsigned char) *s2++;
+		if (c1 == '\0' || c1 != c2)
+			return c1 - c2;
+		n--;
+	}
+
+	return c1 - c2;
+}
+
+#if 1
+#ifdef strncmp
+#undef strncmp
+#endif
+#define strncmp inline_strncmp
+#endif
+
 static int match_entry(const struct name_entry *entry, int pathlen,
 		       const char *match, int matchlen,
 		       int *never_interesting)
--8<--
-- 
Duy
Previous: Dan McGeeNext: Junio C Hamano
Message 5 of 30 in “diff_tree_sha1: skip diff_tree if old == new”
  1. 1/5 diff_tree_sha1: skip diff_tree if old == newDan McGee, Mar 31, 2011
  2. 2/5 tree-walk: drop unused parameter from match_dir_prefixDan McGee, Mar 31, 2011
  3. Dan McGeeAug 30, 2011
  4. 3/5 tree-walk: micro-optimization in tree_entry_interestingDan McGee, Mar 31, 2011
  5. Nguyen Thai Ngoc DuyApr 3, 2011
  6. Junio C HamanoApr 3, 2011
  7. Dan McGeeApr 5, 2011
  8. tree_entry_interesting: inline strncmp()Nguyễn Thái Ngọc Duy, Apr 4, 2011
  9. 4/5 tree-walk: unroll get_mode since loop boundaries are well-knownDan McGee, Mar 31, 2011
  10. Nguyen Thai Ngoc DuyApr 2, 2011
  11. Dan McGeeApr 2, 2011
  12. Nguyen Thai Ngoc DuyApr 3, 2011
  13. Erik Faye-LundApr 4, 2011
  14. Andreas EricssonApr 4, 2011
  15. Junio C HamanoApr 4, 2011
  16. Dan McGeeApr 5, 2011
  17. Antriksh PanyApr 5, 2011
  18. Dan McGeeApr 6, 2011
  19. 5/5 tree-walk: match_entry microoptimizationDan McGee, Mar 31, 2011
  20. Nguyen Thai Ngoc DuyApr 2, 2011
  21. Dan McGeeApr 2, 2011
  22. Nguyen Thai Ngoc DuyMar 31, 2011
  23. Dan McGeeMar 31, 2011
  24. Junio C HamanoApr 1, 2011
  25. Nguyen Thai Ngoc DuyMay 3, 2011
  26. Fwd: [PATCH 1/5] diff_tree_sha1: skip diff_tree if old == newDan McGee, Apr 2, 2011
  27. Dan McGeeAug 30, 2011
  28. Junio C HamanoAug 30, 2011
  29. 1/2 tree-walk: drop unused parameter from match_dir_prefixDan McGee, Sep 9, 2011
  30. 2/2 tree-walk: micro-optimization in tree_entry_interestingDan McGee, Sep 9, 2011

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.