git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH v2 05/46] Add parse_pathspec() that converts cmdline args to struct pathspec

From
Nguyễn Thái Ngọc Duy <pclouds@gmail.com>
Date
Jul 14, 2013, 08:35 UTC
Message-ID
<1373790969-13000-6-git-send-email-pclouds@gmail.com>
In-Reply-To
<1373790969-13000-1-git-send-email-pclouds@gmail.com>
Currently to fill a struct pathspec, we do:
   const char **paths;
   paths = get_pathspec(prefix, argv);
   ...
   init_pathspec(&pathspec, paths);

"paths" can only carry bare strings, which loses information from command line arguments such as pathspec magic or the prefix part's length for each argument.

parse_pathspec() is introduced to combine the two calls into one. The plan is gradually replace all get_pathspec() and init_pathspec() with parse_pathspec(). get_pathspec() now becomes a thin wrapper of parse_pathspec().

parse_pathspec() allows the caller to reject the pathspec magics that it does not support. When a new pathspec magic is introduced, we can enable it per command after making sure that all underlying code has no problem with the new magic.

"flags" parameter is currently unused. But it would allow callers to pass certain instructions to parse_pathspec, for example forcing literal pathspec when no magic is used.

With the introduction of parse_pathspec, there are now two functions that can initialize struct pathspec: init_pathspec and parse_pathspec. Any semantic changes in struct pathspec must be reflected in both functions. init_pathspec() will be phased out in favor of parse_pathspec().

Signed-off-by: Nguyễn Thái Ngọc Duy <pclouds@gmail.com>
---
 Documentation/technical/api-setup.txt |  19 +++-
 dir.c                                 |   4 +-
 dir.h                                 |   2 +
 pathspec.c                            | 168 ++++++++++++++++++++++++++--------
 pathspec.h                            |  11 +++
 5 files changed, 163 insertions(+), 41 deletions(-)
diff --git a/Documentation/technical/api-setup.txt b/Documentation/technical/api-setup.txt
index 4f63a04..90d1aff 100644
--- a/Documentation/technical/api-setup.txt
+++ b/Documentation/technical/api-setup.txt
@@ -8,6 +8,23 @@ Talk about
 * is_inside_git_dir()
 * is_inside_work_tree()
 * setup_work_tree()
-* get_pathspec()
 
 (Dscho)
+
+Pathspec
+--------
+
+See glossary-context.txt for the syntax of pathspec. In memory, a
+pathspec set is represented by "struct pathspec" and is prepared by
+parse_pathspec(). This function takes several arguments:
+
+- magic_mask specifies what features that are NOT supported by the
+  following code. If a user attempts to use such a feature,
+  parse_pathspec() can reject it early.
+
+- flags specifies other things that the caller wants parse_pathspec to
+  perform.
+
+- prefix and args come from cmd_* functions
+
+get_pathspec() is obsolete and should never be used in new code.
diff --git a/dir.c b/dir.c
index b0599dd..5f86e46 100644
--- a/dir.c
+++ b/dir.c
@@ -381,7 +381,7 @@ int match_pathspec_depth(const struct pathspec *ps,
 /*
  * Return the length of the "simple" part of a path match limiter.
  */
-static int simple_length(const char *match)
+int simple_length(const char *match)
 {
 	int len = -1;
 
@@ -393,7 +393,7 @@ static int simple_length(const char *match)
 	}
 }
 
-static int no_wildcard(const char *string)
+int no_wildcard(const char *string)
 {
 	return string[simple_length(string)] == '\0';
 }
diff --git a/dir.h b/dir.h
index 3d6b80c..229ccc8 100644
--- a/dir.h
+++ b/dir.h
@@ -128,6 +128,8 @@ struct dir_struct {
 #define MATCHED_RECURSIVELY 1
 #define MATCHED_FNMATCH 2
 #define MATCHED_EXACTLY 3
+extern int simple_length(const char *match);
+extern int no_wildcard(const char *string);
 extern char *common_prefix(const char **pathspec);
 extern int match_pathspec(const char **pathspec, const char *name, int namelen, int prefix, char *seen);
 extern int match_pathspec_depth(const struct pathspec *pathspec,
diff --git a/pathspec.c b/pathspec.c
index 8fe56cd..ce942db 100644
--- a/pathspec.c
+++ b/pathspec.c
@@ -103,10 +103,6 @@ void die_if_path_beyond_symlink(const char *path, const char *prefix)
 /*
  * Magic pathspec
  *
- * NEEDSWORK: These need to be moved to dir.h or even to a new
- * pathspec.h when we restructure get_pathspec() users to use the
- * "struct pathspec" interface.
- *
  * Possible future magic semantics include stuff like:
  *
  *	{ PATHSPEC_NOGLOB, '!', "noglob" },
@@ -115,7 +111,6 @@ void die_if_path_beyond_symlink(const char *path, const char *prefix)
  *	{ PATHSPEC_REGEXP, '\0', "regexp" },
  *
  */
-#define PATHSPEC_FROMTOP    (1<<0)
 
 static struct pathspec_magic {
 	unsigned bit;
@@ -127,7 +122,7 @@ static struct pathspec_magic {
 
 /*
  * Take an element of a pathspec and check for magic signatures.
- * Append the result to the prefix.
+ * Append the result to the prefix. Return the magic bitmap.
  *
  * For now, we only parse the syntax and throw out anything other than
  * "top" magic.
@@ -138,10 +133,15 @@ static struct pathspec_magic {
  * the prefix part must always match literally, and a single stupid
  * string cannot express such a case.
  */
-static const char *prefix_pathspec(const char *prefix, int prefixlen, const char *elt)
+static unsigned prefix_pathspec(struct pathspec_item *item,
+				unsigned *p_short_magic,
+				const char **raw, unsigned flags,
+				const char *prefix, int prefixlen,
+				const char *elt)
 {
-	unsigned magic = 0;
+	unsigned magic = 0, short_magic = 0;
 	const char *copyfrom = elt;
+	char *match;
 	int i;
 
 	if (elt[0] != ':') {
@@ -184,7 +184,7 @@ static const char *prefix_pathspec(const char *prefix, int prefixlen, const char
 				break;
 			for (i = 0; i < ARRAY_SIZE(pathspec_magic); i++)
 				if (pathspec_magic[i].mnemonic == ch) {
-					magic |= pathspec_magic[i].bit;
+					short_magic |= pathspec_magic[i].bit;
 					break;
 				}
 			if (ARRAY_SIZE(pathspec_magic) <= i)
@@ -195,15 +195,128 @@ static const char *prefix_pathspec(const char *prefix, int prefixlen, const char
 			copyfrom++;
 	}
 
+	magic |= short_magic;
+	*p_short_magic = short_magic;
+
 	if (magic & PATHSPEC_FROMTOP)
-		return xstrdup(copyfrom);
+		match = xstrdup(copyfrom);
 	else
-		return prefix_path(prefix, prefixlen, copyfrom);
+		match = prefix_path(prefix, prefixlen, copyfrom);
+	*raw = item->match = match;
+	item->len = strlen(item->match);
+	if (limit_pathspec_to_literal())
+		item->nowildcard_len = item->len;
+	else
+		item->nowildcard_len = simple_length(item->match);
+	item->flags = 0;
+	if (item->nowildcard_len < item->len &&
+	    item->match[item->nowildcard_len] == '*' &&
+	    no_wildcard(item->match + item->nowildcard_len + 1))
+		item->flags |= PATHSPEC_ONESTAR;
+	return magic;
+}
+
+static int pathspec_item_cmp(const void *a_, const void *b_)
+{
+	struct pathspec_item *a, *b;
+
+	a = (struct pathspec_item *)a_;
+	b = (struct pathspec_item *)b_;
+	return strcmp(a->match, b->match);
+}
+
+static void NORETURN unsupported_magic(const char *pattern,
+				       unsigned magic,
+				       unsigned short_magic)
+{
+	struct strbuf sb = STRBUF_INIT;
+	int i, n;
+	for (n = i = 0; i < ARRAY_SIZE(pathspec_magic); i++) {
+		const struct pathspec_magic *m = pathspec_magic + i;
+		if (!(magic & m->bit))
+			continue;
+		if (sb.len)
+			strbuf_addstr(&sb, " ");
+		if (short_magic & m->bit)
+			strbuf_addf(&sb, "'%c'", m->mnemonic);
+		else
+			strbuf_addf(&sb, "'%s'", m->name);
+		n++;
+	}
+	/*
+	 * We may want to substitute "this command" with a command
+	 * name. E.g. when add--interactive dies when running
+	 * "checkout -p"
+	 */
+	die(_("%s: pathspec magic not supported by this command: %s"),
+	    pattern, sb.buf);
+}
+
+/*
+ * Given command line arguments and a prefix, convert the input to
+ * pathspec. die() if any magic in magic_mask is used.
+ */
+void parse_pathspec(struct pathspec *pathspec,
+		    unsigned magic_mask, unsigned flags,
+		    const char *prefix, const char **argv)
+{
+	struct pathspec_item *item;
+	const char *entry = argv ? *argv : NULL;
+	int i, n, prefixlen;
+
+	memset(pathspec, 0, sizeof(*pathspec));
+
+	/* No arguments, no prefix -> no pathspec */
+	if (!entry && !prefix)
+		return;
+
+	/* No arguments with prefix -> prefix pathspec */
+	if (!entry) {
+		static const char *raw[2];
+
+		pathspec->items = item = xmalloc(sizeof(*item));
+		memset(item, 0, sizeof(*item));
+		item->match = prefix;
+		item->nowildcard_len = item->len = strlen(prefix);
+		raw[0] = prefix;
+		raw[1] = NULL;
+		pathspec->nr = 1;
+		pathspec->raw = raw;
+		return;
+	}
+
+	n = 0;
+	while (argv[n])
+		n++;
+
+	pathspec->nr = n;
+	pathspec->items = item = xmalloc(sizeof(*item) * n);
+	pathspec->raw = argv;
+	prefixlen = prefix ? strlen(prefix) : 0;
+
+	for (i = 0; i < n; i++) {
+		unsigned short_magic;
+		entry = argv[i];
+
+		item[i].magic = prefix_pathspec(item + i, &short_magic,
+						argv + i, flags,
+						prefix, prefixlen, entry);
+		if (item[i].magic & magic_mask)
+			unsupported_magic(entry,
+					  item[i].magic & magic_mask,
+					  short_magic);
+		if (item[i].nowildcard_len < item[i].len)
+			pathspec->has_wildcard = 1;
+		pathspec->magic |= item[i].magic;
+	}
+
+	qsort(pathspec->items, pathspec->nr,
+	      sizeof(struct pathspec_item), pathspec_item_cmp);
 }
 
 /*
  * N.B. get_pathspec() is deprecated in favor of the "struct pathspec"
- * based interface - see pathspec_magic above.
+ * based interface - see pathspec.c:parse_pathspec().
  *
  * Arguments:
  *  - prefix - a path relative to the root of the working tree
@@ -222,32 +335,11 @@ static const char *prefix_pathspec(const char *prefix, int prefixlen, const char
  */
 const char **get_pathspec(const char *prefix, const char **pathspec)
 {
-	const char *entry = *pathspec;
-	const char **src, **dst;
-	int prefixlen;
-
-	if (!prefix && !entry)
-		return NULL;
-
-	if (!entry) {
-		static const char *spec[2];
-		spec[0] = prefix;
-		spec[1] = NULL;
-		return spec;
-	}
-
-	/* Otherwise we have to re-write the entries.. */
-	src = pathspec;
-	dst = pathspec;
-	prefixlen = prefix ? strlen(prefix) : 0;
-	while (*src) {
-		*(dst++) = prefix_pathspec(prefix, prefixlen, *src);
-		src++;
-	}
-	*dst = NULL;
-	if (!*pathspec)
-		return NULL;
-	return pathspec;
+	struct pathspec ps;
+	parse_pathspec(&ps,
+		       PATHSPEC_ALL_MAGIC & ~PATHSPEC_FROMTOP,
+		       0, prefix, pathspec);
+	return ps.raw;
 }
 
 void copy_pathspec(struct pathspec *dst, const struct pathspec *src)
diff --git a/pathspec.h b/pathspec.h
index a621676..937ec91 100644
--- a/pathspec.h
+++ b/pathspec.h
@@ -1,6 +1,10 @@
 #ifndef PATHSPEC_H
 #define PATHSPEC_H
 
+/* Pathspec magic */
+#define PATHSPEC_FROMTOP	(1<<0)
+#define PATHSPEC_ALL_MAGIC PATHSPEC_FROMTOP
+
 #define PATHSPEC_ONESTAR 1	/* the pathspec pattern sastisfies GFNM_ONESTAR */
 
 struct pathspec {
@@ -8,9 +12,11 @@ struct pathspec {
 	int nr;
 	unsigned int has_wildcard:1;
 	unsigned int recursive:1;
+	unsigned magic;
 	int max_depth;
 	struct pathspec_item {
 		const char *match;
+		unsigned magic;
 		int len;
 		int nowildcard_len;
 		int flags;
@@ -18,6 +24,11 @@ struct pathspec {
 };
 
 extern int init_pathspec(struct pathspec *, const char **);
+extern void parse_pathspec(struct pathspec *pathspec,
+			   unsigned magic_mask,
+			   unsigned flags,
+			   const char *prefix,
+			   const char **args);
 extern void copy_pathspec(struct pathspec *dst, const struct pathspec *src);
 extern void free_pathspec(struct pathspec *);
 
-- 
1.8.2.83.gc99314b
Previous: Nguyễn Thái Ngọc DuyNext: Nguyễn Thái Ngọc Duy
Message 6 of 52 in “"struct pathspec" conversion and :(glob) and :(icase)”
  1. 00/46 "struct pathspec" conversion and :(glob) and :(icase)Nguyễn Thái Ngọc Duy, Jul 14, 2013
  2. 01/46 clean: remove unused variable "seen"Nguyễn Thái Ngọc Duy, Jul 14, 2013
  3. 02/46 Move struct pathspec and related functions to pathspec.[ch]Nguyễn Thái Ngọc Duy, Jul 14, 2013
  4. 03/46 pathspec: i18n-ize error strings in pathspec parsing codeNguyễn Thái Ngọc Duy, Jul 14, 2013
  5. 04/46 pathspec: add copy_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  6. 05/46 Add parse_pathspec() that converts cmdline args to struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  7. 06/46 parse_pathspec: save original pathspec for reportingNguyễn Thái Ngọc Duy, Jul 14, 2013
  8. 07/46 parse_pathspec: add PATHSPEC_PREFER_{CWD,FULL}Nguyễn Thái Ngọc Duy, Jul 14, 2013
  9. 08/46 Convert some get_pathspec() calls to parse_pathspec()Nguyễn Thái Ngọc Duy, Jul 14, 2013
  10. 09/46 parse_pathspec: add special flag for max_depth featureNguyễn Thái Ngọc Duy, Jul 14, 2013
  11. 10/46 parse_pathspec: support stripping submodule trailing slashesNguyễn Thái Ngọc Duy, Jul 14, 2013
  12. 11/46 parse_pathspec: support stripping/checking submodule pathsNguyễn Thái Ngọc Duy, Jul 14, 2013
  13. 12/46 parse_pathspec: support prefixing original patternsNguyễn Thái Ngọc Duy, Jul 14, 2013
  14. 13/46 Guard against new pathspec magic in pathspec matching codeNguyễn Thái Ngọc Duy, Jul 14, 2013
  15. 14/46 clean: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  16. 15/46 commit: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  17. 16/46 status: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  18. 17/46 rerere: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  19. 18/46 checkout: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  20. 19/46 rm: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  21. 20/46 ls-files: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  22. 21/46 archive: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  23. 22/46 check-ignore: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  24. 23/46 add: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  25. 24/46 reset: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  26. 25/46 line-log: convert to use parse_pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  27. 26/46 Convert read_cache_preload() to take struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  28. 27/46 Convert run_add_interactive to use struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  29. 28/46 Convert unmerge_cache to take struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  30. 29/46 checkout: convert read_tree_some to take struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  31. 30/46 Convert report_path_error to take struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  32. 31/46 Convert refresh_index to take struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  33. 32/46 Convert {read,fill}_directory to take struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  34. 33/46 Convert add_files_to_cache to take struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  35. 34/46 Convert common_prefix() to use struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  36. 35/46 Remove diff_tree_{setup,release}_pathsNguyễn Thái Ngọc Duy, Jul 14, 2013
  37. 36/46 Remove init_pathspec() in favor of parse_pathspec()Nguyễn Thái Ngọc Duy, Jul 14, 2013
  38. 37/46 Remove match_pathspec() in favor of match_pathspec_depth()Nguyễn Thái Ngọc Duy, Jul 14, 2013
  39. 38/46 tree-diff: remove the use of pathspec's raw[] in follow-rename codepathNguyễn Thái Ngọc Duy, Jul 14, 2013
  40. 39/46 Rename field "raw" to "_raw" in struct pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  41. 40/46 parse_pathspec: make sure the prefix part is wildcard-freeNguyễn Thái Ngọc Duy, Jul 14, 2013
  42. 41/46 parse_pathspec: preserve prefix length via PATHSPEC_PREFIX_ORIGINNguyễn Thái Ngọc Duy, Jul 14, 2013
  43. 42/46 Kill limit_pathspec_to_literal() as it's only used by parse_pathspec()Nguyễn Thái Ngọc Duy, Jul 14, 2013
  44. 43/46 pathspec: support :(literal) syntax for noglob pathspecNguyễn Thái Ngọc Duy, Jul 14, 2013
  45. 44/46 pathspec: make --literal-pathspecs disable pathspec magicNguyễn Thái Ngọc Duy, Jul 14, 2013
  46. 45/46 pathspec: support :(glob) syntaxNguyễn Thái Ngọc Duy, Jul 14, 2013
  47. 46/46 parse_pathspec: accept :(icase)path syntaxNguyễn Thái Ngọc Duy, Jul 14, 2013
  48. Eric SunshineJul 14, 2013
  49. Junio C HamanoJul 15, 2013
  50. Junio C HamanoJul 15, 2013
  51. "git fmt-merge-msg" usage (was [PATCH v2 00/46] "struct pathspec" conversion and :(glob) and :(icase))Michael Haggerty, Aug 16, 2013
  52. Junio C HamanoAug 18, 2013

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.