threads / patch / 42695

patchpathspec: warn on empty strings as pathspec

Subject: [PATCH] pathspec: warn on empty strings as pathspec

## tl;dr

5 messages between Jun 22, 2016 and Jun 24, 2016. Diffs are folded; open one to read it.

replies: 4people: 2as markdown or json

Emily Xie· Jun 22, 2016, 23:00 UTC · lore

Currently, passing an empty string as a pathspec results in a match on all paths. This is because a pathspec match is a leading substring match that honors directory boundaries. So, just as pathspec "dir/" (or "dir") matches "dir/file", "" matches "file".

However, this causes problems. Namely, a user's carelessly-written script could accidentally assign an empty string to a variable that then gets passed to a Git command invocation, e.g.:

        git rm -r "$path"
        git add "$path"

which would unintentionally affect all paths in the current directory.

The fix for this issue requires a two-step approach. As there may be existing scripts that knowingly use empty strings in this manner, the first step simply invokes a warning that (1) declares using empty strings to match all paths will become invalid and (2) asks the user to use "." if their intent was to match all.

For step two, a follow-up patch several release cycles later will remove the warnings and throw an error instead.

This patch is the first step.
Signed-off-by: Emily Xie <emilyxxie@gmail.com>
Reported-by: David Turner <novalis@novalis.org>
Mentored-by: Michail Denchev <mdenchev@gmail.com>
Thanks-to: Sarah Sharp <sarah@thesharps.us> and James Sharp <jamey@minilop.net>
---
 pathspec.c     | 11 +++++++++--
 t/t3600-rm.sh  |  5 +++++
 t/t3700-add.sh |  5 +++++
 3 files changed, 19 insertions(+), 2 deletions(-)
Show changes to 3 files +19 −2

pathspec.c, t/t3600-rm.sh, t/t3700-add.sh

diff --git a/pathspec.c b/pathspec.c
index c9e9b6c..02aa691 100644
--- a/pathspec.c
+++ b/pathspec.c
@@ -364,7 +364,7 @@ void parse_pathspec(struct pathspec *pathspec,
 {
 	struct pathspec_item *item;
 	const char *entry = argv ? *argv : NULL;
-	int i, n, prefixlen, nr_exclude = 0;
+	int i, n, prefixlen, warn_empty_string, nr_exclude = 0;
 
 	memset(pathspec, 0, sizeof(*pathspec));
 
@@ -402,8 +402,15 @@ void parse_pathspec(struct pathspec *pathspec,
 	}
 
 	n = 0;
-	while (argv[n])
+	warn_empty_string = 1;
+	while (argv[n]) {
+		if (*argv[n] == '\0' && warn_empty_string) {
+			warning(_("empty strings as pathspecs will be made invalid in upcoming releases. "
+			          "please use . instead if you meant to match all paths"));
+			warn_empty_string = 0;
+		}
 		n++;
+	}
 
 	pathspec->nr = n;
 	ALLOC_ARRAY(pathspec->items, n);
diff --git a/t/t3600-rm.sh b/t/t3600-rm.sh
index d046d98..14f0edc 100755
--- a/t/t3600-rm.sh
+++ b/t/t3600-rm.sh
@@ -881,4 +881,9 @@ test_expect_success 'rm files with two different errors' '
 	test_i18ncmp expect actual
 '
 
+test_expect_success 'rm empty string should invoke warning' '
+	git rm -rf "" 2>output &&
+	test_i18ngrep "warning: empty strings" output
+'
+
 test_done
diff --git a/t/t3700-add.sh b/t/t3700-add.sh
index f14a665..05379d0 100755
--- a/t/t3700-add.sh
+++ b/t/t3700-add.sh
@@ -332,4 +332,9 @@ test_expect_success 'git add --dry-run --ignore-missing of non-existing file out
 	test_i18ncmp expect.err actual.err
 '
 
+test_expect_success 'git add empty string should invoke warning' '
+	git add "" 2>output &&
+	test_i18ngrep "warning: empty strings" output
+'
+
 test_done
-- 
2.8.4
Junio C Hamano· Jun 22, 2016, 23:12 UTC · re: Emily Xie · lore

Re: [PATCH] pathspec: warn on empty strings as pathspec

Emily Xie <emilyxxie@gmail.com> writes:
Show 17 quoted lines
> The fix for this issue requires a two-step approach. As
> there may be existing scripts that knowingly use empty
> strings in this manner, the first step simply invokes a
> warning that (1) declares using empty strings to
> match all paths will become invalid and (2) asks the user
> to use "." if their intent was to match all.
>
> For step two, a follow-up patch several release cycles
> later will remove the warnings and throw an error instead.
>
> This patch is the first step.
>
> Signed-off-by: Emily Xie <emilyxxie@gmail.com>
> Reported-by: David Turner <novalis@novalis.org>
> Mentored-by: Michail Denchev <mdenchev@gmail.com>
> Thanks-to: Sarah Sharp <sarah@thesharps.us> and James Sharp <jamey@minilop.net>
> ---

Looks sensible. I personally do not think warn-only-once matters in practice, but now you have implemented it, it is an additional nice touch ;-)

Will queue.
Thanks.
Emily Xie· Jun 22, 2016, 23:48 UTC · re: Junio C Hamano · lore

Re: [PATCH] pathspec: warn on empty strings as pathspec

Awesome. Thanks, Junio---this is exciting!

As for step 2: do you have a good sense on the timing? Around how long should I wait to submit the patch for it?

Otherwise, let me know if there is anything else that I need to do!
- Emily
Junio C Hamano· Jun 23, 2016, 06:17 UTC · re: Emily Xie · lore

Re: [PATCH] pathspec: warn on empty strings as pathspec

Emily Xie <emilyxxie@gmail.com> writes:
> Awesome. Thanks, Junio---this is exciting!
No, thank _you_.
> As for step 2: do you have a good sense on the timing? Around how long
> should I wait to submit the patch for it?
Not so fast.  We'll wait for others to comment first.

I am queuing this change but that does not mean anything more than that I am not outright rejecting the idea.

It is possible that others may assess the cost of having to do the two-step migration differently, and the list concensus may end up being "if it hurts, don't pass an empty string", i.e. we'd better without this patch or subsequent second step. If that happens, the first step dies without hitting 'next'. I'd say we'd wait at least for a week.

Otherwise, if the change is received favourably, we'll merge it to 'next', do the same waiting for comments. Repeat the same and then merge to 'master'. After it hits the next feature release (probably at around the end of August), the change will be seen by wider general public, and at that point we may see strong opposition from them with a good argument neither of us thought of why we shouldn't do this change, in which case we might have to revise the plan and scrap the whole thing.

So, we'll wait and see.
Emily Xie· Jun 24, 2016, 18:21 UTC · re: Junio C Hamano · lore

Re: [PATCH] pathspec: warn on empty strings as pathspec

I suppose I got ahead of myself there. :-) Thanks for the clarification on the process.

On Thu, Jun 23, 2016 at 2:17 AM, Junio C Hamano <gitster@pobox.com> wrote:
Show 32 quoted lines
> Emily Xie <emilyxxie@gmail.com> writes:
>
>> Awesome. Thanks, Junio---this is exciting!
>
> No, thank _you_.
>
>> As for step 2: do you have a good sense on the timing? Around how long
>> should I wait to submit the patch for it?
>
> Not so fast.  We'll wait for others to comment first.
>
> I am queuing this change but that does not mean anything more than
> that I am not outright rejecting the idea.
>
> It is possible that others may assess the cost of having to do the
> two-step migration differently, and the list concensus may end up
> being "if it hurts, don't pass an empty string", i.e. we'd better
> without this patch or subsequent second step.  If that happens, the
> first step dies without hitting 'next'.  I'd say we'd wait at least
> for a week.
>
> Otherwise, if the change is received favourably, we'll merge it to
> 'next', do the same waiting for comments.  Repeat the same and then
> merge to 'master'.  After it hits the next feature release (probably
> at around the end of August), the change will be seen by wider
> general public, and at that point we may see strong opposition from
> them with a good argument neither of us thought of why we shouldn't
> do this change, in which case we might have to revise the plan and
> scrap the whole thing.
>
> So, we'll wait and see.
>
-- 
Emily Xie
xie-emily.com
207.399.6370

← back to recent threads