threads / patch / 32388

v3git-completion.bash: add support for path completion

Subject: [PATCH v3] git-completion.bash: add support for path completion

## tl;dr

5 messages between Dec 18, 2012 and Dec 18, 2012. Diffs are folded; open one to read it.

replies: 4people: 2as markdown or json

Manlio Perillo· Dec 18, 2012, 17:25 UTC · lore

The git-completion.bash script did not implemented full, git aware, support for completion, for git commands that operate on files within the current working directory or the index.

For these commands, only long options completion was available. As an example:

	git add <TAB>

will suggest all files in the current working directory, including ignored files and files that have not been modified.

Full support for completion is now implemented, for git commands where the non-option arguments always refer to paths within the current working directory or the index, as the follow:

* the path completion for the "git mv", "git rm" and "git ls-tree"
  commands will suggest all cached files.
* the path completion for the "git add" command will suggest all
  untracked and modified files.  Ignored files are excluded.
* the path completion for the "git clean" command will suggest all
  untracked files.  Ignored files are excluded.
* the path completion for the "git commit" command will suggest all
  files that have been modified from the HEAD.

For all affected commands, completion will always stop at directory boundary. Only standard ignored files are excluded, using the --exclude-standard option of the ls-files command.

Signed-off-by: Manlio Perillo <manlio.perillo@gmail.com>
---
 contrib/completion/git-completion.bash | 112 ++++++++++++++++++++++++++++-----
 1 file changed, 97 insertions(+), 15 deletions(-)
Show changes to contrib/completion/git-completion.bash +97 −15
diff --git a/contrib/completion/git-completion.bash b/contrib/completion/git-completion.bash
index 0b77eb1..923ef37 100644
--- a/contrib/completion/git-completion.bash
+++ b/contrib/completion/git-completion.bash
@@ -13,6 +13,7 @@
 #    *) .git/remotes file names
 #    *) git 'subcommands'
 #    *) tree paths within 'ref:path/to/file' expressions
+#    *) file paths within current working directory and index
 #    *) common --long-options
 #
 # To use these routines:
@@ -233,6 +234,59 @@ __gitcomp_nl ()
 	COMPREPLY=($(compgen -P "${2-}" -S "${4- }" -W "$1" -- "${3-$cur}"))
 }
 
+# Perl filter used to process path list returned by ls-files and
+# diff-index --name-only commands, in order to list file names
+# relative to a specified directory, and append a slash to directory
+# names.
+# The script expects the prefix path in the "pfx" environ variable.
+# The output must be processed with the uniq filter, to remove
+# duplicate directories.
+# XXX remove duplicates in the Perl script ?
+__git_index_file_list_filter='$pfx = $ENV{"pfx"};
+			$idx = index($_, $pfx);
+			if ($idx == 0) {
+				$_ = substr $_, length($pfx);
+				@segments = split("/", $_);
+				if ($segments[1]) {
+					print $segments[0], "/\n"
+				} else {
+					print $segments[0], "\n"
+				}
+			}'
+
+# __git_files accepts 1 or 2 arguments:
+# 1: A string for file index status mode ("c", "m", "d", "o"), as
+#    supported by git ls-files command.  This is required.
+# 2: An optional directory path.  If provided, only files within the
+#    specified directory are listed.  Sub directories are never recursed.
+#    Path must have a trailing slash.
+__git_files ()
+{
+	local dir="$(__gitdir)" flags="-${1}"
+
+	if [ -d "$dir" ]; then
+		git --git-dir="$dir" ls-files --exclude-standard ${flags} ${pfx} \
+			| pfx=$2 perl -ne "${__git_index_file_list_filter}" \
+			| uniq
+		return
+	fi
+}
+
+# __git_commit_files accepts 1 optional argument: a directory path.
+# If provided, only files within the specified directory are listed.
+# Sub directories are never recursed.  Path must have a trailing slash.
+__git_commit_files ()
+{
+	local dir="$(__gitdir)"
+
+	if [ -d "$dir" ]; then
+		git --git-dir="$dir" diff-index --name-only HEAD \
+			| pfx=$1 perl -ne "${__git_index_file_list_filter}" \
+			| uniq
+		return
+	fi
+}
+
 __git_heads ()
 {
 	local dir="$(__gitdir)"
@@ -430,6 +484,25 @@ __git_complete_revlist_file ()
 }
 
 
+# __git_complete_index_file requires 1 argument, the file index
+# status mode
+_git_complete_index_file ()
+{
+	local pfx cur_="$cur" flags=${1}
+	case "$cur_" in
+		?*/*)
+			pfx="${cur_%/*}"
+			cur_="${cur_##*/}"
+			pfx="${pfx}/"
+
+			__gitcomp_nl "$(__git_files ${flags} ${pfx})" "$pfx" "$cur_" ""
+			;;
+		*)
+			__gitcomp_nl "$(__git_files ${flags})" "" "$cur_" ""
+			;;
+	esac
+}
+
 __git_complete_file ()
 {
 	__git_complete_revlist_file
@@ -770,8 +843,6 @@ _git_apply ()
 
 _git_add ()
 {
-	__git_has_doubledash && return
-
 	case "$cur" in
 	--*)
 		__gitcomp "
@@ -780,7 +851,8 @@ _git_add ()
 			"
 		return
 	esac
-	COMPREPLY=()
+	# XXX should we check for --update and --all options ?
+	_git_complete_index_file "om"
 }
 
 _git_archive ()
@@ -930,15 +1002,14 @@ _git_cherry_pick ()
 
 _git_clean ()
 {
-	__git_has_doubledash && return
-
 	case "$cur" in
 	--*)
 		__gitcomp "--dry-run --quiet"
 		return
 		;;
 	esac
-	COMPREPLY=()
+	# XXX should we check for -x option ?
+	_git_complete_index_file "o"
 }
 
 _git_clone ()
@@ -969,7 +1040,7 @@ _git_clone ()
 
 _git_commit ()
 {
-	__git_has_doubledash && return
+	local pfx cur_=${cur}
 
 	case "$cur" in
 	--cleanup=*)
@@ -997,8 +1068,20 @@ _git_commit ()
 			--verbose --quiet --fixup= --squash=
 			"
 		return
+		;;
+	?*/*)
+		pfx="${cur_%/*}"
+		cur_="${cur_##*/}"
+		pfx="${pfx}/"
+
+		__gitcomp_nl "$(__git_commit_files ${pfx})" "$pfx" "$cur_" ""
+		return
+		;;
+	*)
+		__gitcomp_nl "$(__git_commit_files)" "" "$cur_" ""
+		return
+		;;
 	esac
-	COMPREPLY=()
 }
 
 _git_describe ()
@@ -1216,8 +1299,6 @@ _git_init ()
 
 _git_ls_files ()
 {
-	__git_has_doubledash && return
-
 	case "$cur" in
 	--*)
 		__gitcomp "--cached --deleted --modified --others --ignored
@@ -1230,7 +1311,9 @@ _git_ls_files ()
 		return
 		;;
 	esac
-	COMPREPLY=()
+	# XXX ignore options like --modified and always suggest all cached
+	# files.
+	_git_complete_index_file "c"
 }
 
 _git_ls_remote ()
@@ -1362,7 +1445,8 @@ _git_mv ()
 		return
 		;;
 	esac
-	COMPREPLY=()
+	# XXX needs more work
+	_git_complete_index_file "c"
 }
 
 _git_name_rev ()
@@ -2068,15 +2152,13 @@ _git_revert ()
 
 _git_rm ()
 {
-	__git_has_doubledash && return
-
 	case "$cur" in
 	--*)
 		__gitcomp "--cached --dry-run --ignore-unmatch --quiet"
 		return
 		;;
 	esac
-	COMPREPLY=()
+	_git_complete_index_file "c"
 }
 
 _git_shortlog ()
-- 
1.8.1.rc1.18.g9db0d25
Junio C Hamano· Dec 18, 2012, 17:53 UTC · re: Manlio Perillo · lore

Re: [PATCH v3] git-completion.bash: add support for path completion

[jch: cc'ed git-completion experts to review implementation details]
Manlio Perillo <manlio.perillo@gmail.com> writes:
Show 5 quoted lines
> The git-completion.bash script did not implemented full, git aware,
> support for completion, for git commands that operate on files within
> the current working directory or the index.
>
> For these commands, only long options completion was available.

I find the "long options completion" is a misleading phrase. It sounds as if you changed the current completion that does not complete "git commit -<TAB>" but does "git commit --<TAB>" to complete the short options (e.g. "git commit -c"), but I do not think that is the topic of this patch.

Show 8 quoted lines
> As an example:
>
> 	git add <TAB>
>
> will suggest all files in the current working directory, including
> ignored files and files that have not been modified.
>
> Full support for completion is now implemented, for git commands where

s/Full.*implemented/Support more comprehensive completion/; or something, talking in the imperative mood (i.e. as if you are giving the order to the codebase to do something).

Show 5 quoted lines
> the non-option arguments always refer to paths within the current
> working directory or the index, as the follow:
>
> * the path completion for the "git mv", "git rm" and "git ls-tree"
>   commands will suggest all cached files.
I thought you dropped "git mv" in this round.
Show 12 quoted lines
> * the path completion for the "git add" command will suggest all
>   untracked and modified files.  Ignored files are excluded.
>
> * the path completion for the "git clean" command will suggest all
>   untracked files.  Ignored files are excluded.
>
> * the path completion for the "git commit" command will suggest all
>   files that have been modified from the HEAD.
>
> For all affected commands, completion will always stop at directory
> boundary.  Only standard ignored files are excluded, using the
> --exclude-standard option of the ls-files command.
I read "always stop at directory boundary" to mean that
	git cmd t<TAB>

will give us "t/ tag.c" (assuming there is a new or modified file in t/ and tag.c is the only modified file at the root level that begins with "t") and then

	git cmd t/<TAB>

will likewise show the files and top-level subdirectories within t/ directory. That would be great.

Show 29 quoted lines
> Signed-off-by: Manlio Perillo <manlio.perillo@gmail.com>
> ---
>  contrib/completion/git-completion.bash | 112 ++++++++++++++++++++++++++++-----
>  1 file changed, 97 insertions(+), 15 deletions(-)
>
> diff --git a/contrib/completion/git-completion.bash b/contrib/completion/git-completion.bash
> index 0b77eb1..923ef37 100644
> --- a/contrib/completion/git-completion.bash
> +++ b/contrib/completion/git-completion.bash
> @@ -13,6 +13,7 @@
>  #    *) .git/remotes file names
>  #    *) git 'subcommands'
>  #    *) tree paths within 'ref:path/to/file' expressions
> +#    *) file paths within current working directory and index
>  #    *) common --long-options
>  #
>  # To use these routines:
> @@ -233,6 +234,59 @@ __gitcomp_nl ()
>  	COMPREPLY=($(compgen -P "${2-}" -S "${4- }" -W "$1" -- "${3-$cur}"))
>  }
>  
> +# Perl filter used to process path list returned by ls-files and
> +# diff-index --name-only commands, in order to list file names
> +# relative to a specified directory, and append a slash to directory
> +# names.
> +# The script expects the prefix path in the "pfx" environ variable.
> +# The output must be processed with the uniq filter, to remove
> +# duplicate directories.
> +# XXX remove duplicates in the Perl script ?

Surely, that will remove one fork/exec with pipeline. I am not sure what the performance implication of using Perl here, but because we do not have to stick to POSIX shell in this file, the completion experts would be able to help rewriting this logic as a pure bash script.

Show 26 quoted lines
> +__git_index_file_list_filter='$pfx = $ENV{"pfx"};
> +			$idx = index($_, $pfx);
> +			if ($idx == 0) {
> +				$_ = substr $_, length($pfx);
> +				@segments = split("/", $_);
> +				if ($segments[1]) {
> +					print $segments[0], "/\n"
> +				} else {
> +					print $segments[0], "\n"
> +				}
> +			}'
> +
> +# __git_files accepts 1 or 2 arguments:
> +# 1: A string for file index status mode ("c", "m", "d", "o"), as
> +#    supported by git ls-files command.  This is required.
> +# 2: An optional directory path.  If provided, only files within the
> +#    specified directory are listed.  Sub directories are never recursed.
> +#    Path must have a trailing slash.
> +__git_files ()
> +{
> +	local dir="$(__gitdir)" flags="-${1}"
> +
> +	if [ -d "$dir" ]; then
> +		git --git-dir="$dir" ls-files --exclude-standard ${flags} ${pfx} \
> +			| pfx=$2 perl -ne "${__git_index_file_list_filter}" \
> +			| uniq

This is purely a style thing (note that style suggestions are not optional), but

        the data source command |
        a filter command |
        another filter command

is easier to read and can be spelled without the backslash. The same comment applies to git-commit-files as well.

Thanks.
Manlio Perillo· Dec 18, 2012, 18:55 UTC · re: Junio C Hamano · lore

Re: [PATCH v3] git-completion.bash: add support for path completion

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Il 18/12/2012 18:53, Junio C Hamano ha scritto:
Show 16 quoted lines
> [jch: cc'ed git-completion experts to review implementation details]
> 
> Manlio Perillo <manlio.perillo@gmail.com> writes:
> 
>> The git-completion.bash script did not implemented full, git aware,
>> support for completion, for git commands that operate on files within
>> the current working directory or the index.
>>
>> For these commands, only long options completion was available.
> 
> I find the "long options completion" is a misleading phrase.  It
> sounds as if you changed the current completion that does not
> complete "git commit -<TAB>" but does "git commit --<TAB>" to
> complete the short options (e.g. "git commit -c"), but I do not
> think that is the topic of this patch.
> 

It does not sound misleading to me. I'm saying that the git-completion.bash script only implemented completion for long options, but not for file names in the current working directory.

Do you think I should rewrite the subject and the log message introduction?
As an example, something like this in the subject:
  git-completion.bash: improve some git commands completion
and in the message:
  The git-completion.bash script did not implemented full, git aware,
  support for completion, for git commands that operate on files within
  the current working directory or the index.
  As an example:
 ...

I'm still not fully satisfied with it, however. It still requires reading the full message to understand the changes implemented.

Show 13 quoted lines
>> As an example:
>>
>> 	git add <TAB>
>>
>> will suggest all files in the current working directory, including
>> ignored files and files that have not been modified.
>>
>> Full support for completion is now implemented, for git commands where
> 
> s/Full.*implemented/Support more comprehensive completion/; or
> something, talking in the imperative mood (i.e. as if you are giving
> the order to the codebase to do something).
> 
Ok.
Show 8 quoted lines
>> the non-option arguments always refer to paths within the current
>> working directory or the index, as the follow:
>>
>> * the path completion for the "git mv", "git rm" and "git ls-tree"
>>   commands will suggest all cached files.
> 
> I thought you dropped "git mv" in this round.
> 

Well, no. But the current implementation should not cause problems. Also note that I added support for ls-files, too.

There are some XXX marks in the code, but I think that the changes always improve the old behaviour.

Show 18 quoted lines
> [...]
>> For all affected commands, completion will always stop at directory
>> boundary.  Only standard ignored files are excluded, using the
>> --exclude-standard option of the ls-files command.
> 
> I read "always stop at directory boundary" to mean that
> 
> 	git cmd t<TAB>
> 
> will give us "t/ tag.c" (assuming there is a new or modified file in
> t/ and tag.c is the only modified file at the root level that begins
> with "t") and then
> 
> 	git cmd t/<TAB>
> 
> will likewise show the files and top-level subdirectories within t/
> directory.  That would be great.
> 
Yes, this is how it works, bugs excluded (I'm not a bash/perl expert).
Show 16 quoted lines
> [...]
>> +# Perl filter used to process path list returned by ls-files and
>> +# diff-index --name-only commands, in order to list file names
>> +# relative to a specified directory, and append a slash to directory
>> +# names.
>> +# The script expects the prefix path in the "pfx" environ variable.
>> +# The output must be processed with the uniq filter, to remove
>> +# duplicate directories.
>> +# XXX remove duplicates in the Perl script ?
> 
> Surely, that will remove one fork/exec with pipeline.  I am not sure
> what the performance implication of using Perl here, but because we
> do not have to stick to POSIX shell in this file, the completion
> experts would be able to help rewriting this logic as a pure bash
> script.
> 
Ok. I'll wait for a review from git-completion experts.

Note that the performance is the reason why I suggested, in a previous email, that git should have some more options to format data in custom ways. As an example, there is no way to tell ls-files to not recurse directories, and there is no way to also get the file type.

A --no-recurse option, and a change in the code to make, as an example
  git ls-files --stage --modified

to honor the --modified option, will probably make it possible to use a simple sed filter (there is still the problem that, unlike ls-tree, ls-files shows the complete file path).

Show 20 quoted lines
> [...]
>> +__git_files ()
>> +{
>> +	local dir="$(__gitdir)" flags="-${1}"
>> +
>> +	if [ -d "$dir" ]; then
>> +		git --git-dir="$dir" ls-files --exclude-standard ${flags} ${pfx} \
>> +			| pfx=$2 perl -ne "${__git_index_file_list_filter}" \
>> +			| uniq
> 
> This is purely a style thing (note that style suggestions are not
> optional), but
> 
>         the data source command |
>         a filter command |
>         another filter command
> 
> is easier to read and can be spelled without the backslash.  The
> same comment applies to git-commit-files as well.
> 
I agree.

But I was copying the style currently used in the script (see the __git_complete_revlist_file function).

Note that I plan to do a small code refactorization, since I need the ls-tree support code from __git_complete_revlist_file function for a future change. I can fix these style issues in that patch.

I plan to improve completion support for checkout and reset commands, too (currently only the commit/tree-ish argument is autocompleted, but not the path).

Regards  Manlio
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAlDQvDIACgkQscQJ24LbaUTT9wCgh6jtbhdQ7GNIkqCq34QjXdIs w9QAnjz2VjPFm4n2ICkcWWEsqWDWM+Hm =8/Ad -----END PGP SIGNATURE-----

Junio C Hamano· Dec 18, 2012, 19:22 UTC · re: Manlio Perillo · lore

Re: [PATCH v3] git-completion.bash: add support for path completion

Manlio Perillo <manlio.perillo@gmail.com> writes:
Show 24 quoted lines
> Il 18/12/2012 18:53, Junio C Hamano ha scritto:
>> [jch: cc'ed git-completion experts to review implementation details]
>> 
>> Manlio Perillo <manlio.perillo@gmail.com> writes:
>> 
>>> The git-completion.bash script did not implemented full, git aware,
>>> support for completion, for git commands that operate on files within
>>> the current working directory or the index.
>>>
>>> For these commands, only long options completion was available.
>> 
>> I find the "long options completion" is a misleading phrase.  It
>> sounds as if you changed the current completion that does not
>> complete "git commit -<TAB>" but does "git commit --<TAB>" to
>> complete the short options (e.g. "git commit -c"), but I do not
>> think that is the topic of this patch.
>> 
>
> It does not sound misleading to me.
> I'm saying that the git-completion.bash script only implemented
> completion for long options, but not for file names in the current
> working directory.
>
> Do you think I should rewrite the subject and the log message introduction?

The subject sounds fine; it is just "It only does long options" sounded as if it were viewing the lack of "short options" support as an issue. In other words, my knee-jerk answer to "long options, as opposed to what???" question was "short options", not "files".

If the phrase were "It only does options", the question would become "options as opposed to what???", which may have given me a chance to guess "files" as the answer to that question.

> As an example, something like this in the subject:
>
>   git-completion.bash: improve some git commands completion

I think the original is better; you do not touch any "options", either long or short. You are improving "paths", and the original is much clearer on that point.

Show 5 quoted lines
>
> and in the message:
>
>   The git-completion.bash script did not implemented full, git aware,
>   support for completion, for git commands that operate on files within

With s/for completion/to complete paths/, it would be perfect. You do not touch options, and this new log message does not talk about it. Much nicer than the one that was posted.

> Note that the performance is the reason why I suggested, in a previous
> email, that git should have some more options to format data in custom ways.
> As an example, there is no way to tell ls-files to not recurse
> directories, and there is no way to also get the file type.

To ls-files, no-recurse is an idiotic thing to ask. The index is a flat structure that is read as a whole. There is no recursion involved.

Manlio Perillo· Dec 18, 2012, 20:29 UTC · re: Junio C Hamano · lore

Re: [PATCH v3] git-completion.bash: add support for path completion

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Il 18/12/2012 20:22, Junio C Hamano ha scritto:
Show 9 quoted lines
> [...]
>> Note that the performance is the reason why I suggested, in a previous
>> email, that git should have some more options to format data in custom ways.
>> As an example, there is no way to tell ls-files to not recurse
>> directories, and there is no way to also get the file type.
> 
> To ls-files, no-recurse is an idiotic thing to ask.  The index is a
> flat structure that is read as a whole.  There is no recursion
> involved.

What about an option like --as-tree, so that ls-files will list the files as they were in a tree, instead of a flat structure ?

Thanks  Manlio
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAlDQ0j4ACgkQscQJ24LbaURXoACffQ4iz6MsoeffEZEBib1b1KF8 NZsAoIUXa7OonWyFxfJ35mukBK/sddGr =0nO7 -----END PGP SIGNATURE-----

← back to recent threads