git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH v3 2/2] Reduce parse-options.o dependencies

From
Jonathan Nieder <jrnieder@gmail.com>
Date
Aug 11, 2011, 11:04 UTC
Message-ID
<20110811110441.GD5012@elie.gateway.2wire.net>
In-Reply-To
<1313054138-30885-3-git-send-email-divanorama@gmail.com>

(+cc: Stephen) Dmitry Ivankov wrote:

Show 14 quoted lines
> Currently parse-options.o pulls quite a big bunch of dependencies.
> his complicates it's usage in contrib/ because it pulls external
> dependencies and it also increases executables size.
>
> Split off less generic and more internal to git part of
> parse-options.c to parse-options-cb.c.
>
> Move prefix_filename function from setup.c to abspath.c. abspath.o
> and wrapper.o pull each other, so it's unlikely to increase the
> dependencies. It was a dependency of parse-options.o that pulled
> many others.
>
> Now parse-options.o pulls just abspath.o, ctype.o, strbuf.o, usage.o,
> wrapper.o, libc directly and strlcpy.o indirectly.

So, in other words, currently linking to parse-options involves linking to git's object access machinery and diff machinery, hence libz, libssl for SHA-1, libpcre, etc. That is a waste of space, startup time, and build complexity for simple programs that do not need access to git's object db.

This patch does two things to address that:
 - option callbacks which freely use the git object db and other
   facilities move to a separate parse-options-cb.o translation
   unit, so simple programs can avoid them;
 - prefix_filename, which is used to support OPTION_FILENAME,
   moves from setup.c to abspath.c, so it can be used without
   pulling in unrelated git machinery.

The result is, as you say, that use of parse-options.o only pulls in abspath, ctype, strbuf, usage, wrapper, and -lc --- which is to say, just utility functions --- and you can build a program using parse-options with a simple commandline like

	cc -o test-program -Wall -W -O2 test-program.c libgit.a
Okay, on to the patch itself (comments sparsely scattered within).
Show 77 quoted lines
>
> Signed-off-by: Dmitry Ivankov <divanorama@gmail.com>
> ---
>  Makefile           |    3 +-
>  abspath.c          |   28 ++++++++++++
>  parse-options-cb.c |  125 ++++++++++++++++++++++++++++++++++++++++++++++++++++
>  parse-options.c    |  121 --------------------------------------------------
>  setup.c            |   28 ------------
>  5 files changed, 155 insertions(+), 150 deletions(-)
>  create mode 100644 parse-options-cb.c
> 
> diff --git a/Makefile b/Makefile
> index 62ad0c2..7d47bdb 100644
> --- a/Makefile
> +++ b/Makefile
> @@ -642,6 +642,7 @@ LIB_OBJS += pack-revindex.o
>  LIB_OBJS += pack-write.o
>  LIB_OBJS += pager.o
>  LIB_OBJS += parse-options.o
> +LIB_OBJS += parse-options-cb.o
>  LIB_OBJS += patch-delta.o
>  LIB_OBJS += patch-ids.o
>  LIB_OBJS += path.o
> @@ -2204,7 +2205,7 @@ test-delta$X: diff-delta.o patch-delta.o
>  
>  test-line-buffer$X: vcs-svn/lib.a
>  
> -test-parse-options$X: parse-options.o
> +test-parse-options$X: parse-options.o parse-options-cb.o
>  
>  test-string-pool$X: vcs-svn/lib.a
>  
> diff --git a/abspath.c b/abspath.c
> index 37287f8..f04ac18 100644
> --- a/abspath.c
> +++ b/abspath.c
> @@ -139,3 +139,31 @@ const char *absolute_path(const char *path)
>  	}
>  	return buf;
>  }
> +
> +/*
> + * Unlike prefix_path, this should be used if the named file does
> + * not have to interact with index entry; i.e. name of a random file
> + * on the filesystem.
> + */
> +const char *prefix_filename(const char *pfx, int pfx_len, const char *arg)
> +{
> +	static char path[PATH_MAX];
> +#ifndef WIN32
> +	if (!pfx_len || is_absolute_path(arg))
> +		return arg;
> +	memcpy(path, pfx, pfx_len);
> +	strcpy(path + pfx_len, arg);
> +#else
> +	char *p;
> +	/* don't add prefix to absolute paths, but still replace '\' by '/' */
> +	if (is_absolute_path(arg))
> +		pfx_len = 0;
> +	else if (pfx_len)
> +		memcpy(path, pfx, pfx_len);
> +	strcpy(path + pfx_len, arg);
> +	for (p = path + pfx_len; *p; p++)
> +		if (*p == '\\')
> +			*p = '/';
> +#endif
> +	return path;
> +}
> diff --git a/parse-options-cb.c b/parse-options-cb.c
> new file mode 100644
> index 0000000..c248f66
> --- /dev/null
> +++ b/parse-options-cb.c
> @@ -0,0 +1,125 @@
> +#include "git-compat-util.h"
> +#include "parse-options.h"
> +#include "cache.h"
Style: Files in git tend to use only one of "git-compat-util.h",
"cache.h", or "builtin.h" and put it at the top.  So in this case, it
should probably use just "cache.h".
Show 143 quoted lines
> +#include "commit.h"
> +#include "color.h"
> +#include "string-list.h"
> +
> +/*----- some often used options -----*/
> +
> +int parse_opt_abbrev_cb(const struct option *opt, const char *arg, int unset)
> +{
> +	int v;
> +
> +	if (!arg) {
> +		v = unset ? 0 : DEFAULT_ABBREV;
> +	} else {
> +		v = strtol(arg, (char **)&arg, 10);
> +		if (*arg)
> +			return opterror(opt, "expects a numerical value", 0);
> +		if (v && v < MINIMUM_ABBREV)
> +			v = MINIMUM_ABBREV;
> +		else if (v > 40)
> +			v = 40;
> +	}
> +	*(int *)(opt->value) = v;
> +	return 0;
> +}
> +
> +int parse_opt_approxidate_cb(const struct option *opt, const char *arg,
> +			     int unset)
> +{
> +	*(unsigned long *)(opt->value) = approxidate(arg);
> +	return 0;
> +}
> +
> +int parse_opt_color_flag_cb(const struct option *opt, const char *arg,
> +			    int unset)
> +{
> +	int value;
> +
> +	if (!arg)
> +		arg = unset ? "never" : (const char *)opt->defval;
> +	value = git_config_colorbool(NULL, arg, -1);
> +	if (value < 0)
> +		return opterror(opt,
> +			"expects \"always\", \"auto\", or \"never\"", 0);
> +	*(int *)opt->value = value;
> +	return 0;
> +}
> +
> +int parse_opt_verbosity_cb(const struct option *opt, const char *arg,
> +			   int unset)
> +{
> +	int *target = opt->value;
> +
> +	if (unset)
> +		/* --no-quiet, --no-verbose */
> +		*target = 0;
> +	else if (opt->short_name == 'v') {
> +		if (*target >= 0)
> +			(*target)++;
> +		else
> +			*target = 1;
> +	} else {
> +		if (*target <= 0)
> +			(*target)--;
> +		else
> +			*target = -1;
> +	}
> +	return 0;
> +}
> +
> +int parse_opt_with_commit(const struct option *opt, const char *arg, int unset)
> +{
> +	unsigned char sha1[20];
> +	struct commit *commit;
> +
> +	if (!arg)
> +		return -1;
> +	if (get_sha1(arg, sha1))
> +		return error("malformed object name %s", arg);
> +	commit = lookup_commit_reference(sha1);
> +	if (!commit)
> +		return error("no such commit %s", arg);
> +	commit_list_insert(commit, opt->value);
> +	return 0;
> +}
> +
> +int parse_opt_tertiary(const struct option *opt, const char *arg, int unset)
> +{
> +	int *target = opt->value;
> +	*target = unset ? 2 : 1;
> +	return 0;
> +}
> +
> +int parse_options_concat(struct option *dst, size_t dst_size, struct option *src)
> +{
> +	int i, j;
> +
> +	for (i = 0; i < dst_size; i++)
> +		if (dst[i].type == OPTION_END)
> +			break;
> +	for (j = 0; i < dst_size; i++, j++) {
> +		dst[i] = src[j];
> +		if (src[j].type == OPTION_END)
> +			return 0;
> +	}
> +	return -1;
> +}
> +
> +int parse_opt_string_list(const struct option *opt, const char *arg, int unset)
> +{
> +	struct string_list *v = opt->value;
> +
> +	if (unset) {
> +		string_list_clear(v, 0);
> +		return 0;
> +	}
> +
> +	if (!arg)
> +		return -1;
> +
> +	string_list_append(v, xstrdup(arg));
> +	return 0;
> +}
> diff --git a/parse-options.c b/parse-options.c
> index 7b061af..503ab5d 100644
> --- a/parse-options.c
> +++ b/parse-options.c
> @@ -3,7 +3,6 @@
>  #include "cache.h"
>  #include "commit.h"
>  #include "color.h"
> -#include "string-list.h"
>  
>  static int parse_options_usage(struct parse_opt_ctx_t *ctx,
>  			       const char * const *usagestr,
> @@ -584,123 +583,3 @@ static int parse_options_usage(struct parse_opt_ctx_t *ctx,
>  	return usage_with_options_internal(ctx, usagestr, opts, 0, err);
>  }
>  
> -
> -/*----- some often used options -----*/
> -#include "cache.h"
> -
> -int parse_opt_abbrev_cb(const struct option *opt, const char *arg, int unset)
[... snip code moved verbatim ...]
Show 43 quoted lines
> -}
> diff --git a/setup.c b/setup.c
> index 5ea5502..3463819 100644
> --- a/setup.c
> +++ b/setup.c
> @@ -40,34 +40,6 @@ char *prefix_path(const char *prefix, int len, const char *path)
>  	return sanitized;
>  }
>  
> -/*
> - * Unlike prefix_path, this should be used if the named file does
> - * not have to interact with index entry; i.e. name of a random file
> - * on the filesystem.
> - */
> -const char *prefix_filename(const char *pfx, int pfx_len, const char *arg)
> -{
> -	static char path[PATH_MAX];
> -#ifndef WIN32
> -	if (!pfx_len || is_absolute_path(arg))
> -		return arg;
> -	memcpy(path, pfx, pfx_len);
> -	strcpy(path + pfx_len, arg);
> -#else
> -	char *p;
> -	/* don't add prefix to absolute paths, but still replace '\' by '/' */
> -	if (is_absolute_path(arg))
> -		pfx_len = 0;
> -	else if (pfx_len)
> -		memcpy(path, pfx, pfx_len);
> -	strcpy(path + pfx_len, arg);
> -	for (p = path + pfx_len; *p; p++)
> -		if (*p == '\\')
> -			*p = '/';
> -#endif
> -	return path;
> -}
> -
>  int check_filename(const char *prefix, const char *arg)
>  {
>  	const char *name;
> -- 
> 1.7.3.4
> 
Except for the commit message, and with or without the #include tweak
mentioned above,
Reviewed-by: Jonathan Nieder <jrnieder@gmail.com>

Thanks. This seems to be in pretty good shape (and as mentioned before, gets closer to fulfillment of a longstanding wish :)).

Previous: Dmitry IvankovNext: Junio C Hamano
Message 5 of 6 in “Reduce parse-options.o dependencies”
  1. 0/2 Reduce parse-options.o dependenciesDmitry Ivankov, Aug 11, 2011
  2. 1/2 parse-options: export opterr, optbugDmitry Ivankov, Aug 11, 2011
  3. Jonathan NiederAug 11, 2011
  4. 2/2 Reduce parse-options.o dependenciesDmitry Ivankov, Aug 11, 2011
  5. Jonathan NiederAug 11, 2011
  6. Junio C HamanoAug 11, 2011

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.