git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH] sha1_file: don't convert off_t to size_t too early to avoid potential die()

From
Junio C Hamano <gitster@pobox.com>
Date
Sep 22, 2014, 19:41 UTC
Message-ID
<xmqqvbofjvdf.fsf@gitster.dls.corp.google.com>
In-Reply-To
<1411293806-3087-1-git-send-email-prohaska@zib.de>
Steffen Prohaska <prohaska@zib.de> writes:
> This patch should be applied on top of sp/stream-clean-filter.

... or it can be squashed in as a fix, as the topic is not yet in 'next'.

Show 43 quoted lines
> index_stream() might internally also be able to handle large files to
> some extent.  But it uses size_t for its third argument, and we must
> already die() when calling it.  It might be a good idea to convert its
> interface to use off_t and push the size checks further down the stack.
> In general, it might be good idea to carefully consider whether to use
> off_t or size_t when passing file-related sizes around.  To me it looks
> like a separate issue for a separate patch series (I have no specific
> plans to prepare one).
>
>  sha1_file.c | 13 +++++++++----
>  1 file changed, 9 insertions(+), 4 deletions(-)
>
> diff --git a/sha1_file.c b/sha1_file.c
> index 5b0e67a..6f18c22 100644
> --- a/sha1_file.c
> +++ b/sha1_file.c
> @@ -3180,17 +3180,22 @@ int index_fd(unsigned char *sha1, int fd, struct stat *st,
>  	     enum object_type type, const char *path, unsigned flags)
>  {
>  	int ret;
> -	size_t size = xsize_t(st->st_size);
>  
> +	/*
> +	 * Call xsize_t() only when needed to avoid potentially unnecessary
> +	 * die() for large files.
> +	 */
>  	if (type == OBJ_BLOB && path && would_convert_to_git_filter_fd(path))
>  		ret = index_stream_convert_blob(sha1, fd, path, flags);
>  	else if (!S_ISREG(st->st_mode))
>  		ret = index_pipe(sha1, fd, type, path, flags);
> -	else if (size <= big_file_threshold || type != OBJ_BLOB ||
> +	else if (st->st_size <= big_file_threshold || type != OBJ_BLOB ||
>  		 (path && would_convert_to_git(path)))
> -		ret = index_core(sha1, fd, size, type, path, flags);
> +		ret = index_core(sha1, fd, xsize_t(st->st_size), type, path,
> +				 flags);
>  	else
> -		ret = index_stream(sha1, fd, size, type, path, flags);
> +		ret = index_stream(sha1, fd, xsize_t(st->st_size), type, path,
> +				   flags);
>  	close(fd);
>  	return ret;
>  }
Previous: Junio C Hamano
Message 3 of 3 in “sha1_file: don't convert off_t to size_t too early to avoid potential die()”
  1. sha1_file: don't convert off_t to size_t too early to avoid potential die()Steffen Prohaska, Sep 21, 2014
  2. Junio C HamanoSep 22, 2014
  3. Junio C HamanoSep 22, 2014

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.