git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 2/2] fsck: detect and warn a commit with embedded NUL

From
Junio C Hamano <gitster@pobox.com>
Date
Apr 14, 2016, 18:25 UTC
Message-ID
<xmqq1t68gi92.fsf@gitster.mtv.corp.google.com>
In-Reply-To
<20160414182102.GB22068@sigill.intra.peff.net>
Jeff King <peff@peff.net> writes:
Show 9 quoted lines
>> +	const char *buffer_begin = buffer;
>>  
>>  	if (verify_headers(buffer, size, &commit->object, options))
>>  		return -1;
>
> You need this "buffer_begin" because we move the "buffer" pointer
> forward as we parse. But perhaps whole-buffer checks should simply go at
> the top (next to verify_headers) before we start advancing the pointer.
> To me, that makes the function's flow more natural.

That was my second iteration. I didn't want the function return with warning without checking more serious errors that may be in the object.

Show 18 quoted lines
> But alternatively...
>
>> @@ -671,6 +673,12 @@ static int fsck_commit_buffer(struct commit *commit, const char *buffer,
>>  		if (err)
>>  			return err;
>>  	}
>> +	if (memchr(buffer_begin, '\0', size)) {
>> +		err = report(options, &commit->object, FSCK_MSG_NUL_IN_COMMIT,
>> +			     "NUL byte in the commit object body");
>> +		if (err)
>> +			return err;
>> +	}
>
> Here we've parsed to the end of the headers we know about. We know
> there's no NUL there, because verify_headers() would have complained.
> And because the individual header parsers would have complained. So I
> actually think we could check from "buffer" (of course we do still need
> to record the beginning of the buffer to adjust "size" appropriately).

Yes, keeping the "begin" pointer is a cheap way to do an equivalent of "adjusting size".

Show 12 quoted lines
> It's a little more efficient (we don't have to memchr over the same
> bytes again). But I'd worry a little that doing it that way would
> introduce coupling between this check and verify_headers(), though (so
> that if the latter ever changes, our check may start missing cases).
>
> So yet another alternative would be to include this check in
> verify_headers(). It would parse to the end of the headers as now, and
> then from there additionally look for a NUL in the body.
>
> Of the three approaches, I think I like that third one. It's the most
> efficient, and I think the flow is pretty clear. We'd probably want to
> rename verify_headers(), though. :)

Sounds sensible, except the "should a mere warning hide potentially more serious errors?" question remains.

Previous: Jeff KingNext: Jeff King
Message 4 of 13 in “fsck_commit_buffer(): do not special case the last validation”
  1. 1/2 fsck_commit_buffer(): do not special case the last validationJunio C Hamano, Apr 14, 2016
  2. 2/2 fsck: detect and warn a commit with embedded NULJunio C Hamano, Apr 14, 2016
  3. Jeff KingApr 14, 2016
  4. Junio C HamanoApr 14, 2016
  5. Jeff KingApr 14, 2016
  6. Junio C HamanoApr 14, 2016
  7. Jeff KingApr 14, 2016
  8. Junio C HamanoApr 14, 2016
  9. Johannes SchindelinApr 15, 2016
  10. Jeff KingApr 14, 2016
  11. Junio C HamanoApr 14, 2016
  12. Johannes SchindelinApr 15, 2016
  13. Junio C HamanoApr 15, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.