git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH v2] midx: use buffered I/O to talk to pack-objects

From
Jeff King <peff@peff.net>
Date
Aug 13, 2020, 09:11 UTC
Message-ID
<20200813091103.GD3092220@coredump.intra.peff.net>
In-Reply-To
<xmqqd03v61xd.fsf@gitster.c.googlers.com>
On Wed, Aug 12, 2020 at 01:31:58PM -0700, Junio C Hamano wrote:
Show 18 quoted lines
> Junio C Hamano <gitster@pobox.com> writes:
> 
> > René Scharfe <l.s.r@web.de> writes:
> >
> >>  		nth_midxed_object_oid(&oid, m, i);
> >> -		xwrite(cmd.in, oid_to_hex(&oid), the_hash_algo->hexsz);
> >> -		xwrite(cmd.in, "\n", 1);
> >> +		fprintf(cmd_in, "%s\n", oid_to_hex(&oid));
> >
> > I do think it is silly to send an object name and terminating LF in
> > two different system calls per object.
> >
> > The original uses xwrite() so that it does not have to worry about
> > having to restart interrupted system calls and such.
> 
> Oops.  There is not much in "and such".  xwrite() only restarts but
> the caller must deal with truncated write, which the original does
> not do.

Yeah, so I think the new code should be an improvement there, because it will eventually retry the write when the buffer fills, or when we eventually flush on close (my "everything written by the time we hit fflush()" in the previous mail really should have been "...by the time we hit fclose()"). Maybe another reason to use stdio. :)

The original also doesn't handle "real" errors at all (stuff besides EINTR, etc). Nor does the rewrite. I guess it's unlikely to see a write error here that doesn't also involve pack-objects returning a non-zero exit code.

-Peff
Previous: Junio C HamanoNext: Jeff King
Message 13 of 14 in “midx: use buffered I/O to talk to pack-objects”
  1. midx: use buffered I/O to talk to pack-objectsRené Scharfe, Aug 2, 2020
  2. Chris TorekAug 2, 2020
  3. Johannes SixtAug 3, 2020
  4. René ScharfeAug 3, 2020
  5. René ScharfeAug 4, 2020
  6. Junio C HamanoAug 4, 2020
  7. Derrick StoleeAug 3, 2020
  8. René ScharfeAug 11, 2020
  9. Derrick StoleeAug 11, 2020
  10. midx: use buffered I/O to talk to pack-objectsRené Scharfe, Aug 12, 2020
  11. Junio C HamanoAug 12, 2020
  12. Junio C HamanoAug 12, 2020
  13. Jeff KingAug 13, 2020
  14. Jeff KingAug 13, 2020

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.