git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCHv20 05/12] run_processes_parallel: treat output of children as byte array

From
Stefan Beller <sbeller@google.com>
Date
Feb 29, 2016, 19:14 UTC
Message-ID
<1456773250-5510-6-git-send-email-sbeller@google.com>
In-Reply-To
<1456773250-5510-1-git-send-email-sbeller@google.com>

We do not want the output to be interrupted by a NUL byte, so we cannot use raw fputs. Introduce strbuf_write to avoid having long arguments in run-command.c.

Reviewed-by: Jonathan Nieder <jrnieder@gmail.com>
Signed-off-by: Stefan Beller <sbeller@google.com>
Signed-off-by: Junio C Hamano <gitster@pobox.com>
---
 run-command.c | 8 ++++----
 strbuf.c      | 6 ++++++
 strbuf.h      | 6 ++++++
 3 files changed, 16 insertions(+), 4 deletions(-)
diff --git a/run-command.c b/run-command.c
index 51fd72c..2f8f222 100644
--- a/run-command.c
+++ b/run-command.c
@@ -1011,7 +1011,7 @@ static void pp_cleanup(struct parallel_processes *pp)
 	 * When get_next_task added messages to the buffer in its last
 	 * iteration, the buffered output is non empty.
 	 */
-	fputs(pp->buffered_output.buf, stderr);
+	strbuf_write(&pp->buffered_output, stderr);
 	strbuf_release(&pp->buffered_output);
 
 	sigchain_pop_common();
@@ -1097,7 +1097,7 @@ static void pp_output(struct parallel_processes *pp)
 	int i = pp->output_owner;
 	if (pp->children[i].state == GIT_CP_WORKING &&
 	    pp->children[i].err.len) {
-		fputs(pp->children[i].err.buf, stderr);
+		strbuf_write(&pp->children[i].err, stderr);
 		strbuf_reset(&pp->children[i].err);
 	}
 }
@@ -1135,11 +1135,11 @@ static int pp_collect_finished(struct parallel_processes *pp)
 			strbuf_addbuf(&pp->buffered_output, &pp->children[i].err);
 			strbuf_reset(&pp->children[i].err);
 		} else {
-			fputs(pp->children[i].err.buf, stderr);
+			strbuf_write(&pp->children[i].err, stderr);
 			strbuf_reset(&pp->children[i].err);
 
 			/* Output all other finished child processes */
-			fputs(pp->buffered_output.buf, stderr);
+			strbuf_write(&pp->buffered_output, stderr);
 			strbuf_reset(&pp->buffered_output);
 
 			/*
diff --git a/strbuf.c b/strbuf.c
index 38686ff..5f6da82 100644
--- a/strbuf.c
+++ b/strbuf.c
@@ -395,6 +395,12 @@ ssize_t strbuf_read_once(struct strbuf *sb, int fd, size_t hint)
 	return cnt;
 }
 
+ssize_t strbuf_write(struct strbuf *sb, FILE *f)
+{
+	return sb->len ? fwrite(sb->buf, 1, sb->len, f) : 0;
+}
+
+
 #define STRBUF_MAXLINK (2*PATH_MAX)
 
 int strbuf_readlink(struct strbuf *sb, const char *path, size_t hint)
diff --git a/strbuf.h b/strbuf.h
index 2bf90e7..d4f2aa1 100644
--- a/strbuf.h
+++ b/strbuf.h
@@ -387,6 +387,12 @@ extern ssize_t strbuf_read_file(struct strbuf *sb, const char *path, size_t hint
 extern int strbuf_readlink(struct strbuf *sb, const char *path, size_t hint);
 
 /**
+ * Write the whole content of the strbuf to the stream not stopping at
+ * NUL bytes.
+ */
+extern ssize_t strbuf_write(struct strbuf *sb, FILE *stream);
+
+/**
  * Read a line from a FILE *, overwriting the existing contents
  * of the strbuf. The second argument specifies the line
  * terminator character, typically `'\n'`.
-- 
2.7.0.rc0.37.gb7b9e8e
Previous: Stefan BellerNext: Stefan Beller
Message 6 of 16 in “[PATCHv20 00/12] Expose submodule parallelism to the user”
  1. Stefan BellerFeb 29, 2016
  2. 01/12 submodule-config: keep update strategy aroundStefan Beller, Feb 29, 2016
  3. 02/12 submodule-config: drop check against NULLStefan Beller, Feb 29, 2016
  4. 03/12 fetching submodules: respect `submodule.fetchJobs` config optionStefan Beller, Feb 29, 2016
  5. 04/12 submodule update: direct error message to stderrStefan Beller, Feb 29, 2016
  6. 05/12 run_processes_parallel: treat output of children as byte arrayStefan Beller, Feb 29, 2016
  7. 06/12 run-command: expose default_{start_failure, task_finished}Stefan Beller, Feb 29, 2016
  8. 07/12 run_processes_parallel: rename parameters for the callbacksStefan Beller, Feb 29, 2016
  9. 08/12 run_processes_parallel: correctly terminate callbacks with an LFStefan Beller, Feb 29, 2016
  10. 09/12 git submodule update: have a dedicated helper for cloningStefan Beller, Feb 29, 2016
  11. 10/12 submodule helper: remove double 'fatal: ' prefixStefan Beller, Feb 29, 2016
  12. 11/12 submodule update: expose parallelism to the userStefan Beller, Feb 29, 2016
  13. 12/12 clone: allow an explicit argument for parallel submodule clonesStefan Beller, Feb 29, 2016
  14. Jonathan NiederFeb 29, 2016
  15. Stefan BellerFeb 29, 2016
  16. Junio C HamanoFeb 29, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.