git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH 11/20] commit-graph.c: prevent overflow in `write_commit_graph_file()`

From
Taylor Blau <me@ttaylorr.com>
Date
Jul 12, 2023, 23:37 UTC
Message-ID
<66e57bf359dad6c83e103f2b6ffa51d82f604d8d.1689205042.git.me@ttaylorr.com>
In-Reply-To
<cover.1689205042.git.me@ttaylorr.com>

When writing a commit-graph, we use the chunk-format API to write out each individual chunk of the commit-graph. Each chunk of the commit-graph is tracked via a call to `add_chunk()`, along with the expected size of that chunk.

Similar to an earlier commit which handled the identical issue in the MIDX machinery, guard against overflow when dealing with a commit-graph with a large number of entries to avoid corrupting the contents of the commit-graph itself.

Signed-off-by: Taylor Blau <me@ttaylorr.com>
---
 commit-graph.c | 20 ++++++++++----------
 1 file changed, 10 insertions(+), 10 deletions(-)
diff --git a/commit-graph.c b/commit-graph.c
index f70afccada..538f96b27a 100644
--- a/commit-graph.c
+++ b/commit-graph.c
@@ -1952,35 +1952,35 @@ static int write_commit_graph_file(struct write_commit_graph_context *ctx)
 
 	add_chunk(cf, GRAPH_CHUNKID_OIDFANOUT, GRAPH_FANOUT_SIZE,
 		  write_graph_chunk_fanout);
-	add_chunk(cf, GRAPH_CHUNKID_OIDLOOKUP, hashsz * ctx->commits.nr,
+	add_chunk(cf, GRAPH_CHUNKID_OIDLOOKUP, st_mult(hashsz, ctx->commits.nr),
 		  write_graph_chunk_oids);
-	add_chunk(cf, GRAPH_CHUNKID_DATA, (hashsz + 16) * ctx->commits.nr,
+	add_chunk(cf, GRAPH_CHUNKID_DATA, st_mult(hashsz + 16, ctx->commits.nr),
 		  write_graph_chunk_data);
 
 	if (ctx->write_generation_data)
 		add_chunk(cf, GRAPH_CHUNKID_GENERATION_DATA,
-			  sizeof(uint32_t) * ctx->commits.nr,
+			  st_mult(sizeof(uint32_t), ctx->commits.nr),
 			  write_graph_chunk_generation_data);
 	if (ctx->num_generation_data_overflows)
 		add_chunk(cf, GRAPH_CHUNKID_GENERATION_DATA_OVERFLOW,
-			  sizeof(timestamp_t) * ctx->num_generation_data_overflows,
+			  st_mult(sizeof(timestamp_t), ctx->num_generation_data_overflows),
 			  write_graph_chunk_generation_data_overflow);
 	if (ctx->num_extra_edges)
 		add_chunk(cf, GRAPH_CHUNKID_EXTRAEDGES,
-			  4 * ctx->num_extra_edges,
+			  st_mult(4, ctx->num_extra_edges),
 			  write_graph_chunk_extra_edges);
 	if (ctx->changed_paths) {
 		add_chunk(cf, GRAPH_CHUNKID_BLOOMINDEXES,
-			  sizeof(uint32_t) * ctx->commits.nr,
+			  st_mult(sizeof(uint32_t), ctx->commits.nr),
 			  write_graph_chunk_bloom_indexes);
 		add_chunk(cf, GRAPH_CHUNKID_BLOOMDATA,
-			  sizeof(uint32_t) * 3
-				+ ctx->total_bloom_filter_data_size,
+			  st_add(sizeof(uint32_t) * 3,
+				 ctx->total_bloom_filter_data_size),
 			  write_graph_chunk_bloom_data);
 	}
 	if (ctx->num_commit_graphs_after > 1)
 		add_chunk(cf, GRAPH_CHUNKID_BASE,
-			  hashsz * (ctx->num_commit_graphs_after - 1),
+			  st_mult(hashsz, ctx->num_commit_graphs_after - 1),
 			  write_graph_chunk_base);
 
 	hashwrite_be32(f, GRAPH_SIGNATURE);
@@ -1998,7 +1998,7 @@ static int write_commit_graph_file(struct write_commit_graph_context *ctx)
 			    get_num_chunks(cf));
 		ctx->progress = start_delayed_progress(
 			progress_title.buf,
-			get_num_chunks(cf) * ctx->commits.nr);
+			st_mult(get_num_chunks(cf), ctx->commits.nr));
 	}
 
 	write_chunkfile(cf, ctx);
-- 
2.41.0.347.g7b976b8871f
Previous: Taylor BlauNext: Taylor Blau
Message 18 of 28 in “guard object lookups against 32-bit overflow”
  1. 00/20 guard object lookups against 32-bit overflowTaylor Blau, Jul 12, 2023
  2. 01/20 packfile.c: prevent overflow in `nth_packed_object_id()`Taylor Blau, Jul 12, 2023
  3. 02/20 packfile.c: prevent overflow in `load_idx()`Taylor Blau, Jul 12, 2023
  4. Phillip WoodJul 13, 2023
  5. Taylor BlauJul 13, 2023
  6. Taylor BlauJul 14, 2023
  7. Phillip WoodJul 14, 2023
  8. Junio C HamanoJul 14, 2023
  9. Phillip WoodJul 14, 2023
  10. Junio C HamanoJul 13, 2023
  11. 03/20 packfile.c: use checked arithmetic in `nth_packed_object_offset()`Taylor Blau, Jul 12, 2023
  12. 04/20 midx.c: use `size_t`'s for fanout nr and allocTaylor Blau, Jul 12, 2023
  13. 05/20 midx.c: prevent overflow in `nth_midxed_object_oid()`Taylor Blau, Jul 12, 2023
  14. 06/20 midx.c: prevent overflow in `nth_midxed_offset()`Taylor Blau, Jul 12, 2023
  15. 08/20 midx.c: prevent overflow in `write_midx_internal()`Taylor Blau, Jul 12, 2023
  16. 09/20 midx.c: prevent overflow in `fill_included_packs_batch()`Taylor Blau, Jul 12, 2023
  17. 10/20 pack-bitmap.c: ensure that eindex lookups don't overflowTaylor Blau, Jul 12, 2023
  18. 11/20 commit-graph.c: prevent overflow in `write_commit_graph_file()`Taylor Blau, Jul 12, 2023
  19. 12/20 commit-graph.c: prevent overflow in add_graph_to_chain()Taylor Blau, Jul 12, 2023
  20. 13/20 commit-graph.c: prevent overflow in `load_oid_from_graph()`Taylor Blau, Jul 12, 2023
  21. 14/20 commit-graph.c: prevent overflow in `fill_commit_graph_info()`Taylor Blau, Jul 12, 2023
  22. 15/20 commit-graph.c: prevent overflow in `fill_commit_in_graph()`Taylor Blau, Jul 12, 2023
  23. 16/20 commit-graph.c: prevent overflow in `load_tree_for_commit()`Taylor Blau, Jul 12, 2023
  24. 17/20 commit-graph.c: prevent overflow in `split_graph_merge_strategy()`Taylor Blau, Jul 12, 2023
  25. 18/20 commit-graph.c: prevent overflow in `merge_commit_graph()`Taylor Blau, Jul 12, 2023
  26. 19/20 commit-graph.c: prevent overflow in `write_commit_graph()`Taylor Blau, Jul 12, 2023
  27. 20/20 commit-graph.c: prevent overflow in `verify_commit_graph()`Taylor Blau, Jul 12, 2023
  28. 07/20 midx.c: store `nr`, `alloc` variables as `size_t`'sTaylor Blau, Jul 12, 2023

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.