git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH 1/2] commit-graph, fuzz: Add fuzzer for commit-graph

From
Junio C Hamano <gitster@pobox.com>
Date
Dec 6, 2018, 01:32 UTC
Message-ID
<xmqqmupja19b.fsf@gitster-ct.c.googlers.com>
In-Reply-To
<53e62baaa8769bf8e90991e32e0d123cc6629559.1544048946.git.steadmon@google.com>
Josh Steadmon <steadmon@google.com> writes:
Show 5 quoted lines
> @@ -108,27 +106,61 @@ struct commit_graph *load_commit_graph_one(const char *graph_file)
>  		die(_("graph file %s is too small"), graph_file);
>  	}
>  	graph_map = xmmap(NULL, graph_size, PROT_READ, MAP_PRIVATE, fd, 0);
> +	ret = parse_commit_graph(graph_map, fd, graph_size);

OK, assuming that the new helper returns NULL from all places in the original that would have jumped to the cleanup-fail label, this would do the same thing (it may not be the right thing to exit, but that is OK for the purpose of this change).

Show 13 quoted lines
> +	if (ret == NULL) {
> +		munmap(graph_map, graph_size);
> +		close(fd);
> +		exit(1);
> +	}
> +
> +	return ret;
> +}
> +
> +/*
> + * This function is intended to be used only from load_commit_graph_one() or in
> + * fuzz tests.
> + */
Hmph, is that necessary to say?  

"Right now, it has only these two callers" is sometimes handy for those without good static analysis tools, like "git grep" ;-), but I do not think of a reason why a new caller we'll add in the future, who happens to have the data of the graph file in-core, should not be allowed to call this function.

Show 16 quoted lines
> +struct commit_graph *parse_commit_graph(void *graph_map, int fd,
> +					size_t graph_size)
> +{
> +	const unsigned char *data, *chunk_lookup;
> +	uint32_t i;
> +	struct commit_graph *graph;
> +	uint64_t last_chunk_offset;
> +	uint32_t last_chunk_id;
> +	uint32_t graph_signature;
> +	unsigned char graph_version, hash_version;
> +
> +	/*
> +	 * This should already be checked in load_commit_graph_one, but we still
> +	 * need a check here for when we're calling parse_commit_graph directly
> +	 * from fuzz tests. We can omit the error message in that case.
> +	 */

In the same spirit, I am dubious of the longer-term value of this comment. As an explanation of why this conversion is correct in the proposed log message for this change, it perfectly makes sense, though.

> +	if (graph_size < GRAPH_MIN_SIZE)
> +		return NULL;
> +

The load_commit_graph_one() grabbed graph_map out of xmmap() so it is guaranteed to be non-NULL, but we need to check graph_map != NULL when we're calling this directly from the fuzz tests, exactly in the same spirit that we check graph_size above. Besides, these are to make sure future callers won't misuse the API.

>  	data = (const unsigned char *)graph_map;

And the reset of the function is the same as the original modulo jumping to the cleanup_fail label has been replaced with returning NULL.

Looks good.
Show 33 quoted lines
> ...
> -
> -cleanup_fail:
> -	munmap(graph_map, graph_size);
> -	close(fd);
> -	exit(1);
>  }
>  
>  static void prepare_commit_graph_one(struct repository *r, const char *obj_dir)
> diff --git a/fuzz-commit-graph.c b/fuzz-commit-graph.c
> new file mode 100644
> index 0000000000..420851d0d2
> --- /dev/null
> +++ b/fuzz-commit-graph.c
> @@ -0,0 +1,18 @@
> +#include "object-store.h"
> +#include "commit-graph.h"
> +
> +struct commit_graph *parse_commit_graph(void *graph_map, int fd,
> +					size_t graph_size);
> +
> +int LLVMFuzzerTestOneInput(const uint8_t *data, size_t size);
> +
> +int LLVMFuzzerTestOneInput(const uint8_t *data, size_t size)
> +{
> +	struct commit_graph *g;
> +
> +	g = parse_commit_graph((void *) data, -1, size);
> +	if (g)
> +		free(g);
> +
> +	return 0;
> +}
Previous: Josh SteadmonNext: Junio C Hamano
Message 5 of 50 in “Add commit-graph fuzzer and fix buffer overflow”
  1. 0/2 Add commit-graph fuzzer and fix buffer overflowJosh Steadmon, Dec 5, 2018
  2. 1/2 commit-graph, fuzz: Add fuzzer for commit-graphJosh Steadmon, Dec 5, 2018
  3. Ævar Arnfjörð BjarmasonDec 5, 2018
  4. Josh SteadmonDec 6, 2018
  5. Junio C HamanoDec 6, 2018
  6. Junio C HamanoDec 6, 2018
  7. Junio C HamanoDec 6, 2018
  8. 2/2 commit-graph: fix buffer read-overflowJosh Steadmon, Dec 5, 2018
  9. Derrick StoleeDec 6, 2018
  10. 0/3 Add commit-graph fuzzer and fix buffer overflowJosh Steadmon, Dec 6, 2018
  11. 1/3 commit-graph, fuzz: Add fuzzer for commit-graphJosh Steadmon, Dec 6, 2018
  12. 2/3 commit-graph: fix buffer read-overflowJosh Steadmon, Dec 6, 2018
  13. Jeff KingDec 7, 2018
  14. Derrick StoleeDec 7, 2018
  15. 3/3 Makefile: correct example fuzz buildJosh Steadmon, Dec 6, 2018
  16. 0/3 Add commit-graph fuzzer and fix buffer overflowJosh Steadmon, Dec 7, 2018
  17. 1/3 commit-graph, fuzz: Add fuzzer for commit-graphJosh Steadmon, Dec 7, 2018
  18. 2/3 commit-graph: fix buffer read-overflowJosh Steadmon, Dec 7, 2018
  19. Junio C HamanoDec 9, 2018
  20. SZEDER GáborDec 10, 2018
  21. Josh SteadmonDec 10, 2018
  22. Josh SteadmonDec 10, 2018
  23. Jeff KingDec 11, 2018
  24. 3/3 Makefile: correct example fuzz buildJosh Steadmon, Dec 7, 2018
  25. 0/3 Add commit-graph fuzzer and fix buffer overflowJosh Steadmon, Dec 13, 2018
  26. 1/3 commit-graph, fuzz: Add fuzzer for commit-graphJosh Steadmon, Dec 13, 2018
  27. 2/3 commit-graph: fix buffer read-overflowJosh Steadmon, Dec 13, 2018
  28. SZEDER GáborJan 12, 2019
  29. Josh SteadmonJan 15, 2019
  30. 3/3 Makefile: correct example fuzz buildJosh Steadmon, Dec 13, 2018
  31. Jeff KingDec 18, 2018
  32. Josh SteadmonDec 18, 2018
  33. Jeff KingDec 19, 2018
  34. Johannes SchindelinDec 20, 2018
  35. Jeff KingDec 20, 2018
  36. Junio C HamanoDec 26, 2018
  37. 0/3 Add commit-graph fuzzer and fix buffer overflowJosh Steadmon, Jan 15, 2019
  38. 1/3 commit-graph, fuzz: Add fuzzer for commit-graphJosh Steadmon, Jan 15, 2019
  39. Junio C HamanoJan 15, 2019
  40. 2/3 commit-graph: fix buffer read-overflowJosh Steadmon, Jan 15, 2019
  41. 3/3 Makefile: correct example fuzz buildJosh Steadmon, Jan 15, 2019
  42. Junio C HamanoJan 15, 2019
  43. Josh SteadmonJan 15, 2019
  44. Junio C HamanoJan 15, 2019
  45. 0/3 Add commit-graph fuzzer and fix buffer overflowJosh Steadmon, Jan 15, 2019
  46. 1/3 commit-graph, fuzz: Add fuzzer for commit-graphJosh Steadmon, Jan 15, 2019
  47. 2/3 commit-graph: fix buffer read-overflowJosh Steadmon, Jan 15, 2019
  48. Ævar Arnfjörð BjarmasonFeb 20, 2019
  49. SZEDER GáborFeb 20, 2019
  50. 3/3 Makefile: correct example fuzz buildJosh Steadmon, Jan 15, 2019

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.