git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH 2/4] fast-import: allow atom_table to grow dynamically

From
Jonathan Nieder <jrnieder@gmail.com>
Date
Apr 11, 2012, 12:14 UTC
Message-ID
<20120411121414.GD19568@burratino>
In-Reply-To
<20120411121259.GB19568@burratino>
From: David Barr <david.barr@cordelta.com>
Date: Thu, 31 Mar 2011 22:59:57 +1100

Use a struct hash_table to allow the table for atom strings to grow. See the previous commit for explanations.

[jn: with init_hash call, even though it's technically not needed]
Signed-off-by: David Barr <david.barr@cordelta.com>
Signed-off-by: Jonathan Nieder <jrnieder@gmail.com>
---
 fast-import.c |   18 +++++++++++-------
 1 file changed, 11 insertions(+), 7 deletions(-)
diff --git a/fast-import.c b/fast-import.c
index a79a1260..67769573 100644
--- a/fast-import.c
+++ b/fast-import.c
@@ -299,9 +299,8 @@ static size_t total_allocd;
 static struct mem_pool *mem_pool;
 
 /* Atom management */
-static unsigned int atom_table_sz = 4451;
 static unsigned int atom_cnt;
-static struct atom_str **atom_table;
+static struct hash_table atom_table;
 
 /* The .pack file being generated */
 static unsigned int pack_id;
@@ -691,10 +690,11 @@ static struct object_entry *find_mark(uintmax_t idnum)
 
 static struct atom_str *to_atom(const char *s, unsigned short len)
 {
-	unsigned int hc = hc_str(s, len) % atom_table_sz;
+	unsigned int hc = hc_str(s, len);
 	struct atom_str *c;
+	void **pos;
 
-	for (c = atom_table[hc]; c; c = c->next_atom)
+	for (c = lookup_hash(hc, &atom_table); c; c = c->next_atom)
 		if (c->str_len == len && !strncmp(s, c->str_dat, len))
 			return c;
 
@@ -702,8 +702,12 @@ static struct atom_str *to_atom(const char *s, unsigned short len)
 	c->str_len = len;
 	strncpy(c->str_dat, s, len);
 	c->str_dat[len] = 0;
-	c->next_atom = atom_table[hc];
-	atom_table[hc] = c;
+	c->next_atom = NULL;
+	pos = insert_hash(hc, c, &atom_table);
+	if (pos) {
+		c->next_atom = *pos;
+		*pos = c;
+	}
 	atom_cnt++;
 	return c;
 }
@@ -3270,7 +3274,7 @@ int main(int argc, const char **argv)
 
 	alloc_objects(object_entry_alloc);
 	strbuf_init(&command_buf, 0);
-	atom_table = xcalloc(atom_table_sz, sizeof(struct atom_str*));
+	init_hash(&atom_table);
 	branch_table = xcalloc(branch_table_sz, sizeof(struct branch*));
 	avail_tree_table = xcalloc(avail_tree_table_sz, sizeof(struct avail_tree_content*));
 	init_hash(&object_table);
-- 
1.7.10
Previous: Jonathan NiederNext: Jonathan Nieder
Message 11 of 13 in “fast-import: use struct hash_table”
  1. David BarrMar 31, 2011
  2. 1/2 fast-import: use struct hash_table for atom stringsDavid Barr, Mar 31, 2011
  3. Jonathan NiederApr 2, 2011
  4. Jonathan NiederApr 2, 2011
  5. 2/2 fast-import: use struct hash_table for objectsDavid Barr, Mar 31, 2011
  6. Jonathan NiederApr 2, 2011
  7. Jonathan NiederApr 2, 2011
  8. 0/4 Re: fast-import: use struct hash_tableJonathan Nieder, Apr 11, 2012
  9. 0/4 Re: fast-import: use struct hash_tableJonathan Nieder, Apr 11, 2012
  10. 1/4 fast-import: allow object_table to grow dynamicallyJonathan Nieder, Apr 11, 2012
  11. 2/4 fast-import: allow atom_table to grow dynamicallyJonathan Nieder, Apr 11, 2012
  12. 3/4 fast-import: allow branch_table to grow dynamicallyJonathan Nieder, Apr 11, 2012
  13. 4/4 fast-import: use DIV_ROUND_UPJonathan Nieder, Apr 11, 2012

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.