git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH v2 2/2] object-file: flush transaction packfile before migrating objects

From
Justin Tobler <jltobler@gmail.com>
Date
Sep 23, 2026, 22:03 UTC
Message-ID
<20260923220315.569424-3-jltobler@gmail.com>
In-Reply-To
<20260923220315.569424-1-jltobler@gmail.com>

A "files" ODB transaction creates a temporary directory to stage newly written objects in when configured to batch fsync loose objects. Once the temporary directory is created, it is configured as the primary ODB and all object are written to it accordingly. This also includes packfiles containing blobs that exceed `core.bigFileThreshold` written via `odb_transaction_files_write_object_stream()`.

If a "large" blob packfile is written to the ODB transaction temporary directory after other loose objects, the ODB transaction fails to commit as a result of the temporary directory being migrated prior to the packfile being flushed. Fix this bug by always flushing the packfile transaction before objects are migrated to the main ODB.

Signed-off-by: Justin Tobler <jltobler@gmail.com>
---
 object-file.c    |  4 ++--
 t/t1050-large.sh | 17 +++++++++++++++++
 2 files changed, 19 insertions(+), 2 deletions(-)
diff --git a/object-file.c b/object-file.c
index 0f123b79fa..210984f825 100644
--- a/object-file.c
+++ b/object-file.c
@@ -1262,6 +1262,8 @@ static int odb_transaction_files_commit(struct odb_transaction *base)
 		container_of(base, struct odb_transaction_files, base);
 	int have_packfile = !!transaction->packfile.f;
 
+	flush_packfile_transaction(transaction);
+
 	if (transaction->objdir) {
 		struct strbuf temp_path = STRBUF_INIT;
 		struct tempfile *temp;
@@ -1292,8 +1294,6 @@ static int odb_transaction_files_commit(struct odb_transaction *base)
 		transaction->objdir = NULL;
 	}
 
-	flush_packfile_transaction(transaction);
-
 	if (have_packfile)
 		odb_reprepare(transaction->base.source->odb);
 
diff --git a/t/t1050-large.sh b/t/t1050-large.sh
index d295c265c7..95233458b4 100755
--- a/t/t1050-large.sh
+++ b/t/t1050-large.sh
@@ -87,6 +87,23 @@ test_expect_success 'add a large file or two' '
 	test $count = 1
 '
 
+test_expect_success 'add large file with loose object in batch fsync' '
+	test_when_finished "rm -rf batch" &&
+	git init batch &&
+	(
+		cd batch &&
+		git config core.bigFileThreshold 5 &&
+		echo foo >1-small &&
+		echo foobar >2-large &&
+
+		git -c core.fsync=loose-object -c core.fsyncMethod=batch \
+			add 1-small 2-large &&
+
+		git cat-file -e :1-small &&
+		git cat-file -e :2-large
+	)
+'
+
 test_expect_success 'checkout a large file' '
 	large1=$(git rev-parse :large1) &&
 	git update-index --add --cacheinfo 100644 $large1 another &&
-- 
2.55.0.424.g13c7afec21
Previous: Patrick SteinhardtNext: Patrick Steinhardt
Message 17 of 18 in “object-file: fix packfile flush during transaction commit”
  1. 0/2 object-file: fix packfile flush during transaction commitJustin Tobler, Sep 13, 2026
  2. 1/2 object-file: lift ODB reprepare out of packfile flushJustin Tobler, Sep 13, 2026
  3. Karthik NayakSep 15, 2026
  4. Justin ToblerSep 15, 2026
  5. Patrick SteinhardtSep 23, 2026
  6. Justin ToblerSep 23, 2026
  7. Patrick SteinhardtSep 24, 2026
  8. Patrick SteinhardtSep 24, 2026
  9. 2/2 object-file: flush transaction packfile before migrating objectsJustin Tobler, Sep 13, 2026
  10. Karthik NayakSep 15, 2026
  11. Justin ToblerSep 15, 2026
  12. Patrick SteinhardtSep 23, 2026
  13. Justin ToblerSep 23, 2026
  14. 0/2 object-file: fix packfile flush during transaction commitJustin Tobler, Sep 23, 2026
  15. 1/2 object-file: lift ODB reprepare out of packfile flushJustin Tobler, Sep 23, 2026
  16. Patrick SteinhardtSep 24, 2026
  17. 2/2 object-file: flush transaction packfile before migrating objectsJustin Tobler, Sep 23, 2026
  18. Patrick SteinhardtSep 24, 2026

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.