git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH 20/25] midx: don't provide a total for QSORT() progress

From
Ævar Arnfjörð Bjarmason <avarab@gmail.com>
Date
Jun 23, 2021, 17:48 UTC
Message-ID
<patch-20.25-80a991d019a-20210623T155626Z-avarab@gmail.com>
In-Reply-To
<cover-00.25-00000000000-20210623T155626Z-avarab@gmail.com>

The quicksort algorithm can be anywhere between O(n) and O(n^2), so providing a "num objects" as a total means that in some cases we're going to go past 100%.

This fixes a logic error in 5ae18df9d8e (midx: during verify group objects by packfile to speed verification, 2019-03-21), which in turn seems to have been diligently copied from my own logic error in the commit-graph.c code, see 890226ccb57 (commit-graph write: add itermediate progress, 2019-01-19).

That commit-graph code of mine was removed in 1cbdbf3bef7 (commit-graph: drop count_distinct_commits() function, 2020-12-07), so we don't need to fix that too.

Signed-off-by: Ævar Arnfjörð Bjarmason <avarab@gmail.com>
---
 midx.c | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)
diff --git a/midx.c b/midx.c
index d80e68998b8..9f1b4018c1c 100644
--- a/midx.c
+++ b/midx.c
@@ -1265,8 +1265,7 @@ int verify_midx_file(struct repository *r, const char *object_dir, unsigned flag
 	}
 
 	if (flags & MIDX_PROGRESS)
-		progress = start_progress(_("Sorting objects by packfile"),
-					  m->num_objects);
+		progress = start_progress(_("Sorting objects by packfile"), 0);
 	display_progress(progress, 0); /* TODO: Measure QSORT() progress */
 	QSORT(pairs, m->num_objects, compare_pair_pos_vs_id);
 	stop_progress(&progress);
-- 
2.32.0.599.g3967b4fa4ac
Previous: SZEDER GáborNext: Ævar Arnfjörð Bjarmason
Message 55 of 197 in “progress: verify progress counters in the test suite”
  1. 0/7 progress: verify progress counters in the test suiteSZEDER Gábor, Jun 20, 2021
  2. 1/7 progress: introduce GIT_TEST_CHECK_PROGRESS to verify progress countersSZEDER Gábor, Jun 20, 2021
  3. Ævar Arnfjörð BjarmasonJun 21, 2021
  4. Taylor BlauJun 22, 2021
  5. 2/7 progress: catch nested/overlapping progresses with GIT_TEST_CHECK_PROGRESSSZEDER Gábor, Jun 20, 2021
  6. Taylor BlauJun 22, 2021
  7. SZEDER GáborAug 30, 2021
  8. 3/7 progress: catch backwards counting with GIT_TEST_CHECK_PROGRESSSZEDER Gábor, Jun 20, 2021
  9. 4/7 commit-graph: fix bogus counter in "Scanning merged commits" progress lineSZEDER Gábor, Jun 20, 2021
  10. Ævar Arnfjörð BjarmasonJun 20, 2021
  11. René ScharfeJun 21, 2021
  12. Ævar Arnfjörð BjarmasonJun 21, 2021
  13. René ScharfeJun 26, 2021
  14. Ævar Arnfjörð BjarmasonJun 26, 2021
  15. René ScharfeJun 26, 2021
  16. Ævar Arnfjörð BjarmasonJun 26, 2021
  17. René ScharfeJul 4, 2021
  18. Junio C HamanoJul 5, 2021
  19. Ævar Arnfjörð BjarmasonJul 5, 2021
  20. René ScharfeJul 6, 2021
  21. Felipe ContrerasJun 27, 2021
  22. 5/7 entry: show finer-grained counter in "Filtering content" progress lineSZEDER Gábor, Jun 20, 2021
  23. 6/7 [RFC] entry: don't show "Filtering content: ... done." line in case of errorsSZEDER Gábor, Jun 20, 2021
  24. René ScharfeJun 21, 2021
  25. Taylor BlauJun 23, 2021
  26. SZEDER GáborAug 30, 2021
  27. 7/7 test-lib: enable GIT_TEST_CHECK_PROGRESS by defaultSZEDER Gábor, Jun 20, 2021
  28. Ævar Arnfjörð BjarmasonJun 21, 2021
  29. Taylor BlauJun 23, 2021
  30. 00/25 progress.c: various fixes + SZEDER's RFC codeÆvar Arnfjörð Bjarmason, Jun 23, 2021
  31. 01/25 progress.c tests: fix breakage with COLUMNS != 80Ævar Arnfjörð Bjarmason, Jun 23, 2021
  32. 05/25 progress.c: move signal handler functions lowerÆvar Arnfjörð Bjarmason, Jun 23, 2021
  33. 02/25 progress.c tests: make start/stop verbs on stdinÆvar Arnfjörð Bjarmason, Jun 23, 2021
  34. 03/25 progress.c tests: test some invalid usageÆvar Arnfjörð Bjarmason, Jun 23, 2021
  35. 04/25 progress.c tests: add a "signal" verbÆvar Arnfjörð Bjarmason, Jun 23, 2021
  36. 07/25 progress.c: stop eagerly fflush(stderr) when not a terminalÆvar Arnfjörð Bjarmason, Jun 23, 2021
  37. 06/25 progress.c: call progress_interval() from progress_test_force_update()Ævar Arnfjörð Bjarmason, Jun 23, 2021
  38. 08/25 progress.c: add temporary variable from progress structÆvar Arnfjörð Bjarmason, Jun 23, 2021
  39. 09/25 midx perf: add a perf test for multi-pack-indexÆvar Arnfjörð Bjarmason, Jun 23, 2021
  40. 10/25 progress.c: remove the "sparse" mode nano-optimizationÆvar Arnfjörð Bjarmason, Jun 23, 2021
  41. 11/25 pack-bitmap-write.c: add a missing stop_progress()Ævar Arnfjörð Bjarmason, Jun 23, 2021
  42. SZEDER GáborSep 17, 2021
  43. Ævar Arnfjörð BjarmasonSep 17, 2021
  44. SZEDER GáborSep 17, 2021
  45. 12/25 progress.c: add & assert a "global_progress" variableÆvar Arnfjörð Bjarmason, Jun 23, 2021
  46. SZEDER GáborSep 16, 2021
  47. 14/25 progress.[ch]: move test-only code away from "extern" variablesÆvar Arnfjörð Bjarmason, Jun 23, 2021
  48. 13/25 progress.[ch]: move the "struct progress" to the headerÆvar Arnfjörð Bjarmason, Jun 23, 2021
  49. SZEDER GáborSep 16, 2021
  50. 16/25 progress.[ch]: convert "title" to "struct strbuf"Ævar Arnfjörð Bjarmason, Jun 23, 2021
  51. 17/25 progress.c: refactor display() for less confusion, and fix bugÆvar Arnfjörð Bjarmason, Jun 23, 2021
  52. 15/25 progress.c: pass "is done?" (again) to display()Ævar Arnfjörð Bjarmason, Jun 23, 2021
  53. 18/25 progress.c: emit progress on first signal, show "stalled"Ævar Arnfjörð Bjarmason, Jun 23, 2021
  54. SZEDER GáborSep 16, 2021
  55. 20/25 midx: don't provide a total for QSORT() progressÆvar Arnfjörð Bjarmason, Jun 23, 2021
  56. 19/25 commit-graph: fix bogus counter in "Scanning merged commits" progress lineÆvar Arnfjörð Bjarmason, Jun 23, 2021
  57. 22/25 progress.c: add a stop_progress_early() functionÆvar Arnfjörð Bjarmason, Jun 23, 2021
  58. Ævar Arnfjörð BjarmasonJun 24, 2021
  59. Andrei RybakJun 25, 2021
  60. 21/25 entry: show finer-grained counter in "Filtering content" progress lineÆvar Arnfjörð Bjarmason, Jun 23, 2021
  61. 23/25 entry: deal with unexpected "Filtering content" totalÆvar Arnfjörð Bjarmason, Jun 23, 2021
  62. 24/25 progress: assert last update in stop_progress()Ævar Arnfjörð Bjarmason, Jun 23, 2021
  63. 25/25 progress: assert counting upwards in display()Ævar Arnfjörð Bjarmason, Jun 23, 2021
  64. Randall S. BeckerJun 23, 2021
  65. Ævar Arnfjörð BjarmasonJun 23, 2021
  66. Randall S. BeckerJun 23, 2021
  67. 0/4 WIP/POC check isatty(2)-protected progress linesSZEDER Gábor, Jun 23, 2021
  68. 1/4 WIP progress, isatty(2), hidden progress lnies for GIT_TEST_CHECK_PROGRESSSZEDER Gábor, Jun 23, 2021
  69. 2/4 blame: fix progress total with line rangesSZEDER Gábor, Jun 23, 2021
  70. 3/4 read-cache: avoid overlapping progress linesSZEDER Gábor, Jun 23, 2021
  71. 4/4 preload-index: fix "Refreshing index" progress lineSZEDER Gábor, Jun 23, 2021
  72. SZEDER GáborJun 23, 2021
  73. Ævar Arnfjörð BjarmasonJun 24, 2021
  74. Ævar Arnfjörð BjarmasonJun 24, 2021
  75. 0/3 progress.c API users: fix bogus countingÆvar Arnfjörð Bjarmason, Jul 22, 2021
  76. 1/3 commit-graph: fix bogus counter in "Scanning merged commits" progress lineÆvar Arnfjörð Bjarmason, Jul 22, 2021
  77. Junio C HamanoJul 23, 2021
  78. SZEDER GáborAug 2, 2021
  79. 2/3 midx: don't provide a total for QSORT() progressÆvar Arnfjörð Bjarmason, Jul 22, 2021
  80. Junio C HamanoJul 23, 2021
  81. Phillip WoodAug 5, 2021
  82. Ævar Arnfjörð BjarmasonAug 5, 2021
  83. 3/3 entry: show finer-grained counter in "Filtering content" progress lineÆvar Arnfjörð Bjarmason, Jul 22, 2021
  84. Junio C HamanoJul 23, 2021
  85. SZEDER GáborAug 2, 2021
  86. SZEDER GáborAug 2, 2021
  87. 0/3 progress.c API users: fix bogus countingÆvar Arnfjörð Bjarmason, Aug 5, 2021
  88. 1/3 commit-graph: fix bogus counter in "Scanning merged commits" progress lineÆvar Arnfjörð Bjarmason, Aug 5, 2021
  89. 2/3 midx: don't provide a total for QSORT() progressÆvar Arnfjörð Bjarmason, Aug 5, 2021
  90. 3/3 entry: show finer-grained counter in "Filtering content" progress lineÆvar Arnfjörð Bjarmason, Aug 5, 2021
  91. 0/2 progress.c API users: fix bogus countingÆvar Arnfjörð Bjarmason, Aug 23, 2021
  92. 1/2 commit-graph: fix bogus counter in "Scanning merged commits" progress lineÆvar Arnfjörð Bjarmason, Aug 23, 2021
  93. 2/2 entry: show finer-grained counter in "Filtering content" progress lineÆvar Arnfjörð Bjarmason, Aug 23, 2021
  94. 0/2 progress.c API users: fix bogus countingÆvar Arnfjörð Bjarmason, Sep 9, 2021
  95. 1/2 commit-graph: fix bogus counter in "Scanning merged commits" progress lineÆvar Arnfjörð Bjarmason, Sep 9, 2021
  96. 2/2 entry: show finer-grained counter in "Filtering content" progress lineÆvar Arnfjörð Bjarmason, Sep 9, 2021
  97. Junio C HamanoSep 9, 2021
  98. 0/8 progress: assert "global_progress" + test fixes / cleanupÆvar Arnfjörð Bjarmason, Jul 22, 2021
  99. 1/8 progress.c tests: make start/stop verbs on stdinÆvar Arnfjörð Bjarmason, Jul 22, 2021
  100. 2/8 progress.c tests: test some invalid usageÆvar Arnfjörð Bjarmason, Jul 22, 2021
  101. 3/8 progress.c: move signal handler functions lowerÆvar Arnfjörð Bjarmason, Jul 22, 2021
  102. 5/8 progress.c: stop eagerly fflush(stderr) when not a terminalÆvar Arnfjörð Bjarmason, Jul 22, 2021
  103. 4/8 progress.c: call progress_interval() from progress_test_force_update()Ævar Arnfjörð Bjarmason, Jul 22, 2021
  104. 6/8 progress.c: add temporary variable from progress structÆvar Arnfjörð Bjarmason, Jul 22, 2021
  105. 7/8 pack-bitmap-write.c: add a missing stop_progress()Ævar Arnfjörð Bjarmason, Jul 22, 2021
  106. 8/8 progress.c: add & assert a "global_progress" variableÆvar Arnfjörð Bjarmason, Jul 22, 2021
  107. Ævar Arnfjörð BjarmasonSep 16, 2021
  108. Junio C HamanoJul 23, 2021
  109. 0/8 progress: assert "global_progress" + test fixes / cleanupÆvar Arnfjörð Bjarmason, Sep 20, 2021
  110. 1/8 progress.c tests: make start/stop verbs on stdinÆvar Arnfjörð Bjarmason, Sep 20, 2021
  111. Emily ShafferOct 8, 2021
  112. 2/8 progress.c tests: test some invalid usageÆvar Arnfjörð Bjarmason, Sep 20, 2021
  113. Emily ShafferOct 8, 2021
  114. 4/8 progress.c: call progress_interval() from progress_test_force_update()Ævar Arnfjörð Bjarmason, Sep 20, 2021
  115. 3/8 progress.c: move signal handler functions lowerÆvar Arnfjörð Bjarmason, Sep 20, 2021
  116. 6/8 progress.c: add temporary variable from progress structÆvar Arnfjörð Bjarmason, Sep 20, 2021
  117. Emily ShafferOct 8, 2021
  118. 7/8 pack-bitmap-write.c: add a missing stop_progress()Ævar Arnfjörð Bjarmason, Sep 20, 2021
  119. Emily ShafferOct 8, 2021
  120. Ævar Arnfjörð BjarmasonOct 8, 2021
  121. SZEDER GáborOct 10, 2021
  122. 5/8 progress.c: stop eagerly fflush(stderr) when not a terminalÆvar Arnfjörð Bjarmason, Sep 20, 2021
  123. Emily ShafferOct 8, 2021
  124. Ævar Arnfjörð BjarmasonOct 8, 2021
  125. 8/8 progress.c: add & assert a "global_progress" variableÆvar Arnfjörð Bjarmason, Sep 20, 2021
  126. Emily ShafferOct 8, 2021
  127. Ævar Arnfjörð BjarmasonOct 8, 2021
  128. 00/10 progress: assert "global_progress" + test fixes / cleanupÆvar Arnfjörð Bjarmason, Oct 13, 2021
  129. 01/10 leak tests: fix a memory leaks in "test-progress" helperÆvar Arnfjörð Bjarmason, Oct 13, 2021
  130. 02/10 progress.c test helper: add missing bracesÆvar Arnfjörð Bjarmason, Oct 13, 2021
  131. 03/10 progress.c tests: make start/stop verbs on stdinÆvar Arnfjörð Bjarmason, Oct 13, 2021
  132. SZEDER GáborOct 21, 2021
  133. Ævar Arnfjörð BjarmasonOct 22, 2021
  134. Taylor BlauOct 22, 2021
  135. SZEDER GáborOct 24, 2021
  136. Emily ShafferOct 22, 2021
  137. 04/10 progress.c tests: test some invalid usageÆvar Arnfjörð Bjarmason, Oct 13, 2021
  138. 05/10 progress.c: move signal handler functions lowerÆvar Arnfjörð Bjarmason, Oct 13, 2021
  139. 06/10 progress.c: call progress_interval() from progress_test_force_update()Ævar Arnfjörð Bjarmason, Oct 13, 2021
  140. Taylor BlauOct 22, 2021
  141. 07/10 progress.c: add temporary variable from progress structÆvar Arnfjörð Bjarmason, Oct 13, 2021
  142. Taylor BlauOct 22, 2021
  143. 08/10 pack-bitmap-write.c: don't return without stop_progress()Ævar Arnfjörð Bjarmason, Oct 13, 2021
  144. Emily ShafferOct 22, 2021
  145. Taylor BlauOct 22, 2021
  146. 09/10 various *.c: use isatty(1|2), not isatty(STDIN_FILENO|STDERR_FILENO)Ævar Arnfjörð Bjarmason, Oct 13, 2021
  147. Emily ShafferOct 22, 2021
  148. 10/10 progress.c: add & assert a "global_progress" variableÆvar Arnfjörð Bjarmason, Oct 13, 2021
  149. Emily ShafferOct 22, 2021
  150. SZEDER GáborOct 25, 2021
  151. Junio C HamanoOct 25, 2021
  152. SZEDER GáborDec 2, 2021
  153. Ævar Arnfjörð BjarmasonDec 3, 2021
  154. Ævar Arnfjörð BjarmasonOct 25, 2021
  155. Emily ShafferOct 22, 2021
  156. Ævar Arnfjörð BjarmasonOct 22, 2021
  157. 0/8 progress: assert "global_progress" + test fixes / cleanupÆvar Arnfjörð Bjarmason, Oct 25, 2021
  158. 1/8 leak tests: fix a memory leaks in "test-progress" helperÆvar Arnfjörð Bjarmason, Oct 25, 2021
  159. 2/8 progress.c test helper: add missing bracesÆvar Arnfjörð Bjarmason, Oct 25, 2021
  160. 3/8 progress.c tests: make start/stop commands on stdinÆvar Arnfjörð Bjarmason, Oct 25, 2021
  161. 4/8 progress.c tests: test some invalid usageÆvar Arnfjörð Bjarmason, Oct 25, 2021
  162. 6/8 pack-bitmap-write.c: don't return without stop_progress()Ævar Arnfjörð Bjarmason, Oct 25, 2021
  163. 5/8 progress.c: add temporary variable from progress structÆvar Arnfjörð Bjarmason, Oct 25, 2021
  164. 7/8 various *.c: use isatty(1|2), not isatty(STDIN_FILENO|STDERR_FILENO)Ævar Arnfjörð Bjarmason, Oct 25, 2021
  165. 8/8 progress.c: add & assert a "global_progress" variableÆvar Arnfjörð Bjarmason, Oct 25, 2021
  166. Johannes SixtOct 25, 2021
  167. Ævar Arnfjörð BjarmasonOct 25, 2021
  168. 0/8 progress: assert "global_progress" + test fixes / cleanupÆvar Arnfjörð Bjarmason, Nov 1, 2021
  169. 1/8 leak tests: fix a memory leaks in "test-progress" helperÆvar Arnfjörð Bjarmason, Nov 1, 2021
  170. 2/8 progress.c test helper: add missing bracesÆvar Arnfjörð Bjarmason, Nov 1, 2021
  171. 3/8 progress.c tests: make start/stop commands on stdinÆvar Arnfjörð Bjarmason, Nov 1, 2021
  172. 4/8 progress.c tests: test some invalid usageÆvar Arnfjörð Bjarmason, Nov 1, 2021
  173. 5/8 progress.c: add temporary variable from progress structÆvar Arnfjörð Bjarmason, Nov 1, 2021
  174. 6/8 pack-bitmap-write.c: don't return without stop_progress()Ævar Arnfjörð Bjarmason, Nov 1, 2021
  175. 8/8 progress.c: add & assert a "global_progress" variableÆvar Arnfjörð Bjarmason, Nov 1, 2021
  176. 7/8 various *.c: use isatty(1|2), not isatty(STDIN_FILENO|STDERR_FILENO)Ævar Arnfjörð Bjarmason, Nov 1, 2021
  177. Carlo ArenasNov 2, 2021
  178. 0/8 progress: assert "global_progress" + test fixes / cleanupÆvar Arnfjörð Bjarmason, Nov 2, 2021
  179. 1/8 leak tests: fix a memory leaks in "test-progress" helperÆvar Arnfjörð Bjarmason, Nov 2, 2021
  180. 2/8 progress.c test helper: add missing bracesÆvar Arnfjörð Bjarmason, Nov 2, 2021
  181. 3/8 progress.c tests: make start/stop commands on stdinÆvar Arnfjörð Bjarmason, Nov 2, 2021
  182. 4/8 progress.c tests: test some invalid usageÆvar Arnfjörð Bjarmason, Nov 2, 2021
  183. 5/8 progress.c: add temporary variable from progress structÆvar Arnfjörð Bjarmason, Nov 2, 2021
  184. 6/8 pack-bitmap-write.c: don't return without stop_progress()Ævar Arnfjörð Bjarmason, Nov 2, 2021
  185. 7/8 various *.c: use isatty(0|2), not isatty(STDIN_FILENO|STDERR_FILENO)Ævar Arnfjörð Bjarmason, Nov 2, 2021
  186. 8/8 progress.c: add & assert a "global_progress" variableÆvar Arnfjörð Bjarmason, Nov 2, 2021
  187. 0/9 progress: test fixes / cleanupÆvar Arnfjörð Bjarmason, Feb 3, 2022
  188. 1/9 leak tests: fix a memory leak in "test-progress" helperÆvar Arnfjörð Bjarmason, Feb 3, 2022
  189. 2/9 progress.c test helper: add missing bracesÆvar Arnfjörð Bjarmason, Feb 3, 2022
  190. 4/9 progress.c tests: test some invalid usageÆvar Arnfjörð Bjarmason, Feb 3, 2022
  191. 8/9 progress API: unify stop_progress{,_msg}(), fix trace2 bugÆvar Arnfjörð Bjarmason, Feb 3, 2022
  192. 9/9 pack-bitmap-write.c: don't return without stop_progress()Ævar Arnfjörð Bjarmason, Feb 3, 2022
  193. 3/9 progress.c tests: make start/stop commands on stdinÆvar Arnfjörð Bjarmason, Feb 3, 2022
  194. 5/9 progress.h: format and be consistent with progress.c namingÆvar Arnfjörð Bjarmason, Feb 3, 2022
  195. 7/9 progress.c: refactor stop_progress{,_msg}() to use helpersÆvar Arnfjörð Bjarmason, Feb 3, 2022
  196. 6/9 progress.c: use dereferenced "progress" variable, not "(*p_progress)"Ævar Arnfjörð Bjarmason, Feb 3, 2022
  197. Junio C HamanoFeb 3, 2022

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.