git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH v5 02/16] reftable: fix resource leak in block.c error path

From
Junio C Hamano <gitster@pobox.com>
Date
Dec 24, 2021, 04:16 UTC
Message-ID
<xmqq4k6y63j7.fsf@gitster.g>
In-Reply-To
<CAFQ2z_OLCzOYXgXCTXyLOwwk7EBkPzwH=KASDmuJbur=q7L1Jg@mail.gmail.com>
Han-Wen Nienhuys <hanwen@google.com> writes:
> Normally, block_reader_init() transfers the block to the block_reader.
> If err > 0, we skip that, so we'd be leaking the block.
Thanks.  I was about to say that 
    <reftable/block.h> wants to say more than "initializes a block
    reader."; perhaps "returns the number of blocks" or something
    needs to be added.

but I do not think the lack of the documentation was the source of my confusion.

> At the same time, this means the "if (err)" is superfluous. In the
> success case, the block was transferred to the block_reader, so the
> reftable_block_done() call is a nop.

I agree that having the "if (err)" there is highly misleading. "if (err < 0 || 0 < err)" would be the more faithful expression of what you explained, and if it were written that way, I wouldn't have been as confused as I was.

In any case, if _done() becomes a safe and quick no-op when 0 block was transferred, losing the conditional would be the way to make the resulting code the most readable, I think.

Show 9 quoted lines
>> > +     uint8_t hash1[GIT_SHA1_RAWSZ] = { 1 };
>> > +     uint8_t hash2[GIT_SHA1_RAWSZ] = { 2 };
>>
>> Will this code be exercised when compiling with SHA256 support?  If
>> not, this is perfectly fine, but otherwise, this needs to be MAX,
>> not SHA1, no?
>
> The code is parameterized in terms of hash_size, so we don't have to
> test both flavors exhaustively.

If it is safe for this function to assume that it will be called only with hash_size of SHA1, then what you wrote is perfectly fine, and I agree that there is no particular reason why this test must be repeated for all available hashes.

I just don't know if we have a mechanism to prevent clueless code churners from saying "let's test both flavors exhaustively". For example, I see nothing in this function, other than the size of these two hashes, that says that this test function will be compiled with reftable library that expects that the hash function is SHA1. How does this function protect itself from being run in a CI job that uses GIT_TEST_DEFAULT_HASH=sha256, for example? It was why I asked the question. It wasn't that I necessarily thought we need to test all combinations (but there is no need not to, if it takes more engineering time to exclude it when testing Git as a whole in sha256 mode).

Show 8 quoted lines
>> > +     char message[100] = { 0 };
>>
>> You're filling this to the sizeof(message)-1, so we can afford to
>> leave it uninitialized.
>
> At the same time, we can afford to initialize it :-)
>
> I'd rather not think about this, and always initialize everything.

I do not care too deeply in this test-only function, but as a general principle, primarily to help less experienced developers who may be reading from the sidelines to avoid copying such an attitude, I have to make a note here.

If you know you will have to fill an array with, or assign to a variable, meaningful value(s), leaving the array or variable uninitialized at the declaration time is a much better thing to do than initializing them with less meaningful value(s). It will help compilers and tools to detect a lack of proper assignment and use of uninitialized variable (iow, you may know you will have to fill, but in the code to do so, your implementation may be botched). Once you initialize at the declaration with "less meaningful" value (like zero initialization), the tools won't be able to tell when the code uses that variable "uninitialized" (because the assignment was skipped by a bug), since it appears to always be initialied to them.

Helping the tools help us is what those of us, who would rather not think about it, should be doing.

Previous: Han-Wen NienhuysNext: Han-Wen Nienhuys
Message 81 of 194 in “Reftable coverity fixes”
  1. 00/10 Reftable coverity fixesHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  2. 01/10 reftable: fix OOB stack write in print functionsHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  3. 02/10 reftable: fix resource leak in error pathHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  4. Derrick StoleeDec 8, 2021
  5. 03/10 reftable: fix resource leak blocksource.cHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  6. 04/10 reftable: check reftable_stack_auto_compact() return valueHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  7. 05/10 reftable: ignore remove() return value in stack_test.cHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  8. 06/10 reftable: fix resource warningHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  9. 07/10 reftable: fix NULL derefs in error pathsHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  10. 08/10 reftable: order unittests by complexityHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  11. Derrick StoleeDec 8, 2021
  12. 09/10 reftable: drop stray printf in readwrite_testHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  13. 10/10 reftable: make reftable_record a tagged unionHan-Wen Nienhuys via GitGitGadget, Dec 7, 2021
  14. Junio C HamanoDec 7, 2021
  15. Jeff KingDec 8, 2021
  16. Junio C HamanoDec 8, 2021
  17. Han-Wen NienhuysDec 8, 2021
  18. Junio C HamanoDec 8, 2021
  19. config.mak.dev: specify -std=gnu99 for gcc/clangJeff King, Dec 8, 2021
  20. Ævar Arnfjörð BjarmasonDec 9, 2021
  21. Jeff KingDec 10, 2021
  22. Derrick StoleeDec 8, 2021
  23. Han-Wen NienhuysDec 8, 2021
  24. Derrick StoleeDec 8, 2021
  25. Han-Wen NienhuysDec 23, 2021
  26. Junio C HamanoDec 8, 2021
  27. Han-Wen NienhuysDec 8, 2021
  28. 00/11 Reftable coverity fixesHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  29. 01/11 reftable: fix OOB stack write in print functionsHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  30. 02/11 reftable: fix resource leak in error pathHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  31. 03/11 reftable: fix resource leak blocksource.cHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  32. 04/11 reftable: check reftable_stack_auto_compact() return valueHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  33. 05/11 reftable: ignore remove() return value in stack_test.cHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  34. 06/11 reftable: fix resource warningHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  35. 07/11 reftable: fix NULL derefs in error pathsHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  36. 08/11 reftable: order unittests by complexityHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  37. 09/11 reftable: drop stray printf in readwrite_testHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  38. 10/11 reftable: handle null refnames in reftable_ref_record_equalHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  39. 11/11 reftable: make reftable_record a tagged unionHan-Wen Nienhuys via GitGitGadget, Dec 8, 2021
  40. Jeff KingDec 9, 2021
  41. 00/11 Reftable coverity fixesHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  42. 01/11 reftable: fix OOB stack write in print functionsHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  43. 02/11 reftable: fix resource leak in error pathHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  44. Ævar Arnfjörð BjarmasonDec 13, 2021
  45. Han-Wen NienhuysDec 13, 2021
  46. Junio C HamanoDec 13, 2021
  47. 03/11 reftable: fix resource leak blocksource.cHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  48. 05/11 reftable: ignore remove() return value in stack_test.cHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  49. 04/11 reftable: check reftable_stack_auto_compact() return valueHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  50. 06/11 reftable: fix resource warningHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  51. 07/11 reftable: fix NULL derefs in error pathsHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  52. Ævar Arnfjörð BjarmasonDec 13, 2021
  53. 08/11 reftable: order unittests by complexityHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  54. Ævar Arnfjörð BjarmasonDec 13, 2021
  55. Han-Wen NienhuysDec 13, 2021
  56. Junio C HamanoDec 13, 2021
  57. 10/11 reftable: handle null refnames in reftable_ref_record_equalHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  58. 09/11 reftable: drop stray printf in readwrite_testHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  59. Ævar Arnfjörð BjarmasonDec 13, 2021
  60. Han-Wen NienhuysDec 13, 2021
  61. 11/11 reftable: make reftable_record a tagged unionHan-Wen Nienhuys via GitGitGadget, Dec 13, 2021
  62. 00/11 Reftable coverity fixesHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  63. 01/11 reftable: fix OOB stack write in print functionsHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  64. 02/11 reftable: fix resource leak in block.c error pathHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  65. 04/11 reftable: check reftable_stack_auto_compact() return valueHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  66. 03/11 reftable: fix resource leak blocksource.cHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  67. 05/11 reftable: ignore remove() return value in stack_test.cHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  68. 06/11 reftable: fix resource warningHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  69. 07/11 reftable: all xxx_free() functions accept NULL argumentsHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  70. 08/11 reftable: order unittests by complexityHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  71. 09/11 reftable: drop stray printf in readwrite_testHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  72. 10/11 reftable: handle null refnames in reftable_ref_record_equalHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  73. 11/11 reftable: make reftable_record a tagged unionHan-Wen Nienhuys via GitGitGadget, Dec 14, 2021
  74. 00/16 Reftable coverity fixesHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  75. 01/16 reftable: fix OOB stack write in print functionsHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  76. Junio C HamanoDec 22, 2021
  77. Han-Wen NienhuysDec 23, 2021
  78. 02/16 reftable: fix resource leak in block.c error pathHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  79. Junio C HamanoDec 22, 2021
  80. Han-Wen NienhuysDec 23, 2021
  81. Junio C HamanoDec 24, 2021
  82. Han-Wen NienhuysJan 12, 2022
  83. René ScharfeJan 12, 2022
  84. Junio C HamanoJan 13, 2022
  85. Ævar Arnfjörð BjarmasonJan 13, 2022
  86. Han-Wen NienhuysJan 13, 2022
  87. 03/16 reftable: fix resource leak blocksource.cHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  88. 04/16 reftable: check reftable_stack_auto_compact() return valueHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  89. 05/16 reftable: ignore remove() return value in stack_test.cHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  90. 06/16 reftable: fix resource warningHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  91. 08/16 reftable: order unittests by complexityHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  92. 07/16 reftable: all xxx_free() functions accept NULL argumentsHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  93. 09/16 reftable: drop stray printf in readwrite_testHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  94. 10/16 reftable: handle null refnames in reftable_ref_record_equalHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  95. Junio C HamanoDec 22, 2021
  96. 11/16 reftable: make reftable-record.h function signatures const correctHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  97. 12/16 reftable: implement record equality genericallyHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  98. 13/16 reftable: remove outdated file reftable.cHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  99. Junio C HamanoDec 22, 2021
  100. Ævar Arnfjörð BjarmasonDec 24, 2021
  101. 15/16 reftable: add print functions to the record typesHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  102. 16/16 reftable: be more paranoid about 0-length memcpy callsHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  103. Junio C HamanoDec 22, 2021
  104. René ScharfeDec 23, 2021
  105. Junio C HamanoDec 23, 2021
  106. René ScharfeDec 26, 2021
  107. Ævar Arnfjörð BjarmasonDec 26, 2021
  108. Han-Wen NienhuysDec 23, 2021
  109. Junio C HamanoDec 24, 2021
  110. Han-Wen NienhuysJan 12, 2022
  111. Han-Wen NienhuysJan 12, 2022
  112. 14/16 reftable: make reftable_record a tagged unionHan-Wen Nienhuys via GitGitGadget, Dec 22, 2021
  113. Junio C HamanoDec 22, 2021
  114. 00/15 Reftable coverity fixesHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  115. 01/15 reftable: fix OOB stack write in print functionsHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  116. Ævar Arnfjörð BjarmasonJan 21, 2022
  117. Han-Wen NienhuysJan 24, 2022
  118. 02/15 reftable: fix resource leak in block.c error pathHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  119. Ævar Arnfjörð BjarmasonJan 21, 2022
  120. Junio C HamanoJan 22, 2022
  121. 03/15 reftable: fix resource leak blocksource.cHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  122. 04/15 reftable: check reftable_stack_auto_compact() return valueHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  123. Ævar Arnfjörð BjarmasonJan 21, 2022
  124. 06/15 reftable: fix resource warningHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  125. 05/15 reftable: ignore remove() return value in stack_test.cHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  126. Ævar Arnfjörð BjarmasonJan 21, 2022
  127. 07/15 reftable: all xxx_free() functions accept NULL argumentsHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  128. 09/15 reftable: drop stray printf in readwrite_testHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  129. 10/15 reftable: handle null refnames in reftable_ref_record_equalHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  130. 08/15 reftable: order unittests by complexityHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  131. 11/15 reftable: make reftable-record.h function signatures const correctHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  132. 12/15 reftable: implement record equality genericallyHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  133. Ævar Arnfjörð BjarmasonJan 21, 2022
  134. 15/15 reftable: add print functions to the record typesHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  135. Ævar Arnfjörð BjarmasonJan 21, 2022
  136. Han-Wen NienhuysJan 24, 2022
  137. 13/15 reftable: remove outdated file reftable.cHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  138. Ævar Arnfjörð BjarmasonJan 21, 2022
  139. 14/15 reftable: make reftable_record a tagged unionHan-Wen Nienhuys via GitGitGadget, Jan 20, 2022
  140. Ævar Arnfjörð BjarmasonJan 21, 2022
  141. Han-Wen NienhuysJan 24, 2022
  142. 00/16 Reftable coverity fixesHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  143. 04/16 reftable: check reftable_stack_auto_compact() return valueHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  144. 12/16 reftable: implement record equality genericallyHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  145. 13/16 reftable: remove outdated file reftable.cHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  146. 09/16 reftable: drop stray printf in readwrite_testHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  147. 16/16 reftable: rename typ to typeHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  148. 02/16 reftable: fix resource leak in block.c error pathHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  149. 03/16 reftable: fix resource leak blocksource.cHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  150. 01/16 reftable: fix OOB stack write in print functionsHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  151. Ævar Arnfjörð BjarmasonJan 24, 2022
  152. 05/16 reftable: ignore remove() return value in stack_test.cHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  153. 06/16 reftable: fix resource warningHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  154. 07/16 reftable: all xxx_free() functions accept NULL argumentsHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  155. 08/16 reftable: order unittests by complexityHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  156. 10/16 reftable: handle null refnames in reftable_ref_record_equalHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  157. 11/16 reftable: make reftable-record.h function signatures const correctHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  158. 15/16 reftable: add print functions to the record typesHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  159. 14/16 reftable: make reftable_record a tagged unionHan-Wen Nienhuys via GitGitGadget, Jan 24, 2022
  160. Ævar Arnfjörð BjarmasonJan 24, 2022
  161. Han-Wen NienhuysJan 24, 2022
  162. Ævar Arnfjörð BjarmasonJan 24, 2022
  163. master doesn't compile on xlc 21.01 anymore (old AIX compiler) (was: [PATCH v7 14/16] reftable: make reftable_record a tagged union)Ævar Arnfjörð Bjarmason, Feb 19, 2022
  164. René ScharfeFeb 19, 2022
  165. reftable: make assignments portable to AIX xlc v12.01Ævar Arnfjörð Bjarmason, Mar 28, 2022
  166. Junio C HamanoMar 28, 2022
  167. Han-Wen NienhuysMar 29, 2022
  168. Junio C HamanoMar 29, 2022
  169. Ævar Arnfjörð BjarmasonJan 24, 2022
  170. brian m. carlsonJan 14, 2022
  171. Ævar Arnfjörð BjarmasonJan 14, 2022
  172. Junio C HamanoJan 14, 2022
  173. Ævar Arnfjörð BjarmasonJan 14, 2022
  174. Junio C HamanoJan 14, 2022
  175. Junio C HamanoJan 14, 2022
  176. Junio C HamanoJan 14, 2022
  177. Ævar Arnfjörð BjarmasonJan 14, 2022
  178. Junio C HamanoJan 15, 2022
  179. Ævar Arnfjörð BjarmasonJan 15, 2022
  180. Junio C HamanoJan 15, 2022
  181. Johannes SchindelinJan 18, 2022
  182. Ævar Arnfjörð BjarmasonJan 18, 2022
  183. Junio C HamanoJan 18, 2022
  184. Ævar Arnfjörð BjarmasonJan 19, 2022
  185. Junio C HamanoJan 19, 2022
  186. Ævar Arnfjörð BjarmasonJan 19, 2022
  187. Junio C HamanoJan 19, 2022
  188. Makefile: FreeBSD cannot do C99-or-below buildJunio C Hamano, Jan 18, 2022
  189. Neeraj SinghJan 18, 2022
  190. Ævar Arnfjörð BjarmasonJan 18, 2022
  191. Junio C HamanoJan 19, 2022
  192. config.mak.dev: fix DEVELOPER=1 on FreeBSD with -std=gnu99Ævar Arnfjörð Bjarmason, Jan 18, 2022
  193. Junio C HamanoJan 18, 2022
  194. Ævar Arnfjörð BjarmasonJan 19, 2022

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.