git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH 00/29] t: detect and fix broken &&-chains in subshells

From
Eric Sunshine <sunshine@sunshineco.com>
Date
Jun 26, 2018, 07:29 UTC
Message-ID
<20180626073001.6555-1-sunshine@sunshineco.com>

The --chain-lint[1] option detects breakage in the top-level &&-chain of tests. This series undertakes the more complex task of teaching it to also detect &&-chain breakage within subshells. See patch 29/29 for the gory details of how that's done.

The series is built atop 'master', however, it has a conflict with an in-flight topic. In particular, patch 1/29 rewrites a test in t7508 in 'master' to avoid &&-chain breakage. 'jc/clean-after-sanity-tests' in 'next' performs pretty much the same rewrite. If this series is queued atop 'master', then it needs patch 1/29; if it is queued somewhere above 'jc/clean-after-sanity-tests', then 1/29 can be dropped.

Aside from identifying a rather significant number of &&-chain breaks, repairing those broken chains uncovered genuine bugs in several tests which were hidden by missing &&-chain links. Those bugs are also fixed by this series. I would appreciate if the following people would double-check my fixes:

Stefan Bellar - 8/29 "t7400" and (especially) 13/29 "lib-submodule-update" Jonathan Tan - 10/29 "t9001" Elijah Newren - 6/29 "t6036"

In order to keep the noise level down and ease review burden, please take into account that I largely avoided modernizations and cleanups, and limited changes to merely adding "&&" even when some other transformation would have made the fix nicer overall. (For example, I resisted the urge to replace a series of 'echo' statements in a subshell with a simple here-doc.)

Finally, although all simple &&-chain fixes originally inhabited a single patch, they were split out into several patches to avoid hitting vger.kernel.org's message size limit. However, when queuing, all patches titled "t????: fix broken &&-chains in subshells" could be squashed into a single patch titled "t: fix broken &&-chains in subshells".

[1]: https://public-inbox.org/git/20150320100429.GA17354@peff.net/
Eric Sunshine (29):
  t7508: use test_when_finished() instead of managing exit code manually
  t0001: use "{...}" block around "||" expression rather than subshell
  t1300: use sane_unset() to avoid breaking &&-chain
  t3303: use standard here-doc tag "EOF" to avoid fooling --chain-lint
  t5505: modernize and simplify hard-to-digest test
  t6036: fix broken "merge fails but has appropriate contents" tests
  t7201: drop pointless "exit 0" at end of subshell
  t7400: fix broken "submodule add/reconfigure --force" test
  t7810: use test_expect_code() instead of hand-rolled comparison
  t9001: fix broken "invoke hook" test
  t9104: use "{...}" block around "||" expression rather than subshell
  t9401: drop unnecessary nested subshell
  t/lib-submodule-update: fix broken "replace submodule must-fail" test
  t: drop subshell with missing &&-chain in favor of simpler construct
  t: drop unnecessary terminating semicolons in subshell
  t: use test_might_fail() instead of manipulating exit code manually
  t: use test_must_fail() instead of checking exit code manually
  t0000-t0999: fix broken &&-chains in subshells
  t1000-t1999: fix broken &&-chains in subshells
  t2000-t2999: fix broken &&-chains in subshells
  t3000-t3999: fix broken &&-chains in subshells
  t3030: fix broken &&-chains in subshells
  t4000-t4999: fix broken &&-chains in subshells
  t5000-t5999: fix broken &&-chains in subshells
  t6000-t6999: fix broken &&-chains in subshells
  t7000-t7999: fix broken &&-chains in subshells
  t9000-t9999: fix broken &&-chains in subshells
  t9119: fix broken &&-chains in subshells
  t/test-lib: teach --chain-lint to detect broken &&-chains in subshells
 t/lib-submodule-update.sh                     |  10 +-
 t/t0000-basic.sh                              |   2 +-
 t/t0001-init.sh                               |   2 +-
 t/t0003-attributes.sh                         |  24 +-
 t/t0021-conversion.sh                         |   4 +-
 t/t0090-cache-tree.sh                         |   2 +-
 t/t1004-read-tree-m-u-wf.sh                   |   8 +-
 t/t1005-read-tree-reset.sh                    |  10 +-
 t/t1008-read-tree-overlay.sh                  |   2 +-
 t/t1020-subdirectory.sh                       |   2 +-
 t/t1050-large.sh                              |   6 +-
 t/t1300-config.sh                             |   2 +-
 t/t1411-reflog-show.sh                        |   6 +-
 t/t1507-rev-parse-upstream.sh                 |   6 +-
 t/t1512-rev-parse-disambiguation.sh           |   6 +-
 t/t1700-split-index.sh                        |   2 +-
 t/t2016-checkout-patch.sh                     |  24 +-
 t/t2103-update-index-ignore-missing.sh        |   2 +-
 t/t2202-add-addremove.sh                      |  14 +-
 t/t3000-ls-files-others.sh                    |   2 +-
 t/t3006-ls-files-long.sh                      |   2 +-
 t/t3008-ls-files-lazy-init-name-hash.sh       |   8 +-
 t/t3030-merge-recursive.sh                    | 340 +++++++++---------
 t/t3050-subprojects-fetch.sh                  |   8 +-
 t/t3102-ls-tree-wildcards.sh                  |   2 +-
 t/t3301-notes.sh                              |   8 +-
 t/t3303-notes-subtrees.sh                     |  12 +-
 t/t3400-rebase.sh                             |   8 +-
 t/t3402-rebase-merge.sh                       |   4 +-
 t/t3404-rebase-interactive.sh                 |   6 +-
 t/t3418-rebase-continue.sh                    |   4 +-
 t/t3700-add.sh                                |   8 +-
 t/t3701-add-interactive.sh                    |  16 +-
 t/t3904-stash-patch.sh                        |   8 +-
 t/t4001-diff-rename.sh                        |   2 +-
 t/t4010-diff-pathspec.sh                      |   4 +-
 t/t4012-diff-binary.sh                        |   6 +-
 t/t4025-hunk-header.sh                        |   8 +-
 t/t4041-diff-submodule-option.sh              |   4 +-
 t/t4060-diff-submodule-option-diff-format.sh  |   2 +-
 t/t4121-apply-diffs.sh                        |   2 +-
 t/t5300-pack-object.sh                        |   2 +-
 t/t5302-pack-index.sh                         |   2 +-
 t/t5400-send-pack.sh                          |   4 +-
 t/t5401-update-hooks.sh                       |   4 +-
 t/t5405-send-pack-rewind.sh                   |   3 +-
 t/t5406-remote-rejects.sh                     |   2 +-
 t/t5500-fetch-pack.sh                         |   2 +-
 t/t5505-remote.sh                             |  10 +-
 t/t5512-ls-remote.sh                          |   4 +-
 t/t5516-fetch-push.sh                         |  10 +-
 t/t5517-push-mirror.sh                        |  10 +-
 t/t5526-fetch-submodules.sh                   |   2 +-
 t/t5531-deep-submodule-push.sh                |   2 +-
 t/t5543-atomic-push.sh                        |   2 +-
 t/t5601-clone.sh                              |   2 +-
 t/t5605-clone-local.sh                        |   2 +-
 t/t5801-remote-helpers.sh                     |   2 +-
 t/t6010-merge-base.sh                         |   2 +-
 t/t6029-merge-subtree.sh                      |  16 +-
 t/t6036-recursive-corner-cases.sh             |  14 +-
 t/t6042-merge-rename-corner-cases.sh          |   8 +-
 t/t6043-merge-rename-directories.sh           |   2 +-
 t/t7001-mv.sh                                 |   2 +-
 t/t7105-reset-patch.sh                        |  12 +-
 t/t7201-co.sh                                 |  41 ++-
 t/t7301-clean-interactive.sh                  |  41 ++-
 t/t7400-submodule-basic.sh                    |  12 +-
 t/t7406-submodule-update.sh                   |   4 +-
 t/t7408-submodule-reference.sh                |   2 +-
 t/t7501-commit.sh                             |  56 +--
 t/t7506-status-submodule.sh                   |  10 +-
 t/t7508-status.sh                             |  20 +-
 t/t7610-mergetool.sh                          |   8 +-
 t/t7810-grep.sh                               |   7 +-
 t/t9001-send-email.sh                         |  10 +-
 t/t9100-git-svn-basic.sh                      |   2 +-
 t/t9101-git-svn-props.sh                      |   2 +-
 t/t9104-git-svn-follow-parent.sh              |   4 +-
 t/t9119-git-svn-info.sh                       | 120 +++----
 t/t9122-git-svn-author.sh                     |   6 +-
 t/t9129-git-svn-i18n-commitencoding.sh        |   2 +-
 t/t9130-git-svn-authors-file.sh               |   4 +-
 t/t9134-git-svn-ignore-paths.sh               |   6 +-
 t/t9137-git-svn-dcommit-clobber-series.sh     |   2 +-
 t/t9138-git-svn-authors-prog.sh               |   6 +-
 t/t9146-git-svn-empty-dirs.sh                 |  12 +-
 t/t9147-git-svn-include-paths.sh              |   6 +-
 t/t9164-git-svn-dcommit-concurrent.sh         |   2 +-
 ...65-git-svn-fetch-merge-branch-of-branch.sh |   2 +-
 t/t9200-git-cvsexportcommit.sh                |   6 +-
 t/t9400-git-cvsserver-server.sh               |   6 +-
 t/t9401-git-cvsserver-crlf.sh                 |   4 +-
 t/t9600-cvsimport.sh                          |   2 +-
 t/t9806-git-p4-options.sh                     |   2 +-
 t/t9810-git-p4-rcs.sh                         |   2 +-
 t/t9811-git-p4-label-import.sh                |   2 +-
 t/t9814-git-p4-rename.sh                      |  16 +-
 t/t9815-git-p4-submit-fail.sh                 |   2 +-
 t/t9830-git-p4-symlink-dir.sh                 |   2 +-
 t/t9831-git-p4-triggers.sh                    |   2 +-
 t/t9902-completion.sh                         |   4 +-
 t/t9903-bash-prompt.sh                        |   2 +-
 t/test-lib.sh                                 | 245 ++++++++++++-
 104 files changed, 810 insertions(+), 593 deletions(-)
-- 
2.18.0.419.gfe4b301394
Next: Eric Sunshine
Message 1 of 123 in “t: detect and fix broken &&-chains in subshells”
  1. 00/29 t: detect and fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  2. 01/29 t7508: use test_when_finished() instead of managing exit code manuallyEric Sunshine, Jun 26, 2018
  3. 03/29 t1300: use sane_unset() to avoid breaking &&-chainEric Sunshine, Jun 26, 2018
  4. 02/29 t0001: use "{...}" block around "||" expression rather than subshellEric Sunshine, Jun 26, 2018
  5. 04/29 t3303: use standard here-doc tag "EOF" to avoid fooling --chain-lintEric Sunshine, Jun 26, 2018
  6. 09/29 t7810: use test_expect_code() instead of hand-rolled comparisonEric Sunshine, Jun 26, 2018
  7. 12/29 t9401: drop unnecessary nested subshellEric Sunshine, Jun 26, 2018
  8. 15/29 t: drop unnecessary terminating semicolons in subshellEric Sunshine, Jun 26, 2018
  9. 14/29 t: drop subshell with missing &&-chain in favor of simpler constructEric Sunshine, Jun 26, 2018
  10. Junio C HamanoJun 26, 2018
  11. Eric SunshineJun 26, 2018
  12. 20/29 t2000-t2999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  13. 18/29 t0000-t0999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  14. 24/29 t5000-t5999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  15. 28/29 t9119: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  16. 29/29 t/test-lib: teach --chain-lint to detect broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  17. Junio C HamanoJun 26, 2018
  18. Eric SunshineJun 26, 2018
  19. Jeff KingJun 26, 2018
  20. Jeff KingJun 26, 2018
  21. Eric SunshineJun 26, 2018
  22. Elijah NewrenJun 26, 2018
  23. Eric SunshineJun 26, 2018
  24. Eric SunshineJun 26, 2018
  25. Jeff KingJun 26, 2018
  26. Eric SunshineJun 26, 2018
  27. Jeff KingJun 28, 2018
  28. Elijah NewrenJun 27, 2018
  29. Johannes SixtJun 27, 2018
  30. Eric SunshineJun 27, 2018
  31. Jeff KingJun 28, 2018
  32. Junio C HamanoJun 26, 2018
  33. 27/29 t9000-t9999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  34. 26/29 t7000-t7999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  35. 25/29 t6000-t6999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  36. 19/29 t1000-t1999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  37. 22/29 t3030: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  38. 23/29 t4000-t4999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  39. 21/29 t3000-t3999: fix broken &&-chains in subshellsEric Sunshine, Jun 26, 2018
  40. 13/29 t/lib-submodule-update: fix broken "replace submodule must-fail" testEric Sunshine, Jun 26, 2018
  41. t/lib-submodule-update: fix absorbing testStefan Beller, Jun 27, 2018
  42. Eric SunshineJun 27, 2018
  43. 16/29 t: use test_might_fail() instead of manipulating exit code manuallyEric Sunshine, Jun 26, 2018
  44. 17/29 t: use test_must_fail() instead of checking exit code manuallyEric Sunshine, Jun 26, 2018
  45. Luke DiamandJun 26, 2018
  46. Elijah NewrenJun 26, 2018
  47. Eric SunshineJun 26, 2018
  48. Johannes SixtJun 26, 2018
  49. Eric SunshineJun 26, 2018
  50. Johannes SixtJun 26, 2018
  51. 07/29 t7201: drop pointless "exit 0" at end of subshellEric Sunshine, Jun 26, 2018
  52. 08/29 t7400: fix broken "submodule add/reconfigure --force" testEric Sunshine, Jun 26, 2018
  53. Stefan BellerJun 27, 2018
  54. 10/29 t9001: fix broken "invoke hook" testEric Sunshine, Jun 26, 2018
  55. Jonathan TanJun 26, 2018
  56. 11/29 t9104: use "{...}" block around "||" expression rather than subshellEric Sunshine, Jun 26, 2018
  57. 06/29 t6036: fix broken "merge fails but has appropriate contents" testsEric Sunshine, Jun 26, 2018
  58. Elijah NewrenJun 26, 2018
  59. 05/29 t5505: modernize and simplify hard-to-digest testEric Sunshine, Jun 26, 2018
  60. Elijah NewrenJun 26, 2018
  61. Eric SunshineJun 26, 2018
  62. Elijah NewrenJun 26, 2018
  63. Junio C HamanoJun 26, 2018
  64. Eric SunshineJun 26, 2018
  65. Junio C HamanoJun 26, 2018
  66. Jonathan NiederJun 27, 2018
  67. 00/10 detect broken &&-chains in subshellsEric Sunshine, Jul 11, 2018
  68. 03/10 t/chainlint: add chainlint "basic" test casesEric Sunshine, Jul 11, 2018
  69. 04/10 t/chainlint: add chainlint "whitespace" test casesEric Sunshine, Jul 11, 2018
  70. 05/10 t/chainlint: add chainlint "one-liner" test casesEric Sunshine, Jul 11, 2018
  71. 06/10 t/chainlint: add chainlint "nested subshell" test casesEric Sunshine, Jul 11, 2018
  72. 01/10 t/test-lib: teach --chain-lint to detect broken &&-chains in subshellsEric Sunshine, Jul 11, 2018
  73. Junio C HamanoJul 11, 2018
  74. Eric SunshineJul 12, 2018
  75. Jeff KingJul 12, 2018
  76. Eric SunshineJul 12, 2018
  77. Junio C HamanoJul 12, 2018
  78. Jonathan NiederJul 30, 2018
  79. 0/2 subtree: fix &&-chain and simplify tests (Re: [PATCH v2 01/10] t/test-lib: teach --chain-lint to detect broken &&-chains in subshells)Jonathan Nieder, Jul 30, 2018
  80. 1/2 subtree test: add missing && to &&-chainJonathan Nieder, Jul 30, 2018
  81. 2/2 subtree test: simplify preparation of expected resultsJonathan Nieder, Jul 30, 2018
  82. Eric SunshineJul 30, 2018
  83. Jonathan NiederJul 30, 2018
  84. Eric SunshineJul 30, 2018
  85. Jeff KingJul 31, 2018
  86. Eric SunshineJul 31, 2018
  87. Jeff KingJul 31, 2018
  88. Ævar Arnfjörð BjarmasonAug 23, 2018
  89. Eric SunshineAug 23, 2018
  90. 09/10 t/chainlint: add chainlint "complex" test casesEric Sunshine, Jul 11, 2018
  91. 07/10 t/chainlint: add chainlint "loop" and "conditional" test casesEric Sunshine, Jul 11, 2018
  92. 08/10 t/chainlint: add chainlint "cuddled" test casesEric Sunshine, Jul 11, 2018
  93. 10/10 t/chainlint: add chainlint "specialized" test casesEric Sunshine, Jul 11, 2018
  94. 02/10 t/Makefile: add machinery to check correctness of chainlint.sedEric Sunshine, Jul 11, 2018
  95. 0/5 chainlint: improve robustness against "unusual" shell codingEric Sunshine, Aug 7, 2018
  96. 1/5 chainlint: match arbitrary here-docs tags rather than hard-coded namesEric Sunshine, Aug 7, 2018
  97. Jeff KingAug 8, 2018
  98. Eric SunshineAug 9, 2018
  99. Jeff KingAug 9, 2018
  100. 2/5 chainlint: recognize multi-line $(...) when command cuddled with "$("Eric Sunshine, Aug 7, 2018
  101. 3/5 chainlint: let here-doc and multi-line string commence on same lineEric Sunshine, Aug 7, 2018
  102. 4/5 chainlint: recognize multi-line quoted strings more robustlyEric Sunshine, Aug 7, 2018
  103. 5/5 chainlint: add test of pathological case which triggered false positiveEric Sunshine, Aug 7, 2018
  104. Jeff KingAug 8, 2018
  105. Junio C HamanoAug 9, 2018
  106. 0/6 chainlint: improve robustness against "unusual" shell codingEric Sunshine, Aug 13, 2018
  107. 1/6 chainlint: match arbitrary here-docs tags rather than hard-coded namesEric Sunshine, Aug 13, 2018
  108. 2/6 chainlint: match 'quoted' here-doc tagsEric Sunshine, Aug 13, 2018
  109. Junio C HamanoAug 13, 2018
  110. Eric SunshineAug 13, 2018
  111. 3/6 chainlint: recognize multi-line $(...) when command cuddled with "$("Eric Sunshine, Aug 13, 2018
  112. 4/6 chainlint: let here-doc and multi-line string commence on same lineEric Sunshine, Aug 13, 2018
  113. 5/6 chainlint: recognize multi-line quoted strings more robustlyEric Sunshine, Aug 13, 2018
  114. 6/6 chainlint: add test of pathological case which triggered false positiveEric Sunshine, Aug 13, 2018
  115. 0/6 chainlint: improve robustness against "unusual" shell codingEric Sunshine, Aug 15, 2018
  116. 1/6 chainlint: match arbitrary here-docs tags rather than hard-coded namesEric Sunshine, Aug 15, 2018
  117. 3/6 chainlint: recognize multi-line $(...) when command cuddled with "$("Eric Sunshine, Aug 15, 2018
  118. 4/6 chainlint: let here-doc and multi-line string commence on same lineEric Sunshine, Aug 15, 2018
  119. 5/6 chainlint: recognize multi-line quoted strings more robustlyEric Sunshine, Aug 15, 2018
  120. 6/6 chainlint: add test of pathological case which triggered false positiveEric Sunshine, Aug 15, 2018
  121. 2/6 chainlint: match quoted here-doc tagsEric Sunshine, Aug 15, 2018
  122. chainlint: match "quoted" here-doc tagsEric Sunshine, Aug 29, 2018
  123. Junio C HamanoAug 29, 2018

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.