git/list[1] front-page[2] threads[3] people[4] search[5] about
 

[PATCH v2 0/6] bswap.h: Rework ntohl handling

From
Sebastian Andrzej Siewior <sebastian@breakpoint.cc>
Date
Jun 11, 2025, 22:14 UTC
Message-ID
<20250611221444.1567638-1-sebastian@breakpoint.cc>
Hi,

since the add of bswap32/64() support based on __builtin support, the usage of ntohl() macros is broken on big endian machines because the macros are always overwritten providing a swap.

The first patch in the series reverts the change and the following patches try to improve the situation by allowing to always provide an optimized version.

I've been looking at recent compiler and they manage to recognize the manual shifting and use an optimize opcode if available. The ntohl version provided by glibc already provides an "optimized" version which makes an optimisation in git almost not needed. One of the motivation behind overwriting/ providing an optimized version was to provide a macro instead of using a function call. One libc that is still providing ntohl as a function call is musl. So it might makes sense to keep it. While ntohl() is provided by the libc, the ntohll() is not. I found it only on Windows provided by winsock.h.

I haven't touched the put/get_be*() macros. gcc & clang are both smart enough to swap the content accordingly and perform a single store/ load. Only the msvc seems to strugle here and performs multiple bytes stores/ loads and shifts.

Sebastian Andrzej Siewior (6):
  Revert "bswap.h: add support for built-in bswap functions"
  bswap.h: Add support for __BYTE_ORDER__
  bswap.h: Define GIT_LITTLE_ENDIAN on msvc as little endian
  bswap.h: Always overwrite ntohl/ ntohll macros
  bswap.h: Remove optimized x86 version of bswap32/64
  bswap.h: Provide a built-in based version of bswap32/64 if possible
 compat/bswap.h | 118 ++++++++++++++++++-------------------------------
 1 file changed, 44 insertions(+), 74 deletions(-)
-- 
2.49.0
Next: Sebastian Andrzej Siewior
Message 1 of 20 in “bswap.h: Rework ntohl handling”
  1. 0/6 bswap.h: Rework ntohl handlingSebastian Andrzej Siewior, Jun 11, 2025
  2. 2/6 bswap.h: Add support for __BYTE_ORDER__Sebastian Andrzej Siewior, Jun 11, 2025
  3. brian m. carlsonJun 12, 2025
  4. Collin FunkJun 12, 2025
  5. Junio C HamanoJun 12, 2025
  6. 1/6 Revert "bswap.h: add support for built-in bswap functions"Sebastian Andrzej Siewior, Jun 11, 2025
  7. Junio C HamanoJun 12, 2025
  8. 3/6 bswap.h: Define GIT_LITTLE_ENDIAN on msvc as little endianSebastian Andrzej Siewior, Jun 11, 2025
  9. Junio C HamanoJun 12, 2025
  10. 5/6 bswap.h: Remove optimized x86 version of bswap32/64Sebastian Andrzej Siewior, Jun 11, 2025
  11. Kristoffer HaugsbakkJun 26, 2025
  12. Sebastian Andrzej SiewiorJul 15, 2025
  13. 6/6 bswap.h: Provide a built-in based version of bswap32/64 if possibleSebastian Andrzej Siewior, Jun 11, 2025
  14. 5/6 bswap: Remove optimized x86 version of bswap32/64Sebastian Andrzej Siewior, Jun 11, 2025
  15. 4/6 bswap.h: Always overwrite ntohl/ ntohll macrosSebastian Andrzej Siewior, Jun 11, 2025
  16. brian m. carlsonJun 12, 2025
  17. Junio C HamanoJun 12, 2025
  18. Junio C HamanoJun 12, 2025
  19. Junio C HamanoJul 7, 2025
  20. Sebastian Andrzej SiewiorJul 9, 2025

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.