git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH v2 00/17] odb: make object database sources pluggable

From
Junio C Hamano <gitster@pobox.com>
Date
Mar 5, 2026, 20:42 UTC
Message-ID
<xmqq4imu2el0.fsf@gitster.g>
In-Reply-To
<20260305-b4-pks-odb-source-pluggable-v2-0-3290bfd1f444@pks.im>
Patrick Steinhardt <ps@pks.im> writes:
Show 19 quoted lines
> To set expectations: this is only a start, there is still functionality
> missing that needs to be made pluggable. Most importantly:
>
>   - Counting of objects.
>
>   - Abbreviating object IDs and finding ambiguous objects.
>
>   - Consistency checks.
>
>   - Optimizing the object database.
>
>   - Generating packfiles.
>
> These will all happen in later patch series. That being said, with this
> patch series one already gets a lot of the basic functionality, and it's
> almost possible to do local workflows. Only "almost" though because we
> rely on abbreviating object IDs in a lot of places, but once that part
> is implemented in a subsequent patch series you can indeed work locally
> with an alternate backend.

I've been looking over this series, and the transition to a pluggable interface for ODB sources is very clean and follows the patterns we've established for refs and streams quite well.

One thing I am puzzled on the design, specifically starting with patch 09 and onward, is the lack of documentation regarding which of the new callbacks in `struct odb_source` are mandatory and which are optional.

In `odb/source.h`, the static inline wrapper functions dereference the backend's function pointers directly. For example:

+static inline int odb_source_read_object_info(struct odb_source *source, + const struct object_id *oid, + struct object_info *oi, + enum object_info_flags flags) +{ + return source->read_object_info(source, oid, oi, flags); +}

If a future backend (say, a read-only network proxy) doesn't implement some of the write-related functions or the iteration functions, the current wrappers will cause a segmentation fault.

Do we want to
  - Document in `struct odb_source` which callbacks must be implemented
    by every backend.
  - Have the wrapper functions check for NULL. If a mandatory function
    is missing, a `BUG()` would be appropriate. If it's truly optional,
    the wrapper could return a suitable error code (like -1 or
    `GIT_ENOTSUP`).

Given that the "files" backend implements the full set, it's easy to miss, but as we add more specialized backends, a clearly defined interface contract may become important.

What are your thoughts on which of these should be considered the "minimal viable" set for an ODB source?

Previous: Justin ToblerNext: Patrick Steinhardt
Message 76 of 77 in “odb: make object database sources pluggable”
  1. 00/17 odb: make object database sources pluggablePatrick Steinhardt, Feb 23, 2026
  2. 01/17 odb: split `struct odb_source` into separate headerPatrick Steinhardt, Feb 23, 2026
  3. Justin ToblerMar 4, 2026
  4. Patrick SteinhardtMar 5, 2026
  5. Justin ToblerMar 5, 2026
  6. 02/17 odb: introduce "files" sourcePatrick Steinhardt, Feb 23, 2026
  7. Justin ToblerMar 4, 2026
  8. Patrick SteinhardtMar 5, 2026
  9. Karthik NayakMar 5, 2026
  10. 03/17 odb: embed base source in the "files" backendPatrick Steinhardt, Feb 23, 2026
  11. Justin ToblerMar 4, 2026
  12. Patrick SteinhardtMar 5, 2026
  13. Justin ToblerMar 5, 2026
  14. Karthik NayakMar 5, 2026
  15. Patrick SteinhardtMar 5, 2026
  16. 04/17 odb: move reparenting logic into respective subsystemsPatrick Steinhardt, Feb 23, 2026
  17. Justin ToblerMar 4, 2026
  18. Patrick SteinhardtMar 5, 2026
  19. 05/17 odb/source: introduce source type for robustnessPatrick Steinhardt, Feb 23, 2026
  20. Justin ToblerMar 4, 2026
  21. Patrick SteinhardtMar 5, 2026
  22. Karthik NayakMar 5, 2026
  23. 06/17 odb/source: make `free()` function pluggablePatrick Steinhardt, Feb 23, 2026
  24. Justin ToblerMar 4, 2026
  25. 07/17 odb/source: make `reprepare()` function pluggablePatrick Steinhardt, Feb 23, 2026
  26. Justin ToblerMar 4, 2026
  27. Patrick SteinhardtMar 5, 2026
  28. 08/17 odb/source: make `close()` function pluggablePatrick Steinhardt, Feb 23, 2026
  29. Justin ToblerMar 4, 2026
  30. Patrick SteinhardtMar 5, 2026
  31. Justin ToblerMar 5, 2026
  32. Karthik NayakMar 5, 2026
  33. Patrick SteinhardtMar 5, 2026
  34. 09/17 odb/source: make `read_object_info()` function pluggablePatrick Steinhardt, Feb 23, 2026
  35. Justin ToblerMar 4, 2026
  36. 10/17 odb/source: make `read_object_stream()` function pluggablePatrick Steinhardt, Feb 23, 2026
  37. Karthik NayakMar 5, 2026
  38. Patrick SteinhardtMar 5, 2026
  39. 11/17 odb/source: make `for_each_object()` function pluggablePatrick Steinhardt, Feb 23, 2026
  40. Karthik NayakMar 5, 2026
  41. Karthik NayakMar 5, 2026
  42. Patrick SteinhardtMar 5, 2026
  43. 12/17 odb/source: make `freshen_object()` function pluggablePatrick Steinhardt, Feb 23, 2026
  44. 13/17 odb/source: make `write_object()` function pluggablePatrick Steinhardt, Feb 23, 2026
  45. 14/17 odb/source: make `write_object_stream()` function pluggablePatrick Steinhardt, Feb 23, 2026
  46. 15/17 odb/source: make `read_alternates()` function pluggablePatrick Steinhardt, Feb 23, 2026
  47. Justin ToblerMar 4, 2026
  48. Patrick SteinhardtMar 5, 2026
  49. 16/17 odb/source: make `write_alternate()` function pluggablePatrick Steinhardt, Feb 23, 2026
  50. 17/17 odb/source: make `begin_transaction()` function pluggablePatrick Steinhardt, Feb 23, 2026
  51. Justin ToblerMar 4, 2026
  52. Patrick SteinhardtMar 5, 2026
  53. Patrick SteinhardtFeb 23, 2026
  54. Junio C HamanoFeb 23, 2026
  55. Patrick SteinhardtFeb 24, 2026
  56. Karthik NayakMar 5, 2026
  57. 00/17 odb: make object database sources pluggablePatrick Steinhardt, Mar 5, 2026
  58. 01/17 odb: split `struct odb_source` into separate headerPatrick Steinhardt, Mar 5, 2026
  59. 02/17 odb: introduce "files" sourcePatrick Steinhardt, Mar 5, 2026
  60. 03/17 odb: embed base source in the "files" backendPatrick Steinhardt, Mar 5, 2026
  61. 04/17 odb: move reparenting logic into respective subsystemsPatrick Steinhardt, Mar 5, 2026
  62. 05/17 odb/source: introduce source type for robustnessPatrick Steinhardt, Mar 5, 2026
  63. 06/17 odb/source: make `free()` function pluggablePatrick Steinhardt, Mar 5, 2026
  64. 07/17 odb/source: make `reprepare()` function pluggablePatrick Steinhardt, Mar 5, 2026
  65. 08/17 odb/source: make `close()` function pluggablePatrick Steinhardt, Mar 5, 2026
  66. 09/17 odb/source: make `read_object_info()` function pluggablePatrick Steinhardt, Mar 5, 2026
  67. 10/17 odb/source: make `read_object_stream()` function pluggablePatrick Steinhardt, Mar 5, 2026
  68. 11/17 odb/source: make `for_each_object()` function pluggablePatrick Steinhardt, Mar 5, 2026
  69. 12/17 odb/source: make `freshen_object()` function pluggablePatrick Steinhardt, Mar 5, 2026
  70. 13/17 odb/source: make `write_object()` function pluggablePatrick Steinhardt, Mar 5, 2026
  71. 14/17 odb/source: make `write_object_stream()` function pluggablePatrick Steinhardt, Mar 5, 2026
  72. 15/17 odb/source: make `read_alternates()` function pluggablePatrick Steinhardt, Mar 5, 2026
  73. 16/17 odb/source: make `write_alternate()` function pluggablePatrick Steinhardt, Mar 5, 2026
  74. 17/17 odb/source: make `begin_transaction()` function pluggablePatrick Steinhardt, Mar 5, 2026
  75. Justin ToblerMar 5, 2026
  76. Junio C HamanoMar 5, 2026
  77. Patrick SteinhardtMar 10, 2026

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.