git/list[1] front-page[2] threads[3] people[4] search[5] about
wed 2026-10-07 17:29 UTC

Re: [PATCH 11/17] odb/source: make `for_each_object()` function pluggable

From
Karthik Nayak <karthik.188@gmail.com>
Date
Mar 5, 2026, 13:07 UTC
Message-ID
<CAOLa=ZS9ODS1EdZMDW7aRjp+9yk1E0mW15wabPNzTmBxOtwOgQ@mail.gmail.com>
In-Reply-To
<20260223-b4-pks-odb-source-pluggable-v1-11-253bac1db598@pks.im>
[snip]
Show 30 quoted lines
> diff --git a/odb/source.h b/odb/source.h
> index edb425fdef..35aa78e140 100644
> --- a/odb/source.h
> +++ b/odb/source.h
> @@ -53,6 +53,18 @@ struct object_id;
>  struct object_info;
>  struct odb_read_stream;
>
> +/*
> + * A callback function that can be used to iterate through objects. If given,
> + * the optional `oi` parameter will be populated the same as if you would call
> + * `odb_read_object_info()`.
> + *
> + * Returning a non-zero error code will cause iteration to abort. The error
> + * code will be propagated.
> + */
> +typedef int (*odb_for_each_object_cb)(const struct object_id *oid,
> +				      struct object_info *oi,
> +				      void *cb_data);
> +
>  /*
>   * The source is the part of the object database that stores the actual
>   * objects. It thus encapsulates the logic to read and write the specific
> @@ -151,6 +163,27 @@ struct odb_source {
>  	int (*read_object_stream)(struct odb_read_stream **out,
>  				  struct odb_source *source,
>  				  const struct object_id *oid);
> +
> +	/*
> +	 * This callback is expected to iterate over all objects stored in this

This isn't a callback though, this is a function which calls the callback, right?

Show 8 quoted lines
> +	 * source and invoke the callback function for each of them. It is
> +	 * valid to yield the same object multiple time. A non-zero exit code
> +	 * from the object callback shall abort iteration.
> +	 *
> +	 * The optional `oi` structure shall be populated similar to how an individual
> +	 * call to `odb_source_read_object_info()` would have behaved. If the caller
> +	 * passes a `NULL` pointer then the object itself shall not be read.
> +	 *
Nit: here and below, we talk about the `oi` structure, but that's in the
callback function, maybe we should clarify that.
Show 47 quoted lines
> +	 * The callback is expected to return a negative error code in case the
> +	 * iteration has failed to read all objects, 0 otherwise. When the
> +	 * callback function returns a non-zero error code then that error code
> +	 * should be returned.
> +	 */
> +	int (*for_each_object)(struct odb_source *source,
> +			       const struct object_info *request,
> +			       odb_for_each_object_cb cb,
> +			       void *cb_data,
> +			       unsigned flags);
>  };
>
>  /*
> @@ -233,4 +266,30 @@ static inline int odb_source_read_object_stream(struct odb_read_stream **out,
>  	return source->read_object_stream(out, source, oid);
>  }
>
> +/*
> + * Iterate through all objects contained in the given source and invoke the
> + * callback function for each of them. Returning a non-zero code from the
> + * callback function aborts iteration. There is no guarantee that objects
> + * are only iterated over once.
> + *
> + * The optional `oi` structure shall be populated similar to how an individual
> + * call to `odb_source_read_object_info()` would have behaved. If the caller
> + * passes a `NULL` pointer then the object itself shall not be read.
> + *
> + * The flags is a bitfield of `ODB_FOR_EACH_OBJECT_*` flags. Not all flags may
> + * apply to a specific backend, so whether or not they are honored is defined
> + * by the implementation.
> + *
> + * Returns 0 when all objects have been iterated over, a negative error code in
> + * case iteration has failed, or a non-zero value returned from the callback.
> + */
> +static inline int odb_source_for_each_object(struct odb_source *source,
> +					     const struct object_info *request,
> +					     odb_for_each_object_cb cb,
> +					     void *cb_data,
> +					     unsigned flags)
> +{
> +	return source->for_each_object(source, request, cb, cb_data, flags);
> +}
> +
>  #endif
>
> --
> 2.53.0.536.g309c995771.dirty
Previous: Karthik NayakNext: Patrick Steinhardt
Message 39 of 77 in “odb: make object database sources pluggable”
  1. 00/17 odb: make object database sources pluggablePatrick Steinhardt, Feb 23, 2026
  2. 01/17 odb: split `struct odb_source` into separate headerPatrick Steinhardt, Feb 23, 2026
  3. 02/17 odb: introduce "files" sourcePatrick Steinhardt, Feb 23, 2026
  4. 03/17 odb: embed base source in the "files" backendPatrick Steinhardt, Feb 23, 2026
  5. 04/17 odb: move reparenting logic into respective subsystemsPatrick Steinhardt, Feb 23, 2026
  6. 05/17 odb/source: introduce source type for robustnessPatrick Steinhardt, Feb 23, 2026
  7. 06/17 odb/source: make `free()` function pluggablePatrick Steinhardt, Feb 23, 2026
  8. 07/17 odb/source: make `reprepare()` function pluggablePatrick Steinhardt, Feb 23, 2026
  9. 08/17 odb/source: make `close()` function pluggablePatrick Steinhardt, Feb 23, 2026
  10. 09/17 odb/source: make `read_object_info()` function pluggablePatrick Steinhardt, Feb 23, 2026
  11. 10/17 odb/source: make `read_object_stream()` function pluggablePatrick Steinhardt, Feb 23, 2026
  12. 11/17 odb/source: make `for_each_object()` function pluggablePatrick Steinhardt, Feb 23, 2026
  13. 12/17 odb/source: make `freshen_object()` function pluggablePatrick Steinhardt, Feb 23, 2026
  14. 13/17 odb/source: make `write_object()` function pluggablePatrick Steinhardt, Feb 23, 2026
  15. 14/17 odb/source: make `write_object_stream()` function pluggablePatrick Steinhardt, Feb 23, 2026
  16. 15/17 odb/source: make `read_alternates()` function pluggablePatrick Steinhardt, Feb 23, 2026
  17. 16/17 odb/source: make `write_alternate()` function pluggablePatrick Steinhardt, Feb 23, 2026
  18. 17/17 odb/source: make `begin_transaction()` function pluggablePatrick Steinhardt, Feb 23, 2026
  19. Patrick SteinhardtFeb 23, 2026
  20. Junio C HamanoFeb 23, 2026
  21. Patrick SteinhardtFeb 24, 2026
  22. Justin ToblerMar 4, 2026
  23. Justin ToblerMar 4, 2026
  24. Justin ToblerMar 4, 2026
  25. Justin ToblerMar 4, 2026
  26. Justin ToblerMar 4, 2026
  27. Justin ToblerMar 4, 2026
  28. Justin ToblerMar 4, 2026
  29. Justin ToblerMar 4, 2026
  30. Justin ToblerMar 4, 2026
  31. Justin ToblerMar 4, 2026
  32. Justin ToblerMar 4, 2026
  33. Karthik NayakMar 5, 2026
  34. Karthik NayakMar 5, 2026
  35. Karthik NayakMar 5, 2026
  36. Karthik NayakMar 5, 2026
  37. Karthik NayakMar 5, 2026
  38. Karthik NayakMar 5, 2026
  39. Karthik NayakMar 5, 2026
  40. Patrick SteinhardtMar 5, 2026
  41. Karthik NayakMar 5, 2026
  42. Patrick SteinhardtMar 5, 2026
  43. Patrick SteinhardtMar 5, 2026
  44. Patrick SteinhardtMar 5, 2026
  45. Patrick SteinhardtMar 5, 2026
  46. Patrick SteinhardtMar 5, 2026
  47. Patrick SteinhardtMar 5, 2026
  48. Patrick SteinhardtMar 5, 2026
  49. Patrick SteinhardtMar 5, 2026
  50. Patrick SteinhardtMar 5, 2026
  51. Patrick SteinhardtMar 5, 2026
  52. Patrick SteinhardtMar 5, 2026
  53. Patrick SteinhardtMar 5, 2026
  54. 00/17 odb: make object database sources pluggablePatrick Steinhardt, Mar 5, 2026
  55. 01/17 odb: split `struct odb_source` into separate headerPatrick Steinhardt, Mar 5, 2026
  56. 02/17 odb: introduce "files" sourcePatrick Steinhardt, Mar 5, 2026
  57. 03/17 odb: embed base source in the "files" backendPatrick Steinhardt, Mar 5, 2026
  58. 04/17 odb: move reparenting logic into respective subsystemsPatrick Steinhardt, Mar 5, 2026
  59. 05/17 odb/source: introduce source type for robustnessPatrick Steinhardt, Mar 5, 2026
  60. 06/17 odb/source: make `free()` function pluggablePatrick Steinhardt, Mar 5, 2026
  61. 07/17 odb/source: make `reprepare()` function pluggablePatrick Steinhardt, Mar 5, 2026
  62. 08/17 odb/source: make `close()` function pluggablePatrick Steinhardt, Mar 5, 2026
  63. 09/17 odb/source: make `read_object_info()` function pluggablePatrick Steinhardt, Mar 5, 2026
  64. 10/17 odb/source: make `read_object_stream()` function pluggablePatrick Steinhardt, Mar 5, 2026
  65. 11/17 odb/source: make `for_each_object()` function pluggablePatrick Steinhardt, Mar 5, 2026
  66. 12/17 odb/source: make `freshen_object()` function pluggablePatrick Steinhardt, Mar 5, 2026
  67. 13/17 odb/source: make `write_object()` function pluggablePatrick Steinhardt, Mar 5, 2026
  68. 14/17 odb/source: make `write_object_stream()` function pluggablePatrick Steinhardt, Mar 5, 2026
  69. 15/17 odb/source: make `read_alternates()` function pluggablePatrick Steinhardt, Mar 5, 2026
  70. 16/17 odb/source: make `write_alternate()` function pluggablePatrick Steinhardt, Mar 5, 2026
  71. 17/17 odb/source: make `begin_transaction()` function pluggablePatrick Steinhardt, Mar 5, 2026
  72. Justin ToblerMar 5, 2026
  73. Justin ToblerMar 5, 2026
  74. Justin ToblerMar 5, 2026
  75. Justin ToblerMar 5, 2026
  76. Junio C HamanoMar 5, 2026
  77. Patrick SteinhardtMar 10, 2026

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.