git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH v2 14/25] shallow.c: implement a generic shallow boundary finder based on rev-list

From
Duy Nguyen <pclouds@gmail.com>
Date
Feb 19, 2016, 09:30 UTC
Message-ID
<20160219093023.GA12470@lanh>
In-Reply-To
<xmqqvb5y7vuj.fsf@gitster.mtv.corp.google.com>
On Mon, Feb 08, 2016 at 01:09:24PM -0800, Junio C Hamano wrote:
Show 17 quoted lines
> Nguyễn Thái Ngọc Duy  <pclouds@gmail.com> writes:
> 
> > Instead of a custom commit walker like get_shallow_commits(), this new
> > function uses rev-list to mark NOT_SHALLOW to all reachable commits,
> > except borders. The definition of reachable is to be defined by the
> > protocol later. This makes it more flexible to define shallow boundary.
> >
> > Note: if a commit has one NOT_SHALLOW parent and one SHALLOW parent,
> > then it's considered the boundary. Which means in the client side, this
> > commit has _no_ parents. This could lead to surprising cuts if we're not
> > careful.
> >
> > Another option is to include more commits and only mark commits whose
> > all parents are SHALLOW as boundary.
> 
> The second and third are greek to me at this point ;-) but hopefully
> they will become clear as we read on.

Yeah. Everything looks clearer with illustration. This should be a better. The question is should we do something about it now, or leave it as is.

I'm tempted to go with "the first way" in future (so add some comments about this in is_repository_shallow, instead of leaving it as commit message in this patch).

-- 8< -- The way we find find border is paint all reachable commits NOT_SHALLOW. Any of them that "touches" commits without NOT_SHALLOW flag are considered shallow (e.g. zero parents via grafting mechanism). Shallow commits and their true parents are all marked SHALLOW. Then NOT_SHALLOW is removed from shallow commits at the end.

There is interesting observation, though somewhat off topic for this patch. In the following graph, "x" is unreachable commits. "b" is the parent of "a".

           x -- a -- o
	       /    /
         x -- b -- o

And as a result, "a" and "b" are both considered shallow commits. After grafting occurs at the client side, what we see is

                a -- o
	            /
              b -- o

Notice that because of grafting, "a" has zero parents, so "b" is no longer a parent of "a".

This is unfortunate and may be solved in two ways. The first is change the way shallow grafting works and keeps "b -- a" connection if "b" exists and is a shallow commit.

The second way is produce this graph (at client side) instead
           x -- a -- o
	       /    /
              b -- o

Which means we mark "x" as a shallow commit instead of "a". -- 8< -- -- Duy

Previous: Duy NguyenNext: Nguyễn Thái Ngọc Duy
Message 34 of 63 in “More flexibility in making shallow clones”
  1. 00/25 More flexibility in making shallow clonesNguyễn Thái Ngọc Duy, Feb 4, 2016
  2. 01/25 remote-curl.c: convert fetch_git() to use argv_arrayNguyễn Thái Ngọc Duy, Feb 4, 2016
  3. Junio C HamanoFeb 4, 2016
  4. 02/25 transport-helper.c: refactor set_helper_option()Nguyễn Thái Ngọc Duy, Feb 4, 2016
  5. Junio C HamanoFeb 4, 2016
  6. 03/25 transport-helper.c: do not send null option to remote helperNguyễn Thái Ngọc Duy, Feb 4, 2016
  7. Junio C HamanoFeb 4, 2016
  8. Duy NguyenFeb 6, 2016
  9. Junio C HamanoFeb 8, 2016
  10. 04/25 upload-pack: move shallow deepen code out of receive_needs()Nguyễn Thái Ngọc Duy, Feb 4, 2016
  11. Junio C HamanoFeb 4, 2016
  12. 05/25 upload-pack: move "shallow" sending code out of deepen()Nguyễn Thái Ngọc Duy, Feb 4, 2016
  13. 06/25 upload-pack: remove unused variable "backup"Nguyễn Thái Ngọc Duy, Feb 4, 2016
  14. Junio C HamanoFeb 4, 2016
  15. 07/25 upload-pack: move "unshallow" sending code out of deepen()Nguyễn Thái Ngọc Duy, Feb 4, 2016
  16. Junio C HamanoFeb 4, 2016
  17. 08/25 upload-pack: use skip_prefix() instead of starts_with() when possibleNguyễn Thái Ngọc Duy, Feb 4, 2016
  18. Junio C HamanoFeb 4, 2016
  19. 09/25 upload-pack: tighten number parsing at "deepen" linesNguyễn Thái Ngọc Duy, Feb 4, 2016
  20. Junio C HamanoFeb 4, 2016
  21. Duy NguyenFeb 15, 2016
  22. 10/25 upload-pack: move rev-list code out of check_non_tip()Nguyễn Thái Ngọc Duy, Feb 4, 2016
  23. 11/25 fetch-pack: use skip_prefix() instead of starts_with() when possibleNguyễn Thái Ngọc Duy, Feb 4, 2016
  24. Junio C HamanoFeb 4, 2016
  25. 12/25 fetch-pack: use a common function for verbose printingNguyễn Thái Ngọc Duy, Feb 4, 2016
  26. Junio C HamanoFeb 5, 2016
  27. Eric SunshineFeb 5, 2016
  28. 13/25 fetch-pack: use a separate flag for fetch in deepening modeNguyễn Thái Ngọc Duy, Feb 4, 2016
  29. Junio C HamanoFeb 5, 2016
  30. Eric SunshineFeb 5, 2016
  31. 14/25 shallow.c: implement a generic shallow boundary finder based on rev-listNguyễn Thái Ngọc Duy, Feb 4, 2016
  32. Junio C HamanoFeb 8, 2016
  33. Duy NguyenFeb 15, 2016
  34. Duy NguyenFeb 19, 2016
  35. 15/25 upload-pack: add deepen-since to cut shallow repos based on timeNguyễn Thái Ngọc Duy, Feb 4, 2016
  36. Junio C HamanoFeb 8, 2016
  37. 16/25 fetch: define shallow boundary with --shallow-sinceNguyễn Thái Ngọc Duy, Feb 4, 2016
  38. 17/25 clone: define shallow clone boundary based on time with --shallow-sinceNguyễn Thái Ngọc Duy, Feb 4, 2016
  39. Junio C HamanoFeb 8, 2016
  40. 18/25 t5500, t5539: tests for shallow depth since a specific dateNguyễn Thái Ngọc Duy, Feb 4, 2016
  41. Junio C HamanoFeb 8, 2016
  42. Duy NguyenFeb 15, 2016
  43. 19/25 refs: add expand_ref()Nguyễn Thái Ngọc Duy, Feb 4, 2016
  44. Junio C HamanoFeb 8, 2016
  45. 20/25 upload-pack: support define shallow boundary by excluding revisionsNguyễn Thái Ngọc Duy, Feb 4, 2016
  46. Eric SunshineFeb 5, 2016
  47. Junio C HamanoFeb 8, 2016
  48. Eric SunshineFeb 5, 2016
  49. Duy NguyenFeb 15, 2016
  50. 21/25 fetch: define shallow boundary with --shallow-excludeNguyễn Thái Ngọc Duy, Feb 4, 2016
  51. Eric SunshineFeb 5, 2016
  52. Duy NguyenFeb 15, 2016
  53. Eric SunshineFeb 15, 2016
  54. Eric SunshineFeb 15, 2016
  55. Duy NguyenFeb 15, 2016
  56. Eric SunshineFeb 19, 2016
  57. 22/25 clone: define shallow clone boundary with --shallow-excludeNguyễn Thái Ngọc Duy, Feb 4, 2016
  58. 23/25 t5500, t5539: tests for shallow depth excluding a refNguyễn Thái Ngọc Duy, Feb 4, 2016
  59. 24/25 upload-pack: make check_reachable_object() return unreachable list if askedNguyễn Thái Ngọc Duy, Feb 4, 2016
  60. Eric SunshineFeb 5, 2016
  61. 25/25 fetch, upload-pack: --deepen=N extends shallow boundary by N commitsNguyễn Thái Ngọc Duy, Feb 4, 2016
  62. Junio C HamanoFeb 8, 2016
  63. Duy NguyenFeb 12, 2016

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.