git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH v1 2/5] Teach git to optionally utilize a file system monitor to speed up detecting new or changed files.

From
Ben Peart <peartben@gmail.com>
Date
May 16, 2017, 01:55 UTC
Message-ID
<2d965a87-36da-23b4-4bc5-97de47f3d7f7@gmail.com>
In-Reply-To
<20170516003414.yliltu5fsaudfhyu@sigill.intra.peff.net>
On 5/15/2017 8:34 PM, Jeff King wrote:
Show 23 quoted lines
> On Tue, May 16, 2017 at 12:22:14AM +0000, brian m. carlson wrote:
>
>> On Mon, May 15, 2017 at 03:13:44PM -0400, Ben Peart wrote:
>>> +	istate->last_update = (time_t)ntohll(*(uint64_t *)index);
>>> +	index += sizeof(uint64_t);
>>> +
>>> +	ewah_size = ntohl(*(uint32_t *)index);
>>> +	index += sizeof(uint32_t);
>>
>> To answer the question you asked in your cover letter, you cannot write
>> this unless you can guarantee (((uintptr_t)index & 7) == 0) is true.
>> Otherwise, this will produce a SIGBUS on SPARC, Alpha, MIPS, and some
>> ARM systems, and it will perform poorly on PowerPC and other ARM
>> systems[0].
>>
>> If you got that pointer from malloc and have only indexed multiples of 8
>> on it, you're good.  But if you're not sure, you probably want to use
>> memcpy.  If the compiler can determine that it's not necessary, it will
>> omit the copy and perform a direct load.
>
> I think get_be32() does exactly what we want for the ewah_size read. For
> the last_update one, we don't have a get_be64() yet, but it should be
> easy to make based on the 16/32 versions.

Thanks for the pointers. I'll update this to use the existing get_be32 and have created a get_be64 and will use that for the last_update.

>
> (I note also that time_t is not necessarily 64-bits in the first place,
> but David said something about this not really being a time_t).
>

The in memory representation is a time_t as that is the return value of time(NULL) but it is converted to/from a 64 bit value when written/read to the index extension so that the index format is the same no matter the native size of time_t.

> -Peff
>
Previous: Jeff KingNext: Jeff King
Message 15 of 26 in “Fast git status via a file system watcher”
  1. 0/5 Fast git status via a file system watcherBen Peart, May 15, 2017
  2. 1/5 dir: make lookup_untracked() available outside of dir.cBen Peart, May 15, 2017
  3. Junio C HamanoMay 16, 2017
  4. 3/5 fsmonitor: add test cases for fsmonitor extensionBen Peart, May 15, 2017
  5. Junio C HamanoMay 16, 2017
  6. Ben PeartMay 16, 2017
  7. 5/5 Add a sample query-fsmonitor hook script that integrates with the cross platform Watchman file watching service.Ben Peart, May 15, 2017
  8. David TurnerMay 15, 2017
  9. Ben PeartMay 15, 2017
  10. 2/5 Teach git to optionally utilize a file system monitor to speed up detecting new or changed files.Ben Peart, May 15, 2017
  11. David TurnerMay 15, 2017
  12. Ben PeartMay 16, 2017
  13. brian m. carlsonMay 16, 2017
  14. Jeff KingMay 16, 2017
  15. Ben PeartMay 16, 2017
  16. Jeff KingMay 16, 2017
  17. Ben PeartMay 16, 2017
  18. Jeff KingMay 16, 2017
  19. Johannes SixtMay 16, 2017
  20. Ben PeartMay 17, 2017
  21. Johannes SixtMay 17, 2017
  22. Jeff KingMay 18, 2017
  23. Jonathan TanMay 16, 2017
  24. Ben PeartMay 17, 2017
  25. 4/5 Add documentation for the fsmonitor extension. This includes the core.fsmonitor setting, the query-fsmonitor hook, and the fsmonitor index extension.Ben Peart, May 15, 2017
  26. Junio C HamanoMay 16, 2017

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.