git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Re: [PATCH] Fix NO_LIBPCRE1_JIT to fully disable JIT

From
Ævar Arnfjörð Bjarmason <avarab@gmail.com>
Date
Nov 12, 2017, 20:47 UTC
Message-ID
<87tvxzxm0j.fsf@evledraar.booking.com>
In-Reply-To
<20171112165938.8787-1-charles@hashpling.org>
On Sun, Nov 12 2017, Charles Bailey jotted:
Show 62 quoted lines
> From: Charles Bailey <cbailey32@bloomberg.net>
>
> If you have a pcre1 library which is compiled with JIT enabled then
> PCRE_STUDY_JIT_COMPILE will be defined whether or not the
> NO_LIBPCRE1_JIT configuration is set.
>
> This means that we enable JIT functionality when calling pcre_study
> even if NO_LIBPCRE1_JIT has been explicitly set and we just use plain
> pcre_exec later.
>
> Fix this by using own macro (GIT_PCRE_STUDY_JIT_COMPILE) which we set to
> PCRE_STUDY_JIT_COMPILE only if NO_LIBPCRE1_JIT is not set and define to
> 0 otherwise, as before.
> ---
>
> I was bisecting an issue with the PCRE support that was causing a test
> suite failure on our Solaris builds and reached fbaceaac47 ("grep: add
> support for the PCRE v1 JIT API"). It appeared to be a misaligned memory
> access somewhere inside the libpcre code. I tried disabling the use of
> JIT with NO_LIBPCRE1_JIT but it turned out that even with this set we
> were still triggering the JIT code path in the call to pcre_study.
>
> Yes, we probably should fix our PCRE1 library build on Solaris or move
> to PCRE2, but really NO_LIBPCRE1_JIT should have prevented us from
> triggering this crash.
>
>  grep.c | 2 +-
>  grep.h | 5 +++--
>  2 files changed, 4 insertions(+), 3 deletions(-)
>
> diff --git a/grep.c b/grep.c
> index ce6a48e..d0b9b6c 100644
> --- a/grep.c
> +++ b/grep.c
> @@ -387,7 +387,7 @@ static void compile_pcre1_regexp(struct grep_pat *p, const struct grep_opt *opt)
>  	if (!p->pcre1_regexp)
>  		compile_regexp_failed(p, error);
>
> -	p->pcre1_extra_info = pcre_study(p->pcre1_regexp, PCRE_STUDY_JIT_COMPILE, &error);
> +	p->pcre1_extra_info = pcre_study(p->pcre1_regexp, GIT_PCRE_STUDY_JIT_COMPILE, &error);
>  	if (!p->pcre1_extra_info && error)
>  		die("%s", error);
>
> diff --git a/grep.h b/grep.h
> index 52aecfa..399381c 100644
> --- a/grep.h
> +++ b/grep.h
> @@ -7,11 +7,12 @@
>  #if PCRE_MAJOR >= 8 && PCRE_MINOR >= 32
>  #ifndef NO_LIBPCRE1_JIT
>  #define GIT_PCRE1_USE_JIT
> +#define GIT_PCRE_STUDY_JIT_COMPILE PCRE_STUDY_JIT_COMPILE
>  #endif
>  #endif
>  #endif
> -#ifndef PCRE_STUDY_JIT_COMPILE
> -#define PCRE_STUDY_JIT_COMPILE 0
> +#ifndef GIT_PCRE_STUDY_JIT_COMPILE
> +#define GIT_PCRE_STUDY_JIT_COMPILE 0
>  #endif
>  #if PCRE_MAJOR <= 8 && PCRE_MINOR < 20
>  typedef int pcre_jit_stack;
[CC-ing Junio]
Thanks a lot. This patch looks good to me.

I could have sworn I was handling this already, but looking at this now I wasn't really.

However, as a bit of extra info I *did* test this, and it works just fine for me, i.e. if I compile PCRE 8.32 now (as I did at the time) --without-jit it'll error with just USE_LIBPCRE=YesPlease as expected, but add NO_LIBPCRE1_JIT=UnfortunatelyYes and it works just fine without your patch.

However, as your patch shows (and as I've independently verified) PCRE_STUDY_JIT_COMPILE will still be defined in that case, since PCRE will be exposing the same headers. This is the logic error in my initial patch.

*But* for some reason you still get away with that on Linux. I don't know why, but I assume the compiler toolchain is more lax for some reason than on Solaris.

All of which is a roundabout way of saying that we should apply this patch, but that I still have no idea why this worked on Linux before , but it does.

But that we should take it anyway regardless of that since it'll *also* work on Linux with your patch, and this logic makes some sense whereas the other one clearly didn't and just worked by pure accident of some toolchain semantics that I haven't figured out yet.

Previous: Charles BaileyNext: Junio C Hamano
Message 2 of 5 in “Fix NO_LIBPCRE1_JIT to fully disable JIT”
  1. Fix NO_LIBPCRE1_JIT to fully disable JITCharles Bailey, Nov 12, 2017
  2. Ævar Arnfjörð BjarmasonNov 12, 2017
  3. Junio C HamanoNov 13, 2017
  4. Charles BaileyNov 13, 2017
  5. Junio C HamanoNov 14, 2017

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.