Bill Allombert on Wed, 11 Jul 2018 17:25:51 +0200

[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: SIGSEGV on isprime

On Wed, Jul 11, 2018 at 04:48:24PM +0200, Ján Jančár wrote:
> >> I have now tested:
> >>
> >> --enable-tls --kernel=none      --> works
> >> --enable-tls --kernel=none-gmp  --> SEGVs!
> >> --enalbe-tls --kernel=auto-none --> works

My guess is that there is a buffer overflow in the function
red_montgomery in the file src/kernel/gmp/mp.c which only
cause a SEGV when the stack ends on a page boundary.

At least I can reproduce this bug with valgrind now!