bind 9.16.6 on FreeBSD - Assert

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

bind 9.16.6 on FreeBSD - Assert

Borja Marcos
Hi,

I had a named process aborting with an assert.

<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - rbt.c:2355: REQUIRE(newbits <= rbt->maxhashbits) failed, back trace
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #0 0x43d260 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #1 0x62035a in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #2 0x514868 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #3 0x515616 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #4 0x529c7d in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #5 0x579df7 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #6 0x645e1c in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #7 0x80225e036 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - exiting (due to assertion failure)
<6>1 2020-08-27T15:52:04.091803+00:00 host kernel - - - pid 6520 (named), jid 0, uid 53: exited on signal 6

I have a full log of queries (it’s a recursive only server) and I haven’t seen anything unusual before the crash. Unfortunately the
program was stripped, I have recompiled it with debug symbols.

It is bind 9.16.6, built from ports on FreeBSD 11.3.

Any hint on what to look for? Fortunately I have another server running 9.11. It wasn’t affected.

Thanks!





Borja.


_______________________________________________
Please visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.


bind-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/bind-users
Reply | Threaded
Open this post in threaded view
|

Re: bind 9.16.6 on FreeBSD - Assert

Søren Andersen
hmm.. I think you hit this bug right here: https://gitlab.isc.org/isc-projects/bind9/-/issues/2104

/Søren

From: bind-users <[hidden email]> on behalf of Borja Marcos <[hidden email]>
Sent: Tuesday, September 1, 2020 17:12
To: [hidden email] <[hidden email]>
Subject: bind 9.16.6 on FreeBSD - Assert
 
[EXTERNAL MAIL]


Hi,

I had a named process aborting with an assert.

<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - rbt.c:2355: REQUIRE(newbits <= rbt->maxhashbits) failed, back trace
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #0 0x43d260 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #1 0x62035a in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #2 0x514868 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #3 0x515616 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #4 0x529c7d in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #5 0x579df7 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #6 0x645e1c in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - #7 0x80225e036 in ??
<26>1 2020-08-27T15:52:04.000000+00:00 host named 6520 - - exiting (due to assertion failure)
<6>1 2020-08-27T15:52:04.091803+00:00 host kernel - - - pid 6520 (named), jid 0, uid 53: exited on signal 6

I have a full log of queries (it’s a recursive only server) and I haven’t seen anything unusual before the crash. Unfortunately the
program was stripped, I have recompiled it with debug symbols.

It is bind 9.16.6, built from ports on FreeBSD 11.3.

Any hint on what to look for? Fortunately I have another server running 9.11. It wasn’t affected.

Thanks!





Borja.


_______________________________________________
Please visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.


bind-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/bind-users

_______________________________________________
Please visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.


bind-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/bind-users
Reply | Threaded
Open this post in threaded view
|

Re: bind 9.16.6 on FreeBSD - Assert

Borja Marcos


> On 1 Sep 2020, at 19:48, Søren Andersen <[hidden email]> wrote:
>
> hmm.. I think you hit this bug right here: https://gitlab.isc.org/isc-projects/bind9/-/issues/2104

Looks like that. I compiled bind with debug symbols and it crashed again.

No way to append this to your bug report, it’s closed.




Borja.


——
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - rbt.c:2355:
 REQUIRE(newbits <= rbt->maxhashbits) failed, back trace
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #0 0x43fe19
 in assertion_failed()+0x59
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #1 0x7ba3d8
 in isc_assertion_failed()+0x38
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #2 0x5cbb8f
 in rehash()+0x9f
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #3 0x5c2dc7
 in maybe_rehash()+0x47
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #4 0x5c5574
 in hash_node()+0xd4
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #5 0x5c5089 in dns_rbt_addnode()+0xf19
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #6 0x5e6bd0 in findnodeintree()+0x260
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #7 0x5d1c60 in findnode()+0xa0
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #8 0x5201a0 in dns_db_findnode()+0x130
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #9 0x6a8351 in cache_name()+0x3a1
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #10 0x6a240f in cache_message()+0x16f
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #11 0x69f4a6 in resquery_response()+0xd06
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #12 0x804d03 in dispatch()+0xc63
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #13 0x800751 in run()+0x41
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #14 0x80245e036 in _fini()+0x801c3a35e
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - exiting (due to assertion failure)
<6>1 2020-09-02T04:30:04.407121+00:00 host1 kernel - - - pid 49310 (named), jid 0, uid 53: exited on signal 6
——

_______________________________________________
Please visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.


bind-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/bind-users
Reply | Threaded
Open this post in threaded view
|

Re: bind 9.16.6 on FreeBSD - Assert

Søren Andersen
It looks like the same bug to me. - Did you try to patch your source code with the path isc just made?

From: Borja Marcos <[hidden email]>
Sent: Wednesday, September 2, 2020 08:39
To: Søren Andersen <[hidden email]>
Cc: [hidden email] <[hidden email]>
Subject: Re: bind 9.16.6 on FreeBSD - Assert
 
[EXTERNAL MAIL]


> On 1 Sep 2020, at 19:48, Søren Andersen <[hidden email]> wrote:
>
> hmm.. I think you hit this bug right here: https://gitlab.isc.org/isc-projects/bind9/-/issues/2104

Looks like that. I compiled bind with debug symbols and it crashed again.

No way to append this to your bug report, it’s closed.




Borja.


——
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - rbt.c:2355:
 REQUIRE(newbits <= rbt->maxhashbits) failed, back trace
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #0 0x43fe19
 in assertion_failed()+0x59
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #1 0x7ba3d8
 in isc_assertion_failed()+0x38
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #2 0x5cbb8f
 in rehash()+0x9f
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #3 0x5c2dc7
 in maybe_rehash()+0x47
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #4 0x5c5574
 in hash_node()+0xd4
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #5 0x5c5089 in dns_rbt_addnode()+0xf19
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #6 0x5e6bd0 in findnodeintree()+0x260
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #7 0x5d1c60 in findnode()+0xa0
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #8 0x5201a0 in dns_db_findnode()+0x130
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #9 0x6a8351 in cache_name()+0x3a1
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #10 0x6a240f in cache_message()+0x16f
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #11 0x69f4a6 in resquery_response()+0xd06
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #12 0x804d03 in dispatch()+0xc63
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #13 0x800751 in run()+0x41
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - #14 0x80245e036 in _fini()+0x801c3a35e
<26>1 2020-09-02T04:30:04.000000+00:00 host1 named 49310 - - exiting (due to assertion failure)
<6>1 2020-09-02T04:30:04.407121+00:00 host1 kernel - - - pid 49310 (named), jid 0, uid 53: exited on signal 6
——


_______________________________________________
Please visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.


bind-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/bind-users
Reply | Threaded
Open this post in threaded view
|

Re: bind 9.16.6 on FreeBSD - Assert

Borja Marcos


> On 2 Sep 2020, at 09:15, Søren Andersen <[hidden email]> wrote:
>
> It looks like the same bug to me. - Did you try to patch your source code with the path isc just made?

No, I am not aware of a patch. I have rolled it back to 9.11 for now, it’s a production server.


Thanks,




Borja.

_______________________________________________
Please visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.


bind-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/bind-users
Reply | Threaded
Open this post in threaded view
|

Re: bind 9.16.6 on FreeBSD - Assert

Ingeborg Hellemo
In reply to this post by Søren Andersen

[hidden email] said:
> It is bind 9.16.6, built from ports on FreeBSD 11.3.

Same server combination here but different error.

Aug 27 01:36:25 chuck named[11975]: resolver.c:5125: INSIST(dns_name_issubdomain(&fctx->name, &fctx->domain)) failed, back trace
Aug 27 01:36:25 chuck named[11975]: #0 0x43ba00 in ??
Aug 27 01:36:25 chuck named[11975]: #1 0x61ad8a in ??
Aug 27 01:36:25 chuck named[11975]: #2 0x5689bb in ??
Aug 27 01:36:25 chuck named[11975]: #3 0x56e979 in ??
Aug 27 01:36:25 chuck named[11975]: #4 0x5760b0 in ??
Aug 27 01:36:25 chuck named[11975]: #5 0x573bc2 in ??
Aug 27 01:36:25 chuck named[11975]: #6 0x64084c in ??
Aug 27 01:36:25 chuck named[11975]: #7 0x80206e036 in ??
Aug 27 01:36:25 chuck named[11975]: exiting (due to assertion failure)


Upgraded to bind916-9.16.6_1 om Sep 1, but then once more

Sep  2 20:20:22 chuck named[51566]: resolver.c:5125: INSIST(dns_name_issubdomain(&fctx->name, &fctx->domain)) failed, back trace
Sep  2 20:20:22 chuck named[51566]: #0 0x43d2a0 in ??
Sep  2 20:20:22 chuck named[51566]: #1 0x62039a in ??
Sep  2 20:20:22 chuck named[51566]: #2 0x56d84b in ??
Sep  2 20:20:22 chuck named[51566]: #3 0x573809 in ??
Sep  2 20:20:22 chuck named[51566]: #4 0x57b260 in ??
Sep  2 20:20:22 chuck named[51566]: #5 0x578d50 in ??
Sep  2 20:20:22 chuck named[51566]: #6 0x645e5c in ??
Sep  2 20:20:22 chuck named[51566]: #7 0x80246e036 in ??
Sep  2 20:20:22 chuck named[51566]: exiting (due to assertion failure)


The server is dualstack and serves DNS via both IPv4 and IPv6.

Has anyone observed something similar?



--Ingeborg
--
Ingeborg Østrem Hellemo  --  [hidden email]
Dep. of Information Technology  ---  Univ. of Tromsø


_______________________________________________
Please visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.


bind-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/bind-users
Reply | Threaded
Open this post in threaded view
|

Re: bind 9.16.6 on FreeBSD - Assert

Borja Marcos


> On 3 Sep 2020, at 11:13, Ingeborg Hellemo <[hidden email]> wrote:
> The server is dualstack and serves DNS via both IPv4 and IPv6.
>
> Has anyone observed something similar?

 No, I haven’t seen this one.

If you have used the ports subsystem, can you recompile the port with the WITH_DEBUG option?
Doing that the backtrace will include the function names.


Best regards,





Borja.


_______________________________________________
Please visit https://lists.isc.org/mailman/listinfo/bind-users to unsubscribe from this list

ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.


bind-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/bind-users