ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62) #3224

dotbill · 2024-05-23T09:52:53Z

dotbill
May 23, 2024

Open5GS Release, Revision, or Tag

v2.7.1

Steps to reproduce

Various services report in journald:

05/23 10:48:52.539: [app] INFO: Configuration: '/etc/open5gs/udm.yaml' (../lib/app/ogs-init.c:133)
05/23 10:48:52.540: [app] INFO: File Logging: '/var/log/open5gs/udm.log' (../lib/app/ogs-init.c:136)
05/23 10:48:52.551: [sbi] INFO: NF Service [nudm-ueau] (../lib/sbi/context.c:1841)
05/23 10:48:52.551: [sbi] INFO: NF Service [nudm-uecm] (../lib/sbi/context.c:1841)
05/23 10:48:52.551: [sbi] INFO: NF Service [nudm-sdm] (../lib/sbi/context.c:1841)
05/23 10:48:52.551: [sbi] INFO: nghttp2_server() [http://127.0.0.12]:7777 (../lib/sbi/nghttp2-server.c:414)
05/23 10:48:52.552: [app] INFO: UDM initialize...done (../src/udm/app.c:31)
05/23 10:48:52.555: [sbi] ERROR: [a9b6035e-18e9-41ef-9fc7-c52519f275b2] HTTP Response Status Code [500] (../lib/sbi/nf-sm.c:158)
05/23 10:48:54.557: [sbi] WARNING: [a9b6035e-18e9-41ef-9fc7-c52519f275b2] Retry registration with NRF (../lib/sbi/nf-sm.c:405)
05/23 10:48:54.558: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 10:48:54.558: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)

This affects amfd, pcfd, udrd, bsfd, umdmd, ausfd, scpd, etc

Taking a packet dump whilst restarting a single service (just using ngrep for a basic view):

T 127.0.0.1:35324 -> 127.0.0.200:7777 [AP] #13
.........{"nfInstanceId":"33ab287c-1891-41ef-bbdd-132c4e82d36c","nfType":"AMF","nfStatus":"REGISTERED","ipv4Addresses":["127.0.0.5"],"allowedNfTypes":["SCP","SMF","AMF"],"priority":0,"capacity":100,"load":0,"amfInfo":{"amfSetId":"001","amfRegionId":"02","guamiList":[{"plmnId":{"mcc":"234","mnc":"99"},"amfId":"020040"}],"taiList":[{"plmnId":{"mcc":"234","mnc":"99"},"tac":"000001"}]},"nfServiceList":{"33ac3078-1891-41ef-bbdd-132c4e82d36c":{"serviceInstanceId":"33ac3078-1891-41ef-bbdd-132c4e82d36c","serviceName":"namf-comm","versions":[{"apiVersionInUri":"v1","apiFullVersion":"1.0.0"}],"scheme":"http","nfServiceStatus":"REGISTERED","ipEndPoints":[{"ipv4Address":"127.0.0.5","port":7777}],"allowedNfTypes":["SMF","AMF"],"priority":0,"capacity":100,"load":0}},"nfProfileChangesSupportInd":true}
##
T 127.0.0.200:7777 -> 127.0.0.1:35324 [AP] #15
..?.......v..Yjo..;.wW.a..Y>....?J..iA3p-.e.1h....50_..u.b.&=LWa......=_
#
T 127.0.0.200:7777 -> 127.0.0.1:35324 [AP] #16
..2......{"title":"response_handler() failed","status":500}
##
T 127.0.0.1:35324 -> 127.0.0.200:7777 [AP] #18
.........

I cannot see other logs giving a reason for the 500 error. Happy to supply more info to help diagnose why.

Logs

Additional logs of scpd running in debug mode:

05/23 10:51:12.798: [sbi] DEBUG: FLAGS(0x0) [NO-ACK] (../lib/sbi/nghttp2-server.c:1186)
05/23 10:51:12.798: [sbi] DEBUG: MAX_CONCURRENT_STREAMS = 100 (../lib/sbi/nghttp2-server.c:1197)
05/23 10:51:12.798: [sbi] DEBUG: ENABLE_PUSH = false (../lib/sbi/nghttp2-server.c:1199)
0000: 00000004 01000000 00                  .........
05/23 10:51:12.799: [sbi] DEBUG: STREAM added [1] (../lib/sbi/nghttp2-server.c:1542)
05/23 10:51:12.799: [sbi] DEBUG: [PUT] /nnrf-nfm/v1/nf-instances/43fe21e0-1880-41ef-b570-af4405b1a482 (../lib/sbi/nghttp2-server.c:1158)
05/23 10:51:12.799: [sbi] DEBUG: RECEIVED: 602 (../lib/sbi/nghttp2-server.c:1162)
05/23 10:51:12.799: [sbi] DEBUG: {"nfInstanceId":"43fe21e0-1880-41ef-b570-af4405b1a482","nfType":"AUSF","nfStatus":"REGISTERED","ipv4Addresses":["127.0.0.11"],"allowedNfTypes":["SCP","AMF"],"priority":0,"capacity":100,"load":0,"nfServiceList":{"43fe2898-1880-41ef-b570-af4405b1a482":{"serviceInstanceId":"43fe2898-1880-41ef-b570-af4405b1a482","serviceName":"nausf-auth","versions":[{"apiVersionInUri":"v1","apiFullVersion":"1.0.0"}],"scheme":"http","nfServiceStatus":"REGISTERED","ipEndPoints":[{"ipv4Address":"127.0.0.11","port":7777}],"allowedNfTypes":["AMF"],"priority":0,"capacity":100,"load":0}},"nfProfileChangesSupportInd":true} (../lib/sbi/nghttp2-server.c:1164)
05/23 10:51:12.799: [sbi] DEBUG: [PUT] http://127.0.0.10:7777/nnrf-nfm/v1/nf-instances/43fe21e0-1880-41ef-b570-af4405b1a482 (../lib/sbi/client.c:728)
05/23 10:51:12.799: [sbi] DEBUG: SENDING...[602] (../lib/sbi/client.c:497)
05/23 10:51:12.799: [sbi] DEBUG: {"nfInstanceId":"43fe21e0-1880-41ef-b570-af4405b1a482","nfType":"AUSF","nfStatus":"REGISTERED","ipv4Addresses":["127.0.0.11"],"allowedNfTypes":["SCP","AMF"],"priority":0,"capacity":100,"load":0,"nfServiceList":{"43fe2898-1880-41ef-b570-af4405b1a482":{"serviceInstanceId":"43fe2898-1880-41ef-b570-af4405b1a482","serviceName":"nausf-auth","versions":[{"apiVersionInUri":"v1","apiFullVersion":"1.0.0"}],"scheme":"http","nfServiceStatus":"REGISTERED","ipEndPoints":[{"ipv4Address":"127.0.0.11","port":7777}],"allowedNfTypes":["AMF"],"priority":0,"capacity":100,"load":0}},"nfProfileChangesSupportInd":true} (../lib/sbi/client.c:499)
05/23 10:51:12.799: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 10:51:12.799: [scp] WARNING: response_handler() failed [-1] (../src/scp/sbi-path.c:627)
05/23 10:51:12.799: [sbi] DEBUG: STATUS [500] (../lib/sbi/nghttp2-server.c:640)
05/23 10:51:12.799: [sbi] DEBUG: SENDING...: 50 (../lib/sbi/nghttp2-server.c:648)
05/23 10:51:12.799: [sbi] DEBUG: {"title":"response_handler() failed","status":500} (../lib/sbi/nghttp2-server.c:649)
05/23 10:51:12.799: [sbi] DEBUG: STREAM closed [1] (../lib/sbi/nghttp2-server.c:1268)
0000: 00003f01 04000000 018e768b d5596a6f   ..?.......v..Yjo
0010: 16e53b89 77570f61 96df3dbf 4a099534   ..;.wW.a..=.J..4
0020: 0fd28200 9a500fdc 6c370225 3168df0f   .....P..l7.%1h..
0030: 0d023530 5f921d75 d0620d26 3d4c5761   ..50_..u.b.&=LWa
0040: e3a0b4ff be883d5f                     ......=_
0000: 00003200 01000000 017b2274 69746c65   ..2......{"title
0010: 223a2272 6573706f 6e73655f 68616e64   ":"response_hand
0020: 6c657228 29206661 696c6564 222c2273   ler() failed","s
0030: 74617475 73223a35 30307d              tatus":500}
05/23 10:51:12.800: [sbi] DEBUG: FLAGS(0x1) [ACK] (../lib/sbi/nghttp2-server.c:1186)

Expected behaviour

Service registered to scpd

Observed Behaviour

as above

eNodeB/gNodeB

No response

UE Models and versions

No response

dotbill · 2024-05-23T10:59:20Z

dotbill
May 23, 2024
Author

I've further re-tested by having no services other than scpd running - then starting nrfd, yields:


==> nrf.log <==
Open5GS daemon v2.7.1

05/23 11:56:39.880: [app] INFO: Configuration: '/etc/open5gs/nrf.yaml' (../lib/app/ogs-init.c:133)
05/23 11:56:39.880: [app] INFO: File Logging: '/var/log/open5gs/nrf.log' (../lib/app/ogs-init.c:136)
05/23 11:56:39.889: [sbi] INFO: nghttp2_server() [http://127.0.0.10]:7777 (../lib/sbi/nghttp2-server.c:414)
05/23 11:56:39.889: [app] INFO: NRF initialize...done (../src/nrf/app.c:31)

==> scp.log <==
05/23 11:56:40.429: [sbi] WARNING: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] Retry registration with NRF (../lib/sbi/nf-sm.c:182)

==> nrf.log <==
05/23 11:56:40.432: [nrf] INFO: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] NF registered [Heartbeat:10s] (../src/nrf/nf-sm.c:192)

==> scp.log <==
05/23 11:56:40.433: [sbi] INFO: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] NF registered [Heartbeat:10s] (../lib/sbi/nf-sm.c:221)
05/23 11:56:40.435: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.435: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:40.435: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.435: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:40.435: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.436: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:40.436: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.436: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:40.436: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.436: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:40.436: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.436: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:40.436: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.436: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:40.437: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.437: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:40.437: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:40.437: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:50.445: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:50.445: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:56:51.435: [sbi] ERROR: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0:SCP] No heartbeat (../lib/sbi/nf-sm.c:310)
05/23 11:56:51.435: [sbi] INFO: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] NF de-registered (../lib/sbi/nf-sm.c:248)
05/23 11:56:51.436: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:56:51.436: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)

==> nrf.log <==
05/23 11:56:51.439: [nrf] WARNING: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] No heartbeat (../src/nrf/nrf-sm.c:272)
05/23 11:56:51.439: [nrf] INFO: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] NF de-registered (../src/nrf/nf-sm.c:208)

==> scp.log <==
05/23 11:57:02.447: [sbi] WARNING: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] Retry registration with NRF (../lib/sbi/nf-sm.c:182)
05/23 11:57:02.448: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:57:02.448: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:57:13.459: [sbi] WARNING: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] Retry registration with NRF (../lib/sbi/nf-sm.c:182)
05/23 11:57:13.460: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:57:13.460: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:57:24.471: [sbi] WARNING: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] Retry registration with NRF (../lib/sbi/nf-sm.c:182)
05/23 11:57:24.472: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:57:24.472: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)
05/23 11:57:35.483: [sbi] WARNING: [081afa9a-18f3-41ef-9e0b-8b3016afa9d0] Retry registration with NRF (../lib/sbi/nf-sm.c:182)
05/23 11:57:35.484: [sbi] WARNING: [16]  (../lib/sbi/client.c:698)
05/23 11:57:35.484: [sbi] WARNING: ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62)

0 replies

acetcom · 2024-05-23T14:02:11Z

acetcom
May 23, 2024
Maintainer

@dotbill

This problem does not seem to be related to open5gs.

dotbill
May 23, 2024
Author

Hi Sukchan

Thanks for the reply - it does not relate to open5gs - it does entirely relate to Debian 12 and the shipped version of libcurl.

To help others in the same situation:

Debian 12.5
Shipped version of curl: 7.88.1-10+deb12u5 - has issue

Using bookworm-backports, I manually upgraded to version 8.7.1-5~bpo12+1

https://packages.debian.org/bookworm-backports/curl

That has resolved the issue I had (and now moving onto other config issues!)

0 replies

laf0rge · 2024-11-21T19:00:12Z

laf0rge
Nov 21, 2024

did anyone actually bother and report this to debian and request a fix in stable (12) not just in unstable (and hence backports)?

0 replies

acetcom · 2024-12-13T06:17:54Z

acetcom
Dec 13, 2024
Maintainer

@dotbill and @laf0rge

Thanks for your reply. It’s great to hear that upgrading to curl 8.7.1 from the backports resolved your issue. Regarding your question, unfortunately, I haven’t personally reported this issue to Debian, as I’m not familiar with the process of reporting issues or requesting fixes for Debian stable.

Thanks for raising the point – I’ll follow up if I find anything.

Sukchan

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62) #3224

{{title}}

Replies: 5 comments

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

ogs_sbi_client_handler() failed [-1] (../lib/sbi/path.c:62) #3224

dotbill May 23, 2024

Open5GS Release, Revision, or Tag

Steps to reproduce

Logs

Expected behaviour

Observed Behaviour

eNodeB/gNodeB

UE Models and versions

Replies: 5 comments

dotbill May 23, 2024 Author

acetcom May 23, 2024 Maintainer

dotbill May 23, 2024 Author

laf0rge Nov 21, 2024

acetcom Dec 13, 2024 Maintainer

dotbill
May 23, 2024

dotbill
May 23, 2024
Author

acetcom
May 23, 2024
Maintainer

dotbill
May 23, 2024
Author

laf0rge
Nov 21, 2024

acetcom
Dec 13, 2024
Maintainer