/hierarchy pagination token is expiring too fast

[dkasak]

Description

While searching a space via Element Desktop, I encountered a case where my homeserver returned 400 Unknown pagination token for a token that should've been valid, because it was returned as the next_batch in the immediately preceding /hierarchy response.

Steps to reproduce

Not sure how to reproduce. I just searched on a large space and waited.

Homeserver

termina.org.uk

Synapse Version

1.105.1

Installation Method

Other (please mention below)

Database

PostgreSQL

Workers

Single process

Platform

FreeBSD. Installed from the FreeBSD synapse package.

Configuration

No response

Relevant log output

2024-06-20 12:51:32,495 - synapse.access.http.8008:472 | INFO - GET-263232 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.193sec/0.001sec (0.026sec, 0.008sec) (0.005sec/0.016sec/13) 4120B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=true&max_depth=1&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:51:50,931 - synapse.access.http.8008:472 | INFO - GET-263276 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 13.752sec/0.002sec (0.042sec, 0.015sec) (0.004sec/0.018sec/16) 36255B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:51:52,050 - synapse.access.http.8008:472 | INFO - GET-263366 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.049sec/0.001sec (0.018sec, 0.000sec) (0.004sec/0.018sec/19) 17091B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=HvNFeajyzFJmbjIGDImuGCBA&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:51:52,879 - synapse.access.http.8008:472 | INFO - GET-263369 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.712sec/0.001sec (0.042sec, 0.005sec) (0.007sec/0.020sec/21) 15129B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=kUPNkjpqpBlYREeUTKEDSqJr&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:51:53,435 - synapse.access.http.8008:472 | INFO - GET-263387 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.088sec/0.001sec (0.021sec, 0.001sec) (0.006sec/0.020sec/23) 14593B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=iZkJledavWxWDtAvrSKMLccK&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:51:54,050 - synapse.access.http.8008:472 | INFO - GET-263390 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.530sec/0.001sec (0.041sec, 0.000sec) (0.005sec/0.015sec/19) 16230B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=AnlrHYQcjjPOtPpmgOBeyEIE&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:52:06,037 - synapse.access.http.8008:472 | INFO - GET-263470 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.279sec/0.001sec (0.034sec, 0.001sec) (0.008sec/0.027sec/29) 18321B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=WEEcrRWcLVftEVAgsPjMMaPj&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:52:06,394 - synapse.access.http.8008:472 | INFO - GET-263474 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.257sec/0.001sec (0.037sec, 0.000sec) (0.010sec/0.028sec/33) 10309B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=YmNyHephbhzlFDWnPaDlLcxY&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:52:07,280 - synapse.access.http.8008:472 | INFO - GET-263477 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.810sec/0.002sec (0.050sec, 0.000sec) (0.019sec/0.034sec/35) 21525B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=lHszUnrAFonxnSVagjeUnyBH&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:52:26,676 - synapse.access.http.8008:472 | INFO - GET-263571 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 8.269sec/0.001sec (0.045sec, 0.001sec) (0.006sec/0.021sec/25) 18082B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=JXuDFslooLCvmxtdvAkSiVBV&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 12:53:13,787 - synapse.access.http.8008:472 | INFO - GET-263630 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 44.415sec/0.001sec (0.063sec, 0.001sec) (0.028sec/0.059sec/41) 12426B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=LaCpCmefLbIGyDwueuSlMvgo&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [27 dbevts]
2024-06-20 12:53:26,538 - synapse.access.http.8008:472 | INFO - GET-263963 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 9.324sec/0.001sec (0.048sec, 0.001sec) (0.013sec/0.037sec/41) 21675B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=TCtHULGIyVKWdzZvYgpvSXGG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [6 dbevts]
2024-06-20 12:53:34,187 - synapse.access.http.8008:472 | INFO - GET-264036 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 2.494sec/0.001sec (0.065sec, 0.009sec) (0.017sec/0.044sec/50) 8763B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=DLbabBGNhgzDKQZUtdvBDSLY&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [18 dbevts]
2024-06-20 12:55:28,084 - synapse.access.http.8008:472 | INFO - GET-264586 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 14.034sec/0.001sec (0.166sec, 0.001sec) (0.033sec/0.075sec/82) 30373B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=OxkCtiOmWZDwvtNKeBxdjNDQ&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [58 dbevts]
2024-06-20 12:55:51,338 - synapse.access.http.8008:472 | INFO - GET-264765 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 14.717sec/0.001sec (0.178sec, 0.025sec) (0.036sec/0.093sec/66) 15326B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=RqHPQoWEpOVlSdUtytdhNqYd&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [54 dbevts]
2024-06-20 12:57:27,905 - synapse.access.http.8008:472 | INFO - GET-264891 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 96.437sec/0.001sec (0.131sec, 0.001sec) (0.021sec/0.057sec/62) 11973B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=rZAiBKBlYNPQTFukDSBAwwZm&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [110 dbevts]
2024-06-20 13:02:31,167 - synapse.http.server:130 | INFO - GET-266562 - <XForwardedForRequest at 0x923e1a4c0 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,168 - synapse.access.http.8008:472 | INFO - GET-266562 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.006sec/0.001sec (0.003sec, 0.000sec) (0.001sec/0.003sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,261 - synapse.http.server:130 | INFO - GET-266564 - <XForwardedForRequest at 0x9afd70910 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,262 - synapse.access.http.8008:472 | INFO - GET-266564 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.007sec/0.000sec (0.002sec, 0.000sec) (0.002sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,348 - synapse.http.server:130 | INFO - GET-266567 - <XForwardedForRequest at 0xa8253ddf0 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,350 - synapse.access.http.8008:472 | INFO - GET-266567 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.006sec/0.001sec (0.003sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,437 - synapse.http.server:130 | INFO - GET-266569 - <XForwardedForRequest at 0x91d0c9580 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,438 - synapse.access.http.8008:472 | INFO - GET-266569 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.001sec (0.003sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,522 - synapse.http.server:130 | INFO - GET-266571 - <XForwardedForRequest at 0x99558de20 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,523 - synapse.access.http.8008:472 | INFO - GET-266571 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.006sec/0.001sec (0.003sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,602 - synapse.http.server:130 | INFO - GET-266573 - <XForwardedForRequest at 0x920beb6d0 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,603 - synapse.access.http.8008:472 | INFO - GET-266573 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.001sec (0.002sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,689 - synapse.http.server:130 | INFO - GET-266575 - <XForwardedForRequest at 0x908983580 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,690 - synapse.access.http.8008:472 | INFO - GET-266575 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.001sec (0.002sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,774 - synapse.http.server:130 | INFO - GET-266577 - <XForwardedForRequest at 0x914669850 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,775 - synapse.access.http.8008:472 | INFO - GET-266577 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.000sec (0.003sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,864 - synapse.http.server:130 | INFO - GET-266579 - <XForwardedForRequest at 0x939c26580 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,865 - synapse.access.http.8008:472 | INFO - GET-266579 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.000sec (0.003sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:31,959 - synapse.http.server:130 | INFO - GET-266581 - <XForwardedForRequest at 0x939c26250 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:31,960 - synapse.access.http.8008:472 | INFO - GET-266581 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.000sec (0.002sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,048 - synapse.http.server:130 | INFO - GET-266583 - <XForwardedForRequest at 0x99a01a700 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:32,049 - synapse.access.http.8008:472 | INFO - GET-266583 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.000sec (0.002sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,140 - synapse.http.server:130 | INFO - GET-266585 - <XForwardedForRequest at 0x9431d8970 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:32,141 - synapse.access.http.8008:472 | INFO - GET-266585 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.000sec (0.003sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,228 - synapse.http.server:130 | INFO - GET-266587 - <XForwardedForRequest at 0x9183c3d30 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:32,229 - synapse.access.http.8008:472 | INFO - GET-266587 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.000sec (0.003sec, 0.000sec) (0.001sec/0.001sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,316 - synapse.http.server:130 | INFO - GET-266589 - <XForwardedForRequest at 0xac74dd730 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:32,317 - synapse.access.http.8008:472 | INFO - GET-266589 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.001sec (0.004sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,404 - synapse.http.server:130 | INFO - GET-266592 - <XForwardedForRequest at 0xa79607eb0 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:32,405 - synapse.access.http.8008:472 | INFO - GET-266592 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.001sec (0.003sec, 0.000sec) (0.001sec/0.001sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,497 - synapse.http.server:130 | INFO - GET-266594 - <XForwardedForRequest at 0xa27b2a3d0 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:32,498 - synapse.access.http.8008:472 | INFO - GET-266594 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.006sec/0.001sec (0.003sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,589 - synapse.http.server:130 | INFO - GET-266596 - <XForwardedForRequest at 0xa795f5d00 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token
2024-06-20 13:02:32,590 - synapse.access.http.8008:472 | INFO - GET-266596 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.005sec/0.001sec (0.003sec, 0.000sec) (0.001sec/0.002sec/2) 64B 400 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,677 - synapse.http.server:126 | INFO - GET-266598 - <XForwardedForRequest at 0x9b78753d0 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 429 - Too Many Requests (<room summary>)
2024-06-20 13:02:32,678 - synapse.access.http.8008:472 | INFO - GET-266598 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 0.001sec/0.001sec (0.002sec, 0.000sec) (0.000sec/0.000sec/0) 78B 429 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [0 dbevts]
2024-06-20 13:02:32,775 - synapse.http.server:130 | INFO - GET-266600 - <XForwardedForRequest at 0x9f2daa220 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token

Anything else that would be useful to know?

No response

[S7evinK]

2024-06-20 12:57:27,905 - synapse.access.http.8008:472 | INFO - GET-264891 - 89.164.57.55 - 8008 - {@dkasak:termina.org.uk} Processed request: 96.437sec/0.001sec (0.131sec, 0.001sec) (0.021sec/0.057sec/62) 11973B 200 "GET /_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=rZAiBKBlYNPQTFukDSBAwwZm&limit=20 HTTP/1.1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.68 Chrome/124.0.6367.243 Electron/30.1.1 Safari/537.36" [110 dbevts]
2024-06-20 13:02:31,167 - synapse.http.server:130 | INFO - GET-266562 - <XForwardedForRequest at 0x923e1a4c0 method='GET' uri='/_matrix/client/v1/rooms/!OJBlkJuUrsKnqtNnTi%3Amatrix.org/hierarchy?suggested_only=false&from=qsKAKoySPzhitprQcBytQewG&limit=20' clientproto='HTTP/1.1' site='8008'> SynapseError: 400 - Unknown pagination token

According to this, the session has expired after 5 minutes and thus Synapse does not know about the token anymore.
The client should try paginating from the beginning in this case and don't hammer the endpoint with an unknown token.
Element Web issue at element-hq/element-web#22138

[dkasak]

Thanks for triaging and linking to the correct issue. Though apart from Element Web not doing the right thing, this is another failure mode and fallout from the /hierarchy endpoint being excruciatingly slow.

[clokep]

this is another failure mode and fallout from the /hierarchy endpoint being excruciatingly slow.

I had plans to make it a lot faster by de-normalizing the space relationships to a separate table instead of having to parse it out of the state. You should be able to do some nice recursive queries on it. I seem to have not saved the branch for it though.