Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

possible uncaught error in rss parsing, stopping main thread until interrupt event is sent manually #20

Open
Carravan opened this issue Oct 9, 2022 · 0 comments
Labels
bug Something isn't working

Comments

@Carravan
Copy link

Carravan commented Oct 9, 2022

Log from such a recent event I encountered below. Unfortunately I have no clue what the response body looked like but I suppose a general catch to dump the response into the log could do the trick to nail it down over some time. It's better for the parsing to verbosely fail, rather than to block the thread silently.

[2022-10-07T14:00:11Z DEBUG hoshinova::module::scraper] Fetching RSS for Vesper
[2022-10-07T14:00:11Z DEBUG hyper::client::pool] reuse idle connection for ("https", www.youtube.com)
[2022-10-07T14:00:11Z DEBUG h2::codec::framed_write] send frame=Headers { stream_id: StreamId(211), flags: (0x5: END_HEADERS | END_STREAM) }
[2022-10-07T14:00:11Z DEBUG h2::codec::framed_read] received frame=Headers { stream_id: StreamId(211), flags: (0x4: END_HEADERS) }
[2022-10-07T14:00:11Z DEBUG h2::codec::framed_read] received frame=Data { stream_id: StreamId(211), flags: (0x1: END_STREAM) }
[2022-10-07T14:00:11Z DEBUG h2::codec::framed_read] received frame=Ping { ack: false, payload: [0, 0, 0, 0, 0, 0, 0, 88] }
[2022-10-07T14:00:11Z DEBUG h2::codec::framed_write] send frame=Ping { ack: true, payload: [0, 0, 0, 0, 0, 0, 0, 88] }
[2022-10-07T14:00:11Z DEBUG reqwest::async_impl::client] response '200 OK' for https://www.youtube.com/feeds/videos.xml?channel_id=UCDRWSO281bIHYVi-OV3iFYA
[2022-10-07T14:00:41Z DEBUG hoshinova::module::scraper] Fetching RSS for Terumi
[2022-10-07T14:00:41Z DEBUG hyper::client::pool] reuse idle connection for ("https", www.youtube.com)
[2022-10-07T14:00:41Z DEBUG hoshinova::module::scraper] Fetching RSS for Yuuki
[2022-10-07T14:00:41Z DEBUG hyper::client::pool] reuse idle connection for ("https", www.youtube.com)
[2022-10-07T14:00:41Z DEBUG hoshinova::module::scraper] Fetching RSS for Pippa
[2022-10-07T14:00:41Z DEBUG hyper::client::pool] reuse idle connection for ("https", www.youtube.com)
[2022-10-07T14:00:41Z DEBUG hoshinova::module::scraper] Fetching RSS for Lisa
[2022-10-07T14:00:41Z DEBUG hyper::client::pool] reuse idle connection for ("https", www.youtube.com)
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_write] send frame=Headers { stream_id: StreamId(213), flags: (0x5: END_HEADERS | END_STREAM) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_write] send frame=Headers { stream_id: StreamId(215), flags: (0x5: END_HEADERS | END_STREAM) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_write] send frame=Headers { stream_id: StreamId(217), flags: (0x5: END_HEADERS | END_STREAM) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_write] send frame=Headers { stream_id: StreamId(219), flags: (0x5: END_HEADERS | END_STREAM) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Headers { stream_id: StreamId(215), flags: (0x4: END_HEADERS) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Data { stream_id: StreamId(215), flags: (0x1: END_STREAM) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Ping { ack: false, payload: [0, 0, 0, 0, 0, 0, 0, 90] }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_write] send frame=Ping { ack: true, payload: [0, 0, 0, 0, 0, 0, 0, 90] }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Headers { stream_id: StreamId(213), flags: (0x4: END_HEADERS) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Data { stream_id: StreamId(213), flags: (0x1: END_STREAM) }
[2022-10-07T14:00:41Z DEBUG reqwest::async_impl::client] response '200 OK' for https://www.youtube.com/feeds/videos.xml?channel_id=UC0G2Y7_TXXJKL1OwTdTsWBg
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Headers { stream_id: StreamId(217), flags: (0x4: END_HEADERS) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Data { stream_id: StreamId(217), flags: (0x1: END_STREAM) }
[2022-10-07T14:00:41Z DEBUG reqwest::async_impl::client] response '200 OK' for https://www.youtube.com/feeds/videos.xml?channel_id=UCSmWTq8TP7zejNS6qbJLHUw
[2022-10-07T14:00:41Z DEBUG reqwest::async_impl::client] response '200 OK' for https://www.youtube.com/feeds/videos.xml?channel_id=UCJ46YTYBQVXsfsp8-HryoUA
[2022-10-07T14:00:41Z DEBUG hoshinova::module::scraper] Fetching RSS for Vesper
[2022-10-07T14:00:41Z DEBUG hyper::client::pool] reuse idle connection for ("https", www.youtube.com)
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Headers { stream_id: StreamId(219), flags: (0x4: END_HEADERS) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Data { stream_id: StreamId(219), flags: (0x1: END_STREAM) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_write] send frame=Headers { stream_id: StreamId(221), flags: (0x5: END_HEADERS | END_STREAM) }
[2022-10-07T14:00:41Z DEBUG reqwest::async_impl::client] response '200 OK' for https://www.youtube.com/feeds/videos.xml?channel_id=UCdureux7B_V-xhM7tYImASQ
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Headers { stream_id: StreamId(221), flags: (0x4: END_HEADERS) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Data { stream_id: StreamId(221), flags: (0x1: END_STREAM) }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_read] received frame=Ping { ack: false, payload: [0, 0, 0, 0, 0, 0, 0, 92] }
[2022-10-07T14:00:41Z DEBUG h2::codec::framed_write] send frame=Ping { ack: true, payload: [0, 0, 0, 0, 0, 0, 0, 92] }
[2022-10-07T14:00:41Z DEBUG reqwest::async_impl::client] response '200 OK' for https://www.youtube.com/feeds/videos.xml?channel_id=UCDRWSO281bIHYVi-OV3iFYA
[2022-10-07T14:01:11Z DEBUG hoshinova::module::scraper] Fetching RSS for Terumi

Sent interrupt here

[2022-10-08T02:10:59Z DEBUG h2::codec::framed_read] received frame=GoAway { error_code: NO_ERROR, last_stream_id: StreamId(2147483647), debug_data: b"session_timed_out" }
[2022-10-08T02:10:59Z INFO  hoshinova::module::recorder] [vNodJC74mQU][Terumi Koizumi Ch.][【CYBERPUNK】Did you guess it was going to be Cyberpunk?! Let's go do Flatline some Cyberpsychos!] Recording started
[2022-10-08T02:10:59Z INFO  hoshinova::module::recorder] [4aPlZMEsCUo][Lisa Ch. 近藤リサ 【Tsunderia】][Stellar Stellar (Midwest Emo ver.) / Covered by Chikafuji Lisa] Recording started
[2022-10-08T02:10:59Z INFO  hoshinova::module::recorder] [mxTtycZdRqg][Pipkin Pippa Ch.【Phase Connect】][Talking to Famous Vtubers. . . and myself] Recording started
[2022-10-08T02:10:59Z DEBUG hoshinova::module::recorder] [4aPlZMEsCUo][Lisa Ch. 近藤リサ 【Tsunderia】][Stellar Stellar (Midwest Emo ver.) / Covered by Chikafuji Lisa] Process exited with Ok(ExitStatus(unix_wait_status(0)))
[2022-10-08T02:11:09Z DEBUG hoshinova::module::recorder] [vNodJC74mQU][Terumi Koizumi Ch.][【CYBERPUNK】Did you guess it was going to be Cyberpunk?! Let's go do Flatline some Cyberpsychos!] Process exited with Ok(ExitStatus(unix_wait_status(0)))
[2022-10-09T09:23:57Z DEBUG reqwest::connect] starting new connection: https://www.youtube.com/
[2022-10-09T09:23:57Z DEBUG h2::codec::framed_read] received frame=Ping { ack: false, payload: [0, 0, 0, 0, 0, 0, 0, 94] }
[2022-10-09T09:23:57Z DEBUG reqwest::connect] starting new connection: https://discord.com/
[2022-10-09T09:23:57Z DEBUG hoshinova::module::scraper] Fetching RSS for Yuuki
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::dns] resolving host="www.youtube.com"
[2022-10-09T09:23:57Z DEBUG h2::codec::framed_write] send frame=Ping { ack: true, payload: [0, 0, 0, 0, 0, 0, 0, 94] }
[2022-10-09T09:23:57Z DEBUG h2::codec::framed_read] received frame=GoAway { error_code: NO_ERROR, last_stream_id: StreamId(221), debug_data: b"session_timed_out" }
[2022-10-09T09:23:57Z DEBUG reqwest::connect] starting new connection: https://www.youtube.com/
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::dns] resolving host="discord.com"
[2022-10-09T09:23:57Z DEBUG h2::proto::connection] Connection::poll; IO error error=UnexpectedEof
[2022-10-09T09:23:57Z DEBUG hoshinova::module::scraper] Fetching RSS for Pippa
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::dns] resolving host="www.youtube.com"
[2022-10-09T09:23:57Z DEBUG hyper::proto::h2::client] connection error: unexpected end of file
[2022-10-09T09:23:57Z DEBUG reqwest::connect] starting new connection: https://www.youtube.com/
[2022-10-09T09:23:57Z DEBUG hoshinova::module::scraper] Fetching RSS for Lisa
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::dns] resolving host="www.youtube.com"
[2022-10-09T09:23:57Z DEBUG reqwest::connect] starting new connection: https://www.youtube.com/
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::dns] resolving host="www.youtube.com"
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::http] connecting to 142.251.36.174:443
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::http] connecting to 172.217.16.174:443
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::http] connecting to 142.251.37.14:443
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::http] connecting to 142.251.36.174:443
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::http] connected to 142.251.36.174:443
[2022-10-09T09:23:57Z DEBUG rustls::client::hs] Resuming session
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::http] connected to 172.217.16.174:443
[2022-10-09T09:23:57Z DEBUG rustls::client::hs] Resuming session
[2022-10-09T09:23:57Z DEBUG hyper::client::connect::http] connected to 142.251.37.14:443
@hizkifw hizkifw added the bug Something isn't working label Oct 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants