Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to debug never stopping process #118

Open
hyperknot opened this issue Apr 22, 2020 · 2 comments
Open

How to debug never stopping process #118

hyperknot opened this issue Apr 22, 2020 · 2 comments

Comments

@hyperknot
Copy link

hyperknot commented Apr 22, 2020

I am trying to use osmtogeojson to recreate an alternative to the recently shutdown Wambachers OSM Boundaries service.

I've exported boundary=administrative + admin_level=2..8 filtered osm files with osmium.

My problem is that while levels 2, 3, 4, 5 are processed withing a few minutes, level 6 is going on forever. On a 64 GB, 8 core server, it has been running for 66 hours now.

I think something is wrong or it went into an infinite loop somehow, but I cannot debug it.

Level 4 was 2.2 GB while Level 6 is 5.6 GB, but the difference shouldn't be that big. I mean Level 4 was processed in 4 minutes and for level 6 I'm waiting for 66 hours, so definitely something is not right.

If needed I can give the command which can replicate level 6 file. It's basically 2 command on a planet.pbf.

@hyperknot
Copy link
Author

I couldn't debug what was causing this, but what I did was I've split the file to 10 segments and then they all completed correctly.

@MrFoxPro
Copy link

MrFoxPro commented May 29, 2024

Same thing, processing admin_level=4 hang for an hour with max-old-space-size of 12228.
That's why you don't write performance-sensetive programs in languages like javascript

upd: ran with Bun and after ~50min and 13Gb of RAM it finished

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants