Migrate the update to use plant extracts

[HarelM]

Due to the extract delays that sometime occur in the French minutely extracts we would like to consider migrating to a more robust mechanism using the planet extracts and some extra processing.

[HarelM]

The following is a partial code related to the creating of the change files:

[ ! -f data/changes.osc.gz ] || rm data/changes.osc.gz

pyosmium-get-changes --server https://planet.osm.org/replication/minute -f data/$(area).sequence.state -v -v -o data/changes.osc.gz --size 1024

osmconvert -B=israel_and_palestine.poly data/changes.osc.gz --out-osc > data/changes.osc

gzip --force data/changes.

Things to note here in terms of command line utilities that do not exist in the docker right now:
gzip, pyosmium-get-changes
Files that are needed:
israel_and_palestine.poly

[zstadler]

In the map generation code, I ended up using osmctools and the following update procedure:

osmupdate --verbose -B=israel_and_palestine.poly israel_and_palestine.osm.pbf israel_and_palestine-new.o5m
osmconvert --diff israel_and_palestine.osm.pbf israel_and_palestine-new.o5m --out-osc | gzip > changes.osc.gz
osmconvert israel_and_palestine-new.o5m -o=israel_and_palestine.osm.pbf

It produces changes.osc.gz as a changefile and updates israel_and_palestine.osm.pbf.

[HarelM]

Thanks! the .poly file is from geofabrik as well, right?

[zstadler]

The .poly is from the same source as the .osm.pbf file - both Geofabrik and openstreetmnap.fr have them.