Major improvement to OSM-based electricity grid (e.g. using relations, preserving substation locations)

[bobbyxng]

Changes proposed in this Pull Request

• Major improvement to the OSM-based electricity grid
• build_osm_network completely rewritten:
  • Use of OSM relations, where available and where a single linestring could be extracted to replace member ways
  • substantial speed improvements
  • Exact locations of original substations are preserved
  • Lines with identical geometries and voltages are aggregated (num_parallel is increased)
  • Lines overpassing "virtual nodes" (not actual substations as per OSM raw data) are merged, if their electric properties allow it (same voltage levels, same number of circuits)
  • Geometries are preserved. Method to extend line/link to the substation has been improved significantly. No "mess" inside of a substation cluster anymore.
  • Method to determine substation point improved, based on "Point of Inaccessibility" (PoI) method developed by Garcia-Castellanos & Lombardo 2007, doi.org/10.1080/14702540801897809 which ensures that an interior point in non-convex shapes is always found.
  • Clustering resolution has been sharpened from 5000 meter radius to only 500 meters, while still ensuring topological connectivity.
  • Single bus for each voltage level in each substation. Buses of different voltages are arranged in geometric shape (three buses form a triangle, see screenshot)
  • Transformers now have a capacity s_nom based on the maximum of connected capacity connected to each bus
  • Resolves many issues related around cross-border capacity, especially if the substation was located close to a border. @lindnemi @toniseibold @JulianGeis @nworbmot

Todo:

• Validation runs still open

Checklist

• I tested my contribution locally and it works as intended.
• Code and workflow changes are sufficiently documented.
• Changed dependencies are added to envs/environment.yaml.
• Changes in configuration options are added in config/config.default.yaml.
• Changes in configuration options are documented in doc/configtables/*.csv.
• Sources of newly added data are documented in doc/data_sources.rst.
• A release note doc/release_notes.rst is added.

[github-actions]

Validator Report

I am the Validator. Download all artifacts here.
I'll be back and edit this comment for each new commit.

General

Plots comparison

Main branch	Feature branch

Files comparison

	Status	NRMSE	MAE (norm)
prices.csv	⚠️Changed	0.000	0.17
weighted_prices.csv	⚠️Changed	0.539	0.56
curtailment.csv	⚠️Changed	0.000	0.21
price_statistics.csv	⚠️Changed	0.017	0.19
metrics.csv	⚠️Changed	0.000	0.13
cfs.csv	⚠️Changed	0.034	0.09
nodal_supply_energy.csv	⚠️ NaN mismatch
nodal_cfs.csv	⚠️ NaN mismatch
nodal_capacities.csv	⚠️ NaN mismatch
nodal_costs.csv	⚠️ NaN mismatch
market_values.csv	✅ Almost equal	0.014	0.04
supply.csv	✅ Almost equal	0.000	0.03
costs.csv	✅ Almost equal	0.000	0.01
capacities.csv	✅ Almost equal	0.001	0.02
supply_energy.csv	✅ Almost equal	0.000	0.02
energy.csv	✅ Almost equal	0.000	0.02

NRMSE: Normalized (combined-min-max) Root Mean Square Error
MAE (norm): Mean Absolute Error on normalized data (min-max)
Status Threshold: MAE (norm) > 0.05 and NRMSE > 0.3

Model Metrics

Benchmarks

Comparing osm-relations (8aec857) with master (49ca406).
Branch is 17 commits ahead and 2 commits behind.
Last updated on 2024-10-22 19:45:48 CEST.