diff --git a/README.md b/README.md index b4b22ee5..a0c1579f 100644 --- a/README.md +++ b/README.md @@ -12,6 +12,8 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2025-01-25](results/bm-20250125-3.14.0a4%2B-3f2cfd0) | python/3f2cfd0462e13368092a | 3f2cfd0 | 1.072x ↑
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) | 1.030x ↑
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) | | +| [2025-01-25](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL) | python/3f2cfd0462e13368092a | 3f2cfd0 (NOGIL) | 1.102x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) | 1.135x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) | 1.158x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.svg)[🧠](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base-mem.svg) | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-9abbb58) | python/9abbb58e3f023555473d | 9abbb58 | 1.066x ↑
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.svg) | 1.021x ↑
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.svg) | | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL) | python/9abbb58e3f023555473d | 9abbb58 (NOGIL) | 1.081x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.svg) | 1.114x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.svg) | 1.133x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base.svg)[🧠](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base-mem.svg) | | [2025-01-23](results/bm-20250123-3.14.0a4%2B-732670d) | python/732670d93b9b0c0ff8ad | 732670d | 1.068x ↑
[📄](results/bm-20250123-3.14.0a4%2B-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4%2B-732670d-vs-3.12.6.md)[📈](results/bm-20250123-3.14.0a4%2B-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4%2B-732670d-vs-3.12.6.svg) | 1.030x ↑
[📄](results/bm-20250123-3.14.0a4%2B-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4%2B-732670d-vs-3.13.0rc2.md)[📈](results/bm-20250123-3.14.0a4%2B-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4%2B-732670d-vs-3.13.0rc2.svg) | | @@ -20,14 +22,12 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE | [2025-01-23](results/bm-20250123-3.14.0a4%2B-ec91e1c-NOGIL) | python/ec91e1c2762412f1408b | ec91e1c (NOGIL) | 1.084x ↓
[📄](results/bm-20250123-3.14.0a4%2B-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4%2B-ec91e1c-vs-3.12.6.md)[📈](results/bm-20250123-3.14.0a4%2B-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4%2B-ec91e1c-vs-3.12.6.svg) | 1.119x ↓
[📄](results/bm-20250123-3.14.0a4%2B-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4%2B-ec91e1c-vs-3.13.0rc2.md)[📈](results/bm-20250123-3.14.0a4%2B-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4%2B-ec91e1c-vs-3.13.0rc2.svg) | 1.136x ↓
[📄](results/bm-20250123-3.14.0a4%2B-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4%2B-ec91e1c-vs-base.md)[📈](results/bm-20250123-3.14.0a4%2B-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4%2B-ec91e1c-vs-base.svg)[🧠](results/bm-20250123-3.14.0a4%2B-ec91e1c-NOGIL/bm-20250123-linux-x86_64-python-ec91e1c2762412f1408b-3.14.0a4%2B-ec91e1c-vs-base-mem.svg) | | [2025-01-23](results/bm-20250123-3.14.0a4%2B-327a257) | python/327a257e6ae4ad0e3b6e | 327a257 | 1.060x ↑
[📄](results/bm-20250123-3.14.0a4%2B-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.12.6.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.12.6.svg) | 1.018x ↑
[📄](results/bm-20250123-3.14.0a4%2B-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.13.0rc2.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.13.0rc2.svg) | | | [2025-01-23](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL) | python/327a257e6ae4ad0e3b6e | 327a257 (NOGIL) | 1.088x ↓
[📄](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.12.6.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.12.6.svg) | 1.122x ↓
[📄](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.13.0rc2.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.13.0rc2.svg) | 1.134x ↓
[📄](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-base.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-base.svg)[🧠](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-linux-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-base-mem.svg) | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL) | python/86c1a60d5a28cfb51f88 | 86c1a60 (NOGIL) | 1.087x ↓
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.svg) | 1.117x ↓
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.svg) | 1.120x ↓
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base-mem.svg) | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-86c1a60) | python/86c1a60d5a28cfb51f88 | 86c1a60 | 1.049x ↑
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.svg) | 1.010x ↑
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.svg) | | -| [2025-01-21](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL) | python/01bcf13a1c5bfca5124c | 01bcf13 (NOGIL) | 1.097x ↓
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.12.6.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.12.6.svg) | 1.132x ↓
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.svg) | 1.128x ↓
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-base.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-base.svg)[🧠](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-base-mem.svg) | -| [2025-01-21](results/bm-20250121-3.14.0a4%2B-01bcf13) | python/01bcf13a1c5bfca5124c | 01bcf13 | 1.048x ↑
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.12.6.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.12.6.svg) | 1.005x ↑
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-linux-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.svg) | | ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2025-01-25](results/bm-20250125-3.14.0a4%2B-3f2cfd0) | python/3f2cfd0462e13368092a | 3f2cfd0 | 1.088x ↑
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) | 1.050x ↑
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) | | +| [2025-01-25](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL) | python/3f2cfd0462e13368092a | 3f2cfd0 (NOGIL) | 1.058x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) | 1.088x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) | 1.135x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.svg)[🧠](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base-mem.svg) | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-9abbb58) | python/9abbb58e3f023555473d | 9abbb58 | 1.089x ↑
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.svg) | 1.051x ↑
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.svg) | | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL) | python/9abbb58e3f023555473d | 9abbb58 (NOGIL) | 1.063x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.svg) | 1.094x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.svg) | 1.140x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base.svg)[🧠](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base-mem.svg) | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL) | faster-cpython/remove_most_conditio | 1e0f842 (NOGIL) | 1.053x ↓
[📄](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-3.12.6.svg) | 1.083x ↓
[📄](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-3.13.0rc2.svg) | 1.010x ↑
[📄](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-base.md)[📈](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-base.svg)[🧠](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-base-mem.svg) | @@ -43,22 +43,7 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE | [2025-01-23](results/bm-20250123-3.14.0a4%2B-327a257) | python/327a257e6ae4ad0e3b6e | 327a257 | 1.085x ↑
[📄](results/bm-20250123-3.14.0a4%2B-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.12.6.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.12.6.svg) | 1.046x ↑
[📄](results/bm-20250123-3.14.0a4%2B-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.13.0rc2.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.13.0rc2.svg) | | | [2025-01-23](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL) | python/327a257e6ae4ad0e3b6e | 327a257 (NOGIL) | 1.087x ↓
[📄](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.12.6.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.12.6.svg) | 1.117x ↓
[📄](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.13.0rc2.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-3.13.0rc2.svg) | 1.159x ↓
[📄](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-base.md)[📈](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-base.svg)[🧠](results/bm-20250123-3.14.0a4%2B-327a257-NOGIL/bm-20250123-vultr-x86_64-python-327a257e6ae4ad0e3b6e-3.14.0a4%2B-327a257-vs-base-mem.svg) | | [2025-01-22](results/bm-20250122-3.14.0a4%2B-1b4e8c3-NOGIL) | nascheme/gh_129201_gc_mark_pr | 1b4e8c3 (NOGIL) | 1.071x ↓
[📄](results/bm-20250122-3.14.0a4%2B-1b4e8c3-NOGIL/bm-20250122-vultr-x86_64-nascheme-gh_129201_gc_mark_pr-3.14.0a4%2B-1b4e8c3-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-1b4e8c3-NOGIL/bm-20250122-vultr-x86_64-nascheme-gh_129201_gc_mark_pr-3.14.0a4%2B-1b4e8c3-vs-3.12.6.svg) | 1.102x ↓
[📄](results/bm-20250122-3.14.0a4%2B-1b4e8c3-NOGIL/bm-20250122-vultr-x86_64-nascheme-gh_129201_gc_mark_pr-3.14.0a4%2B-1b4e8c3-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-1b4e8c3-NOGIL/bm-20250122-vultr-x86_64-nascheme-gh_129201_gc_mark_pr-3.14.0a4%2B-1b4e8c3-vs-3.13.0rc2.svg) | 1.009x ↓
[📄](results/bm-20250122-3.14.0a4%2B-1b4e8c3-NOGIL/bm-20250122-vultr-x86_64-nascheme-gh_129201_gc_mark_pr-3.14.0a4%2B-1b4e8c3-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-1b4e8c3-NOGIL/bm-20250122-vultr-x86_64-nascheme-gh_129201_gc_mark_pr-3.14.0a4%2B-1b4e8c3-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-1b4e8c3-NOGIL/bm-20250122-vultr-x86_64-nascheme-gh_129201_gc_mark_pr-3.14.0a4%2B-1b4e8c3-vs-base-mem.svg) | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-2ed5ee9) | python/2ed5ee9a50454b3fce87 | 2ed5ee9 | 1.084x ↑
[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.svg) | 1.047x ↑
[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.svg) | | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL) | python/2ed5ee9a50454b3fce87 | 2ed5ee9 (NOGIL) | 1.079x ↓
[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.svg) | 1.109x ↓
[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.svg) | 1.151x ↓
[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-base-mem.svg) | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-dc449a1-NOGIL) | mpage/ft_aa_test_1 | dc449a1 (NOGIL) | 1.079x ↓
[📄](results/bm-20250122-3.14.0a4%2B-dc449a1-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_1-3.14.0a4%2B-dc449a1-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-dc449a1-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_1-3.14.0a4%2B-dc449a1-vs-3.12.6.svg) | 1.109x ↓
[📄](results/bm-20250122-3.14.0a4%2B-dc449a1-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_1-3.14.0a4%2B-dc449a1-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-dc449a1-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_1-3.14.0a4%2B-dc449a1-vs-3.13.0rc2.svg) | 1.002x ↓
[📄](results/bm-20250122-3.14.0a4%2B-dc449a1-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_1-3.14.0a4%2B-dc449a1-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-dc449a1-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_1-3.14.0a4%2B-dc449a1-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-dc449a1-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_1-3.14.0a4%2B-dc449a1-vs-base-mem.svg) | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-fcbf62d-NOGIL) | mpage/ft_aa_test_0 | fcbf62d (NOGIL) | 1.081x ↓
[📄](results/bm-20250122-3.14.0a4%2B-fcbf62d-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_0-3.14.0a4%2B-fcbf62d-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-fcbf62d-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_0-3.14.0a4%2B-fcbf62d-vs-3.12.6.svg) | 1.111x ↓
[📄](results/bm-20250122-3.14.0a4%2B-fcbf62d-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_0-3.14.0a4%2B-fcbf62d-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-fcbf62d-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_0-3.14.0a4%2B-fcbf62d-vs-3.13.0rc2.svg) | 1.001x ↓
[📄](results/bm-20250122-3.14.0a4%2B-fcbf62d-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_0-3.14.0a4%2B-fcbf62d-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-fcbf62d-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_0-3.14.0a4%2B-fcbf62d-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-fcbf62d-NOGIL/bm-20250122-vultr-x86_64-mpage-ft_aa_test_0-3.14.0a4%2B-fcbf62d-vs-base-mem.svg) | | [2025-01-22](results/bm-20250122-3.14.0a4%2B-24c84d8-NOGIL) | python/24c84d816f2f2ecb76b8 | 24c84d8 (NOGIL) | 1.076x ↓
[📄](results/bm-20250122-3.14.0a4%2B-24c84d8-NOGIL/bm-20250122-vultr-x86_64-python-24c84d816f2f2ecb76b8-3.14.0a4%2B-24c84d8-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-24c84d8-NOGIL/bm-20250122-vultr-x86_64-python-24c84d816f2f2ecb76b8-3.14.0a4%2B-24c84d8-vs-3.12.6.svg) | 1.106x ↓
[📄](results/bm-20250122-3.14.0a4%2B-24c84d8-NOGIL/bm-20250122-vultr-x86_64-python-24c84d816f2f2ecb76b8-3.14.0a4%2B-24c84d8-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-24c84d8-NOGIL/bm-20250122-vultr-x86_64-python-24c84d816f2f2ecb76b8-3.14.0a4%2B-24c84d8-vs-3.13.0rc2.svg) | | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL) | colesbury/revert_gh_128914 | 68ce740 (NOGIL) | 1.056x ↓
[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.12.6.svg) | 1.086x ↓
[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.13.0rc2.svg) | 1.025x ↑
[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base-mem.svg) | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-68ce740) | colesbury/revert_gh_128914 | 68ce740 | 1.089x ↑
[📄](results/bm-20250122-3.14.0a4%2B-68ce740/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.12.6.svg) | 1.051x ↑
[📄](results/bm-20250122-3.14.0a4%2B-68ce740/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.13.0rc2.svg) | 1.005x ↑
[📄](results/bm-20250122-3.14.0a4%2B-68ce740/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-68ce740/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base-mem.svg) | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL) | python/86c1a60d5a28cfb51f88 | 86c1a60 (NOGIL) | 1.084x ↓
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.svg) | 1.113x ↓
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.svg) | | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-86c1a60) | python/86c1a60d5a28cfb51f88 | 86c1a60 | 1.089x ↑
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.svg) | 1.051x ↑
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.svg) | 1.001x ↑
[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base-mem.svg) | -| [2025-01-22](results/bm-20250122-3.14.0a4%2B-767cf70) | python/767cf708449fbf13826d | 767cf70 | 1.088x ↑
[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.12.6.svg) | 1.050x ↑
[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.13.0rc2.svg) | 1.004x ↓
[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base-mem.svg) | -| [2025-01-21](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL) | python/01bcf13a1c5bfca5124c | 01bcf13 (NOGIL) | 1.075x ↓
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.12.6.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.12.6.svg) | 1.105x ↓
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13-NOGIL/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.svg) | | -| [2025-01-21](results/bm-20250121-3.14.0a4%2B-01bcf13) | mpage/aa_test_6 | 01bcf13 | 1.087x ↑
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-mpage-aa_test_6-3.14.0a4%2B-01bcf13-vs-3.12.6.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-mpage-aa_test_6-3.14.0a4%2B-01bcf13-vs-3.12.6.svg) | 1.049x ↑
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-mpage-aa_test_6-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-mpage-aa_test_6-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.svg) | 1.006x ↓
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-mpage-aa_test_6-3.14.0a4%2B-01bcf13-vs-base.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-mpage-aa_test_6-3.14.0a4%2B-01bcf13-vs-base.svg)[🧠](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-mpage-aa_test_6-3.14.0a4%2B-01bcf13-vs-base-mem.svg) | -| [2025-01-21](results/bm-20250121-3.14.0a4%2B-01bcf13) | python/01bcf13a1c5bfca5124c | 01bcf13 | 1.093x ↑
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.12.6.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.12.6.svg) | 1.054x ↑
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-3.13.0rc2.svg) | 1.002x ↓
[📄](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-base.md)[📈](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-base.svg)[🧠](results/bm-20250121-3.14.0a4%2B-01bcf13/bm-20250121-vultr-x86_64-python-01bcf13a1c5bfca5124c-3.14.0a4%2B-01bcf13-vs-base-mem.svg) | -| [2025-01-21](results/bm-20250121-3.14.0a4%2B-2ea0525) | mpage/aa_test_5 | 2ea0525 | 1.089x ↑
[📄](results/bm-20250121-3.14.0a4%2B-2ea0525/bm-20250121-vultr-x86_64-mpage-aa_test_5-3.14.0a4%2B-2ea0525-vs-3.12.6.md)[📈](results/bm-20250121-3.14.0a4%2B-2ea0525/bm-20250121-vultr-x86_64-mpage-aa_test_5-3.14.0a4%2B-2ea0525-vs-3.12.6.svg) | 1.051x ↑
[📄](results/bm-20250121-3.14.0a4%2B-2ea0525/bm-20250121-vultr-x86_64-mpage-aa_test_5-3.14.0a4%2B-2ea0525-vs-3.13.0rc2.md)[📈](results/bm-20250121-3.14.0a4%2B-2ea0525/bm-20250121-vultr-x86_64-mpage-aa_test_5-3.14.0a4%2B-2ea0525-vs-3.13.0rc2.svg) | 1.001x ↑
[📄](results/bm-20250121-3.14.0a4%2B-2ea0525/bm-20250121-vultr-x86_64-mpage-aa_test_5-3.14.0a4%2B-2ea0525-vs-base.md)[📈](results/bm-20250121-3.14.0a4%2B-2ea0525/bm-20250121-vultr-x86_64-mpage-aa_test_5-3.14.0a4%2B-2ea0525-vs-base.svg)[🧠](results/bm-20250121-3.14.0a4%2B-2ea0525/bm-20250121-vultr-x86_64-mpage-aa_test_5-3.14.0a4%2B-2ea0525-vs-base-mem.svg) | -| [2025-01-21](results/bm-20250121-3.14.0a4%2B-29caec6) | python/29caec62ee0650493c83 | 29caec6 | 1.094x ↑
[📄](results/bm-20250121-3.14.0a4%2B-29caec6/bm-20250121-vultr-x86_64-python-29caec62ee0650493c83-3.14.0a4%2B-29caec6-vs-3.12.6.md)[📈](results/bm-20250121-3.14.0a4%2B-29caec6/bm-20250121-vultr-x86_64-python-29caec62ee0650493c83-3.14.0a4%2B-29caec6-vs-3.12.6.svg) | 1.056x ↑
[📄](results/bm-20250121-3.14.0a4%2B-29caec6/bm-20250121-vultr-x86_64-python-29caec62ee0650493c83-3.14.0a4%2B-29caec6-vs-3.13.0rc2.md)[📈](results/bm-20250121-3.14.0a4%2B-29caec6/bm-20250121-vultr-x86_64-python-29caec62ee0650493c83-3.14.0a4%2B-29caec6-vs-3.13.0rc2.svg) | | -| [2025-01-20](results/bm-20250120-3.14.0a4%2B-e54ac3b-NOGIL) | python/e54ac3b69edacf414998 | e54ac3b (NOGIL) | 1.083x ↓
[📄](results/bm-20250120-3.14.0a4%2B-e54ac3b-NOGIL/bm-20250120-vultr-x86_64-python-e54ac3b69edacf414998-3.14.0a4%2B-e54ac3b-vs-3.12.6.md)[📈](results/bm-20250120-3.14.0a4%2B-e54ac3b-NOGIL/bm-20250120-vultr-x86_64-python-e54ac3b69edacf414998-3.14.0a4%2B-e54ac3b-vs-3.12.6.svg) | 1.113x ↓
[📄](results/bm-20250120-3.14.0a4%2B-e54ac3b-NOGIL/bm-20250120-vultr-x86_64-python-e54ac3b69edacf414998-3.14.0a4%2B-e54ac3b-vs-3.13.0rc2.md)[📈](results/bm-20250120-3.14.0a4%2B-e54ac3b-NOGIL/bm-20250120-vultr-x86_64-python-e54ac3b69edacf414998-3.14.0a4%2B-e54ac3b-vs-3.13.0rc2.svg) | | | [2025-01-17](results/bm-20250117-3.14.0a4%2B-3829104-NOGIL) | python/3829104ab412a47bf3f3 | 3829104 (NOGIL) | 1.060x ↓
[📄](results/bm-20250117-3.14.0a4%2B-3829104-NOGIL/bm-20250117-vultr-x86_64-python-3829104ab412a47bf3f3-3.14.0a4%2B-3829104-vs-3.12.6.md)[📈](results/bm-20250117-3.14.0a4%2B-3829104-NOGIL/bm-20250117-vultr-x86_64-python-3829104ab412a47bf3f3-3.14.0a4%2B-3829104-vs-3.12.6.svg) | 1.090x ↓
[📄](results/bm-20250117-3.14.0a4%2B-3829104-NOGIL/bm-20250117-vultr-x86_64-python-3829104ab412a47bf3f3-3.14.0a4%2B-3829104-vs-3.13.0rc2.md)[📈](results/bm-20250117-3.14.0a4%2B-3829104-NOGIL/bm-20250117-vultr-x86_64-python-3829104ab412a47bf3f3-3.14.0a4%2B-3829104-vs-3.13.0rc2.svg) | | diff --git a/RESULTS.md b/RESULTS.md index 74a9c5f4..ae7b4bed 100644 --- a/RESULTS.md +++ b/RESULTS.md @@ -6,6 +6,8 @@ ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2025-01-25](results/bm-20250125-3.14.0a4%2B-3f2cfd0) | python/3f2cfd0462e13368092a | 3f2cfd0 | 1.072x ↑
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) | 1.030x ↑
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) | | +| [2025-01-25](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL) | python/3f2cfd0462e13368092a | 3f2cfd0 (NOGIL) | 1.102x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) | 1.135x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) | 1.158x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.svg)[🧠](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base-mem.svg) | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-9abbb58) | python/9abbb58e3f023555473d | 9abbb58 | 1.066x ↑
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.svg) | 1.021x ↑
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.svg) | | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL) | python/9abbb58e3f023555473d | 9abbb58 (NOGIL) | 1.081x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.svg) | 1.114x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.svg) | 1.133x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base.svg)[🧠](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base-mem.svg) | | [2025-01-23](results/bm-20250123-3.14.0a4%2B-732670d) | python/732670d93b9b0c0ff8ad | 732670d | 1.068x ↑
[📄](results/bm-20250123-3.14.0a4%2B-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4%2B-732670d-vs-3.12.6.md)[📈](results/bm-20250123-3.14.0a4%2B-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4%2B-732670d-vs-3.12.6.svg) | 1.030x ↑
[📄](results/bm-20250123-3.14.0a4%2B-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4%2B-732670d-vs-3.13.0rc2.md)[📈](results/bm-20250123-3.14.0a4%2B-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4%2B-732670d-vs-3.13.0rc2.svg) | | @@ -287,6 +289,8 @@ ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2025-01-25](results/bm-20250125-3.14.0a4%2B-3f2cfd0) | python/3f2cfd0462e13368092a | 3f2cfd0 | 1.088x ↑
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) | 1.050x ↑
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) | | +| [2025-01-25](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL) | python/3f2cfd0462e13368092a | 3f2cfd0 (NOGIL) | 1.058x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) | 1.088x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) | 1.135x ↓
[📄](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.md)[📈](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.svg)[🧠](results/bm-20250125-3.14.0a4%2B-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base-mem.svg) | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-9abbb58) | python/9abbb58e3f023555473d | 9abbb58 | 1.089x ↑
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.svg) | 1.051x ↑
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.svg) | | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL) | python/9abbb58e3f023555473d | 9abbb58 (NOGIL) | 1.063x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.12.6.svg) | 1.094x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-3.13.0rc2.svg) | 1.140x ↓
[📄](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base.md)[📈](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base.svg)[🧠](results/bm-20250124-3.14.0a4%2B-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4%2B-9abbb58-vs-base-mem.svg) | | [2025-01-24](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL) | faster-cpython/remove_most_conditio | 1e0f842 (NOGIL) | 1.053x ↓
[📄](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-3.12.6.md)[📈](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-3.12.6.svg) | 1.083x ↓
[📄](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-3.13.0rc2.md)[📈](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-3.13.0rc2.svg) | 1.010x ↑
[📄](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-base.md)[📈](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-base.svg)[🧠](results/bm-20250124-3.14.0a4%2B-1e0f842-NOGIL/bm-20250124-vultr-x86_64-faster%252dcpython-remove_most_conditio-3.14.0a4%2B-1e0f842-vs-base-mem.svg) | diff --git a/configs.json b/configs.json index 23213b75..b3273227 100644 --- a/configs.json +++ b/configs.json @@ -227,5 +227,7 @@ "bm-20250123-3.14.0a4+-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json,bm-20250123-3.14.0a4+-732670d-NOGIL/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json": 0.8732756812202237, "bm-20250123-3.14.0a4+-732670d/bm-20250123-vultr-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json,bm-20250123-3.14.0a4+-732670d-NOGIL/bm-20250123-vultr-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json": 0.85442489306087, "bm-20250124-3.14.0a4+-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,bm-20250124-3.14.0a4+-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json": 0.8670613998359655, - "bm-20250124-3.14.0a4+-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,bm-20250124-3.14.0a4+-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json": 0.8598039754333389 + "bm-20250124-3.14.0a4+-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,bm-20250124-3.14.0a4+-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json": 0.8598039754333389, + "bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json,bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json": 0.8421770201473499, + "bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json,bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json": 0.8648341240795506 } \ No newline at end of file diff --git a/configs.svg b/configs.svg index c5937082..35ace608 100644 --- a/configs.svg +++ b/configs.svg @@ -5,8 +5,8 @@ - - + + @@ -20,9 +20,9 @@ - - - + + + @@ -30,9 +30,9 @@ - - - + + + @@ -40,9 +40,9 @@ - - - + + + @@ -50,9 +50,9 @@ - - - + + + @@ -60,9 +60,9 @@ - - - + + + @@ -70,7 +70,7 @@ - + @@ -85,7 +85,7 @@ - + @@ -94,7 +94,7 @@ - + @@ -103,7 +103,7 @@ - + @@ -112,7 +112,7 @@ - + @@ -121,7 +121,7 @@ - + @@ -131,10 +131,10 @@ - - - - + + + + @@ -155,7 +155,7 @@ - + @@ -173,7 +173,7 @@ - + @@ -250,10 +250,10 @@ - - - - + + + + @@ -265,8 +265,8 @@ - - + + @@ -280,7 +280,7 @@ - + @@ -291,7 +291,7 @@ - + @@ -302,7 +302,7 @@ - + @@ -313,7 +313,7 @@ - + @@ -327,7 +327,7 @@ - + @@ -337,7 +337,7 @@ - + @@ -346,7 +346,7 @@ - + @@ -358,7 +358,7 @@ - + @@ -367,7 +367,7 @@ - + @@ -376,7 +376,7 @@ - + @@ -385,249 +385,251 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - - - + + + @@ -652,7 +654,7 @@ - + @@ -731,50 +733,50 @@ - - + + - - - + + + - - - + + + - - - + + + - - - + + + - - - + + + - + @@ -783,7 +785,7 @@ - + @@ -792,7 +794,7 @@ - + @@ -801,7 +803,7 @@ - + @@ -810,7 +812,7 @@ - + @@ -819,7 +821,7 @@ - + @@ -829,10 +831,10 @@ - - - - + + + + @@ -844,7 +846,7 @@ - + @@ -856,7 +858,7 @@ - + @@ -949,14 +951,14 @@ - - + + - + - - + + diff --git a/longitudinal.json b/longitudinal.json index 31a89b43..3f990186 100644 --- a/longitudinal.json +++ b/longitudinal.json @@ -269,5 +269,7 @@ "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250123-3.14.0a4+-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json,3.13.0rc2": 1.0298501512662417, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250123-3.14.0a4+-732670d/bm-20250123-vultr-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json,3.13.0rc2": 1.0551630667317058, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250124-3.14.0a4+-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,3.13.0rc2": 1.0205098778682251, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250124-3.14.0a4+-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,3.13.0rc2": 1.049743399303183 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250124-3.14.0a4+-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,3.13.0rc2": 1.049743399303183, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json,3.13.0rc2": 1.0296597874012765, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json,3.13.0rc2": 1.0487584413892552 } \ No newline at end of file diff --git a/longitudinal.svg b/longitudinal.svg index 173b9045..274fc5db 100644 --- a/longitudinal.svg +++ b/longitudinal.svg @@ -5,13 +5,13 @@ - - + + - - + + @@ -31,9 +31,9 @@ - - - + + + @@ -48,8 +48,8 @@ - - + + @@ -62,9 +62,9 @@ - - - + + + @@ -79,9 +79,9 @@ - - - + + + @@ -93,9 +93,9 @@ - - - + + + @@ -110,9 +110,9 @@ - - - + + + @@ -124,9 +124,9 @@ - - - + + + @@ -141,9 +141,9 @@ - - - + + + @@ -155,7 +155,7 @@ - + @@ -171,7 +171,7 @@ - + @@ -180,7 +180,7 @@ - + @@ -189,7 +189,7 @@ - + @@ -198,7 +198,7 @@ - + @@ -207,7 +207,7 @@ - + @@ -216,7 +216,7 @@ - + @@ -225,7 +225,7 @@ - + @@ -234,7 +234,7 @@ - + @@ -246,36 +246,36 @@ - + - - - + + + - + - - + + - - - - - + + + + + - - + + @@ -322,7 +322,7 @@ - + - - - - + + + + @@ -397,8 +397,8 @@ - - + + @@ -409,7 +409,7 @@ - + @@ -420,7 +420,7 @@ - + @@ -431,7 +431,7 @@ - + @@ -442,7 +442,7 @@ - + @@ -453,7 +453,7 @@ - + @@ -463,7 +463,7 @@ - + @@ -472,7 +472,7 @@ - + @@ -481,7 +481,7 @@ - + @@ -490,7 +490,7 @@ - + @@ -499,7 +499,7 @@ - + @@ -508,7 +508,7 @@ - + @@ -517,7 +517,7 @@ - + @@ -526,7 +526,7 @@ - + @@ -535,7 +535,7 @@ - + @@ -545,263 +545,265 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - - - - - + + + + + @@ -829,7 +831,7 @@ - + @@ -932,10 +934,10 @@ - + - + diff --git a/memory_configs.json b/memory_configs.json index 0612d7e0..28edda28 100644 --- a/memory_configs.json +++ b/memory_configs.json @@ -227,5 +227,7 @@ "bm-20250123-3.14.0a4+-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json,bm-20250123-3.14.0a4+-732670d-NOGIL/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json": 1.19, "bm-20250123-3.14.0a4+-732670d/bm-20250123-vultr-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json,bm-20250123-3.14.0a4+-732670d-NOGIL/bm-20250123-vultr-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json": 1.2, "bm-20250124-3.14.0a4+-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,bm-20250124-3.14.0a4+-9abbb58-NOGIL/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json": 1.19, - "bm-20250124-3.14.0a4+-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,bm-20250124-3.14.0a4+-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json": 1.2 + "bm-20250124-3.14.0a4+-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,bm-20250124-3.14.0a4+-9abbb58-NOGIL/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json": 1.2, + "bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json,bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json": 1.19, + "bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json,bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json": 1.2 } \ No newline at end of file diff --git a/memory_configs.svg b/memory_configs.svg index 1b8ce676..f2441e9e 100644 --- a/memory_configs.svg +++ b/memory_configs.svg @@ -5,7 +5,7 @@ - + @@ -20,9 +20,9 @@ - - - + + + @@ -30,9 +30,9 @@ - - - + + + @@ -40,9 +40,9 @@ - - - + + + @@ -50,9 +50,9 @@ - - - + + + @@ -60,9 +60,9 @@ - - - + + + @@ -70,7 +70,7 @@ - + @@ -85,7 +85,7 @@ - + @@ -94,7 +94,7 @@ - + @@ -103,7 +103,7 @@ - + @@ -112,7 +112,7 @@ - + @@ -121,7 +121,7 @@ - + @@ -131,9 +131,9 @@ - - - + + + @@ -166,7 +166,7 @@ - + @@ -246,10 +246,10 @@ - - - - + + + + @@ -261,8 +261,8 @@ - - + + @@ -276,7 +276,7 @@ - + @@ -287,7 +287,7 @@ - + @@ -298,7 +298,7 @@ - + @@ -309,7 +309,7 @@ - + @@ -323,7 +323,7 @@ - + @@ -333,7 +333,7 @@ - + @@ -342,7 +342,7 @@ - + @@ -351,7 +351,7 @@ - + @@ -360,7 +360,7 @@ - + @@ -369,7 +369,7 @@ - + @@ -378,7 +378,7 @@ - + @@ -387,7 +387,7 @@ - + @@ -396,7 +396,7 @@ - + @@ -405,7 +405,7 @@ - + @@ -417,249 +417,251 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - - - + + + @@ -680,7 +682,7 @@ - + @@ -759,7 +761,7 @@ - + @@ -767,42 +769,42 @@ - - - + + + - - - + + + - - - + + + - - - + + + - - - + + + - + @@ -811,7 +813,7 @@ - + @@ -820,7 +822,7 @@ - + @@ -829,7 +831,7 @@ - + @@ -838,7 +840,7 @@ - + @@ -847,7 +849,7 @@ - + @@ -857,9 +859,9 @@ - - - + + + @@ -880,7 +882,7 @@ - + @@ -969,13 +971,13 @@ - + - + - + diff --git a/memory_long.json b/memory_long.json index cf1492f0..b069a784 100644 --- a/memory_long.json +++ b/memory_long.json @@ -269,5 +269,7 @@ "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250123-3.14.0a4+-732670d/bm-20250123-linux-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json,3.13.0rc2": 1.13, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250123-3.14.0a4+-732670d/bm-20250123-vultr-x86_64-python-732670d93b9b0c0ff8ad-3.14.0a4+-732670d.json,3.13.0rc2": 1.1, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250124-3.14.0a4+-9abbb58/bm-20250124-linux-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,3.13.0rc2": 1.3, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250124-3.14.0a4+-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,3.13.0rc2": 1.29 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250124-3.14.0a4+-9abbb58/bm-20250124-vultr-x86_64-python-9abbb58e3f023555473d-3.14.0a4+-9abbb58.json,3.13.0rc2": 1.29, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json,3.13.0rc2": 1.13, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json,3.13.0rc2": 1.1 } \ No newline at end of file diff --git a/memory_long.svg b/memory_long.svg index 25e1fb2e..02d123c2 100644 --- a/memory_long.svg +++ b/memory_long.svg @@ -5,13 +5,13 @@ - - + + - - + + @@ -31,9 +31,9 @@ - - - + + + @@ -48,8 +48,8 @@ - - + + @@ -62,9 +62,9 @@ - - - + + + @@ -79,9 +79,9 @@ - - - + + + @@ -93,9 +93,9 @@ - - - + + + @@ -110,9 +110,9 @@ - - - + + + @@ -124,9 +124,9 @@ - - - + + + @@ -141,9 +141,9 @@ - - - + + + @@ -155,7 +155,7 @@ - + @@ -171,7 +171,7 @@ - + @@ -180,7 +180,7 @@ - + @@ -189,7 +189,7 @@ - + @@ -198,7 +198,7 @@ - + @@ -207,7 +207,7 @@ - + @@ -216,7 +216,7 @@ - + @@ -225,7 +225,7 @@ - + @@ -234,7 +234,7 @@ - + @@ -246,36 +246,36 @@ - + - - - + + + - + - - + + - - - - - + + + + + - - + + @@ -315,7 +315,7 @@ - + @@ -379,10 +379,10 @@ - - - - + + + + @@ -391,8 +391,8 @@ - - + + @@ -403,7 +403,7 @@ - + @@ -414,7 +414,7 @@ - + @@ -425,7 +425,7 @@ - + @@ -436,7 +436,7 @@ - + @@ -447,7 +447,7 @@ - + @@ -457,7 +457,7 @@ - + @@ -466,7 +466,7 @@ - + @@ -475,7 +475,7 @@ - + @@ -484,7 +484,7 @@ - + @@ -493,7 +493,7 @@ - + @@ -502,7 +502,7 @@ - + @@ -511,7 +511,7 @@ - + @@ -521,262 +521,264 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - - - - - + + + + + @@ -803,7 +805,7 @@ - + @@ -902,10 +904,10 @@ - + - + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/README.md b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/README.md new file mode 100644 index 00000000..9bc4debe --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/README.md @@ -0,0 +1,77 @@ +# Results + +- fork: python/3f2cfd0462e13368092a +- version: 3.14.0a4+ +- config: NOGIL +- commit hash: [3f2cfd0](https://github.com/python/cpython/commit/3f2cfd0) +- commit date: 2025-01-25T23:50:09+05:30 +- commit merge base: [be98fda7c6698e8468afd528c864aca1f532af59](https://github.com/python/cpython/commit/be98fda7c6698e8468afd528c864aca1f532af59) +- ref: 3f2cfd0462e13368092a + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12969596525) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0.json) + +### vs. 3.12.6 + +- Geometric mean: 1.102x slower (HPT: reliability of 100.00%, 1.04x slower at 99th %ile) +- Memory usage: 1.34x +- missing benchmarks: aiohttp, chameleon, dask, flaskblogging, gunicorn, mypy2, tornado_http +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md) +- [📈time plot](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.135x slower (HPT: reliability of 100.00%, 1.08x slower at 99th %ile) +- Memory usage: 1.34x +- missing benchmarks: aiohttp, chameleon, dask, flaskblogging, gunicorn, tornado_http +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md) +- [📈time plot](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.158x slower (HPT: reliability of 100.00%, 1.15x slower at 99th %ile) +- Memory usage: 1.19x +- [🧠memory plot](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base-mem.svg) +- [📄table](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.md) +- [📈time plot](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12969596525) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-51-generic-x86_64-with-glibc2.39 +- [raw results](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0.json) + +### vs. 3.12.6 + +- Geometric mean: 1.058x slower (HPT: reliability of 99.96%, 1.03x slower at 99th %ile) +- Memory usage: 1.36x +- missing benchmarks: aiohttp, chameleon, dask, flaskblogging, gunicorn, mypy2, tornado_http +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md) +- [📈time plot](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.088x slower (HPT: reliability of 100.00%, 1.05x slower at 99th %ile) +- Memory usage: 1.34x +- missing benchmarks: aiohttp, chameleon, dask, flaskblogging, gunicorn, tornado_http +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md) +- [📈time plot](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.135x slower (HPT: reliability of 100.00%, 1.12x slower at 99th %ile) +- Memory usage: 1.20x +- new benchmarks: html5lib +- [🧠memory plot](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base-mem.svg) +- [📄table](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.md) +- [📈time plot](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-base.svg) + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md new file mode 100644 index 00000000..716c4311 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md @@ -0,0 +1,217 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.102x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.04x slower +- Memory change: 1.34x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 570 ms: 1.25x slower | +| docutils | 4.00 sec | 4.20 sec: 1.05x slower | +| html5lib | 88.9 ms | 118 ms: 1.33x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 896 ms: 2.16x faster | +| async_tree_io | 1.85 sec | 892 ms: 2.07x faster | +| async_tree_memoization | 977 ms | 567 ms: 1.72x faster | +| async_tree_memoization_tg | 930 ms | 541 ms: 1.72x faster | +| async_tree_none_tg | 704 ms | 414 ms: 1.70x faster | +| async_tree_none | 741 ms | 454 ms: 1.64x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 703 ms: 1.56x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 825 ms: 1.31x faster | +| async_generators | 589 ms | 619 ms: 1.05x slower | +| asyncio_tcp | 923 ms | 1.05 sec: 1.14x slower | +| coroutines | 29.5 ms | 34.8 ms: 1.18x slower | +| asyncio_tcp_ssl | 2.81 sec | 3.44 sec: 1.22x slower | +| Geometric mean | (ref) | 1.34x faster | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 123 ms | 117 ms: 1.06x faster | +| pidigits | 250 ms | 239 ms: 1.04x faster | +| nbody | 119 ms | 198 ms: 1.66x slower | +| Geometric mean | (ref) | 1.15x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.79 ms: 1.07x faster | +| regex_compile | 187 ms | 201 ms: 1.07x slower | +| regex_dna | 278 ms | 304 ms: 1.09x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (1): regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pickle_dict | 52.7 us | 47.4 us: 1.11x faster | +| xml_etree_parse | 241 ms | 225 ms: 1.07x faster | +| xml_etree_iterparse | 169 ms | 158 ms: 1.07x faster | +| tomli_loads | 2.88 sec | 3.04 sec: 1.05x slower | +| unpickle_list | 6.83 us | 7.71 us: 1.13x slower | +| json_dumps | 14.3 ms | 16.9 ms: 1.18x slower | +| xml_etree_generate | 127 ms | 150 ms: 1.18x slower | +| xml_etree_process | 83.7 ms | 98.9 ms: 1.18x slower | +| unpickle_pure_python | 300 us | 359 us: 1.20x slower | +| pickle_pure_python | 436 us | 548 us: 1.26x slower | +| json_loads | 37.9 us | 47.8 us: 1.26x slower | +| Geometric mean | (ref) | 1.08x slower | + +Benchmark hidden because not significant (3): pickle, unpickle, pickle_list + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 23.1 ms: 1.31x slower | +| python_startup | 23.7 ms | 36.0 ms: 1.52x slower | +| Geometric mean | (ref) | 1.41x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| django_template | 44.9 ms | 59.6 ms: 1.33x slower | +| genshi_text | 30.2 ms | 42.4 ms: 1.40x slower | +| genshi_xml | 67.6 ms | 101 ms: 1.49x slower | +| mako | 15.7 ms | 24.8 ms: 1.58x slower | +| Geometric mean | (ref) | 1.45x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 896 ms: 2.16x faster | +| async_tree_io | 1.85 sec | 892 ms: 2.07x faster | +| async_tree_memoization | 977 ms | 567 ms: 1.72x faster | +| async_tree_memoization_tg | 930 ms | 541 ms: 1.72x faster | +| async_tree_none_tg | 704 ms | 414 ms: 1.70x faster | +| async_tree_none | 741 ms | 454 ms: 1.64x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 703 ms: 1.56x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 825 ms: 1.31x faster | +| pickle_dict | 52.7 us | 47.4 us: 1.11x faster | +| deepcopy | 468 us | 429 us: 1.09x faster | +| pycparser | 1.79 sec | 1.64 sec: 1.09x faster | +| regex_effbot | 5.13 ms | 4.79 ms: 1.07x faster | +| xml_etree_parse | 241 ms | 225 ms: 1.07x faster | +| xml_etree_iterparse | 169 ms | 158 ms: 1.07x faster | +| float | 123 ms | 117 ms: 1.06x faster | +| pidigits | 250 ms | 239 ms: 1.04x faster | +| docutils | 4.00 sec | 4.20 sec: 1.05x slower | +| async_generators | 589 ms | 619 ms: 1.05x slower | +| tomli_loads | 2.88 sec | 3.04 sec: 1.05x slower | +| nqueens | 117 ms | 123 ms: 1.06x slower | +| pyflate | 727 ms | 771 ms: 1.06x slower | +| pathlib | 31.6 ms | 33.6 ms: 1.06x slower | +| mdp | 3.97 sec | 4.25 sec: 1.07x slower | +| regex_compile | 187 ms | 201 ms: 1.07x slower | +| scimark_sor | 167 ms | 180 ms: 1.08x slower | +| spectral_norm | 156 ms | 168 ms: 1.08x slower | +| regex_dna | 278 ms | 304 ms: 1.09x slower | +| sqlalchemy_declarative | 218 ms | 239 ms: 1.10x slower | +| dulwich_log | 100 ms | 111 ms: 1.11x slower | +| sympy_str | 385 ms | 428 ms: 1.11x slower | +| logging_silent | 139 ns | 156 ns: 1.12x slower | +| unpickle_list | 6.83 us | 7.71 us: 1.13x slower | +| scimark_fft | 500 ms | 571 ms: 1.14x slower | +| comprehensions | 27.1 us | 31.0 us: 1.14x slower | +| asyncio_tcp | 923 ms | 1.05 sec: 1.14x slower | +| deepcopy_memo | 52.4 us | 60.4 us: 1.15x slower | +| scimark_lu | 152 ms | 176 ms: 1.16x slower | +| sympy_sum | 222 ms | 259 ms: 1.17x slower | +| raytrace | 408 ms | 478 ms: 1.17x slower | +| richards_super | 72.8 ms | 85.5 ms: 1.17x slower | +| json_dumps | 14.3 ms | 16.9 ms: 1.18x slower | +| xml_etree_generate | 127 ms | 150 ms: 1.18x slower | +| coroutines | 29.5 ms | 34.8 ms: 1.18x slower | +| xml_etree_process | 83.7 ms | 98.9 ms: 1.18x slower | +| pprint_safe_repr | 967 ms | 1.14 sec: 1.18x slower | +| generators | 41.1 ms | 49.3 ms: 1.20x slower | +| unpickle_pure_python | 300 us | 359 us: 1.20x slower | +| logging_format | 9.59 us | 11.5 us: 1.20x slower | +| sympy_expand | 582 ms | 706 ms: 1.21x slower | +| crypto_pyaes | 107 ms | 131 ms: 1.22x slower | +| asyncio_tcp_ssl | 2.81 sec | 3.44 sec: 1.22x slower | +| sqlglot_optimize | 76.0 ms | 93.3 ms: 1.23x slower | +| typing_runtime_protocols | 224 us | 276 us: 1.23x slower | +| 2to3 | 456 ms | 570 ms: 1.25x slower | +| pprint_pformat | 1.98 sec | 2.47 sec: 1.25x slower | +| bpe_tokeniser | 6.59 sec | 8.26 sec: 1.25x slower | +| pickle_pure_python | 436 us | 548 us: 1.26x slower | +| json_loads | 37.9 us | 47.8 us: 1.26x slower | +| gc_traversal | 5.86 ms | 7.46 ms: 1.27x slower | +| fannkuch | 540 ms | 692 ms: 1.28x slower | +| go | 172 ms | 224 ms: 1.30x slower | +| python_startup_no_site | 17.6 ms | 23.1 ms: 1.31x slower | +| meteor_contest | 146 ms | 192 ms: 1.31x slower | +| bench_thread_pool | 3.48 ms | 4.58 ms: 1.32x slower | +| unpack_sequence | 60.2 ns | 79.7 ns: 1.32x slower | +| scimark_sparse_mat_mult | 6.70 ms | 8.88 ms: 1.33x slower | +| django_template | 44.9 ms | 59.6 ms: 1.33x slower | +| html5lib | 88.9 ms | 118 ms: 1.33x slower | +| sqlglot_transpile | 2.34 ms | 3.12 ms: 1.33x slower | +| sympy_integrate | 29.8 ms | 39.9 ms: 1.34x slower | +| deepcopy_reduce | 4.04 us | 5.46 us: 1.35x slower | +| json | 6.85 ms | 9.28 ms: 1.36x slower | +| thrift | 1.06 ms | 1.45 ms: 1.37x slower | +| sqlglot_parse | 1.79 ms | 2.46 ms: 1.38x slower | +| telco | 9.59 ms | 13.3 ms: 1.39x slower | +| chaos | 84.9 ms | 118 ms: 1.40x slower | +| richards | 60.3 ms | 84.3 ms: 1.40x slower | +| scimark_monte_carlo | 96.4 ms | 135 ms: 1.40x slower | +| genshi_text | 30.2 ms | 42.4 ms: 1.40x slower | +| genshi_xml | 67.6 ms | 101 ms: 1.49x slower | +| python_startup | 23.7 ms | 36.0 ms: 1.52x slower | +| logging_simple | 9.45 us | 14.6 us: 1.55x slower | +| hexiom | 8.27 ms | 12.8 ms: 1.55x slower | +| sqlalchemy_imperative | 24.7 ms | 38.6 ms: 1.56x slower | +| mako | 15.7 ms | 24.8 ms: 1.58x slower | +| coverage | 95.4 ms | 154 ms: 1.61x slower | +| create_gc_cycles | 1.94 ms | 3.21 ms: 1.66x slower | +| nbody | 119 ms | 198 ms: 1.66x slower | +| deltablue | 4.27 ms | 7.27 ms: 1.70x slower | +| bench_mp_pool | 20.7 ms | 105 ms: 5.09x slower | +| Geometric mean | (ref) | 1.15x slower | + +Benchmark hidden because not significant (8): pickle, unpickle, sqlite_synth, asyncio_websockets, pylint, regex_v8, pickle_list, sqlglot_normalize +Ignored benchmarks (7) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, mypy2, tornado_http +Ignored benchmarks (6) of results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.102x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.08x +- 95% likely to have a slowdown of 1.06x +- 99% likely to have a slowdown of 1.04x + +# Memory +- memory change: 1.34x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg new file mode 100644 index 00000000..851e3779 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg @@ -0,0 +1,3068 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md new file mode 100644 index 00000000..159e1d6b --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md @@ -0,0 +1,207 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.135x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.08x slower +- Memory change: 1.34x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 445 ms | 570 ms: 1.28x slower | +| docutils | 4.01 sec | 4.20 sec: 1.05x slower | +| html5lib | 92.6 ms | 118 ms: 1.28x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 896 ms: 1.56x faster | +| async_tree_io | 1.39 sec | 892 ms: 1.56x faster | +| async_tree_none | 572 ms | 454 ms: 1.26x faster | +| async_tree_memoization | 709 ms | 567 ms: 1.25x faster | +| async_tree_memoization_tg | 670 ms | 541 ms: 1.24x faster | +| async_tree_none_tg | 504 ms | 414 ms: 1.22x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 703 ms: 1.21x faster | +| async_tree_cpu_io_mixed | 889 ms | 825 ms: 1.08x faster | +| async_generators | 567 ms | 619 ms: 1.09x slower | +| asyncio_tcp | 948 ms | 1.05 sec: 1.11x slower | +| coroutines | 30.9 ms | 34.8 ms: 1.13x slower | +| asyncio_tcp_ssl | 2.77 sec | 3.44 sec: 1.24x slower | +| Geometric mean | (ref) | 1.12x faster | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| nbody | 119 ms | 198 ms: 1.67x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmark hidden because not significant (2): pidigits, float + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_dna | 282 ms | 304 ms: 1.08x slower | +| regex_compile | 182 ms | 201 ms: 1.10x slower | +| Geometric mean | (ref) | 1.05x slower | + +Benchmark hidden because not significant (2): regex_effbot, regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 177 ms | 158 ms: 1.12x faster | +| tomli_loads | 2.78 sec | 3.04 sec: 1.09x slower | +| xml_etree_process | 85.9 ms | 98.9 ms: 1.15x slower | +| unpickle_list | 6.68 us | 7.71 us: 1.15x slower | +| json_dumps | 14.1 ms | 16.9 ms: 1.19x slower | +| xml_etree_generate | 122 ms | 150 ms: 1.22x slower | +| unpickle_pure_python | 290 us | 359 us: 1.24x slower | +| pickle_pure_python | 416 us | 548 us: 1.32x slower | +| json_loads | 34.3 us | 47.8 us: 1.39x slower | +| Geometric mean | (ref) | 1.12x slower | + +Benchmark hidden because not significant (5): xml_etree_parse, pickle_dict, unpickle, pickle, pickle_list + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 23.1 ms: 1.51x slower | +| python_startup | 22.4 ms | 36.0 ms: 1.61x slower | +| Geometric mean | (ref) | 1.56x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 31.7 ms | 42.4 ms: 1.34x slower | +| django_template | 44.3 ms | 59.6 ms: 1.35x slower | +| genshi_xml | 72.1 ms | 101 ms: 1.40x slower | +| mako | 15.9 ms | 24.8 ms: 1.56x slower | +| Geometric mean | (ref) | 1.41x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 896 ms: 1.56x faster | +| async_tree_io | 1.39 sec | 892 ms: 1.56x faster | +| async_tree_none | 572 ms | 454 ms: 1.26x faster | +| async_tree_memoization | 709 ms | 567 ms: 1.25x faster | +| async_tree_memoization_tg | 670 ms | 541 ms: 1.24x faster | +| async_tree_none_tg | 504 ms | 414 ms: 1.22x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 703 ms: 1.21x faster | +| deepcopy | 498 us | 429 us: 1.16x faster | +| xml_etree_iterparse | 177 ms | 158 ms: 1.12x faster | +| async_tree_cpu_io_mixed | 889 ms | 825 ms: 1.08x faster | +| pycparser | 1.57 sec | 1.64 sec: 1.05x slower | +| docutils | 4.01 sec | 4.20 sec: 1.05x slower | +| unpack_sequence | 74.3 ns | 79.7 ns: 1.07x slower | +| spectral_norm | 157 ms | 168 ms: 1.07x slower | +| regex_dna | 282 ms | 304 ms: 1.08x slower | +| async_generators | 567 ms | 619 ms: 1.09x slower | +| tomli_loads | 2.78 sec | 3.04 sec: 1.09x slower | +| telco | 12.2 ms | 13.3 ms: 1.09x slower | +| regex_compile | 182 ms | 201 ms: 1.10x slower | +| nqueens | 112 ms | 123 ms: 1.10x slower | +| asyncio_tcp | 948 ms | 1.05 sec: 1.11x slower | +| mdp | 3.80 sec | 4.25 sec: 1.12x slower | +| pathlib | 29.9 ms | 33.6 ms: 1.12x slower | +| coroutines | 30.9 ms | 34.8 ms: 1.13x slower | +| sympy_str | 379 ms | 428 ms: 1.13x slower | +| xml_etree_process | 85.9 ms | 98.9 ms: 1.15x slower | +| unpickle_list | 6.68 us | 7.71 us: 1.15x slower | +| pprint_safe_repr | 987 ms | 1.14 sec: 1.16x slower | +| sqlglot_normalize | 140 ms | 162 ms: 1.16x slower | +| pyflate | 664 ms | 771 ms: 1.16x slower | +| richards_super | 73.2 ms | 85.5 ms: 1.17x slower | +| go | 191 ms | 224 ms: 1.17x slower | +| sympy_expand | 601 ms | 706 ms: 1.18x slower | +| dulwich_log | 93.7 ms | 111 ms: 1.19x slower | +| json_dumps | 14.1 ms | 16.9 ms: 1.19x slower | +| logging_silent | 130 ns | 156 ns: 1.20x slower | +| deepcopy_memo | 50.1 us | 60.4 us: 1.21x slower | +| scimark_lu | 146 ms | 176 ms: 1.21x slower | +| scimark_fft | 473 ms | 571 ms: 1.21x slower | +| typing_runtime_protocols | 226 us | 276 us: 1.22x slower | +| xml_etree_generate | 122 ms | 150 ms: 1.22x slower | +| generators | 40.0 ms | 49.3 ms: 1.23x slower | +| sympy_sum | 210 ms | 259 ms: 1.23x slower | +| unpickle_pure_python | 290 us | 359 us: 1.24x slower | +| asyncio_tcp_ssl | 2.77 sec | 3.44 sec: 1.24x slower | +| logging_format | 9.24 us | 11.5 us: 1.25x slower | +| sqlglot_optimize | 74.7 ms | 93.3 ms: 1.25x slower | +| fannkuch | 547 ms | 692 ms: 1.26x slower | +| pprint_pformat | 1.94 sec | 2.47 sec: 1.27x slower | +| html5lib | 92.6 ms | 118 ms: 1.28x slower | +| 2to3 | 445 ms | 570 ms: 1.28x slower | +| meteor_contest | 150 ms | 192 ms: 1.28x slower | +| richards | 65.5 ms | 84.3 ms: 1.29x slower | +| crypto_pyaes | 100 ms | 131 ms: 1.31x slower | +| gc_traversal | 5.70 ms | 7.46 ms: 1.31x slower | +| bpe_tokeniser | 6.28 sec | 8.26 sec: 1.31x slower | +| scimark_sparse_mat_mult | 6.76 ms | 8.88 ms: 1.31x slower | +| pickle_pure_python | 416 us | 548 us: 1.32x slower | +| thrift | 1.10 ms | 1.45 ms: 1.32x slower | +| sympy_integrate | 30.2 ms | 39.9 ms: 1.32x slower | +| deepcopy_reduce | 4.10 us | 5.46 us: 1.33x slower | +| create_gc_cycles | 2.41 ms | 3.21 ms: 1.33x slower | +| genshi_text | 31.7 ms | 42.4 ms: 1.34x slower | +| django_template | 44.3 ms | 59.6 ms: 1.35x slower | +| raytrace | 344 ms | 478 ms: 1.39x slower | +| comprehensions | 22.2 us | 31.0 us: 1.39x slower | +| json_loads | 34.3 us | 47.8 us: 1.39x slower | +| genshi_xml | 72.1 ms | 101 ms: 1.40x slower | +| sqlglot_parse | 1.76 ms | 2.46 ms: 1.40x slower | +| chaos | 83.6 ms | 118 ms: 1.42x slower | +| sqlglot_transpile | 2.20 ms | 3.12 ms: 1.42x slower | +| json | 6.51 ms | 9.28 ms: 1.43x slower | +| coverage | 107 ms | 154 ms: 1.43x slower | +| scimark_monte_carlo | 90.6 ms | 135 ms: 1.49x slower | +| python_startup_no_site | 15.3 ms | 23.1 ms: 1.51x slower | +| mako | 15.9 ms | 24.8 ms: 1.56x slower | +| hexiom | 8.11 ms | 12.8 ms: 1.58x slower | +| bench_thread_pool | 2.89 ms | 4.58 ms: 1.59x slower | +| python_startup | 22.4 ms | 36.0 ms: 1.61x slower | +| deltablue | 4.44 ms | 7.27 ms: 1.64x slower | +| nbody | 119 ms | 198 ms: 1.67x slower | +| logging_simple | 8.56 us | 14.6 us: 1.71x slower | +| bench_mp_pool | 18.7 ms | 105 ms: 5.63x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmark hidden because not significant (13): pidigits, sqlite_synth, xml_etree_parse, asyncio_websockets, pickle_dict, float, scimark_sor, pylint, regex_effbot, regex_v8, unpickle, pickle, pickle_list +Ignored benchmarks (6) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, tornado_http +Ignored benchmarks (8) of results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.135x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.11x +- 95% likely to have a slowdown of 1.09x +- 99% likely to have a slowdown of 1.08x + +# Memory +- memory change: 1.34x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg new file mode 100644 index 00000000..8313674c --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg @@ -0,0 +1,3071 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base-mem.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base-mem.svg new file mode 100644 index 00000000..d0808034 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base-mem.svg @@ -0,0 +1,3182 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.md b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.md new file mode 100644 index 00000000..64cfdc13 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.md @@ -0,0 +1,211 @@ +# Results vs. base + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.158x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.15x slower +- Memory change: 1.19x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 531 ms | 570 ms: 1.07x slower | +| docutils | 3.67 sec | 4.20 sec: 1.15x slower | +| html5lib | 91.4 ms | 118 ms: 1.29x slower | +| sphinx | 1.40 sec | 1.64 sec: 1.17x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|---------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| async_tree_io_tg | 954 ms | 896 ms: 1.06x faster | +| coroutines | 33.1 ms | 34.8 ms: 1.05x slower | +| async_tree_memoization_tg | 504 ms | 541 ms: 1.07x slower | +| asyncio_tcp | 981 ms | 1.05 sec: 1.08x slower | +| async_tree_none | 395 ms | 454 ms: 1.15x slower | +| async_tree_cpu_io_mixed | 710 ms | 825 ms: 1.16x slower | +| async_generators | 529 ms | 619 ms: 1.17x slower | +| asyncio_tcp_ssl | 2.82 sec | 3.44 sec: 1.22x slower | +| Geometric mean | (ref) | 1.06x slower | + +Benchmark hidden because not significant (5): async_tree_none_tg, asyncio_websockets, async_tree_memoization, async_tree_cpu_io_mixed_tg, async_tree_io + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| nbody | 116 ms | 198 ms: 1.71x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmark hidden because not significant (2): float, pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_v8 | 35.1 ms | 33.3 ms: 1.05x faster | +| regex_dna | 286 ms | 304 ms: 1.06x slower | +| regex_compile | 159 ms | 201 ms: 1.27x slower | +| Geometric mean | (ref) | 1.06x slower | + +Benchmark hidden because not significant (1): regex_effbot + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pickle | 17.3 us | 15.7 us: 1.10x faster | +| pickle_dict | 51.2 us | 47.4 us: 1.08x faster | +| pickle_list | 7.62 us | 7.14 us: 1.07x faster | +| json_dumps | 17.9 ms | 16.9 ms: 1.06x faster | +| xml_etree_process | 87.2 ms | 98.9 ms: 1.13x slower | +| xml_etree_parse | 195 ms | 225 ms: 1.15x slower | +| pickle_pure_python | 456 us | 548 us: 1.20x slower | +| json_loads | 39.1 us | 47.8 us: 1.22x slower | +| unpickle_pure_python | 290 us | 359 us: 1.24x slower | +| tomli_loads | 2.44 sec | 3.04 sec: 1.24x slower | +| xml_etree_generate | 114 ms | 150 ms: 1.32x slower | +| Geometric mean | (ref) | 1.08x slower | + +Benchmark hidden because not significant (3): unpickle, unpickle_list, xml_etree_iterparse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup | 29.3 ms | 36.0 ms: 1.23x slower | +| python_startup_no_site | 16.0 ms | 23.1 ms: 1.45x slower | +| Geometric mean | (ref) | 1.33x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| django_template | 50.5 ms | 59.6 ms: 1.18x slower | +| genshi_text | 30.6 ms | 42.4 ms: 1.39x slower | +| mako | 16.7 ms | 24.8 ms: 1.48x slower | +| genshi_xml | 66.6 ms | 101 ms: 1.51x slower | +| Geometric mean | (ref) | 1.38x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|---------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 9.82 ms | 7.46 ms: 1.32x faster | +| create_gc_cycles | 4.18 ms | 3.21 ms: 1.30x faster | +| pickle | 17.3 us | 15.7 us: 1.10x faster | +| pickle_dict | 51.2 us | 47.4 us: 1.08x faster | +| pickle_list | 7.62 us | 7.14 us: 1.07x faster | +| async_tree_io_tg | 954 ms | 896 ms: 1.06x faster | +| json_dumps | 17.9 ms | 16.9 ms: 1.06x faster | +| regex_v8 | 35.1 ms | 33.3 ms: 1.05x faster | +| coroutines | 33.1 ms | 34.8 ms: 1.05x slower | +| k_core | 4.25 sec | 4.51 sec: 1.06x slower | +| regex_dna | 286 ms | 304 ms: 1.06x slower | +| sqlglot_normalize | 151 ms | 162 ms: 1.07x slower | +| 2to3 | 531 ms | 570 ms: 1.07x slower | +| async_tree_memoization_tg | 504 ms | 541 ms: 1.07x slower | +| subparsers | 32.8 ms | 35.3 ms: 1.07x slower | +| asyncio_tcp | 981 ms | 1.05 sec: 1.08x slower | +| bench_mp_pool | 97.4 ms | 105 ms: 1.08x slower | +| dulwich_log | 101 ms | 111 ms: 1.10x slower | +| scimark_sor | 163 ms | 180 ms: 1.10x slower | +| generators | 43.6 ms | 49.3 ms: 1.13x slower | +| xml_etree_process | 87.2 ms | 98.9 ms: 1.13x slower | +| pathlib | 29.5 ms | 33.6 ms: 1.14x slower | +| docutils | 3.67 sec | 4.20 sec: 1.15x slower | +| async_tree_none | 395 ms | 454 ms: 1.15x slower | +| xml_etree_parse | 195 ms | 225 ms: 1.15x slower | +| scimark_lu | 153 ms | 176 ms: 1.15x slower | +| deepcopy | 371 us | 429 us: 1.16x slower | +| async_tree_cpu_io_mixed | 710 ms | 825 ms: 1.16x slower | +| sympy_str | 368 ms | 428 ms: 1.16x slower | +| sphinx | 1.40 sec | 1.64 sec: 1.17x slower | +| sympy_expand | 603 ms | 706 ms: 1.17x slower | +| shortest_path | 934 ms | 1.09 sec: 1.17x slower | +| async_generators | 529 ms | 619 ms: 1.17x slower | +| django_template | 50.5 ms | 59.6 ms: 1.18x slower | +| mdp | 3.60 sec | 4.25 sec: 1.18x slower | +| pprint_safe_repr | 968 ms | 1.14 sec: 1.18x slower | +| scimark_fft | 478 ms | 571 ms: 1.20x slower | +| pickle_pure_python | 456 us | 548 us: 1.20x slower | +| pyflate | 639 ms | 771 ms: 1.21x slower | +| crypto_pyaes | 108 ms | 131 ms: 1.21x slower | +| sympy_sum | 214 ms | 259 ms: 1.21x slower | +| asyncio_tcp_ssl | 2.82 sec | 3.44 sec: 1.22x slower | +| json_loads | 39.1 us | 47.8 us: 1.22x slower | +| spectral_norm | 137 ms | 168 ms: 1.22x slower | +| python_startup | 29.3 ms | 36.0 ms: 1.23x slower | +| connected_components | 788 ms | 972 ms: 1.23x slower | +| unpickle_pure_python | 290 us | 359 us: 1.24x slower | +| pylint | 381 ms | 474 ms: 1.24x slower | +| tomli_loads | 2.44 sec | 3.04 sec: 1.24x slower | +| coverage | 123 ms | 154 ms: 1.25x slower | +| thrift | 1.15 ms | 1.45 ms: 1.26x slower | +| logging_format | 9.16 us | 11.5 us: 1.26x slower | +| regex_compile | 159 ms | 201 ms: 1.27x slower | +| telco | 10.5 ms | 13.3 ms: 1.27x slower | +| go | 176 ms | 224 ms: 1.27x slower | +| json | 7.28 ms | 9.28 ms: 1.27x slower | +| comprehensions | 24.2 us | 31.0 us: 1.28x slower | +| richards_super | 66.8 ms | 85.5 ms: 1.28x slower | +| scimark_sparse_mat_mult | 6.93 ms | 8.88 ms: 1.28x slower | +| fannkuch | 537 ms | 692 ms: 1.29x slower | +| html5lib | 91.4 ms | 118 ms: 1.29x slower | +| many_optionals | 1.23 ms | 1.59 ms: 1.30x slower | +| xml_etree_generate | 114 ms | 150 ms: 1.32x slower | +| pprint_pformat | 1.88 sec | 2.47 sec: 1.32x slower | +| deepcopy_memo | 45.7 us | 60.4 us: 1.32x slower | +| sympy_integrate | 29.9 ms | 39.9 ms: 1.33x slower | +| sqlglot_transpile | 2.33 ms | 3.12 ms: 1.33x slower | +| sqlglot_optimize | 69.8 ms | 93.3 ms: 1.34x slower | +| unpack_sequence | 59.3 ns | 79.7 ns: 1.34x slower | +| typing_runtime_protocols | 203 us | 276 us: 1.36x slower | +| bench_thread_pool | 3.35 ms | 4.58 ms: 1.37x slower | +| bpe_tokeniser | 6.00 sec | 8.26 sec: 1.38x slower | +| raytrace | 346 ms | 478 ms: 1.38x slower | +| sqlalchemy_declarative | 172 ms | 239 ms: 1.38x slower | +| genshi_text | 30.6 ms | 42.4 ms: 1.39x slower | +| chaos | 85.4 ms | 118 ms: 1.39x slower | +| meteor_contest | 137 ms | 192 ms: 1.40x slower | +| python_startup_no_site | 16.0 ms | 23.1 ms: 1.45x slower | +| deepcopy_reduce | 3.71 us | 5.46 us: 1.47x slower | +| mako | 16.7 ms | 24.8 ms: 1.48x slower | +| hexiom | 8.63 ms | 12.8 ms: 1.49x slower | +| richards | 56.7 ms | 84.3 ms: 1.49x slower | +| genshi_xml | 66.6 ms | 101 ms: 1.51x slower | +| scimark_monte_carlo | 86.5 ms | 135 ms: 1.56x slower | +| logging_simple | 9.37 us | 14.6 us: 1.56x slower | +| sqlglot_parse | 1.57 ms | 2.46 ms: 1.57x slower | +| sqlalchemy_imperative | 24.5 ms | 38.6 ms: 1.57x slower | +| nbody | 116 ms | 198 ms: 1.71x slower | +| deltablue | 4.19 ms | 7.27 ms: 1.74x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmark hidden because not significant (15): float, async_tree_none_tg, asyncio_websockets, sqlite_synth, pidigits, async_tree_memoization, async_tree_cpu_io_mixed_tg, regex_effbot, async_tree_io, unpickle, logging_silent, pycparser, unpickle_list, xml_etree_iterparse, nqueens + +- Geometric mean (including insignificant results): 1.158x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.16x +- 95% likely to have a slowdown of 1.16x +- 99% likely to have a slowdown of 1.15x + +# Memory +- memory change: 1.19x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.svg new file mode 100644 index 00000000..069a2da5 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.svg @@ -0,0 +1,3340 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md new file mode 100644 index 00000000..a9472d7c --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md @@ -0,0 +1,221 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.058x slower +- HPT reliability: 99.96% +- HPT 99th percentile: 1.03x slower +- Memory change: 1.36x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 304 ms: 1.15x slower | +| docutils | 2.64 sec | 2.81 sec: 1.06x slower | +| html5lib | 63.6 ms | 68.5 ms: 1.08x slower | +| Geometric mean | (ref) | 1.10x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 586 ms: 1.89x faster | +| async_tree_none_tg | 446 ms | 253 ms: 1.76x faster | +| async_tree_io | 1.08 sec | 617 ms: 1.76x faster | +| async_tree_memoization_tg | 560 ms | 322 ms: 1.74x faster | +| async_tree_none | 464 ms | 292 ms: 1.59x faster | +| async_tree_memoization | 555 ms | 357 ms: 1.55x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 556 ms: 1.30x faster | +| async_tree_cpu_io_mixed | 715 ms | 588 ms: 1.22x faster | +| async_generators | 384 ms | 369 ms: 1.04x faster | +| asyncio_websockets | 517 ms | 509 ms: 1.01x faster | +| coroutines | 23.9 ms | 23.8 ms: 1.01x faster | +| asyncio_tcp | 519 ms | 535 ms: 1.03x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.79 sec: 1.19x slower | +| Geometric mean | (ref) | 1.31x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 80.8 ms | 77.6 ms: 1.04x faster | +| pidigits | 184 ms | 217 ms: 1.18x slower | +| nbody | 89.3 ms | 135 ms: 1.51x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.17 ms | 2.86 ms: 1.11x faster | +| regex_compile | 142 ms | 150 ms: 1.05x slower | +| regex_dna | 168 ms | 180 ms: 1.08x slower | +| regex_v8 | 20.6 ms | 23.9 ms: 1.16x slower | +| Geometric mean | (ref) | 1.04x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 96.7 ms | 86.9 ms: 1.11x faster | +| xml_etree_parse | 139 ms | 128 ms: 1.08x faster | +| pickle_dict | 31.8 us | 31.9 us: 1.00x slower | +| unpickle | 14.1 us | 14.7 us: 1.05x slower | +| pickle_list | 4.77 us | 5.00 us: 1.05x slower | +| pickle | 10.9 us | 11.9 us: 1.09x slower | +| tomli_loads | 2.11 sec | 2.34 sec: 1.11x slower | +| xml_etree_generate | 85.2 ms | 96.3 ms: 1.13x slower | +| unpickle_pure_python | 221 us | 249 us: 1.13x slower | +| unpickle_list | 4.67 us | 5.29 us: 1.13x slower | +| xml_etree_process | 59.0 ms | 68.6 ms: 1.16x slower | +| json_loads | 26.5 us | 31.0 us: 1.17x slower | +| pickle_pure_python | 308 us | 372 us: 1.21x slower | +| json_dumps | 10.4 ms | 13.0 ms: 1.25x slower | +| Geometric mean | (ref) | 1.09x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 9.57 ms: 1.34x slower | +| python_startup | 9.93 ms | 15.2 ms: 1.54x slower | +| Geometric mean | (ref) | 1.43x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 50.2 ms | 59.6 ms: 1.19x slower | +| genshi_text | 22.8 ms | 27.9 ms: 1.22x slower | +| django_template | 34.7 ms | 43.3 ms: 1.25x slower | +| mako | 11.0 ms | 15.6 ms: 1.42x slower | +| Geometric mean | (ref) | 1.27x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 586 ms: 1.89x faster | +| async_tree_none_tg | 446 ms | 253 ms: 1.76x faster | +| async_tree_io | 1.08 sec | 617 ms: 1.76x faster | +| async_tree_memoization_tg | 560 ms | 322 ms: 1.74x faster | +| async_tree_none | 464 ms | 292 ms: 1.59x faster | +| async_tree_memoization | 555 ms | 357 ms: 1.55x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 556 ms: 1.30x faster | +| async_tree_cpu_io_mixed | 715 ms | 588 ms: 1.22x faster | +| pathlib | 21.5 ms | 18.8 ms: 1.15x faster | +| xml_etree_iterparse | 96.7 ms | 86.9 ms: 1.11x faster | +| deepcopy | 352 us | 317 us: 1.11x faster | +| regex_effbot | 3.17 ms | 2.86 ms: 1.11x faster | +| gc_traversal | 3.46 ms | 3.15 ms: 1.10x faster | +| xml_etree_parse | 139 ms | 128 ms: 1.08x faster | +| sqlite_synth | 2.20 us | 2.04 us: 1.08x faster | +| async_generators | 384 ms | 369 ms: 1.04x faster | +| float | 80.8 ms | 77.6 ms: 1.04x faster | +| deepcopy_memo | 40.3 us | 39.0 us: 1.03x faster | +| asyncio_websockets | 517 ms | 509 ms: 1.01x faster | +| spectral_norm | 110 ms | 109 ms: 1.01x faster | +| bpe_tokeniser | 4.74 sec | 4.67 sec: 1.01x faster | +| coroutines | 23.9 ms | 23.8 ms: 1.01x faster | +| pickle_dict | 31.8 us | 31.9 us: 1.00x slower | +| pycparser | 1.17 sec | 1.19 sec: 1.02x slower | +| scimark_sor | 130 ms | 133 ms: 1.02x slower | +| asyncio_tcp | 519 ms | 535 ms: 1.03x slower | +| comprehensions | 19.8 us | 20.6 us: 1.04x slower | +| deepcopy_reduce | 3.08 us | 3.21 us: 1.04x slower | +| dulwich_log | 78.9 ms | 82.3 ms: 1.04x slower | +| unpickle | 14.1 us | 14.7 us: 1.05x slower | +| pickle_list | 4.77 us | 5.00 us: 1.05x slower | +| regex_compile | 142 ms | 150 ms: 1.05x slower | +| logging_silent | 109 ns | 116 ns: 1.06x slower | +| docutils | 2.64 sec | 2.81 sec: 1.06x slower | +| json | 5.02 ms | 5.37 ms: 1.07x slower | +| regex_dna | 168 ms | 180 ms: 1.08x slower | +| html5lib | 63.6 ms | 68.5 ms: 1.08x slower | +| pickle | 10.9 us | 11.9 us: 1.09x slower | +| logging_simple | 6.63 us | 7.22 us: 1.09x slower | +| sqlalchemy_imperative | 21.8 ms | 23.9 ms: 1.10x slower | +| pyflate | 448 ms | 492 ms: 1.10x slower | +| pprint_safe_repr | 743 ms | 817 ms: 1.10x slower | +| chaos | 62.8 ms | 69.1 ms: 1.10x slower | +| tomli_loads | 2.11 sec | 2.34 sec: 1.11x slower | +| raytrace | 299 ms | 333 ms: 1.11x slower | +| logging_format | 7.35 us | 8.18 us: 1.11x slower | +| sympy_sum | 166 ms | 185 ms: 1.11x slower | +| pprint_pformat | 1.52 sec | 1.69 sec: 1.12x slower | +| unpack_sequence | 52.1 ns | 58.1 ns: 1.12x slower | +| mdp | 2.42 sec | 2.71 sec: 1.12x slower | +| scimark_fft | 342 ms | 383 ms: 1.12x slower | +| sqlglot_normalize | 107 ms | 120 ms: 1.12x slower | +| xml_etree_generate | 85.2 ms | 96.3 ms: 1.13x slower | +| unpickle_pure_python | 221 us | 249 us: 1.13x slower | +| unpickle_list | 4.67 us | 5.29 us: 1.13x slower | +| crypto_pyaes | 76.6 ms | 86.9 ms: 1.13x slower | +| thrift | 791 us | 900 us: 1.14x slower | +| sqlalchemy_declarative | 143 ms | 163 ms: 1.14x slower | +| sympy_str | 292 ms | 334 ms: 1.15x slower | +| sqlglot_optimize | 53.3 ms | 61.3 ms: 1.15x slower | +| sqlglot_transpile | 1.67 ms | 1.92 ms: 1.15x slower | +| 2to3 | 264 ms | 304 ms: 1.15x slower | +| sympy_expand | 468 ms | 542 ms: 1.16x slower | +| regex_v8 | 20.6 ms | 23.9 ms: 1.16x slower | +| xml_etree_process | 59.0 ms | 68.6 ms: 1.16x slower | +| json_loads | 26.5 us | 31.0 us: 1.17x slower | +| sqlglot_parse | 1.36 ms | 1.60 ms: 1.18x slower | +| sympy_integrate | 20.5 ms | 24.2 ms: 1.18x slower | +| pidigits | 184 ms | 217 ms: 1.18x slower | +| nqueens | 80.1 ms | 94.7 ms: 1.18x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.79 sec: 1.19x slower | +| hexiom | 6.17 ms | 7.32 ms: 1.19x slower | +| genshi_xml | 50.2 ms | 59.6 ms: 1.19x slower | +| scimark_lu | 114 ms | 136 ms: 1.19x slower | +| scimark_monte_carlo | 68.4 ms | 81.6 ms: 1.19x slower | +| pickle_pure_python | 308 us | 372 us: 1.21x slower | +| richards | 45.9 ms | 55.5 ms: 1.21x slower | +| typing_runtime_protocols | 163 us | 199 us: 1.22x slower | +| genshi_text | 22.8 ms | 27.9 ms: 1.22x slower | +| create_gc_cycles | 1.09 ms | 1.36 ms: 1.24x slower | +| richards_super | 51.9 ms | 64.8 ms: 1.25x slower | +| django_template | 34.7 ms | 43.3 ms: 1.25x slower | +| json_dumps | 10.4 ms | 13.0 ms: 1.25x slower | +| meteor_contest | 104 ms | 130 ms: 1.26x slower | +| fannkuch | 372 ms | 478 ms: 1.28x slower | +| scimark_sparse_mat_mult | 4.39 ms | 5.72 ms: 1.30x slower | +| telco | 6.53 ms | 8.53 ms: 1.31x slower | +| python_startup_no_site | 7.16 ms | 9.57 ms: 1.34x slower | +| deltablue | 3.45 ms | 4.62 ms: 1.34x slower | +| coverage | 71.4 ms | 98.2 ms: 1.38x slower | +| mako | 11.0 ms | 15.6 ms: 1.42x slower | +| nbody | 89.3 ms | 135 ms: 1.51x slower | +| python_startup | 9.93 ms | 15.2 ms: 1.54x slower | +| bench_thread_pool | 941 us | 3.33 ms: 3.54x slower | +| bench_mp_pool | 10.8 ms | 94.6 ms: 8.76x slower | +| Geometric mean | (ref) | 1.10x slower | + +Benchmark hidden because not significant (3): pylint, go, generators +Ignored benchmarks (7) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, mypy2, tornado_http +Ignored benchmarks (6) of results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.058x slower + +# HPT report + +- Reliability score: 99.96% likely to be slow +- 90% likely to have a slowdown of 1.06x +- 95% likely to have a slowdown of 1.05x +- 99% likely to have a slowdown of 1.03x + +# Memory +- memory change: 1.36x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg new file mode 100644 index 00000000..1c79536b --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg @@ -0,0 +1,3098 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md new file mode 100644 index 00000000..ffffde77 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md @@ -0,0 +1,220 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.088x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.05x slower +- Memory change: 1.34x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 304 ms: 1.17x slower | +| docutils | 2.62 sec | 2.81 sec: 1.07x slower | +| html5lib | 67.0 ms | 68.5 ms: 1.02x slower | +| Geometric mean | (ref) | 1.09x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 586 ms: 1.56x faster | +| async_tree_io | 876 ms | 617 ms: 1.42x faster | +| async_tree_none_tg | 336 ms | 253 ms: 1.33x faster | +| async_tree_memoization | 461 ms | 357 ms: 1.29x faster | +| async_tree_memoization_tg | 414 ms | 322 ms: 1.29x faster | +| async_tree_none | 354 ms | 292 ms: 1.21x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 556 ms: 1.15x faster | +| async_tree_cpu_io_mixed | 666 ms | 588 ms: 1.13x faster | +| async_generators | 377 ms | 369 ms: 1.02x faster | +| asyncio_websockets | 520 ms | 509 ms: 1.02x faster | +| coroutines | 23.6 ms | 23.8 ms: 1.01x slower | +| asyncio_tcp | 505 ms | 535 ms: 1.06x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.79 sec: 1.18x slower | +| Geometric mean | (ref) | 1.15x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 217 ms: 1.00x slower | +| nbody | 85.1 ms | 135 ms: 1.59x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmark hidden because not significant (1): float + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.86 ms: 1.08x faster | +| regex_v8 | 22.7 ms | 23.9 ms: 1.05x slower | +| regex_compile | 132 ms | 150 ms: 1.13x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (1): regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 94.9 ms | 86.9 ms: 1.09x faster | +| xml_etree_parse | 136 ms | 128 ms: 1.06x faster | +| pickle_dict | 32.5 us | 31.9 us: 1.02x faster | +| pickle_list | 4.93 us | 5.00 us: 1.01x slower | +| unpickle | 14.3 us | 14.7 us: 1.03x slower | +| pickle | 11.3 us | 11.9 us: 1.05x slower | +| unpickle_list | 4.71 us | 5.29 us: 1.12x slower | +| xml_etree_generate | 85.4 ms | 96.3 ms: 1.13x slower | +| json_loads | 27.0 us | 31.0 us: 1.15x slower | +| xml_etree_process | 59.3 ms | 68.6 ms: 1.16x slower | +| tomli_loads | 2.01 sec | 2.34 sec: 1.17x slower | +| unpickle_pure_python | 210 us | 249 us: 1.19x slower | +| json_dumps | 10.5 ms | 13.0 ms: 1.23x slower | +| pickle_pure_python | 294 us | 372 us: 1.26x slower | +| Geometric mean | (ref) | 1.09x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 9.57 ms: 1.30x slower | +| python_startup | 11.0 ms | 15.2 ms: 1.39x slower | +| Geometric mean | (ref) | 1.34x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 48.8 ms | 59.6 ms: 1.22x slower | +| django_template | 34.1 ms | 43.3 ms: 1.27x slower | +| genshi_text | 21.5 ms | 27.9 ms: 1.30x slower | +| mako | 11.3 ms | 15.6 ms: 1.38x slower | +| Geometric mean | (ref) | 1.29x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 586 ms: 1.56x faster | +| async_tree_io | 876 ms | 617 ms: 1.42x faster | +| async_tree_none_tg | 336 ms | 253 ms: 1.33x faster | +| async_tree_memoization | 461 ms | 357 ms: 1.29x faster | +| async_tree_memoization_tg | 414 ms | 322 ms: 1.29x faster | +| async_tree_none | 354 ms | 292 ms: 1.21x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 556 ms: 1.15x faster | +| async_tree_cpu_io_mixed | 666 ms | 588 ms: 1.13x faster | +| deepcopy | 355 us | 317 us: 1.12x faster | +| xml_etree_iterparse | 94.9 ms | 86.9 ms: 1.09x faster | +| sqlite_synth | 2.21 us | 2.04 us: 1.08x faster | +| regex_effbot | 3.08 ms | 2.86 ms: 1.08x faster | +| xml_etree_parse | 136 ms | 128 ms: 1.06x faster | +| async_generators | 377 ms | 369 ms: 1.02x faster | +| spectral_norm | 111 ms | 109 ms: 1.02x faster | +| pathlib | 19.2 ms | 18.8 ms: 1.02x faster | +| asyncio_websockets | 520 ms | 509 ms: 1.02x faster | +| pickle_dict | 32.5 us | 31.9 us: 1.02x faster | +| scimark_sor | 134 ms | 133 ms: 1.01x faster | +| go | 141 ms | 139 ms: 1.01x faster | +| pidigits | 217 ms | 217 ms: 1.00x slower | +| gc_traversal | 3.14 ms | 3.15 ms: 1.00x slower | +| coroutines | 23.6 ms | 23.8 ms: 1.01x slower | +| create_gc_cycles | 1.34 ms | 1.36 ms: 1.01x slower | +| pickle_list | 4.93 us | 5.00 us: 1.01x slower | +| html5lib | 67.0 ms | 68.5 ms: 1.02x slower | +| unpickle | 14.3 us | 14.7 us: 1.03x slower | +| deepcopy_reduce | 3.11 us | 3.21 us: 1.03x slower | +| pickle | 11.3 us | 11.9 us: 1.05x slower | +| bpe_tokeniser | 4.45 sec | 4.67 sec: 1.05x slower | +| regex_v8 | 22.7 ms | 23.9 ms: 1.05x slower | +| asyncio_tcp | 505 ms | 535 ms: 1.06x slower | +| pycparser | 1.12 sec | 1.19 sec: 1.06x slower | +| docutils | 2.62 sec | 2.81 sec: 1.07x slower | +| json | 4.93 ms | 5.37 ms: 1.09x slower | +| telco | 7.82 ms | 8.53 ms: 1.09x slower | +| scimark_fft | 349 ms | 383 ms: 1.10x slower | +| pyflate | 449 ms | 492 ms: 1.10x slower | +| dulwich_log | 74.8 ms | 82.3 ms: 1.10x slower | +| pprint_safe_repr | 738 ms | 817 ms: 1.11x slower | +| unpickle_list | 4.71 us | 5.29 us: 1.12x slower | +| generators | 28.8 ms | 32.5 ms: 1.13x slower | +| xml_etree_generate | 85.4 ms | 96.3 ms: 1.13x slower | +| logging_silent | 103 ns | 116 ns: 1.13x slower | +| regex_compile | 132 ms | 150 ms: 1.13x slower | +| pprint_pformat | 1.50 sec | 1.69 sec: 1.13x slower | +| sqlglot_normalize | 106 ms | 120 ms: 1.13x slower | +| json_loads | 27.0 us | 31.0 us: 1.15x slower | +| mdp | 2.36 sec | 2.71 sec: 1.15x slower | +| xml_etree_process | 59.3 ms | 68.6 ms: 1.16x slower | +| thrift | 778 us | 900 us: 1.16x slower | +| sqlglot_optimize | 52.7 ms | 61.3 ms: 1.16x slower | +| tomli_loads | 2.01 sec | 2.34 sec: 1.17x slower | +| 2to3 | 260 ms | 304 ms: 1.17x slower | +| logging_simple | 6.16 us | 7.22 us: 1.17x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.79 sec: 1.18x slower | +| coverage | 83.0 ms | 98.2 ms: 1.18x slower | +| sympy_expand | 457 ms | 542 ms: 1.19x slower | +| unpickle_pure_python | 210 us | 249 us: 1.19x slower | +| sympy_sum | 156 ms | 185 ms: 1.19x slower | +| logging_format | 6.84 us | 8.18 us: 1.20x slower | +| scimark_lu | 113 ms | 136 ms: 1.20x slower | +| nqueens | 78.6 ms | 94.7 ms: 1.20x slower | +| chaos | 57.3 ms | 69.1 ms: 1.21x slower | +| scimark_sparse_mat_mult | 4.71 ms | 5.72 ms: 1.22x slower | +| sympy_str | 275 ms | 334 ms: 1.22x slower | +| sympy_integrate | 19.8 ms | 24.2 ms: 1.22x slower | +| hexiom | 5.99 ms | 7.32 ms: 1.22x slower | +| genshi_xml | 48.8 ms | 59.6 ms: 1.22x slower | +| richards | 45.2 ms | 55.5 ms: 1.23x slower | +| json_dumps | 10.5 ms | 13.0 ms: 1.23x slower | +| sqlglot_transpile | 1.56 ms | 1.92 ms: 1.23x slower | +| scimark_monte_carlo | 65.4 ms | 81.6 ms: 1.25x slower | +| comprehensions | 16.5 us | 20.6 us: 1.25x slower | +| richards_super | 51.6 ms | 64.8 ms: 1.25x slower | +| pickle_pure_python | 294 us | 372 us: 1.26x slower | +| django_template | 34.1 ms | 43.3 ms: 1.27x slower | +| sqlglot_parse | 1.25 ms | 1.60 ms: 1.28x slower | +| crypto_pyaes | 67.9 ms | 86.9 ms: 1.28x slower | +| meteor_contest | 102 ms | 130 ms: 1.28x slower | +| typing_runtime_protocols | 155 us | 199 us: 1.29x slower | +| fannkuch | 370 ms | 478 ms: 1.29x slower | +| python_startup_no_site | 7.39 ms | 9.57 ms: 1.30x slower | +| unpack_sequence | 44.8 ns | 58.1 ns: 1.30x slower | +| genshi_text | 21.5 ms | 27.9 ms: 1.30x slower | +| raytrace | 253 ms | 333 ms: 1.32x slower | +| mako | 11.3 ms | 15.6 ms: 1.38x slower | +| python_startup | 11.0 ms | 15.2 ms: 1.39x slower | +| deltablue | 3.12 ms | 4.62 ms: 1.48x slower | +| nbody | 85.1 ms | 135 ms: 1.59x slower | +| bench_thread_pool | 919 us | 3.33 ms: 3.62x slower | +| bench_mp_pool | 11.0 ms | 94.6 ms: 8.60x slower | +| Geometric mean | (ref) | 1.13x slower | + +Benchmark hidden because not significant (4): deepcopy_memo, pylint, regex_dna, float +Ignored benchmarks (6) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, tornado_http +Ignored benchmarks (8) of results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.088x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.07x +- 95% likely to have a slowdown of 1.06x +- 99% likely to have a slowdown of 1.05x + +# Memory +- memory change: 1.34x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg new file mode 100644 index 00000000..d8508703 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg @@ -0,0 +1,3012 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base-mem.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base-mem.svg new file mode 100644 index 00000000..3b22f3bf --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base-mem.svg @@ -0,0 +1,3124 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.md b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.md new file mode 100644 index 00000000..69f82c87 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.md @@ -0,0 +1,226 @@ +# Results vs. base + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.135x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.12x slower +- Memory change: 1.20x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 254 ms | 304 ms: 1.20x slower | +| docutils | 2.57 sec | 2.81 sec: 1.09x slower | +| sphinx | 985 ms | 1.11 sec: 1.13x slower | +| Geometric mean | (ref) | 1.14x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| async_tree_io_tg | 624 ms | 586 ms: 1.06x faster | +| async_tree_none_tg | 264 ms | 253 ms: 1.04x faster | +| async_tree_io | 627 ms | 617 ms: 1.02x faster | +| asyncio_websockets | 517 ms | 509 ms: 1.01x faster | +| async_tree_memoization_tg | 315 ms | 322 ms: 1.02x slower | +| async_tree_none | 272 ms | 292 ms: 1.07x slower | +| asyncio_tcp | 498 ms | 535 ms: 1.07x slower | +| async_tree_memoization | 325 ms | 357 ms: 1.10x slower | +| async_tree_cpu_io_mixed_tg | 492 ms | 556 ms: 1.13x slower | +| async_generators | 326 ms | 369 ms: 1.13x slower | +| coroutines | 21.0 ms | 23.8 ms: 1.13x slower | +| async_tree_cpu_io_mixed | 505 ms | 588 ms: 1.16x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.79 sec: 1.19x slower | +| Geometric mean | (ref) | 1.06x slower | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pidigits | 207 ms | 217 ms: 1.05x slower | +| float | 71.2 ms | 77.6 ms: 1.09x slower | +| nbody | 89.0 ms | 135 ms: 1.52x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_v8 | 23.3 ms | 23.9 ms: 1.03x slower | +| regex_dna | 171 ms | 180 ms: 1.06x slower | +| regex_effbot | 2.64 ms | 2.86 ms: 1.08x slower | +| regex_compile | 127 ms | 150 ms: 1.18x slower | +| Geometric mean | (ref) | 1.08x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| xml_etree_iterparse | 99.8 ms | 86.9 ms: 1.15x faster | +| pickle | 12.3 us | 11.9 us: 1.04x faster | +| pickle_list | 4.98 us | 5.00 us: 1.00x slower | +| xml_etree_parse | 127 ms | 128 ms: 1.01x slower | +| pickle_dict | 31.5 us | 31.9 us: 1.01x slower | +| json_loads | 29.0 us | 31.0 us: 1.07x slower | +| unpickle | 13.7 us | 14.7 us: 1.08x slower | +| unpickle_list | 4.91 us | 5.29 us: 1.08x slower | +| xml_etree_generate | 83.9 ms | 96.3 ms: 1.15x slower | +| json_dumps | 11.3 ms | 13.0 ms: 1.15x slower | +| xml_etree_process | 59.2 ms | 68.6 ms: 1.16x slower | +| pickle_pure_python | 318 us | 372 us: 1.17x slower | +| unpickle_pure_python | 212 us | 249 us: 1.17x slower | +| tomli_loads | 1.90 sec | 2.34 sec: 1.23x slower | +| Geometric mean | (ref) | 1.08x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup | 14.7 ms | 15.2 ms: 1.04x slower | +| python_startup_no_site | 7.46 ms | 9.57 ms: 1.28x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| genshi_xml | 49.4 ms | 59.6 ms: 1.21x slower | +| django_template | 35.4 ms | 43.3 ms: 1.23x slower | +| genshi_text | 21.3 ms | 27.9 ms: 1.31x slower | +| mako | 11.7 ms | 15.6 ms: 1.34x slower | +| Geometric mean | (ref) | 1.27x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 4.33 ms | 3.15 ms: 1.37x faster | +| create_gc_cycles | 1.85 ms | 1.36 ms: 1.36x faster | +| xml_etree_iterparse | 99.8 ms | 86.9 ms: 1.15x faster | +| sqlite_synth | 2.19 us | 2.04 us: 1.07x faster | +| async_tree_io_tg | 624 ms | 586 ms: 1.06x faster | +| async_tree_none_tg | 264 ms | 253 ms: 1.04x faster | +| pickle | 12.3 us | 11.9 us: 1.04x faster | +| async_tree_io | 627 ms | 617 ms: 1.02x faster | +| asyncio_websockets | 517 ms | 509 ms: 1.01x faster | +| pickle_list | 4.98 us | 5.00 us: 1.00x slower | +| xml_etree_parse | 127 ms | 128 ms: 1.01x slower | +| pickle_dict | 31.5 us | 31.9 us: 1.01x slower | +| pathlib | 18.4 ms | 18.8 ms: 1.02x slower | +| async_tree_memoization_tg | 315 ms | 322 ms: 1.02x slower | +| regex_v8 | 23.3 ms | 23.9 ms: 1.03x slower | +| python_startup | 14.7 ms | 15.2 ms: 1.04x slower | +| pidigits | 207 ms | 217 ms: 1.05x slower | +| json | 5.10 ms | 5.37 ms: 1.05x slower | +| regex_dna | 171 ms | 180 ms: 1.06x slower | +| pycparser | 1.12 sec | 1.19 sec: 1.06x slower | +| bench_mp_pool | 88.5 ms | 94.6 ms: 1.07x slower | +| json_loads | 29.0 us | 31.0 us: 1.07x slower | +| async_tree_none | 272 ms | 292 ms: 1.07x slower | +| asyncio_tcp | 498 ms | 535 ms: 1.07x slower | +| unpickle | 13.7 us | 14.7 us: 1.08x slower | +| unpickle_list | 4.91 us | 5.29 us: 1.08x slower | +| regex_effbot | 2.64 ms | 2.86 ms: 1.08x slower | +| dulwich_log | 75.6 ms | 82.3 ms: 1.09x slower | +| float | 71.2 ms | 77.6 ms: 1.09x slower | +| docutils | 2.57 sec | 2.81 sec: 1.09x slower | +| async_tree_memoization | 325 ms | 357 ms: 1.10x slower | +| bpe_tokeniser | 4.20 sec | 4.67 sec: 1.11x slower | +| pylint | 281 ms | 317 ms: 1.13x slower | +| k_core | 2.05 sec | 2.32 sec: 1.13x slower | +| async_tree_cpu_io_mixed_tg | 492 ms | 556 ms: 1.13x slower | +| sphinx | 985 ms | 1.11 sec: 1.13x slower | +| async_generators | 326 ms | 369 ms: 1.13x slower | +| generators | 28.7 ms | 32.5 ms: 1.13x slower | +| logging_silent | 102 ns | 116 ns: 1.13x slower | +| coroutines | 21.0 ms | 23.8 ms: 1.13x slower | +| many_optionals | 1.03 ms | 1.17 ms: 1.14x slower | +| spectral_norm | 94.9 ms | 109 ms: 1.14x slower | +| xml_etree_generate | 83.9 ms | 96.3 ms: 1.15x slower | +| json_dumps | 11.3 ms | 13.0 ms: 1.15x slower | +| sqlglot_normalize | 104 ms | 120 ms: 1.15x slower | +| mdp | 2.34 sec | 2.71 sec: 1.16x slower | +| xml_etree_process | 59.2 ms | 68.6 ms: 1.16x slower | +| unpack_sequence | 50.1 ns | 58.1 ns: 1.16x slower | +| pprint_safe_repr | 703 ms | 817 ms: 1.16x slower | +| async_tree_cpu_io_mixed | 505 ms | 588 ms: 1.16x slower | +| scimark_sor | 114 ms | 133 ms: 1.17x slower | +| pickle_pure_python | 318 us | 372 us: 1.17x slower | +| subparsers | 22.0 ms | 25.8 ms: 1.17x slower | +| logging_simple | 6.15 us | 7.22 us: 1.17x slower | +| unpickle_pure_python | 212 us | 249 us: 1.17x slower | +| logging_format | 6.95 us | 8.18 us: 1.18x slower | +| regex_compile | 127 ms | 150 ms: 1.18x slower | +| sqlglot_optimize | 52.0 ms | 61.3 ms: 1.18x slower | +| pprint_pformat | 1.43 sec | 1.69 sec: 1.18x slower | +| sympy_expand | 458 ms | 542 ms: 1.18x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.79 sec: 1.19x slower | +| telco | 7.15 ms | 8.53 ms: 1.19x slower | +| 2to3 | 254 ms | 304 ms: 1.20x slower | +| sympy_sum | 154 ms | 185 ms: 1.20x slower | +| genshi_xml | 49.4 ms | 59.6 ms: 1.21x slower | +| pyflate | 408 ms | 492 ms: 1.21x slower | +| deepcopy_reduce | 2.66 us | 3.21 us: 1.21x slower | +| nqueens | 78.1 ms | 94.7 ms: 1.21x slower | +| deepcopy | 261 us | 317 us: 1.21x slower | +| sympy_integrate | 19.9 ms | 24.2 ms: 1.22x slower | +| thrift | 739 us | 900 us: 1.22x slower | +| scimark_lu | 111 ms | 136 ms: 1.22x slower | +| coverage | 80.3 ms | 98.2 ms: 1.22x slower | +| django_template | 35.4 ms | 43.3 ms: 1.23x slower | +| sympy_str | 272 ms | 334 ms: 1.23x slower | +| tomli_loads | 1.90 sec | 2.34 sec: 1.23x slower | +| go | 113 ms | 139 ms: 1.23x slower | +| sqlalchemy_imperative | 19.3 ms | 23.9 ms: 1.24x slower | +| scimark_fft | 309 ms | 383 ms: 1.24x slower | +| sqlglot_transpile | 1.55 ms | 1.92 ms: 1.24x slower | +| comprehensions | 16.6 us | 20.6 us: 1.24x slower | +| shortest_path | 433 ms | 539 ms: 1.24x slower | +| connected_components | 392 ms | 489 ms: 1.25x slower | +| chaos | 55.1 ms | 69.1 ms: 1.25x slower | +| hexiom | 5.79 ms | 7.32 ms: 1.26x slower | +| raytrace | 262 ms | 333 ms: 1.27x slower | +| sqlalchemy_declarative | 128 ms | 163 ms: 1.27x slower | +| typing_runtime_protocols | 156 us | 199 us: 1.27x slower | +| scimark_monte_carlo | 64.1 ms | 81.6 ms: 1.27x slower | +| sqlglot_parse | 1.25 ms | 1.60 ms: 1.28x slower | +| python_startup_no_site | 7.46 ms | 9.57 ms: 1.28x slower | +| fannkuch | 370 ms | 478 ms: 1.29x slower | +| crypto_pyaes | 67.2 ms | 86.9 ms: 1.29x slower | +| meteor_contest | 100 ms | 130 ms: 1.30x slower | +| deepcopy_memo | 30.0 us | 39.0 us: 1.30x slower | +| genshi_text | 21.3 ms | 27.9 ms: 1.31x slower | +| richards | 42.1 ms | 55.5 ms: 1.32x slower | +| mako | 11.7 ms | 15.6 ms: 1.34x slower | +| richards_super | 48.4 ms | 64.8 ms: 1.34x slower | +| scimark_sparse_mat_mult | 4.20 ms | 5.72 ms: 1.36x slower | +| deltablue | 3.06 ms | 4.62 ms: 1.51x slower | +| nbody | 89.0 ms | 135 ms: 1.52x slower | +| bench_thread_pool | 1.03 ms | 3.33 ms: 3.23x slower | +| Geometric mean | (ref) | 1.16x slower | +Ignored benchmarks (1) of results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: html5lib + +- Geometric mean (including insignificant results): 1.135x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.14x +- 95% likely to have a slowdown of 1.14x +- 99% likely to have a slowdown of 1.12x + +# Memory +- memory change: 1.20x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.svg new file mode 100644 index 00000000..496d9183 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.svg @@ -0,0 +1,3252 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/README.md b/results/bm-20250125-3.14.0a4+-3f2cfd0/README.md new file mode 100644 index 00000000..03f3986d --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/README.md @@ -0,0 +1,62 @@ +# Results + +- fork: python/3f2cfd0462e13368092a +- version: 3.14.0a4+ +- config: +- commit hash: [3f2cfd0](https://github.com/python/cpython/commit/3f2cfd0) +- commit date: 2025-01-25T23:50:09+05:30 +- commit merge base: [be98fda7c6698e8468afd528c864aca1f532af59](https://github.com/python/cpython/commit/be98fda7c6698e8468afd528c864aca1f532af59) +- ref: 3f2cfd0462e13368092a + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12969596525) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [pystats raw](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-pystats.json) +- [pystats table](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-pystats.md) +- [raw results](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0.json) + +### vs. 3.12.6 + +- Geometric mean: 1.072x faster (HPT: reliability of 99.99%, 1.02x faster at 99th %ile) +- Memory usage: 1.13x +- missing benchmarks: aiohttp, chameleon, dask, flaskblogging, gunicorn, mypy2, tornado_http +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md) +- [📈time plot](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.030x faster (HPT: reliability of 99.95%, 1.01x faster at 99th %ile) +- Memory usage: 1.13x +- missing benchmarks: aiohttp, chameleon, dask, flaskblogging, gunicorn, tornado_http +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md) +- [📈time plot](bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12969596525) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-51-generic-x86_64-with-glibc2.39 +- [raw results](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0.json) + +### vs. 3.12.6 + +- Geometric mean: 1.088x faster (HPT: reliability of 100.00%, 1.04x faster at 99th %ile) +- Memory usage: 1.11x +- missing benchmarks: aiohttp, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, tornado_http +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.md) +- [📈time plot](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.050x faster (HPT: reliability of 100.00%, 1.01x faster at 99th %ile) +- Memory usage: 1.10x +- missing benchmarks: aiohttp, chameleon, dask, flaskblogging, gunicorn, html5lib, tornado_http +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.md) +- [📈time plot](bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4%2B-3f2cfd0-vs-3.13.0rc2.svg) + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md new file mode 100644 index 00000000..da53cc74 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md @@ -0,0 +1,179 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.072x faster +- HPT reliability: 99.99% +- HPT 99th percentile: 1.02x faster +- Memory change: 1.13x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 531 ms: 1.16x slower | +| docutils | 4.00 sec | 3.67 sec: 1.09x faster | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (1): html5lib + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io | 1.85 sec | 885 ms: 2.09x faster | +| async_tree_io_tg | 1.93 sec | 954 ms: 2.03x faster | +| async_tree_none | 741 ms | 395 ms: 1.88x faster | +| async_tree_memoization_tg | 930 ms | 504 ms: 1.85x faster | +| async_tree_memoization | 977 ms | 566 ms: 1.73x faster | +| async_tree_none_tg | 704 ms | 431 ms: 1.64x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 701 ms: 1.57x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 710 ms: 1.52x faster | +| async_generators | 589 ms | 529 ms: 1.11x faster | +| asyncio_websockets | 748 ms | 783 ms: 1.05x slower | +| asyncio_tcp | 923 ms | 981 ms: 1.06x slower | +| coroutines | 29.5 ms | 33.1 ms: 1.12x slower | +| Geometric mean | (ref) | 1.41x faster | + +Benchmark hidden because not significant (1): asyncio_tcp_ssl + +Benchmarks with tag 'math': +=========================== + +Benchmark hidden because not significant (3): nbody, pidigits, float + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_compile | 187 ms | 159 ms: 1.18x faster | +| regex_effbot | 5.13 ms | 4.76 ms: 1.08x faster | +| regex_v8 | 32.5 ms | 35.1 ms: 1.08x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (1): regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|---------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 241 ms | 195 ms: 1.23x faster | +| tomli_loads | 2.88 sec | 2.44 sec: 1.18x faster | +| xml_etree_generate | 127 ms | 114 ms: 1.12x faster | +| xml_etree_iterparse | 169 ms | 153 ms: 1.11x faster | +| pickle_list | 6.97 us | 7.62 us: 1.09x slower | +| unpickle_list | 6.83 us | 7.50 us: 1.10x slower | +| json_dumps | 14.3 ms | 17.9 ms: 1.25x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (7): unpickle_pure_python, pickle_dict, unpickle, json_loads, xml_etree_process, pickle_pure_python, pickle + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 16.0 ms: 1.10x faster | +| python_startup | 23.7 ms | 29.3 ms: 1.23x slower | +| Geometric mean | (ref) | 1.06x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| mako | 15.7 ms | 16.7 ms: 1.06x slower | +| django_template | 44.9 ms | 50.5 ms: 1.12x slower | +| Geometric mean | (ref) | 1.05x slower | + +Benchmark hidden because not significant (2): genshi_xml, genshi_text + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io | 1.85 sec | 885 ms: 2.09x faster | +| async_tree_io_tg | 1.93 sec | 954 ms: 2.03x faster | +| async_tree_none | 741 ms | 395 ms: 1.88x faster | +| async_tree_memoization_tg | 930 ms | 504 ms: 1.85x faster | +| async_tree_memoization | 977 ms | 566 ms: 1.73x faster | +| async_tree_none_tg | 704 ms | 431 ms: 1.64x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 701 ms: 1.57x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 710 ms: 1.52x faster | +| sqlalchemy_declarative | 218 ms | 172 ms: 1.26x faster | +| deepcopy | 468 us | 371 us: 1.26x faster | +| xml_etree_parse | 241 ms | 195 ms: 1.23x faster | +| pylint | 465 ms | 381 ms: 1.22x faster | +| tomli_loads | 2.88 sec | 2.44 sec: 1.18x faster | +| raytrace | 408 ms | 346 ms: 1.18x faster | +| regex_compile | 187 ms | 159 ms: 1.18x faster | +| deepcopy_memo | 52.4 us | 45.7 us: 1.15x faster | +| sqlglot_parse | 1.79 ms | 1.57 ms: 1.14x faster | +| pyflate | 727 ms | 639 ms: 1.14x faster | +| spectral_norm | 156 ms | 137 ms: 1.13x faster | +| comprehensions | 27.1 us | 24.2 us: 1.12x faster | +| xml_etree_generate | 127 ms | 114 ms: 1.12x faster | +| pycparser | 1.79 sec | 1.61 sec: 1.12x faster | +| scimark_monte_carlo | 96.4 ms | 86.5 ms: 1.11x faster | +| async_generators | 589 ms | 529 ms: 1.11x faster | +| typing_runtime_protocols | 224 us | 203 us: 1.11x faster | +| xml_etree_iterparse | 169 ms | 153 ms: 1.11x faster | +| mdp | 3.97 sec | 3.60 sec: 1.10x faster | +| python_startup_no_site | 17.6 ms | 16.0 ms: 1.10x faster | +| bpe_tokeniser | 6.59 sec | 6.00 sec: 1.10x faster | +| richards_super | 72.8 ms | 66.8 ms: 1.09x faster | +| docutils | 4.00 sec | 3.67 sec: 1.09x faster | +| sqlglot_optimize | 76.0 ms | 69.8 ms: 1.09x faster | +| deepcopy_reduce | 4.04 us | 3.71 us: 1.09x faster | +| regex_effbot | 5.13 ms | 4.76 ms: 1.08x faster | +| pathlib | 31.6 ms | 29.5 ms: 1.07x faster | +| meteor_contest | 146 ms | 137 ms: 1.06x faster | +| richards | 60.3 ms | 56.7 ms: 1.06x faster | +| pprint_pformat | 1.98 sec | 1.88 sec: 1.05x faster | +| sympy_str | 385 ms | 368 ms: 1.05x faster | +| scimark_fft | 500 ms | 478 ms: 1.05x faster | +| asyncio_websockets | 748 ms | 783 ms: 1.05x slower | +| generators | 41.1 ms | 43.6 ms: 1.06x slower | +| asyncio_tcp | 923 ms | 981 ms: 1.06x slower | +| mako | 15.7 ms | 16.7 ms: 1.06x slower | +| json | 6.85 ms | 7.28 ms: 1.06x slower | +| regex_v8 | 32.5 ms | 35.1 ms: 1.08x slower | +| thrift | 1.06 ms | 1.15 ms: 1.09x slower | +| telco | 9.59 ms | 10.5 ms: 1.09x slower | +| pickle_list | 6.97 us | 7.62 us: 1.09x slower | +| unpickle_list | 6.83 us | 7.50 us: 1.10x slower | +| logging_silent | 139 ns | 153 ns: 1.10x slower | +| coroutines | 29.5 ms | 33.1 ms: 1.12x slower | +| django_template | 44.9 ms | 50.5 ms: 1.12x slower | +| 2to3 | 456 ms | 531 ms: 1.16x slower | +| python_startup | 23.7 ms | 29.3 ms: 1.23x slower | +| json_dumps | 14.3 ms | 17.9 ms: 1.25x slower | +| coverage | 95.4 ms | 123 ms: 1.29x slower | +| gc_traversal | 5.86 ms | 9.82 ms: 1.68x slower | +| create_gc_cycles | 1.94 ms | 4.18 ms: 2.16x slower | +| bench_mp_pool | 20.7 ms | 97.4 ms: 4.70x slower | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (38): logging_format, bench_thread_pool, sqlglot_normalize, sympy_sum, unpickle_pure_python, nbody, pickle_dict, scimark_sor, pidigits, unpickle, deltablue, unpack_sequence, genshi_xml, logging_simple, sqlalchemy_imperative, fannkuch, float, sqlglot_transpile, pprint_safe_repr, sympy_integrate, asyncio_tcp_ssl, scimark_lu, dulwich_log, chaos, crypto_pyaes, nqueens, genshi_text, go, regex_dna, html5lib, json_loads, sqlite_synth, scimark_sparse_mat_mult, sympy_expand, xml_etree_process, hexiom, pickle_pure_python, pickle +Ignored benchmarks (7) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, mypy2, tornado_http +Ignored benchmarks (6) of results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.072x faster + +# HPT report + +- Reliability score: 99.99% likely to be faster +- 90% likely to have a speedup of 1.03x +- 95% likely to have a speedup of 1.02x +- 99% likely to have a speedup of 1.02x + +# Memory +- memory change: 1.13x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg new file mode 100644 index 00000000..5fd2f2d5 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg @@ -0,0 +1,3246 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md new file mode 100644 index 00000000..3dba0645 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md @@ -0,0 +1,196 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.030x faster +- HPT reliability: 99.95% +- HPT 99th percentile: 1.01x faster +- Memory change: 1.13x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 445 ms | 531 ms: 1.19x slower | +| docutils | 4.01 sec | 3.67 sec: 1.09x faster | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (1): html5lib + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io | 1.39 sec | 885 ms: 1.57x faster | +| async_tree_io_tg | 1.40 sec | 954 ms: 1.47x faster | +| async_tree_none | 572 ms | 395 ms: 1.45x faster | +| async_tree_memoization_tg | 670 ms | 504 ms: 1.33x faster | +| async_tree_memoization | 709 ms | 566 ms: 1.25x faster | +| async_tree_cpu_io_mixed | 889 ms | 710 ms: 1.25x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 701 ms: 1.21x faster | +| async_tree_none_tg | 504 ms | 431 ms: 1.17x faster | +| async_generators | 567 ms | 529 ms: 1.07x faster | +| coroutines | 30.9 ms | 33.1 ms: 1.07x slower | +| Geometric mean | (ref) | 1.19x faster | + +Benchmark hidden because not significant (3): asyncio_tcp_ssl, asyncio_websockets, asyncio_tcp + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 116 ms | 123 ms: 1.06x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (2): nbody, pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_compile | 182 ms | 159 ms: 1.15x faster | +| regex_v8 | 32.8 ms | 35.1 ms: 1.07x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): regex_effbot, regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|---------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 231 ms | 195 ms: 1.18x faster | +| xml_etree_iterparse | 177 ms | 153 ms: 1.16x faster | +| tomli_loads | 2.78 sec | 2.44 sec: 1.14x faster | +| xml_etree_generate | 122 ms | 114 ms: 1.08x faster | +| pickle_dict | 47.2 us | 51.2 us: 1.09x slower | +| pickle_pure_python | 416 us | 456 us: 1.09x slower | +| pickle_list | 6.86 us | 7.62 us: 1.11x slower | +| unpickle_list | 6.68 us | 7.50 us: 1.12x slower | +| pickle | 15.1 us | 17.3 us: 1.14x slower | +| json_loads | 34.3 us | 39.1 us: 1.14x slower | +| json_dumps | 14.1 ms | 17.9 ms: 1.27x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (3): unpickle_pure_python, unpickle, xml_etree_process + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 16.0 ms: 1.04x slower | +| python_startup | 22.4 ms | 29.3 ms: 1.31x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 72.1 ms | 66.6 ms: 1.08x faster | +| mako | 15.9 ms | 16.7 ms: 1.05x slower | +| django_template | 44.3 ms | 50.5 ms: 1.14x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (1): genshi_text + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io | 1.39 sec | 885 ms: 1.57x faster | +| async_tree_io_tg | 1.40 sec | 954 ms: 1.47x faster | +| async_tree_none | 572 ms | 395 ms: 1.45x faster | +| deepcopy | 498 us | 371 us: 1.34x faster | +| async_tree_memoization_tg | 670 ms | 504 ms: 1.33x faster | +| async_tree_memoization | 709 ms | 566 ms: 1.25x faster | +| unpack_sequence | 74.3 ns | 59.3 ns: 1.25x faster | +| async_tree_cpu_io_mixed | 889 ms | 710 ms: 1.25x faster | +| pylint | 470 ms | 381 ms: 1.23x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 701 ms: 1.21x faster | +| xml_etree_parse | 231 ms | 195 ms: 1.18x faster | +| async_tree_none_tg | 504 ms | 431 ms: 1.17x faster | +| telco | 12.2 ms | 10.5 ms: 1.16x faster | +| xml_etree_iterparse | 177 ms | 153 ms: 1.16x faster | +| richards | 65.5 ms | 56.7 ms: 1.15x faster | +| regex_compile | 182 ms | 159 ms: 1.15x faster | +| spectral_norm | 157 ms | 137 ms: 1.14x faster | +| tomli_loads | 2.78 sec | 2.44 sec: 1.14x faster | +| sqlglot_parse | 1.76 ms | 1.57 ms: 1.12x faster | +| typing_runtime_protocols | 226 us | 203 us: 1.11x faster | +| deepcopy_reduce | 4.10 us | 3.71 us: 1.10x faster | +| deepcopy_memo | 50.1 us | 45.7 us: 1.10x faster | +| richards_super | 73.2 ms | 66.8 ms: 1.10x faster | +| scimark_sor | 179 ms | 163 ms: 1.10x faster | +| docutils | 4.01 sec | 3.67 sec: 1.09x faster | +| meteor_contest | 150 ms | 137 ms: 1.09x faster | +| go | 191 ms | 176 ms: 1.09x faster | +| genshi_xml | 72.1 ms | 66.6 ms: 1.08x faster | +| xml_etree_generate | 122 ms | 114 ms: 1.08x faster | +| async_generators | 567 ms | 529 ms: 1.07x faster | +| sqlglot_optimize | 74.7 ms | 69.8 ms: 1.07x faster | +| deltablue | 4.44 ms | 4.19 ms: 1.06x faster | +| mdp | 3.80 sec | 3.60 sec: 1.06x faster | +| scimark_monte_carlo | 90.6 ms | 86.5 ms: 1.05x faster | +| bpe_tokeniser | 6.28 sec | 6.00 sec: 1.05x faster | +| pyflate | 664 ms | 639 ms: 1.04x faster | +| pprint_pformat | 1.94 sec | 1.88 sec: 1.04x faster | +| python_startup_no_site | 15.3 ms | 16.0 ms: 1.04x slower | +| scimark_lu | 146 ms | 153 ms: 1.05x slower | +| mako | 15.9 ms | 16.7 ms: 1.05x slower | +| thrift | 1.10 ms | 1.15 ms: 1.05x slower | +| nqueens | 112 ms | 118 ms: 1.06x slower | +| float | 116 ms | 123 ms: 1.06x slower | +| sqlglot_transpile | 2.20 ms | 2.33 ms: 1.06x slower | +| hexiom | 8.11 ms | 8.63 ms: 1.06x slower | +| regex_v8 | 32.8 ms | 35.1 ms: 1.07x slower | +| coroutines | 30.9 ms | 33.1 ms: 1.07x slower | +| dulwich_log | 93.7 ms | 101 ms: 1.08x slower | +| crypto_pyaes | 100 ms | 108 ms: 1.08x slower | +| sqlglot_normalize | 140 ms | 151 ms: 1.08x slower | +| pickle_dict | 47.2 us | 51.2 us: 1.09x slower | +| comprehensions | 22.2 us | 24.2 us: 1.09x slower | +| generators | 40.0 ms | 43.6 ms: 1.09x slower | +| pickle_pure_python | 416 us | 456 us: 1.09x slower | +| logging_simple | 8.56 us | 9.37 us: 1.09x slower | +| pickle_list | 6.86 us | 7.62 us: 1.11x slower | +| json | 6.51 ms | 7.28 ms: 1.12x slower | +| unpickle_list | 6.68 us | 7.50 us: 1.12x slower | +| pickle | 15.1 us | 17.3 us: 1.14x slower | +| django_template | 44.3 ms | 50.5 ms: 1.14x slower | +| json_loads | 34.3 us | 39.1 us: 1.14x slower | +| coverage | 107 ms | 123 ms: 1.15x slower | +| bench_thread_pool | 2.89 ms | 3.35 ms: 1.16x slower | +| logging_silent | 130 ns | 153 ns: 1.18x slower | +| 2to3 | 445 ms | 531 ms: 1.19x slower | +| json_dumps | 14.1 ms | 17.9 ms: 1.27x slower | +| python_startup | 22.4 ms | 29.3 ms: 1.31x slower | +| gc_traversal | 5.70 ms | 9.82 ms: 1.72x slower | +| create_gc_cycles | 2.41 ms | 4.18 ms: 1.73x slower | +| bench_mp_pool | 18.7 ms | 97.4 ms: 5.21x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (26): genshi_text, sympy_str, nbody, pidigits, pprint_safe_repr, fannkuch, pathlib, html5lib, sympy_integrate, logging_format, unpickle_pure_python, sqlite_synth, raytrace, sympy_expand, regex_effbot, scimark_fft, unpickle, regex_dna, xml_etree_process, asyncio_tcp_ssl, sympy_sum, pycparser, chaos, asyncio_websockets, scimark_sparse_mat_mult, asyncio_tcp +Ignored benchmarks (6) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, tornado_http +Ignored benchmarks (8) of results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.030x faster + +# HPT report + +- Reliability score: 99.95% likely to be faster +- 90% likely to have a speedup of 1.02x +- 95% likely to have a speedup of 1.02x +- 99% likely to have a speedup of 1.01x + +# Memory +- memory change: 1.13x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg new file mode 100644 index 00000000..a82c69f2 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg @@ -0,0 +1,3160 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md new file mode 100644 index 00000000..a2d1164f --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.md @@ -0,0 +1,219 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.088x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.04x faster +- Memory change: 1.11x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 254 ms: 1.04x faster | +| docutils | 2.64 sec | 2.57 sec: 1.03x faster | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 624 ms: 1.78x faster | +| async_tree_memoization_tg | 560 ms | 315 ms: 1.77x faster | +| async_tree_io | 1.08 sec | 627 ms: 1.73x faster | +| async_tree_memoization | 555 ms | 325 ms: 1.71x faster | +| async_tree_none | 464 ms | 272 ms: 1.71x faster | +| async_tree_none_tg | 446 ms | 264 ms: 1.69x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 492 ms: 1.47x faster | +| async_tree_cpu_io_mixed | 715 ms | 505 ms: 1.42x faster | +| async_generators | 384 ms | 326 ms: 1.18x faster | +| coroutines | 23.9 ms | 21.0 ms: 1.14x faster | +| asyncio_tcp | 519 ms | 498 ms: 1.04x faster | +| Geometric mean | (ref) | 1.40x faster | + +Benchmark hidden because not significant (2): asyncio_tcp_ssl, asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 80.8 ms | 71.2 ms: 1.13x faster | +| pidigits | 184 ms | 207 ms: 1.12x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (1): nbody + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.17 ms | 2.64 ms: 1.20x faster | +| regex_compile | 142 ms | 127 ms: 1.12x faster | +| regex_dna | 168 ms | 171 ms: 1.02x slower | +| regex_v8 | 20.6 ms | 23.3 ms: 1.13x slower | +| Geometric mean | (ref) | 1.04x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| tomli_loads | 2.11 sec | 1.90 sec: 1.11x faster | +| xml_etree_parse | 139 ms | 127 ms: 1.09x faster | +| unpickle_pure_python | 221 us | 212 us: 1.04x faster | +| unpickle | 14.1 us | 13.7 us: 1.03x faster | +| xml_etree_generate | 85.2 ms | 83.9 ms: 1.02x faster | +| pickle_dict | 31.8 us | 31.5 us: 1.01x faster | +| xml_etree_process | 59.0 ms | 59.2 ms: 1.00x slower | +| xml_etree_iterparse | 96.7 ms | 99.8 ms: 1.03x slower | +| pickle_pure_python | 308 us | 318 us: 1.03x slower | +| pickle_list | 4.77 us | 4.98 us: 1.04x slower | +| unpickle_list | 4.67 us | 4.91 us: 1.05x slower | +| json_loads | 26.5 us | 29.0 us: 1.09x slower | +| json_dumps | 10.4 ms | 11.3 ms: 1.09x slower | +| pickle | 10.9 us | 12.3 us: 1.13x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 7.46 ms: 1.04x slower | +| python_startup | 9.93 ms | 14.7 ms: 1.48x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 22.8 ms | 21.3 ms: 1.07x faster | +| genshi_xml | 50.2 ms | 49.4 ms: 1.02x faster | +| django_template | 34.7 ms | 35.4 ms: 1.02x slower | +| mako | 11.0 ms | 11.7 ms: 1.06x slower | +| Geometric mean | (ref) | 1.00x faster | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 624 ms: 1.78x faster | +| async_tree_memoization_tg | 560 ms | 315 ms: 1.77x faster | +| async_tree_io | 1.08 sec | 627 ms: 1.73x faster | +| async_tree_memoization | 555 ms | 325 ms: 1.71x faster | +| async_tree_none | 464 ms | 272 ms: 1.71x faster | +| async_tree_none_tg | 446 ms | 264 ms: 1.69x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 492 ms: 1.47x faster | +| async_tree_cpu_io_mixed | 715 ms | 505 ms: 1.42x faster | +| deepcopy | 352 us | 261 us: 1.35x faster | +| deepcopy_memo | 40.3 us | 30.0 us: 1.34x faster | +| go | 139 ms | 113 ms: 1.23x faster | +| regex_effbot | 3.17 ms | 2.64 ms: 1.20x faster | +| comprehensions | 19.8 us | 16.6 us: 1.20x faster | +| async_generators | 384 ms | 326 ms: 1.18x faster | +| pathlib | 21.5 ms | 18.4 ms: 1.17x faster | +| spectral_norm | 110 ms | 94.9 ms: 1.16x faster | +| deepcopy_reduce | 3.08 us | 2.66 us: 1.16x faster | +| raytrace | 299 ms | 262 ms: 1.14x faster | +| coroutines | 23.9 ms | 21.0 ms: 1.14x faster | +| crypto_pyaes | 76.6 ms | 67.2 ms: 1.14x faster | +| chaos | 62.8 ms | 55.1 ms: 1.14x faster | +| scimark_sor | 130 ms | 114 ms: 1.14x faster | +| float | 80.8 ms | 71.2 ms: 1.13x faster | +| pylint | 319 ms | 281 ms: 1.13x faster | +| sqlalchemy_imperative | 21.8 ms | 19.3 ms: 1.13x faster | +| bpe_tokeniser | 4.74 sec | 4.20 sec: 1.13x faster | +| deltablue | 3.45 ms | 3.06 ms: 1.13x faster | +| generators | 32.2 ms | 28.7 ms: 1.12x faster | +| regex_compile | 142 ms | 127 ms: 1.12x faster | +| sqlalchemy_declarative | 143 ms | 128 ms: 1.11x faster | +| tomli_loads | 2.11 sec | 1.90 sec: 1.11x faster | +| scimark_fft | 342 ms | 309 ms: 1.11x faster | +| pyflate | 448 ms | 408 ms: 1.10x faster | +| xml_etree_parse | 139 ms | 127 ms: 1.09x faster | +| richards | 45.9 ms | 42.1 ms: 1.09x faster | +| sqlglot_parse | 1.36 ms | 1.25 ms: 1.09x faster | +| sympy_sum | 166 ms | 154 ms: 1.08x faster | +| logging_simple | 6.63 us | 6.15 us: 1.08x faster | +| sqlglot_transpile | 1.67 ms | 1.55 ms: 1.08x faster | +| sympy_str | 292 ms | 272 ms: 1.07x faster | +| richards_super | 51.9 ms | 48.4 ms: 1.07x faster | +| thrift | 791 us | 739 us: 1.07x faster | +| genshi_text | 22.8 ms | 21.3 ms: 1.07x faster | +| logging_silent | 109 ns | 102 ns: 1.07x faster | +| scimark_monte_carlo | 68.4 ms | 64.1 ms: 1.07x faster | +| hexiom | 6.17 ms | 5.79 ms: 1.06x faster | +| pprint_pformat | 1.52 sec | 1.43 sec: 1.06x faster | +| logging_format | 7.35 us | 6.95 us: 1.06x faster | +| pprint_safe_repr | 743 ms | 703 ms: 1.06x faster | +| pycparser | 1.17 sec | 1.12 sec: 1.05x faster | +| scimark_sparse_mat_mult | 4.39 ms | 4.20 ms: 1.05x faster | +| typing_runtime_protocols | 163 us | 156 us: 1.04x faster | +| dulwich_log | 78.9 ms | 75.6 ms: 1.04x faster | +| asyncio_tcp | 519 ms | 498 ms: 1.04x faster | +| unpack_sequence | 52.1 ns | 50.1 ns: 1.04x faster | +| unpickle_pure_python | 221 us | 212 us: 1.04x faster | +| 2to3 | 264 ms | 254 ms: 1.04x faster | +| sympy_integrate | 20.5 ms | 19.9 ms: 1.03x faster | +| mdp | 2.42 sec | 2.34 sec: 1.03x faster | +| meteor_contest | 104 ms | 100 ms: 1.03x faster | +| docutils | 2.64 sec | 2.57 sec: 1.03x faster | +| scimark_lu | 114 ms | 111 ms: 1.03x faster | +| unpickle | 14.1 us | 13.7 us: 1.03x faster | +| nqueens | 80.1 ms | 78.1 ms: 1.03x faster | +| sqlglot_optimize | 53.3 ms | 52.0 ms: 1.02x faster | +| sqlglot_normalize | 107 ms | 104 ms: 1.02x faster | +| sympy_expand | 468 ms | 458 ms: 1.02x faster | +| xml_etree_generate | 85.2 ms | 83.9 ms: 1.02x faster | +| genshi_xml | 50.2 ms | 49.4 ms: 1.02x faster | +| pickle_dict | 31.8 us | 31.5 us: 1.01x faster | +| fannkuch | 372 ms | 370 ms: 1.01x faster | +| xml_etree_process | 59.0 ms | 59.2 ms: 1.00x slower | +| json | 5.02 ms | 5.10 ms: 1.01x slower | +| regex_dna | 168 ms | 171 ms: 1.02x slower | +| django_template | 34.7 ms | 35.4 ms: 1.02x slower | +| xml_etree_iterparse | 96.7 ms | 99.8 ms: 1.03x slower | +| pickle_pure_python | 308 us | 318 us: 1.03x slower | +| python_startup_no_site | 7.16 ms | 7.46 ms: 1.04x slower | +| pickle_list | 4.77 us | 4.98 us: 1.04x slower | +| unpickle_list | 4.67 us | 4.91 us: 1.05x slower | +| mako | 11.0 ms | 11.7 ms: 1.06x slower | +| json_loads | 26.5 us | 29.0 us: 1.09x slower | +| json_dumps | 10.4 ms | 11.3 ms: 1.09x slower | +| bench_thread_pool | 941 us | 1.03 ms: 1.09x slower | +| telco | 6.53 ms | 7.15 ms: 1.10x slower | +| pidigits | 184 ms | 207 ms: 1.12x slower | +| coverage | 71.4 ms | 80.3 ms: 1.13x slower | +| pickle | 10.9 us | 12.3 us: 1.13x slower | +| regex_v8 | 20.6 ms | 23.3 ms: 1.13x slower | +| gc_traversal | 3.46 ms | 4.33 ms: 1.25x slower | +| python_startup | 9.93 ms | 14.7 ms: 1.48x slower | +| create_gc_cycles | 1.09 ms | 1.85 ms: 1.70x slower | +| bench_mp_pool | 10.8 ms | 88.5 ms: 8.20x slower | +| Geometric mean | (ref) | 1.05x faster | + +Benchmark hidden because not significant (4): sqlite_synth, nbody, asyncio_tcp_ssl, asyncio_websockets +Ignored benchmarks (8) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, tornado_http +Ignored benchmarks (6) of results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.088x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.05x +- 95% likely to have a speedup of 1.05x +- 99% likely to have a speedup of 1.04x + +# Memory +- memory change: 1.11x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg new file mode 100644 index 00000000..2af80ee3 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.12.6.svg @@ -0,0 +1,3067 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md new file mode 100644 index 00000000..2b77b9c8 --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md @@ -0,0 +1,215 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 3f2cfd0462e13368092a +- machine: linux-x86_64 +- commit hash: 3f2cfd0 +- commit date: 2025-01-25 +- overall geometric mean: 1.050x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.01x faster +- Memory change: 1.10x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 254 ms: 1.02x faster | +| docutils | 2.62 sec | 2.57 sec: 1.02x faster | +| Geometric mean | (ref) | 1.02x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 624 ms: 1.46x faster | +| async_tree_memoization | 461 ms | 325 ms: 1.42x faster | +| async_tree_io | 876 ms | 627 ms: 1.40x faster | +| async_tree_cpu_io_mixed | 666 ms | 505 ms: 1.32x faster | +| async_tree_memoization_tg | 414 ms | 315 ms: 1.31x faster | +| async_tree_none | 354 ms | 272 ms: 1.30x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 492 ms: 1.30x faster | +| async_tree_none_tg | 336 ms | 264 ms: 1.27x faster | +| async_generators | 377 ms | 326 ms: 1.16x faster | +| coroutines | 23.6 ms | 21.0 ms: 1.12x faster | +| asyncio_tcp | 505 ms | 498 ms: 1.02x faster | +| asyncio_websockets | 520 ms | 517 ms: 1.01x faster | +| asyncio_tcp_ssl | 1.51 sec | 1.51 sec: 1.00x faster | +| Geometric mean | (ref) | 1.23x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 77.5 ms | 71.2 ms: 1.09x faster | +| pidigits | 217 ms | 207 ms: 1.05x faster | +| nbody | 85.1 ms | 89.0 ms: 1.05x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.64 ms: 1.17x faster | +| regex_dna | 180 ms | 171 ms: 1.06x faster | +| regex_compile | 132 ms | 127 ms: 1.04x faster | +| regex_v8 | 22.7 ms | 23.3 ms: 1.03x slower | +| Geometric mean | (ref) | 1.06x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 136 ms | 127 ms: 1.07x faster | +| tomli_loads | 2.01 sec | 1.90 sec: 1.06x faster | +| unpickle | 14.3 us | 13.7 us: 1.05x faster | +| pickle_dict | 32.5 us | 31.5 us: 1.03x faster | +| xml_etree_generate | 85.4 ms | 83.9 ms: 1.02x faster | +| pickle_list | 4.93 us | 4.98 us: 1.01x slower | +| unpickle_pure_python | 210 us | 212 us: 1.01x slower | +| unpickle_list | 4.71 us | 4.91 us: 1.04x slower | +| xml_etree_iterparse | 94.9 ms | 99.8 ms: 1.05x slower | +| json_loads | 27.0 us | 29.0 us: 1.07x slower | +| json_dumps | 10.5 ms | 11.3 ms: 1.07x slower | +| pickle_pure_python | 294 us | 318 us: 1.08x slower | +| pickle | 11.3 us | 12.3 us: 1.09x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmark hidden because not significant (1): xml_etree_process + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 7.46 ms: 1.01x slower | +| python_startup | 11.0 ms | 14.7 ms: 1.34x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 21.5 ms | 21.3 ms: 1.01x faster | +| genshi_xml | 48.8 ms | 49.4 ms: 1.01x slower | +| mako | 11.3 ms | 11.7 ms: 1.03x slower | +| django_template | 34.1 ms | 35.4 ms: 1.04x slower | +| Geometric mean | (ref) | 1.02x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 624 ms: 1.46x faster | +| async_tree_memoization | 461 ms | 325 ms: 1.42x faster | +| async_tree_io | 876 ms | 627 ms: 1.40x faster | +| deepcopy | 355 us | 261 us: 1.36x faster | +| async_tree_cpu_io_mixed | 666 ms | 505 ms: 1.32x faster | +| async_tree_memoization_tg | 414 ms | 315 ms: 1.31x faster | +| deepcopy_memo | 39.1 us | 30.0 us: 1.30x faster | +| async_tree_none | 354 ms | 272 ms: 1.30x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 492 ms: 1.30x faster | +| async_tree_none_tg | 336 ms | 264 ms: 1.27x faster | +| go | 141 ms | 113 ms: 1.25x faster | +| scimark_sor | 134 ms | 114 ms: 1.18x faster | +| deepcopy_reduce | 3.11 us | 2.66 us: 1.17x faster | +| spectral_norm | 111 ms | 94.9 ms: 1.17x faster | +| regex_effbot | 3.08 ms | 2.64 ms: 1.17x faster | +| async_generators | 377 ms | 326 ms: 1.16x faster | +| scimark_fft | 349 ms | 309 ms: 1.13x faster | +| pylint | 317 ms | 281 ms: 1.13x faster | +| coroutines | 23.6 ms | 21.0 ms: 1.12x faster | +| scimark_sparse_mat_mult | 4.71 ms | 4.20 ms: 1.12x faster | +| pyflate | 449 ms | 408 ms: 1.10x faster | +| telco | 7.82 ms | 7.15 ms: 1.09x faster | +| float | 77.5 ms | 71.2 ms: 1.09x faster | +| richards | 45.2 ms | 42.1 ms: 1.07x faster | +| xml_etree_parse | 136 ms | 127 ms: 1.07x faster | +| richards_super | 51.6 ms | 48.4 ms: 1.07x faster | +| bpe_tokeniser | 4.45 sec | 4.20 sec: 1.06x faster | +| tomli_loads | 2.01 sec | 1.90 sec: 1.06x faster | +| regex_dna | 180 ms | 171 ms: 1.06x faster | +| thrift | 778 us | 739 us: 1.05x faster | +| pprint_safe_repr | 738 ms | 703 ms: 1.05x faster | +| pidigits | 217 ms | 207 ms: 1.05x faster | +| unpickle | 14.3 us | 13.7 us: 1.05x faster | +| pprint_pformat | 1.50 sec | 1.43 sec: 1.04x faster | +| pathlib | 19.2 ms | 18.4 ms: 1.04x faster | +| regex_compile | 132 ms | 127 ms: 1.04x faster | +| chaos | 57.3 ms | 55.1 ms: 1.04x faster | +| pickle_dict | 32.5 us | 31.5 us: 1.03x faster | +| hexiom | 5.99 ms | 5.79 ms: 1.03x faster | +| coverage | 83.0 ms | 80.3 ms: 1.03x faster | +| 2to3 | 260 ms | 254 ms: 1.02x faster | +| scimark_monte_carlo | 65.4 ms | 64.1 ms: 1.02x faster | +| deltablue | 3.12 ms | 3.06 ms: 1.02x faster | +| docutils | 2.62 sec | 2.57 sec: 1.02x faster | +| xml_etree_generate | 85.4 ms | 83.9 ms: 1.02x faster | +| asyncio_tcp | 505 ms | 498 ms: 1.02x faster | +| sqlglot_optimize | 52.7 ms | 52.0 ms: 1.01x faster | +| sqlglot_normalize | 106 ms | 104 ms: 1.01x faster | +| scimark_lu | 113 ms | 111 ms: 1.01x faster | +| meteor_contest | 102 ms | 100 ms: 1.01x faster | +| sympy_sum | 156 ms | 154 ms: 1.01x faster | +| crypto_pyaes | 67.9 ms | 67.2 ms: 1.01x faster | +| genshi_text | 21.5 ms | 21.3 ms: 1.01x faster | +| sympy_str | 275 ms | 272 ms: 1.01x faster | +| sqlite_synth | 2.21 us | 2.19 us: 1.01x faster | +| asyncio_websockets | 520 ms | 517 ms: 1.01x faster | +| nqueens | 78.6 ms | 78.1 ms: 1.01x faster | +| mdp | 2.36 sec | 2.34 sec: 1.01x faster | +| logging_silent | 103 ns | 102 ns: 1.01x faster | +| sqlglot_transpile | 1.56 ms | 1.55 ms: 1.01x faster | +| generators | 28.8 ms | 28.7 ms: 1.00x faster | +| asyncio_tcp_ssl | 1.51 sec | 1.51 sec: 1.00x faster | +| sympy_integrate | 19.8 ms | 19.9 ms: 1.00x slower | +| comprehensions | 16.5 us | 16.6 us: 1.01x slower | +| python_startup_no_site | 7.39 ms | 7.46 ms: 1.01x slower | +| pickle_list | 4.93 us | 4.98 us: 1.01x slower | +| dulwich_log | 74.8 ms | 75.6 ms: 1.01x slower | +| typing_runtime_protocols | 155 us | 156 us: 1.01x slower | +| unpickle_pure_python | 210 us | 212 us: 1.01x slower | +| genshi_xml | 48.8 ms | 49.4 ms: 1.01x slower | +| logging_format | 6.84 us | 6.95 us: 1.02x slower | +| regex_v8 | 22.7 ms | 23.3 ms: 1.03x slower | +| mako | 11.3 ms | 11.7 ms: 1.03x slower | +| json | 4.93 ms | 5.10 ms: 1.03x slower | +| raytrace | 253 ms | 262 ms: 1.04x slower | +| django_template | 34.1 ms | 35.4 ms: 1.04x slower | +| unpickle_list | 4.71 us | 4.91 us: 1.04x slower | +| nbody | 85.1 ms | 89.0 ms: 1.05x slower | +| xml_etree_iterparse | 94.9 ms | 99.8 ms: 1.05x slower | +| json_loads | 27.0 us | 29.0 us: 1.07x slower | +| json_dumps | 10.5 ms | 11.3 ms: 1.07x slower | +| pickle_pure_python | 294 us | 318 us: 1.08x slower | +| pickle | 11.3 us | 12.3 us: 1.09x slower | +| unpack_sequence | 44.8 ns | 50.1 ns: 1.12x slower | +| bench_thread_pool | 919 us | 1.03 ms: 1.12x slower | +| python_startup | 11.0 ms | 14.7 ms: 1.34x slower | +| gc_traversal | 3.14 ms | 4.33 ms: 1.38x slower | +| create_gc_cycles | 1.34 ms | 1.85 ms: 1.38x slower | +| bench_mp_pool | 11.0 ms | 88.5 ms: 8.05x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (6): xml_etree_process, sqlglot_parse, logging_simple, fannkuch, pycparser, sympy_expand +Ignored benchmarks (7) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, html5lib, tornado_http +Ignored benchmarks (8) of results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.050x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.01x +- 95% likely to have a speedup of 1.01x +- 99% likely to have a speedup of 1.01x + +# Memory +- memory change: 1.10x \ No newline at end of file diff --git a/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg new file mode 100644 index 00000000..b0cc5cfb --- /dev/null +++ b/results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-vultr-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.svg @@ -0,0 +1,2959 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +