Skip to content

Commit

Permalink
Benchmarking results for @colesbury
Browse files Browse the repository at this point in the history
  • Loading branch information
colesbury committed Jan 22, 2025
1 parent 43e0fcf commit 95b8bc7
Show file tree
Hide file tree
Showing 15 changed files with 20,045 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,8 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE
## linux x86_64 (vultr)
| date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |
| --- | --- | --- | ---: | ---: | ---: |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL) | python/2ed5ee9a50454b3fce87 | 2ed5ee9 (NOGIL) | 1.079x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.svg) | 1.109x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.svg) | |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL) | colesbury/revert_gh_128914 | 68ce740 (NOGIL) | 1.056x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.12.6.svg) | 1.086x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.13.0rc2.svg) | 1.025x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base-mem.svg) |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-86c1a60) | python/86c1a60d5a28cfb51f88 | 86c1a60 | 1.089x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.svg) | 1.051x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.svg) | 1.001x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base-mem.svg) |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL) | python/86c1a60d5a28cfb51f88 | 86c1a60 (NOGIL) | 1.084x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.svg) | 1.113x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.svg) | |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-767cf70) | python/767cf708449fbf13826d | 767cf70 | 1.088x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.12.6.svg) | 1.050x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.13.0rc2.svg) | 1.004x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base-mem.svg) |
Expand Down
2 changes: 2 additions & 0 deletions RESULTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -279,6 +279,8 @@
## linux x86_64 (vultr)
| date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |
| --- | --- | --- | ---: | ---: | ---: |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL) | python/2ed5ee9a50454b3fce87 | 2ed5ee9 (NOGIL) | 1.079x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.svg) | 1.109x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-2ed5ee9-NOGIL/bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.svg) | |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL) | colesbury/revert_gh_128914 | 68ce740 (NOGIL) | 1.056x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.12.6.svg) | 1.086x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-3.13.0rc2.svg) | 1.025x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-68ce740-NOGIL/bm-20250122-vultr-x86_64-colesbury-revert_gh_128914-3.14.0a4%2B-68ce740-vs-base-mem.svg) |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-86c1a60) | python/86c1a60d5a28cfb51f88 | 86c1a60 | 1.089x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.svg) | 1.051x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.svg) | 1.001x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-86c1a60/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-base-mem.svg) |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL) | python/86c1a60d5a28cfb51f88 | 86c1a60 (NOGIL) | 1.084x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.12.6.svg) | 1.113x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-86c1a60-NOGIL/bm-20250122-vultr-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4%2B-86c1a60-vs-3.13.0rc2.svg) | |
| [2025-01-22](results/bm-20250122-3.14.0a4%2B-767cf70) | python/767cf708449fbf13826d | 767cf70 | 1.088x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.12.6.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.12.6.svg) | 1.050x ↑<br>[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.13.0rc2.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-3.13.0rc2.svg) | 1.004x ↓<br>[📄](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base.md)[📈](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base.svg)[🧠](results/bm-20250122-3.14.0a4%2B-767cf70/bm-20250122-vultr-x86_64-python-767cf708449fbf13826d-3.14.0a4%2B-767cf70-vs-base-mem.svg) |
Expand Down
35 changes: 35 additions & 0 deletions results/bm-20250122-3.14.0a4+-2ed5ee9-NOGIL/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
# Results

- fork: python/2ed5ee9a50454b3fce87
- version: 3.14.0a4+
- config: NOGIL
- commit hash: [2ed5ee9](https://github.com/python/cpython/commit/2ed5ee9)
- commit date: 2025-01-22T13:52:45+00:00
- commit merge base: [8e20e42cc63321dacc500d7670bfc225ca04e78b](https://github.com/python/cpython/commit/8e20e42cc63321dacc500d7670bfc225ca04e78b)
- ref: 2ed5ee9a50454b3fce87

## linux x86_64 (vultr)

- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12910324097)
- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz
- platform: Linux-6.8.0-51-generic-x86_64-with-glibc2.39
- [raw results](bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9.json)

### vs. 3.12.6

- Geometric mean: 1.079x slower (HPT: reliability of 100.00%, 1.06x slower at 99th %ile)
- Memory usage: 1.35x
- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers
- [📄table](bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.md)
- [📈time plot](bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.12.6.svg)

### vs. 3.13.0rc2

- Geometric mean: 1.109x slower (HPT: reliability of 100.00%, 1.08x slower at 99th %ile)
- Memory usage: 1.33x
- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
- [📄table](bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.md)
- [📈time plot](bm-20250122-vultr-x86_64-python-2ed5ee9a50454b3fce87-3.14.0a4%2B-2ed5ee9-vs-3.13.0rc2.svg)

Loading

0 comments on commit 95b8bc7

Please sign in to comment.