Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bump codecov/codecov-action from 4 to 5 #428

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Bump codecov/codecov-action from 4 to 5 #428

wants to merge 1 commit into from

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Nov 18, 2024

Bumps codecov/codecov-action from 4 to 5.

Release notes

Sourced from codecov/codecov-action's releases.

v5.0.0

v5 Release

v5 of the Codecov GitHub Action will use the Codecov Wrapper to encapsulate the CLI. This will help ensure that the Action gets updates quicker.

Migration Guide

The v5 release also coincides with the opt-out feature for tokens for public repositories. In the Global Upload Token section of the settings page of an organization in codecov.io, you can set the ability for Codecov to receive a coverage reports from any source. This will allow contributors or other members of a repository to upload without needing access to the Codecov token. For more details see how to upload without a token.

[!WARNING]
The following arguments have been changed

  • file (this has been deprecated in favor of files)
  • plugin (this has been deprecated in favor of plugins)

The following arguments have been added:

  • binary
  • gcov_args
  • gcov_executable
  • gcov_ignore
  • gcov_include
  • report_type
  • skip_validation
  • swift_project

You can see their usage in the action.yml file.

What's Changed

... (truncated)

Changelog

Sourced from codecov/codecov-action's changelog.

4.0.0-beta.2

Fixes

  • #1085 not adding -n if empty to do-upload command

4.0.0-beta.1

v4 represents a move from the universal uploader to the Codecov CLI. Although this will unlock new features for our users, the CLI is not yet at feature parity with the universal uploader.

Breaking Changes

  • No current support for aarch64 and alpine architectures.
  • Tokenless uploading is unsuported
  • Various arguments to the Action have been removed

3.1.4

Fixes

  • #967 Fix typo in README.md
  • #971 fix: add back in working dir
  • #969 fix: CLI option names for uploader

Dependencies

  • #970 build(deps-dev): bump @​types/node from 18.15.12 to 18.16.3
  • #979 build(deps-dev): bump @​types/node from 20.1.0 to 20.1.2
  • #981 build(deps-dev): bump @​types/node from 20.1.2 to 20.1.4

3.1.3

Fixes

  • #960 fix: allow for aarch64 build

Dependencies

  • #957 build(deps-dev): bump jest-junit from 15.0.0 to 16.0.0
  • #958 build(deps): bump openpgp from 5.7.0 to 5.8.0
  • #959 build(deps-dev): bump @​types/node from 18.15.10 to 18.15.12

3.1.2

Fixes

  • #718 Update README.md
  • #851 Remove unsupported path_to_write_report argument
  • #898 codeql-analysis.yml
  • #901 Update README to contain correct information - inputs and negate feature
  • #955 fix: add in all the extra arguments for uploader

Dependencies

  • #819 build(deps): bump openpgp from 5.4.0 to 5.5.0
  • #835 build(deps): bump node-fetch from 3.2.4 to 3.2.10
  • #840 build(deps): bump ossf/scorecard-action from 1.1.1 to 2.0.4
  • #841 build(deps): bump @​actions/core from 1.9.1 to 1.10.0
  • #843 build(deps): bump @​actions/github from 5.0.3 to 5.1.1
  • #869 build(deps): bump node-fetch from 3.2.10 to 3.3.0
  • #872 build(deps-dev): bump jest-junit from 13.2.0 to 15.0.0
  • #879 build(deps): bump decode-uri-component from 0.2.0 to 0.2.2

... (truncated)

Commits

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot
Bump codecov/codecov-action from 4 to 5
0b0e0ef 
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 4 to 5.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](codecov/codecov-action@v4...v5)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added the dependencies Pull requests that update a dependency file label Nov 18, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Nov 18, 2024 •
edited
Loading

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 18 Nov 2024 - 08:35
  • Baseline: 18 Nov 2024 - 08:42
  • Package commits:
  • Target: 1c31bd
  • Baseline: ce1dc0
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.88 (5%) ✅ 0.95 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.99 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.01 (5%) 1.02 (1%) ❌
["pauli", "mul", "20000000"] 1.10 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1975 s 0 s 163 s 7944 s 0 s
 #2 2445 MHz 1982 s 0 s 127 s 7978 s 0 s
 #3 3243 MHz 2123 s 0 s 147 s 7810 s 0 s
 #4 3215 MHz 2471 s 0 s 152 s 7460 s 0 s
 Memory: 15.606491088867188 GB (13604.3203125 MB free)
 Uptime: 1013.19 sec
 Load Avg: 1.0 1.01 0.72
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3219 MHz 2929 s 0 s 190 s 11029 s 0 s
 #2 3242 MHz 2975 s 0 s 165 s 11015 s 0 s
 #3 2445 MHz 3081 s 0 s 177 s 10889 s 0 s
 #4 2445 MHz 3623 s 0 s 185 s 10341 s 0 s
 Memory: 15.606491088867188 GB (13477.13671875 MB free)
 Uptime: 1420.54 sec
 Load Avg: 1.0 1.0 0.83
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 18 Nov 2024 - 8:35
  • Package commit: 1c31bd
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.998 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.232 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.718 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 189.693 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.164 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.782 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.169 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.278 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 61.184 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 160.729 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.042 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.142 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.706 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 151.853 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.037 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.703 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.159 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.213 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.814 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 995.863 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.010 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.520 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 813.605 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.098 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 49.432 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.343 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 27.311 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.473 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.018 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.517 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.734 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.098 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.414 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.863 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.152 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.157 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.649 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.344 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.628 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.325 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.698 ms (5%) 1.37 MiB (1%) 22207
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.763 ms (5%) 2.71 MiB (1%) 39980
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.090 ms (5%) 2.77 MiB (1%) 40402
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.286 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 50.951 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 51.461 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 388.984 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.112 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.438 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 787.403 ms (5%) 6.811 ms 169.55 MiB (1%) 582099
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.659 s (5%) 20.322 ms 354.36 MiB (1%) 1228730
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.632 s (5%) 18.079 ms 348.28 MiB (1%) 1218959
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 397.751 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 822.943 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 832.253 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.906 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.463 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.621 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.179 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.447 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.683 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.154 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 719.022 ns (5%)
["pauli", "mul", "20000000"] 205.393 μs (5%)
["stabilizer", "canon", "cano500"] 2.840 ms (5%)
["stabilizer", "canon", "diag_cano500"] 531.009 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.563 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 443.976 μs (5%)
["stabilizer", "canon", "gott500"] 10.746 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.362 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.358 ms (5%)
["stabilizer", "canon", "rref500"] 2.658 ms (5%)
["stabilizer", "project", "destabilizer"] 13.255 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 6.081 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.473 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.899 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.519 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.100 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1975 s 0 s 163 s 7944 s 0 s
 #2 2445 MHz 1982 s 0 s 127 s 7978 s 0 s
 #3 3243 MHz 2123 s 0 s 147 s 7810 s 0 s
 #4 3215 MHz 2471 s 0 s 152 s 7460 s 0 s
 Memory: 15.606491088867188 GB (13604.3203125 MB free)
 Uptime: 1013.19 sec
 Load Avg: 1.0 1.01 0.72
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 18 Nov 2024 - 8:42
  • Package commit: ce1dc0
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.982 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.210 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.728 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 190.444 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.263 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.621 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.261 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.188 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 58.519 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 160.538 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.026 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.891 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.456 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.410 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.023 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.680 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.139 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.212 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 123.800 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 978.833 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.012 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.513 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 813.734 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.027 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.093 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.363 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 27.371 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.483 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.015 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.518 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.483 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.017 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.410 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.291 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.150 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.038 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.648 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.344 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.608 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.334 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.698 ms (5%) 1.38 MiB (1%) 22239
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.804 ms (5%) 2.71 MiB (1%) 40036
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.631 ms (5%) 2.91 MiB (1%) 42282
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.286 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 52.142 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.081 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 388.123 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.106 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.433 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 794.809 ms (5%) 6.312 ms 173.32 MiB (1%) 594767
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.638 s (5%) 14.544 ms 347.43 MiB (1%) 1205438
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.663 s (5%) 17.073 ms 351.59 MiB (1%) 1230103
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 399.362 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 823.437 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 833.295 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.843 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.266 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.492 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.160 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.435 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.654 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.054 ns (5%)
["pauli", "mul", "1000"] 18.228 ns (5%)
["pauli", "mul", "100000"] 728.590 ns (5%)
["pauli", "mul", "20000000"] 186.958 μs (5%)
["stabilizer", "canon", "cano500"] 2.847 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.431 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.636 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 443.555 μs (5%)
["stabilizer", "canon", "gott500"] 10.804 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.389 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.356 ms (5%)
["stabilizer", "canon", "rref500"] 2.660 ms (5%)
["stabilizer", "project", "destabilizer"] 13.224 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 6.071 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.513 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.915 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.670 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.109 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3219 MHz 2929 s 0 s 190 s 11029 s 0 s
 #2 3242 MHz 2975 s 0 s 165 s 11015 s 0 s
 #3 2445 MHz 3081 s 0 s 177 s 10889 s 0 s
 #4 2445 MHz 3623 s 0 s 185 s 10341 s 0 s
 Memory: 15.606491088867188 GB (13477.13671875 MB free)
 Uptime: 1420.54 sec
 Load Avg: 1.0 1.0 0.83
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 18 Nov 2024 - 08:35
  • Baseline: 18 Nov 2024 - 08:42
  • Package commits:
  • Target: 1c31bd
  • Baseline: ce1dc0
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.88 (5%) ✅ 0.95 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.99 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.01 (5%) 1.02 (1%) ❌
["pauli", "mul", "20000000"] 1.10 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1975 s 0 s 163 s 7944 s 0 s
 #2 2445 MHz 1982 s 0 s 127 s 7978 s 0 s
 #3 3243 MHz 2123 s 0 s 147 s 7810 s 0 s
 #4 3215 MHz 2471 s 0 s 152 s 7460 s 0 s
 Memory: 15.606491088867188 GB (13604.3203125 MB free)
 Uptime: 1013.19 sec
 Load Avg: 1.0 1.01 0.72
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3219 MHz 2929 s 0 s 190 s 11029 s 0 s
 #2 3242 MHz 2975 s 0 s 165 s 11015 s 0 s
 #3 2445 MHz 3081 s 0 s 177 s 10889 s 0 s
 #4 2445 MHz 3623 s 0 s 185 s 10341 s 0 s
 Memory: 15.606491088867188 GB (13477.13671875 MB free)
 Uptime: 1420.54 sec
 Load Avg: 1.0 1.0 0.83
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 18 Nov 2024 - 8:35
  • Package commit: 1c31bd
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.998 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.232 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.718 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 189.693 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.164 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.782 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.169 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.278 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 61.184 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 160.729 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.042 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.142 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.706 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 151.853 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.037 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.703 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.159 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.213 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.814 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 995.863 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.010 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.520 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 813.605 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.098 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 49.432 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.343 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 27.311 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.473 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.018 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.517 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.734 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.098 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.414 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.863 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.152 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.157 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.649 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.344 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.628 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.325 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.698 ms (5%) 1.37 MiB (1%) 22207
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.763 ms (5%) 2.71 MiB (1%) 39980
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.090 ms (5%) 2.77 MiB (1%) 40402
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.286 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 50.951 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 51.461 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 388.984 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.112 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.438 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 787.403 ms (5%) 6.811 ms 169.55 MiB (1%) 582099
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.659 s (5%) 20.322 ms 354.36 MiB (1%) 1228730
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.632 s (5%) 18.079 ms 348.28 MiB (1%) 1218959
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 397.751 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 822.943 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 832.253 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.906 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.463 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.621 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.179 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.447 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.683 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.154 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 719.022 ns (5%)
["pauli", "mul", "20000000"] 205.393 μs (5%)
["stabilizer", "canon", "cano500"] 2.840 ms (5%)
["stabilizer", "canon", "diag_cano500"] 531.009 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.563 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 443.976 μs (5%)
["stabilizer", "canon", "gott500"] 10.746 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.362 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.358 ms (5%)
["stabilizer", "canon", "rref500"] 2.658 ms (5%)
["stabilizer", "project", "destabilizer"] 13.255 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 6.081 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.473 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.899 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.519 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.100 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1975 s 0 s 163 s 7944 s 0 s
 #2 2445 MHz 1982 s 0 s 127 s 7978 s 0 s
 #3 3243 MHz 2123 s 0 s 147 s 7810 s 0 s
 #4 3215 MHz 2471 s 0 s 152 s 7460 s 0 s
 Memory: 15.606491088867188 GB (13604.3203125 MB free)
 Uptime: 1013.19 sec
 Load Avg: 1.0 1.01 0.72
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 18 Nov 2024 - 8:42
  • Package commit: ce1dc0
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.982 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.210 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.728 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 190.444 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.263 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.621 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.261 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.188 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 58.519 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 160.538 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.026 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.891 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.456 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.410 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.023 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.680 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.139 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.212 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 123.800 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 978.833 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.012 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.513 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 813.734 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.027 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.093 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.363 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 27.371 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.483 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.015 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.518 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.483 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.017 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.410 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.291 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.150 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.038 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.648 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.344 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.608 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.334 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.698 ms (5%) 1.38 MiB (1%) 22239
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.804 ms (5%) 2.71 MiB (1%) 40036
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.631 ms (5%) 2.91 MiB (1%) 42282
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.286 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 52.142 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.081 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 388.123 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.106 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.433 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 794.809 ms (5%) 6.312 ms 173.32 MiB (1%) 594767
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.638 s (5%) 14.544 ms 347.43 MiB (1%) 1205438
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.663 s (5%) 17.073 ms 351.59 MiB (1%) 1230103
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 399.362 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 823.437 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 833.295 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.843 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.266 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.492 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.160 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.435 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.654 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.054 ns (5%)
["pauli", "mul", "1000"] 18.228 ns (5%)
["pauli", "mul", "100000"] 728.590 ns (5%)
["pauli", "mul", "20000000"] 186.958 μs (5%)
["stabilizer", "canon", "cano500"] 2.847 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.431 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.636 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 443.555 μs (5%)
["stabilizer", "canon", "gott500"] 10.804 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.389 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.356 ms (5%)
["stabilizer", "canon", "rref500"] 2.660 ms (5%)
["stabilizer", "project", "destabilizer"] 13.224 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 6.071 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.513 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.915 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.670 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.109 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3219 MHz 2929 s 0 s 190 s 11029 s 0 s
 #2 3242 MHz 2975 s 0 s 165 s 11015 s 0 s
 #3 2445 MHz 3081 s 0 s 177 s 10889 s 0 s
 #4 2445 MHz 3623 s 0 s 185 s 10341 s 0 s
 Memory: 15.606491088867188 GB (13477.13671875 MB free)
 Uptime: 1420.54 sec
 Load Avg: 1.0 1.0 0.83
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 18 Nov 2024 - 08:35
  • Baseline: 18 Nov 2024 - 08:42
  • Package commits:
  • Target: 1c31bd
  • Baseline: ce1dc0
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.88 (5%) ✅ 0.95 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.99 (5%) 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.01 (5%) 1.02 (1%) ❌
["pauli", "mul", "20000000"] 1.10 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1975 s 0 s 163 s 7944 s 0 s
 #2 2445 MHz 1982 s 0 s 127 s 7978 s 0 s
 #3 3243 MHz 2123 s 0 s 147 s 7810 s 0 s
 #4 3215 MHz 2471 s 0 s 152 s 7460 s 0 s
 Memory: 15.606491088867188 GB (13604.3203125 MB free)
 Uptime: 1013.19 sec
 Load Avg: 1.0 1.01 0.72
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3219 MHz 2929 s 0 s 190 s 11029 s 0 s
 #2 3242 MHz 2975 s 0 s 165 s 11015 s 0 s
 #3 2445 MHz 3081 s 0 s 177 s 10889 s 0 s
 #4 2445 MHz 3623 s 0 s 185 s 10341 s 0 s
 Memory: 15.606491088867188 GB (13477.13671875 MB free)
 Uptime: 1420.54 sec
 Load Avg: 1.0 1.0 0.83
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 18 Nov 2024 - 8:35
  • Package commit: 1c31bd
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.998 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.232 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.718 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 189.693 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.164 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.782 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.169 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.278 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 61.184 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 160.729 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.042 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.142 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.706 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 151.853 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.037 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.703 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.159 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.213 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.814 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 995.863 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.010 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.520 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 813.605 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.098 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 49.432 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.343 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 27.311 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.473 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.018 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.517 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.734 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.098 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.414 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.863 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.152 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.157 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.649 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.344 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.628 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.325 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.698 ms (5%) 1.37 MiB (1%) 22207
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.763 ms (5%) 2.71 MiB (1%) 39980
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.090 ms (5%) 2.77 MiB (1%) 40402
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.286 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 50.951 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 51.461 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 388.984 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.112 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.438 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 787.403 ms (5%) 6.811 ms 169.55 MiB (1%) 582099
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.659 s (5%) 20.322 ms 354.36 MiB (1%) 1228730
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.632 s (5%) 18.079 ms 348.28 MiB (1%) 1218959
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 397.751 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 822.943 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 832.253 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.906 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.463 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.621 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.179 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.447 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.683 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.154 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 719.022 ns (5%)
["pauli", "mul", "20000000"] 205.393 μs (5%)
["stabilizer", "canon", "cano500"] 2.840 ms (5%)
["stabilizer", "canon", "diag_cano500"] 531.009 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.563 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 443.976 μs (5%)
["stabilizer", "canon", "gott500"] 10.746 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.362 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.358 ms (5%)
["stabilizer", "canon", "rref500"] 2.658 ms (5%)
["stabilizer", "project", "destabilizer"] 13.255 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 6.081 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.473 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.899 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.519 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.100 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1975 s 0 s 163 s 7944 s 0 s
 #2 2445 MHz 1982 s 0 s 127 s 7978 s 0 s
 #3 3243 MHz 2123 s 0 s 147 s 7810 s 0 s
 #4 3215 MHz 2471 s 0 s 152 s 7460 s 0 s
 Memory: 15.606491088867188 GB (13604.3203125 MB free)
 Uptime: 1013.19 sec
 Load Avg: 1.0 1.01 0.72
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 18 Nov 2024 - 8:42
  • Package commit: ce1dc0
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.982 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.210 ms (5%) 281.25 KiB (1%) 6000
`["circuitsim", "...[Comment body truncated]

@codecov Codecov
Copy link

codecov bot commented Nov 18, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.16%. Comparing base (ce1dc02) to head (0b0e0ef).

Additional details and impacted files 
@@            Coverage Diff             @@
##           master     #428      +/-   ##
==========================================
+ Coverage   83.08%   87.16%   +4.07%     
==========================================
  Files          71       51      -20     
  Lines        4565     4012     -553     
==========================================
- Hits         3793     3497     -296     
+ Misses        772      515     -257

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
0 participants