Skip to content

v0.1.0
Compare
Choose a tag to compare
@mobicham mobicham released this 19 Sep 11:24
· 184 commits to master since this release
0.1.0
4690460
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Triton Kernels

  • A16W8 (GEMV + GEMM) - with grouping
  • A16W4 (GEMV + GEMM) - with grouping
  • A16W2 (GEMV + GEMM) - with grouping
  • A16W1 (GEMV + GEMM) - with grouping

CUDA Kernels

  • A16W8 (GEMV - batch-size=1) - no grouping
  • A16W4 (GEMV - batch-size=1) - no grouping
  • A16W2 (GEMV - batch-size=1) - no grouping
  • A8W8 (GEMV - batch-size=1) - no grouping
  • A8W4 (GEMV - batch-size=1) - no grouping
  • A8W2 (GEMV - batch-size=1) - no grouping
Assets 2
Loading