Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Port most vLLM kernels to ROCm #1313

Closed
wants to merge 23 commits into from
Closed

Port most vLLM kernels to ROCm #1313

wants to merge 23 commits into from

Commits on Oct 10, 2023

  1. port dtype_float16.cuh and cache_kernels.cu

    @pcmoritz
    pcmoritz committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    43af310 View commit details
    Browse the repository at this point in the history

  2. port dtype_bfloat16.cuh

    @pcmoritz
    pcmoritz committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    cc81866 View commit details
    Browse the repository at this point in the history

  3. port attention_utils.cuh

    @pcmoritz
    pcmoritz committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    475b5e2 View commit details
    Browse the repository at this point in the history

  4. port more kernels

    @pcmoritz
    pcmoritz committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    ddc496c View commit details
    Browse the repository at this point in the history

  5. fix typo

    @pcmoritz
    pcmoritz committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    5eaa7a1 View commit details
    Browse the repository at this point in the history

  6. add cuda_compat.h

    @pcmoritz
    pcmoritz committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    f7273c6 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Merge branch 'main' into port-to-rocm

    @pcmoritz
    pcmoritz authored Oct 16, 2023
    Configuration menu
    Copy the full SHA
    99c3be7 View commit details
    Browse the repository at this point in the history

  2. sync branches

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    f8093dc View commit details
    Browse the repository at this point in the history

  3. update

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    41df689 View commit details
    Browse the repository at this point in the history

  4. update

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    93be9c5 View commit details
    Browse the repository at this point in the history

  5. fixes

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    d96fa3c View commit details
    Browse the repository at this point in the history

  6. cleanup

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    421365b View commit details
    Browse the repository at this point in the history

  7. update

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    06b800e View commit details
    Browse the repository at this point in the history

  8. update

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    2312beb View commit details
    Browse the repository at this point in the history

  9. update

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    2958b39 View commit details
    Browse the repository at this point in the history

  10. fmt

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    3f89734 View commit details
    Browse the repository at this point in the history

  11. cleanup

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    5397a57 View commit details
    Browse the repository at this point in the history

  12. refactor

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    90e02d2 View commit details
    Browse the repository at this point in the history

  13. update

    @pcmoritz
    pcmoritz committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    a420202 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Merge branch 'main' into port-to-rocm

    @pcmoritz
    pcmoritz authored Oct 17, 2023
    Configuration menu
    Copy the full SHA
    b072182 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. detecting rocm and adding flag for compiling

    @iAmir97 @pcmoritz
    iAmir97 authored and pcmoritz committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    2d1e435 View commit details
    Browse the repository at this point in the history

  2. using asm volatile instead of hip api

    @iAmir97 @pcmoritz
    iAmir97 authored and pcmoritz committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    e231b79 View commit details
    Browse the repository at this point in the history

  3. using asm volatile for type casting of f16

    @iAmir97 @pcmoritz
    iAmir97 authored and pcmoritz committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    31bb335 View commit details
    Browse the repository at this point in the history