Pinned Loading

1. vllm-gptq vllm-gptq Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 129 15

2. exl2-for-all exl2-for-all Public

   EXL2 quantization generalized to other models.

   Python 8 2

3. QuIP-for-all QuIP-for-all Public

   QuIP quantization

   Python 46 5

4. llama-cpp-torch llama-cpp-torch Public

   llama.cpp to PyTorch Converter

   Cuda 26 5