"bitsandbytes was compiled without GPU support"

[RedLeader721]

Here's what happens on my RTX 3090 system:
(qlora) PS C:\Users\ron\qlora> git clone https://github.com/georgesung/llm_qlora.git
(qlora) PS C:\Users\ron\qlora> cd llm-qlora
(qlora) PS C:\Users\ron\qlora\llm_qlora> pip install -r requirements.txt
(qlora) PS C:\Users\ron\qlora\llm_qlora> python.exe -V
Python 3.10.12
(qlora) PS C:\Users\ron\qlora\llm_qlora> python train.py configs/open_llama_7b_qlora_uncensored.yaml
C:\Users\ron\miniconda3\lib\site-packages\bitsandbytes\cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
'NoneType' object has no attribute 'cadam32bit_grad_fp32'
ImportError: cannot import name 'BitsAndBytesConfig' from 'transformers'
(C:\Users\ron\miniconda3\lib\site-packages\transformers_init_.py)
(qlora) PS C:\Users\ron\qlora\llm_qlora>

[georgesung]

Looks like an issue with bitsandbytes installation, see this issue: bitsandbytes-foundation/bitsandbytes#112