How do I swap from GPU to CPU? #3126
Replies: 4 comments 2 replies
-
I would also like an answer to this, please. Anybody? |
Beta Was this translation helpful? Give feedback.
-
For llama.cpp you can simply choose not to offload any layers to GPU. If that doesn't work, you can tick the "CPU" checkbox. Then it will use llama.cpp specifically build for CPU |
Beta Was this translation helpful? Give feedback.
-
I chose AMD or rocm. I have an iGPU/APU that I can allocate 16GB RAM to. It should work and be faster than CPU. However, AMD in their greatness make it impossible (at least to me) to use. So I can't use it. |
Beta Was this translation helpful? Give feedback.
-
To uninstall, you can just delete the text-generation-webiu directory. Because it uses a virtual environment, that will delete the application and all of its dependencies too. Again, because of the virtual environment, this deletion shouldn't affect anything else you have installed. Do remember to get any models you've downloaded out of the models subdirectory first, if you want to keep them. Same for chats and character cards etc. that you've downloaded too. |
Beta Was this translation helpful? Give feedback.
-
During setup I chose to use my GPU but now I want to use the CPU. How do I swap from GPU to CPU?
Beta Was this translation helpful? Give feedback.
All reactions