koboldcpp slows down when the program minimized or run on the background. #1179
-
Hello, everyone. I would like to raise a question also help regarding to my koboldcpp that somehow slows down everytime the program minimized or run before my browser. I used my koboldcpp with an 8B model alongside with SillyTavern. Everytime I requested for generation from the front, everything went okay including the BLAS processing. But when it comes into the generation phase, it always slows down with an exception if I opened my koboldcpp window, it goes normal again until I minimized it or moved back to my browser. I expected this to be my own performance issue and or idling slowdown issue. I usually run koboldcpp by disabling mmap, keep foreground, and runs with 8192 tokens for context size (w/ Context Shift). Can anyone give me at least an explanation for this? I'm looking further for help, thanks!
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Follow up here #1180 |
Beta Was this translation helpful? Give feedback.
Follow up here #1180