Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Broken pipe error #1160

Open
Asherathe opened this issue Oct 13, 2024 · 2 comments
Open

Broken pipe error #1160

Asherathe opened this issue Oct 13, 2024 · 2 comments

Comments

@Asherathe
Copy link

When using RisuAI 136.0.1 as the frontend with a Yi 34B based model, text generation will cut off after around 400-500 tokens. Terminal shows the error message: "Token streaming was interrupted or aborted! [Errno 32] Broken pipe". Streaming is enabled in Risu, max response tokens is set to 4096, and API selected is OpenAI-compatible.

Kobold.cpp is version 1.76 (although this also happened with the previous version), started with the command line "./koboldcpp-linux-x64-nocuda --usevulkan --gpulayers 24 --threads 7 --contextsize 8192".

On up-to-date openSuse Tumbleweed, i7-12700KF cpu with 32GB DDR4 RAM and AMD RX 6800 card.
@LostRuins
Copy link
Owner

I'm guessing the connection is being closed by the frontend

@Asherathe
Copy link
Author

I'm guessing the connection is being closed by the frontend

Okay, I'll make a bug report there. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@LostRuins @Asherathe