New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Suggestion] FlexGen support #1

Open

RyutaItabashi opened this issue Feb 27, 2023 · 1 comment

Labels

RyutaItabashi commented Feb 27, 2023

This works brilliantly with webui, however with my limited computational resources I could not get some of the heavier model to work.

So I would really appreciate it if there's any implementation to use FlexGen with this webui. Sorry if there's already any ways to to this.

Thank you!

Owner

Tps-F commented Feb 28, 2023

I'll give it a try once my final exams are over! Thanks for your valuable input!

Tps-F added the enhancement label

Tps-F added this to ToDo

Tps-F moved this to Todo in ToDo

Tps-F moved this from Todo to In Progress in ToDo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment