You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Unable to run some of the models available on TabbyML huggingface.
Reproducible examples:
# TabbyML/J-350M fails
docker run tabbyml/tabby:0.5.5 serve --model TabbyML/J-350M
# TabbyML/T5P-220M fails
docker run tabbyml/tabby:0.5.5 serve --model TabbyML/T5P-220M
# TabbyML/StarCoder-1B works just fine
docker run tabbyml/tabby:0.5.5 serve --model TabbyML/StarCoder-1B
Information about your version
Tabby 0.5.5, using the docker-container tabbyml/tabby:0.5.5.
Information about your GPU
No GPU, just CPU.
Additional context
Setting RUST_BACKTRACE=1 yields the following stacktrace for T5P-220M. J-350M yields an identical error.
If you're interested in using a customized model in tabby, please refer the How can I convert my own model for use with Tabby? in https://tabby.tabbyml.com/docs/faq
Describe the bug
Unable to run some of the models available on TabbyML huggingface.
Reproducible examples:
Information about your version
Tabby 0.5.5, using the docker-container
tabbyml/tabby:0.5.5
.Information about your GPU
No GPU, just CPU.
Additional context
Setting
RUST_BACKTRACE=1
yields the following stacktrace for T5P-220M. J-350M yields an identical error.The text was updated successfully, but these errors were encountered: