You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
GengyuXu
changed the title
部署glm-4v-9b模型后,模型可以加载但是无法
部署glm-4v-9b模型后,模型可以加载但是无法进行对话,报[address=0.0.0.0:33271, pid=892267] ChatGLM4Tokenizer._pad() got an unexpected keyword argument 'padding_side'
Nov 5, 2024
System Info / 系統信息
jetson agx orin
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
Version info / 版本信息
0.16.1
The command used to start Xinference / 用以启动 xinference 的命令
XINFERENCE_HOME=/mnt/data/xinference_data XINFERENCE_MODEL_SRC=modelscope xinference-local --host 0.0.0.0 --port 9997
Reproduction / 复现过程
Expected behavior / 期待表现
能够进行正常的对话
The text was updated successfully, but these errors were encountered: