Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

部署glm-4v-9b模型后,模型可以加载但是无法进行对话,报[address=0.0.0.0:33271, pid=892267] ChatGLM4Tokenizer._pad() got an unexpected keyword argument 'padding_side' #2523

Open
1 of 3 tasks
GengyuXu opened this issue Nov 5, 2024 · 0 comments
Milestone

Comments

@GengyuXu
Copy link

GengyuXu commented Nov 5, 2024

System Info / 系統信息

jetson agx orin

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

0.16.1

The command used to start Xinference / 用以启动 xinference 的命令

XINFERENCE_HOME=/mnt/data/xinference_data XINFERENCE_MODEL_SRC=modelscope xinference-local --host 0.0.0.0 --port 9997

Reproduction / 复现过程

image

Expected behavior / 期待表现

能够进行正常的对话

@XprobeBot XprobeBot added this to the v0.16 milestone Nov 5, 2024
@GengyuXu GengyuXu changed the title 部署glm-4v-9b模型后,模型可以加载但是无法 部署glm-4v-9b模型后,模型可以加载但是无法进行对话,报[address=0.0.0.0:33271, pid=892267] ChatGLM4Tokenizer._pad() got an unexpected keyword argument 'padding_side' Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants