Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] qwen2.5 是否可以支持tool_calls传入? #2610

Open
akai-shuuichi opened this issue Oct 17, 2024 · 2 comments
Open

[Feature] qwen2.5 是否可以支持tool_calls传入? #2610

akai-shuuichi opened this issue Oct 17, 2024 · 2 comments

Comments

@akai-shuuichi
Copy link

Motivation

传入tools参数后服务无法按照预期返回,我是否可以根据https://github.com/InternLM/lmdeploy/pull/2147/files 这个例子尝试支持qwen2.5的工具调用?

Related resources

No response

Additional context

No response

@lvhan028
Copy link
Collaborator

可以参考 PR #2147 #2123
非常欢迎能给 lmdeploy 提交 pr,支持 qwen2 的 tools calling

@songyinghao
Copy link

可以脱离lmdeploy实现的,2.5的函数调用依然是 基于system\user\assistant实现的。自己解析tool_call和tool_response既可

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants