New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

openai_api_server接收请求报错：Unexpected keyword argument 'use_beam_search' #663

Open

1 of 2 tasks

hoofungson opened this issue Nov 27, 2024 · 1 comment

Assignees

hoofungson commented Nov 27, 2024

System Info / 系統信息

运行环境：nvidia/cuda:12.4.1-cudnn-devel-ubuntu22.04

Who can help? / 谁可以帮助到您？

@

Information / 问题信息

The official example scripts / 官方的示例脚本
My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

1、运行openai_api_server.py；
2、运行openai_api_request.py；

Expected behavior / 期待表现

openai_api_server响应AI对话内容。

Collaborator

sixsixcoder commented Nov 28, 2024 •

edited

Loading

在源代码中删除该字段即可use_beam_search，另外，您是否使用的最新仓库代码，最新的仓库代码中已经修复了这个bug

sixsixcoder self-assigned this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment