Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

大佬，这个项目还更新吗？或者有啥平替的项目吗 #318

Open
FreeRotate opened this issue Feb 7, 2025 · 3 comments
Open

大佬，这个项目还更新吗？或者有啥平替的项目吗 #318

FreeRotate opened this issue Feb 7, 2025 · 3 comments

Comments

@FreeRotate
Copy link
Contributor

FreeRotate commented Feb 7, 2025 •
edited
Loading

No description provided.

@xusenlinzy
Copy link
Owner

应该不更新了，推荐使用gpustack来部署和管理模型

@FreeRotate
Copy link
Contributor Author

应该不更新了，推荐使用gpustack来部署和管理模型

好吧，我之前也commit过这个项目，但是模型和vllm版本更新太快了，两者不适配的问题频发，用爱发电确实难以为继哈哈哈

@xusenlinzy
Copy link
Owner

gpustack现在支持指定vllm具体版本了，可以试试~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@FreeRotate @xusenlinzy