New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

使用deepspeed lora 4bit 微调完，如何多卡4bit推理呢？ #64

Open

Baitlo opened this issue Feb 14, 2025 · 0 comments

Baitlo commented Feb 14, 2025

可以给一个deepspeed lora 4bit 微调完的推理脚本吗？

順頌時祺～

Baitlo changed the title ~~使用deepspeed lora 4bit 微调完，如何推理呢？~~ 使用deepspeed lora 4bit 微调完，如何多卡4bit推理呢？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment