Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deepseek vl2 tiny模型转onnx #85

Open
cjjimmy opened this issue Feb 17, 2025 · 1 comment
Open

deepseek vl2 tiny模型转onnx #85

cjjimmy opened this issue Feb 17, 2025 · 1 comment

Comments

@cjjimmy
Copy link

cjjimmy commented Feb 17, 2025

deepseek vl2 tiny可以转onnx模型吗,按常规的torch.onnx.export方式生成的onnx架构里只有graph,对应的weight data为空。请问该模型转换是有特殊参数设置还是不能成功转换?如可转换,有没有样例?谢谢

@steven9046
Copy link

onnx 最大 2G,你转的这个除了 graph 以外应该还是一堆 weight 文件,你要想把 weight 和 graph 合在一起,就把 transformer 部分切成每一块小于 2G 就可以了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants