You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Having spent two days figuring out why my source builds (GH200) for sglang v0.4.1 and flashinfer (0.1.6 and 0.2.0) doesn't work i found out that public wheel release of 0.1.6 is not corresponding with git taged version 0.1.6
sglang requires gemma_fused_add_rmsnorm and gemma_rmsnorm kernels which are not not available in 0.1.6 tag, but they are present in released wheels.
Dear FlashInfer team
Having spent two days figuring out why my source builds (GH200) for sglang v0.4.1 and flashinfer (0.1.6 and 0.2.0) doesn't work i found out that public wheel release of 0.1.6 is not corresponding with git taged version 0.1.6
sglang requires gemma_fused_add_rmsnorm and gemma_rmsnorm kernels which are not not available in 0.1.6 tag, but they are present in released wheels.
wheels were based on ac41d1b instead of 9ee26e7 (tag)
This is very confusing for people builing code from sources.
Please consider fixing tags ang keeping release versioning consistent with tags
Lukasz Flis
The text was updated successfully, but these errors were encountered: