You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Kvrouter that will increase the kv-cache hits in case of multiple routing strategy#2965
Open
Narsil wants to merge 7 commits intomainhuggingface/text-generation-inference:mainfrom kvrouterhuggingface/text-generation-inference:kvrouterCopy head branch name to clipboard
