You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Infinity engine supports using a local path so maybe we could make PVC work not only for VLLM.
Also in the past I have implemented a similar solution for standalone Ollama, involving mounting a Persistent Volume Claim (PVC) within the default Ollama download directory to persist model downloads.
This approach could potentially be adapted for both Ollama and Infinity engines within the Kubeai environment.
The text was updated successfully, but these errors were encountered:
Infinity engine supports using a local path so maybe we could make PVC work not only for VLLM.
Also in the past I have implemented a similar solution for standalone Ollama, involving mounting a Persistent Volume Claim (PVC) within the default Ollama download directory to persist model downloads.
This approach could potentially be adapted for both Ollama and Infinity engines within the Kubeai environment.
The text was updated successfully, but these errors were encountered: