You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi @sedletsky-f5 - we will try to prioritize this, in the meantime, if you are able or willing, would you consider making a PR and we can review and get it merged?
Please add one or more params to control logs from RESTful API server - namely in
mii.serve()
function.You can see as reference
-log-
config params in vLLM: https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#command-line-arguments-for-the-serverIt is especially important at startup, when there is a huge amount of logs (from several processes).
The text was updated successfully, but these errors were encountered: