Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configure server log level #495

Open
sedletsky-f5 opened this issue Jun 19, 2024 · 2 comments
Open

Configure server log level #495

sedletsky-f5 opened this issue Jun 19, 2024 · 2 comments
Assignees

Comments

@sedletsky-f5
Copy link

sedletsky-f5 commented Jun 19, 2024

Please add one or more params to control logs from RESTful API server - namely in mii.serve() function.
You can see as reference -log- config params in vLLM: https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#command-line-arguments-for-the-server

It is especially important at startup, when there is a huge amount of logs (from several processes).

@loadams
Copy link
Contributor

loadams commented Jul 1, 2024

Hi @sedletsky-f5 - we will try to prioritize this, in the meantime, if you are able or willing, would you consider making a PR and we can review and get it merged?

@loadams loadams self-assigned this Jul 1, 2024
@sedletsky-f5
Copy link
Author

thanks @loadams , I will wait for you implementation (I didn't get into the code to make this change)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants