From 0352e98e7d18c206bd0c57b0b830d3e5f952e7b7 Mon Sep 17 00:00:00 2001 From: simon-mo Date: Thu, 25 Jul 2024 17:09:46 -0700 Subject: [PATCH] Add db and snow --- 2024/07/25/lfai-perf.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/2024/07/25/lfai-perf.html b/2024/07/25/lfai-perf.html index 0fbce8f..453f7f9 100644 --- a/2024/07/25/lfai-perf.html +++ b/2024/07/25/lfai-perf.html @@ -48,7 +48,7 @@

Future of vLLM is Open

We are excited to see vLLM is becoming the standard for LLM inference and serving. In the recent Meta Llama 3.1 announcement, 8 out of 10 official partners for real time inference run vLLM as the serving engine for the Llama 3.1 models. We have also heard anecdotally that vLLM is being used in many of the AI features in our daily life.

-

We believe vLLM’s success comes from the power of the strong open source community. vLLM is actively maintained by a consortium of groups such as UC Berkeley, Anyscale, AWS, CentML, IBM, Neural Magic, Roblox, and others. To this extent, we want to ensure the ownership and governance of the project is open and transparent as well.

+

We believe vLLM’s success comes from the power of the strong open source community. vLLM is actively maintained by a consortium of groups such as UC Berkeley, Anyscale, AWS, CentML, Databricks, IBM, Neural Magic, Roblox, Snowflake, and others. To this extent, we want to ensure the ownership and governance of the project is open and transparent as well.

We are excited to announce that vLLM has started the incubation process into LF AI & Data Foundation. This means no one party will have exclusive control over the future of vLLM. The license and trademark will be irrevocably open. You can trust vLLM is here to stay and will be actively maintained and improved going forward.