Pinned Loading

1. InftyAI/Awesome-LLMOps InftyAI/Awesome-LLMOps Public

   🎉 An awesome & curated list of best LLMOps tools.

   40 10

2. InftyAI/llmaz InftyAI/llmaz Public

   ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

   Go 65 11

3. InftyAI/Manta InftyAI/Manta Public

   💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

   Go 20 2

4. InftyAI/llmchat InftyAI/llmchat Public

   ChatUI for LLMs on llmaz.

   Python 3 5

5. InftyAI/omnistore InftyAI/omnistore Public

   🎯 An unified python client to communicate with various kinds of object-store providers.

   Python 2 2

6. InftyAI/PUMA InftyAI/PUMA Public

   Aim to be a lightweight, high-performance inference engine for heterogeneous devices. WIP.

   Rust 1